Aug 26 10:07:00 user nova-compute[73572]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code.
Aug 26 10:07:03 user nova-compute[73572]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=73572) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Aug 26 10:07:03 user nova-compute[73572]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=73572) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Aug 26 10:07:03 user nova-compute[73572]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=73572) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Aug 26 10:07:03 user nova-compute[73572]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Aug 26 10:07:03 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:07:03 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.020s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:07:03 user nova-compute[73572]: INFO nova.virt.driver [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] Loading compute driver 'libvirt.LibvirtDriver'
Aug 26 10:07:04 user nova-compute[73572]: INFO nova.compute.provider_config [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] Acquiring lock "singleton_lock" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] Acquired lock "singleton_lock" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] Releasing lock "singleton_lock" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] Full set of CONF: {{(pid=73572) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] ******************************************************************************** {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] Configuration options gathered from: {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] ================================================================================ {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] allow_resize_to_same_host      = True {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] arq_binding_timeout            = 300 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] backdoor_port                  = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] backdoor_socket                = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] block_device_allocate_retries  = 300 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] block_device_allocate_retries_interval = 5 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] cert                           = self.pem {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] compute_monitors               = [] {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] config_dir                     = [] {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] config_drive_format            = iso9660 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] config_source                  = [] {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] console_host                   = user {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] control_exchange               = nova {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] cpu_allocation_ratio           = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] daemon                         = False {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] debug                          = True {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] default_access_ip_network_name = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] default_availability_zone      = nova {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] default_ephemeral_format       = ext4 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] default_green_pool_size        = 1000 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] default_schedule_zone          = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] disk_allocation_ratio          = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] enable_new_services            = True {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] enabled_apis                   = ['osapi_compute'] {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] enabled_ssl_apis               = [] {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] flat_injected                  = False {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] force_config_drive             = False {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] force_raw_images               = True {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] graceful_shutdown_timeout      = 5 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] heal_instance_info_cache_interval = 60 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] host                           = user {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] initial_disk_allocation_ratio  = 1.0 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] initial_ram_allocation_ratio   = 1.0 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] instance_build_timeout         = 0 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] instance_delete_interval       = 300 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] instance_format                = [instance: %(uuid)s]  {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] instance_name_template         = instance-%08x {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] instance_usage_audit           = False {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] instance_usage_audit_period    = month {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] internal_service_availability_zone = internal {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] key                            = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] live_migration_retry_count     = 30 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] log_config_append              = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] log_dir                        = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] log_file                       = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] log_options                    = True {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] log_rotate_interval            = 1 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] log_rotate_interval_type       = days {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] log_rotation_type              = none {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] long_rpc_timeout               = 1800 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] max_concurrent_builds          = 10 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] max_concurrent_live_migrations = 1 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] max_concurrent_snapshots       = 5 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] max_local_block_devices        = 3 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] max_logfile_count              = 30 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] max_logfile_size_mb            = 200 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] maximum_instance_delete_attempts = 5 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] metadata_listen                = 0.0.0.0 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] metadata_listen_port           = 8775 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] metadata_workers               = 3 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] migrate_max_retries            = -1 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] mkisofs_cmd                    = genisoimage {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] my_block_storage_ip            = 10.0.0.210 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] my_ip                          = 10.0.0.210 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] network_allocate_retries       = 0 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] osapi_compute_listen           = 0.0.0.0 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] osapi_compute_listen_port      = 8774 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] osapi_compute_unique_server_name_scope =  {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] osapi_compute_workers          = 3 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] password_length                = 12 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] periodic_enable                = True {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] periodic_fuzzy_delay           = 60 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] pointer_model                  = ps2mouse {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] preallocate_images             = none {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] publish_errors                 = False {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] pybasedir                      = /opt/stack/nova {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] ram_allocation_ratio           = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] rate_limit_burst               = 0 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] rate_limit_except_level        = CRITICAL {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] rate_limit_interval            = 0 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] reboot_timeout                 = 0 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] reclaim_instance_interval      = 0 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] record                         = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] reimage_timeout_per_gb         = 60 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] report_interval                = 120 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] rescue_timeout                 = 0 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] reserved_host_cpus             = 0 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] reserved_host_disk_mb          = 0 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] reserved_host_memory_mb        = 512 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] reserved_huge_pages            = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] resize_confirm_window          = 0 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] resize_fs_using_block_device   = False {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] resume_guests_state_on_host_boot = False {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] rpc_response_timeout           = 60 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] run_external_periodic_tasks    = True {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] running_deleted_instance_action = reap {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] running_deleted_instance_poll_interval = 1800 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] running_deleted_instance_timeout = 0 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] scheduler_instance_sync_interval = 120 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] service_down_time              = 720 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] servicegroup_driver            = db {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] shelved_offload_time           = 0 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] shelved_poll_interval          = 3600 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] shutdown_timeout               = 0 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] source_is_ipv6                 = False {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] ssl_only                       = False {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] state_path                     = /opt/stack/data/nova {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] sync_power_state_interval      = 600 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] sync_power_state_pool_size     = 1000 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] syslog_log_facility            = LOG_USER {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] tempdir                        = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] timeout_nbd                    = 10 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] transport_url                  = **** {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] update_resources_interval      = 0 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] use_cow_images                 = True {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] use_eventlog                   = False {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] use_journal                    = False {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] use_json                       = False {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] use_rootwrap_daemon            = False {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] use_stderr                     = False {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] use_syslog                     = False {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] vcpu_pin_set                   = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] vif_plugging_is_fatal          = False {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] vif_plugging_timeout           = 0 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] virt_mkfs                      = [] {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] volume_usage_poll_interval     = 0 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] watch_log_file                 = False {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] web                            = /usr/share/spice-html5 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] oslo_concurrency.disable_process_locking = False {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] api.auth_strategy              = keystone {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] api.compute_link_prefix        = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] api.dhcp_domain                = novalocal {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] api.enable_instance_password   = True {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] api.glance_link_prefix         = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] api.instance_list_per_project_cells = False {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] api.list_records_by_skipping_down_cells = True {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] api.local_metadata_per_cell    = False {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] api.max_limit                  = 1000 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] api.metadata_cache_expiration  = 15 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] api.neutron_default_tenant_id  = default {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] api.use_forwarded_for          = False {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] api.use_neutron_default_nets   = False {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] api.vendordata_dynamic_targets = [] {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] api.vendordata_jsonfile_path   = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] cache.backend                  = dogpile.cache.memcached {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] cache.backend_argument         = **** {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] cache.config_prefix            = cache.oslo {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] cache.dead_timeout             = 60.0 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] cache.debug_cache_backend      = False {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] cache.enable_retry_client      = False {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] cache.enable_socket_keepalive  = False {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] cache.enabled                  = True {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] cache.expiration_time          = 600 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] cache.hashclient_retry_attempts = 2 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] cache.memcache_dead_retry      = 300 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] cache.memcache_password        =  {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] cache.memcache_pool_maxsize    = 10 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] cache.memcache_sasl_enabled    = False {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] cache.memcache_username        =  {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] cache.proxies                  = [] {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] cache.retry_attempts           = 2 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] cache.retry_delay              = 0.0 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] cache.socket_keepalive_count   = 1 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] cache.socket_keepalive_idle    = 1 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] cache.socket_keepalive_interval = 1 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] cache.tls_allowed_ciphers      = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] cache.tls_cafile               = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] cache.tls_certfile             = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] cache.tls_enabled              = False {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] cache.tls_keyfile              = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] cinder.auth_section            = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] cinder.auth_type               = password {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] cinder.cafile                  = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] cinder.catalog_info            = volumev3::publicURL {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] cinder.certfile                = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] cinder.collect_timing          = False {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] cinder.cross_az_attach         = True {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] cinder.debug                   = False {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] cinder.endpoint_template       = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] cinder.http_retries            = 3 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] cinder.insecure                = False {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] cinder.keyfile                 = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] cinder.os_region_name          = RegionOne {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] cinder.split_loggers           = False {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] cinder.timeout                 = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] compute.cpu_dedicated_set      = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] compute.cpu_shared_set         = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] compute.image_type_exclude_list = [] {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] compute.max_concurrent_disk_ops = 0 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] compute.max_disk_devices_to_attach = -1 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] compute.resource_provider_association_refresh = 300 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] compute.shutdown_retry_interval = 10 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] conductor.workers              = 3 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] console.allowed_origins        = [] {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] console.ssl_ciphers            = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] console.ssl_minimum_version    = default {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] consoleauth.token_ttl          = 600 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] cyborg.cafile                  = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] cyborg.certfile                = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] cyborg.collect_timing          = False {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] cyborg.connect_retries         = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] cyborg.connect_retry_delay     = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] cyborg.endpoint_override       = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] cyborg.insecure                = False {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] cyborg.keyfile                 = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] cyborg.max_version             = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] cyborg.min_version             = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] cyborg.region_name             = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] cyborg.service_name            = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] cyborg.service_type            = accelerator {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] cyborg.split_loggers           = False {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] cyborg.status_code_retries     = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] cyborg.status_code_retry_delay = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] cyborg.timeout                 = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] cyborg.version                 = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] database.backend               = sqlalchemy {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] database.connection            = **** {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] database.connection_debug      = 0 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] database.connection_parameters =  {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] database.connection_recycle_time = 3600 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] database.connection_trace      = False {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] database.db_inc_retry_interval = True {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] database.db_max_retries        = 20 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] database.db_max_retry_interval = 10 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] database.db_retry_interval     = 1 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] database.max_overflow          = 50 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] database.max_pool_size         = 5 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] database.max_retries           = 10 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] database.mysql_enable_ndb      = False {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] database.mysql_wsrep_sync_wait = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] database.pool_timeout          = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] database.retry_interval        = 10 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] database.slave_connection      = **** {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] database.sqlite_synchronous    = True {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] api_database.backend           = sqlalchemy {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] api_database.connection        = **** {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] api_database.connection_debug  = 0 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] api_database.connection_parameters =  {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] api_database.connection_recycle_time = 3600 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] api_database.connection_trace  = False {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] api_database.db_inc_retry_interval = True {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] api_database.db_max_retries    = 20 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] api_database.db_max_retry_interval = 10 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] api_database.db_retry_interval = 1 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] api_database.max_overflow      = 50 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] api_database.max_pool_size     = 5 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] api_database.max_retries       = 10 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] api_database.mysql_enable_ndb  = False {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] api_database.pool_timeout      = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] api_database.retry_interval    = 10 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] api_database.slave_connection  = **** {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] api_database.sqlite_synchronous = True {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] devices.enabled_mdev_types     = [] {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] ephemeral_storage_encryption.enabled = False {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] glance.api_servers             = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] glance.cafile                  = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] glance.certfile                = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] glance.collect_timing          = False {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] glance.connect_retries         = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] glance.connect_retry_delay     = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] glance.debug                   = False {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] glance.default_trusted_certificate_ids = [] {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] glance.enable_certificate_validation = False {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] glance.enable_rbd_download     = False {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] glance.endpoint_override       = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] glance.insecure                = False {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] glance.keyfile                 = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] glance.max_version             = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] glance.min_version             = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] glance.num_retries             = 3 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] glance.rbd_ceph_conf           =  {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] glance.rbd_connect_timeout     = 5 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] glance.rbd_pool                =  {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] glance.rbd_user                =  {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] glance.region_name             = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] glance.service_name            = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] glance.service_type            = image {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] glance.split_loggers           = False {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] glance.status_code_retries     = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] glance.status_code_retry_delay = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] glance.timeout                 = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] glance.verify_glance_signatures = False {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] glance.version                 = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] guestfs.debug                  = False {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] hyperv.config_drive_cdrom      = False {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] hyperv.config_drive_inject_password = False {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] hyperv.enable_instance_metrics_collection = False {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] hyperv.enable_remotefx         = False {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] hyperv.instances_path_share    =  {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] hyperv.iscsi_initiator_list    = [] {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] hyperv.limit_cpu_features      = False {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] hyperv.power_state_check_timeframe = 60 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] hyperv.use_multipath_io        = False {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] hyperv.volume_attach_retry_count = 10 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] hyperv.vswitch_name            = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] mks.enabled                    = False {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] image_cache.manager_interval   = 2400 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] image_cache.precache_concurrency = 1 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] image_cache.remove_unused_base_images = True {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] image_cache.subdirectory_name  = _base {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] ironic.api_max_retries         = 60 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] ironic.api_retry_interval      = 2 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] ironic.auth_section            = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] ironic.auth_type               = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] ironic.cafile                  = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] ironic.certfile                = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] ironic.collect_timing          = False {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] ironic.connect_retries         = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] ironic.connect_retry_delay     = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] ironic.endpoint_override       = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] ironic.insecure                = False {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] ironic.keyfile                 = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] ironic.max_version             = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] ironic.min_version             = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] ironic.partition_key           = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] ironic.peer_list               = [] {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] ironic.region_name             = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] ironic.serial_console_state_timeout = 10 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] ironic.service_name            = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] ironic.service_type            = baremetal {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] ironic.split_loggers           = False {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] ironic.status_code_retries     = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] ironic.status_code_retry_delay = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] ironic.timeout                 = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] ironic.version                 = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] key_manager.fixed_key          = **** {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] barbican.barbican_api_version  = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] barbican.barbican_endpoint     = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] barbican.barbican_endpoint_type = public {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] barbican.barbican_region_name  = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] barbican.cafile                = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] barbican.certfile              = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] barbican.collect_timing        = False {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] barbican.insecure              = False {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] barbican.keyfile               = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] barbican.number_of_retries     = 60 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] barbican.retry_delay           = 1 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] barbican.send_service_user_token = False {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] barbican.split_loggers         = False {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] barbican.timeout               = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] barbican.verify_ssl            = True {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] barbican.verify_ssl_path       = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] barbican_service_user.auth_section = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] barbican_service_user.auth_type = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] barbican_service_user.cafile   = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] barbican_service_user.certfile = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] barbican_service_user.collect_timing = False {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] barbican_service_user.insecure = False {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] barbican_service_user.keyfile  = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] barbican_service_user.split_loggers = False {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] barbican_service_user.timeout  = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] vault.approle_role_id          = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] vault.approle_secret_id        = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] vault.cafile                   = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] vault.certfile                 = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] vault.collect_timing           = False {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] vault.insecure                 = False {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] vault.keyfile                  = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] vault.kv_mountpoint            = secret {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] vault.kv_version               = 2 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] vault.namespace                = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] vault.root_token_id            = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] vault.split_loggers            = False {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] vault.ssl_ca_crt_file          = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] vault.timeout                  = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] vault.use_ssl                  = False {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] keystone.cafile                = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] keystone.certfile              = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] keystone.collect_timing        = False {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] keystone.connect_retries       = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] keystone.connect_retry_delay   = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] keystone.endpoint_override     = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] keystone.insecure              = False {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] keystone.keyfile               = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] keystone.max_version           = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] keystone.min_version           = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] keystone.region_name           = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] keystone.service_name          = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] keystone.service_type          = identity {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] keystone.split_loggers         = False {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] keystone.status_code_retries   = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] keystone.status_code_retry_delay = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] keystone.timeout               = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] keystone.version               = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] libvirt.connection_uri         =  {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] libvirt.cpu_mode               = custom {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] libvirt.cpu_model_extra_flags  = [] {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: WARNING oslo_config.cfg [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] libvirt.cpu_power_governor_high = performance {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] libvirt.cpu_power_governor_low = powersave {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] libvirt.cpu_power_management   = False {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] libvirt.device_detach_attempts = 8 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] libvirt.device_detach_timeout  = 20 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] libvirt.disk_cachemodes        = [] {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] libvirt.disk_prefix            = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] libvirt.enabled_perf_events    = [] {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] libvirt.file_backed_memory     = 0 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] libvirt.gid_maps               = [] {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] libvirt.hw_disk_discard        = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] libvirt.hw_machine_type        = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] libvirt.images_rbd_ceph_conf   =  {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] libvirt.images_rbd_glance_store_name =  {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] libvirt.images_rbd_pool        = rbd {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] libvirt.images_type            = default {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] libvirt.images_volume_group    = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] libvirt.inject_key             = False {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] libvirt.inject_partition       = -2 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] libvirt.inject_password        = False {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] libvirt.iscsi_iface            = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] libvirt.iser_use_multipath     = False {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] libvirt.live_migration_bandwidth = 0 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] libvirt.live_migration_downtime = 500 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] libvirt.live_migration_inbound_addr = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] libvirt.live_migration_permit_post_copy = False {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] libvirt.live_migration_scheme  = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] libvirt.live_migration_timeout_action = abort {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] libvirt.live_migration_tunnelled = False {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: WARNING oslo_config.cfg [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Aug 26 10:07:04 user nova-compute[73572]: live_migration_uri is deprecated for removal in favor of two other options that
Aug 26 10:07:04 user nova-compute[73572]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Aug 26 10:07:04 user nova-compute[73572]: and ``live_migration_inbound_addr`` respectively.
Aug 26 10:07:04 user nova-compute[73572]: ).  Its value may be silently ignored in the future.
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] libvirt.live_migration_with_native_tls = False {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] libvirt.max_queues             = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] libvirt.nfs_mount_options      = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] libvirt.num_iser_scan_tries    = 5 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] libvirt.num_memory_encrypted_guests = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] libvirt.num_pcie_ports         = 0 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] libvirt.num_volume_scan_tries  = 5 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] libvirt.pmem_namespaces        = [] {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] libvirt.quobyte_client_cfg     = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] libvirt.rbd_connect_timeout    = 5 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] libvirt.rbd_secret_uuid        = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] libvirt.rbd_user               = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] libvirt.remote_filesystem_transport = ssh {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] libvirt.rescue_image_id        = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] libvirt.rescue_kernel_id       = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] libvirt.rescue_ramdisk_id      = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] libvirt.rx_queue_size          = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] libvirt.smbfs_mount_options    =  {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] libvirt.snapshot_compression   = False {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] libvirt.snapshot_image_format  = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] libvirt.sparse_logical_volumes = False {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] libvirt.swtpm_enabled          = False {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] libvirt.swtpm_group            = tss {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] libvirt.swtpm_user             = tss {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] libvirt.sysinfo_serial         = unique {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] libvirt.tb_cache_size          = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] libvirt.tx_queue_size          = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] libvirt.uid_maps               = [] {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] libvirt.use_virtio_for_bridges = True {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] libvirt.virt_type              = kvm {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] libvirt.volume_clear           = zero {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] libvirt.volume_clear_size      = 0 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] libvirt.volume_use_multipath   = False {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] libvirt.vzstorage_cache_path   = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] libvirt.vzstorage_mount_group  = qemu {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] libvirt.vzstorage_mount_opts   = [] {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] libvirt.vzstorage_mount_user   = stack {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] neutron.auth_section           = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] neutron.auth_type              = password {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] neutron.cafile                 = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] neutron.certfile               = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] neutron.collect_timing         = False {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] neutron.connect_retries        = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] neutron.connect_retry_delay    = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] neutron.default_floating_pool  = public {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] neutron.endpoint_override      = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] neutron.extension_sync_interval = 600 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] neutron.http_retries           = 3 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] neutron.insecure               = False {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] neutron.keyfile                = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] neutron.max_version            = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] neutron.min_version            = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] neutron.ovs_bridge             = br-int {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] neutron.physnets               = [] {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] neutron.region_name            = RegionOne {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] neutron.service_metadata_proxy = True {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] neutron.service_name           = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] neutron.service_type           = network {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] neutron.split_loggers          = False {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] neutron.status_code_retries    = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] neutron.status_code_retry_delay = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] neutron.timeout                = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] neutron.version                = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] notifications.bdms_in_notifications = False {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] notifications.default_level    = INFO {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] notifications.notification_format = unversioned {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] notifications.notify_on_state_change = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] pci.alias                      = [] {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] pci.device_spec                = [] {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] pci.report_in_placement        = False {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] placement.auth_section         = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] placement.auth_type            = password {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] placement.cafile               = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] placement.certfile             = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] placement.collect_timing       = False {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] placement.connect_retries      = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] placement.connect_retry_delay  = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] placement.default_domain_id    = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] placement.default_domain_name  = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] placement.domain_id            = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] placement.domain_name          = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] placement.endpoint_override    = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] placement.insecure             = False {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] placement.keyfile              = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] placement.max_version          = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] placement.min_version          = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] placement.password             = **** {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] placement.project_domain_id    = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] placement.project_domain_name  = Default {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] placement.project_id           = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] placement.project_name         = service {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] placement.region_name          = RegionOne {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] placement.service_name         = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] placement.service_type         = placement {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] placement.split_loggers        = False {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] placement.status_code_retries  = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] placement.status_code_retry_delay = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] placement.system_scope         = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] placement.timeout              = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] placement.trust_id             = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] placement.user_domain_id       = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] placement.user_domain_name     = Default {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] placement.user_id              = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] placement.username             = placement {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] placement.version              = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] quota.cores                    = 20 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] quota.count_usage_from_placement = False {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] quota.injected_file_content_bytes = 10240 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] quota.injected_file_path_length = 255 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] quota.injected_files           = 5 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] quota.instances                = 10 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] quota.key_pairs                = 100 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] quota.metadata_items           = 128 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] quota.ram                      = 51200 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] quota.recheck_quota            = True {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] quota.server_group_members     = 10 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] quota.server_groups            = 10 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] rdp.enabled                    = False {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] scheduler.image_metadata_prefilter = False {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] scheduler.max_attempts         = 3 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] scheduler.max_placement_results = 1000 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] scheduler.query_placement_for_availability_zone = True {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] scheduler.query_placement_for_image_type_support = False {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] scheduler.workers              = 3 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] filter_scheduler.host_subset_size = 1 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] filter_scheduler.isolated_hosts = [] {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] filter_scheduler.isolated_images = [] {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] filter_scheduler.pci_in_placement = False {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] filter_scheduler.track_instance_changes = False {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] metrics.required               = True {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] metrics.weight_multiplier      = 1.0 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] metrics.weight_setting         = [] {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] serial_console.enabled         = False {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] serial_console.port_range      = 10000:20000 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] serial_console.serialproxy_port = 6083 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] service_user.auth_section      = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] service_user.auth_type         = password {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] service_user.cafile            = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] service_user.certfile          = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] service_user.collect_timing    = False {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] service_user.insecure          = False {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] service_user.keyfile           = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] service_user.send_service_user_token = True {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] service_user.split_loggers     = False {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] service_user.timeout           = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] spice.agent_enabled            = True {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] spice.enabled                  = False {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] spice.html5proxy_port          = 6082 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] spice.image_compression        = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] spice.jpeg_compression         = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] spice.playback_compression     = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] spice.server_listen            = 127.0.0.1 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] spice.streaming_mode           = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] spice.zlib_compression         = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] upgrade_levels.baseapi         = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] upgrade_levels.cert            = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] upgrade_levels.compute         = auto {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] upgrade_levels.conductor       = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] upgrade_levels.scheduler       = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] vendordata_dynamic_auth.auth_section = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] vendordata_dynamic_auth.auth_type = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] vendordata_dynamic_auth.cafile = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] vendordata_dynamic_auth.certfile = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] vendordata_dynamic_auth.insecure = False {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] vendordata_dynamic_auth.keyfile = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] vendordata_dynamic_auth.timeout = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] vmware.api_retry_count         = 10 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] vmware.ca_file                 = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] vmware.cache_prefix            = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] vmware.cluster_name            = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] vmware.connection_pool_size    = 10 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] vmware.console_delay_seconds   = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] vmware.datastore_regex         = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] vmware.host_ip                 = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] vmware.host_password           = **** {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] vmware.host_port               = 443 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] vmware.host_username           = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] vmware.insecure                = False {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] vmware.integration_bridge      = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] vmware.maximum_objects         = 100 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] vmware.pbm_default_policy      = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] vmware.pbm_enabled             = False {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] vmware.pbm_wsdl_location       = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] vmware.serial_port_proxy_uri   = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] vmware.serial_port_service_uri = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] vmware.task_poll_interval      = 0.5 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] vmware.use_linked_clone        = True {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] vmware.vnc_keymap              = en-us {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] vmware.vnc_port                = 5900 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] vmware.vnc_port_total          = 10000 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] vnc.auth_schemes               = ['none'] {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] vnc.enabled                    = True {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] vnc.novncproxy_port            = 6080 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] vnc.server_listen              = 0.0.0.0 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] vnc.vencrypt_ca_certs          = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] vnc.vencrypt_client_cert       = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] vnc.vencrypt_client_key        = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] workarounds.disable_group_policy_check_upcall = True {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] workarounds.disable_rootwrap   = False {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] workarounds.enable_numa_live_migration = False {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] workarounds.libvirt_disable_apic = False {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] wsgi.client_socket_timeout     = 900 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] wsgi.default_pool_size         = 1000 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] wsgi.keep_alive                = True {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] wsgi.max_header_line           = 16384 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] wsgi.secure_proxy_ssl_header   = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] wsgi.ssl_ca_file               = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] wsgi.ssl_cert_file             = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] wsgi.ssl_key_file              = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] wsgi.tcp_keepidle              = 600 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] zvm.ca_file                    = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] zvm.cloud_connector_url        = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] zvm.reachable_timeout          = 300 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] oslo_policy.enforce_new_defaults = True {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] oslo_policy.enforce_scope      = True {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] oslo_policy.policy_default_rule = default {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] oslo_policy.policy_file        = policy.yaml {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] profiler.connection_string     = messaging:// {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] profiler.enabled               = False {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] profiler.es_doc_type           = notification {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] profiler.es_scroll_size        = 10000 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] profiler.es_scroll_time        = 2m {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] profiler.filter_error_trace    = False {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] profiler.hmac_keys             = **** {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] profiler.sentinel_service_name = mymaster {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] profiler.socket_timeout        = 0.1 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] profiler.trace_requests        = False {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] profiler.trace_sqlalchemy      = False {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] profiler_jaeger.process_tags   = {} {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] profiler_jaeger.service_name_prefix = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] profiler_otlp.service_name_prefix = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] remote_debug.host              = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] remote_debug.port              = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] oslo_messaging_rabbit.ssl      = False {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] oslo_messaging_notifications.retry = -1 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] oslo_messaging_notifications.transport_url = **** {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] oslo_limit.auth_section        = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] oslo_limit.auth_type           = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] oslo_limit.cafile              = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] oslo_limit.certfile            = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] oslo_limit.collect_timing      = False {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] oslo_limit.connect_retries     = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] oslo_limit.connect_retry_delay = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] oslo_limit.endpoint_id         = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] oslo_limit.endpoint_override   = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] oslo_limit.insecure            = False {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] oslo_limit.keyfile             = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] oslo_limit.max_version         = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] oslo_limit.min_version         = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] oslo_limit.region_name         = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] oslo_limit.service_name        = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] oslo_limit.service_type        = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] oslo_limit.split_loggers       = False {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] oslo_limit.status_code_retries = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] oslo_limit.status_code_retry_delay = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] oslo_limit.timeout             = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] oslo_limit.valid_interfaces    = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] oslo_limit.version             = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] oslo_reports.file_event_handler = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] oslo_reports.log_dir           = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] vif_plug_linux_bridge_privileged.group = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] vif_plug_linux_bridge_privileged.user = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] vif_plug_ovs_privileged.group  = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] vif_plug_ovs_privileged.helper_command = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] vif_plug_ovs_privileged.user   = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] os_vif_linux_bridge.flat_interface = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] os_vif_linux_bridge.vlan_interface = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] os_vif_ovs.isolate_vif         = False {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] os_vif_ovs.ovsdb_interface     = native {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] os_vif_ovs.per_port_bridge     = False {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] os_brick.lock_path             = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] privsep_osbrick.capabilities   = [21] {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] privsep_osbrick.group          = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] privsep_osbrick.helper_command = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] privsep_osbrick.user           = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] nova_sys_admin.group           = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] nova_sys_admin.helper_command  = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] nova_sys_admin.thread_pool_size = 12 {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] nova_sys_admin.user            = None {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG oslo_service.service [None req-8b7d9147-906e-44ed-b435-8881b1e95925 None None] ******************************************************************************** {{(pid=73572) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Aug 26 10:07:04 user nova-compute[73572]: INFO nova.service [-] Starting compute node (version 0.0.0)
Aug 26 10:07:04 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Starting native event thread {{(pid=73572) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Starting green dispatch thread {{(pid=73572) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Starting connection event dispatch thread {{(pid=73572) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:501}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Connecting to libvirt: qemu:///system {{(pid=73572) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:506}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7fc8c05ae7a0> {{(pid=73572) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:512}}
Aug 26 10:07:04 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7fc8c05ae7a0> {{(pid=73572) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:533}}
Aug 26 10:07:04 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Connection event '1' reason 'None'
Aug 26 10:07:04 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Aug 26 10:07:04 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.mount [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Initialising _HostMountState generation 0 {{(pid=73572) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Aug 26 10:07:11 user nova-compute[73572]: INFO nova.virt.libvirt.host [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Libvirt host capabilities <capabilities>
Aug 26 10:07:11 user nova-compute[73572]:   <host>
Aug 26 10:07:11 user nova-compute[73572]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Aug 26 10:07:11 user nova-compute[73572]:     <cpu>
Aug 26 10:07:11 user nova-compute[73572]:       <arch>x86_64</arch>
Aug 26 10:07:11 user nova-compute[73572]:       <model>IvyBridge-IBRS</model>
Aug 26 10:07:11 user nova-compute[73572]:       <vendor>Intel</vendor>
Aug 26 10:07:11 user nova-compute[73572]:       <microcode version='1070'/>
Aug 26 10:07:11 user nova-compute[73572]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Aug 26 10:07:11 user nova-compute[73572]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Aug 26 10:07:11 user nova-compute[73572]:       <feature name='ss'/>
Aug 26 10:07:11 user nova-compute[73572]:       <feature name='vmx'/>
Aug 26 10:07:11 user nova-compute[73572]:       <feature name='pcid'/>
Aug 26 10:07:11 user nova-compute[73572]:       <feature name='osxsave'/>
Aug 26 10:07:11 user nova-compute[73572]:       <feature name='hypervisor'/>
Aug 26 10:07:11 user nova-compute[73572]:       <feature name='arat'/>
Aug 26 10:07:11 user nova-compute[73572]:       <feature name='tsc_adjust'/>
Aug 26 10:07:11 user nova-compute[73572]:       <feature name='md-clear'/>
Aug 26 10:07:11 user nova-compute[73572]:       <feature name='stibp'/>
Aug 26 10:07:11 user nova-compute[73572]:       <feature name='arch-capabilities'/>
Aug 26 10:07:11 user nova-compute[73572]:       <feature name='ssbd'/>
Aug 26 10:07:11 user nova-compute[73572]:       <feature name='invtsc'/>
Aug 26 10:07:11 user nova-compute[73572]:       <feature name='rsba'/>
Aug 26 10:07:11 user nova-compute[73572]:       <feature name='skip-l1dfl-vmentry'/>
Aug 26 10:07:11 user nova-compute[73572]:       <pages unit='KiB' size='4'/>
Aug 26 10:07:11 user nova-compute[73572]:       <pages unit='KiB' size='2048'/>
Aug 26 10:07:11 user nova-compute[73572]:     </cpu>
Aug 26 10:07:11 user nova-compute[73572]:     <power_management>
Aug 26 10:07:11 user nova-compute[73572]:       <suspend_mem/>
Aug 26 10:07:11 user nova-compute[73572]:       <suspend_disk/>
Aug 26 10:07:11 user nova-compute[73572]:       <suspend_hybrid/>
Aug 26 10:07:11 user nova-compute[73572]:     </power_management>
Aug 26 10:07:11 user nova-compute[73572]:     <iommu support='no'/>
Aug 26 10:07:11 user nova-compute[73572]:     <migration_features>
Aug 26 10:07:11 user nova-compute[73572]:       <live/>
Aug 26 10:07:11 user nova-compute[73572]:       <uri_transports>
Aug 26 10:07:11 user nova-compute[73572]:         <uri_transport>tcp</uri_transport>
Aug 26 10:07:11 user nova-compute[73572]:         <uri_transport>rdma</uri_transport>
Aug 26 10:07:11 user nova-compute[73572]:       </uri_transports>
Aug 26 10:07:11 user nova-compute[73572]:     </migration_features>
Aug 26 10:07:11 user nova-compute[73572]:     <topology>
Aug 26 10:07:11 user nova-compute[73572]:       <cells num='2'>
Aug 26 10:07:11 user nova-compute[73572]:         <cell id='0'>
Aug 26 10:07:11 user nova-compute[73572]:           <memory unit='KiB'>8140616</memory>
Aug 26 10:07:11 user nova-compute[73572]:           <pages unit='KiB' size='4'>2035154</pages>
Aug 26 10:07:11 user nova-compute[73572]:           <pages unit='KiB' size='2048'>0</pages>
Aug 26 10:07:11 user nova-compute[73572]:           <distances>
Aug 26 10:07:11 user nova-compute[73572]:             <sibling id='0' value='10'/>
Aug 26 10:07:11 user nova-compute[73572]:             <sibling id='1' value='20'/>
Aug 26 10:07:11 user nova-compute[73572]:           </distances>
Aug 26 10:07:11 user nova-compute[73572]:           <cpus num='6'>
Aug 26 10:07:11 user nova-compute[73572]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Aug 26 10:07:11 user nova-compute[73572]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Aug 26 10:07:11 user nova-compute[73572]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Aug 26 10:07:11 user nova-compute[73572]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Aug 26 10:07:11 user nova-compute[73572]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Aug 26 10:07:11 user nova-compute[73572]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Aug 26 10:07:11 user nova-compute[73572]:           </cpus>
Aug 26 10:07:11 user nova-compute[73572]:         </cell>
Aug 26 10:07:11 user nova-compute[73572]:         <cell id='1'>
Aug 26 10:07:11 user nova-compute[73572]:           <memory unit='KiB'>8255068</memory>
Aug 26 10:07:11 user nova-compute[73572]:           <pages unit='KiB' size='4'>2063767</pages>
Aug 26 10:07:11 user nova-compute[73572]:           <pages unit='KiB' size='2048'>0</pages>
Aug 26 10:07:11 user nova-compute[73572]:           <distances>
Aug 26 10:07:11 user nova-compute[73572]:             <sibling id='0' value='20'/>
Aug 26 10:07:11 user nova-compute[73572]:             <sibling id='1' value='10'/>
Aug 26 10:07:11 user nova-compute[73572]:           </distances>
Aug 26 10:07:11 user nova-compute[73572]:           <cpus num='6'>
Aug 26 10:07:11 user nova-compute[73572]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Aug 26 10:07:11 user nova-compute[73572]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Aug 26 10:07:11 user nova-compute[73572]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Aug 26 10:07:11 user nova-compute[73572]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Aug 26 10:07:11 user nova-compute[73572]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Aug 26 10:07:11 user nova-compute[73572]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Aug 26 10:07:11 user nova-compute[73572]:           </cpus>
Aug 26 10:07:11 user nova-compute[73572]:         </cell>
Aug 26 10:07:11 user nova-compute[73572]:       </cells>
Aug 26 10:07:11 user nova-compute[73572]:     </topology>
Aug 26 10:07:11 user nova-compute[73572]:     <cache>
Aug 26 10:07:11 user nova-compute[73572]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Aug 26 10:07:11 user nova-compute[73572]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Aug 26 10:07:11 user nova-compute[73572]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Aug 26 10:07:11 user nova-compute[73572]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Aug 26 10:07:11 user nova-compute[73572]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Aug 26 10:07:11 user nova-compute[73572]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Aug 26 10:07:11 user nova-compute[73572]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Aug 26 10:07:11 user nova-compute[73572]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Aug 26 10:07:11 user nova-compute[73572]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Aug 26 10:07:11 user nova-compute[73572]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Aug 26 10:07:11 user nova-compute[73572]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Aug 26 10:07:11 user nova-compute[73572]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Aug 26 10:07:11 user nova-compute[73572]:     </cache>
Aug 26 10:07:11 user nova-compute[73572]:     <secmodel>
Aug 26 10:07:11 user nova-compute[73572]:       <model>apparmor</model>
Aug 26 10:07:11 user nova-compute[73572]:       <doi>0</doi>
Aug 26 10:07:11 user nova-compute[73572]:     </secmodel>
Aug 26 10:07:11 user nova-compute[73572]:     <secmodel>
Aug 26 10:07:11 user nova-compute[73572]:       <model>dac</model>
Aug 26 10:07:11 user nova-compute[73572]:       <doi>0</doi>
Aug 26 10:07:11 user nova-compute[73572]:       <baselabel type='kvm'>+64055:+108</baselabel>
Aug 26 10:07:11 user nova-compute[73572]:       <baselabel type='qemu'>+64055:+108</baselabel>
Aug 26 10:07:11 user nova-compute[73572]:     </secmodel>
Aug 26 10:07:11 user nova-compute[73572]:   </host>
Aug 26 10:07:11 user nova-compute[73572]:   <guest>
Aug 26 10:07:11 user nova-compute[73572]:     <os_type>hvm</os_type>
Aug 26 10:07:11 user nova-compute[73572]:     <arch name='alpha'>
Aug 26 10:07:11 user nova-compute[73572]:       <wordsize>64</wordsize>
Aug 26 10:07:11 user nova-compute[73572]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='4'>clipper</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <domain type='qemu'/>
Aug 26 10:07:11 user nova-compute[73572]:     </arch>
Aug 26 10:07:11 user nova-compute[73572]:     <features>
Aug 26 10:07:11 user nova-compute[73572]:       <cpuselection/>
Aug 26 10:07:11 user nova-compute[73572]:       <deviceboot/>
Aug 26 10:07:11 user nova-compute[73572]:       <disksnapshot default='on' toggle='no'/>
Aug 26 10:07:11 user nova-compute[73572]:     </features>
Aug 26 10:07:11 user nova-compute[73572]:   </guest>
Aug 26 10:07:11 user nova-compute[73572]:   <guest>
Aug 26 10:07:11 user nova-compute[73572]:     <os_type>hvm</os_type>
Aug 26 10:07:11 user nova-compute[73572]:     <arch name='armv6l'>
Aug 26 10:07:11 user nova-compute[73572]:       <wordsize>32</wordsize>
Aug 26 10:07:11 user nova-compute[73572]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>integratorcp</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>borzoi</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>spitz</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='2'>nuri</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='2'>musca-b1</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>versatileab</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>kzm</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='2'>musca-a</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='2'>smdkc210</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>sx1</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>z2</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>tosa</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='4'>sabrelite</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>realview-eb</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>n810</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>n800</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>versatilepb</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>terrier</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>mainstone</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='4'>midway</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>musicpal</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>microbit</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>cubieboard</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>verdex</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>netduino2</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='4'>raspi2b</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>cheetah</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='4'>highbank</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>akita</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>connex</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>collie</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>raspi0</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <domain type='qemu'/>
Aug 26 10:07:11 user nova-compute[73572]:     </arch>
Aug 26 10:07:11 user nova-compute[73572]:     <features>
Aug 26 10:07:11 user nova-compute[73572]:       <cpuselection/>
Aug 26 10:07:11 user nova-compute[73572]:       <deviceboot/>
Aug 26 10:07:11 user nova-compute[73572]:       <disksnapshot default='on' toggle='no'/>
Aug 26 10:07:11 user nova-compute[73572]:     </features>
Aug 26 10:07:11 user nova-compute[73572]:   </guest>
Aug 26 10:07:11 user nova-compute[73572]:   <guest>
Aug 26 10:07:11 user nova-compute[73572]:     <os_type>hvm</os_type>
Aug 26 10:07:11 user nova-compute[73572]:     <arch name='armv7l'>
Aug 26 10:07:11 user nova-compute[73572]:       <wordsize>32</wordsize>
Aug 26 10:07:11 user nova-compute[73572]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>integratorcp</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>borzoi</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>spitz</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='2'>nuri</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='2'>musca-b1</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>versatileab</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>kzm</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='2'>musca-a</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='2'>smdkc210</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>sx1</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>z2</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>tosa</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='4'>sabrelite</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>realview-eb</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>n810</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>n800</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>versatilepb</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>terrier</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>mainstone</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='4'>midway</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>musicpal</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>microbit</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>cubieboard</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>verdex</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>netduino2</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='4'>raspi2b</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>cheetah</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='4'>highbank</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>akita</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>connex</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>collie</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>raspi0</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <domain type='qemu'/>
Aug 26 10:07:11 user nova-compute[73572]:     </arch>
Aug 26 10:07:11 user nova-compute[73572]:     <features>
Aug 26 10:07:11 user nova-compute[73572]:       <cpuselection/>
Aug 26 10:07:11 user nova-compute[73572]:       <deviceboot/>
Aug 26 10:07:11 user nova-compute[73572]:       <disksnapshot default='on' toggle='no'/>
Aug 26 10:07:11 user nova-compute[73572]:     </features>
Aug 26 10:07:11 user nova-compute[73572]:   </guest>
Aug 26 10:07:11 user nova-compute[73572]:   <guest>
Aug 26 10:07:11 user nova-compute[73572]:     <os_type>hvm</os_type>
Aug 26 10:07:11 user nova-compute[73572]:     <arch name='aarch64'>
Aug 26 10:07:11 user nova-compute[73572]:       <wordsize>64</wordsize>
Aug 26 10:07:11 user nova-compute[73572]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>integratorcp</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>borzoi</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>spitz</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='2'>nuri</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='2'>musca-b1</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>versatileab</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>kzm</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='2'>musca-a</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='2'>smdkc210</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>sx1</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>z2</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>tosa</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='4'>sabrelite</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>realview-eb</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='512'>sbsa-ref</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>n810</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>n800</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>versatilepb</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>terrier</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>mainstone</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='4'>midway</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>musicpal</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>microbit</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='4'>raspi3ap</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>cubieboard</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>verdex</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>netduino2</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='4'>raspi3b</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='4'>raspi2b</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>cheetah</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='4'>highbank</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>akita</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>connex</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>collie</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>raspi0</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <domain type='qemu'/>
Aug 26 10:07:11 user nova-compute[73572]:     </arch>
Aug 26 10:07:11 user nova-compute[73572]:     <features>
Aug 26 10:07:11 user nova-compute[73572]:       <acpi default='on' toggle='yes'/>
Aug 26 10:07:11 user nova-compute[73572]:       <cpuselection/>
Aug 26 10:07:11 user nova-compute[73572]:       <deviceboot/>
Aug 26 10:07:11 user nova-compute[73572]:       <disksnapshot default='on' toggle='no'/>
Aug 26 10:07:11 user nova-compute[73572]:     </features>
Aug 26 10:07:11 user nova-compute[73572]:   </guest>
Aug 26 10:07:11 user nova-compute[73572]:   <guest>
Aug 26 10:07:11 user nova-compute[73572]:     <os_type>hvm</os_type>
Aug 26 10:07:11 user nova-compute[73572]:     <arch name='cris'>
Aug 26 10:07:11 user nova-compute[73572]:       <wordsize>32</wordsize>
Aug 26 10:07:11 user nova-compute[73572]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>axis-dev88</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <domain type='qemu'/>
Aug 26 10:07:11 user nova-compute[73572]:     </arch>
Aug 26 10:07:11 user nova-compute[73572]:     <features>
Aug 26 10:07:11 user nova-compute[73572]:       <cpuselection/>
Aug 26 10:07:11 user nova-compute[73572]:       <deviceboot/>
Aug 26 10:07:11 user nova-compute[73572]:       <disksnapshot default='on' toggle='no'/>
Aug 26 10:07:11 user nova-compute[73572]:     </features>
Aug 26 10:07:11 user nova-compute[73572]:   </guest>
Aug 26 10:07:11 user nova-compute[73572]:   <guest>
Aug 26 10:07:11 user nova-compute[73572]:     <os_type>hvm</os_type>
Aug 26 10:07:11 user nova-compute[73572]:     <arch name='i686'>
Aug 26 10:07:11 user nova-compute[73572]:       <wordsize>32</wordsize>
Aug 26 10:07:11 user nova-compute[73572]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='288'>pc-q35-artful</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>x-remote</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>isapc</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='288'>pc-q35-disco</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='288'>pc-q35-impish</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='288'>pc-q35-focal</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='288'>microvm</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <domain type='qemu'/>
Aug 26 10:07:11 user nova-compute[73572]:       <domain type='kvm'/>
Aug 26 10:07:11 user nova-compute[73572]:     </arch>
Aug 26 10:07:11 user nova-compute[73572]:     <features>
Aug 26 10:07:11 user nova-compute[73572]:       <pae/>
Aug 26 10:07:11 user nova-compute[73572]:       <nonpae/>
Aug 26 10:07:11 user nova-compute[73572]:       <acpi default='on' toggle='yes'/>
Aug 26 10:07:11 user nova-compute[73572]:       <apic default='on' toggle='no'/>
Aug 26 10:07:11 user nova-compute[73572]:       <cpuselection/>
Aug 26 10:07:11 user nova-compute[73572]:       <deviceboot/>
Aug 26 10:07:11 user nova-compute[73572]:       <disksnapshot default='on' toggle='no'/>
Aug 26 10:07:11 user nova-compute[73572]:     </features>
Aug 26 10:07:11 user nova-compute[73572]:   </guest>
Aug 26 10:07:11 user nova-compute[73572]:   <guest>
Aug 26 10:07:11 user nova-compute[73572]:     <os_type>hvm</os_type>
Aug 26 10:07:11 user nova-compute[73572]:     <arch name='m68k'>
Aug 26 10:07:11 user nova-compute[73572]:       <wordsize>32</wordsize>
Aug 26 10:07:11 user nova-compute[73572]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>mcf5208evb</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>an5206</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>virt-6.0</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>q800</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>virt-6.2</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>next-cube</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>virt-6.1</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <domain type='qemu'/>
Aug 26 10:07:11 user nova-compute[73572]:     </arch>
Aug 26 10:07:11 user nova-compute[73572]:     <features>
Aug 26 10:07:11 user nova-compute[73572]:       <cpuselection/>
Aug 26 10:07:11 user nova-compute[73572]:       <deviceboot/>
Aug 26 10:07:11 user nova-compute[73572]:       <disksnapshot default='on' toggle='no'/>
Aug 26 10:07:11 user nova-compute[73572]:     </features>
Aug 26 10:07:11 user nova-compute[73572]:   </guest>
Aug 26 10:07:11 user nova-compute[73572]:   <guest>
Aug 26 10:07:11 user nova-compute[73572]:     <os_type>hvm</os_type>
Aug 26 10:07:11 user nova-compute[73572]:     <arch name='microblaze'>
Aug 26 10:07:11 user nova-compute[73572]:       <wordsize>32</wordsize>
Aug 26 10:07:11 user nova-compute[73572]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>petalogix-ml605</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <domain type='qemu'/>
Aug 26 10:07:11 user nova-compute[73572]:     </arch>
Aug 26 10:07:11 user nova-compute[73572]:     <features>
Aug 26 10:07:11 user nova-compute[73572]:       <cpuselection/>
Aug 26 10:07:11 user nova-compute[73572]:       <deviceboot/>
Aug 26 10:07:11 user nova-compute[73572]:       <disksnapshot default='on' toggle='no'/>
Aug 26 10:07:11 user nova-compute[73572]:     </features>
Aug 26 10:07:11 user nova-compute[73572]:   </guest>
Aug 26 10:07:11 user nova-compute[73572]:   <guest>
Aug 26 10:07:11 user nova-compute[73572]:     <os_type>hvm</os_type>
Aug 26 10:07:11 user nova-compute[73572]:     <arch name='microblazeel'>
Aug 26 10:07:11 user nova-compute[73572]:       <wordsize>32</wordsize>
Aug 26 10:07:11 user nova-compute[73572]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>petalogix-ml605</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <domain type='qemu'/>
Aug 26 10:07:11 user nova-compute[73572]:     </arch>
Aug 26 10:07:11 user nova-compute[73572]:     <features>
Aug 26 10:07:11 user nova-compute[73572]:       <cpuselection/>
Aug 26 10:07:11 user nova-compute[73572]:       <deviceboot/>
Aug 26 10:07:11 user nova-compute[73572]:       <disksnapshot default='on' toggle='no'/>
Aug 26 10:07:11 user nova-compute[73572]:     </features>
Aug 26 10:07:11 user nova-compute[73572]:   </guest>
Aug 26 10:07:11 user nova-compute[73572]:   <guest>
Aug 26 10:07:11 user nova-compute[73572]:     <os_type>hvm</os_type>
Aug 26 10:07:11 user nova-compute[73572]:     <arch name='mips'>
Aug 26 10:07:11 user nova-compute[73572]:       <wordsize>32</wordsize>
Aug 26 10:07:11 user nova-compute[73572]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='16'>malta</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>mipssim</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <domain type='qemu'/>
Aug 26 10:07:11 user nova-compute[73572]:     </arch>
Aug 26 10:07:11 user nova-compute[73572]:     <features>
Aug 26 10:07:11 user nova-compute[73572]:       <cpuselection/>
Aug 26 10:07:11 user nova-compute[73572]:       <deviceboot/>
Aug 26 10:07:11 user nova-compute[73572]:       <disksnapshot default='on' toggle='no'/>
Aug 26 10:07:11 user nova-compute[73572]:     </features>
Aug 26 10:07:11 user nova-compute[73572]:   </guest>
Aug 26 10:07:11 user nova-compute[73572]:   <guest>
Aug 26 10:07:11 user nova-compute[73572]:     <os_type>hvm</os_type>
Aug 26 10:07:11 user nova-compute[73572]:     <arch name='mipsel'>
Aug 26 10:07:11 user nova-compute[73572]:       <wordsize>32</wordsize>
Aug 26 10:07:11 user nova-compute[73572]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='16'>malta</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>mipssim</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <domain type='qemu'/>
Aug 26 10:07:11 user nova-compute[73572]:     </arch>
Aug 26 10:07:11 user nova-compute[73572]:     <features>
Aug 26 10:07:11 user nova-compute[73572]:       <cpuselection/>
Aug 26 10:07:11 user nova-compute[73572]:       <deviceboot/>
Aug 26 10:07:11 user nova-compute[73572]:       <disksnapshot default='on' toggle='no'/>
Aug 26 10:07:11 user nova-compute[73572]:     </features>
Aug 26 10:07:11 user nova-compute[73572]:   </guest>
Aug 26 10:07:11 user nova-compute[73572]:   <guest>
Aug 26 10:07:11 user nova-compute[73572]:     <os_type>hvm</os_type>
Aug 26 10:07:11 user nova-compute[73572]:     <arch name='mips64'>
Aug 26 10:07:11 user nova-compute[73572]:       <wordsize>64</wordsize>
Aug 26 10:07:11 user nova-compute[73572]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='16'>malta</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>mipssim</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>pica61</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>magnum</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <domain type='qemu'/>
Aug 26 10:07:11 user nova-compute[73572]:     </arch>
Aug 26 10:07:11 user nova-compute[73572]:     <features>
Aug 26 10:07:11 user nova-compute[73572]:       <cpuselection/>
Aug 26 10:07:11 user nova-compute[73572]:       <deviceboot/>
Aug 26 10:07:11 user nova-compute[73572]:       <disksnapshot default='on' toggle='no'/>
Aug 26 10:07:11 user nova-compute[73572]:     </features>
Aug 26 10:07:11 user nova-compute[73572]:   </guest>
Aug 26 10:07:11 user nova-compute[73572]:   <guest>
Aug 26 10:07:11 user nova-compute[73572]:     <os_type>hvm</os_type>
Aug 26 10:07:11 user nova-compute[73572]:     <arch name='mips64el'>
Aug 26 10:07:11 user nova-compute[73572]:       <wordsize>64</wordsize>
Aug 26 10:07:11 user nova-compute[73572]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='16'>malta</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='16'>loongson3-virt</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>mipssim</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>pica61</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>magnum</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='16'>boston</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>fuloong2e</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <domain type='qemu'/>
Aug 26 10:07:11 user nova-compute[73572]:     </arch>
Aug 26 10:07:11 user nova-compute[73572]:     <features>
Aug 26 10:07:11 user nova-compute[73572]:       <cpuselection/>
Aug 26 10:07:11 user nova-compute[73572]:       <deviceboot/>
Aug 26 10:07:11 user nova-compute[73572]:       <disksnapshot default='on' toggle='no'/>
Aug 26 10:07:11 user nova-compute[73572]:     </features>
Aug 26 10:07:11 user nova-compute[73572]:   </guest>
Aug 26 10:07:11 user nova-compute[73572]:   <guest>
Aug 26 10:07:11 user nova-compute[73572]:     <os_type>hvm</os_type>
Aug 26 10:07:11 user nova-compute[73572]:     <arch name='ppc'>
Aug 26 10:07:11 user nova-compute[73572]:       <wordsize>32</wordsize>
Aug 26 10:07:11 user nova-compute[73572]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>g3beige</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>mac99</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='32'>ppce500</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>pegasos2</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>sam460ex</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>bamboo</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>40p</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>ref405ep</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>taihu</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <domain type='qemu'/>
Aug 26 10:07:11 user nova-compute[73572]:     </arch>
Aug 26 10:07:11 user nova-compute[73572]:     <features>
Aug 26 10:07:11 user nova-compute[73572]:       <cpuselection/>
Aug 26 10:07:11 user nova-compute[73572]:       <deviceboot/>
Aug 26 10:07:11 user nova-compute[73572]:       <disksnapshot default='on' toggle='no'/>
Aug 26 10:07:11 user nova-compute[73572]:     </features>
Aug 26 10:07:11 user nova-compute[73572]:   </guest>
Aug 26 10:07:11 user nova-compute[73572]:   <guest>
Aug 26 10:07:11 user nova-compute[73572]:     <os_type>hvm</os_type>
Aug 26 10:07:11 user nova-compute[73572]:     <arch name='ppc64'>
Aug 26 10:07:11 user nova-compute[73572]:       <wordsize>64</wordsize>
Aug 26 10:07:11 user nova-compute[73572]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='2048'>powernv9</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>taihu</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='2048'>powernv10</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='32'>ppce500</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>40p</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>pegasos2</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>bamboo</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>g3beige</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>mac99</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>sam460ex</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>ref405ep</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='2048'>powernv8</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <domain type='qemu'/>
Aug 26 10:07:11 user nova-compute[73572]:     </arch>
Aug 26 10:07:11 user nova-compute[73572]:     <features>
Aug 26 10:07:11 user nova-compute[73572]:       <cpuselection/>
Aug 26 10:07:11 user nova-compute[73572]:       <deviceboot/>
Aug 26 10:07:11 user nova-compute[73572]:       <disksnapshot default='on' toggle='no'/>
Aug 26 10:07:11 user nova-compute[73572]:     </features>
Aug 26 10:07:11 user nova-compute[73572]:   </guest>
Aug 26 10:07:11 user nova-compute[73572]:   <guest>
Aug 26 10:07:11 user nova-compute[73572]:     <os_type>hvm</os_type>
Aug 26 10:07:11 user nova-compute[73572]:     <arch name='ppc64le'>
Aug 26 10:07:11 user nova-compute[73572]:       <wordsize>64</wordsize>
Aug 26 10:07:11 user nova-compute[73572]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='2048'>powernv9</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>taihu</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='2048'>powernv10</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='32'>ppce500</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>40p</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>pegasos2</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>bamboo</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>g3beige</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>mac99</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>sam460ex</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>ref405ep</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='2048'>powernv8</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <domain type='qemu'/>
Aug 26 10:07:11 user nova-compute[73572]:     </arch>
Aug 26 10:07:11 user nova-compute[73572]:     <features>
Aug 26 10:07:11 user nova-compute[73572]:       <cpuselection/>
Aug 26 10:07:11 user nova-compute[73572]:       <deviceboot/>
Aug 26 10:07:11 user nova-compute[73572]:       <disksnapshot default='on' toggle='no'/>
Aug 26 10:07:11 user nova-compute[73572]:     </features>
Aug 26 10:07:11 user nova-compute[73572]:   </guest>
Aug 26 10:07:11 user nova-compute[73572]:   <guest>
Aug 26 10:07:11 user nova-compute[73572]:     <os_type>hvm</os_type>
Aug 26 10:07:11 user nova-compute[73572]:     <arch name='riscv32'>
Aug 26 10:07:11 user nova-compute[73572]:       <wordsize>32</wordsize>
Aug 26 10:07:11 user nova-compute[73572]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='8'>spike</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>opentitan</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='5'>sifive_u</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>sifive_e</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='8'>virt</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <domain type='qemu'/>
Aug 26 10:07:11 user nova-compute[73572]:     </arch>
Aug 26 10:07:11 user nova-compute[73572]:     <features>
Aug 26 10:07:11 user nova-compute[73572]:       <cpuselection/>
Aug 26 10:07:11 user nova-compute[73572]:       <deviceboot/>
Aug 26 10:07:11 user nova-compute[73572]:       <disksnapshot default='on' toggle='no'/>
Aug 26 10:07:11 user nova-compute[73572]:     </features>
Aug 26 10:07:11 user nova-compute[73572]:   </guest>
Aug 26 10:07:11 user nova-compute[73572]:   <guest>
Aug 26 10:07:11 user nova-compute[73572]:     <os_type>hvm</os_type>
Aug 26 10:07:11 user nova-compute[73572]:     <arch name='riscv64'>
Aug 26 10:07:11 user nova-compute[73572]:       <wordsize>64</wordsize>
Aug 26 10:07:11 user nova-compute[73572]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='8'>spike</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='5'>sifive_u</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>shakti_c</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>sifive_e</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='8'>virt</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <domain type='qemu'/>
Aug 26 10:07:11 user nova-compute[73572]:     </arch>
Aug 26 10:07:11 user nova-compute[73572]:     <features>
Aug 26 10:07:11 user nova-compute[73572]:       <cpuselection/>
Aug 26 10:07:11 user nova-compute[73572]:       <deviceboot/>
Aug 26 10:07:11 user nova-compute[73572]:       <disksnapshot default='on' toggle='no'/>
Aug 26 10:07:11 user nova-compute[73572]:     </features>
Aug 26 10:07:11 user nova-compute[73572]:   </guest>
Aug 26 10:07:11 user nova-compute[73572]:   <guest>
Aug 26 10:07:11 user nova-compute[73572]:     <os_type>hvm</os_type>
Aug 26 10:07:11 user nova-compute[73572]:     <arch name='s390x'>
Aug 26 10:07:11 user nova-compute[73572]:       <wordsize>64</wordsize>
Aug 26 10:07:11 user nova-compute[73572]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <domain type='qemu'/>
Aug 26 10:07:11 user nova-compute[73572]:     </arch>
Aug 26 10:07:11 user nova-compute[73572]:     <features>
Aug 26 10:07:11 user nova-compute[73572]:       <cpuselection/>
Aug 26 10:07:11 user nova-compute[73572]:       <deviceboot/>
Aug 26 10:07:11 user nova-compute[73572]:       <disksnapshot default='on' toggle='no'/>
Aug 26 10:07:11 user nova-compute[73572]:     </features>
Aug 26 10:07:11 user nova-compute[73572]:   </guest>
Aug 26 10:07:11 user nova-compute[73572]:   <guest>
Aug 26 10:07:11 user nova-compute[73572]:     <os_type>hvm</os_type>
Aug 26 10:07:11 user nova-compute[73572]:     <arch name='sh4'>
Aug 26 10:07:11 user nova-compute[73572]:       <wordsize>32</wordsize>
Aug 26 10:07:11 user nova-compute[73572]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>shix</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>r2d</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <domain type='qemu'/>
Aug 26 10:07:11 user nova-compute[73572]:     </arch>
Aug 26 10:07:11 user nova-compute[73572]:     <features>
Aug 26 10:07:11 user nova-compute[73572]:       <cpuselection/>
Aug 26 10:07:11 user nova-compute[73572]:       <deviceboot/>
Aug 26 10:07:11 user nova-compute[73572]:       <disksnapshot default='on' toggle='no'/>
Aug 26 10:07:11 user nova-compute[73572]:     </features>
Aug 26 10:07:11 user nova-compute[73572]:   </guest>
Aug 26 10:07:11 user nova-compute[73572]:   <guest>
Aug 26 10:07:11 user nova-compute[73572]:     <os_type>hvm</os_type>
Aug 26 10:07:11 user nova-compute[73572]:     <arch name='sh4eb'>
Aug 26 10:07:11 user nova-compute[73572]:       <wordsize>64</wordsize>
Aug 26 10:07:11 user nova-compute[73572]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>shix</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>r2d</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <domain type='qemu'/>
Aug 26 10:07:11 user nova-compute[73572]:     </arch>
Aug 26 10:07:11 user nova-compute[73572]:     <features>
Aug 26 10:07:11 user nova-compute[73572]:       <cpuselection/>
Aug 26 10:07:11 user nova-compute[73572]:       <deviceboot/>
Aug 26 10:07:11 user nova-compute[73572]:       <disksnapshot default='on' toggle='no'/>
Aug 26 10:07:11 user nova-compute[73572]:     </features>
Aug 26 10:07:11 user nova-compute[73572]:   </guest>
Aug 26 10:07:11 user nova-compute[73572]:   <guest>
Aug 26 10:07:11 user nova-compute[73572]:     <os_type>hvm</os_type>
Aug 26 10:07:11 user nova-compute[73572]:     <arch name='sparc'>
Aug 26 10:07:11 user nova-compute[73572]:       <wordsize>32</wordsize>
Aug 26 10:07:11 user nova-compute[73572]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>SS-5</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='4'>SS-20</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>LX</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>SPARCClassic</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>leon3_generic</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>SPARCbook</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>SS-4</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='4'>SS-600MP</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='4'>SS-10</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>Voyager</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <domain type='qemu'/>
Aug 26 10:07:11 user nova-compute[73572]:     </arch>
Aug 26 10:07:11 user nova-compute[73572]:     <features>
Aug 26 10:07:11 user nova-compute[73572]:       <cpuselection/>
Aug 26 10:07:11 user nova-compute[73572]:       <deviceboot/>
Aug 26 10:07:11 user nova-compute[73572]:       <disksnapshot default='on' toggle='no'/>
Aug 26 10:07:11 user nova-compute[73572]:     </features>
Aug 26 10:07:11 user nova-compute[73572]:   </guest>
Aug 26 10:07:11 user nova-compute[73572]:   <guest>
Aug 26 10:07:11 user nova-compute[73572]:     <os_type>hvm</os_type>
Aug 26 10:07:11 user nova-compute[73572]:     <arch name='sparc64'>
Aug 26 10:07:11 user nova-compute[73572]:       <wordsize>64</wordsize>
Aug 26 10:07:11 user nova-compute[73572]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>sun4u</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>niagara</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>sun4v</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <domain type='qemu'/>
Aug 26 10:07:11 user nova-compute[73572]:     </arch>
Aug 26 10:07:11 user nova-compute[73572]:     <features>
Aug 26 10:07:11 user nova-compute[73572]:       <cpuselection/>
Aug 26 10:07:11 user nova-compute[73572]:       <deviceboot/>
Aug 26 10:07:11 user nova-compute[73572]:       <disksnapshot default='on' toggle='no'/>
Aug 26 10:07:11 user nova-compute[73572]:     </features>
Aug 26 10:07:11 user nova-compute[73572]:   </guest>
Aug 26 10:07:11 user nova-compute[73572]:   <guest>
Aug 26 10:07:11 user nova-compute[73572]:     <os_type>hvm</os_type>
Aug 26 10:07:11 user nova-compute[73572]:     <arch name='x86_64'>
Aug 26 10:07:11 user nova-compute[73572]:       <wordsize>64</wordsize>
Aug 26 10:07:11 user nova-compute[73572]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='288'>pc-q35-artful</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>x-remote</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='1'>isapc</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='288'>pc-q35-disco</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='288'>pc-q35-impish</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='288'>pc-q35-focal</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='288'>microvm</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <domain type='qemu'/>
Aug 26 10:07:11 user nova-compute[73572]:       <domain type='kvm'/>
Aug 26 10:07:11 user nova-compute[73572]:     </arch>
Aug 26 10:07:11 user nova-compute[73572]:     <features>
Aug 26 10:07:11 user nova-compute[73572]:       <acpi default='on' toggle='yes'/>
Aug 26 10:07:11 user nova-compute[73572]:       <apic default='on' toggle='no'/>
Aug 26 10:07:11 user nova-compute[73572]:       <cpuselection/>
Aug 26 10:07:11 user nova-compute[73572]:       <deviceboot/>
Aug 26 10:07:11 user nova-compute[73572]:       <disksnapshot default='on' toggle='no'/>
Aug 26 10:07:11 user nova-compute[73572]:     </features>
Aug 26 10:07:11 user nova-compute[73572]:   </guest>
Aug 26 10:07:11 user nova-compute[73572]:   <guest>
Aug 26 10:07:11 user nova-compute[73572]:     <os_type>hvm</os_type>
Aug 26 10:07:11 user nova-compute[73572]:     <arch name='xtensa'>
Aug 26 10:07:11 user nova-compute[73572]:       <wordsize>32</wordsize>
Aug 26 10:07:11 user nova-compute[73572]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='4'>sim</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='32'>kc705</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='32'>ml605</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='32'>ml605-nommu</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='32'>virt</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='32'>lx60-nommu</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='32'>lx200</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='32'>lx200-nommu</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='32'>lx60</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='32'>kc705-nommu</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <domain type='qemu'/>
Aug 26 10:07:11 user nova-compute[73572]:     </arch>
Aug 26 10:07:11 user nova-compute[73572]:     <features>
Aug 26 10:07:11 user nova-compute[73572]:       <cpuselection/>
Aug 26 10:07:11 user nova-compute[73572]:       <deviceboot/>
Aug 26 10:07:11 user nova-compute[73572]:       <disksnapshot default='on' toggle='no'/>
Aug 26 10:07:11 user nova-compute[73572]:     </features>
Aug 26 10:07:11 user nova-compute[73572]:   </guest>
Aug 26 10:07:11 user nova-compute[73572]:   <guest>
Aug 26 10:07:11 user nova-compute[73572]:     <os_type>hvm</os_type>
Aug 26 10:07:11 user nova-compute[73572]:     <arch name='xtensaeb'>
Aug 26 10:07:11 user nova-compute[73572]:       <wordsize>32</wordsize>
Aug 26 10:07:11 user nova-compute[73572]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='4'>sim</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='32'>kc705</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='32'>ml605</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='32'>ml605-nommu</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='32'>virt</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='32'>lx60-nommu</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='32'>lx200</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='32'>lx200-nommu</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='32'>lx60</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <machine maxCpus='32'>kc705-nommu</machine>
Aug 26 10:07:11 user nova-compute[73572]:       <domain type='qemu'/>
Aug 26 10:07:11 user nova-compute[73572]:     </arch>
Aug 26 10:07:11 user nova-compute[73572]:     <features>
Aug 26 10:07:11 user nova-compute[73572]:       <cpuselection/>
Aug 26 10:07:11 user nova-compute[73572]:       <deviceboot/>
Aug 26 10:07:11 user nova-compute[73572]:       <disksnapshot default='on' toggle='no'/>
Aug 26 10:07:11 user nova-compute[73572]:     </features>
Aug 26 10:07:11 user nova-compute[73572]:   </guest>
Aug 26 10:07:11 user nova-compute[73572]: </capabilities>
Aug 26 10:07:11 user nova-compute[73572]: 
Aug 26 10:07:11 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=73572) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 10:07:11 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=73572) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 10:07:11 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=73572) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 10:07:11 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=73572) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 10:07:11 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=73572) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 10:07:11 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=73572) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 10:07:11 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=73572) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 10:07:11 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=73572) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 10:07:11 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=73572) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 10:07:11 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Getting domain capabilities for cris via machine types: {None} {{(pid=73572) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 10:07:11 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=73572) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 10:07:11 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Getting domain capabilities for i686 via machine types: {'pc', 'q35', 'ubuntu', 'ubuntu-q35'} {{(pid=73572) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 10:07:11 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Aug 26 10:07:11 user nova-compute[73572]: <domainCapabilities>
Aug 26 10:07:11 user nova-compute[73572]:   <path>/usr/bin/qemu-system-i386</path>
Aug 26 10:07:11 user nova-compute[73572]:   <domain>kvm</domain>
Aug 26 10:07:11 user nova-compute[73572]:   <machine>pc-i440fx-6.2</machine>
Aug 26 10:07:11 user nova-compute[73572]:   <arch>i686</arch>
Aug 26 10:07:11 user nova-compute[73572]:   <vcpu max='255'/>
Aug 26 10:07:11 user nova-compute[73572]:   <iothreads supported='yes'/>
Aug 26 10:07:11 user nova-compute[73572]:   <os supported='yes'>
Aug 26 10:07:11 user nova-compute[73572]:     <enum name='firmware'/>
Aug 26 10:07:11 user nova-compute[73572]:     <loader supported='yes'>
Aug 26 10:07:11 user nova-compute[73572]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 26 10:07:11 user nova-compute[73572]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 26 10:07:11 user nova-compute[73572]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 26 10:07:11 user nova-compute[73572]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 26 10:07:11 user nova-compute[73572]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 26 10:07:11 user nova-compute[73572]:       <enum name='type'>
Aug 26 10:07:11 user nova-compute[73572]:         <value>rom</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>pflash</value>
Aug 26 10:07:11 user nova-compute[73572]:       </enum>
Aug 26 10:07:11 user nova-compute[73572]:       <enum name='readonly'>
Aug 26 10:07:11 user nova-compute[73572]:         <value>yes</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>no</value>
Aug 26 10:07:11 user nova-compute[73572]:       </enum>
Aug 26 10:07:11 user nova-compute[73572]:       <enum name='secure'>
Aug 26 10:07:11 user nova-compute[73572]:         <value>no</value>
Aug 26 10:07:11 user nova-compute[73572]:       </enum>
Aug 26 10:07:11 user nova-compute[73572]:     </loader>
Aug 26 10:07:11 user nova-compute[73572]:   </os>
Aug 26 10:07:11 user nova-compute[73572]:   <cpu>
Aug 26 10:07:11 user nova-compute[73572]:     <mode name='host-passthrough' supported='yes'>
Aug 26 10:07:11 user nova-compute[73572]:       <enum name='hostPassthroughMigratable'>
Aug 26 10:07:11 user nova-compute[73572]:         <value>off</value>
Aug 26 10:07:11 user nova-compute[73572]:       </enum>
Aug 26 10:07:11 user nova-compute[73572]:     </mode>
Aug 26 10:07:11 user nova-compute[73572]:     <mode name='maximum' supported='yes'>
Aug 26 10:07:11 user nova-compute[73572]:       <enum name='maximumMigratable'>
Aug 26 10:07:11 user nova-compute[73572]:         <value>on</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>off</value>
Aug 26 10:07:11 user nova-compute[73572]:       </enum>
Aug 26 10:07:11 user nova-compute[73572]:     </mode>
Aug 26 10:07:11 user nova-compute[73572]:     <mode name='host-model' supported='yes'>
Aug 26 10:07:11 user nova-compute[73572]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 26 10:07:11 user nova-compute[73572]:       <vendor>Intel</vendor>
Aug 26 10:07:11 user nova-compute[73572]:       <feature policy='require' name='ss'/>
Aug 26 10:07:11 user nova-compute[73572]:       <feature policy='require' name='vmx'/>
Aug 26 10:07:11 user nova-compute[73572]:       <feature policy='require' name='pcid'/>
Aug 26 10:07:11 user nova-compute[73572]:       <feature policy='require' name='hypervisor'/>
Aug 26 10:07:11 user nova-compute[73572]:       <feature policy='require' name='arat'/>
Aug 26 10:07:11 user nova-compute[73572]:       <feature policy='require' name='tsc_adjust'/>
Aug 26 10:07:11 user nova-compute[73572]:       <feature policy='require' name='umip'/>
Aug 26 10:07:11 user nova-compute[73572]:       <feature policy='require' name='md-clear'/>
Aug 26 10:07:11 user nova-compute[73572]:       <feature policy='require' name='stibp'/>
Aug 26 10:07:11 user nova-compute[73572]:       <feature policy='require' name='arch-capabilities'/>
Aug 26 10:07:11 user nova-compute[73572]:       <feature policy='require' name='ssbd'/>
Aug 26 10:07:11 user nova-compute[73572]:       <feature policy='require' name='ibpb'/>
Aug 26 10:07:11 user nova-compute[73572]:       <feature policy='require' name='ibrs'/>
Aug 26 10:07:11 user nova-compute[73572]:       <feature policy='require' name='amd-stibp'/>
Aug 26 10:07:11 user nova-compute[73572]:       <feature policy='require' name='amd-ssbd'/>
Aug 26 10:07:11 user nova-compute[73572]:       <feature policy='disable' name='erms'/>
Aug 26 10:07:11 user nova-compute[73572]:       <feature policy='disable' name='xsaveopt'/>
Aug 26 10:07:11 user nova-compute[73572]:       <feature policy='disable' name='lm'/>
Aug 26 10:07:11 user nova-compute[73572]:     </mode>
Aug 26 10:07:11 user nova-compute[73572]:     <mode name='custom' supported='yes'>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>qemu64</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='yes'>qemu32</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>phenom</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='yes'>pentium3</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='yes'>pentium2</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='yes'>pentium</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>n270</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>kvm64</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='yes'>kvm32</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='yes'>coreduo</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>core2duo</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>athlon</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Westmere-IBRS</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Westmere</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Snowridge</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Skylake-Server</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Skylake-Client</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>SandyBridge</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Penryn</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Opteron_G5</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Opteron_G4</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Opteron_G3</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Opteron_G2</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Opteron_G1</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Nehalem-IBRS</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Nehalem</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>IvyBridge</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Icelake-Server</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Haswell-noTSX</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Haswell-IBRS</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Haswell</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>EPYC-Rome</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>EPYC-Milan</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>EPYC-IBPB</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>EPYC</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Dhyana</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Cooperlake</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Conroe</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Cascadelake-Server</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Broadwell-noTSX</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Broadwell-IBRS</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Broadwell</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='yes'>486</model>
Aug 26 10:07:11 user nova-compute[73572]:     </mode>
Aug 26 10:07:11 user nova-compute[73572]:   </cpu>
Aug 26 10:07:11 user nova-compute[73572]:   <memoryBacking supported='yes'>
Aug 26 10:07:11 user nova-compute[73572]:     <enum name='sourceType'>
Aug 26 10:07:11 user nova-compute[73572]:       <value>file</value>
Aug 26 10:07:11 user nova-compute[73572]:       <value>anonymous</value>
Aug 26 10:07:11 user nova-compute[73572]:       <value>memfd</value>
Aug 26 10:07:11 user nova-compute[73572]:     </enum>
Aug 26 10:07:11 user nova-compute[73572]:   </memoryBacking>
Aug 26 10:07:11 user nova-compute[73572]:   <devices>
Aug 26 10:07:11 user nova-compute[73572]:     <disk supported='yes'>
Aug 26 10:07:11 user nova-compute[73572]:       <enum name='diskDevice'>
Aug 26 10:07:11 user nova-compute[73572]:         <value>disk</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>cdrom</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>floppy</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>lun</value>
Aug 26 10:07:11 user nova-compute[73572]:       </enum>
Aug 26 10:07:11 user nova-compute[73572]:       <enum name='bus'>
Aug 26 10:07:11 user nova-compute[73572]:         <value>ide</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>fdc</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>scsi</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>virtio</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>usb</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>sata</value>
Aug 26 10:07:11 user nova-compute[73572]:       </enum>
Aug 26 10:07:11 user nova-compute[73572]:       <enum name='model'>
Aug 26 10:07:11 user nova-compute[73572]:         <value>virtio</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>virtio-transitional</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>virtio-non-transitional</value>
Aug 26 10:07:11 user nova-compute[73572]:       </enum>
Aug 26 10:07:11 user nova-compute[73572]:     </disk>
Aug 26 10:07:11 user nova-compute[73572]:     <graphics supported='yes'>
Aug 26 10:07:11 user nova-compute[73572]:       <enum name='type'>
Aug 26 10:07:11 user nova-compute[73572]:         <value>sdl</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>vnc</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>spice</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>egl-headless</value>
Aug 26 10:07:11 user nova-compute[73572]:       </enum>
Aug 26 10:07:11 user nova-compute[73572]:     </graphics>
Aug 26 10:07:11 user nova-compute[73572]:     <video supported='yes'>
Aug 26 10:07:11 user nova-compute[73572]:       <enum name='modelType'>
Aug 26 10:07:11 user nova-compute[73572]:         <value>vga</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>cirrus</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>vmvga</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>qxl</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>virtio</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>none</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>bochs</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>ramfb</value>
Aug 26 10:07:11 user nova-compute[73572]:       </enum>
Aug 26 10:07:11 user nova-compute[73572]:     </video>
Aug 26 10:07:11 user nova-compute[73572]:     <hostdev supported='yes'>
Aug 26 10:07:11 user nova-compute[73572]:       <enum name='mode'>
Aug 26 10:07:11 user nova-compute[73572]:         <value>subsystem</value>
Aug 26 10:07:11 user nova-compute[73572]:       </enum>
Aug 26 10:07:11 user nova-compute[73572]:       <enum name='startupPolicy'>
Aug 26 10:07:11 user nova-compute[73572]:         <value>default</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>mandatory</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>requisite</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>optional</value>
Aug 26 10:07:11 user nova-compute[73572]:       </enum>
Aug 26 10:07:11 user nova-compute[73572]:       <enum name='subsysType'>
Aug 26 10:07:11 user nova-compute[73572]:         <value>usb</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>pci</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>scsi</value>
Aug 26 10:07:11 user nova-compute[73572]:       </enum>
Aug 26 10:07:11 user nova-compute[73572]:       <enum name='capsType'/>
Aug 26 10:07:11 user nova-compute[73572]:       <enum name='pciBackend'/>
Aug 26 10:07:11 user nova-compute[73572]:     </hostdev>
Aug 26 10:07:11 user nova-compute[73572]:     <rng supported='yes'>
Aug 26 10:07:11 user nova-compute[73572]:       <enum name='model'>
Aug 26 10:07:11 user nova-compute[73572]:         <value>virtio</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>virtio-transitional</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>virtio-non-transitional</value>
Aug 26 10:07:11 user nova-compute[73572]:       </enum>
Aug 26 10:07:11 user nova-compute[73572]:       <enum name='backendModel'>
Aug 26 10:07:11 user nova-compute[73572]:         <value>random</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>egd</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>builtin</value>
Aug 26 10:07:11 user nova-compute[73572]:       </enum>
Aug 26 10:07:11 user nova-compute[73572]:     </rng>
Aug 26 10:07:11 user nova-compute[73572]:     <filesystem supported='yes'>
Aug 26 10:07:11 user nova-compute[73572]:       <enum name='driverType'>
Aug 26 10:07:11 user nova-compute[73572]:         <value>path</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>handle</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>virtiofs</value>
Aug 26 10:07:11 user nova-compute[73572]:       </enum>
Aug 26 10:07:11 user nova-compute[73572]:     </filesystem>
Aug 26 10:07:11 user nova-compute[73572]:     <tpm supported='yes'>
Aug 26 10:07:11 user nova-compute[73572]:       <enum name='model'>
Aug 26 10:07:11 user nova-compute[73572]:         <value>tpm-tis</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>tpm-crb</value>
Aug 26 10:07:11 user nova-compute[73572]:       </enum>
Aug 26 10:07:11 user nova-compute[73572]:       <enum name='backendModel'>
Aug 26 10:07:11 user nova-compute[73572]:         <value>passthrough</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>emulator</value>
Aug 26 10:07:11 user nova-compute[73572]:       </enum>
Aug 26 10:07:11 user nova-compute[73572]:     </tpm>
Aug 26 10:07:11 user nova-compute[73572]:   </devices>
Aug 26 10:07:11 user nova-compute[73572]:   <features>
Aug 26 10:07:11 user nova-compute[73572]:     <gic supported='no'/>
Aug 26 10:07:11 user nova-compute[73572]:     <vmcoreinfo supported='yes'/>
Aug 26 10:07:11 user nova-compute[73572]:     <genid supported='yes'/>
Aug 26 10:07:11 user nova-compute[73572]:     <backingStoreInput supported='yes'/>
Aug 26 10:07:11 user nova-compute[73572]:     <backup supported='yes'/>
Aug 26 10:07:11 user nova-compute[73572]:     <sev supported='no'/>
Aug 26 10:07:11 user nova-compute[73572]:   </features>
Aug 26 10:07:11 user nova-compute[73572]: </domainCapabilities>
Aug 26 10:07:11 user nova-compute[73572]:  {{(pid=73572) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 26 10:07:11 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Aug 26 10:07:11 user nova-compute[73572]: <domainCapabilities>
Aug 26 10:07:11 user nova-compute[73572]:   <path>/usr/bin/qemu-system-i386</path>
Aug 26 10:07:11 user nova-compute[73572]:   <domain>kvm</domain>
Aug 26 10:07:11 user nova-compute[73572]:   <machine>pc-q35-6.2</machine>
Aug 26 10:07:11 user nova-compute[73572]:   <arch>i686</arch>
Aug 26 10:07:11 user nova-compute[73572]:   <vcpu max='288'/>
Aug 26 10:07:11 user nova-compute[73572]:   <iothreads supported='yes'/>
Aug 26 10:07:11 user nova-compute[73572]:   <os supported='yes'>
Aug 26 10:07:11 user nova-compute[73572]:     <enum name='firmware'/>
Aug 26 10:07:11 user nova-compute[73572]:     <loader supported='yes'>
Aug 26 10:07:11 user nova-compute[73572]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 26 10:07:11 user nova-compute[73572]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 26 10:07:11 user nova-compute[73572]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 26 10:07:11 user nova-compute[73572]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 26 10:07:11 user nova-compute[73572]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 26 10:07:11 user nova-compute[73572]:       <enum name='type'>
Aug 26 10:07:11 user nova-compute[73572]:         <value>rom</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>pflash</value>
Aug 26 10:07:11 user nova-compute[73572]:       </enum>
Aug 26 10:07:11 user nova-compute[73572]:       <enum name='readonly'>
Aug 26 10:07:11 user nova-compute[73572]:         <value>yes</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>no</value>
Aug 26 10:07:11 user nova-compute[73572]:       </enum>
Aug 26 10:07:11 user nova-compute[73572]:       <enum name='secure'>
Aug 26 10:07:11 user nova-compute[73572]:         <value>no</value>
Aug 26 10:07:11 user nova-compute[73572]:       </enum>
Aug 26 10:07:11 user nova-compute[73572]:     </loader>
Aug 26 10:07:11 user nova-compute[73572]:   </os>
Aug 26 10:07:11 user nova-compute[73572]:   <cpu>
Aug 26 10:07:11 user nova-compute[73572]:     <mode name='host-passthrough' supported='yes'>
Aug 26 10:07:11 user nova-compute[73572]:       <enum name='hostPassthroughMigratable'>
Aug 26 10:07:11 user nova-compute[73572]:         <value>off</value>
Aug 26 10:07:11 user nova-compute[73572]:       </enum>
Aug 26 10:07:11 user nova-compute[73572]:     </mode>
Aug 26 10:07:11 user nova-compute[73572]:     <mode name='maximum' supported='yes'>
Aug 26 10:07:11 user nova-compute[73572]:       <enum name='maximumMigratable'>
Aug 26 10:07:11 user nova-compute[73572]:         <value>on</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>off</value>
Aug 26 10:07:11 user nova-compute[73572]:       </enum>
Aug 26 10:07:11 user nova-compute[73572]:     </mode>
Aug 26 10:07:11 user nova-compute[73572]:     <mode name='host-model' supported='yes'>
Aug 26 10:07:11 user nova-compute[73572]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 26 10:07:11 user nova-compute[73572]:       <vendor>Intel</vendor>
Aug 26 10:07:11 user nova-compute[73572]:       <feature policy='require' name='ss'/>
Aug 26 10:07:11 user nova-compute[73572]:       <feature policy='require' name='vmx'/>
Aug 26 10:07:11 user nova-compute[73572]:       <feature policy='require' name='pcid'/>
Aug 26 10:07:11 user nova-compute[73572]:       <feature policy='require' name='hypervisor'/>
Aug 26 10:07:11 user nova-compute[73572]:       <feature policy='require' name='arat'/>
Aug 26 10:07:11 user nova-compute[73572]:       <feature policy='require' name='tsc_adjust'/>
Aug 26 10:07:11 user nova-compute[73572]:       <feature policy='require' name='umip'/>
Aug 26 10:07:11 user nova-compute[73572]:       <feature policy='require' name='md-clear'/>
Aug 26 10:07:11 user nova-compute[73572]:       <feature policy='require' name='stibp'/>
Aug 26 10:07:11 user nova-compute[73572]:       <feature policy='require' name='arch-capabilities'/>
Aug 26 10:07:11 user nova-compute[73572]:       <feature policy='require' name='ssbd'/>
Aug 26 10:07:11 user nova-compute[73572]:       <feature policy='require' name='ibpb'/>
Aug 26 10:07:11 user nova-compute[73572]:       <feature policy='require' name='ibrs'/>
Aug 26 10:07:11 user nova-compute[73572]:       <feature policy='require' name='amd-stibp'/>
Aug 26 10:07:11 user nova-compute[73572]:       <feature policy='require' name='amd-ssbd'/>
Aug 26 10:07:11 user nova-compute[73572]:       <feature policy='disable' name='erms'/>
Aug 26 10:07:11 user nova-compute[73572]:       <feature policy='disable' name='xsaveopt'/>
Aug 26 10:07:11 user nova-compute[73572]:       <feature policy='disable' name='lm'/>
Aug 26 10:07:11 user nova-compute[73572]:     </mode>
Aug 26 10:07:11 user nova-compute[73572]:     <mode name='custom' supported='yes'>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>qemu64</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='yes'>qemu32</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>phenom</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='yes'>pentium3</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='yes'>pentium2</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='yes'>pentium</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>n270</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>kvm64</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='yes'>kvm32</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='yes'>coreduo</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>core2duo</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>athlon</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Westmere-IBRS</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Westmere</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Snowridge</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Skylake-Server</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Skylake-Client</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>SandyBridge</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Penryn</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Opteron_G5</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Opteron_G4</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Opteron_G3</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Opteron_G2</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Opteron_G1</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Nehalem-IBRS</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Nehalem</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>IvyBridge</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Icelake-Server</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Haswell-noTSX</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Haswell-IBRS</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Haswell</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>EPYC-Rome</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>EPYC-Milan</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>EPYC-IBPB</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>EPYC</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Dhyana</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Cooperlake</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Conroe</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Cascadelake-Server</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Broadwell-noTSX</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Broadwell-IBRS</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Broadwell</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='yes'>486</model>
Aug 26 10:07:11 user nova-compute[73572]:     </mode>
Aug 26 10:07:11 user nova-compute[73572]:   </cpu>
Aug 26 10:07:11 user nova-compute[73572]:   <memoryBacking supported='yes'>
Aug 26 10:07:11 user nova-compute[73572]:     <enum name='sourceType'>
Aug 26 10:07:11 user nova-compute[73572]:       <value>file</value>
Aug 26 10:07:11 user nova-compute[73572]:       <value>anonymous</value>
Aug 26 10:07:11 user nova-compute[73572]:       <value>memfd</value>
Aug 26 10:07:11 user nova-compute[73572]:     </enum>
Aug 26 10:07:11 user nova-compute[73572]:   </memoryBacking>
Aug 26 10:07:11 user nova-compute[73572]:   <devices>
Aug 26 10:07:11 user nova-compute[73572]:     <disk supported='yes'>
Aug 26 10:07:11 user nova-compute[73572]:       <enum name='diskDevice'>
Aug 26 10:07:11 user nova-compute[73572]:         <value>disk</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>cdrom</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>floppy</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>lun</value>
Aug 26 10:07:11 user nova-compute[73572]:       </enum>
Aug 26 10:07:11 user nova-compute[73572]:       <enum name='bus'>
Aug 26 10:07:11 user nova-compute[73572]:         <value>fdc</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>scsi</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>virtio</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>usb</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>sata</value>
Aug 26 10:07:11 user nova-compute[73572]:       </enum>
Aug 26 10:07:11 user nova-compute[73572]:       <enum name='model'>
Aug 26 10:07:11 user nova-compute[73572]:         <value>virtio</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>virtio-transitional</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>virtio-non-transitional</value>
Aug 26 10:07:11 user nova-compute[73572]:       </enum>
Aug 26 10:07:11 user nova-compute[73572]:     </disk>
Aug 26 10:07:11 user nova-compute[73572]:     <graphics supported='yes'>
Aug 26 10:07:11 user nova-compute[73572]:       <enum name='type'>
Aug 26 10:07:11 user nova-compute[73572]:         <value>sdl</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>vnc</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>spice</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>egl-headless</value>
Aug 26 10:07:11 user nova-compute[73572]:       </enum>
Aug 26 10:07:11 user nova-compute[73572]:     </graphics>
Aug 26 10:07:11 user nova-compute[73572]:     <video supported='yes'>
Aug 26 10:07:11 user nova-compute[73572]:       <enum name='modelType'>
Aug 26 10:07:11 user nova-compute[73572]:         <value>vga</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>cirrus</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>vmvga</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>qxl</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>virtio</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>none</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>bochs</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>ramfb</value>
Aug 26 10:07:11 user nova-compute[73572]:       </enum>
Aug 26 10:07:11 user nova-compute[73572]:     </video>
Aug 26 10:07:11 user nova-compute[73572]:     <hostdev supported='yes'>
Aug 26 10:07:11 user nova-compute[73572]:       <enum name='mode'>
Aug 26 10:07:11 user nova-compute[73572]:         <value>subsystem</value>
Aug 26 10:07:11 user nova-compute[73572]:       </enum>
Aug 26 10:07:11 user nova-compute[73572]:       <enum name='startupPolicy'>
Aug 26 10:07:11 user nova-compute[73572]:         <value>default</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>mandatory</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>requisite</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>optional</value>
Aug 26 10:07:11 user nova-compute[73572]:       </enum>
Aug 26 10:07:11 user nova-compute[73572]:       <enum name='subsysType'>
Aug 26 10:07:11 user nova-compute[73572]:         <value>usb</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>pci</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>scsi</value>
Aug 26 10:07:11 user nova-compute[73572]:       </enum>
Aug 26 10:07:11 user nova-compute[73572]:       <enum name='capsType'/>
Aug 26 10:07:11 user nova-compute[73572]:       <enum name='pciBackend'/>
Aug 26 10:07:11 user nova-compute[73572]:     </hostdev>
Aug 26 10:07:11 user nova-compute[73572]:     <rng supported='yes'>
Aug 26 10:07:11 user nova-compute[73572]:       <enum name='model'>
Aug 26 10:07:11 user nova-compute[73572]:         <value>virtio</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>virtio-transitional</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>virtio-non-transitional</value>
Aug 26 10:07:11 user nova-compute[73572]:       </enum>
Aug 26 10:07:11 user nova-compute[73572]:       <enum name='backendModel'>
Aug 26 10:07:11 user nova-compute[73572]:         <value>random</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>egd</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>builtin</value>
Aug 26 10:07:11 user nova-compute[73572]:       </enum>
Aug 26 10:07:11 user nova-compute[73572]:     </rng>
Aug 26 10:07:11 user nova-compute[73572]:     <filesystem supported='yes'>
Aug 26 10:07:11 user nova-compute[73572]:       <enum name='driverType'>
Aug 26 10:07:11 user nova-compute[73572]:         <value>path</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>handle</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>virtiofs</value>
Aug 26 10:07:11 user nova-compute[73572]:       </enum>
Aug 26 10:07:11 user nova-compute[73572]:     </filesystem>
Aug 26 10:07:11 user nova-compute[73572]:     <tpm supported='yes'>
Aug 26 10:07:11 user nova-compute[73572]:       <enum name='model'>
Aug 26 10:07:11 user nova-compute[73572]:         <value>tpm-tis</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>tpm-crb</value>
Aug 26 10:07:11 user nova-compute[73572]:       </enum>
Aug 26 10:07:11 user nova-compute[73572]:       <enum name='backendModel'>
Aug 26 10:07:11 user nova-compute[73572]:         <value>passthrough</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>emulator</value>
Aug 26 10:07:11 user nova-compute[73572]:       </enum>
Aug 26 10:07:11 user nova-compute[73572]:     </tpm>
Aug 26 10:07:11 user nova-compute[73572]:   </devices>
Aug 26 10:07:11 user nova-compute[73572]:   <features>
Aug 26 10:07:11 user nova-compute[73572]:     <gic supported='no'/>
Aug 26 10:07:11 user nova-compute[73572]:     <vmcoreinfo supported='yes'/>
Aug 26 10:07:11 user nova-compute[73572]:     <genid supported='yes'/>
Aug 26 10:07:11 user nova-compute[73572]:     <backingStoreInput supported='yes'/>
Aug 26 10:07:11 user nova-compute[73572]:     <backup supported='yes'/>
Aug 26 10:07:11 user nova-compute[73572]:     <sev supported='no'/>
Aug 26 10:07:11 user nova-compute[73572]:   </features>
Aug 26 10:07:11 user nova-compute[73572]: </domainCapabilities>
Aug 26 10:07:11 user nova-compute[73572]:  {{(pid=73572) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 26 10:07:11 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Aug 26 10:07:11 user nova-compute[73572]: <domainCapabilities>
Aug 26 10:07:11 user nova-compute[73572]:   <path>/usr/bin/qemu-system-i386</path>
Aug 26 10:07:11 user nova-compute[73572]:   <domain>kvm</domain>
Aug 26 10:07:11 user nova-compute[73572]:   <machine>pc-i440fx-jammy</machine>
Aug 26 10:07:11 user nova-compute[73572]:   <arch>i686</arch>
Aug 26 10:07:11 user nova-compute[73572]:   <vcpu max='255'/>
Aug 26 10:07:11 user nova-compute[73572]:   <iothreads supported='yes'/>
Aug 26 10:07:11 user nova-compute[73572]:   <os supported='yes'>
Aug 26 10:07:11 user nova-compute[73572]:     <enum name='firmware'/>
Aug 26 10:07:11 user nova-compute[73572]:     <loader supported='yes'>
Aug 26 10:07:11 user nova-compute[73572]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 26 10:07:11 user nova-compute[73572]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 26 10:07:11 user nova-compute[73572]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 26 10:07:11 user nova-compute[73572]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 26 10:07:11 user nova-compute[73572]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 26 10:07:11 user nova-compute[73572]:       <enum name='type'>
Aug 26 10:07:11 user nova-compute[73572]:         <value>rom</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>pflash</value>
Aug 26 10:07:11 user nova-compute[73572]:       </enum>
Aug 26 10:07:11 user nova-compute[73572]:       <enum name='readonly'>
Aug 26 10:07:11 user nova-compute[73572]:         <value>yes</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>no</value>
Aug 26 10:07:11 user nova-compute[73572]:       </enum>
Aug 26 10:07:11 user nova-compute[73572]:       <enum name='secure'>
Aug 26 10:07:11 user nova-compute[73572]:         <value>no</value>
Aug 26 10:07:11 user nova-compute[73572]:       </enum>
Aug 26 10:07:11 user nova-compute[73572]:     </loader>
Aug 26 10:07:11 user nova-compute[73572]:   </os>
Aug 26 10:07:11 user nova-compute[73572]:   <cpu>
Aug 26 10:07:11 user nova-compute[73572]:     <mode name='host-passthrough' supported='yes'>
Aug 26 10:07:11 user nova-compute[73572]:       <enum name='hostPassthroughMigratable'>
Aug 26 10:07:11 user nova-compute[73572]:         <value>off</value>
Aug 26 10:07:11 user nova-compute[73572]:       </enum>
Aug 26 10:07:11 user nova-compute[73572]:     </mode>
Aug 26 10:07:11 user nova-compute[73572]:     <mode name='maximum' supported='yes'>
Aug 26 10:07:11 user nova-compute[73572]:       <enum name='maximumMigratable'>
Aug 26 10:07:11 user nova-compute[73572]:         <value>on</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>off</value>
Aug 26 10:07:11 user nova-compute[73572]:       </enum>
Aug 26 10:07:11 user nova-compute[73572]:     </mode>
Aug 26 10:07:11 user nova-compute[73572]:     <mode name='host-model' supported='yes'>
Aug 26 10:07:11 user nova-compute[73572]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 26 10:07:11 user nova-compute[73572]:       <vendor>Intel</vendor>
Aug 26 10:07:11 user nova-compute[73572]:       <feature policy='require' name='ss'/>
Aug 26 10:07:11 user nova-compute[73572]:       <feature policy='require' name='vmx'/>
Aug 26 10:07:11 user nova-compute[73572]:       <feature policy='require' name='pcid'/>
Aug 26 10:07:11 user nova-compute[73572]:       <feature policy='require' name='hypervisor'/>
Aug 26 10:07:11 user nova-compute[73572]:       <feature policy='require' name='arat'/>
Aug 26 10:07:11 user nova-compute[73572]:       <feature policy='require' name='tsc_adjust'/>
Aug 26 10:07:11 user nova-compute[73572]:       <feature policy='require' name='umip'/>
Aug 26 10:07:11 user nova-compute[73572]:       <feature policy='require' name='md-clear'/>
Aug 26 10:07:11 user nova-compute[73572]:       <feature policy='require' name='stibp'/>
Aug 26 10:07:11 user nova-compute[73572]:       <feature policy='require' name='arch-capabilities'/>
Aug 26 10:07:11 user nova-compute[73572]:       <feature policy='require' name='ssbd'/>
Aug 26 10:07:11 user nova-compute[73572]:       <feature policy='require' name='ibpb'/>
Aug 26 10:07:11 user nova-compute[73572]:       <feature policy='require' name='ibrs'/>
Aug 26 10:07:11 user nova-compute[73572]:       <feature policy='require' name='amd-stibp'/>
Aug 26 10:07:11 user nova-compute[73572]:       <feature policy='require' name='amd-ssbd'/>
Aug 26 10:07:11 user nova-compute[73572]:       <feature policy='disable' name='erms'/>
Aug 26 10:07:11 user nova-compute[73572]:       <feature policy='disable' name='xsaveopt'/>
Aug 26 10:07:11 user nova-compute[73572]:       <feature policy='disable' name='lm'/>
Aug 26 10:07:11 user nova-compute[73572]:     </mode>
Aug 26 10:07:11 user nova-compute[73572]:     <mode name='custom' supported='yes'>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>qemu64</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='yes'>qemu32</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>phenom</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='yes'>pentium3</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='yes'>pentium2</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='yes'>pentium</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>n270</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>kvm64</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='yes'>kvm32</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='yes'>coreduo</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>core2duo</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>athlon</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Westmere-IBRS</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Westmere</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Snowridge</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Skylake-Server</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Skylake-Client</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>SandyBridge</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Penryn</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Opteron_G5</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Opteron_G4</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Opteron_G3</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Opteron_G2</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Opteron_G1</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Nehalem-IBRS</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Nehalem</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>IvyBridge</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Icelake-Server</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Haswell-noTSX</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Haswell-IBRS</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Haswell</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>EPYC-Rome</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>EPYC-Milan</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>EPYC-IBPB</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>EPYC</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Dhyana</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Cooperlake</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Conroe</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Cascadelake-Server</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Broadwell-noTSX</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Broadwell-IBRS</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Broadwell</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='yes'>486</model>
Aug 26 10:07:11 user nova-compute[73572]:     </mode>
Aug 26 10:07:11 user nova-compute[73572]:   </cpu>
Aug 26 10:07:11 user nova-compute[73572]:   <memoryBacking supported='yes'>
Aug 26 10:07:11 user nova-compute[73572]:     <enum name='sourceType'>
Aug 26 10:07:11 user nova-compute[73572]:       <value>file</value>
Aug 26 10:07:11 user nova-compute[73572]:       <value>anonymous</value>
Aug 26 10:07:11 user nova-compute[73572]:       <value>memfd</value>
Aug 26 10:07:11 user nova-compute[73572]:     </enum>
Aug 26 10:07:11 user nova-compute[73572]:   </memoryBacking>
Aug 26 10:07:11 user nova-compute[73572]:   <devices>
Aug 26 10:07:11 user nova-compute[73572]:     <disk supported='yes'>
Aug 26 10:07:11 user nova-compute[73572]:       <enum name='diskDevice'>
Aug 26 10:07:11 user nova-compute[73572]:         <value>disk</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>cdrom</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>floppy</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>lun</value>
Aug 26 10:07:11 user nova-compute[73572]:       </enum>
Aug 26 10:07:11 user nova-compute[73572]:       <enum name='bus'>
Aug 26 10:07:11 user nova-compute[73572]:         <value>ide</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>fdc</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>scsi</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>virtio</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>usb</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>sata</value>
Aug 26 10:07:11 user nova-compute[73572]:       </enum>
Aug 26 10:07:11 user nova-compute[73572]:       <enum name='model'>
Aug 26 10:07:11 user nova-compute[73572]:         <value>virtio</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>virtio-transitional</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>virtio-non-transitional</value>
Aug 26 10:07:11 user nova-compute[73572]:       </enum>
Aug 26 10:07:11 user nova-compute[73572]:     </disk>
Aug 26 10:07:11 user nova-compute[73572]:     <graphics supported='yes'>
Aug 26 10:07:11 user nova-compute[73572]:       <enum name='type'>
Aug 26 10:07:11 user nova-compute[73572]:         <value>sdl</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>vnc</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>spice</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>egl-headless</value>
Aug 26 10:07:11 user nova-compute[73572]:       </enum>
Aug 26 10:07:11 user nova-compute[73572]:     </graphics>
Aug 26 10:07:11 user nova-compute[73572]:     <video supported='yes'>
Aug 26 10:07:11 user nova-compute[73572]:       <enum name='modelType'>
Aug 26 10:07:11 user nova-compute[73572]:         <value>vga</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>cirrus</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>vmvga</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>qxl</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>virtio</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>none</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>bochs</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>ramfb</value>
Aug 26 10:07:11 user nova-compute[73572]:       </enum>
Aug 26 10:07:11 user nova-compute[73572]:     </video>
Aug 26 10:07:11 user nova-compute[73572]:     <hostdev supported='yes'>
Aug 26 10:07:11 user nova-compute[73572]:       <enum name='mode'>
Aug 26 10:07:11 user nova-compute[73572]:         <value>subsystem</value>
Aug 26 10:07:11 user nova-compute[73572]:       </enum>
Aug 26 10:07:11 user nova-compute[73572]:       <enum name='startupPolicy'>
Aug 26 10:07:11 user nova-compute[73572]:         <value>default</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>mandatory</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>requisite</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>optional</value>
Aug 26 10:07:11 user nova-compute[73572]:       </enum>
Aug 26 10:07:11 user nova-compute[73572]:       <enum name='subsysType'>
Aug 26 10:07:11 user nova-compute[73572]:         <value>usb</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>pci</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>scsi</value>
Aug 26 10:07:11 user nova-compute[73572]:       </enum>
Aug 26 10:07:11 user nova-compute[73572]:       <enum name='capsType'/>
Aug 26 10:07:11 user nova-compute[73572]:       <enum name='pciBackend'/>
Aug 26 10:07:11 user nova-compute[73572]:     </hostdev>
Aug 26 10:07:11 user nova-compute[73572]:     <rng supported='yes'>
Aug 26 10:07:11 user nova-compute[73572]:       <enum name='model'>
Aug 26 10:07:11 user nova-compute[73572]:         <value>virtio</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>virtio-transitional</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>virtio-non-transitional</value>
Aug 26 10:07:11 user nova-compute[73572]:       </enum>
Aug 26 10:07:11 user nova-compute[73572]:       <enum name='backendModel'>
Aug 26 10:07:11 user nova-compute[73572]:         <value>random</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>egd</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>builtin</value>
Aug 26 10:07:11 user nova-compute[73572]:       </enum>
Aug 26 10:07:11 user nova-compute[73572]:     </rng>
Aug 26 10:07:11 user nova-compute[73572]:     <filesystem supported='yes'>
Aug 26 10:07:11 user nova-compute[73572]:       <enum name='driverType'>
Aug 26 10:07:11 user nova-compute[73572]:         <value>path</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>handle</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>virtiofs</value>
Aug 26 10:07:11 user nova-compute[73572]:       </enum>
Aug 26 10:07:11 user nova-compute[73572]:     </filesystem>
Aug 26 10:07:11 user nova-compute[73572]:     <tpm supported='yes'>
Aug 26 10:07:11 user nova-compute[73572]:       <enum name='model'>
Aug 26 10:07:11 user nova-compute[73572]:         <value>tpm-tis</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>tpm-crb</value>
Aug 26 10:07:11 user nova-compute[73572]:       </enum>
Aug 26 10:07:11 user nova-compute[73572]:       <enum name='backendModel'>
Aug 26 10:07:11 user nova-compute[73572]:         <value>passthrough</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>emulator</value>
Aug 26 10:07:11 user nova-compute[73572]:       </enum>
Aug 26 10:07:11 user nova-compute[73572]:     </tpm>
Aug 26 10:07:11 user nova-compute[73572]:   </devices>
Aug 26 10:07:11 user nova-compute[73572]:   <features>
Aug 26 10:07:11 user nova-compute[73572]:     <gic supported='no'/>
Aug 26 10:07:11 user nova-compute[73572]:     <vmcoreinfo supported='yes'/>
Aug 26 10:07:11 user nova-compute[73572]:     <genid supported='yes'/>
Aug 26 10:07:11 user nova-compute[73572]:     <backingStoreInput supported='yes'/>
Aug 26 10:07:11 user nova-compute[73572]:     <backup supported='yes'/>
Aug 26 10:07:11 user nova-compute[73572]:     <sev supported='no'/>
Aug 26 10:07:11 user nova-compute[73572]:   </features>
Aug 26 10:07:11 user nova-compute[73572]: </domainCapabilities>
Aug 26 10:07:11 user nova-compute[73572]:  {{(pid=73572) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 26 10:07:11 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Aug 26 10:07:11 user nova-compute[73572]: <domainCapabilities>
Aug 26 10:07:11 user nova-compute[73572]:   <path>/usr/bin/qemu-system-i386</path>
Aug 26 10:07:11 user nova-compute[73572]:   <domain>kvm</domain>
Aug 26 10:07:11 user nova-compute[73572]:   <machine>pc-q35-jammy</machine>
Aug 26 10:07:11 user nova-compute[73572]:   <arch>i686</arch>
Aug 26 10:07:11 user nova-compute[73572]:   <vcpu max='288'/>
Aug 26 10:07:11 user nova-compute[73572]:   <iothreads supported='yes'/>
Aug 26 10:07:11 user nova-compute[73572]:   <os supported='yes'>
Aug 26 10:07:11 user nova-compute[73572]:     <enum name='firmware'/>
Aug 26 10:07:11 user nova-compute[73572]:     <loader supported='yes'>
Aug 26 10:07:11 user nova-compute[73572]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 26 10:07:11 user nova-compute[73572]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 26 10:07:11 user nova-compute[73572]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 26 10:07:11 user nova-compute[73572]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 26 10:07:11 user nova-compute[73572]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 26 10:07:11 user nova-compute[73572]:       <enum name='type'>
Aug 26 10:07:11 user nova-compute[73572]:         <value>rom</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>pflash</value>
Aug 26 10:07:11 user nova-compute[73572]:       </enum>
Aug 26 10:07:11 user nova-compute[73572]:       <enum name='readonly'>
Aug 26 10:07:11 user nova-compute[73572]:         <value>yes</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>no</value>
Aug 26 10:07:11 user nova-compute[73572]:       </enum>
Aug 26 10:07:11 user nova-compute[73572]:       <enum name='secure'>
Aug 26 10:07:11 user nova-compute[73572]:         <value>no</value>
Aug 26 10:07:11 user nova-compute[73572]:       </enum>
Aug 26 10:07:11 user nova-compute[73572]:     </loader>
Aug 26 10:07:11 user nova-compute[73572]:   </os>
Aug 26 10:07:11 user nova-compute[73572]:   <cpu>
Aug 26 10:07:11 user nova-compute[73572]:     <mode name='host-passthrough' supported='yes'>
Aug 26 10:07:11 user nova-compute[73572]:       <enum name='hostPassthroughMigratable'>
Aug 26 10:07:11 user nova-compute[73572]:         <value>off</value>
Aug 26 10:07:11 user nova-compute[73572]:       </enum>
Aug 26 10:07:11 user nova-compute[73572]:     </mode>
Aug 26 10:07:11 user nova-compute[73572]:     <mode name='maximum' supported='yes'>
Aug 26 10:07:11 user nova-compute[73572]:       <enum name='maximumMigratable'>
Aug 26 10:07:11 user nova-compute[73572]:         <value>on</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>off</value>
Aug 26 10:07:11 user nova-compute[73572]:       </enum>
Aug 26 10:07:11 user nova-compute[73572]:     </mode>
Aug 26 10:07:11 user nova-compute[73572]:     <mode name='host-model' supported='yes'>
Aug 26 10:07:11 user nova-compute[73572]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 26 10:07:11 user nova-compute[73572]:       <vendor>Intel</vendor>
Aug 26 10:07:11 user nova-compute[73572]:       <feature policy='require' name='ss'/>
Aug 26 10:07:11 user nova-compute[73572]:       <feature policy='require' name='vmx'/>
Aug 26 10:07:11 user nova-compute[73572]:       <feature policy='require' name='pcid'/>
Aug 26 10:07:11 user nova-compute[73572]:       <feature policy='require' name='hypervisor'/>
Aug 26 10:07:11 user nova-compute[73572]:       <feature policy='require' name='arat'/>
Aug 26 10:07:11 user nova-compute[73572]:       <feature policy='require' name='tsc_adjust'/>
Aug 26 10:07:11 user nova-compute[73572]:       <feature policy='require' name='umip'/>
Aug 26 10:07:11 user nova-compute[73572]:       <feature policy='require' name='md-clear'/>
Aug 26 10:07:11 user nova-compute[73572]:       <feature policy='require' name='stibp'/>
Aug 26 10:07:11 user nova-compute[73572]:       <feature policy='require' name='arch-capabilities'/>
Aug 26 10:07:11 user nova-compute[73572]:       <feature policy='require' name='ssbd'/>
Aug 26 10:07:11 user nova-compute[73572]:       <feature policy='require' name='ibpb'/>
Aug 26 10:07:11 user nova-compute[73572]:       <feature policy='require' name='ibrs'/>
Aug 26 10:07:11 user nova-compute[73572]:       <feature policy='require' name='amd-stibp'/>
Aug 26 10:07:11 user nova-compute[73572]:       <feature policy='require' name='amd-ssbd'/>
Aug 26 10:07:11 user nova-compute[73572]:       <feature policy='disable' name='erms'/>
Aug 26 10:07:11 user nova-compute[73572]:       <feature policy='disable' name='xsaveopt'/>
Aug 26 10:07:11 user nova-compute[73572]:       <feature policy='disable' name='lm'/>
Aug 26 10:07:11 user nova-compute[73572]:     </mode>
Aug 26 10:07:11 user nova-compute[73572]:     <mode name='custom' supported='yes'>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>qemu64</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='yes'>qemu32</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>phenom</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='yes'>pentium3</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='yes'>pentium2</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='yes'>pentium</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>n270</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>kvm64</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='yes'>kvm32</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='yes'>coreduo</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>core2duo</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>athlon</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Westmere-IBRS</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Westmere</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Snowridge</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Skylake-Server</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Skylake-Client</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>SandyBridge</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Penryn</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Opteron_G5</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Opteron_G4</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Opteron_G3</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Opteron_G2</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Opteron_G1</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Nehalem-IBRS</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Nehalem</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>IvyBridge</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Icelake-Server</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Haswell-noTSX</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Haswell-IBRS</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Haswell</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>EPYC-Rome</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>EPYC-Milan</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>EPYC-IBPB</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>EPYC</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Dhyana</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Cooperlake</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Conroe</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Cascadelake-Server</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Broadwell-noTSX</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Broadwell-IBRS</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Broadwell</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='yes'>486</model>
Aug 26 10:07:11 user nova-compute[73572]:     </mode>
Aug 26 10:07:11 user nova-compute[73572]:   </cpu>
Aug 26 10:07:11 user nova-compute[73572]:   <memoryBacking supported='yes'>
Aug 26 10:07:11 user nova-compute[73572]:     <enum name='sourceType'>
Aug 26 10:07:11 user nova-compute[73572]:       <value>file</value>
Aug 26 10:07:11 user nova-compute[73572]:       <value>anonymous</value>
Aug 26 10:07:11 user nova-compute[73572]:       <value>memfd</value>
Aug 26 10:07:11 user nova-compute[73572]:     </enum>
Aug 26 10:07:11 user nova-compute[73572]:   </memoryBacking>
Aug 26 10:07:11 user nova-compute[73572]:   <devices>
Aug 26 10:07:11 user nova-compute[73572]:     <disk supported='yes'>
Aug 26 10:07:11 user nova-compute[73572]:       <enum name='diskDevice'>
Aug 26 10:07:11 user nova-compute[73572]:         <value>disk</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>cdrom</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>floppy</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>lun</value>
Aug 26 10:07:11 user nova-compute[73572]:       </enum>
Aug 26 10:07:11 user nova-compute[73572]:       <enum name='bus'>
Aug 26 10:07:11 user nova-compute[73572]:         <value>fdc</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>scsi</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>virtio</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>usb</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>sata</value>
Aug 26 10:07:11 user nova-compute[73572]:       </enum>
Aug 26 10:07:11 user nova-compute[73572]:       <enum name='model'>
Aug 26 10:07:11 user nova-compute[73572]:         <value>virtio</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>virtio-transitional</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>virtio-non-transitional</value>
Aug 26 10:07:11 user nova-compute[73572]:       </enum>
Aug 26 10:07:11 user nova-compute[73572]:     </disk>
Aug 26 10:07:11 user nova-compute[73572]:     <graphics supported='yes'>
Aug 26 10:07:11 user nova-compute[73572]:       <enum name='type'>
Aug 26 10:07:11 user nova-compute[73572]:         <value>sdl</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>vnc</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>spice</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>egl-headless</value>
Aug 26 10:07:11 user nova-compute[73572]:       </enum>
Aug 26 10:07:11 user nova-compute[73572]:     </graphics>
Aug 26 10:07:11 user nova-compute[73572]:     <video supported='yes'>
Aug 26 10:07:11 user nova-compute[73572]:       <enum name='modelType'>
Aug 26 10:07:11 user nova-compute[73572]:         <value>vga</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>cirrus</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>vmvga</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>qxl</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>virtio</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>none</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>bochs</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>ramfb</value>
Aug 26 10:07:11 user nova-compute[73572]:       </enum>
Aug 26 10:07:11 user nova-compute[73572]:     </video>
Aug 26 10:07:11 user nova-compute[73572]:     <hostdev supported='yes'>
Aug 26 10:07:11 user nova-compute[73572]:       <enum name='mode'>
Aug 26 10:07:11 user nova-compute[73572]:         <value>subsystem</value>
Aug 26 10:07:11 user nova-compute[73572]:       </enum>
Aug 26 10:07:11 user nova-compute[73572]:       <enum name='startupPolicy'>
Aug 26 10:07:11 user nova-compute[73572]:         <value>default</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>mandatory</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>requisite</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>optional</value>
Aug 26 10:07:11 user nova-compute[73572]:       </enum>
Aug 26 10:07:11 user nova-compute[73572]:       <enum name='subsysType'>
Aug 26 10:07:11 user nova-compute[73572]:         <value>usb</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>pci</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>scsi</value>
Aug 26 10:07:11 user nova-compute[73572]:       </enum>
Aug 26 10:07:11 user nova-compute[73572]:       <enum name='capsType'/>
Aug 26 10:07:11 user nova-compute[73572]:       <enum name='pciBackend'/>
Aug 26 10:07:11 user nova-compute[73572]:     </hostdev>
Aug 26 10:07:11 user nova-compute[73572]:     <rng supported='yes'>
Aug 26 10:07:11 user nova-compute[73572]:       <enum name='model'>
Aug 26 10:07:11 user nova-compute[73572]:         <value>virtio</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>virtio-transitional</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>virtio-non-transitional</value>
Aug 26 10:07:11 user nova-compute[73572]:       </enum>
Aug 26 10:07:11 user nova-compute[73572]:       <enum name='backendModel'>
Aug 26 10:07:11 user nova-compute[73572]:         <value>random</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>egd</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>builtin</value>
Aug 26 10:07:11 user nova-compute[73572]:       </enum>
Aug 26 10:07:11 user nova-compute[73572]:     </rng>
Aug 26 10:07:11 user nova-compute[73572]:     <filesystem supported='yes'>
Aug 26 10:07:11 user nova-compute[73572]:       <enum name='driverType'>
Aug 26 10:07:11 user nova-compute[73572]:         <value>path</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>handle</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>virtiofs</value>
Aug 26 10:07:11 user nova-compute[73572]:       </enum>
Aug 26 10:07:11 user nova-compute[73572]:     </filesystem>
Aug 26 10:07:11 user nova-compute[73572]:     <tpm supported='yes'>
Aug 26 10:07:11 user nova-compute[73572]:       <enum name='model'>
Aug 26 10:07:11 user nova-compute[73572]:         <value>tpm-tis</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>tpm-crb</value>
Aug 26 10:07:11 user nova-compute[73572]:       </enum>
Aug 26 10:07:11 user nova-compute[73572]:       <enum name='backendModel'>
Aug 26 10:07:11 user nova-compute[73572]:         <value>passthrough</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>emulator</value>
Aug 26 10:07:11 user nova-compute[73572]:       </enum>
Aug 26 10:07:11 user nova-compute[73572]:     </tpm>
Aug 26 10:07:11 user nova-compute[73572]:   </devices>
Aug 26 10:07:11 user nova-compute[73572]:   <features>
Aug 26 10:07:11 user nova-compute[73572]:     <gic supported='no'/>
Aug 26 10:07:11 user nova-compute[73572]:     <vmcoreinfo supported='yes'/>
Aug 26 10:07:11 user nova-compute[73572]:     <genid supported='yes'/>
Aug 26 10:07:11 user nova-compute[73572]:     <backingStoreInput supported='yes'/>
Aug 26 10:07:11 user nova-compute[73572]:     <backup supported='yes'/>
Aug 26 10:07:11 user nova-compute[73572]:     <sev supported='no'/>
Aug 26 10:07:11 user nova-compute[73572]:   </features>
Aug 26 10:07:11 user nova-compute[73572]: </domainCapabilities>
Aug 26 10:07:11 user nova-compute[73572]:  {{(pid=73572) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 26 10:07:11 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=73572) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 10:07:11 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=73572) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 10:07:11 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=73572) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 10:07:11 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=73572) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 10:07:11 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=73572) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 10:07:11 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=73572) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 10:07:11 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=73572) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 10:07:11 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Getting domain capabilities for mips via machine types: {None} {{(pid=73572) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 10:07:11 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=73572) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 10:07:11 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=73572) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 10:07:11 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=73572) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 10:07:11 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=73572) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 10:07:11 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=73572) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 10:07:11 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=73572) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 10:07:11 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=73572) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 10:07:11 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=73572) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 10:07:11 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=73572) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 10:07:11 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Getting domain capabilities for ppc64 via machine types: {'pseries', 'powernv', None} {{(pid=73572) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 10:07:11 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=73572) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 10:07:11 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=73572) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 10:07:11 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=73572) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 10:07:11 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Getting domain capabilities for ppc64le via machine types: {'pseries', 'powernv'} {{(pid=73572) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 10:07:11 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=73572) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 10:07:11 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=73572) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 10:07:11 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=73572) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 10:07:11 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=73572) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 10:07:11 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=73572) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 10:07:11 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=73572) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 10:07:11 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=73572) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 10:07:11 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=73572) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 10:07:11 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=73572) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 10:07:11 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=73572) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 10:07:11 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=73572) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 10:07:11 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=73572) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 10:07:11 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=73572) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 10:07:11 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=73572) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 10:07:11 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=73572) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 10:07:11 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=73572) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 10:07:11 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Getting domain capabilities for x86_64 via machine types: {'pc', 'q35', 'ubuntu', 'ubuntu-q35'} {{(pid=73572) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 10:07:11 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Aug 26 10:07:11 user nova-compute[73572]: <domainCapabilities>
Aug 26 10:07:11 user nova-compute[73572]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 26 10:07:11 user nova-compute[73572]:   <domain>kvm</domain>
Aug 26 10:07:11 user nova-compute[73572]:   <machine>pc-i440fx-6.2</machine>
Aug 26 10:07:11 user nova-compute[73572]:   <arch>x86_64</arch>
Aug 26 10:07:11 user nova-compute[73572]:   <vcpu max='255'/>
Aug 26 10:07:11 user nova-compute[73572]:   <iothreads supported='yes'/>
Aug 26 10:07:11 user nova-compute[73572]:   <os supported='yes'>
Aug 26 10:07:11 user nova-compute[73572]:     <enum name='firmware'>
Aug 26 10:07:11 user nova-compute[73572]:       <value>efi</value>
Aug 26 10:07:11 user nova-compute[73572]:     </enum>
Aug 26 10:07:11 user nova-compute[73572]:     <loader supported='yes'>
Aug 26 10:07:11 user nova-compute[73572]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 26 10:07:11 user nova-compute[73572]:       <enum name='type'>
Aug 26 10:07:11 user nova-compute[73572]:         <value>rom</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>pflash</value>
Aug 26 10:07:11 user nova-compute[73572]:       </enum>
Aug 26 10:07:11 user nova-compute[73572]:       <enum name='readonly'>
Aug 26 10:07:11 user nova-compute[73572]:         <value>yes</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>no</value>
Aug 26 10:07:11 user nova-compute[73572]:       </enum>
Aug 26 10:07:11 user nova-compute[73572]:       <enum name='secure'>
Aug 26 10:07:11 user nova-compute[73572]:         <value>no</value>
Aug 26 10:07:11 user nova-compute[73572]:       </enum>
Aug 26 10:07:11 user nova-compute[73572]:     </loader>
Aug 26 10:07:11 user nova-compute[73572]:   </os>
Aug 26 10:07:11 user nova-compute[73572]:   <cpu>
Aug 26 10:07:11 user nova-compute[73572]:     <mode name='host-passthrough' supported='yes'>
Aug 26 10:07:11 user nova-compute[73572]:       <enum name='hostPassthroughMigratable'>
Aug 26 10:07:11 user nova-compute[73572]:         <value>on</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>off</value>
Aug 26 10:07:11 user nova-compute[73572]:       </enum>
Aug 26 10:07:11 user nova-compute[73572]:     </mode>
Aug 26 10:07:11 user nova-compute[73572]:     <mode name='maximum' supported='yes'>
Aug 26 10:07:11 user nova-compute[73572]:       <enum name='maximumMigratable'>
Aug 26 10:07:11 user nova-compute[73572]:         <value>on</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>off</value>
Aug 26 10:07:11 user nova-compute[73572]:       </enum>
Aug 26 10:07:11 user nova-compute[73572]:     </mode>
Aug 26 10:07:11 user nova-compute[73572]:     <mode name='host-model' supported='yes'>
Aug 26 10:07:11 user nova-compute[73572]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 26 10:07:11 user nova-compute[73572]:       <vendor>Intel</vendor>
Aug 26 10:07:11 user nova-compute[73572]:       <feature policy='require' name='ss'/>
Aug 26 10:07:11 user nova-compute[73572]:       <feature policy='require' name='vmx'/>
Aug 26 10:07:11 user nova-compute[73572]:       <feature policy='require' name='pcid'/>
Aug 26 10:07:11 user nova-compute[73572]:       <feature policy='require' name='hypervisor'/>
Aug 26 10:07:11 user nova-compute[73572]:       <feature policy='require' name='arat'/>
Aug 26 10:07:11 user nova-compute[73572]:       <feature policy='require' name='tsc_adjust'/>
Aug 26 10:07:11 user nova-compute[73572]:       <feature policy='require' name='umip'/>
Aug 26 10:07:11 user nova-compute[73572]:       <feature policy='require' name='md-clear'/>
Aug 26 10:07:11 user nova-compute[73572]:       <feature policy='require' name='stibp'/>
Aug 26 10:07:11 user nova-compute[73572]:       <feature policy='require' name='arch-capabilities'/>
Aug 26 10:07:11 user nova-compute[73572]:       <feature policy='require' name='ssbd'/>
Aug 26 10:07:11 user nova-compute[73572]:       <feature policy='require' name='invtsc'/>
Aug 26 10:07:11 user nova-compute[73572]:       <feature policy='require' name='ibpb'/>
Aug 26 10:07:11 user nova-compute[73572]:       <feature policy='require' name='ibrs'/>
Aug 26 10:07:11 user nova-compute[73572]:       <feature policy='require' name='amd-stibp'/>
Aug 26 10:07:11 user nova-compute[73572]:       <feature policy='require' name='amd-ssbd'/>
Aug 26 10:07:11 user nova-compute[73572]:       <feature policy='require' name='rsba'/>
Aug 26 10:07:11 user nova-compute[73572]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 26 10:07:11 user nova-compute[73572]:       <feature policy='require' name='pschange-mc-no'/>
Aug 26 10:07:11 user nova-compute[73572]:       <feature policy='disable' name='erms'/>
Aug 26 10:07:11 user nova-compute[73572]:       <feature policy='disable' name='xsaveopt'/>
Aug 26 10:07:11 user nova-compute[73572]:     </mode>
Aug 26 10:07:11 user nova-compute[73572]:     <mode name='custom' supported='yes'>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>qemu64</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='yes'>qemu32</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>phenom</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='yes'>pentium3</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='yes'>pentium2</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='yes'>pentium</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>n270</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='yes'>kvm64</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='yes'>kvm32</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='yes'>coreduo</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='yes'>core2duo</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>athlon</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='yes'>Westmere-IBRS</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='yes'>Westmere</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Snowridge</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Skylake-Server</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Skylake-Client</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>SandyBridge</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='yes'>Penryn</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Opteron_G5</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Opteron_G4</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Opteron_G3</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Opteron_G2</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='yes'>Opteron_G1</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='yes'>Nehalem</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>IvyBridge</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Icelake-Server</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Haswell-noTSX</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Haswell-IBRS</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Haswell</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>EPYC-Rome</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>EPYC-Milan</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>EPYC-IBPB</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>EPYC</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Dhyana</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Cooperlake</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='yes'>Conroe</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Cascadelake-Server</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Broadwell-noTSX</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Broadwell-IBRS</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Broadwell</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='yes'>486</model>
Aug 26 10:07:11 user nova-compute[73572]:     </mode>
Aug 26 10:07:11 user nova-compute[73572]:   </cpu>
Aug 26 10:07:11 user nova-compute[73572]:   <memoryBacking supported='yes'>
Aug 26 10:07:11 user nova-compute[73572]:     <enum name='sourceType'>
Aug 26 10:07:11 user nova-compute[73572]:       <value>file</value>
Aug 26 10:07:11 user nova-compute[73572]:       <value>anonymous</value>
Aug 26 10:07:11 user nova-compute[73572]:       <value>memfd</value>
Aug 26 10:07:11 user nova-compute[73572]:     </enum>
Aug 26 10:07:11 user nova-compute[73572]:   </memoryBacking>
Aug 26 10:07:11 user nova-compute[73572]:   <devices>
Aug 26 10:07:11 user nova-compute[73572]:     <disk supported='yes'>
Aug 26 10:07:11 user nova-compute[73572]:       <enum name='diskDevice'>
Aug 26 10:07:11 user nova-compute[73572]:         <value>disk</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>cdrom</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>floppy</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>lun</value>
Aug 26 10:07:11 user nova-compute[73572]:       </enum>
Aug 26 10:07:11 user nova-compute[73572]:       <enum name='bus'>
Aug 26 10:07:11 user nova-compute[73572]:         <value>ide</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>fdc</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>scsi</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>virtio</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>usb</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>sata</value>
Aug 26 10:07:11 user nova-compute[73572]:       </enum>
Aug 26 10:07:11 user nova-compute[73572]:       <enum name='model'>
Aug 26 10:07:11 user nova-compute[73572]:         <value>virtio</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>virtio-transitional</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>virtio-non-transitional</value>
Aug 26 10:07:11 user nova-compute[73572]:       </enum>
Aug 26 10:07:11 user nova-compute[73572]:     </disk>
Aug 26 10:07:11 user nova-compute[73572]:     <graphics supported='yes'>
Aug 26 10:07:11 user nova-compute[73572]:       <enum name='type'>
Aug 26 10:07:11 user nova-compute[73572]:         <value>sdl</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>vnc</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>spice</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>egl-headless</value>
Aug 26 10:07:11 user nova-compute[73572]:       </enum>
Aug 26 10:07:11 user nova-compute[73572]:     </graphics>
Aug 26 10:07:11 user nova-compute[73572]:     <video supported='yes'>
Aug 26 10:07:11 user nova-compute[73572]:       <enum name='modelType'>
Aug 26 10:07:11 user nova-compute[73572]:         <value>vga</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>cirrus</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>vmvga</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>qxl</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>virtio</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>none</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>bochs</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>ramfb</value>
Aug 26 10:07:11 user nova-compute[73572]:       </enum>
Aug 26 10:07:11 user nova-compute[73572]:     </video>
Aug 26 10:07:11 user nova-compute[73572]:     <hostdev supported='yes'>
Aug 26 10:07:11 user nova-compute[73572]:       <enum name='mode'>
Aug 26 10:07:11 user nova-compute[73572]:         <value>subsystem</value>
Aug 26 10:07:11 user nova-compute[73572]:       </enum>
Aug 26 10:07:11 user nova-compute[73572]:       <enum name='startupPolicy'>
Aug 26 10:07:11 user nova-compute[73572]:         <value>default</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>mandatory</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>requisite</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>optional</value>
Aug 26 10:07:11 user nova-compute[73572]:       </enum>
Aug 26 10:07:11 user nova-compute[73572]:       <enum name='subsysType'>
Aug 26 10:07:11 user nova-compute[73572]:         <value>usb</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>pci</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>scsi</value>
Aug 26 10:07:11 user nova-compute[73572]:       </enum>
Aug 26 10:07:11 user nova-compute[73572]:       <enum name='capsType'/>
Aug 26 10:07:11 user nova-compute[73572]:       <enum name='pciBackend'/>
Aug 26 10:07:11 user nova-compute[73572]:     </hostdev>
Aug 26 10:07:11 user nova-compute[73572]:     <rng supported='yes'>
Aug 26 10:07:11 user nova-compute[73572]:       <enum name='model'>
Aug 26 10:07:11 user nova-compute[73572]:         <value>virtio</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>virtio-transitional</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>virtio-non-transitional</value>
Aug 26 10:07:11 user nova-compute[73572]:       </enum>
Aug 26 10:07:11 user nova-compute[73572]:       <enum name='backendModel'>
Aug 26 10:07:11 user nova-compute[73572]:         <value>random</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>egd</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>builtin</value>
Aug 26 10:07:11 user nova-compute[73572]:       </enum>
Aug 26 10:07:11 user nova-compute[73572]:     </rng>
Aug 26 10:07:11 user nova-compute[73572]:     <filesystem supported='yes'>
Aug 26 10:07:11 user nova-compute[73572]:       <enum name='driverType'>
Aug 26 10:07:11 user nova-compute[73572]:         <value>path</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>handle</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>virtiofs</value>
Aug 26 10:07:11 user nova-compute[73572]:       </enum>
Aug 26 10:07:11 user nova-compute[73572]:     </filesystem>
Aug 26 10:07:11 user nova-compute[73572]:     <tpm supported='yes'>
Aug 26 10:07:11 user nova-compute[73572]:       <enum name='model'>
Aug 26 10:07:11 user nova-compute[73572]:         <value>tpm-tis</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>tpm-crb</value>
Aug 26 10:07:11 user nova-compute[73572]:       </enum>
Aug 26 10:07:11 user nova-compute[73572]:       <enum name='backendModel'>
Aug 26 10:07:11 user nova-compute[73572]:         <value>passthrough</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>emulator</value>
Aug 26 10:07:11 user nova-compute[73572]:       </enum>
Aug 26 10:07:11 user nova-compute[73572]:     </tpm>
Aug 26 10:07:11 user nova-compute[73572]:   </devices>
Aug 26 10:07:11 user nova-compute[73572]:   <features>
Aug 26 10:07:11 user nova-compute[73572]:     <gic supported='no'/>
Aug 26 10:07:11 user nova-compute[73572]:     <vmcoreinfo supported='yes'/>
Aug 26 10:07:11 user nova-compute[73572]:     <genid supported='yes'/>
Aug 26 10:07:11 user nova-compute[73572]:     <backingStoreInput supported='yes'/>
Aug 26 10:07:11 user nova-compute[73572]:     <backup supported='yes'/>
Aug 26 10:07:11 user nova-compute[73572]:     <sev supported='no'/>
Aug 26 10:07:11 user nova-compute[73572]:   </features>
Aug 26 10:07:11 user nova-compute[73572]: </domainCapabilities>
Aug 26 10:07:11 user nova-compute[73572]:  {{(pid=73572) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 26 10:07:11 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Aug 26 10:07:11 user nova-compute[73572]: <domainCapabilities>
Aug 26 10:07:11 user nova-compute[73572]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 26 10:07:11 user nova-compute[73572]:   <domain>kvm</domain>
Aug 26 10:07:11 user nova-compute[73572]:   <machine>pc-q35-6.2</machine>
Aug 26 10:07:11 user nova-compute[73572]:   <arch>x86_64</arch>
Aug 26 10:07:11 user nova-compute[73572]:   <vcpu max='288'/>
Aug 26 10:07:11 user nova-compute[73572]:   <iothreads supported='yes'/>
Aug 26 10:07:11 user nova-compute[73572]:   <os supported='yes'>
Aug 26 10:07:11 user nova-compute[73572]:     <enum name='firmware'>
Aug 26 10:07:11 user nova-compute[73572]:       <value>efi</value>
Aug 26 10:07:11 user nova-compute[73572]:     </enum>
Aug 26 10:07:11 user nova-compute[73572]:     <loader supported='yes'>
Aug 26 10:07:11 user nova-compute[73572]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Aug 26 10:07:11 user nova-compute[73572]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Aug 26 10:07:11 user nova-compute[73572]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 26 10:07:11 user nova-compute[73572]:       <enum name='type'>
Aug 26 10:07:11 user nova-compute[73572]:         <value>rom</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>pflash</value>
Aug 26 10:07:11 user nova-compute[73572]:       </enum>
Aug 26 10:07:11 user nova-compute[73572]:       <enum name='readonly'>
Aug 26 10:07:11 user nova-compute[73572]:         <value>yes</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>no</value>
Aug 26 10:07:11 user nova-compute[73572]:       </enum>
Aug 26 10:07:11 user nova-compute[73572]:       <enum name='secure'>
Aug 26 10:07:11 user nova-compute[73572]:         <value>yes</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>no</value>
Aug 26 10:07:11 user nova-compute[73572]:       </enum>
Aug 26 10:07:11 user nova-compute[73572]:     </loader>
Aug 26 10:07:11 user nova-compute[73572]:   </os>
Aug 26 10:07:11 user nova-compute[73572]:   <cpu>
Aug 26 10:07:11 user nova-compute[73572]:     <mode name='host-passthrough' supported='yes'>
Aug 26 10:07:11 user nova-compute[73572]:       <enum name='hostPassthroughMigratable'>
Aug 26 10:07:11 user nova-compute[73572]:         <value>on</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>off</value>
Aug 26 10:07:11 user nova-compute[73572]:       </enum>
Aug 26 10:07:11 user nova-compute[73572]:     </mode>
Aug 26 10:07:11 user nova-compute[73572]:     <mode name='maximum' supported='yes'>
Aug 26 10:07:11 user nova-compute[73572]:       <enum name='maximumMigratable'>
Aug 26 10:07:11 user nova-compute[73572]:         <value>on</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>off</value>
Aug 26 10:07:11 user nova-compute[73572]:       </enum>
Aug 26 10:07:11 user nova-compute[73572]:     </mode>
Aug 26 10:07:11 user nova-compute[73572]:     <mode name='host-model' supported='yes'>
Aug 26 10:07:11 user nova-compute[73572]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 26 10:07:11 user nova-compute[73572]:       <vendor>Intel</vendor>
Aug 26 10:07:11 user nova-compute[73572]:       <feature policy='require' name='ss'/>
Aug 26 10:07:11 user nova-compute[73572]:       <feature policy='require' name='vmx'/>
Aug 26 10:07:11 user nova-compute[73572]:       <feature policy='require' name='pcid'/>
Aug 26 10:07:11 user nova-compute[73572]:       <feature policy='require' name='hypervisor'/>
Aug 26 10:07:11 user nova-compute[73572]:       <feature policy='require' name='arat'/>
Aug 26 10:07:11 user nova-compute[73572]:       <feature policy='require' name='tsc_adjust'/>
Aug 26 10:07:11 user nova-compute[73572]:       <feature policy='require' name='umip'/>
Aug 26 10:07:11 user nova-compute[73572]:       <feature policy='require' name='md-clear'/>
Aug 26 10:07:11 user nova-compute[73572]:       <feature policy='require' name='stibp'/>
Aug 26 10:07:11 user nova-compute[73572]:       <feature policy='require' name='arch-capabilities'/>
Aug 26 10:07:11 user nova-compute[73572]:       <feature policy='require' name='ssbd'/>
Aug 26 10:07:11 user nova-compute[73572]:       <feature policy='require' name='invtsc'/>
Aug 26 10:07:11 user nova-compute[73572]:       <feature policy='require' name='ibpb'/>
Aug 26 10:07:11 user nova-compute[73572]:       <feature policy='require' name='ibrs'/>
Aug 26 10:07:11 user nova-compute[73572]:       <feature policy='require' name='amd-stibp'/>
Aug 26 10:07:11 user nova-compute[73572]:       <feature policy='require' name='amd-ssbd'/>
Aug 26 10:07:11 user nova-compute[73572]:       <feature policy='require' name='rsba'/>
Aug 26 10:07:11 user nova-compute[73572]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 26 10:07:11 user nova-compute[73572]:       <feature policy='require' name='pschange-mc-no'/>
Aug 26 10:07:11 user nova-compute[73572]:       <feature policy='disable' name='erms'/>
Aug 26 10:07:11 user nova-compute[73572]:       <feature policy='disable' name='xsaveopt'/>
Aug 26 10:07:11 user nova-compute[73572]:     </mode>
Aug 26 10:07:11 user nova-compute[73572]:     <mode name='custom' supported='yes'>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>qemu64</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='yes'>qemu32</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>phenom</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='yes'>pentium3</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='yes'>pentium2</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='yes'>pentium</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>n270</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='yes'>kvm64</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='yes'>kvm32</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='yes'>coreduo</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='yes'>core2duo</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>athlon</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='yes'>Westmere-IBRS</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='yes'>Westmere</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Snowridge</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Skylake-Server</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Skylake-Client</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>SandyBridge</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='yes'>Penryn</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Opteron_G5</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Opteron_G4</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Opteron_G3</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Opteron_G2</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='yes'>Opteron_G1</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='yes'>Nehalem</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>IvyBridge</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Icelake-Server</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Haswell-noTSX</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Haswell-IBRS</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Haswell</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>EPYC-Rome</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>EPYC-Milan</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>EPYC-IBPB</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>EPYC</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Dhyana</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Cooperlake</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='yes'>Conroe</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Cascadelake-Server</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Broadwell-noTSX</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Broadwell-IBRS</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Broadwell</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='yes'>486</model>
Aug 26 10:07:11 user nova-compute[73572]:     </mode>
Aug 26 10:07:11 user nova-compute[73572]:   </cpu>
Aug 26 10:07:11 user nova-compute[73572]:   <memoryBacking supported='yes'>
Aug 26 10:07:11 user nova-compute[73572]:     <enum name='sourceType'>
Aug 26 10:07:11 user nova-compute[73572]:       <value>file</value>
Aug 26 10:07:11 user nova-compute[73572]:       <value>anonymous</value>
Aug 26 10:07:11 user nova-compute[73572]:       <value>memfd</value>
Aug 26 10:07:11 user nova-compute[73572]:     </enum>
Aug 26 10:07:11 user nova-compute[73572]:   </memoryBacking>
Aug 26 10:07:11 user nova-compute[73572]:   <devices>
Aug 26 10:07:11 user nova-compute[73572]:     <disk supported='yes'>
Aug 26 10:07:11 user nova-compute[73572]:       <enum name='diskDevice'>
Aug 26 10:07:11 user nova-compute[73572]:         <value>disk</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>cdrom</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>floppy</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>lun</value>
Aug 26 10:07:11 user nova-compute[73572]:       </enum>
Aug 26 10:07:11 user nova-compute[73572]:       <enum name='bus'>
Aug 26 10:07:11 user nova-compute[73572]:         <value>fdc</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>scsi</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>virtio</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>usb</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>sata</value>
Aug 26 10:07:11 user nova-compute[73572]:       </enum>
Aug 26 10:07:11 user nova-compute[73572]:       <enum name='model'>
Aug 26 10:07:11 user nova-compute[73572]:         <value>virtio</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>virtio-transitional</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>virtio-non-transitional</value>
Aug 26 10:07:11 user nova-compute[73572]:       </enum>
Aug 26 10:07:11 user nova-compute[73572]:     </disk>
Aug 26 10:07:11 user nova-compute[73572]:     <graphics supported='yes'>
Aug 26 10:07:11 user nova-compute[73572]:       <enum name='type'>
Aug 26 10:07:11 user nova-compute[73572]:         <value>sdl</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>vnc</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>spice</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>egl-headless</value>
Aug 26 10:07:11 user nova-compute[73572]:       </enum>
Aug 26 10:07:11 user nova-compute[73572]:     </graphics>
Aug 26 10:07:11 user nova-compute[73572]:     <video supported='yes'>
Aug 26 10:07:11 user nova-compute[73572]:       <enum name='modelType'>
Aug 26 10:07:11 user nova-compute[73572]:         <value>vga</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>cirrus</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>vmvga</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>qxl</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>virtio</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>none</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>bochs</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>ramfb</value>
Aug 26 10:07:11 user nova-compute[73572]:       </enum>
Aug 26 10:07:11 user nova-compute[73572]:     </video>
Aug 26 10:07:11 user nova-compute[73572]:     <hostdev supported='yes'>
Aug 26 10:07:11 user nova-compute[73572]:       <enum name='mode'>
Aug 26 10:07:11 user nova-compute[73572]:         <value>subsystem</value>
Aug 26 10:07:11 user nova-compute[73572]:       </enum>
Aug 26 10:07:11 user nova-compute[73572]:       <enum name='startupPolicy'>
Aug 26 10:07:11 user nova-compute[73572]:         <value>default</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>mandatory</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>requisite</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>optional</value>
Aug 26 10:07:11 user nova-compute[73572]:       </enum>
Aug 26 10:07:11 user nova-compute[73572]:       <enum name='subsysType'>
Aug 26 10:07:11 user nova-compute[73572]:         <value>usb</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>pci</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>scsi</value>
Aug 26 10:07:11 user nova-compute[73572]:       </enum>
Aug 26 10:07:11 user nova-compute[73572]:       <enum name='capsType'/>
Aug 26 10:07:11 user nova-compute[73572]:       <enum name='pciBackend'/>
Aug 26 10:07:11 user nova-compute[73572]:     </hostdev>
Aug 26 10:07:11 user nova-compute[73572]:     <rng supported='yes'>
Aug 26 10:07:11 user nova-compute[73572]:       <enum name='model'>
Aug 26 10:07:11 user nova-compute[73572]:         <value>virtio</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>virtio-transitional</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>virtio-non-transitional</value>
Aug 26 10:07:11 user nova-compute[73572]:       </enum>
Aug 26 10:07:11 user nova-compute[73572]:       <enum name='backendModel'>
Aug 26 10:07:11 user nova-compute[73572]:         <value>random</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>egd</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>builtin</value>
Aug 26 10:07:11 user nova-compute[73572]:       </enum>
Aug 26 10:07:11 user nova-compute[73572]:     </rng>
Aug 26 10:07:11 user nova-compute[73572]:     <filesystem supported='yes'>
Aug 26 10:07:11 user nova-compute[73572]:       <enum name='driverType'>
Aug 26 10:07:11 user nova-compute[73572]:         <value>path</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>handle</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>virtiofs</value>
Aug 26 10:07:11 user nova-compute[73572]:       </enum>
Aug 26 10:07:11 user nova-compute[73572]:     </filesystem>
Aug 26 10:07:11 user nova-compute[73572]:     <tpm supported='yes'>
Aug 26 10:07:11 user nova-compute[73572]:       <enum name='model'>
Aug 26 10:07:11 user nova-compute[73572]:         <value>tpm-tis</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>tpm-crb</value>
Aug 26 10:07:11 user nova-compute[73572]:       </enum>
Aug 26 10:07:11 user nova-compute[73572]:       <enum name='backendModel'>
Aug 26 10:07:11 user nova-compute[73572]:         <value>passthrough</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>emulator</value>
Aug 26 10:07:11 user nova-compute[73572]:       </enum>
Aug 26 10:07:11 user nova-compute[73572]:     </tpm>
Aug 26 10:07:11 user nova-compute[73572]:   </devices>
Aug 26 10:07:11 user nova-compute[73572]:   <features>
Aug 26 10:07:11 user nova-compute[73572]:     <gic supported='no'/>
Aug 26 10:07:11 user nova-compute[73572]:     <vmcoreinfo supported='yes'/>
Aug 26 10:07:11 user nova-compute[73572]:     <genid supported='yes'/>
Aug 26 10:07:11 user nova-compute[73572]:     <backingStoreInput supported='yes'/>
Aug 26 10:07:11 user nova-compute[73572]:     <backup supported='yes'/>
Aug 26 10:07:11 user nova-compute[73572]:     <sev supported='no'/>
Aug 26 10:07:11 user nova-compute[73572]:   </features>
Aug 26 10:07:11 user nova-compute[73572]: </domainCapabilities>
Aug 26 10:07:11 user nova-compute[73572]:  {{(pid=73572) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 26 10:07:11 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Aug 26 10:07:11 user nova-compute[73572]: <domainCapabilities>
Aug 26 10:07:11 user nova-compute[73572]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 26 10:07:11 user nova-compute[73572]:   <domain>kvm</domain>
Aug 26 10:07:11 user nova-compute[73572]:   <machine>pc-i440fx-jammy</machine>
Aug 26 10:07:11 user nova-compute[73572]:   <arch>x86_64</arch>
Aug 26 10:07:11 user nova-compute[73572]:   <vcpu max='255'/>
Aug 26 10:07:11 user nova-compute[73572]:   <iothreads supported='yes'/>
Aug 26 10:07:11 user nova-compute[73572]:   <os supported='yes'>
Aug 26 10:07:11 user nova-compute[73572]:     <enum name='firmware'>
Aug 26 10:07:11 user nova-compute[73572]:       <value>efi</value>
Aug 26 10:07:11 user nova-compute[73572]:     </enum>
Aug 26 10:07:11 user nova-compute[73572]:     <loader supported='yes'>
Aug 26 10:07:11 user nova-compute[73572]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 26 10:07:11 user nova-compute[73572]:       <enum name='type'>
Aug 26 10:07:11 user nova-compute[73572]:         <value>rom</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>pflash</value>
Aug 26 10:07:11 user nova-compute[73572]:       </enum>
Aug 26 10:07:11 user nova-compute[73572]:       <enum name='readonly'>
Aug 26 10:07:11 user nova-compute[73572]:         <value>yes</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>no</value>
Aug 26 10:07:11 user nova-compute[73572]:       </enum>
Aug 26 10:07:11 user nova-compute[73572]:       <enum name='secure'>
Aug 26 10:07:11 user nova-compute[73572]:         <value>no</value>
Aug 26 10:07:11 user nova-compute[73572]:       </enum>
Aug 26 10:07:11 user nova-compute[73572]:     </loader>
Aug 26 10:07:11 user nova-compute[73572]:   </os>
Aug 26 10:07:11 user nova-compute[73572]:   <cpu>
Aug 26 10:07:11 user nova-compute[73572]:     <mode name='host-passthrough' supported='yes'>
Aug 26 10:07:11 user nova-compute[73572]:       <enum name='hostPassthroughMigratable'>
Aug 26 10:07:11 user nova-compute[73572]:         <value>on</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>off</value>
Aug 26 10:07:11 user nova-compute[73572]:       </enum>
Aug 26 10:07:11 user nova-compute[73572]:     </mode>
Aug 26 10:07:11 user nova-compute[73572]:     <mode name='maximum' supported='yes'>
Aug 26 10:07:11 user nova-compute[73572]:       <enum name='maximumMigratable'>
Aug 26 10:07:11 user nova-compute[73572]:         <value>on</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>off</value>
Aug 26 10:07:11 user nova-compute[73572]:       </enum>
Aug 26 10:07:11 user nova-compute[73572]:     </mode>
Aug 26 10:07:11 user nova-compute[73572]:     <mode name='host-model' supported='yes'>
Aug 26 10:07:11 user nova-compute[73572]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 26 10:07:11 user nova-compute[73572]:       <vendor>Intel</vendor>
Aug 26 10:07:11 user nova-compute[73572]:       <feature policy='require' name='ss'/>
Aug 26 10:07:11 user nova-compute[73572]:       <feature policy='require' name='vmx'/>
Aug 26 10:07:11 user nova-compute[73572]:       <feature policy='require' name='pcid'/>
Aug 26 10:07:11 user nova-compute[73572]:       <feature policy='require' name='hypervisor'/>
Aug 26 10:07:11 user nova-compute[73572]:       <feature policy='require' name='arat'/>
Aug 26 10:07:11 user nova-compute[73572]:       <feature policy='require' name='tsc_adjust'/>
Aug 26 10:07:11 user nova-compute[73572]:       <feature policy='require' name='umip'/>
Aug 26 10:07:11 user nova-compute[73572]:       <feature policy='require' name='md-clear'/>
Aug 26 10:07:11 user nova-compute[73572]:       <feature policy='require' name='stibp'/>
Aug 26 10:07:11 user nova-compute[73572]:       <feature policy='require' name='arch-capabilities'/>
Aug 26 10:07:11 user nova-compute[73572]:       <feature policy='require' name='ssbd'/>
Aug 26 10:07:11 user nova-compute[73572]:       <feature policy='require' name='invtsc'/>
Aug 26 10:07:11 user nova-compute[73572]:       <feature policy='require' name='ibpb'/>
Aug 26 10:07:11 user nova-compute[73572]:       <feature policy='require' name='ibrs'/>
Aug 26 10:07:11 user nova-compute[73572]:       <feature policy='require' name='amd-stibp'/>
Aug 26 10:07:11 user nova-compute[73572]:       <feature policy='require' name='amd-ssbd'/>
Aug 26 10:07:11 user nova-compute[73572]:       <feature policy='require' name='rsba'/>
Aug 26 10:07:11 user nova-compute[73572]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 26 10:07:11 user nova-compute[73572]:       <feature policy='require' name='pschange-mc-no'/>
Aug 26 10:07:11 user nova-compute[73572]:       <feature policy='disable' name='erms'/>
Aug 26 10:07:11 user nova-compute[73572]:       <feature policy='disable' name='xsaveopt'/>
Aug 26 10:07:11 user nova-compute[73572]:     </mode>
Aug 26 10:07:11 user nova-compute[73572]:     <mode name='custom' supported='yes'>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>qemu64</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='yes'>qemu32</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>phenom</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='yes'>pentium3</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='yes'>pentium2</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='yes'>pentium</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>n270</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='yes'>kvm64</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='yes'>kvm32</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='yes'>coreduo</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='yes'>core2duo</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>athlon</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='yes'>Westmere-IBRS</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='yes'>Westmere</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Snowridge</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Skylake-Server</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Skylake-Client</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>SandyBridge</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='yes'>Penryn</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Opteron_G5</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Opteron_G4</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Opteron_G3</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Opteron_G2</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='yes'>Opteron_G1</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='yes'>Nehalem</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>IvyBridge</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Icelake-Server</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Haswell-noTSX</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Haswell-IBRS</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Haswell</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>EPYC-Rome</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>EPYC-Milan</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>EPYC-IBPB</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>EPYC</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Dhyana</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Cooperlake</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='yes'>Conroe</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Cascadelake-Server</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Broadwell-noTSX</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Broadwell-IBRS</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Broadwell</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='yes'>486</model>
Aug 26 10:07:11 user nova-compute[73572]:     </mode>
Aug 26 10:07:11 user nova-compute[73572]:   </cpu>
Aug 26 10:07:11 user nova-compute[73572]:   <memoryBacking supported='yes'>
Aug 26 10:07:11 user nova-compute[73572]:     <enum name='sourceType'>
Aug 26 10:07:11 user nova-compute[73572]:       <value>file</value>
Aug 26 10:07:11 user nova-compute[73572]:       <value>anonymous</value>
Aug 26 10:07:11 user nova-compute[73572]:       <value>memfd</value>
Aug 26 10:07:11 user nova-compute[73572]:     </enum>
Aug 26 10:07:11 user nova-compute[73572]:   </memoryBacking>
Aug 26 10:07:11 user nova-compute[73572]:   <devices>
Aug 26 10:07:11 user nova-compute[73572]:     <disk supported='yes'>
Aug 26 10:07:11 user nova-compute[73572]:       <enum name='diskDevice'>
Aug 26 10:07:11 user nova-compute[73572]:         <value>disk</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>cdrom</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>floppy</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>lun</value>
Aug 26 10:07:11 user nova-compute[73572]:       </enum>
Aug 26 10:07:11 user nova-compute[73572]:       <enum name='bus'>
Aug 26 10:07:11 user nova-compute[73572]:         <value>ide</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>fdc</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>scsi</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>virtio</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>usb</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>sata</value>
Aug 26 10:07:11 user nova-compute[73572]:       </enum>
Aug 26 10:07:11 user nova-compute[73572]:       <enum name='model'>
Aug 26 10:07:11 user nova-compute[73572]:         <value>virtio</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>virtio-transitional</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>virtio-non-transitional</value>
Aug 26 10:07:11 user nova-compute[73572]:       </enum>
Aug 26 10:07:11 user nova-compute[73572]:     </disk>
Aug 26 10:07:11 user nova-compute[73572]:     <graphics supported='yes'>
Aug 26 10:07:11 user nova-compute[73572]:       <enum name='type'>
Aug 26 10:07:11 user nova-compute[73572]:         <value>sdl</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>vnc</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>spice</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>egl-headless</value>
Aug 26 10:07:11 user nova-compute[73572]:       </enum>
Aug 26 10:07:11 user nova-compute[73572]:     </graphics>
Aug 26 10:07:11 user nova-compute[73572]:     <video supported='yes'>
Aug 26 10:07:11 user nova-compute[73572]:       <enum name='modelType'>
Aug 26 10:07:11 user nova-compute[73572]:         <value>vga</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>cirrus</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>vmvga</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>qxl</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>virtio</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>none</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>bochs</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>ramfb</value>
Aug 26 10:07:11 user nova-compute[73572]:       </enum>
Aug 26 10:07:11 user nova-compute[73572]:     </video>
Aug 26 10:07:11 user nova-compute[73572]:     <hostdev supported='yes'>
Aug 26 10:07:11 user nova-compute[73572]:       <enum name='mode'>
Aug 26 10:07:11 user nova-compute[73572]:         <value>subsystem</value>
Aug 26 10:07:11 user nova-compute[73572]:       </enum>
Aug 26 10:07:11 user nova-compute[73572]:       <enum name='startupPolicy'>
Aug 26 10:07:11 user nova-compute[73572]:         <value>default</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>mandatory</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>requisite</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>optional</value>
Aug 26 10:07:11 user nova-compute[73572]:       </enum>
Aug 26 10:07:11 user nova-compute[73572]:       <enum name='subsysType'>
Aug 26 10:07:11 user nova-compute[73572]:         <value>usb</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>pci</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>scsi</value>
Aug 26 10:07:11 user nova-compute[73572]:       </enum>
Aug 26 10:07:11 user nova-compute[73572]:       <enum name='capsType'/>
Aug 26 10:07:11 user nova-compute[73572]:       <enum name='pciBackend'/>
Aug 26 10:07:11 user nova-compute[73572]:     </hostdev>
Aug 26 10:07:11 user nova-compute[73572]:     <rng supported='yes'>
Aug 26 10:07:11 user nova-compute[73572]:       <enum name='model'>
Aug 26 10:07:11 user nova-compute[73572]:         <value>virtio</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>virtio-transitional</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>virtio-non-transitional</value>
Aug 26 10:07:11 user nova-compute[73572]:       </enum>
Aug 26 10:07:11 user nova-compute[73572]:       <enum name='backendModel'>
Aug 26 10:07:11 user nova-compute[73572]:         <value>random</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>egd</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>builtin</value>
Aug 26 10:07:11 user nova-compute[73572]:       </enum>
Aug 26 10:07:11 user nova-compute[73572]:     </rng>
Aug 26 10:07:11 user nova-compute[73572]:     <filesystem supported='yes'>
Aug 26 10:07:11 user nova-compute[73572]:       <enum name='driverType'>
Aug 26 10:07:11 user nova-compute[73572]:         <value>path</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>handle</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>virtiofs</value>
Aug 26 10:07:11 user nova-compute[73572]:       </enum>
Aug 26 10:07:11 user nova-compute[73572]:     </filesystem>
Aug 26 10:07:11 user nova-compute[73572]:     <tpm supported='yes'>
Aug 26 10:07:11 user nova-compute[73572]:       <enum name='model'>
Aug 26 10:07:11 user nova-compute[73572]:         <value>tpm-tis</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>tpm-crb</value>
Aug 26 10:07:11 user nova-compute[73572]:       </enum>
Aug 26 10:07:11 user nova-compute[73572]:       <enum name='backendModel'>
Aug 26 10:07:11 user nova-compute[73572]:         <value>passthrough</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>emulator</value>
Aug 26 10:07:11 user nova-compute[73572]:       </enum>
Aug 26 10:07:11 user nova-compute[73572]:     </tpm>
Aug 26 10:07:11 user nova-compute[73572]:   </devices>
Aug 26 10:07:11 user nova-compute[73572]:   <features>
Aug 26 10:07:11 user nova-compute[73572]:     <gic supported='no'/>
Aug 26 10:07:11 user nova-compute[73572]:     <vmcoreinfo supported='yes'/>
Aug 26 10:07:11 user nova-compute[73572]:     <genid supported='yes'/>
Aug 26 10:07:11 user nova-compute[73572]:     <backingStoreInput supported='yes'/>
Aug 26 10:07:11 user nova-compute[73572]:     <backup supported='yes'/>
Aug 26 10:07:11 user nova-compute[73572]:     <sev supported='no'/>
Aug 26 10:07:11 user nova-compute[73572]:   </features>
Aug 26 10:07:11 user nova-compute[73572]: </domainCapabilities>
Aug 26 10:07:11 user nova-compute[73572]:  {{(pid=73572) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 26 10:07:11 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Aug 26 10:07:11 user nova-compute[73572]: <domainCapabilities>
Aug 26 10:07:11 user nova-compute[73572]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 26 10:07:11 user nova-compute[73572]:   <domain>kvm</domain>
Aug 26 10:07:11 user nova-compute[73572]:   <machine>pc-q35-jammy</machine>
Aug 26 10:07:11 user nova-compute[73572]:   <arch>x86_64</arch>
Aug 26 10:07:11 user nova-compute[73572]:   <vcpu max='288'/>
Aug 26 10:07:11 user nova-compute[73572]:   <iothreads supported='yes'/>
Aug 26 10:07:11 user nova-compute[73572]:   <os supported='yes'>
Aug 26 10:07:11 user nova-compute[73572]:     <enum name='firmware'>
Aug 26 10:07:11 user nova-compute[73572]:       <value>efi</value>
Aug 26 10:07:11 user nova-compute[73572]:     </enum>
Aug 26 10:07:11 user nova-compute[73572]:     <loader supported='yes'>
Aug 26 10:07:11 user nova-compute[73572]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Aug 26 10:07:11 user nova-compute[73572]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Aug 26 10:07:11 user nova-compute[73572]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 26 10:07:11 user nova-compute[73572]:       <enum name='type'>
Aug 26 10:07:11 user nova-compute[73572]:         <value>rom</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>pflash</value>
Aug 26 10:07:11 user nova-compute[73572]:       </enum>
Aug 26 10:07:11 user nova-compute[73572]:       <enum name='readonly'>
Aug 26 10:07:11 user nova-compute[73572]:         <value>yes</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>no</value>
Aug 26 10:07:11 user nova-compute[73572]:       </enum>
Aug 26 10:07:11 user nova-compute[73572]:       <enum name='secure'>
Aug 26 10:07:11 user nova-compute[73572]:         <value>yes</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>no</value>
Aug 26 10:07:11 user nova-compute[73572]:       </enum>
Aug 26 10:07:11 user nova-compute[73572]:     </loader>
Aug 26 10:07:11 user nova-compute[73572]:   </os>
Aug 26 10:07:11 user nova-compute[73572]:   <cpu>
Aug 26 10:07:11 user nova-compute[73572]:     <mode name='host-passthrough' supported='yes'>
Aug 26 10:07:11 user nova-compute[73572]:       <enum name='hostPassthroughMigratable'>
Aug 26 10:07:11 user nova-compute[73572]:         <value>on</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>off</value>
Aug 26 10:07:11 user nova-compute[73572]:       </enum>
Aug 26 10:07:11 user nova-compute[73572]:     </mode>
Aug 26 10:07:11 user nova-compute[73572]:     <mode name='maximum' supported='yes'>
Aug 26 10:07:11 user nova-compute[73572]:       <enum name='maximumMigratable'>
Aug 26 10:07:11 user nova-compute[73572]:         <value>on</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>off</value>
Aug 26 10:07:11 user nova-compute[73572]:       </enum>
Aug 26 10:07:11 user nova-compute[73572]:     </mode>
Aug 26 10:07:11 user nova-compute[73572]:     <mode name='host-model' supported='yes'>
Aug 26 10:07:11 user nova-compute[73572]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 26 10:07:11 user nova-compute[73572]:       <vendor>Intel</vendor>
Aug 26 10:07:11 user nova-compute[73572]:       <feature policy='require' name='ss'/>
Aug 26 10:07:11 user nova-compute[73572]:       <feature policy='require' name='vmx'/>
Aug 26 10:07:11 user nova-compute[73572]:       <feature policy='require' name='pcid'/>
Aug 26 10:07:11 user nova-compute[73572]:       <feature policy='require' name='hypervisor'/>
Aug 26 10:07:11 user nova-compute[73572]:       <feature policy='require' name='arat'/>
Aug 26 10:07:11 user nova-compute[73572]:       <feature policy='require' name='tsc_adjust'/>
Aug 26 10:07:11 user nova-compute[73572]:       <feature policy='require' name='umip'/>
Aug 26 10:07:11 user nova-compute[73572]:       <feature policy='require' name='md-clear'/>
Aug 26 10:07:11 user nova-compute[73572]:       <feature policy='require' name='stibp'/>
Aug 26 10:07:11 user nova-compute[73572]:       <feature policy='require' name='arch-capabilities'/>
Aug 26 10:07:11 user nova-compute[73572]:       <feature policy='require' name='ssbd'/>
Aug 26 10:07:11 user nova-compute[73572]:       <feature policy='require' name='invtsc'/>
Aug 26 10:07:11 user nova-compute[73572]:       <feature policy='require' name='ibpb'/>
Aug 26 10:07:11 user nova-compute[73572]:       <feature policy='require' name='ibrs'/>
Aug 26 10:07:11 user nova-compute[73572]:       <feature policy='require' name='amd-stibp'/>
Aug 26 10:07:11 user nova-compute[73572]:       <feature policy='require' name='amd-ssbd'/>
Aug 26 10:07:11 user nova-compute[73572]:       <feature policy='require' name='rsba'/>
Aug 26 10:07:11 user nova-compute[73572]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 26 10:07:11 user nova-compute[73572]:       <feature policy='require' name='pschange-mc-no'/>
Aug 26 10:07:11 user nova-compute[73572]:       <feature policy='disable' name='erms'/>
Aug 26 10:07:11 user nova-compute[73572]:       <feature policy='disable' name='xsaveopt'/>
Aug 26 10:07:11 user nova-compute[73572]:     </mode>
Aug 26 10:07:11 user nova-compute[73572]:     <mode name='custom' supported='yes'>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>qemu64</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='yes'>qemu32</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>phenom</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='yes'>pentium3</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='yes'>pentium2</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='yes'>pentium</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>n270</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='yes'>kvm64</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='yes'>kvm32</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='yes'>coreduo</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='yes'>core2duo</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>athlon</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='yes'>Westmere-IBRS</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='yes'>Westmere</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Snowridge</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Skylake-Server</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Skylake-Client</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>SandyBridge</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='yes'>Penryn</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Opteron_G5</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Opteron_G4</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Opteron_G3</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Opteron_G2</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='yes'>Opteron_G1</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='yes'>Nehalem</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>IvyBridge</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Icelake-Server</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Haswell-noTSX</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Haswell-IBRS</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Haswell</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>EPYC-Rome</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>EPYC-Milan</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>EPYC-IBPB</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>EPYC</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Dhyana</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Cooperlake</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='yes'>Conroe</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Cascadelake-Server</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Broadwell-noTSX</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Broadwell-IBRS</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='no'>Broadwell</model>
Aug 26 10:07:11 user nova-compute[73572]:       <model usable='yes'>486</model>
Aug 26 10:07:11 user nova-compute[73572]:     </mode>
Aug 26 10:07:11 user nova-compute[73572]:   </cpu>
Aug 26 10:07:11 user nova-compute[73572]:   <memoryBacking supported='yes'>
Aug 26 10:07:11 user nova-compute[73572]:     <enum name='sourceType'>
Aug 26 10:07:11 user nova-compute[73572]:       <value>file</value>
Aug 26 10:07:11 user nova-compute[73572]:       <value>anonymous</value>
Aug 26 10:07:11 user nova-compute[73572]:       <value>memfd</value>
Aug 26 10:07:11 user nova-compute[73572]:     </enum>
Aug 26 10:07:11 user nova-compute[73572]:   </memoryBacking>
Aug 26 10:07:11 user nova-compute[73572]:   <devices>
Aug 26 10:07:11 user nova-compute[73572]:     <disk supported='yes'>
Aug 26 10:07:11 user nova-compute[73572]:       <enum name='diskDevice'>
Aug 26 10:07:11 user nova-compute[73572]:         <value>disk</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>cdrom</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>floppy</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>lun</value>
Aug 26 10:07:11 user nova-compute[73572]:       </enum>
Aug 26 10:07:11 user nova-compute[73572]:       <enum name='bus'>
Aug 26 10:07:11 user nova-compute[73572]:         <value>fdc</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>scsi</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>virtio</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>usb</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>sata</value>
Aug 26 10:07:11 user nova-compute[73572]:       </enum>
Aug 26 10:07:11 user nova-compute[73572]:       <enum name='model'>
Aug 26 10:07:11 user nova-compute[73572]:         <value>virtio</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>virtio-transitional</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>virtio-non-transitional</value>
Aug 26 10:07:11 user nova-compute[73572]:       </enum>
Aug 26 10:07:11 user nova-compute[73572]:     </disk>
Aug 26 10:07:11 user nova-compute[73572]:     <graphics supported='yes'>
Aug 26 10:07:11 user nova-compute[73572]:       <enum name='type'>
Aug 26 10:07:11 user nova-compute[73572]:         <value>sdl</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>vnc</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>spice</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>egl-headless</value>
Aug 26 10:07:11 user nova-compute[73572]:       </enum>
Aug 26 10:07:11 user nova-compute[73572]:     </graphics>
Aug 26 10:07:11 user nova-compute[73572]:     <video supported='yes'>
Aug 26 10:07:11 user nova-compute[73572]:       <enum name='modelType'>
Aug 26 10:07:11 user nova-compute[73572]:         <value>vga</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>cirrus</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>vmvga</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>qxl</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>virtio</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>none</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>bochs</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>ramfb</value>
Aug 26 10:07:11 user nova-compute[73572]:       </enum>
Aug 26 10:07:11 user nova-compute[73572]:     </video>
Aug 26 10:07:11 user nova-compute[73572]:     <hostdev supported='yes'>
Aug 26 10:07:11 user nova-compute[73572]:       <enum name='mode'>
Aug 26 10:07:11 user nova-compute[73572]:         <value>subsystem</value>
Aug 26 10:07:11 user nova-compute[73572]:       </enum>
Aug 26 10:07:11 user nova-compute[73572]:       <enum name='startupPolicy'>
Aug 26 10:07:11 user nova-compute[73572]:         <value>default</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>mandatory</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>requisite</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>optional</value>
Aug 26 10:07:11 user nova-compute[73572]:       </enum>
Aug 26 10:07:11 user nova-compute[73572]:       <enum name='subsysType'>
Aug 26 10:07:11 user nova-compute[73572]:         <value>usb</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>pci</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>scsi</value>
Aug 26 10:07:11 user nova-compute[73572]:       </enum>
Aug 26 10:07:11 user nova-compute[73572]:       <enum name='capsType'/>
Aug 26 10:07:11 user nova-compute[73572]:       <enum name='pciBackend'/>
Aug 26 10:07:11 user nova-compute[73572]:     </hostdev>
Aug 26 10:07:11 user nova-compute[73572]:     <rng supported='yes'>
Aug 26 10:07:11 user nova-compute[73572]:       <enum name='model'>
Aug 26 10:07:11 user nova-compute[73572]:         <value>virtio</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>virtio-transitional</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>virtio-non-transitional</value>
Aug 26 10:07:11 user nova-compute[73572]:       </enum>
Aug 26 10:07:11 user nova-compute[73572]:       <enum name='backendModel'>
Aug 26 10:07:11 user nova-compute[73572]:         <value>random</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>egd</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>builtin</value>
Aug 26 10:07:11 user nova-compute[73572]:       </enum>
Aug 26 10:07:11 user nova-compute[73572]:     </rng>
Aug 26 10:07:11 user nova-compute[73572]:     <filesystem supported='yes'>
Aug 26 10:07:11 user nova-compute[73572]:       <enum name='driverType'>
Aug 26 10:07:11 user nova-compute[73572]:         <value>path</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>handle</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>virtiofs</value>
Aug 26 10:07:11 user nova-compute[73572]:       </enum>
Aug 26 10:07:11 user nova-compute[73572]:     </filesystem>
Aug 26 10:07:11 user nova-compute[73572]:     <tpm supported='yes'>
Aug 26 10:07:11 user nova-compute[73572]:       <enum name='model'>
Aug 26 10:07:11 user nova-compute[73572]:         <value>tpm-tis</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>tpm-crb</value>
Aug 26 10:07:11 user nova-compute[73572]:       </enum>
Aug 26 10:07:11 user nova-compute[73572]:       <enum name='backendModel'>
Aug 26 10:07:11 user nova-compute[73572]:         <value>passthrough</value>
Aug 26 10:07:11 user nova-compute[73572]:         <value>emulator</value>
Aug 26 10:07:11 user nova-compute[73572]:       </enum>
Aug 26 10:07:11 user nova-compute[73572]:     </tpm>
Aug 26 10:07:11 user nova-compute[73572]:   </devices>
Aug 26 10:07:11 user nova-compute[73572]:   <features>
Aug 26 10:07:11 user nova-compute[73572]:     <gic supported='no'/>
Aug 26 10:07:11 user nova-compute[73572]:     <vmcoreinfo supported='yes'/>
Aug 26 10:07:11 user nova-compute[73572]:     <genid supported='yes'/>
Aug 26 10:07:11 user nova-compute[73572]:     <backingStoreInput supported='yes'/>
Aug 26 10:07:11 user nova-compute[73572]:     <backup supported='yes'/>
Aug 26 10:07:11 user nova-compute[73572]:     <sev supported='no'/>
Aug 26 10:07:11 user nova-compute[73572]:   </features>
Aug 26 10:07:11 user nova-compute[73572]: </domainCapabilities>
Aug 26 10:07:11 user nova-compute[73572]:  {{(pid=73572) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 26 10:07:11 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=73572) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 10:07:11 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=73572) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 10:07:11 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=73572) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 10:07:11 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=73572) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 10:07:11 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Checking secure boot support for host arch (x86_64) {{(pid=73572) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Aug 26 10:07:11 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Checking secure boot support for host arch (x86_64) {{(pid=73572) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Aug 26 10:07:11 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Checking secure boot support for host arch (x86_64) {{(pid=73572) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Aug 26 10:07:11 user nova-compute[73572]: INFO nova.virt.libvirt.host [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Secure Boot support detected
Aug 26 10:07:11 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] cpu compare xml: <cpu match="exact">
Aug 26 10:07:11 user nova-compute[73572]:   <model>Nehalem</model>
Aug 26 10:07:11 user nova-compute[73572]: </cpu>
Aug 26 10:07:11 user nova-compute[73572]:  {{(pid=73572) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Aug 26 10:07:11 user nova-compute[73572]: INFO nova.virt.node [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Generated node identity e2cec974-59b2-4c77-a53d-a7f4e5a30d75
Aug 26 10:07:11 user nova-compute[73572]: INFO nova.virt.node [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Wrote node identity e2cec974-59b2-4c77-a53d-a7f4e5a30d75 to /opt/stack/data/nova/compute_id
Aug 26 10:07:11 user nova-compute[73572]: WARNING nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Compute nodes ['e2cec974-59b2-4c77-a53d-a7f4e5a30d75'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Aug 26 10:07:11 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Aug 26 10:07:12 user nova-compute[73572]: WARNING nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Aug 26 10:07:12 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:07:12 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:07:12 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:07:12 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Auditing locally available compute resources for user (node: user) {{(pid=73572) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 10:07:12 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:07:12 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:07:12 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Hypervisor/Node resource view: name=user free_ram=10865MB free_disk=26.26083755493164GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=73572) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 10:07:12 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:07:12 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:07:12 user nova-compute[73572]: WARNING nova.compute.resource_tracker [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] No compute node record for user:e2cec974-59b2-4c77-a53d-a7f4e5a30d75: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host e2cec974-59b2-4c77-a53d-a7f4e5a30d75 could not be found.
Aug 26 10:07:12 user nova-compute[73572]: INFO nova.compute.resource_tracker [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Compute node record created for user:user with uuid: e2cec974-59b2-4c77-a53d-a7f4e5a30d75
Aug 26 10:07:12 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73572) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 10:07:12 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73572) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 10:07:12 user nova-compute[73572]: INFO nova.scheduler.client.report [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [req-ac5a503c-204b-40d2-a21a-858d26742eb5] Created resource provider record via placement API for resource provider with UUID e2cec974-59b2-4c77-a53d-a7f4e5a30d75 and name user.
Aug 26 10:07:12 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=73572) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Aug 26 10:07:12 user nova-compute[73572]: INFO nova.virt.libvirt.host [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] kernel doesn't support AMD SEV
Aug 26 10:07:12 user nova-compute[73572]: DEBUG nova.compute.provider_tree [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Updating inventory in ProviderTree for provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=73572) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 26 10:07:12 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73572) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 10:07:12 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Libvirt baseline CPU <cpu>
Aug 26 10:07:12 user nova-compute[73572]:   <arch>x86_64</arch>
Aug 26 10:07:12 user nova-compute[73572]:   <model>Nehalem</model>
Aug 26 10:07:12 user nova-compute[73572]:   <vendor>Intel</vendor>
Aug 26 10:07:12 user nova-compute[73572]:   <topology sockets="6" cores="1" threads="1"/>
Aug 26 10:07:12 user nova-compute[73572]: </cpu>
Aug 26 10:07:12 user nova-compute[73572]:  {{(pid=73572) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Aug 26 10:07:12 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Updated inventory for provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=73572) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Aug 26 10:07:12 user nova-compute[73572]: DEBUG nova.compute.provider_tree [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Updating resource provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 generation from 0 to 1 during operation: update_inventory {{(pid=73572) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Aug 26 10:07:12 user nova-compute[73572]: DEBUG nova.compute.provider_tree [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Updating inventory in ProviderTree for provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73572) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 26 10:07:12 user nova-compute[73572]: DEBUG nova.compute.provider_tree [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Updating resource provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 generation from 1 to 2 during operation: update_traits {{(pid=73572) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Aug 26 10:07:13 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Compute_service record updated for user:user {{(pid=73572) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 10:07:13 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.686s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:07:13 user nova-compute[73572]: DEBUG nova.service [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Creating RPC server for service compute {{(pid=73572) start /opt/stack/nova/nova/service.py:182}}
Aug 26 10:07:13 user nova-compute[73572]: DEBUG nova.service [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Join ServiceGroup membership for this service compute {{(pid=73572) start /opt/stack/nova/nova/service.py:199}}
Aug 26 10:07:13 user nova-compute[73572]: DEBUG nova.servicegroup.drivers.db [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=73572) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Aug 26 10:07:37 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._sync_power_states {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:07:37 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:08:03 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:08:03 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:08:03 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Starting heal instance info cache {{(pid=73572) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 10:08:03 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Rebuilding the list of instances to heal {{(pid=73572) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 10:08:03 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Didn't find any instances for network info cache update. {{(pid=73572) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 26 10:08:03 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:08:03 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:08:03 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:08:03 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:08:03 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:08:03 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:08:03 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73572) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 10:08:03 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:08:03 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:08:03 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:08:03 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:08:03 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Auditing locally available compute resources for user (node: user) {{(pid=73572) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 10:08:04 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:08:04 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:08:04 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Hypervisor/Node resource view: name=user free_ram=10264MB free_disk=26.164562225341797GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=73572) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 10:08:04 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:08:04 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:08:04 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73572) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 10:08:04 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73572) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 10:08:04 user nova-compute[73572]: DEBUG nova.compute.provider_tree [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Inventory has not changed in ProviderTree for provider: e2cec974-59b2-4c77-a53d-a7f4e5a30d75 {{(pid=73572) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 10:08:04 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Inventory has not changed for provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73572) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 10:08:04 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Compute_service record updated for user:user {{(pid=73572) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 10:08:04 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.134s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:09:04 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:09:04 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:09:04 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Starting heal instance info cache {{(pid=73572) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 10:09:04 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Rebuilding the list of instances to heal {{(pid=73572) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 10:09:04 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Didn't find any instances for network info cache update. {{(pid=73572) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 26 10:09:04 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:09:04 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:09:04 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:09:04 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:09:04 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73572) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 10:09:04 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:09:04 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:09:04 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:09:04 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:09:04 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Auditing locally available compute resources for user (node: user) {{(pid=73572) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 10:09:05 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:09:05 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:09:05 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Hypervisor/Node resource view: name=user free_ram=10205MB free_disk=26.211166381835938GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=73572) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 10:09:05 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:09:05 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:09:05 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73572) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 10:09:05 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73572) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 10:09:05 user nova-compute[73572]: DEBUG nova.compute.provider_tree [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Inventory has not changed in ProviderTree for provider: e2cec974-59b2-4c77-a53d-a7f4e5a30d75 {{(pid=73572) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 10:09:05 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Inventory has not changed for provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73572) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 10:09:05 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Compute_service record updated for user:user {{(pid=73572) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 10:09:05 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.139s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:09:06 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:09:06 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:09:06 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:10:03 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:10:03 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Starting heal instance info cache {{(pid=73572) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 10:10:03 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Rebuilding the list of instances to heal {{(pid=73572) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 10:10:03 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Didn't find any instances for network info cache update. {{(pid=73572) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 26 10:10:03 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:10:04 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:10:05 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:10:05 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73572) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 10:10:06 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:10:06 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:10:06 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:10:06 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:10:06 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:10:06 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:10:06 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:10:06 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Auditing locally available compute resources for user (node: user) {{(pid=73572) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 10:10:07 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:10:07 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:10:07 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Hypervisor/Node resource view: name=user free_ram=10211MB free_disk=25.994869232177734GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=73572) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 10:10:07 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:10:07 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:10:07 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73572) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 10:10:07 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73572) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 10:10:07 user nova-compute[73572]: DEBUG nova.compute.provider_tree [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Inventory has not changed in ProviderTree for provider: e2cec974-59b2-4c77-a53d-a7f4e5a30d75 {{(pid=73572) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 10:10:07 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Inventory has not changed for provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73572) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 10:10:07 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Compute_service record updated for user:user {{(pid=73572) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 10:10:07 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.141s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:10:08 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:11:03 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:11:03 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:11:03 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Starting heal instance info cache {{(pid=73572) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 10:11:03 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Rebuilding the list of instances to heal {{(pid=73572) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 10:11:03 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Didn't find any instances for network info cache update. {{(pid=73572) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 26 10:11:05 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:11:06 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:11:06 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:11:06 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:11:06 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:11:06 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73572) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 10:11:07 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:11:07 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:11:07 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:11:07 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:11:07 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Auditing locally available compute resources for user (node: user) {{(pid=73572) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 10:11:08 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:11:08 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:11:08 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Hypervisor/Node resource view: name=user free_ram=9419MB free_disk=25.977500915527344GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=73572) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 10:11:08 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:11:08 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:11:08 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73572) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 10:11:08 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73572) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 10:11:08 user nova-compute[73572]: DEBUG nova.compute.provider_tree [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Inventory has not changed in ProviderTree for provider: e2cec974-59b2-4c77-a53d-a7f4e5a30d75 {{(pid=73572) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 10:11:08 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Inventory has not changed for provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73572) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 10:11:08 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Compute_service record updated for user:user {{(pid=73572) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 10:11:08 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.163s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:11:09 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:11:09 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:11:17 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-53c4bc61-ff31-43d6-ad6e-df67c7776f92 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] Acquiring lock "61b60a19-597e-4dc1-af0f-a0ec95e9fd24" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:11:17 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-53c4bc61-ff31-43d6-ad6e-df67c7776f92 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] Lock "61b60a19-597e-4dc1-af0f-a0ec95e9fd24" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:11:17 user nova-compute[73572]: DEBUG nova.compute.manager [None req-53c4bc61-ff31-43d6-ad6e-df67c7776f92 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] [instance: 61b60a19-597e-4dc1-af0f-a0ec95e9fd24] Starting instance... {{(pid=73572) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 10:11:17 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-53c4bc61-ff31-43d6-ad6e-df67c7776f92 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:11:17 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-53c4bc61-ff31-43d6-ad6e-df67c7776f92 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:11:17 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-53c4bc61-ff31-43d6-ad6e-df67c7776f92 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73572) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 10:11:17 user nova-compute[73572]: INFO nova.compute.claims [None req-53c4bc61-ff31-43d6-ad6e-df67c7776f92 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] [instance: 61b60a19-597e-4dc1-af0f-a0ec95e9fd24] Claim successful on node user
Aug 26 10:11:17 user nova-compute[73572]: DEBUG nova.compute.provider_tree [None req-53c4bc61-ff31-43d6-ad6e-df67c7776f92 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] Inventory has not changed in ProviderTree for provider: e2cec974-59b2-4c77-a53d-a7f4e5a30d75 {{(pid=73572) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 10:11:17 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-53c4bc61-ff31-43d6-ad6e-df67c7776f92 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] Inventory has not changed for provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73572) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 10:11:17 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-53c4bc61-ff31-43d6-ad6e-df67c7776f92 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.387s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:11:17 user nova-compute[73572]: DEBUG nova.compute.manager [None req-53c4bc61-ff31-43d6-ad6e-df67c7776f92 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] [instance: 61b60a19-597e-4dc1-af0f-a0ec95e9fd24] Start building networks asynchronously for instance. {{(pid=73572) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 10:11:18 user nova-compute[73572]: DEBUG nova.compute.manager [None req-53c4bc61-ff31-43d6-ad6e-df67c7776f92 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] [instance: 61b60a19-597e-4dc1-af0f-a0ec95e9fd24] Allocating IP information in the background. {{(pid=73572) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 10:11:18 user nova-compute[73572]: DEBUG nova.network.neutron [None req-53c4bc61-ff31-43d6-ad6e-df67c7776f92 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] [instance: 61b60a19-597e-4dc1-af0f-a0ec95e9fd24] allocate_for_instance() {{(pid=73572) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 10:11:18 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-53c4bc61-ff31-43d6-ad6e-df67c7776f92 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] [instance: 61b60a19-597e-4dc1-af0f-a0ec95e9fd24] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 10:11:18 user nova-compute[73572]: DEBUG nova.compute.manager [None req-53c4bc61-ff31-43d6-ad6e-df67c7776f92 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] [instance: 61b60a19-597e-4dc1-af0f-a0ec95e9fd24] Start building block device mappings for instance. {{(pid=73572) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 10:11:18 user nova-compute[73572]: DEBUG nova.compute.manager [None req-53c4bc61-ff31-43d6-ad6e-df67c7776f92 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] [instance: 61b60a19-597e-4dc1-af0f-a0ec95e9fd24] Start spawning the instance on the hypervisor. {{(pid=73572) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 10:11:18 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-53c4bc61-ff31-43d6-ad6e-df67c7776f92 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] [instance: 61b60a19-597e-4dc1-af0f-a0ec95e9fd24] Creating instance directory {{(pid=73572) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 10:11:18 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-53c4bc61-ff31-43d6-ad6e-df67c7776f92 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] [instance: 61b60a19-597e-4dc1-af0f-a0ec95e9fd24] Creating image(s)
Aug 26 10:11:18 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-53c4bc61-ff31-43d6-ad6e-df67c7776f92 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] Acquiring lock "/opt/stack/data/nova/instances/61b60a19-597e-4dc1-af0f-a0ec95e9fd24/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:11:18 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-53c4bc61-ff31-43d6-ad6e-df67c7776f92 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] Lock "/opt/stack/data/nova/instances/61b60a19-597e-4dc1-af0f-a0ec95e9fd24/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:11:18 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-53c4bc61-ff31-43d6-ad6e-df67c7776f92 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] Lock "/opt/stack/data/nova/instances/61b60a19-597e-4dc1-af0f-a0ec95e9fd24/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:11:18 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-53c4bc61-ff31-43d6-ad6e-df67c7776f92 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] Acquiring lock "2099350d6f3bcd0de9471c73862d4fe75b049801" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:11:18 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-53c4bc61-ff31-43d6-ad6e-df67c7776f92 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] Lock "2099350d6f3bcd0de9471c73862d4fe75b049801" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:11:18 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-62a5f658-c44e-4e75-863d-84de11d2aa43 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Acquiring lock "c785b609-0068-442f-91f5-d26e888a993f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:11:18 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-62a5f658-c44e-4e75-863d-84de11d2aa43 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Lock "c785b609-0068-442f-91f5-d26e888a993f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:11:18 user nova-compute[73572]: DEBUG nova.compute.manager [None req-62a5f658-c44e-4e75-863d-84de11d2aa43 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: c785b609-0068-442f-91f5-d26e888a993f] Starting instance... {{(pid=73572) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 10:11:18 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-53c4bc61-ff31-43d6-ad6e-df67c7776f92 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801.part --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:11:18 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-4390620d-fd54-45c3-98fa-55a5a0bae479 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] Acquiring lock "8302d6e7-aaf3-461c-a55e-f2e685d1800d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:11:18 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-4390620d-fd54-45c3-98fa-55a5a0bae479 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] Lock "8302d6e7-aaf3-461c-a55e-f2e685d1800d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:11:18 user nova-compute[73572]: DEBUG nova.policy [None req-53c4bc61-ff31-43d6-ad6e-df67c7776f92 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5373e9f0d5924f65807259963192e12a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5500e4b0418743abaeca3f853a4908c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73572) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 10:11:19 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-62a5f658-c44e-4e75-863d-84de11d2aa43 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:11:19 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-62a5f658-c44e-4e75-863d-84de11d2aa43 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:11:19 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-62a5f658-c44e-4e75-863d-84de11d2aa43 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73572) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 10:11:19 user nova-compute[73572]: INFO nova.compute.claims [None req-62a5f658-c44e-4e75-863d-84de11d2aa43 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: c785b609-0068-442f-91f5-d26e888a993f] Claim successful on node user
Aug 26 10:11:19 user nova-compute[73572]: DEBUG nova.compute.manager [None req-4390620d-fd54-45c3-98fa-55a5a0bae479 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] [instance: 8302d6e7-aaf3-461c-a55e-f2e685d1800d] Starting instance... {{(pid=73572) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 10:11:19 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-53c4bc61-ff31-43d6-ad6e-df67c7776f92 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801.part --force-share --output=json" returned: 0 in 0.191s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:11:19 user nova-compute[73572]: DEBUG nova.virt.images [None req-53c4bc61-ff31-43d6-ad6e-df67c7776f92 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] 299da0c9-e1c4-48f0-be55-fbe20dd06bc9 was qcow2, converting to raw {{(pid=73572) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 26 10:11:19 user nova-compute[73572]: DEBUG nova.privsep.utils [None req-53c4bc61-ff31-43d6-ad6e-df67c7776f92 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73572) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 26 10:11:19 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-53c4bc61-ff31-43d6-ad6e-df67c7776f92 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801.part /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801.converted {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:11:19 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-4390620d-fd54-45c3-98fa-55a5a0bae479 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:11:19 user nova-compute[73572]: DEBUG nova.compute.provider_tree [None req-62a5f658-c44e-4e75-863d-84de11d2aa43 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Inventory has not changed in ProviderTree for provider: e2cec974-59b2-4c77-a53d-a7f4e5a30d75 {{(pid=73572) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 10:11:19 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-62a5f658-c44e-4e75-863d-84de11d2aa43 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Inventory has not changed for provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73572) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 10:11:19 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-62a5f658-c44e-4e75-863d-84de11d2aa43 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.448s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:11:19 user nova-compute[73572]: DEBUG nova.compute.manager [None req-62a5f658-c44e-4e75-863d-84de11d2aa43 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: c785b609-0068-442f-91f5-d26e888a993f] Start building networks asynchronously for instance. {{(pid=73572) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 10:11:19 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-4390620d-fd54-45c3-98fa-55a5a0bae479 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.302s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:11:19 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-4390620d-fd54-45c3-98fa-55a5a0bae479 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73572) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 10:11:19 user nova-compute[73572]: INFO nova.compute.claims [None req-4390620d-fd54-45c3-98fa-55a5a0bae479 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] [instance: 8302d6e7-aaf3-461c-a55e-f2e685d1800d] Claim successful on node user
Aug 26 10:11:19 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-53c4bc61-ff31-43d6-ad6e-df67c7776f92 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801.part /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801.converted" returned: 0 in 0.448s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:11:19 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-53c4bc61-ff31-43d6-ad6e-df67c7776f92 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801.converted --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:11:19 user nova-compute[73572]: DEBUG nova.compute.manager [None req-62a5f658-c44e-4e75-863d-84de11d2aa43 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: c785b609-0068-442f-91f5-d26e888a993f] Allocating IP information in the background. {{(pid=73572) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 10:11:19 user nova-compute[73572]: DEBUG nova.network.neutron [None req-62a5f658-c44e-4e75-863d-84de11d2aa43 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: c785b609-0068-442f-91f5-d26e888a993f] allocate_for_instance() {{(pid=73572) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 10:11:19 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-62a5f658-c44e-4e75-863d-84de11d2aa43 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: c785b609-0068-442f-91f5-d26e888a993f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 10:11:19 user nova-compute[73572]: DEBUG nova.compute.manager [None req-62a5f658-c44e-4e75-863d-84de11d2aa43 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: c785b609-0068-442f-91f5-d26e888a993f] Start building block device mappings for instance. {{(pid=73572) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 10:11:19 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-53c4bc61-ff31-43d6-ad6e-df67c7776f92 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801.converted --force-share --output=json" returned: 0 in 0.215s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:11:19 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-53c4bc61-ff31-43d6-ad6e-df67c7776f92 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] Lock "2099350d6f3bcd0de9471c73862d4fe75b049801" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.351s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:11:19 user nova-compute[73572]: INFO oslo.privsep.daemon [None req-53c4bc61-ff31-43d6-ad6e-df67c7776f92 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpw9_pln4v/privsep.sock']
Aug 26 10:11:19 user sudo[82898]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpw9_pln4v/privsep.sock
Aug 26 10:11:19 user sudo[82898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 26 10:11:19 user nova-compute[73572]: DEBUG nova.compute.manager [None req-62a5f658-c44e-4e75-863d-84de11d2aa43 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: c785b609-0068-442f-91f5-d26e888a993f] Start spawning the instance on the hypervisor. {{(pid=73572) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 10:11:19 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-62a5f658-c44e-4e75-863d-84de11d2aa43 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: c785b609-0068-442f-91f5-d26e888a993f] Creating instance directory {{(pid=73572) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 10:11:19 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-62a5f658-c44e-4e75-863d-84de11d2aa43 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: c785b609-0068-442f-91f5-d26e888a993f] Creating image(s)
Aug 26 10:11:19 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-62a5f658-c44e-4e75-863d-84de11d2aa43 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Acquiring lock "/opt/stack/data/nova/instances/c785b609-0068-442f-91f5-d26e888a993f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:11:19 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-62a5f658-c44e-4e75-863d-84de11d2aa43 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Lock "/opt/stack/data/nova/instances/c785b609-0068-442f-91f5-d26e888a993f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:11:19 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-62a5f658-c44e-4e75-863d-84de11d2aa43 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Lock "/opt/stack/data/nova/instances/c785b609-0068-442f-91f5-d26e888a993f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:11:20 user nova-compute[73572]: DEBUG nova.policy [None req-62a5f658-c44e-4e75-863d-84de11d2aa43 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '07f3538038a14713af3bbe420f1fb03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4636f93c5bfc4653804de097aed2882c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73572) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 10:11:20 user nova-compute[73572]: DEBUG nova.compute.provider_tree [None req-4390620d-fd54-45c3-98fa-55a5a0bae479 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] Inventory has not changed in ProviderTree for provider: e2cec974-59b2-4c77-a53d-a7f4e5a30d75 {{(pid=73572) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 10:11:20 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-4390620d-fd54-45c3-98fa-55a5a0bae479 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] Inventory has not changed for provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73572) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 10:11:20 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-4390620d-fd54-45c3-98fa-55a5a0bae479 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.823s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:11:20 user nova-compute[73572]: DEBUG nova.compute.manager [None req-4390620d-fd54-45c3-98fa-55a5a0bae479 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] [instance: 8302d6e7-aaf3-461c-a55e-f2e685d1800d] Start building networks asynchronously for instance. {{(pid=73572) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 10:11:20 user nova-compute[73572]: DEBUG nova.compute.manager [None req-4390620d-fd54-45c3-98fa-55a5a0bae479 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] [instance: 8302d6e7-aaf3-461c-a55e-f2e685d1800d] Allocating IP information in the background. {{(pid=73572) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 10:11:20 user nova-compute[73572]: DEBUG nova.network.neutron [None req-4390620d-fd54-45c3-98fa-55a5a0bae479 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] [instance: 8302d6e7-aaf3-461c-a55e-f2e685d1800d] allocate_for_instance() {{(pid=73572) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 10:11:20 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-4390620d-fd54-45c3-98fa-55a5a0bae479 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] [instance: 8302d6e7-aaf3-461c-a55e-f2e685d1800d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 10:11:20 user nova-compute[73572]: DEBUG nova.compute.manager [None req-4390620d-fd54-45c3-98fa-55a5a0bae479 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] [instance: 8302d6e7-aaf3-461c-a55e-f2e685d1800d] Start building block device mappings for instance. {{(pid=73572) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 10:11:20 user nova-compute[73572]: DEBUG nova.compute.manager [None req-4390620d-fd54-45c3-98fa-55a5a0bae479 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] [instance: 8302d6e7-aaf3-461c-a55e-f2e685d1800d] Start spawning the instance on the hypervisor. {{(pid=73572) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 10:11:20 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-4390620d-fd54-45c3-98fa-55a5a0bae479 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] [instance: 8302d6e7-aaf3-461c-a55e-f2e685d1800d] Creating instance directory {{(pid=73572) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 10:11:20 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-4390620d-fd54-45c3-98fa-55a5a0bae479 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] [instance: 8302d6e7-aaf3-461c-a55e-f2e685d1800d] Creating image(s)
Aug 26 10:11:20 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-4390620d-fd54-45c3-98fa-55a5a0bae479 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] Acquiring lock "/opt/stack/data/nova/instances/8302d6e7-aaf3-461c-a55e-f2e685d1800d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:11:20 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-4390620d-fd54-45c3-98fa-55a5a0bae479 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] Lock "/opt/stack/data/nova/instances/8302d6e7-aaf3-461c-a55e-f2e685d1800d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:11:20 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-4390620d-fd54-45c3-98fa-55a5a0bae479 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] Lock "/opt/stack/data/nova/instances/8302d6e7-aaf3-461c-a55e-f2e685d1800d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:11:20 user nova-compute[73572]: DEBUG nova.policy [None req-4390620d-fd54-45c3-98fa-55a5a0bae479 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8efee83728774e58a60714e5c72cb1f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e946bd18464231965d43e20f1d2201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73572) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 10:11:20 user nova-compute[73572]: DEBUG nova.network.neutron [None req-53c4bc61-ff31-43d6-ad6e-df67c7776f92 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] [instance: 61b60a19-597e-4dc1-af0f-a0ec95e9fd24] Successfully created port: f846939c-c22d-4e0c-9237-404eabf0abd4 {{(pid=73572) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 10:11:21 user sudo[82898]: pam_unix(sudo:session): session closed for user root
Aug 26 10:11:21 user nova-compute[73572]: INFO oslo.privsep.daemon [None req-53c4bc61-ff31-43d6-ad6e-df67c7776f92 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] Spawned new privsep daemon via rootwrap
Aug 26 10:11:21 user nova-compute[73572]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 26 10:11:21 user nova-compute[73572]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 26 10:11:21 user nova-compute[73572]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Aug 26 10:11:21 user nova-compute[73572]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 82903
Aug 26 10:11:21 user nova-compute[73572]: WARNING oslo_privsep.priv_context [None req-62a5f658-c44e-4e75-863d-84de11d2aa43 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] privsep daemon already running
Aug 26 10:11:21 user nova-compute[73572]: WARNING oslo_privsep.priv_context [None req-4390620d-fd54-45c3-98fa-55a5a0bae479 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] privsep daemon already running
Aug 26 10:11:22 user nova-compute[73572]: DEBUG nova.network.neutron [None req-53c4bc61-ff31-43d6-ad6e-df67c7776f92 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] [instance: 61b60a19-597e-4dc1-af0f-a0ec95e9fd24] Successfully updated port: f846939c-c22d-4e0c-9237-404eabf0abd4 {{(pid=73572) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 10:11:22 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-53c4bc61-ff31-43d6-ad6e-df67c7776f92 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] Acquiring lock "refresh_cache-61b60a19-597e-4dc1-af0f-a0ec95e9fd24" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:11:22 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-53c4bc61-ff31-43d6-ad6e-df67c7776f92 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] Acquired lock "refresh_cache-61b60a19-597e-4dc1-af0f-a0ec95e9fd24" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:11:22 user nova-compute[73572]: DEBUG nova.network.neutron [None req-53c4bc61-ff31-43d6-ad6e-df67c7776f92 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] [instance: 61b60a19-597e-4dc1-af0f-a0ec95e9fd24] Building network info cache for instance {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 10:11:22 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-62a5f658-c44e-4e75-863d-84de11d2aa43 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:11:22 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-53c4bc61-ff31-43d6-ad6e-df67c7776f92 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:11:22 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-4390620d-fd54-45c3-98fa-55a5a0bae479 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:11:22 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-62a5f658-c44e-4e75-863d-84de11d2aa43 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json" returned: 0 in 0.177s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:11:22 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-62a5f658-c44e-4e75-863d-84de11d2aa43 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Acquiring lock "2099350d6f3bcd0de9471c73862d4fe75b049801" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:11:22 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-62a5f658-c44e-4e75-863d-84de11d2aa43 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Lock "2099350d6f3bcd0de9471c73862d4fe75b049801" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:11:22 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-62a5f658-c44e-4e75-863d-84de11d2aa43 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:11:22 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-53c4bc61-ff31-43d6-ad6e-df67c7776f92 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json" returned: 0 in 0.183s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:11:22 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-53c4bc61-ff31-43d6-ad6e-df67c7776f92 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] Acquiring lock "2099350d6f3bcd0de9471c73862d4fe75b049801" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:11:22 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-4390620d-fd54-45c3-98fa-55a5a0bae479 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json" returned: 0 in 0.175s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:11:22 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-4390620d-fd54-45c3-98fa-55a5a0bae479 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] Acquiring lock "2099350d6f3bcd0de9471c73862d4fe75b049801" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:11:22 user nova-compute[73572]: DEBUG nova.network.neutron [None req-53c4bc61-ff31-43d6-ad6e-df67c7776f92 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] [instance: 61b60a19-597e-4dc1-af0f-a0ec95e9fd24] Instance cache missing network info. {{(pid=73572) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 10:11:22 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-62a5f658-c44e-4e75-863d-84de11d2aa43 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json" returned: 0 in 0.191s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:11:22 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-62a5f658-c44e-4e75-863d-84de11d2aa43 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801,backing_fmt=raw /opt/stack/data/nova/instances/c785b609-0068-442f-91f5-d26e888a993f/disk 1073741824 {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:11:22 user nova-compute[73572]: DEBUG nova.compute.manager [req-4d21cb53-dd5c-4269-a540-ea0b9e5933f0 req-a2c0f717-b694-4825-b01e-6b2563e385eb service nova] [instance: 61b60a19-597e-4dc1-af0f-a0ec95e9fd24] Received event network-changed-f846939c-c22d-4e0c-9237-404eabf0abd4 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:11:22 user nova-compute[73572]: DEBUG nova.compute.manager [req-4d21cb53-dd5c-4269-a540-ea0b9e5933f0 req-a2c0f717-b694-4825-b01e-6b2563e385eb service nova] [instance: 61b60a19-597e-4dc1-af0f-a0ec95e9fd24] Refreshing instance network info cache due to event network-changed-f846939c-c22d-4e0c-9237-404eabf0abd4. {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 10:11:22 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-4d21cb53-dd5c-4269-a540-ea0b9e5933f0 req-a2c0f717-b694-4825-b01e-6b2563e385eb service nova] Acquiring lock "refresh_cache-61b60a19-597e-4dc1-af0f-a0ec95e9fd24" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:11:22 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-62a5f658-c44e-4e75-863d-84de11d2aa43 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801,backing_fmt=raw /opt/stack/data/nova/instances/c785b609-0068-442f-91f5-d26e888a993f/disk 1073741824" returned: 0 in 0.058s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:11:22 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-62a5f658-c44e-4e75-863d-84de11d2aa43 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Lock "2099350d6f3bcd0de9471c73862d4fe75b049801" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.252s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:11:22 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-62a5f658-c44e-4e75-863d-84de11d2aa43 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:11:22 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-53c4bc61-ff31-43d6-ad6e-df67c7776f92 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] Lock "2099350d6f3bcd0de9471c73862d4fe75b049801" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.253s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:11:22 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-53c4bc61-ff31-43d6-ad6e-df67c7776f92 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:11:22 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-62a5f658-c44e-4e75-863d-84de11d2aa43 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json" returned: 0 in 0.255s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:11:22 user nova-compute[73572]: DEBUG nova.virt.disk.api [None req-62a5f658-c44e-4e75-863d-84de11d2aa43 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c785b609-0068-442f-91f5-d26e888a993f/disk. size=1073741824 {{(pid=73572) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 10:11:22 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-62a5f658-c44e-4e75-863d-84de11d2aa43 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c785b609-0068-442f-91f5-d26e888a993f/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:11:22 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-53c4bc61-ff31-43d6-ad6e-df67c7776f92 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json" returned: 0 in 0.253s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:11:22 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-53c4bc61-ff31-43d6-ad6e-df67c7776f92 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801,backing_fmt=raw /opt/stack/data/nova/instances/61b60a19-597e-4dc1-af0f-a0ec95e9fd24/disk 1073741824 {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:11:22 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-62a5f658-c44e-4e75-863d-84de11d2aa43 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c785b609-0068-442f-91f5-d26e888a993f/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:11:22 user nova-compute[73572]: DEBUG nova.virt.disk.api [None req-62a5f658-c44e-4e75-863d-84de11d2aa43 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Cannot resize image /opt/stack/data/nova/instances/c785b609-0068-442f-91f5-d26e888a993f/disk to a smaller size. {{(pid=73572) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 10:11:22 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-62a5f658-c44e-4e75-863d-84de11d2aa43 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: c785b609-0068-442f-91f5-d26e888a993f] Created local disks {{(pid=73572) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 10:11:22 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-62a5f658-c44e-4e75-863d-84de11d2aa43 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: c785b609-0068-442f-91f5-d26e888a993f] Ensure instance console log exists: /opt/stack/data/nova/instances/c785b609-0068-442f-91f5-d26e888a993f/console.log {{(pid=73572) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 10:11:22 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-62a5f658-c44e-4e75-863d-84de11d2aa43 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:11:22 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-62a5f658-c44e-4e75-863d-84de11d2aa43 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:11:22 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-62a5f658-c44e-4e75-863d-84de11d2aa43 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:11:23 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-53c4bc61-ff31-43d6-ad6e-df67c7776f92 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801,backing_fmt=raw /opt/stack/data/nova/instances/61b60a19-597e-4dc1-af0f-a0ec95e9fd24/disk 1073741824" returned: 0 in 0.219s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:11:23 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-53c4bc61-ff31-43d6-ad6e-df67c7776f92 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] Lock "2099350d6f3bcd0de9471c73862d4fe75b049801" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.480s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:11:23 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-53c4bc61-ff31-43d6-ad6e-df67c7776f92 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:11:23 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-4390620d-fd54-45c3-98fa-55a5a0bae479 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] Lock "2099350d6f3bcd0de9471c73862d4fe75b049801" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.742s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:11:23 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-4390620d-fd54-45c3-98fa-55a5a0bae479 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:11:23 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-53c4bc61-ff31-43d6-ad6e-df67c7776f92 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json" returned: 0 in 0.170s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:11:23 user nova-compute[73572]: DEBUG nova.virt.disk.api [None req-53c4bc61-ff31-43d6-ad6e-df67c7776f92 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] Checking if we can resize image /opt/stack/data/nova/instances/61b60a19-597e-4dc1-af0f-a0ec95e9fd24/disk. size=1073741824 {{(pid=73572) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 10:11:23 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-53c4bc61-ff31-43d6-ad6e-df67c7776f92 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61b60a19-597e-4dc1-af0f-a0ec95e9fd24/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:11:23 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-4390620d-fd54-45c3-98fa-55a5a0bae479 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json" returned: 0 in 0.192s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:11:23 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-4390620d-fd54-45c3-98fa-55a5a0bae479 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801,backing_fmt=raw /opt/stack/data/nova/instances/8302d6e7-aaf3-461c-a55e-f2e685d1800d/disk 1073741824 {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:11:23 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-4390620d-fd54-45c3-98fa-55a5a0bae479 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801,backing_fmt=raw /opt/stack/data/nova/instances/8302d6e7-aaf3-461c-a55e-f2e685d1800d/disk 1073741824" returned: 0 in 0.043s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:11:23 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-4390620d-fd54-45c3-98fa-55a5a0bae479 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] Lock "2099350d6f3bcd0de9471c73862d4fe75b049801" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.242s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:11:23 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-4390620d-fd54-45c3-98fa-55a5a0bae479 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:11:23 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-53c4bc61-ff31-43d6-ad6e-df67c7776f92 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61b60a19-597e-4dc1-af0f-a0ec95e9fd24/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:11:23 user nova-compute[73572]: DEBUG nova.virt.disk.api [None req-53c4bc61-ff31-43d6-ad6e-df67c7776f92 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] Cannot resize image /opt/stack/data/nova/instances/61b60a19-597e-4dc1-af0f-a0ec95e9fd24/disk to a smaller size. {{(pid=73572) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 10:11:23 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-53c4bc61-ff31-43d6-ad6e-df67c7776f92 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] [instance: 61b60a19-597e-4dc1-af0f-a0ec95e9fd24] Created local disks {{(pid=73572) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 10:11:23 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-53c4bc61-ff31-43d6-ad6e-df67c7776f92 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] [instance: 61b60a19-597e-4dc1-af0f-a0ec95e9fd24] Ensure instance console log exists: /opt/stack/data/nova/instances/61b60a19-597e-4dc1-af0f-a0ec95e9fd24/console.log {{(pid=73572) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 10:11:23 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-53c4bc61-ff31-43d6-ad6e-df67c7776f92 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:11:23 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-53c4bc61-ff31-43d6-ad6e-df67c7776f92 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:11:23 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-53c4bc61-ff31-43d6-ad6e-df67c7776f92 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:11:23 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-4390620d-fd54-45c3-98fa-55a5a0bae479 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json" returned: 0 in 0.188s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:11:23 user nova-compute[73572]: DEBUG nova.virt.disk.api [None req-4390620d-fd54-45c3-98fa-55a5a0bae479 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8302d6e7-aaf3-461c-a55e-f2e685d1800d/disk. size=1073741824 {{(pid=73572) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 10:11:23 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-4390620d-fd54-45c3-98fa-55a5a0bae479 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8302d6e7-aaf3-461c-a55e-f2e685d1800d/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:11:23 user nova-compute[73572]: DEBUG nova.network.neutron [None req-53c4bc61-ff31-43d6-ad6e-df67c7776f92 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] [instance: 61b60a19-597e-4dc1-af0f-a0ec95e9fd24] Updating instance_info_cache with network_info: [{"id": "f846939c-c22d-4e0c-9237-404eabf0abd4", "address": "fa:16:3e:46:77:5d", "network": {"id": "07a1c135-6593-4fe1-8020-305e2596db1d", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1106906776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5500e4b0418743abaeca3f853a4908c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf846939c-c2", "ovs_interfaceid": "f846939c-c22d-4e0c-9237-404eabf0abd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:11:23 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-53c4bc61-ff31-43d6-ad6e-df67c7776f92 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] Releasing lock "refresh_cache-61b60a19-597e-4dc1-af0f-a0ec95e9fd24" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:11:23 user nova-compute[73572]: DEBUG nova.compute.manager [None req-53c4bc61-ff31-43d6-ad6e-df67c7776f92 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] [instance: 61b60a19-597e-4dc1-af0f-a0ec95e9fd24] Instance network_info: |[{"id": "f846939c-c22d-4e0c-9237-404eabf0abd4", "address": "fa:16:3e:46:77:5d", "network": {"id": "07a1c135-6593-4fe1-8020-305e2596db1d", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1106906776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5500e4b0418743abaeca3f853a4908c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf846939c-c2", "ovs_interfaceid": "f846939c-c22d-4e0c-9237-404eabf0abd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73572) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 10:11:23 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-4d21cb53-dd5c-4269-a540-ea0b9e5933f0 req-a2c0f717-b694-4825-b01e-6b2563e385eb service nova] Acquired lock "refresh_cache-61b60a19-597e-4dc1-af0f-a0ec95e9fd24" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:11:23 user nova-compute[73572]: DEBUG nova.network.neutron [req-4d21cb53-dd5c-4269-a540-ea0b9e5933f0 req-a2c0f717-b694-4825-b01e-6b2563e385eb service nova] [instance: 61b60a19-597e-4dc1-af0f-a0ec95e9fd24] Refreshing network info cache for port f846939c-c22d-4e0c-9237-404eabf0abd4 {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 10:11:23 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-53c4bc61-ff31-43d6-ad6e-df67c7776f92 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] [instance: 61b60a19-597e-4dc1-af0f-a0ec95e9fd24] Start _get_guest_xml network_info=[{"id": "f846939c-c22d-4e0c-9237-404eabf0abd4", "address": "fa:16:3e:46:77:5d", "network": {"id": "07a1c135-6593-4fe1-8020-305e2596db1d", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1106906776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5500e4b0418743abaeca3f853a4908c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf846939c-c2", "ovs_interfaceid": "f846939c-c22d-4e0c-9237-404eabf0abd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T10:07:33Z,direct_url=<?>,disk_format='qcow2',id=299da0c9-e1c4-48f0-be55-fbe20dd06bc9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5c995f8bbbab4368b67a253e0df3971a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T10:07:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'guest_format': None, 'size': 0, 'encryption_format': None, 'device_type': 'disk', 'image_id': '299da0c9-e1c4-48f0-be55-fbe20dd06bc9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73572) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 10:11:23 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-53c4bc61-ff31-43d6-ad6e-df67c7776f92 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:11:23 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-53c4bc61-ff31-43d6-ad6e-df67c7776f92 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:11:23 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-53c4bc61-ff31-43d6-ad6e-df67c7776f92 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73572) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 10:11:23 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-53c4bc61-ff31-43d6-ad6e-df67c7776f92 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] CPU controller missing on host. {{(pid=73572) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 10:11:23 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-53c4bc61-ff31-43d6-ad6e-df67c7776f92 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73572) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 10:11:23 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-53c4bc61-ff31-43d6-ad6e-df67c7776f92 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] CPU controller found on host. {{(pid=73572) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 10:11:23 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-53c4bc61-ff31-43d6-ad6e-df67c7776f92 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73572) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 10:11:23 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-53c4bc61-ff31-43d6-ad6e-df67c7776f92 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T10:07:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T10:07:33Z,direct_url=<?>,disk_format='qcow2',id=299da0c9-e1c4-48f0-be55-fbe20dd06bc9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5c995f8bbbab4368b67a253e0df3971a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T10:07:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 10:11:23 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-53c4bc61-ff31-43d6-ad6e-df67c7776f92 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] Flavor limits 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 10:11:23 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-53c4bc61-ff31-43d6-ad6e-df67c7776f92 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] Image limits 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 10:11:23 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-53c4bc61-ff31-43d6-ad6e-df67c7776f92 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] Flavor pref 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 10:11:23 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-53c4bc61-ff31-43d6-ad6e-df67c7776f92 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] Image pref 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 10:11:23 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-53c4bc61-ff31-43d6-ad6e-df67c7776f92 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 10:11:23 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-53c4bc61-ff31-43d6-ad6e-df67c7776f92 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 10:11:23 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-53c4bc61-ff31-43d6-ad6e-df67c7776f92 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73572) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 10:11:23 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-53c4bc61-ff31-43d6-ad6e-df67c7776f92 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] Got 1 possible topologies {{(pid=73572) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 10:11:23 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-53c4bc61-ff31-43d6-ad6e-df67c7776f92 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 10:11:23 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-53c4bc61-ff31-43d6-ad6e-df67c7776f92 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 10:11:23 user nova-compute[73572]: DEBUG nova.privsep.utils [None req-53c4bc61-ff31-43d6-ad6e-df67c7776f92 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73572) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 26 10:11:23 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-53c4bc61-ff31-43d6-ad6e-df67c7776f92 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T10:11:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1967617769',display_name='tempest-DeleteServersTestJSON-server-1967617769',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1967617769',id=1,image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5500e4b0418743abaeca3f853a4908c4',ramdisk_id='',reservation_id='r-hfk0l9n9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1148500196',owner_user_name='tempest-DeleteServersTestJSON-1148500196-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T10:11:18Z,user_data=None,user_id='5373e9f0d5924f65807259963192e12a',uuid=61b60a19-597e-4dc1-af0f-a0ec95e9fd24,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f846939c-c22d-4e0c-9237-404eabf0abd4", "address": "fa:16:3e:46:77:5d", "network": {"id": "07a1c135-6593-4fe1-8020-305e2596db1d", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1106906776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5500e4b0418743abaeca3f853a4908c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf846939c-c2", "ovs_interfaceid": "f846939c-c22d-4e0c-9237-404eabf0abd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73572) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 10:11:23 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-53c4bc61-ff31-43d6-ad6e-df67c7776f92 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] Converting VIF {"id": "f846939c-c22d-4e0c-9237-404eabf0abd4", "address": "fa:16:3e:46:77:5d", "network": {"id": "07a1c135-6593-4fe1-8020-305e2596db1d", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1106906776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5500e4b0418743abaeca3f853a4908c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf846939c-c2", "ovs_interfaceid": "f846939c-c22d-4e0c-9237-404eabf0abd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:11:23 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-53c4bc61-ff31-43d6-ad6e-df67c7776f92 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:77:5d,bridge_name='br-int',has_traffic_filtering=True,id=f846939c-c22d-4e0c-9237-404eabf0abd4,network=Network(07a1c135-6593-4fe1-8020-305e2596db1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf846939c-c2') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:11:23 user nova-compute[73572]: DEBUG nova.objects.instance [None req-53c4bc61-ff31-43d6-ad6e-df67c7776f92 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] Lazy-loading 'pci_devices' on Instance uuid 61b60a19-597e-4dc1-af0f-a0ec95e9fd24 {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:11:23 user nova-compute[73572]: DEBUG nova.network.neutron [None req-62a5f658-c44e-4e75-863d-84de11d2aa43 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: c785b609-0068-442f-91f5-d26e888a993f] Successfully created port: f01cdcf9-2430-4eb5-bb2d-3d126756dfc1 {{(pid=73572) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 10:11:23 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-53c4bc61-ff31-43d6-ad6e-df67c7776f92 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] [instance: 61b60a19-597e-4dc1-af0f-a0ec95e9fd24] End _get_guest_xml xml=<domain type="kvm">
Aug 26 10:11:23 user nova-compute[73572]:   <uuid>61b60a19-597e-4dc1-af0f-a0ec95e9fd24</uuid>
Aug 26 10:11:23 user nova-compute[73572]:   <name>instance-00000001</name>
Aug 26 10:11:23 user nova-compute[73572]:   <memory>524288</memory>
Aug 26 10:11:23 user nova-compute[73572]:   <vcpu>1</vcpu>
Aug 26 10:11:23 user nova-compute[73572]:   <metadata>
Aug 26 10:11:23 user nova-compute[73572]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 10:11:23 user nova-compute[73572]:       <nova:package version="0.0.0"/>
Aug 26 10:11:23 user nova-compute[73572]:       <nova:name>tempest-DeleteServersTestJSON-server-1967617769</nova:name>
Aug 26 10:11:23 user nova-compute[73572]:       <nova:creationTime>2023-08-26 10:11:23</nova:creationTime>
Aug 26 10:11:23 user nova-compute[73572]:       <nova:flavor name="m1.tiny">
Aug 26 10:11:23 user nova-compute[73572]:         <nova:memory>512</nova:memory>
Aug 26 10:11:23 user nova-compute[73572]:         <nova:disk>1</nova:disk>
Aug 26 10:11:23 user nova-compute[73572]:         <nova:swap>0</nova:swap>
Aug 26 10:11:23 user nova-compute[73572]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 10:11:23 user nova-compute[73572]:         <nova:vcpus>1</nova:vcpus>
Aug 26 10:11:23 user nova-compute[73572]:       </nova:flavor>
Aug 26 10:11:23 user nova-compute[73572]:       <nova:owner>
Aug 26 10:11:23 user nova-compute[73572]:         <nova:user uuid="5373e9f0d5924f65807259963192e12a">tempest-DeleteServersTestJSON-1148500196-project-member</nova:user>
Aug 26 10:11:23 user nova-compute[73572]:         <nova:project uuid="5500e4b0418743abaeca3f853a4908c4">tempest-DeleteServersTestJSON-1148500196</nova:project>
Aug 26 10:11:23 user nova-compute[73572]:       </nova:owner>
Aug 26 10:11:23 user nova-compute[73572]:       <nova:root type="image" uuid="299da0c9-e1c4-48f0-be55-fbe20dd06bc9"/>
Aug 26 10:11:23 user nova-compute[73572]:       <nova:ports>
Aug 26 10:11:23 user nova-compute[73572]:         <nova:port uuid="f846939c-c22d-4e0c-9237-404eabf0abd4">
Aug 26 10:11:23 user nova-compute[73572]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 26 10:11:23 user nova-compute[73572]:         </nova:port>
Aug 26 10:11:23 user nova-compute[73572]:       </nova:ports>
Aug 26 10:11:23 user nova-compute[73572]:     </nova:instance>
Aug 26 10:11:23 user nova-compute[73572]:   </metadata>
Aug 26 10:11:23 user nova-compute[73572]:   <sysinfo type="smbios">
Aug 26 10:11:23 user nova-compute[73572]:     <system>
Aug 26 10:11:23 user nova-compute[73572]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 10:11:23 user nova-compute[73572]:       <entry name="product">OpenStack Nova</entry>
Aug 26 10:11:23 user nova-compute[73572]:       <entry name="version">0.0.0</entry>
Aug 26 10:11:23 user nova-compute[73572]:       <entry name="serial">61b60a19-597e-4dc1-af0f-a0ec95e9fd24</entry>
Aug 26 10:11:23 user nova-compute[73572]:       <entry name="uuid">61b60a19-597e-4dc1-af0f-a0ec95e9fd24</entry>
Aug 26 10:11:23 user nova-compute[73572]:       <entry name="family">Virtual Machine</entry>
Aug 26 10:11:23 user nova-compute[73572]:     </system>
Aug 26 10:11:23 user nova-compute[73572]:   </sysinfo>
Aug 26 10:11:23 user nova-compute[73572]:   <os>
Aug 26 10:11:23 user nova-compute[73572]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 10:11:23 user nova-compute[73572]:     <boot dev="hd"/>
Aug 26 10:11:23 user nova-compute[73572]:     <smbios mode="sysinfo"/>
Aug 26 10:11:23 user nova-compute[73572]:   </os>
Aug 26 10:11:23 user nova-compute[73572]:   <features>
Aug 26 10:11:23 user nova-compute[73572]:     <acpi/>
Aug 26 10:11:23 user nova-compute[73572]:     <apic/>
Aug 26 10:11:23 user nova-compute[73572]:     <vmcoreinfo/>
Aug 26 10:11:23 user nova-compute[73572]:   </features>
Aug 26 10:11:23 user nova-compute[73572]:   <clock offset="utc">
Aug 26 10:11:23 user nova-compute[73572]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 10:11:23 user nova-compute[73572]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 10:11:23 user nova-compute[73572]:     <timer name="hpet" present="no"/>
Aug 26 10:11:23 user nova-compute[73572]:   </clock>
Aug 26 10:11:23 user nova-compute[73572]:   <cpu mode="custom" match="exact">
Aug 26 10:11:23 user nova-compute[73572]:     <model>Nehalem</model>
Aug 26 10:11:23 user nova-compute[73572]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 10:11:23 user nova-compute[73572]:   </cpu>
Aug 26 10:11:23 user nova-compute[73572]:   <devices>
Aug 26 10:11:23 user nova-compute[73572]:     <disk type="file" device="disk">
Aug 26 10:11:23 user nova-compute[73572]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 10:11:23 user nova-compute[73572]:       <source file="/opt/stack/data/nova/instances/61b60a19-597e-4dc1-af0f-a0ec95e9fd24/disk"/>
Aug 26 10:11:23 user nova-compute[73572]:       <target dev="vda" bus="virtio"/>
Aug 26 10:11:23 user nova-compute[73572]:     </disk>
Aug 26 10:11:23 user nova-compute[73572]:     <interface type="ethernet">
Aug 26 10:11:23 user nova-compute[73572]:       <mac address="fa:16:3e:46:77:5d"/>
Aug 26 10:11:23 user nova-compute[73572]:       <model type="virtio"/>
Aug 26 10:11:23 user nova-compute[73572]:       <mtu size="1442"/>
Aug 26 10:11:23 user nova-compute[73572]:       <target dev="tapf846939c-c2"/>
Aug 26 10:11:23 user nova-compute[73572]:     </interface>
Aug 26 10:11:23 user nova-compute[73572]:     <serial type="pty">
Aug 26 10:11:23 user nova-compute[73572]:       <log file="/opt/stack/data/nova/instances/61b60a19-597e-4dc1-af0f-a0ec95e9fd24/console.log" append="off"/>
Aug 26 10:11:23 user nova-compute[73572]:     </serial>
Aug 26 10:11:23 user nova-compute[73572]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 10:11:23 user nova-compute[73572]:     <video>
Aug 26 10:11:23 user nova-compute[73572]:       <model type="virtio"/>
Aug 26 10:11:23 user nova-compute[73572]:     </video>
Aug 26 10:11:23 user nova-compute[73572]:     <rng model="virtio">
Aug 26 10:11:23 user nova-compute[73572]:       <backend model="random">/dev/urandom</backend>
Aug 26 10:11:23 user nova-compute[73572]:     </rng>
Aug 26 10:11:23 user nova-compute[73572]:     <controller type="usb" index="0" model="none"/>
Aug 26 10:11:23 user nova-compute[73572]:     <memballoon model="virtio">
Aug 26 10:11:23 user nova-compute[73572]:       <stats period="10"/>
Aug 26 10:11:23 user nova-compute[73572]:     </memballoon>
Aug 26 10:11:23 user nova-compute[73572]:   </devices>
Aug 26 10:11:23 user nova-compute[73572]: </domain>
Aug 26 10:11:23 user nova-compute[73572]:  {{(pid=73572) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 10:11:23 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-53c4bc61-ff31-43d6-ad6e-df67c7776f92 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T10:11:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1967617769',display_name='tempest-DeleteServersTestJSON-server-1967617769',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1967617769',id=1,image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5500e4b0418743abaeca3f853a4908c4',ramdisk_id='',reservation_id='r-hfk0l9n9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1148500196',owner_user_name='tempest-DeleteServersTestJSON-1148500196-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T10:11:18Z,user_data=None,user_id='5373e9f0d5924f65807259963192e12a',uuid=61b60a19-597e-4dc1-af0f-a0ec95e9fd24,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f846939c-c22d-4e0c-9237-404eabf0abd4", "address": "fa:16:3e:46:77:5d", "network": {"id": "07a1c135-6593-4fe1-8020-305e2596db1d", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1106906776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5500e4b0418743abaeca3f853a4908c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf846939c-c2", "ovs_interfaceid": "f846939c-c22d-4e0c-9237-404eabf0abd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 10:11:23 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-53c4bc61-ff31-43d6-ad6e-df67c7776f92 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] Converting VIF {"id": "f846939c-c22d-4e0c-9237-404eabf0abd4", "address": "fa:16:3e:46:77:5d", "network": {"id": "07a1c135-6593-4fe1-8020-305e2596db1d", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1106906776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5500e4b0418743abaeca3f853a4908c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf846939c-c2", "ovs_interfaceid": "f846939c-c22d-4e0c-9237-404eabf0abd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:11:23 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-53c4bc61-ff31-43d6-ad6e-df67c7776f92 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:77:5d,bridge_name='br-int',has_traffic_filtering=True,id=f846939c-c22d-4e0c-9237-404eabf0abd4,network=Network(07a1c135-6593-4fe1-8020-305e2596db1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf846939c-c2') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:11:23 user nova-compute[73572]: DEBUG os_vif [None req-53c4bc61-ff31-43d6-ad6e-df67c7776f92 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:77:5d,bridge_name='br-int',has_traffic_filtering=True,id=f846939c-c22d-4e0c-9237-404eabf0abd4,network=Network(07a1c135-6593-4fe1-8020-305e2596db1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf846939c-c2') {{(pid=73572) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 10:11:23 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-4390620d-fd54-45c3-98fa-55a5a0bae479 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8302d6e7-aaf3-461c-a55e-f2e685d1800d/disk --force-share --output=json" returned: 0 in 0.280s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:11:23 user nova-compute[73572]: DEBUG nova.virt.disk.api [None req-4390620d-fd54-45c3-98fa-55a5a0bae479 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] Cannot resize image /opt/stack/data/nova/instances/8302d6e7-aaf3-461c-a55e-f2e685d1800d/disk to a smaller size. {{(pid=73572) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 10:11:23 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-4390620d-fd54-45c3-98fa-55a5a0bae479 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] [instance: 8302d6e7-aaf3-461c-a55e-f2e685d1800d] Created local disks {{(pid=73572) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 10:11:23 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-4390620d-fd54-45c3-98fa-55a5a0bae479 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] [instance: 8302d6e7-aaf3-461c-a55e-f2e685d1800d] Ensure instance console log exists: /opt/stack/data/nova/instances/8302d6e7-aaf3-461c-a55e-f2e685d1800d/console.log {{(pid=73572) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 10:11:23 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-4390620d-fd54-45c3-98fa-55a5a0bae479 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:11:23 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-4390620d-fd54-45c3-98fa-55a5a0bae479 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:11:23 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-4390620d-fd54-45c3-98fa-55a5a0bae479 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:11:23 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl [None req-53c4bc61-ff31-43d6-ad6e-df67c7776f92 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] Created schema index Interface.name {{(pid=73572) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 26 10:11:23 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl [None req-53c4bc61-ff31-43d6-ad6e-df67c7776f92 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] Created schema index Port.name {{(pid=73572) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 26 10:11:23 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl [None req-53c4bc61-ff31-43d6-ad6e-df67c7776f92 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] Created schema index Bridge.name {{(pid=73572) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 26 10:11:23 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-53c4bc61-ff31-43d6-ad6e-df67c7776f92 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=73572) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 10:11:23 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-53c4bc61-ff31-43d6-ad6e-df67c7776f92 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] [POLLOUT] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:11:23 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-53c4bc61-ff31-43d6-ad6e-df67c7776f92 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73572) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 10:11:23 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-53c4bc61-ff31-43d6-ad6e-df67c7776f92 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:11:23 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-53c4bc61-ff31-43d6-ad6e-df67c7776f92 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:11:23 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-53c4bc61-ff31-43d6-ad6e-df67c7776f92 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:11:23 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:11:23 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:11:23 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 10:11:23 user nova-compute[73572]: INFO oslo.privsep.daemon [None req-53c4bc61-ff31-43d6-ad6e-df67c7776f92 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmp8ecdhuko/privsep.sock']
Aug 26 10:11:23 user sudo[82953]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmp8ecdhuko/privsep.sock
Aug 26 10:11:23 user sudo[82953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 26 10:11:24 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-188a1c5b-a0ef-4f1c-91ef-7e2d1ce280a1 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] Acquiring lock "c555f971-b177-4c26-a38e-09e0e78bf7b9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:11:24 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-188a1c5b-a0ef-4f1c-91ef-7e2d1ce280a1 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] Lock "c555f971-b177-4c26-a38e-09e0e78bf7b9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:11:24 user nova-compute[73572]: DEBUG nova.compute.manager [None req-188a1c5b-a0ef-4f1c-91ef-7e2d1ce280a1 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] [instance: c555f971-b177-4c26-a38e-09e0e78bf7b9] Starting instance... {{(pid=73572) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 10:11:24 user nova-compute[73572]: DEBUG nova.network.neutron [None req-4390620d-fd54-45c3-98fa-55a5a0bae479 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] [instance: 8302d6e7-aaf3-461c-a55e-f2e685d1800d] Successfully created port: 61c82fb7-2eee-4be0-a37f-669791ea6d9c {{(pid=73572) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 10:11:24 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-188a1c5b-a0ef-4f1c-91ef-7e2d1ce280a1 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:11:24 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-188a1c5b-a0ef-4f1c-91ef-7e2d1ce280a1 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:11:24 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-188a1c5b-a0ef-4f1c-91ef-7e2d1ce280a1 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73572) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 10:11:24 user nova-compute[73572]: INFO nova.compute.claims [None req-188a1c5b-a0ef-4f1c-91ef-7e2d1ce280a1 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] [instance: c555f971-b177-4c26-a38e-09e0e78bf7b9] Claim successful on node user
Aug 26 10:11:24 user nova-compute[73572]: DEBUG nova.compute.provider_tree [None req-188a1c5b-a0ef-4f1c-91ef-7e2d1ce280a1 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] Inventory has not changed in ProviderTree for provider: e2cec974-59b2-4c77-a53d-a7f4e5a30d75 {{(pid=73572) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 10:11:24 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-188a1c5b-a0ef-4f1c-91ef-7e2d1ce280a1 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] Inventory has not changed for provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73572) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 10:11:24 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-188a1c5b-a0ef-4f1c-91ef-7e2d1ce280a1 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.318s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:11:24 user nova-compute[73572]: DEBUG nova.compute.manager [None req-188a1c5b-a0ef-4f1c-91ef-7e2d1ce280a1 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] [instance: c555f971-b177-4c26-a38e-09e0e78bf7b9] Start building networks asynchronously for instance. {{(pid=73572) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 10:11:24 user nova-compute[73572]: DEBUG nova.compute.manager [None req-188a1c5b-a0ef-4f1c-91ef-7e2d1ce280a1 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] [instance: c555f971-b177-4c26-a38e-09e0e78bf7b9] Allocating IP information in the background. {{(pid=73572) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 10:11:24 user nova-compute[73572]: DEBUG nova.network.neutron [None req-188a1c5b-a0ef-4f1c-91ef-7e2d1ce280a1 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] [instance: c555f971-b177-4c26-a38e-09e0e78bf7b9] allocate_for_instance() {{(pid=73572) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 10:11:24 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-188a1c5b-a0ef-4f1c-91ef-7e2d1ce280a1 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] [instance: c555f971-b177-4c26-a38e-09e0e78bf7b9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 10:11:24 user nova-compute[73572]: DEBUG nova.compute.manager [None req-188a1c5b-a0ef-4f1c-91ef-7e2d1ce280a1 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] [instance: c555f971-b177-4c26-a38e-09e0e78bf7b9] Start building block device mappings for instance. {{(pid=73572) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 10:11:24 user nova-compute[73572]: DEBUG nova.compute.manager [None req-188a1c5b-a0ef-4f1c-91ef-7e2d1ce280a1 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] [instance: c555f971-b177-4c26-a38e-09e0e78bf7b9] Start spawning the instance on the hypervisor. {{(pid=73572) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 10:11:24 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-188a1c5b-a0ef-4f1c-91ef-7e2d1ce280a1 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] [instance: c555f971-b177-4c26-a38e-09e0e78bf7b9] Creating instance directory {{(pid=73572) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 10:11:24 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-188a1c5b-a0ef-4f1c-91ef-7e2d1ce280a1 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] [instance: c555f971-b177-4c26-a38e-09e0e78bf7b9] Creating image(s)
Aug 26 10:11:24 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-188a1c5b-a0ef-4f1c-91ef-7e2d1ce280a1 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] Acquiring lock "/opt/stack/data/nova/instances/c555f971-b177-4c26-a38e-09e0e78bf7b9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:11:24 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-188a1c5b-a0ef-4f1c-91ef-7e2d1ce280a1 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] Lock "/opt/stack/data/nova/instances/c555f971-b177-4c26-a38e-09e0e78bf7b9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:11:24 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-188a1c5b-a0ef-4f1c-91ef-7e2d1ce280a1 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] Lock "/opt/stack/data/nova/instances/c555f971-b177-4c26-a38e-09e0e78bf7b9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:11:24 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-188a1c5b-a0ef-4f1c-91ef-7e2d1ce280a1 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:11:24 user nova-compute[73572]: DEBUG nova.network.neutron [req-4d21cb53-dd5c-4269-a540-ea0b9e5933f0 req-a2c0f717-b694-4825-b01e-6b2563e385eb service nova] [instance: 61b60a19-597e-4dc1-af0f-a0ec95e9fd24] Updated VIF entry in instance network info cache for port f846939c-c22d-4e0c-9237-404eabf0abd4. {{(pid=73572) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 10:11:24 user nova-compute[73572]: DEBUG nova.network.neutron [req-4d21cb53-dd5c-4269-a540-ea0b9e5933f0 req-a2c0f717-b694-4825-b01e-6b2563e385eb service nova] [instance: 61b60a19-597e-4dc1-af0f-a0ec95e9fd24] Updating instance_info_cache with network_info: [{"id": "f846939c-c22d-4e0c-9237-404eabf0abd4", "address": "fa:16:3e:46:77:5d", "network": {"id": "07a1c135-6593-4fe1-8020-305e2596db1d", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1106906776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5500e4b0418743abaeca3f853a4908c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf846939c-c2", "ovs_interfaceid": "f846939c-c22d-4e0c-9237-404eabf0abd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:11:24 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-4d21cb53-dd5c-4269-a540-ea0b9e5933f0 req-a2c0f717-b694-4825-b01e-6b2563e385eb service nova] Releasing lock "refresh_cache-61b60a19-597e-4dc1-af0f-a0ec95e9fd24" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:11:25 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-188a1c5b-a0ef-4f1c-91ef-7e2d1ce280a1 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json" returned: 0 in 0.176s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:11:25 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-188a1c5b-a0ef-4f1c-91ef-7e2d1ce280a1 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] Acquiring lock "2099350d6f3bcd0de9471c73862d4fe75b049801" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:11:25 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-188a1c5b-a0ef-4f1c-91ef-7e2d1ce280a1 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] Lock "2099350d6f3bcd0de9471c73862d4fe75b049801" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:11:25 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-188a1c5b-a0ef-4f1c-91ef-7e2d1ce280a1 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:11:25 user nova-compute[73572]: DEBUG nova.policy [None req-188a1c5b-a0ef-4f1c-91ef-7e2d1ce280a1 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a56cbd5c1fe94cf9b2a0adc3e82f600b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4556d14c0dd416fbe13ab2274947dec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73572) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 10:11:25 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-188a1c5b-a0ef-4f1c-91ef-7e2d1ce280a1 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json" returned: 0 in 0.196s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:11:25 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-188a1c5b-a0ef-4f1c-91ef-7e2d1ce280a1 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801,backing_fmt=raw /opt/stack/data/nova/instances/c555f971-b177-4c26-a38e-09e0e78bf7b9/disk 1073741824 {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:11:25 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-188a1c5b-a0ef-4f1c-91ef-7e2d1ce280a1 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801,backing_fmt=raw /opt/stack/data/nova/instances/c555f971-b177-4c26-a38e-09e0e78bf7b9/disk 1073741824" returned: 0 in 0.061s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:11:25 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-188a1c5b-a0ef-4f1c-91ef-7e2d1ce280a1 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] Lock "2099350d6f3bcd0de9471c73862d4fe75b049801" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.261s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:11:25 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-188a1c5b-a0ef-4f1c-91ef-7e2d1ce280a1 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:11:25 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:11:25 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-188a1c5b-a0ef-4f1c-91ef-7e2d1ce280a1 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json" returned: 0 in 0.201s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:11:25 user nova-compute[73572]: DEBUG nova.virt.disk.api [None req-188a1c5b-a0ef-4f1c-91ef-7e2d1ce280a1 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c555f971-b177-4c26-a38e-09e0e78bf7b9/disk. size=1073741824 {{(pid=73572) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 10:11:25 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-188a1c5b-a0ef-4f1c-91ef-7e2d1ce280a1 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c555f971-b177-4c26-a38e-09e0e78bf7b9/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:11:25 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-188a1c5b-a0ef-4f1c-91ef-7e2d1ce280a1 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c555f971-b177-4c26-a38e-09e0e78bf7b9/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:11:25 user nova-compute[73572]: DEBUG nova.virt.disk.api [None req-188a1c5b-a0ef-4f1c-91ef-7e2d1ce280a1 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] Cannot resize image /opt/stack/data/nova/instances/c555f971-b177-4c26-a38e-09e0e78bf7b9/disk to a smaller size. {{(pid=73572) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 10:11:25 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-188a1c5b-a0ef-4f1c-91ef-7e2d1ce280a1 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] [instance: c555f971-b177-4c26-a38e-09e0e78bf7b9] Created local disks {{(pid=73572) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 10:11:25 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-188a1c5b-a0ef-4f1c-91ef-7e2d1ce280a1 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] [instance: c555f971-b177-4c26-a38e-09e0e78bf7b9] Ensure instance console log exists: /opt/stack/data/nova/instances/c555f971-b177-4c26-a38e-09e0e78bf7b9/console.log {{(pid=73572) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 10:11:25 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-188a1c5b-a0ef-4f1c-91ef-7e2d1ce280a1 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:11:25 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-188a1c5b-a0ef-4f1c-91ef-7e2d1ce280a1 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:11:25 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-188a1c5b-a0ef-4f1c-91ef-7e2d1ce280a1 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:11:25 user sudo[82953]: pam_unix(sudo:session): session closed for user root
Aug 26 10:11:25 user nova-compute[73572]: INFO oslo.privsep.daemon [None req-53c4bc61-ff31-43d6-ad6e-df67c7776f92 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] Spawned new privsep daemon via rootwrap
Aug 26 10:11:25 user nova-compute[73572]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 26 10:11:25 user nova-compute[73572]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 26 10:11:25 user nova-compute[73572]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Aug 26 10:11:25 user nova-compute[73572]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 82966
Aug 26 10:11:26 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:11:26 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:11:26 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf846939c-c2, may_exist=True, interface_attrs={}) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:11:26 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf846939c-c2, col_values=(('external_ids', {'iface-id': 'f846939c-c22d-4e0c-9237-404eabf0abd4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:46:77:5d', 'vm-uuid': '61b60a19-597e-4dc1-af0f-a0ec95e9fd24'}),), if_exists=True) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:11:26 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:11:26 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:11:26 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:11:26 user nova-compute[73572]: INFO os_vif [None req-53c4bc61-ff31-43d6-ad6e-df67c7776f92 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:77:5d,bridge_name='br-int',has_traffic_filtering=True,id=f846939c-c22d-4e0c-9237-404eabf0abd4,network=Network(07a1c135-6593-4fe1-8020-305e2596db1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf846939c-c2')
Aug 26 10:11:26 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-53c4bc61-ff31-43d6-ad6e-df67c7776f92 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] No BDM found with device name vda, not building metadata. {{(pid=73572) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 10:11:26 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-53c4bc61-ff31-43d6-ad6e-df67c7776f92 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] No VIF found with MAC fa:16:3e:46:77:5d, not building metadata {{(pid=73572) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 10:11:27 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:11:27 user nova-compute[73572]: DEBUG nova.network.neutron [None req-62a5f658-c44e-4e75-863d-84de11d2aa43 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: c785b609-0068-442f-91f5-d26e888a993f] Successfully updated port: f01cdcf9-2430-4eb5-bb2d-3d126756dfc1 {{(pid=73572) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 10:11:27 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-62a5f658-c44e-4e75-863d-84de11d2aa43 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Acquiring lock "refresh_cache-c785b609-0068-442f-91f5-d26e888a993f" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:11:27 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-62a5f658-c44e-4e75-863d-84de11d2aa43 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Acquired lock "refresh_cache-c785b609-0068-442f-91f5-d26e888a993f" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:11:27 user nova-compute[73572]: DEBUG nova.network.neutron [None req-62a5f658-c44e-4e75-863d-84de11d2aa43 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: c785b609-0068-442f-91f5-d26e888a993f] Building network info cache for instance {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 10:11:27 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:11:27 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:11:27 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:11:27 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:11:27 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:11:27 user nova-compute[73572]: DEBUG nova.network.neutron [None req-62a5f658-c44e-4e75-863d-84de11d2aa43 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: c785b609-0068-442f-91f5-d26e888a993f] Instance cache missing network info. {{(pid=73572) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 10:11:27 user nova-compute[73572]: DEBUG nova.compute.manager [req-98d451b1-ec4c-4601-9dcb-917820834a0b req-3a56d70b-ae44-4186-a126-2bdfb80a74a1 service nova] [instance: c785b609-0068-442f-91f5-d26e888a993f] Received event network-changed-f01cdcf9-2430-4eb5-bb2d-3d126756dfc1 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:11:27 user nova-compute[73572]: DEBUG nova.compute.manager [req-98d451b1-ec4c-4601-9dcb-917820834a0b req-3a56d70b-ae44-4186-a126-2bdfb80a74a1 service nova] [instance: c785b609-0068-442f-91f5-d26e888a993f] Refreshing instance network info cache due to event network-changed-f01cdcf9-2430-4eb5-bb2d-3d126756dfc1. {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 10:11:27 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-98d451b1-ec4c-4601-9dcb-917820834a0b req-3a56d70b-ae44-4186-a126-2bdfb80a74a1 service nova] Acquiring lock "refresh_cache-c785b609-0068-442f-91f5-d26e888a993f" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:11:28 user nova-compute[73572]: DEBUG nova.network.neutron [None req-4390620d-fd54-45c3-98fa-55a5a0bae479 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] [instance: 8302d6e7-aaf3-461c-a55e-f2e685d1800d] Successfully updated port: 61c82fb7-2eee-4be0-a37f-669791ea6d9c {{(pid=73572) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 10:11:28 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-4390620d-fd54-45c3-98fa-55a5a0bae479 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] Acquiring lock "refresh_cache-8302d6e7-aaf3-461c-a55e-f2e685d1800d" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:11:28 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-4390620d-fd54-45c3-98fa-55a5a0bae479 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] Acquired lock "refresh_cache-8302d6e7-aaf3-461c-a55e-f2e685d1800d" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:11:28 user nova-compute[73572]: DEBUG nova.network.neutron [None req-4390620d-fd54-45c3-98fa-55a5a0bae479 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] [instance: 8302d6e7-aaf3-461c-a55e-f2e685d1800d] Building network info cache for instance {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 10:11:28 user nova-compute[73572]: DEBUG nova.network.neutron [None req-4390620d-fd54-45c3-98fa-55a5a0bae479 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] [instance: 8302d6e7-aaf3-461c-a55e-f2e685d1800d] Instance cache missing network info. {{(pid=73572) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 10:11:28 user nova-compute[73572]: DEBUG nova.network.neutron [None req-188a1c5b-a0ef-4f1c-91ef-7e2d1ce280a1 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] [instance: c555f971-b177-4c26-a38e-09e0e78bf7b9] Successfully created port: 4ffb7229-16fb-441b-a954-d91308071fb8 {{(pid=73572) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 10:11:28 user nova-compute[73572]: DEBUG nova.network.neutron [None req-62a5f658-c44e-4e75-863d-84de11d2aa43 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: c785b609-0068-442f-91f5-d26e888a993f] Updating instance_info_cache with network_info: [{"id": "f01cdcf9-2430-4eb5-bb2d-3d126756dfc1", "address": "fa:16:3e:fa:6c:bc", "network": {"id": "991b9dff-5173-4456-a530-b1f7eb5cfa4a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1845930297-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4636f93c5bfc4653804de097aed2882c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf01cdcf9-24", "ovs_interfaceid": "f01cdcf9-2430-4eb5-bb2d-3d126756dfc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:11:28 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:11:28 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-62a5f658-c44e-4e75-863d-84de11d2aa43 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Releasing lock "refresh_cache-c785b609-0068-442f-91f5-d26e888a993f" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:11:28 user nova-compute[73572]: DEBUG nova.compute.manager [None req-62a5f658-c44e-4e75-863d-84de11d2aa43 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: c785b609-0068-442f-91f5-d26e888a993f] Instance network_info: |[{"id": "f01cdcf9-2430-4eb5-bb2d-3d126756dfc1", "address": "fa:16:3e:fa:6c:bc", "network": {"id": "991b9dff-5173-4456-a530-b1f7eb5cfa4a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1845930297-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4636f93c5bfc4653804de097aed2882c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf01cdcf9-24", "ovs_interfaceid": "f01cdcf9-2430-4eb5-bb2d-3d126756dfc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73572) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 10:11:28 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-98d451b1-ec4c-4601-9dcb-917820834a0b req-3a56d70b-ae44-4186-a126-2bdfb80a74a1 service nova] Acquired lock "refresh_cache-c785b609-0068-442f-91f5-d26e888a993f" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:11:28 user nova-compute[73572]: DEBUG nova.network.neutron [req-98d451b1-ec4c-4601-9dcb-917820834a0b req-3a56d70b-ae44-4186-a126-2bdfb80a74a1 service nova] [instance: c785b609-0068-442f-91f5-d26e888a993f] Refreshing network info cache for port f01cdcf9-2430-4eb5-bb2d-3d126756dfc1 {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 10:11:28 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-62a5f658-c44e-4e75-863d-84de11d2aa43 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: c785b609-0068-442f-91f5-d26e888a993f] Start _get_guest_xml network_info=[{"id": "f01cdcf9-2430-4eb5-bb2d-3d126756dfc1", "address": "fa:16:3e:fa:6c:bc", "network": {"id": "991b9dff-5173-4456-a530-b1f7eb5cfa4a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1845930297-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4636f93c5bfc4653804de097aed2882c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf01cdcf9-24", "ovs_interfaceid": "f01cdcf9-2430-4eb5-bb2d-3d126756dfc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T10:07:33Z,direct_url=<?>,disk_format='qcow2',id=299da0c9-e1c4-48f0-be55-fbe20dd06bc9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5c995f8bbbab4368b67a253e0df3971a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T10:07:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'guest_format': None, 'size': 0, 'encryption_format': None, 'device_type': 'disk', 'image_id': '299da0c9-e1c4-48f0-be55-fbe20dd06bc9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73572) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 10:11:28 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-62a5f658-c44e-4e75-863d-84de11d2aa43 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:11:28 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-62a5f658-c44e-4e75-863d-84de11d2aa43 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:11:28 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-62a5f658-c44e-4e75-863d-84de11d2aa43 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73572) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 10:11:28 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-62a5f658-c44e-4e75-863d-84de11d2aa43 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] CPU controller missing on host. {{(pid=73572) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 10:11:28 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-62a5f658-c44e-4e75-863d-84de11d2aa43 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73572) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 10:11:28 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-62a5f658-c44e-4e75-863d-84de11d2aa43 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] CPU controller found on host. {{(pid=73572) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 10:11:28 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-62a5f658-c44e-4e75-863d-84de11d2aa43 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73572) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 10:11:28 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-62a5f658-c44e-4e75-863d-84de11d2aa43 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T10:07:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T10:07:33Z,direct_url=<?>,disk_format='qcow2',id=299da0c9-e1c4-48f0-be55-fbe20dd06bc9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5c995f8bbbab4368b67a253e0df3971a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T10:07:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 10:11:28 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-62a5f658-c44e-4e75-863d-84de11d2aa43 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Flavor limits 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 10:11:28 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-62a5f658-c44e-4e75-863d-84de11d2aa43 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Image limits 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 10:11:28 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-62a5f658-c44e-4e75-863d-84de11d2aa43 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Flavor pref 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 10:11:28 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-62a5f658-c44e-4e75-863d-84de11d2aa43 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Image pref 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 10:11:28 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-62a5f658-c44e-4e75-863d-84de11d2aa43 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 10:11:28 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-62a5f658-c44e-4e75-863d-84de11d2aa43 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 10:11:28 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-62a5f658-c44e-4e75-863d-84de11d2aa43 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73572) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 10:11:28 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-62a5f658-c44e-4e75-863d-84de11d2aa43 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Got 1 possible topologies {{(pid=73572) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 10:11:28 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-62a5f658-c44e-4e75-863d-84de11d2aa43 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 10:11:28 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-62a5f658-c44e-4e75-863d-84de11d2aa43 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 10:11:28 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-62a5f658-c44e-4e75-863d-84de11d2aa43 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T10:11:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-146724740',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-146724740',id=2,image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4636f93c5bfc4653804de097aed2882c',ramdisk_id='',reservation_id='r-in137qtn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-665602868',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T10:11:20Z,user_data=None,user_id='07f3538038a14713af3bbe420f1fb03a',uuid=c785b609-0068-442f-91f5-d26e888a993f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f01cdcf9-2430-4eb5-bb2d-3d126756dfc1", "address": "fa:16:3e:fa:6c:bc", "network": {"id": "991b9dff-5173-4456-a530-b1f7eb5cfa4a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1845930297-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4636f93c5bfc4653804de097aed2882c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf01cdcf9-24", "ovs_interfaceid": "f01cdcf9-2430-4eb5-bb2d-3d126756dfc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73572) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 10:11:28 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-62a5f658-c44e-4e75-863d-84de11d2aa43 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Converting VIF {"id": "f01cdcf9-2430-4eb5-bb2d-3d126756dfc1", "address": "fa:16:3e:fa:6c:bc", "network": {"id": "991b9dff-5173-4456-a530-b1f7eb5cfa4a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1845930297-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4636f93c5bfc4653804de097aed2882c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf01cdcf9-24", "ovs_interfaceid": "f01cdcf9-2430-4eb5-bb2d-3d126756dfc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:11:28 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-62a5f658-c44e-4e75-863d-84de11d2aa43 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fa:6c:bc,bridge_name='br-int',has_traffic_filtering=True,id=f01cdcf9-2430-4eb5-bb2d-3d126756dfc1,network=Network(991b9dff-5173-4456-a530-b1f7eb5cfa4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf01cdcf9-24') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:11:28 user nova-compute[73572]: DEBUG nova.objects.instance [None req-62a5f658-c44e-4e75-863d-84de11d2aa43 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Lazy-loading 'pci_devices' on Instance uuid c785b609-0068-442f-91f5-d26e888a993f {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:11:28 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-62a5f658-c44e-4e75-863d-84de11d2aa43 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: c785b609-0068-442f-91f5-d26e888a993f] End _get_guest_xml xml=<domain type="kvm">
Aug 26 10:11:28 user nova-compute[73572]:   <uuid>c785b609-0068-442f-91f5-d26e888a993f</uuid>
Aug 26 10:11:28 user nova-compute[73572]:   <name>instance-00000002</name>
Aug 26 10:11:28 user nova-compute[73572]:   <memory>524288</memory>
Aug 26 10:11:28 user nova-compute[73572]:   <vcpu>1</vcpu>
Aug 26 10:11:28 user nova-compute[73572]:   <metadata>
Aug 26 10:11:28 user nova-compute[73572]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 10:11:28 user nova-compute[73572]:       <nova:package version="0.0.0"/>
Aug 26 10:11:28 user nova-compute[73572]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-146724740</nova:name>
Aug 26 10:11:28 user nova-compute[73572]:       <nova:creationTime>2023-08-26 10:11:28</nova:creationTime>
Aug 26 10:11:28 user nova-compute[73572]:       <nova:flavor name="m1.tiny">
Aug 26 10:11:28 user nova-compute[73572]:         <nova:memory>512</nova:memory>
Aug 26 10:11:28 user nova-compute[73572]:         <nova:disk>1</nova:disk>
Aug 26 10:11:28 user nova-compute[73572]:         <nova:swap>0</nova:swap>
Aug 26 10:11:28 user nova-compute[73572]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 10:11:28 user nova-compute[73572]:         <nova:vcpus>1</nova:vcpus>
Aug 26 10:11:28 user nova-compute[73572]:       </nova:flavor>
Aug 26 10:11:28 user nova-compute[73572]:       <nova:owner>
Aug 26 10:11:28 user nova-compute[73572]:         <nova:user uuid="07f3538038a14713af3bbe420f1fb03a">tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member</nova:user>
Aug 26 10:11:28 user nova-compute[73572]:         <nova:project uuid="4636f93c5bfc4653804de097aed2882c">tempest-ServerBootFromVolumeStableRescueTest-665602868</nova:project>
Aug 26 10:11:28 user nova-compute[73572]:       </nova:owner>
Aug 26 10:11:28 user nova-compute[73572]:       <nova:root type="image" uuid="299da0c9-e1c4-48f0-be55-fbe20dd06bc9"/>
Aug 26 10:11:28 user nova-compute[73572]:       <nova:ports>
Aug 26 10:11:28 user nova-compute[73572]:         <nova:port uuid="f01cdcf9-2430-4eb5-bb2d-3d126756dfc1">
Aug 26 10:11:28 user nova-compute[73572]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 26 10:11:28 user nova-compute[73572]:         </nova:port>
Aug 26 10:11:28 user nova-compute[73572]:       </nova:ports>
Aug 26 10:11:28 user nova-compute[73572]:     </nova:instance>
Aug 26 10:11:28 user nova-compute[73572]:   </metadata>
Aug 26 10:11:28 user nova-compute[73572]:   <sysinfo type="smbios">
Aug 26 10:11:28 user nova-compute[73572]:     <system>
Aug 26 10:11:28 user nova-compute[73572]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 10:11:28 user nova-compute[73572]:       <entry name="product">OpenStack Nova</entry>
Aug 26 10:11:28 user nova-compute[73572]:       <entry name="version">0.0.0</entry>
Aug 26 10:11:28 user nova-compute[73572]:       <entry name="serial">c785b609-0068-442f-91f5-d26e888a993f</entry>
Aug 26 10:11:28 user nova-compute[73572]:       <entry name="uuid">c785b609-0068-442f-91f5-d26e888a993f</entry>
Aug 26 10:11:28 user nova-compute[73572]:       <entry name="family">Virtual Machine</entry>
Aug 26 10:11:28 user nova-compute[73572]:     </system>
Aug 26 10:11:28 user nova-compute[73572]:   </sysinfo>
Aug 26 10:11:28 user nova-compute[73572]:   <os>
Aug 26 10:11:28 user nova-compute[73572]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 10:11:28 user nova-compute[73572]:     <boot dev="hd"/>
Aug 26 10:11:28 user nova-compute[73572]:     <smbios mode="sysinfo"/>
Aug 26 10:11:28 user nova-compute[73572]:   </os>
Aug 26 10:11:28 user nova-compute[73572]:   <features>
Aug 26 10:11:28 user nova-compute[73572]:     <acpi/>
Aug 26 10:11:28 user nova-compute[73572]:     <apic/>
Aug 26 10:11:28 user nova-compute[73572]:     <vmcoreinfo/>
Aug 26 10:11:28 user nova-compute[73572]:   </features>
Aug 26 10:11:28 user nova-compute[73572]:   <clock offset="utc">
Aug 26 10:11:28 user nova-compute[73572]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 10:11:28 user nova-compute[73572]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 10:11:28 user nova-compute[73572]:     <timer name="hpet" present="no"/>
Aug 26 10:11:28 user nova-compute[73572]:   </clock>
Aug 26 10:11:28 user nova-compute[73572]:   <cpu mode="custom" match="exact">
Aug 26 10:11:28 user nova-compute[73572]:     <model>Nehalem</model>
Aug 26 10:11:28 user nova-compute[73572]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 10:11:28 user nova-compute[73572]:   </cpu>
Aug 26 10:11:28 user nova-compute[73572]:   <devices>
Aug 26 10:11:28 user nova-compute[73572]:     <disk type="file" device="disk">
Aug 26 10:11:28 user nova-compute[73572]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 10:11:28 user nova-compute[73572]:       <source file="/opt/stack/data/nova/instances/c785b609-0068-442f-91f5-d26e888a993f/disk"/>
Aug 26 10:11:28 user nova-compute[73572]:       <target dev="vda" bus="virtio"/>
Aug 26 10:11:28 user nova-compute[73572]:     </disk>
Aug 26 10:11:28 user nova-compute[73572]:     <interface type="ethernet">
Aug 26 10:11:28 user nova-compute[73572]:       <mac address="fa:16:3e:fa:6c:bc"/>
Aug 26 10:11:28 user nova-compute[73572]:       <model type="virtio"/>
Aug 26 10:11:28 user nova-compute[73572]:       <mtu size="1442"/>
Aug 26 10:11:28 user nova-compute[73572]:       <target dev="tapf01cdcf9-24"/>
Aug 26 10:11:28 user nova-compute[73572]:     </interface>
Aug 26 10:11:28 user nova-compute[73572]:     <serial type="pty">
Aug 26 10:11:28 user nova-compute[73572]:       <log file="/opt/stack/data/nova/instances/c785b609-0068-442f-91f5-d26e888a993f/console.log" append="off"/>
Aug 26 10:11:28 user nova-compute[73572]:     </serial>
Aug 26 10:11:28 user nova-compute[73572]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 10:11:28 user nova-compute[73572]:     <video>
Aug 26 10:11:28 user nova-compute[73572]:       <model type="virtio"/>
Aug 26 10:11:28 user nova-compute[73572]:     </video>
Aug 26 10:11:28 user nova-compute[73572]:     <rng model="virtio">
Aug 26 10:11:28 user nova-compute[73572]:       <backend model="random">/dev/urandom</backend>
Aug 26 10:11:28 user nova-compute[73572]:     </rng>
Aug 26 10:11:28 user nova-compute[73572]:     <controller type="usb" index="0" model="none"/>
Aug 26 10:11:28 user nova-compute[73572]:     <memballoon model="virtio">
Aug 26 10:11:28 user nova-compute[73572]:       <stats period="10"/>
Aug 26 10:11:28 user nova-compute[73572]:     </memballoon>
Aug 26 10:11:28 user nova-compute[73572]:   </devices>
Aug 26 10:11:28 user nova-compute[73572]: </domain>
Aug 26 10:11:28 user nova-compute[73572]:  {{(pid=73572) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 10:11:28 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-62a5f658-c44e-4e75-863d-84de11d2aa43 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T10:11:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-146724740',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-146724740',id=2,image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4636f93c5bfc4653804de097aed2882c',ramdisk_id='',reservation_id='r-in137qtn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-665602868',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T10:11:20Z,user_data=None,user_id='07f3538038a14713af3bbe420f1fb03a',uuid=c785b609-0068-442f-91f5-d26e888a993f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f01cdcf9-2430-4eb5-bb2d-3d126756dfc1", "address": "fa:16:3e:fa:6c:bc", "network": {"id": "991b9dff-5173-4456-a530-b1f7eb5cfa4a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1845930297-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4636f93c5bfc4653804de097aed2882c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf01cdcf9-24", "ovs_interfaceid": "f01cdcf9-2430-4eb5-bb2d-3d126756dfc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 10:11:28 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-62a5f658-c44e-4e75-863d-84de11d2aa43 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Converting VIF {"id": "f01cdcf9-2430-4eb5-bb2d-3d126756dfc1", "address": "fa:16:3e:fa:6c:bc", "network": {"id": "991b9dff-5173-4456-a530-b1f7eb5cfa4a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1845930297-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4636f93c5bfc4653804de097aed2882c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf01cdcf9-24", "ovs_interfaceid": "f01cdcf9-2430-4eb5-bb2d-3d126756dfc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:11:28 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-62a5f658-c44e-4e75-863d-84de11d2aa43 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fa:6c:bc,bridge_name='br-int',has_traffic_filtering=True,id=f01cdcf9-2430-4eb5-bb2d-3d126756dfc1,network=Network(991b9dff-5173-4456-a530-b1f7eb5cfa4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf01cdcf9-24') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:11:28 user nova-compute[73572]: DEBUG os_vif [None req-62a5f658-c44e-4e75-863d-84de11d2aa43 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fa:6c:bc,bridge_name='br-int',has_traffic_filtering=True,id=f01cdcf9-2430-4eb5-bb2d-3d126756dfc1,network=Network(991b9dff-5173-4456-a530-b1f7eb5cfa4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf01cdcf9-24') {{(pid=73572) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 10:11:28 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:11:28 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:11:28 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 10:11:28 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:11:28 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf01cdcf9-24, may_exist=True, interface_attrs={}) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:11:28 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf01cdcf9-24, col_values=(('external_ids', {'iface-id': 'f01cdcf9-2430-4eb5-bb2d-3d126756dfc1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fa:6c:bc', 'vm-uuid': 'c785b609-0068-442f-91f5-d26e888a993f'}),), if_exists=True) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:11:28 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:11:28 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:11:28 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:11:28 user nova-compute[73572]: INFO os_vif [None req-62a5f658-c44e-4e75-863d-84de11d2aa43 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fa:6c:bc,bridge_name='br-int',has_traffic_filtering=True,id=f01cdcf9-2430-4eb5-bb2d-3d126756dfc1,network=Network(991b9dff-5173-4456-a530-b1f7eb5cfa4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf01cdcf9-24')
Aug 26 10:11:28 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-62a5f658-c44e-4e75-863d-84de11d2aa43 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] No BDM found with device name vda, not building metadata. {{(pid=73572) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 10:11:28 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-62a5f658-c44e-4e75-863d-84de11d2aa43 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] No VIF found with MAC fa:16:3e:fa:6c:bc, not building metadata {{(pid=73572) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 10:11:29 user nova-compute[73572]: DEBUG nova.virt.driver [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Emitting event <LifecycleEvent: 1693044689.1668286, 61b60a19-597e-4dc1-af0f-a0ec95e9fd24 => Resumed> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:11:29 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 61b60a19-597e-4dc1-af0f-a0ec95e9fd24] VM Resumed (Lifecycle Event)
Aug 26 10:11:29 user nova-compute[73572]: DEBUG nova.compute.manager [None req-53c4bc61-ff31-43d6-ad6e-df67c7776f92 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] [instance: 61b60a19-597e-4dc1-af0f-a0ec95e9fd24] Instance event wait completed in 0 seconds for  {{(pid=73572) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 10:11:29 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-53c4bc61-ff31-43d6-ad6e-df67c7776f92 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] [instance: 61b60a19-597e-4dc1-af0f-a0ec95e9fd24] Guest created on hypervisor {{(pid=73572) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 10:11:29 user nova-compute[73572]: INFO nova.virt.libvirt.driver [-] [instance: 61b60a19-597e-4dc1-af0f-a0ec95e9fd24] Instance spawned successfully.
Aug 26 10:11:29 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-53c4bc61-ff31-43d6-ad6e-df67c7776f92 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] [instance: 61b60a19-597e-4dc1-af0f-a0ec95e9fd24] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 10:11:29 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-53c4bc61-ff31-43d6-ad6e-df67c7776f92 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] [instance: 61b60a19-597e-4dc1-af0f-a0ec95e9fd24] Found default for hw_cdrom_bus of ide {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:11:29 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-53c4bc61-ff31-43d6-ad6e-df67c7776f92 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] [instance: 61b60a19-597e-4dc1-af0f-a0ec95e9fd24] Found default for hw_disk_bus of virtio {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:11:29 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-53c4bc61-ff31-43d6-ad6e-df67c7776f92 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] [instance: 61b60a19-597e-4dc1-af0f-a0ec95e9fd24] Found default for hw_input_bus of None {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:11:29 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-53c4bc61-ff31-43d6-ad6e-df67c7776f92 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] [instance: 61b60a19-597e-4dc1-af0f-a0ec95e9fd24] Found default for hw_pointer_model of None {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:11:29 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-53c4bc61-ff31-43d6-ad6e-df67c7776f92 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] [instance: 61b60a19-597e-4dc1-af0f-a0ec95e9fd24] Found default for hw_video_model of virtio {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:11:29 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-53c4bc61-ff31-43d6-ad6e-df67c7776f92 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] [instance: 61b60a19-597e-4dc1-af0f-a0ec95e9fd24] Found default for hw_vif_model of virtio {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:11:29 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 61b60a19-597e-4dc1-af0f-a0ec95e9fd24] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:11:29 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 61b60a19-597e-4dc1-af0f-a0ec95e9fd24] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73572) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 10:11:29 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 61b60a19-597e-4dc1-af0f-a0ec95e9fd24] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 10:11:29 user nova-compute[73572]: DEBUG nova.virt.driver [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Emitting event <LifecycleEvent: 1693044689.168816, 61b60a19-597e-4dc1-af0f-a0ec95e9fd24 => Started> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:11:29 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 61b60a19-597e-4dc1-af0f-a0ec95e9fd24] VM Started (Lifecycle Event)
Aug 26 10:11:29 user nova-compute[73572]: INFO nova.compute.manager [None req-53c4bc61-ff31-43d6-ad6e-df67c7776f92 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] [instance: 61b60a19-597e-4dc1-af0f-a0ec95e9fd24] Took 10.88 seconds to spawn the instance on the hypervisor.
Aug 26 10:11:29 user nova-compute[73572]: DEBUG nova.compute.manager [None req-53c4bc61-ff31-43d6-ad6e-df67c7776f92 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] [instance: 61b60a19-597e-4dc1-af0f-a0ec95e9fd24] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:11:29 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 61b60a19-597e-4dc1-af0f-a0ec95e9fd24] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:11:29 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 61b60a19-597e-4dc1-af0f-a0ec95e9fd24] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73572) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 10:11:29 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 61b60a19-597e-4dc1-af0f-a0ec95e9fd24] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 10:11:29 user nova-compute[73572]: DEBUG nova.network.neutron [None req-4390620d-fd54-45c3-98fa-55a5a0bae479 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] [instance: 8302d6e7-aaf3-461c-a55e-f2e685d1800d] Updating instance_info_cache with network_info: [{"id": "61c82fb7-2eee-4be0-a37f-669791ea6d9c", "address": "fa:16:3e:6a:1a:9f", "network": {"id": "f4c05fef-baf8-4c06-876f-1bdccd5a8689", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-169805980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27e946bd18464231965d43e20f1d2201", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61c82fb7-2e", "ovs_interfaceid": "61c82fb7-2eee-4be0-a37f-669791ea6d9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:11:29 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-4390620d-fd54-45c3-98fa-55a5a0bae479 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] Releasing lock "refresh_cache-8302d6e7-aaf3-461c-a55e-f2e685d1800d" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:11:29 user nova-compute[73572]: DEBUG nova.compute.manager [None req-4390620d-fd54-45c3-98fa-55a5a0bae479 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] [instance: 8302d6e7-aaf3-461c-a55e-f2e685d1800d] Instance network_info: |[{"id": "61c82fb7-2eee-4be0-a37f-669791ea6d9c", "address": "fa:16:3e:6a:1a:9f", "network": {"id": "f4c05fef-baf8-4c06-876f-1bdccd5a8689", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-169805980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27e946bd18464231965d43e20f1d2201", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61c82fb7-2e", "ovs_interfaceid": "61c82fb7-2eee-4be0-a37f-669791ea6d9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73572) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 10:11:29 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-4390620d-fd54-45c3-98fa-55a5a0bae479 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] [instance: 8302d6e7-aaf3-461c-a55e-f2e685d1800d] Start _get_guest_xml network_info=[{"id": "61c82fb7-2eee-4be0-a37f-669791ea6d9c", "address": "fa:16:3e:6a:1a:9f", "network": {"id": "f4c05fef-baf8-4c06-876f-1bdccd5a8689", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-169805980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27e946bd18464231965d43e20f1d2201", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61c82fb7-2e", "ovs_interfaceid": "61c82fb7-2eee-4be0-a37f-669791ea6d9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T10:07:33Z,direct_url=<?>,disk_format='qcow2',id=299da0c9-e1c4-48f0-be55-fbe20dd06bc9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5c995f8bbbab4368b67a253e0df3971a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T10:07:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'guest_format': None, 'size': 0, 'encryption_format': None, 'device_type': 'disk', 'image_id': '299da0c9-e1c4-48f0-be55-fbe20dd06bc9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73572) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 10:11:29 user nova-compute[73572]: INFO nova.compute.manager [None req-53c4bc61-ff31-43d6-ad6e-df67c7776f92 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] [instance: 61b60a19-597e-4dc1-af0f-a0ec95e9fd24] Took 11.98 seconds to build instance.
Aug 26 10:11:29 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-4390620d-fd54-45c3-98fa-55a5a0bae479 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:11:29 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-4390620d-fd54-45c3-98fa-55a5a0bae479 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:11:29 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-4390620d-fd54-45c3-98fa-55a5a0bae479 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73572) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 10:11:29 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-4390620d-fd54-45c3-98fa-55a5a0bae479 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] CPU controller missing on host. {{(pid=73572) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 10:11:29 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-4390620d-fd54-45c3-98fa-55a5a0bae479 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73572) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 10:11:29 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-4390620d-fd54-45c3-98fa-55a5a0bae479 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] CPU controller found on host. {{(pid=73572) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 10:11:29 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-4390620d-fd54-45c3-98fa-55a5a0bae479 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73572) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 10:11:29 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-4390620d-fd54-45c3-98fa-55a5a0bae479 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T10:07:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T10:07:33Z,direct_url=<?>,disk_format='qcow2',id=299da0c9-e1c4-48f0-be55-fbe20dd06bc9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5c995f8bbbab4368b67a253e0df3971a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T10:07:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 10:11:29 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-4390620d-fd54-45c3-98fa-55a5a0bae479 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] Flavor limits 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 10:11:29 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-4390620d-fd54-45c3-98fa-55a5a0bae479 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] Image limits 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 10:11:29 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-4390620d-fd54-45c3-98fa-55a5a0bae479 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] Flavor pref 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 10:11:29 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-4390620d-fd54-45c3-98fa-55a5a0bae479 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] Image pref 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 10:11:29 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-4390620d-fd54-45c3-98fa-55a5a0bae479 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 10:11:29 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-4390620d-fd54-45c3-98fa-55a5a0bae479 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 10:11:29 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-4390620d-fd54-45c3-98fa-55a5a0bae479 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73572) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 10:11:29 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-4390620d-fd54-45c3-98fa-55a5a0bae479 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] Got 1 possible topologies {{(pid=73572) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 10:11:29 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-4390620d-fd54-45c3-98fa-55a5a0bae479 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 10:11:29 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-4390620d-fd54-45c3-98fa-55a5a0bae479 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 10:11:29 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-4390620d-fd54-45c3-98fa-55a5a0bae479 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T10:11:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-643880944',display_name='tempest-ServersNegativeTestJSON-server-643880944',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-643880944',id=3,image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='27e946bd18464231965d43e20f1d2201',ramdisk_id='',reservation_id='r-7dmiqx3a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1661886679',owner_user_name='tempest-ServersNegativeTestJSON-1661886679-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T10:11:21Z,user_data=None,user_id='8efee83728774e58a60714e5c72cb1f2',uuid=8302d6e7-aaf3-461c-a55e-f2e685d1800d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "61c82fb7-2eee-4be0-a37f-669791ea6d9c", "address": "fa:16:3e:6a:1a:9f", "network": {"id": "f4c05fef-baf8-4c06-876f-1bdccd5a8689", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-169805980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27e946bd18464231965d43e20f1d2201", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61c82fb7-2e", "ovs_interfaceid": "61c82fb7-2eee-4be0-a37f-669791ea6d9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73572) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 10:11:29 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-4390620d-fd54-45c3-98fa-55a5a0bae479 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] Converting VIF {"id": "61c82fb7-2eee-4be0-a37f-669791ea6d9c", "address": "fa:16:3e:6a:1a:9f", "network": {"id": "f4c05fef-baf8-4c06-876f-1bdccd5a8689", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-169805980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27e946bd18464231965d43e20f1d2201", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61c82fb7-2e", "ovs_interfaceid": "61c82fb7-2eee-4be0-a37f-669791ea6d9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:11:29 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-4390620d-fd54-45c3-98fa-55a5a0bae479 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6a:1a:9f,bridge_name='br-int',has_traffic_filtering=True,id=61c82fb7-2eee-4be0-a37f-669791ea6d9c,network=Network(f4c05fef-baf8-4c06-876f-1bdccd5a8689),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61c82fb7-2e') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:11:29 user nova-compute[73572]: DEBUG nova.objects.instance [None req-4390620d-fd54-45c3-98fa-55a5a0bae479 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] Lazy-loading 'pci_devices' on Instance uuid 8302d6e7-aaf3-461c-a55e-f2e685d1800d {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:11:29 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-53c4bc61-ff31-43d6-ad6e-df67c7776f92 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] Lock "61b60a19-597e-4dc1-af0f-a0ec95e9fd24" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.294s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:11:29 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-4390620d-fd54-45c3-98fa-55a5a0bae479 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] [instance: 8302d6e7-aaf3-461c-a55e-f2e685d1800d] End _get_guest_xml xml=<domain type="kvm">
Aug 26 10:11:29 user nova-compute[73572]:   <uuid>8302d6e7-aaf3-461c-a55e-f2e685d1800d</uuid>
Aug 26 10:11:29 user nova-compute[73572]:   <name>instance-00000003</name>
Aug 26 10:11:29 user nova-compute[73572]:   <memory>524288</memory>
Aug 26 10:11:29 user nova-compute[73572]:   <vcpu>1</vcpu>
Aug 26 10:11:29 user nova-compute[73572]:   <metadata>
Aug 26 10:11:29 user nova-compute[73572]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 10:11:29 user nova-compute[73572]:       <nova:package version="0.0.0"/>
Aug 26 10:11:29 user nova-compute[73572]:       <nova:name>tempest-ServersNegativeTestJSON-server-643880944</nova:name>
Aug 26 10:11:29 user nova-compute[73572]:       <nova:creationTime>2023-08-26 10:11:29</nova:creationTime>
Aug 26 10:11:29 user nova-compute[73572]:       <nova:flavor name="m1.tiny">
Aug 26 10:11:29 user nova-compute[73572]:         <nova:memory>512</nova:memory>
Aug 26 10:11:29 user nova-compute[73572]:         <nova:disk>1</nova:disk>
Aug 26 10:11:29 user nova-compute[73572]:         <nova:swap>0</nova:swap>
Aug 26 10:11:29 user nova-compute[73572]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 10:11:29 user nova-compute[73572]:         <nova:vcpus>1</nova:vcpus>
Aug 26 10:11:29 user nova-compute[73572]:       </nova:flavor>
Aug 26 10:11:29 user nova-compute[73572]:       <nova:owner>
Aug 26 10:11:29 user nova-compute[73572]:         <nova:user uuid="8efee83728774e58a60714e5c72cb1f2">tempest-ServersNegativeTestJSON-1661886679-project-member</nova:user>
Aug 26 10:11:29 user nova-compute[73572]:         <nova:project uuid="27e946bd18464231965d43e20f1d2201">tempest-ServersNegativeTestJSON-1661886679</nova:project>
Aug 26 10:11:29 user nova-compute[73572]:       </nova:owner>
Aug 26 10:11:29 user nova-compute[73572]:       <nova:root type="image" uuid="299da0c9-e1c4-48f0-be55-fbe20dd06bc9"/>
Aug 26 10:11:29 user nova-compute[73572]:       <nova:ports>
Aug 26 10:11:29 user nova-compute[73572]:         <nova:port uuid="61c82fb7-2eee-4be0-a37f-669791ea6d9c">
Aug 26 10:11:29 user nova-compute[73572]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 26 10:11:29 user nova-compute[73572]:         </nova:port>
Aug 26 10:11:29 user nova-compute[73572]:       </nova:ports>
Aug 26 10:11:29 user nova-compute[73572]:     </nova:instance>
Aug 26 10:11:29 user nova-compute[73572]:   </metadata>
Aug 26 10:11:29 user nova-compute[73572]:   <sysinfo type="smbios">
Aug 26 10:11:29 user nova-compute[73572]:     <system>
Aug 26 10:11:29 user nova-compute[73572]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 10:11:29 user nova-compute[73572]:       <entry name="product">OpenStack Nova</entry>
Aug 26 10:11:29 user nova-compute[73572]:       <entry name="version">0.0.0</entry>
Aug 26 10:11:29 user nova-compute[73572]:       <entry name="serial">8302d6e7-aaf3-461c-a55e-f2e685d1800d</entry>
Aug 26 10:11:29 user nova-compute[73572]:       <entry name="uuid">8302d6e7-aaf3-461c-a55e-f2e685d1800d</entry>
Aug 26 10:11:29 user nova-compute[73572]:       <entry name="family">Virtual Machine</entry>
Aug 26 10:11:29 user nova-compute[73572]:     </system>
Aug 26 10:11:29 user nova-compute[73572]:   </sysinfo>
Aug 26 10:11:29 user nova-compute[73572]:   <os>
Aug 26 10:11:29 user nova-compute[73572]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 10:11:29 user nova-compute[73572]:     <boot dev="hd"/>
Aug 26 10:11:29 user nova-compute[73572]:     <smbios mode="sysinfo"/>
Aug 26 10:11:29 user nova-compute[73572]:   </os>
Aug 26 10:11:29 user nova-compute[73572]:   <features>
Aug 26 10:11:29 user nova-compute[73572]:     <acpi/>
Aug 26 10:11:29 user nova-compute[73572]:     <apic/>
Aug 26 10:11:29 user nova-compute[73572]:     <vmcoreinfo/>
Aug 26 10:11:29 user nova-compute[73572]:   </features>
Aug 26 10:11:29 user nova-compute[73572]:   <clock offset="utc">
Aug 26 10:11:29 user nova-compute[73572]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 10:11:29 user nova-compute[73572]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 10:11:29 user nova-compute[73572]:     <timer name="hpet" present="no"/>
Aug 26 10:11:29 user nova-compute[73572]:   </clock>
Aug 26 10:11:29 user nova-compute[73572]:   <cpu mode="custom" match="exact">
Aug 26 10:11:29 user nova-compute[73572]:     <model>Nehalem</model>
Aug 26 10:11:29 user nova-compute[73572]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 10:11:29 user nova-compute[73572]:   </cpu>
Aug 26 10:11:29 user nova-compute[73572]:   <devices>
Aug 26 10:11:29 user nova-compute[73572]:     <disk type="file" device="disk">
Aug 26 10:11:29 user nova-compute[73572]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 10:11:29 user nova-compute[73572]:       <source file="/opt/stack/data/nova/instances/8302d6e7-aaf3-461c-a55e-f2e685d1800d/disk"/>
Aug 26 10:11:29 user nova-compute[73572]:       <target dev="vda" bus="virtio"/>
Aug 26 10:11:29 user nova-compute[73572]:     </disk>
Aug 26 10:11:29 user nova-compute[73572]:     <interface type="ethernet">
Aug 26 10:11:29 user nova-compute[73572]:       <mac address="fa:16:3e:6a:1a:9f"/>
Aug 26 10:11:29 user nova-compute[73572]:       <model type="virtio"/>
Aug 26 10:11:29 user nova-compute[73572]:       <mtu size="1442"/>
Aug 26 10:11:29 user nova-compute[73572]:       <target dev="tap61c82fb7-2e"/>
Aug 26 10:11:29 user nova-compute[73572]:     </interface>
Aug 26 10:11:29 user nova-compute[73572]:     <serial type="pty">
Aug 26 10:11:29 user nova-compute[73572]:       <log file="/opt/stack/data/nova/instances/8302d6e7-aaf3-461c-a55e-f2e685d1800d/console.log" append="off"/>
Aug 26 10:11:29 user nova-compute[73572]:     </serial>
Aug 26 10:11:29 user nova-compute[73572]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 10:11:29 user nova-compute[73572]:     <video>
Aug 26 10:11:29 user nova-compute[73572]:       <model type="virtio"/>
Aug 26 10:11:29 user nova-compute[73572]:     </video>
Aug 26 10:11:29 user nova-compute[73572]:     <rng model="virtio">
Aug 26 10:11:29 user nova-compute[73572]:       <backend model="random">/dev/urandom</backend>
Aug 26 10:11:29 user nova-compute[73572]:     </rng>
Aug 26 10:11:29 user nova-compute[73572]:     <controller type="usb" index="0" model="none"/>
Aug 26 10:11:29 user nova-compute[73572]:     <memballoon model="virtio">
Aug 26 10:11:29 user nova-compute[73572]:       <stats period="10"/>
Aug 26 10:11:29 user nova-compute[73572]:     </memballoon>
Aug 26 10:11:29 user nova-compute[73572]:   </devices>
Aug 26 10:11:29 user nova-compute[73572]: </domain>
Aug 26 10:11:29 user nova-compute[73572]:  {{(pid=73572) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 10:11:29 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-4390620d-fd54-45c3-98fa-55a5a0bae479 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T10:11:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-643880944',display_name='tempest-ServersNegativeTestJSON-server-643880944',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-643880944',id=3,image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='27e946bd18464231965d43e20f1d2201',ramdisk_id='',reservation_id='r-7dmiqx3a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1661886679',owner_user_name='tempest-ServersNegativeTestJSON-1661886679-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T10:11:21Z,user_data=None,user_id='8efee83728774e58a60714e5c72cb1f2',uuid=8302d6e7-aaf3-461c-a55e-f2e685d1800d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "61c82fb7-2eee-4be0-a37f-669791ea6d9c", "address": "fa:16:3e:6a:1a:9f", "network": {"id": "f4c05fef-baf8-4c06-876f-1bdccd5a8689", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-169805980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27e946bd18464231965d43e20f1d2201", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61c82fb7-2e", "ovs_interfaceid": "61c82fb7-2eee-4be0-a37f-669791ea6d9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 10:11:29 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-4390620d-fd54-45c3-98fa-55a5a0bae479 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] Converting VIF {"id": "61c82fb7-2eee-4be0-a37f-669791ea6d9c", "address": "fa:16:3e:6a:1a:9f", "network": {"id": "f4c05fef-baf8-4c06-876f-1bdccd5a8689", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-169805980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27e946bd18464231965d43e20f1d2201", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61c82fb7-2e", "ovs_interfaceid": "61c82fb7-2eee-4be0-a37f-669791ea6d9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:11:29 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-4390620d-fd54-45c3-98fa-55a5a0bae479 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6a:1a:9f,bridge_name='br-int',has_traffic_filtering=True,id=61c82fb7-2eee-4be0-a37f-669791ea6d9c,network=Network(f4c05fef-baf8-4c06-876f-1bdccd5a8689),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61c82fb7-2e') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:11:29 user nova-compute[73572]: DEBUG os_vif [None req-4390620d-fd54-45c3-98fa-55a5a0bae479 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:1a:9f,bridge_name='br-int',has_traffic_filtering=True,id=61c82fb7-2eee-4be0-a37f-669791ea6d9c,network=Network(f4c05fef-baf8-4c06-876f-1bdccd5a8689),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61c82fb7-2e') {{(pid=73572) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 10:11:29 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:11:29 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:11:29 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 10:11:29 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:11:29 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap61c82fb7-2e, may_exist=True, interface_attrs={}) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:11:29 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap61c82fb7-2e, col_values=(('external_ids', {'iface-id': '61c82fb7-2eee-4be0-a37f-669791ea6d9c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6a:1a:9f', 'vm-uuid': '8302d6e7-aaf3-461c-a55e-f2e685d1800d'}),), if_exists=True) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:11:29 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:11:29 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:11:29 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:11:29 user nova-compute[73572]: INFO os_vif [None req-4390620d-fd54-45c3-98fa-55a5a0bae479 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:1a:9f,bridge_name='br-int',has_traffic_filtering=True,id=61c82fb7-2eee-4be0-a37f-669791ea6d9c,network=Network(f4c05fef-baf8-4c06-876f-1bdccd5a8689),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61c82fb7-2e')
Aug 26 10:11:29 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-4390620d-fd54-45c3-98fa-55a5a0bae479 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] No BDM found with device name vda, not building metadata. {{(pid=73572) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 10:11:29 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-4390620d-fd54-45c3-98fa-55a5a0bae479 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] No VIF found with MAC fa:16:3e:6a:1a:9f, not building metadata {{(pid=73572) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 10:11:30 user nova-compute[73572]: DEBUG nova.compute.manager [req-773d468d-0ab4-45b4-8ca3-8e016a9cf3f5 req-1ec0c573-778a-4f7b-92bd-ffb51251c994 service nova] [instance: 8302d6e7-aaf3-461c-a55e-f2e685d1800d] Received event network-changed-61c82fb7-2eee-4be0-a37f-669791ea6d9c {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:11:30 user nova-compute[73572]: DEBUG nova.compute.manager [req-773d468d-0ab4-45b4-8ca3-8e016a9cf3f5 req-1ec0c573-778a-4f7b-92bd-ffb51251c994 service nova] [instance: 8302d6e7-aaf3-461c-a55e-f2e685d1800d] Refreshing instance network info cache due to event network-changed-61c82fb7-2eee-4be0-a37f-669791ea6d9c. {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 10:11:30 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-773d468d-0ab4-45b4-8ca3-8e016a9cf3f5 req-1ec0c573-778a-4f7b-92bd-ffb51251c994 service nova] Acquiring lock "refresh_cache-8302d6e7-aaf3-461c-a55e-f2e685d1800d" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:11:30 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-773d468d-0ab4-45b4-8ca3-8e016a9cf3f5 req-1ec0c573-778a-4f7b-92bd-ffb51251c994 service nova] Acquired lock "refresh_cache-8302d6e7-aaf3-461c-a55e-f2e685d1800d" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:11:30 user nova-compute[73572]: DEBUG nova.network.neutron [req-773d468d-0ab4-45b4-8ca3-8e016a9cf3f5 req-1ec0c573-778a-4f7b-92bd-ffb51251c994 service nova] [instance: 8302d6e7-aaf3-461c-a55e-f2e685d1800d] Refreshing network info cache for port 61c82fb7-2eee-4be0-a37f-669791ea6d9c {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 10:11:30 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:11:30 user nova-compute[73572]: DEBUG nova.network.neutron [req-98d451b1-ec4c-4601-9dcb-917820834a0b req-3a56d70b-ae44-4186-a126-2bdfb80a74a1 service nova] [instance: c785b609-0068-442f-91f5-d26e888a993f] Updated VIF entry in instance network info cache for port f01cdcf9-2430-4eb5-bb2d-3d126756dfc1. {{(pid=73572) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 10:11:30 user nova-compute[73572]: DEBUG nova.network.neutron [req-98d451b1-ec4c-4601-9dcb-917820834a0b req-3a56d70b-ae44-4186-a126-2bdfb80a74a1 service nova] [instance: c785b609-0068-442f-91f5-d26e888a993f] Updating instance_info_cache with network_info: [{"id": "f01cdcf9-2430-4eb5-bb2d-3d126756dfc1", "address": "fa:16:3e:fa:6c:bc", "network": {"id": "991b9dff-5173-4456-a530-b1f7eb5cfa4a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1845930297-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4636f93c5bfc4653804de097aed2882c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf01cdcf9-24", "ovs_interfaceid": "f01cdcf9-2430-4eb5-bb2d-3d126756dfc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:11:30 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-98d451b1-ec4c-4601-9dcb-917820834a0b req-3a56d70b-ae44-4186-a126-2bdfb80a74a1 service nova] Releasing lock "refresh_cache-c785b609-0068-442f-91f5-d26e888a993f" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:11:30 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:11:30 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:11:30 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:11:30 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:11:31 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:11:31 user nova-compute[73572]: DEBUG nova.network.neutron [req-773d468d-0ab4-45b4-8ca3-8e016a9cf3f5 req-1ec0c573-778a-4f7b-92bd-ffb51251c994 service nova] [instance: 8302d6e7-aaf3-461c-a55e-f2e685d1800d] Updated VIF entry in instance network info cache for port 61c82fb7-2eee-4be0-a37f-669791ea6d9c. {{(pid=73572) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 10:11:31 user nova-compute[73572]: DEBUG nova.network.neutron [req-773d468d-0ab4-45b4-8ca3-8e016a9cf3f5 req-1ec0c573-778a-4f7b-92bd-ffb51251c994 service nova] [instance: 8302d6e7-aaf3-461c-a55e-f2e685d1800d] Updating instance_info_cache with network_info: [{"id": "61c82fb7-2eee-4be0-a37f-669791ea6d9c", "address": "fa:16:3e:6a:1a:9f", "network": {"id": "f4c05fef-baf8-4c06-876f-1bdccd5a8689", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-169805980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27e946bd18464231965d43e20f1d2201", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61c82fb7-2e", "ovs_interfaceid": "61c82fb7-2eee-4be0-a37f-669791ea6d9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:11:31 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-773d468d-0ab4-45b4-8ca3-8e016a9cf3f5 req-1ec0c573-778a-4f7b-92bd-ffb51251c994 service nova] Releasing lock "refresh_cache-8302d6e7-aaf3-461c-a55e-f2e685d1800d" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:11:32 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:11:32 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:11:32 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:11:32 user nova-compute[73572]: DEBUG nova.network.neutron [None req-188a1c5b-a0ef-4f1c-91ef-7e2d1ce280a1 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] [instance: c555f971-b177-4c26-a38e-09e0e78bf7b9] Successfully updated port: 4ffb7229-16fb-441b-a954-d91308071fb8 {{(pid=73572) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 10:11:32 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-188a1c5b-a0ef-4f1c-91ef-7e2d1ce280a1 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] Acquiring lock "refresh_cache-c555f971-b177-4c26-a38e-09e0e78bf7b9" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:11:32 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-188a1c5b-a0ef-4f1c-91ef-7e2d1ce280a1 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] Acquired lock "refresh_cache-c555f971-b177-4c26-a38e-09e0e78bf7b9" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:11:32 user nova-compute[73572]: DEBUG nova.network.neutron [None req-188a1c5b-a0ef-4f1c-91ef-7e2d1ce280a1 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] [instance: c555f971-b177-4c26-a38e-09e0e78bf7b9] Building network info cache for instance {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 10:11:33 user nova-compute[73572]: DEBUG nova.compute.manager [req-fece5bb4-a433-44e2-95b1-35bfaebe6891 req-2b71de78-9e66-4221-b46a-61a161d3ba76 service nova] [instance: c555f971-b177-4c26-a38e-09e0e78bf7b9] Received event network-changed-4ffb7229-16fb-441b-a954-d91308071fb8 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:11:33 user nova-compute[73572]: DEBUG nova.compute.manager [req-fece5bb4-a433-44e2-95b1-35bfaebe6891 req-2b71de78-9e66-4221-b46a-61a161d3ba76 service nova] [instance: c555f971-b177-4c26-a38e-09e0e78bf7b9] Refreshing instance network info cache due to event network-changed-4ffb7229-16fb-441b-a954-d91308071fb8. {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 10:11:33 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-fece5bb4-a433-44e2-95b1-35bfaebe6891 req-2b71de78-9e66-4221-b46a-61a161d3ba76 service nova] Acquiring lock "refresh_cache-c555f971-b177-4c26-a38e-09e0e78bf7b9" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:11:33 user nova-compute[73572]: DEBUG nova.network.neutron [None req-188a1c5b-a0ef-4f1c-91ef-7e2d1ce280a1 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] [instance: c555f971-b177-4c26-a38e-09e0e78bf7b9] Instance cache missing network info. {{(pid=73572) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 10:11:33 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:11:34 user nova-compute[73572]: DEBUG nova.network.neutron [None req-188a1c5b-a0ef-4f1c-91ef-7e2d1ce280a1 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] [instance: c555f971-b177-4c26-a38e-09e0e78bf7b9] Updating instance_info_cache with network_info: [{"id": "4ffb7229-16fb-441b-a954-d91308071fb8", "address": "fa:16:3e:26:32:ef", "network": {"id": "e052e34f-ce84-4612-b48b-2ed8474e7177", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-332746918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4556d14c0dd416fbe13ab2274947dec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ffb7229-16", "ovs_interfaceid": "4ffb7229-16fb-441b-a954-d91308071fb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:11:34 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-188a1c5b-a0ef-4f1c-91ef-7e2d1ce280a1 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] Releasing lock "refresh_cache-c555f971-b177-4c26-a38e-09e0e78bf7b9" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:11:34 user nova-compute[73572]: DEBUG nova.compute.manager [None req-188a1c5b-a0ef-4f1c-91ef-7e2d1ce280a1 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] [instance: c555f971-b177-4c26-a38e-09e0e78bf7b9] Instance network_info: |[{"id": "4ffb7229-16fb-441b-a954-d91308071fb8", "address": "fa:16:3e:26:32:ef", "network": {"id": "e052e34f-ce84-4612-b48b-2ed8474e7177", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-332746918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4556d14c0dd416fbe13ab2274947dec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ffb7229-16", "ovs_interfaceid": "4ffb7229-16fb-441b-a954-d91308071fb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73572) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 10:11:34 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-fece5bb4-a433-44e2-95b1-35bfaebe6891 req-2b71de78-9e66-4221-b46a-61a161d3ba76 service nova] Acquired lock "refresh_cache-c555f971-b177-4c26-a38e-09e0e78bf7b9" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:11:34 user nova-compute[73572]: DEBUG nova.network.neutron [req-fece5bb4-a433-44e2-95b1-35bfaebe6891 req-2b71de78-9e66-4221-b46a-61a161d3ba76 service nova] [instance: c555f971-b177-4c26-a38e-09e0e78bf7b9] Refreshing network info cache for port 4ffb7229-16fb-441b-a954-d91308071fb8 {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 10:11:34 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-188a1c5b-a0ef-4f1c-91ef-7e2d1ce280a1 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] [instance: c555f971-b177-4c26-a38e-09e0e78bf7b9] Start _get_guest_xml network_info=[{"id": "4ffb7229-16fb-441b-a954-d91308071fb8", "address": "fa:16:3e:26:32:ef", "network": {"id": "e052e34f-ce84-4612-b48b-2ed8474e7177", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-332746918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4556d14c0dd416fbe13ab2274947dec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ffb7229-16", "ovs_interfaceid": "4ffb7229-16fb-441b-a954-d91308071fb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T10:07:33Z,direct_url=<?>,disk_format='qcow2',id=299da0c9-e1c4-48f0-be55-fbe20dd06bc9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5c995f8bbbab4368b67a253e0df3971a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T10:07:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'guest_format': None, 'size': 0, 'encryption_format': None, 'device_type': 'disk', 'image_id': '299da0c9-e1c4-48f0-be55-fbe20dd06bc9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73572) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 10:11:34 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-188a1c5b-a0ef-4f1c-91ef-7e2d1ce280a1 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:11:34 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-188a1c5b-a0ef-4f1c-91ef-7e2d1ce280a1 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:11:34 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:11:34 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-188a1c5b-a0ef-4f1c-91ef-7e2d1ce280a1 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73572) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 10:11:34 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-188a1c5b-a0ef-4f1c-91ef-7e2d1ce280a1 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] CPU controller missing on host. {{(pid=73572) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 10:11:34 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-188a1c5b-a0ef-4f1c-91ef-7e2d1ce280a1 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73572) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 10:11:34 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-188a1c5b-a0ef-4f1c-91ef-7e2d1ce280a1 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] CPU controller found on host. {{(pid=73572) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 10:11:34 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-188a1c5b-a0ef-4f1c-91ef-7e2d1ce280a1 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73572) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 10:11:34 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-188a1c5b-a0ef-4f1c-91ef-7e2d1ce280a1 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T10:07:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T10:07:33Z,direct_url=<?>,disk_format='qcow2',id=299da0c9-e1c4-48f0-be55-fbe20dd06bc9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5c995f8bbbab4368b67a253e0df3971a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T10:07:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 10:11:34 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-188a1c5b-a0ef-4f1c-91ef-7e2d1ce280a1 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] Flavor limits 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 10:11:34 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-188a1c5b-a0ef-4f1c-91ef-7e2d1ce280a1 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] Image limits 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 10:11:34 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-188a1c5b-a0ef-4f1c-91ef-7e2d1ce280a1 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] Flavor pref 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 10:11:34 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-188a1c5b-a0ef-4f1c-91ef-7e2d1ce280a1 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] Image pref 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 10:11:34 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-188a1c5b-a0ef-4f1c-91ef-7e2d1ce280a1 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 10:11:34 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-188a1c5b-a0ef-4f1c-91ef-7e2d1ce280a1 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 10:11:34 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-188a1c5b-a0ef-4f1c-91ef-7e2d1ce280a1 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73572) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 10:11:34 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-188a1c5b-a0ef-4f1c-91ef-7e2d1ce280a1 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] Got 1 possible topologies {{(pid=73572) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 10:11:34 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-188a1c5b-a0ef-4f1c-91ef-7e2d1ce280a1 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 10:11:34 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-188a1c5b-a0ef-4f1c-91ef-7e2d1ce280a1 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 10:11:34 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-188a1c5b-a0ef-4f1c-91ef-7e2d1ce280a1 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T10:11:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1454082664',display_name='tempest-ServerStableDeviceRescueTest-server-1454082664',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1454082664',id=4,image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK8A2oE4l13QSyERYwh4Ahnk9uJU+nAPDuhZ37O71VJwdAai0fKJUmgw/2IvPbix5amEMjoghtaXSFXa7D9qX8lOxviBOZZHzhpX2yXB6onP6197FUVAXT21Pc+RZuhqOw==',key_name='tempest-keypair-1487694876',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c4556d14c0dd416fbe13ab2274947dec',ramdisk_id='',reservation_id='r-cj50rz21',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1992646584',owner_user_name='tempest-ServerStableDeviceRescueTest-1992646584-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T10:11:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a56cbd5c1fe94cf9b2a0adc3e82f600b',uuid=c555f971-b177-4c26-a38e-09e0e78bf7b9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4ffb7229-16fb-441b-a954-d91308071fb8", "address": "fa:16:3e:26:32:ef", "network": {"id": "e052e34f-ce84-4612-b48b-2ed8474e7177", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-332746918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4556d14c0dd416fbe13ab2274947dec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ffb7229-16", "ovs_interfaceid": "4ffb7229-16fb-441b-a954-d91308071fb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73572) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 10:11:34 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-188a1c5b-a0ef-4f1c-91ef-7e2d1ce280a1 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] Converting VIF {"id": "4ffb7229-16fb-441b-a954-d91308071fb8", "address": "fa:16:3e:26:32:ef", "network": {"id": "e052e34f-ce84-4612-b48b-2ed8474e7177", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-332746918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4556d14c0dd416fbe13ab2274947dec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ffb7229-16", "ovs_interfaceid": "4ffb7229-16fb-441b-a954-d91308071fb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:11:34 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-188a1c5b-a0ef-4f1c-91ef-7e2d1ce280a1 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:32:ef,bridge_name='br-int',has_traffic_filtering=True,id=4ffb7229-16fb-441b-a954-d91308071fb8,network=Network(e052e34f-ce84-4612-b48b-2ed8474e7177),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ffb7229-16') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:11:34 user nova-compute[73572]: DEBUG nova.objects.instance [None req-188a1c5b-a0ef-4f1c-91ef-7e2d1ce280a1 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] Lazy-loading 'pci_devices' on Instance uuid c555f971-b177-4c26-a38e-09e0e78bf7b9 {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:11:34 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-188a1c5b-a0ef-4f1c-91ef-7e2d1ce280a1 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] [instance: c555f971-b177-4c26-a38e-09e0e78bf7b9] End _get_guest_xml xml=<domain type="kvm">
Aug 26 10:11:34 user nova-compute[73572]:   <uuid>c555f971-b177-4c26-a38e-09e0e78bf7b9</uuid>
Aug 26 10:11:34 user nova-compute[73572]:   <name>instance-00000004</name>
Aug 26 10:11:34 user nova-compute[73572]:   <memory>524288</memory>
Aug 26 10:11:34 user nova-compute[73572]:   <vcpu>1</vcpu>
Aug 26 10:11:34 user nova-compute[73572]:   <metadata>
Aug 26 10:11:34 user nova-compute[73572]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 10:11:34 user nova-compute[73572]:       <nova:package version="0.0.0"/>
Aug 26 10:11:34 user nova-compute[73572]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1454082664</nova:name>
Aug 26 10:11:34 user nova-compute[73572]:       <nova:creationTime>2023-08-26 10:11:34</nova:creationTime>
Aug 26 10:11:34 user nova-compute[73572]:       <nova:flavor name="m1.tiny">
Aug 26 10:11:34 user nova-compute[73572]:         <nova:memory>512</nova:memory>
Aug 26 10:11:34 user nova-compute[73572]:         <nova:disk>1</nova:disk>
Aug 26 10:11:34 user nova-compute[73572]:         <nova:swap>0</nova:swap>
Aug 26 10:11:34 user nova-compute[73572]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 10:11:34 user nova-compute[73572]:         <nova:vcpus>1</nova:vcpus>
Aug 26 10:11:34 user nova-compute[73572]:       </nova:flavor>
Aug 26 10:11:34 user nova-compute[73572]:       <nova:owner>
Aug 26 10:11:34 user nova-compute[73572]:         <nova:user uuid="a56cbd5c1fe94cf9b2a0adc3e82f600b">tempest-ServerStableDeviceRescueTest-1992646584-project-member</nova:user>
Aug 26 10:11:34 user nova-compute[73572]:         <nova:project uuid="c4556d14c0dd416fbe13ab2274947dec">tempest-ServerStableDeviceRescueTest-1992646584</nova:project>
Aug 26 10:11:34 user nova-compute[73572]:       </nova:owner>
Aug 26 10:11:34 user nova-compute[73572]:       <nova:root type="image" uuid="299da0c9-e1c4-48f0-be55-fbe20dd06bc9"/>
Aug 26 10:11:34 user nova-compute[73572]:       <nova:ports>
Aug 26 10:11:34 user nova-compute[73572]:         <nova:port uuid="4ffb7229-16fb-441b-a954-d91308071fb8">
Aug 26 10:11:34 user nova-compute[73572]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 26 10:11:34 user nova-compute[73572]:         </nova:port>
Aug 26 10:11:34 user nova-compute[73572]:       </nova:ports>
Aug 26 10:11:34 user nova-compute[73572]:     </nova:instance>
Aug 26 10:11:34 user nova-compute[73572]:   </metadata>
Aug 26 10:11:34 user nova-compute[73572]:   <sysinfo type="smbios">
Aug 26 10:11:34 user nova-compute[73572]:     <system>
Aug 26 10:11:34 user nova-compute[73572]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 10:11:34 user nova-compute[73572]:       <entry name="product">OpenStack Nova</entry>
Aug 26 10:11:34 user nova-compute[73572]:       <entry name="version">0.0.0</entry>
Aug 26 10:11:34 user nova-compute[73572]:       <entry name="serial">c555f971-b177-4c26-a38e-09e0e78bf7b9</entry>
Aug 26 10:11:34 user nova-compute[73572]:       <entry name="uuid">c555f971-b177-4c26-a38e-09e0e78bf7b9</entry>
Aug 26 10:11:34 user nova-compute[73572]:       <entry name="family">Virtual Machine</entry>
Aug 26 10:11:34 user nova-compute[73572]:     </system>
Aug 26 10:11:34 user nova-compute[73572]:   </sysinfo>
Aug 26 10:11:34 user nova-compute[73572]:   <os>
Aug 26 10:11:34 user nova-compute[73572]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 10:11:34 user nova-compute[73572]:     <boot dev="hd"/>
Aug 26 10:11:34 user nova-compute[73572]:     <smbios mode="sysinfo"/>
Aug 26 10:11:34 user nova-compute[73572]:   </os>
Aug 26 10:11:34 user nova-compute[73572]:   <features>
Aug 26 10:11:34 user nova-compute[73572]:     <acpi/>
Aug 26 10:11:34 user nova-compute[73572]:     <apic/>
Aug 26 10:11:34 user nova-compute[73572]:     <vmcoreinfo/>
Aug 26 10:11:34 user nova-compute[73572]:   </features>
Aug 26 10:11:34 user nova-compute[73572]:   <clock offset="utc">
Aug 26 10:11:34 user nova-compute[73572]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 10:11:34 user nova-compute[73572]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 10:11:34 user nova-compute[73572]:     <timer name="hpet" present="no"/>
Aug 26 10:11:34 user nova-compute[73572]:   </clock>
Aug 26 10:11:34 user nova-compute[73572]:   <cpu mode="custom" match="exact">
Aug 26 10:11:34 user nova-compute[73572]:     <model>Nehalem</model>
Aug 26 10:11:34 user nova-compute[73572]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 10:11:34 user nova-compute[73572]:   </cpu>
Aug 26 10:11:34 user nova-compute[73572]:   <devices>
Aug 26 10:11:34 user nova-compute[73572]:     <disk type="file" device="disk">
Aug 26 10:11:34 user nova-compute[73572]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 10:11:34 user nova-compute[73572]:       <source file="/opt/stack/data/nova/instances/c555f971-b177-4c26-a38e-09e0e78bf7b9/disk"/>
Aug 26 10:11:34 user nova-compute[73572]:       <target dev="vda" bus="virtio"/>
Aug 26 10:11:34 user nova-compute[73572]:     </disk>
Aug 26 10:11:34 user nova-compute[73572]:     <interface type="ethernet">
Aug 26 10:11:34 user nova-compute[73572]:       <mac address="fa:16:3e:26:32:ef"/>
Aug 26 10:11:34 user nova-compute[73572]:       <model type="virtio"/>
Aug 26 10:11:34 user nova-compute[73572]:       <mtu size="1442"/>
Aug 26 10:11:34 user nova-compute[73572]:       <target dev="tap4ffb7229-16"/>
Aug 26 10:11:34 user nova-compute[73572]:     </interface>
Aug 26 10:11:34 user nova-compute[73572]:     <serial type="pty">
Aug 26 10:11:34 user nova-compute[73572]:       <log file="/opt/stack/data/nova/instances/c555f971-b177-4c26-a38e-09e0e78bf7b9/console.log" append="off"/>
Aug 26 10:11:34 user nova-compute[73572]:     </serial>
Aug 26 10:11:34 user nova-compute[73572]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 10:11:34 user nova-compute[73572]:     <video>
Aug 26 10:11:34 user nova-compute[73572]:       <model type="virtio"/>
Aug 26 10:11:34 user nova-compute[73572]:     </video>
Aug 26 10:11:34 user nova-compute[73572]:     <rng model="virtio">
Aug 26 10:11:34 user nova-compute[73572]:       <backend model="random">/dev/urandom</backend>
Aug 26 10:11:34 user nova-compute[73572]:     </rng>
Aug 26 10:11:34 user nova-compute[73572]:     <controller type="usb" index="0" model="none"/>
Aug 26 10:11:34 user nova-compute[73572]:     <memballoon model="virtio">
Aug 26 10:11:34 user nova-compute[73572]:       <stats period="10"/>
Aug 26 10:11:34 user nova-compute[73572]:     </memballoon>
Aug 26 10:11:34 user nova-compute[73572]:   </devices>
Aug 26 10:11:34 user nova-compute[73572]: </domain>
Aug 26 10:11:34 user nova-compute[73572]:  {{(pid=73572) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 10:11:34 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-188a1c5b-a0ef-4f1c-91ef-7e2d1ce280a1 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T10:11:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1454082664',display_name='tempest-ServerStableDeviceRescueTest-server-1454082664',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1454082664',id=4,image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK8A2oE4l13QSyERYwh4Ahnk9uJU+nAPDuhZ37O71VJwdAai0fKJUmgw/2IvPbix5amEMjoghtaXSFXa7D9qX8lOxviBOZZHzhpX2yXB6onP6197FUVAXT21Pc+RZuhqOw==',key_name='tempest-keypair-1487694876',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c4556d14c0dd416fbe13ab2274947dec',ramdisk_id='',reservation_id='r-cj50rz21',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1992646584',owner_user_name='tempest-ServerStableDeviceRescueTest-1992646584-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T10:11:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a56cbd5c1fe94cf9b2a0adc3e82f600b',uuid=c555f971-b177-4c26-a38e-09e0e78bf7b9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4ffb7229-16fb-441b-a954-d91308071fb8", "address": "fa:16:3e:26:32:ef", "network": {"id": "e052e34f-ce84-4612-b48b-2ed8474e7177", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-332746918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4556d14c0dd416fbe13ab2274947dec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ffb7229-16", "ovs_interfaceid": "4ffb7229-16fb-441b-a954-d91308071fb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 10:11:34 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-188a1c5b-a0ef-4f1c-91ef-7e2d1ce280a1 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] Converting VIF {"id": "4ffb7229-16fb-441b-a954-d91308071fb8", "address": "fa:16:3e:26:32:ef", "network": {"id": "e052e34f-ce84-4612-b48b-2ed8474e7177", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-332746918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4556d14c0dd416fbe13ab2274947dec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ffb7229-16", "ovs_interfaceid": "4ffb7229-16fb-441b-a954-d91308071fb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:11:34 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-188a1c5b-a0ef-4f1c-91ef-7e2d1ce280a1 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:32:ef,bridge_name='br-int',has_traffic_filtering=True,id=4ffb7229-16fb-441b-a954-d91308071fb8,network=Network(e052e34f-ce84-4612-b48b-2ed8474e7177),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ffb7229-16') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:11:34 user nova-compute[73572]: DEBUG os_vif [None req-188a1c5b-a0ef-4f1c-91ef-7e2d1ce280a1 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:32:ef,bridge_name='br-int',has_traffic_filtering=True,id=4ffb7229-16fb-441b-a954-d91308071fb8,network=Network(e052e34f-ce84-4612-b48b-2ed8474e7177),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ffb7229-16') {{(pid=73572) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 10:11:34 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:11:34 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:11:34 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 10:11:34 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:11:34 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4ffb7229-16, may_exist=True, interface_attrs={}) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:11:34 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4ffb7229-16, col_values=(('external_ids', {'iface-id': '4ffb7229-16fb-441b-a954-d91308071fb8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:26:32:ef', 'vm-uuid': 'c555f971-b177-4c26-a38e-09e0e78bf7b9'}),), if_exists=True) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:11:34 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:11:34 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:11:34 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:11:34 user nova-compute[73572]: INFO os_vif [None req-188a1c5b-a0ef-4f1c-91ef-7e2d1ce280a1 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:32:ef,bridge_name='br-int',has_traffic_filtering=True,id=4ffb7229-16fb-441b-a954-d91308071fb8,network=Network(e052e34f-ce84-4612-b48b-2ed8474e7177),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ffb7229-16')
Aug 26 10:11:34 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-188a1c5b-a0ef-4f1c-91ef-7e2d1ce280a1 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] No BDM found with device name vda, not building metadata. {{(pid=73572) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 10:11:34 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-188a1c5b-a0ef-4f1c-91ef-7e2d1ce280a1 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] No VIF found with MAC fa:16:3e:26:32:ef, not building metadata {{(pid=73572) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 10:11:34 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:11:34 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:11:34 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:11:35 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:11:35 user nova-compute[73572]: DEBUG nova.virt.driver [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Emitting event <LifecycleEvent: 1693044695.158572, 8302d6e7-aaf3-461c-a55e-f2e685d1800d => Resumed> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:11:35 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 8302d6e7-aaf3-461c-a55e-f2e685d1800d] VM Resumed (Lifecycle Event)
Aug 26 10:11:35 user nova-compute[73572]: DEBUG nova.compute.manager [None req-4390620d-fd54-45c3-98fa-55a5a0bae479 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] [instance: 8302d6e7-aaf3-461c-a55e-f2e685d1800d] Instance event wait completed in 0 seconds for  {{(pid=73572) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 10:11:35 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-4390620d-fd54-45c3-98fa-55a5a0bae479 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] [instance: 8302d6e7-aaf3-461c-a55e-f2e685d1800d] Guest created on hypervisor {{(pid=73572) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 10:11:35 user nova-compute[73572]: INFO nova.virt.libvirt.driver [-] [instance: 8302d6e7-aaf3-461c-a55e-f2e685d1800d] Instance spawned successfully.
Aug 26 10:11:35 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-4390620d-fd54-45c3-98fa-55a5a0bae479 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] [instance: 8302d6e7-aaf3-461c-a55e-f2e685d1800d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 10:11:35 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 8302d6e7-aaf3-461c-a55e-f2e685d1800d] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:11:35 user nova-compute[73572]: DEBUG nova.compute.manager [None req-62a5f658-c44e-4e75-863d-84de11d2aa43 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: c785b609-0068-442f-91f5-d26e888a993f] Instance event wait completed in 0 seconds for  {{(pid=73572) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 10:11:35 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-62a5f658-c44e-4e75-863d-84de11d2aa43 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: c785b609-0068-442f-91f5-d26e888a993f] Guest created on hypervisor {{(pid=73572) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 10:11:35 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 8302d6e7-aaf3-461c-a55e-f2e685d1800d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73572) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 10:11:35 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-4390620d-fd54-45c3-98fa-55a5a0bae479 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] [instance: 8302d6e7-aaf3-461c-a55e-f2e685d1800d] Found default for hw_cdrom_bus of ide {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:11:35 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-4390620d-fd54-45c3-98fa-55a5a0bae479 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] [instance: 8302d6e7-aaf3-461c-a55e-f2e685d1800d] Found default for hw_disk_bus of virtio {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:11:35 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-4390620d-fd54-45c3-98fa-55a5a0bae479 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] [instance: 8302d6e7-aaf3-461c-a55e-f2e685d1800d] Found default for hw_input_bus of None {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:11:35 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-4390620d-fd54-45c3-98fa-55a5a0bae479 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] [instance: 8302d6e7-aaf3-461c-a55e-f2e685d1800d] Found default for hw_pointer_model of None {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:11:35 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-4390620d-fd54-45c3-98fa-55a5a0bae479 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] [instance: 8302d6e7-aaf3-461c-a55e-f2e685d1800d] Found default for hw_video_model of virtio {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:11:35 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-4390620d-fd54-45c3-98fa-55a5a0bae479 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] [instance: 8302d6e7-aaf3-461c-a55e-f2e685d1800d] Found default for hw_vif_model of virtio {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:11:35 user nova-compute[73572]: INFO nova.virt.libvirt.driver [-] [instance: c785b609-0068-442f-91f5-d26e888a993f] Instance spawned successfully.
Aug 26 10:11:35 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-62a5f658-c44e-4e75-863d-84de11d2aa43 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: c785b609-0068-442f-91f5-d26e888a993f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 10:11:35 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 8302d6e7-aaf3-461c-a55e-f2e685d1800d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 10:11:35 user nova-compute[73572]: DEBUG nova.virt.driver [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Emitting event <LifecycleEvent: 1693044695.1631825, 8302d6e7-aaf3-461c-a55e-f2e685d1800d => Started> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:11:35 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 8302d6e7-aaf3-461c-a55e-f2e685d1800d] VM Started (Lifecycle Event)
Aug 26 10:11:35 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-62a5f658-c44e-4e75-863d-84de11d2aa43 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: c785b609-0068-442f-91f5-d26e888a993f] Found default for hw_cdrom_bus of ide {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:11:35 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-62a5f658-c44e-4e75-863d-84de11d2aa43 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: c785b609-0068-442f-91f5-d26e888a993f] Found default for hw_disk_bus of virtio {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:11:35 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-62a5f658-c44e-4e75-863d-84de11d2aa43 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: c785b609-0068-442f-91f5-d26e888a993f] Found default for hw_input_bus of None {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:11:35 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-62a5f658-c44e-4e75-863d-84de11d2aa43 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: c785b609-0068-442f-91f5-d26e888a993f] Found default for hw_pointer_model of None {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:11:35 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-62a5f658-c44e-4e75-863d-84de11d2aa43 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: c785b609-0068-442f-91f5-d26e888a993f] Found default for hw_video_model of virtio {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:11:35 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-62a5f658-c44e-4e75-863d-84de11d2aa43 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: c785b609-0068-442f-91f5-d26e888a993f] Found default for hw_vif_model of virtio {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:11:35 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 8302d6e7-aaf3-461c-a55e-f2e685d1800d] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:11:35 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 8302d6e7-aaf3-461c-a55e-f2e685d1800d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73572) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 10:11:35 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 8302d6e7-aaf3-461c-a55e-f2e685d1800d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 10:11:35 user nova-compute[73572]: DEBUG nova.virt.driver [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Emitting event <LifecycleEvent: 1693044695.196151, c785b609-0068-442f-91f5-d26e888a993f => Resumed> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:11:35 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: c785b609-0068-442f-91f5-d26e888a993f] VM Resumed (Lifecycle Event)
Aug 26 10:11:35 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: c785b609-0068-442f-91f5-d26e888a993f] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:11:35 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: c785b609-0068-442f-91f5-d26e888a993f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73572) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 10:11:35 user nova-compute[73572]: INFO nova.compute.manager [None req-4390620d-fd54-45c3-98fa-55a5a0bae479 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] [instance: 8302d6e7-aaf3-461c-a55e-f2e685d1800d] Took 14.92 seconds to spawn the instance on the hypervisor.
Aug 26 10:11:35 user nova-compute[73572]: DEBUG nova.compute.manager [None req-4390620d-fd54-45c3-98fa-55a5a0bae479 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] [instance: 8302d6e7-aaf3-461c-a55e-f2e685d1800d] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:11:35 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: c785b609-0068-442f-91f5-d26e888a993f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 10:11:35 user nova-compute[73572]: DEBUG nova.virt.driver [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Emitting event <LifecycleEvent: 1693044695.2151198, c785b609-0068-442f-91f5-d26e888a993f => Started> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:11:35 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: c785b609-0068-442f-91f5-d26e888a993f] VM Started (Lifecycle Event)
Aug 26 10:11:35 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: c785b609-0068-442f-91f5-d26e888a993f] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:11:35 user nova-compute[73572]: INFO nova.compute.manager [None req-62a5f658-c44e-4e75-863d-84de11d2aa43 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: c785b609-0068-442f-91f5-d26e888a993f] Took 15.98 seconds to spawn the instance on the hypervisor.
Aug 26 10:11:35 user nova-compute[73572]: DEBUG nova.compute.manager [None req-62a5f658-c44e-4e75-863d-84de11d2aa43 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: c785b609-0068-442f-91f5-d26e888a993f] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:11:35 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: c785b609-0068-442f-91f5-d26e888a993f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73572) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 10:11:36 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: c785b609-0068-442f-91f5-d26e888a993f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 10:11:36 user nova-compute[73572]: INFO nova.compute.manager [None req-4390620d-fd54-45c3-98fa-55a5a0bae479 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] [instance: 8302d6e7-aaf3-461c-a55e-f2e685d1800d] Took 16.89 seconds to build instance.
Aug 26 10:11:36 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-4390620d-fd54-45c3-98fa-55a5a0bae479 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] Lock "8302d6e7-aaf3-461c-a55e-f2e685d1800d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.188s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:11:36 user nova-compute[73572]: INFO nova.compute.manager [None req-62a5f658-c44e-4e75-863d-84de11d2aa43 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: c785b609-0068-442f-91f5-d26e888a993f] Took 17.23 seconds to build instance.
Aug 26 10:11:36 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-62a5f658-c44e-4e75-863d-84de11d2aa43 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Lock "c785b609-0068-442f-91f5-d26e888a993f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.750s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:11:36 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:11:36 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:11:36 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:11:36 user nova-compute[73572]: DEBUG nova.compute.manager [req-63818396-2800-4de6-8fa7-8ea7bb5cc6bf req-dbc37e2f-0503-43ac-8842-f8d9e516e0c7 service nova] [instance: 61b60a19-597e-4dc1-af0f-a0ec95e9fd24] Received event network-vif-plugged-f846939c-c22d-4e0c-9237-404eabf0abd4 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:11:36 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-63818396-2800-4de6-8fa7-8ea7bb5cc6bf req-dbc37e2f-0503-43ac-8842-f8d9e516e0c7 service nova] Acquiring lock "61b60a19-597e-4dc1-af0f-a0ec95e9fd24-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:11:36 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-63818396-2800-4de6-8fa7-8ea7bb5cc6bf req-dbc37e2f-0503-43ac-8842-f8d9e516e0c7 service nova] Lock "61b60a19-597e-4dc1-af0f-a0ec95e9fd24-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:11:36 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-63818396-2800-4de6-8fa7-8ea7bb5cc6bf req-dbc37e2f-0503-43ac-8842-f8d9e516e0c7 service nova] Lock "61b60a19-597e-4dc1-af0f-a0ec95e9fd24-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:11:36 user nova-compute[73572]: DEBUG nova.compute.manager [req-63818396-2800-4de6-8fa7-8ea7bb5cc6bf req-dbc37e2f-0503-43ac-8842-f8d9e516e0c7 service nova] [instance: 61b60a19-597e-4dc1-af0f-a0ec95e9fd24] No waiting events found dispatching network-vif-plugged-f846939c-c22d-4e0c-9237-404eabf0abd4 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:11:36 user nova-compute[73572]: WARNING nova.compute.manager [req-63818396-2800-4de6-8fa7-8ea7bb5cc6bf req-dbc37e2f-0503-43ac-8842-f8d9e516e0c7 service nova] [instance: 61b60a19-597e-4dc1-af0f-a0ec95e9fd24] Received unexpected event network-vif-plugged-f846939c-c22d-4e0c-9237-404eabf0abd4 for instance with vm_state active and task_state None.
Aug 26 10:11:36 user nova-compute[73572]: DEBUG nova.network.neutron [req-fece5bb4-a433-44e2-95b1-35bfaebe6891 req-2b71de78-9e66-4221-b46a-61a161d3ba76 service nova] [instance: c555f971-b177-4c26-a38e-09e0e78bf7b9] Updated VIF entry in instance network info cache for port 4ffb7229-16fb-441b-a954-d91308071fb8. {{(pid=73572) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 10:11:36 user nova-compute[73572]: DEBUG nova.network.neutron [req-fece5bb4-a433-44e2-95b1-35bfaebe6891 req-2b71de78-9e66-4221-b46a-61a161d3ba76 service nova] [instance: c555f971-b177-4c26-a38e-09e0e78bf7b9] Updating instance_info_cache with network_info: [{"id": "4ffb7229-16fb-441b-a954-d91308071fb8", "address": "fa:16:3e:26:32:ef", "network": {"id": "e052e34f-ce84-4612-b48b-2ed8474e7177", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-332746918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4556d14c0dd416fbe13ab2274947dec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ffb7229-16", "ovs_interfaceid": "4ffb7229-16fb-441b-a954-d91308071fb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:11:36 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-fece5bb4-a433-44e2-95b1-35bfaebe6891 req-2b71de78-9e66-4221-b46a-61a161d3ba76 service nova] Releasing lock "refresh_cache-c555f971-b177-4c26-a38e-09e0e78bf7b9" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:11:37 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-a36233cf-267a-41b0-a89a-1cd104e96613 tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] Acquiring lock "ee9bcbaa-25a6-4588-b757-2a2ae15b6cf8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:11:37 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-a36233cf-267a-41b0-a89a-1cd104e96613 tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] Lock "ee9bcbaa-25a6-4588-b757-2a2ae15b6cf8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:11:37 user nova-compute[73572]: DEBUG nova.compute.manager [None req-a36233cf-267a-41b0-a89a-1cd104e96613 tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] [instance: ee9bcbaa-25a6-4588-b757-2a2ae15b6cf8] Starting instance... {{(pid=73572) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 10:11:37 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-a36233cf-267a-41b0-a89a-1cd104e96613 tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:11:37 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-a36233cf-267a-41b0-a89a-1cd104e96613 tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:11:37 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-a36233cf-267a-41b0-a89a-1cd104e96613 tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73572) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 10:11:37 user nova-compute[73572]: INFO nova.compute.claims [None req-a36233cf-267a-41b0-a89a-1cd104e96613 tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] [instance: ee9bcbaa-25a6-4588-b757-2a2ae15b6cf8] Claim successful on node user
Aug 26 10:11:37 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:11:37 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:11:37 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:11:37 user nova-compute[73572]: DEBUG nova.compute.provider_tree [None req-a36233cf-267a-41b0-a89a-1cd104e96613 tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] Inventory has not changed in ProviderTree for provider: e2cec974-59b2-4c77-a53d-a7f4e5a30d75 {{(pid=73572) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 10:11:37 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-a36233cf-267a-41b0-a89a-1cd104e96613 tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] Inventory has not changed for provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73572) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 10:11:38 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-a36233cf-267a-41b0-a89a-1cd104e96613 tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.624s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:11:38 user nova-compute[73572]: DEBUG nova.compute.manager [None req-a36233cf-267a-41b0-a89a-1cd104e96613 tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] [instance: ee9bcbaa-25a6-4588-b757-2a2ae15b6cf8] Start building networks asynchronously for instance. {{(pid=73572) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 10:11:38 user nova-compute[73572]: DEBUG nova.compute.manager [None req-a36233cf-267a-41b0-a89a-1cd104e96613 tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] [instance: ee9bcbaa-25a6-4588-b757-2a2ae15b6cf8] Allocating IP information in the background. {{(pid=73572) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 10:11:38 user nova-compute[73572]: DEBUG nova.network.neutron [None req-a36233cf-267a-41b0-a89a-1cd104e96613 tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] [instance: ee9bcbaa-25a6-4588-b757-2a2ae15b6cf8] allocate_for_instance() {{(pid=73572) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 10:11:38 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-a36233cf-267a-41b0-a89a-1cd104e96613 tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] [instance: ee9bcbaa-25a6-4588-b757-2a2ae15b6cf8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 10:11:38 user nova-compute[73572]: DEBUG nova.compute.manager [None req-a36233cf-267a-41b0-a89a-1cd104e96613 tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] [instance: ee9bcbaa-25a6-4588-b757-2a2ae15b6cf8] Start building block device mappings for instance. {{(pid=73572) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 10:11:38 user nova-compute[73572]: DEBUG nova.policy [None req-a36233cf-267a-41b0-a89a-1cd104e96613 tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fe58afb632fe4189a29df22dc61fb0ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9898b65714845e7aea403cc39182df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73572) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 10:11:38 user nova-compute[73572]: DEBUG nova.compute.manager [None req-a36233cf-267a-41b0-a89a-1cd104e96613 tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] [instance: ee9bcbaa-25a6-4588-b757-2a2ae15b6cf8] Start spawning the instance on the hypervisor. {{(pid=73572) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 10:11:38 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-a36233cf-267a-41b0-a89a-1cd104e96613 tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] [instance: ee9bcbaa-25a6-4588-b757-2a2ae15b6cf8] Creating instance directory {{(pid=73572) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 10:11:38 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-a36233cf-267a-41b0-a89a-1cd104e96613 tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] [instance: ee9bcbaa-25a6-4588-b757-2a2ae15b6cf8] Creating image(s)
Aug 26 10:11:38 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-a36233cf-267a-41b0-a89a-1cd104e96613 tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] Acquiring lock "/opt/stack/data/nova/instances/ee9bcbaa-25a6-4588-b757-2a2ae15b6cf8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:11:38 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-a36233cf-267a-41b0-a89a-1cd104e96613 tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] Lock "/opt/stack/data/nova/instances/ee9bcbaa-25a6-4588-b757-2a2ae15b6cf8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:11:38 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-a36233cf-267a-41b0-a89a-1cd104e96613 tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] Lock "/opt/stack/data/nova/instances/ee9bcbaa-25a6-4588-b757-2a2ae15b6cf8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:11:38 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-a36233cf-267a-41b0-a89a-1cd104e96613 tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:11:38 user nova-compute[73572]: DEBUG nova.compute.manager [req-251a4f91-7ea8-443f-a6a3-1432a70ff80b req-392f28d4-a53d-4d27-9e1c-043e5e39e9a7 service nova] [instance: 61b60a19-597e-4dc1-af0f-a0ec95e9fd24] Received event network-vif-plugged-f846939c-c22d-4e0c-9237-404eabf0abd4 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:11:38 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-251a4f91-7ea8-443f-a6a3-1432a70ff80b req-392f28d4-a53d-4d27-9e1c-043e5e39e9a7 service nova] Acquiring lock "61b60a19-597e-4dc1-af0f-a0ec95e9fd24-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:11:38 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-251a4f91-7ea8-443f-a6a3-1432a70ff80b req-392f28d4-a53d-4d27-9e1c-043e5e39e9a7 service nova] Lock "61b60a19-597e-4dc1-af0f-a0ec95e9fd24-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:11:38 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-251a4f91-7ea8-443f-a6a3-1432a70ff80b req-392f28d4-a53d-4d27-9e1c-043e5e39e9a7 service nova] Lock "61b60a19-597e-4dc1-af0f-a0ec95e9fd24-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:11:38 user nova-compute[73572]: DEBUG nova.compute.manager [req-251a4f91-7ea8-443f-a6a3-1432a70ff80b req-392f28d4-a53d-4d27-9e1c-043e5e39e9a7 service nova] [instance: 61b60a19-597e-4dc1-af0f-a0ec95e9fd24] No waiting events found dispatching network-vif-plugged-f846939c-c22d-4e0c-9237-404eabf0abd4 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:11:38 user nova-compute[73572]: WARNING nova.compute.manager [req-251a4f91-7ea8-443f-a6a3-1432a70ff80b req-392f28d4-a53d-4d27-9e1c-043e5e39e9a7 service nova] [instance: 61b60a19-597e-4dc1-af0f-a0ec95e9fd24] Received unexpected event network-vif-plugged-f846939c-c22d-4e0c-9237-404eabf0abd4 for instance with vm_state active and task_state None.
Aug 26 10:11:38 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:11:38 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:11:38 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-a36233cf-267a-41b0-a89a-1cd104e96613 tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json" returned: 0 in 0.312s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:11:38 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-a36233cf-267a-41b0-a89a-1cd104e96613 tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] Acquiring lock "2099350d6f3bcd0de9471c73862d4fe75b049801" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:11:38 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-a36233cf-267a-41b0-a89a-1cd104e96613 tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] Lock "2099350d6f3bcd0de9471c73862d4fe75b049801" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:11:38 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-a36233cf-267a-41b0-a89a-1cd104e96613 tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:11:39 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-a36233cf-267a-41b0-a89a-1cd104e96613 tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json" returned: 0 in 0.216s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:11:39 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-a36233cf-267a-41b0-a89a-1cd104e96613 tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801,backing_fmt=raw /opt/stack/data/nova/instances/ee9bcbaa-25a6-4588-b757-2a2ae15b6cf8/disk 1073741824 {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:11:39 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-a36233cf-267a-41b0-a89a-1cd104e96613 tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801,backing_fmt=raw /opt/stack/data/nova/instances/ee9bcbaa-25a6-4588-b757-2a2ae15b6cf8/disk 1073741824" returned: 0 in 0.056s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:11:39 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-a36233cf-267a-41b0-a89a-1cd104e96613 tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] Lock "2099350d6f3bcd0de9471c73862d4fe75b049801" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.289s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:11:39 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-a36233cf-267a-41b0-a89a-1cd104e96613 tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:11:39 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:11:39 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-a36233cf-267a-41b0-a89a-1cd104e96613 tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json" returned: 0 in 0.286s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:11:39 user nova-compute[73572]: DEBUG nova.virt.disk.api [None req-a36233cf-267a-41b0-a89a-1cd104e96613 tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ee9bcbaa-25a6-4588-b757-2a2ae15b6cf8/disk. size=1073741824 {{(pid=73572) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 10:11:39 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-a36233cf-267a-41b0-a89a-1cd104e96613 tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee9bcbaa-25a6-4588-b757-2a2ae15b6cf8/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:11:39 user nova-compute[73572]: DEBUG nova.virt.driver [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Emitting event <LifecycleEvent: 1693044699.627856, c555f971-b177-4c26-a38e-09e0e78bf7b9 => Resumed> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:11:39 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: c555f971-b177-4c26-a38e-09e0e78bf7b9] VM Resumed (Lifecycle Event)
Aug 26 10:11:39 user nova-compute[73572]: DEBUG nova.compute.manager [None req-188a1c5b-a0ef-4f1c-91ef-7e2d1ce280a1 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] [instance: c555f971-b177-4c26-a38e-09e0e78bf7b9] Instance event wait completed in 0 seconds for  {{(pid=73572) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 10:11:39 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-188a1c5b-a0ef-4f1c-91ef-7e2d1ce280a1 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] [instance: c555f971-b177-4c26-a38e-09e0e78bf7b9] Guest created on hypervisor {{(pid=73572) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 10:11:39 user nova-compute[73572]: INFO nova.virt.libvirt.driver [-] [instance: c555f971-b177-4c26-a38e-09e0e78bf7b9] Instance spawned successfully.
Aug 26 10:11:39 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-188a1c5b-a0ef-4f1c-91ef-7e2d1ce280a1 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] [instance: c555f971-b177-4c26-a38e-09e0e78bf7b9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 10:11:39 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: c555f971-b177-4c26-a38e-09e0e78bf7b9] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:11:39 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: c555f971-b177-4c26-a38e-09e0e78bf7b9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73572) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 10:11:39 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-188a1c5b-a0ef-4f1c-91ef-7e2d1ce280a1 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] [instance: c555f971-b177-4c26-a38e-09e0e78bf7b9] Found default for hw_cdrom_bus of ide {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:11:39 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-188a1c5b-a0ef-4f1c-91ef-7e2d1ce280a1 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] [instance: c555f971-b177-4c26-a38e-09e0e78bf7b9] Found default for hw_disk_bus of virtio {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:11:39 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-188a1c5b-a0ef-4f1c-91ef-7e2d1ce280a1 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] [instance: c555f971-b177-4c26-a38e-09e0e78bf7b9] Found default for hw_input_bus of None {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:11:39 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-188a1c5b-a0ef-4f1c-91ef-7e2d1ce280a1 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] [instance: c555f971-b177-4c26-a38e-09e0e78bf7b9] Found default for hw_pointer_model of None {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:11:39 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-188a1c5b-a0ef-4f1c-91ef-7e2d1ce280a1 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] [instance: c555f971-b177-4c26-a38e-09e0e78bf7b9] Found default for hw_video_model of virtio {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:11:39 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-188a1c5b-a0ef-4f1c-91ef-7e2d1ce280a1 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] [instance: c555f971-b177-4c26-a38e-09e0e78bf7b9] Found default for hw_vif_model of virtio {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:11:39 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: c555f971-b177-4c26-a38e-09e0e78bf7b9] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 10:11:39 user nova-compute[73572]: DEBUG nova.virt.driver [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Emitting event <LifecycleEvent: 1693044699.6288323, c555f971-b177-4c26-a38e-09e0e78bf7b9 => Started> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:11:39 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: c555f971-b177-4c26-a38e-09e0e78bf7b9] VM Started (Lifecycle Event)
Aug 26 10:11:39 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: c555f971-b177-4c26-a38e-09e0e78bf7b9] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:11:39 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: c555f971-b177-4c26-a38e-09e0e78bf7b9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73572) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 10:11:39 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-a36233cf-267a-41b0-a89a-1cd104e96613 tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee9bcbaa-25a6-4588-b757-2a2ae15b6cf8/disk --force-share --output=json" returned: 0 in 0.337s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:11:39 user nova-compute[73572]: DEBUG nova.virt.disk.api [None req-a36233cf-267a-41b0-a89a-1cd104e96613 tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] Cannot resize image /opt/stack/data/nova/instances/ee9bcbaa-25a6-4588-b757-2a2ae15b6cf8/disk to a smaller size. {{(pid=73572) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 10:11:39 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-a36233cf-267a-41b0-a89a-1cd104e96613 tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] [instance: ee9bcbaa-25a6-4588-b757-2a2ae15b6cf8] Created local disks {{(pid=73572) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 10:11:39 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-a36233cf-267a-41b0-a89a-1cd104e96613 tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] [instance: ee9bcbaa-25a6-4588-b757-2a2ae15b6cf8] Ensure instance console log exists: /opt/stack/data/nova/instances/ee9bcbaa-25a6-4588-b757-2a2ae15b6cf8/console.log {{(pid=73572) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 10:11:39 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-a36233cf-267a-41b0-a89a-1cd104e96613 tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:11:39 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-a36233cf-267a-41b0-a89a-1cd104e96613 tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:11:39 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-a36233cf-267a-41b0-a89a-1cd104e96613 tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:11:39 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: c555f971-b177-4c26-a38e-09e0e78bf7b9] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 10:11:39 user nova-compute[73572]: INFO nova.compute.manager [None req-188a1c5b-a0ef-4f1c-91ef-7e2d1ce280a1 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] [instance: c555f971-b177-4c26-a38e-09e0e78bf7b9] Took 15.07 seconds to spawn the instance on the hypervisor.
Aug 26 10:11:39 user nova-compute[73572]: DEBUG nova.compute.manager [None req-188a1c5b-a0ef-4f1c-91ef-7e2d1ce280a1 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] [instance: c555f971-b177-4c26-a38e-09e0e78bf7b9] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:11:39 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:11:40 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:11:40 user nova-compute[73572]: INFO nova.compute.manager [None req-188a1c5b-a0ef-4f1c-91ef-7e2d1ce280a1 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] [instance: c555f971-b177-4c26-a38e-09e0e78bf7b9] Took 15.87 seconds to build instance.
Aug 26 10:11:40 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-188a1c5b-a0ef-4f1c-91ef-7e2d1ce280a1 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] Lock "c555f971-b177-4c26-a38e-09e0e78bf7b9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.014s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:11:40 user nova-compute[73572]: DEBUG nova.network.neutron [None req-a36233cf-267a-41b0-a89a-1cd104e96613 tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] [instance: ee9bcbaa-25a6-4588-b757-2a2ae15b6cf8] Successfully created port: f47d01ad-ade6-4b38-8b96-ea183c06134c {{(pid=73572) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 10:11:40 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:11:42 user nova-compute[73572]: DEBUG nova.network.neutron [None req-a36233cf-267a-41b0-a89a-1cd104e96613 tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] [instance: ee9bcbaa-25a6-4588-b757-2a2ae15b6cf8] Successfully updated port: f47d01ad-ade6-4b38-8b96-ea183c06134c {{(pid=73572) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 10:11:42 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-a36233cf-267a-41b0-a89a-1cd104e96613 tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] Acquiring lock "refresh_cache-ee9bcbaa-25a6-4588-b757-2a2ae15b6cf8" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:11:42 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-a36233cf-267a-41b0-a89a-1cd104e96613 tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] Acquired lock "refresh_cache-ee9bcbaa-25a6-4588-b757-2a2ae15b6cf8" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:11:42 user nova-compute[73572]: DEBUG nova.network.neutron [None req-a36233cf-267a-41b0-a89a-1cd104e96613 tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] [instance: ee9bcbaa-25a6-4588-b757-2a2ae15b6cf8] Building network info cache for instance {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 10:11:42 user nova-compute[73572]: DEBUG nova.compute.manager [req-0702afcc-40e7-4f9b-89e1-577d95075db3 req-ab837c0c-1def-4894-ad99-25b6851c7c26 service nova] [instance: ee9bcbaa-25a6-4588-b757-2a2ae15b6cf8] Received event network-changed-f47d01ad-ade6-4b38-8b96-ea183c06134c {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:11:42 user nova-compute[73572]: DEBUG nova.compute.manager [req-0702afcc-40e7-4f9b-89e1-577d95075db3 req-ab837c0c-1def-4894-ad99-25b6851c7c26 service nova] [instance: ee9bcbaa-25a6-4588-b757-2a2ae15b6cf8] Refreshing instance network info cache due to event network-changed-f47d01ad-ade6-4b38-8b96-ea183c06134c. {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 10:11:42 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-0702afcc-40e7-4f9b-89e1-577d95075db3 req-ab837c0c-1def-4894-ad99-25b6851c7c26 service nova] Acquiring lock "refresh_cache-ee9bcbaa-25a6-4588-b757-2a2ae15b6cf8" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:11:42 user nova-compute[73572]: DEBUG nova.network.neutron [None req-a36233cf-267a-41b0-a89a-1cd104e96613 tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] [instance: ee9bcbaa-25a6-4588-b757-2a2ae15b6cf8] Instance cache missing network info. {{(pid=73572) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 10:11:42 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-b138e73f-947b-47be-9bec-df0aaf35f032 tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] Acquiring lock "8ee427dc-7aa0-4435-b23c-1223f2881df7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:11:42 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-b138e73f-947b-47be-9bec-df0aaf35f032 tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] Lock "8ee427dc-7aa0-4435-b23c-1223f2881df7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:11:42 user nova-compute[73572]: DEBUG nova.compute.manager [None req-b138e73f-947b-47be-9bec-df0aaf35f032 tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] [instance: 8ee427dc-7aa0-4435-b23c-1223f2881df7] Starting instance... {{(pid=73572) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 10:11:42 user nova-compute[73572]: DEBUG nova.compute.manager [req-39900106-f0c4-45e1-9ec9-d4ce1c1f2e2d req-65f480dc-681f-4068-be97-3a6a799e6b67 service nova] [instance: c555f971-b177-4c26-a38e-09e0e78bf7b9] Received event network-vif-plugged-4ffb7229-16fb-441b-a954-d91308071fb8 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:11:42 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-39900106-f0c4-45e1-9ec9-d4ce1c1f2e2d req-65f480dc-681f-4068-be97-3a6a799e6b67 service nova] Acquiring lock "c555f971-b177-4c26-a38e-09e0e78bf7b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:11:42 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-39900106-f0c4-45e1-9ec9-d4ce1c1f2e2d req-65f480dc-681f-4068-be97-3a6a799e6b67 service nova] Lock "c555f971-b177-4c26-a38e-09e0e78bf7b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:11:42 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-39900106-f0c4-45e1-9ec9-d4ce1c1f2e2d req-65f480dc-681f-4068-be97-3a6a799e6b67 service nova] Lock "c555f971-b177-4c26-a38e-09e0e78bf7b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.004s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:11:42 user nova-compute[73572]: DEBUG nova.compute.manager [req-39900106-f0c4-45e1-9ec9-d4ce1c1f2e2d req-65f480dc-681f-4068-be97-3a6a799e6b67 service nova] [instance: c555f971-b177-4c26-a38e-09e0e78bf7b9] No waiting events found dispatching network-vif-plugged-4ffb7229-16fb-441b-a954-d91308071fb8 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:11:42 user nova-compute[73572]: WARNING nova.compute.manager [req-39900106-f0c4-45e1-9ec9-d4ce1c1f2e2d req-65f480dc-681f-4068-be97-3a6a799e6b67 service nova] [instance: c555f971-b177-4c26-a38e-09e0e78bf7b9] Received unexpected event network-vif-plugged-4ffb7229-16fb-441b-a954-d91308071fb8 for instance with vm_state active and task_state None.
Aug 26 10:11:42 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-b138e73f-947b-47be-9bec-df0aaf35f032 tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:11:42 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-b138e73f-947b-47be-9bec-df0aaf35f032 tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:11:42 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-b138e73f-947b-47be-9bec-df0aaf35f032 tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73572) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 10:11:42 user nova-compute[73572]: INFO nova.compute.claims [None req-b138e73f-947b-47be-9bec-df0aaf35f032 tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] [instance: 8ee427dc-7aa0-4435-b23c-1223f2881df7] Claim successful on node user
Aug 26 10:11:42 user nova-compute[73572]: DEBUG nova.network.neutron [None req-a36233cf-267a-41b0-a89a-1cd104e96613 tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] [instance: ee9bcbaa-25a6-4588-b757-2a2ae15b6cf8] Updating instance_info_cache with network_info: [{"id": "f47d01ad-ade6-4b38-8b96-ea183c06134c", "address": "fa:16:3e:f9:ca:45", "network": {"id": "529bb981-16ba-47c5-afb0-55f4aa577ecc", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-265382654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9898b65714845e7aea403cc39182df7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf47d01ad-ad", "ovs_interfaceid": "f47d01ad-ade6-4b38-8b96-ea183c06134c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:11:43 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-a36233cf-267a-41b0-a89a-1cd104e96613 tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] Releasing lock "refresh_cache-ee9bcbaa-25a6-4588-b757-2a2ae15b6cf8" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:11:43 user nova-compute[73572]: DEBUG nova.compute.manager [None req-a36233cf-267a-41b0-a89a-1cd104e96613 tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] [instance: ee9bcbaa-25a6-4588-b757-2a2ae15b6cf8] Instance network_info: |[{"id": "f47d01ad-ade6-4b38-8b96-ea183c06134c", "address": "fa:16:3e:f9:ca:45", "network": {"id": "529bb981-16ba-47c5-afb0-55f4aa577ecc", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-265382654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9898b65714845e7aea403cc39182df7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf47d01ad-ad", "ovs_interfaceid": "f47d01ad-ade6-4b38-8b96-ea183c06134c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73572) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 10:11:43 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-0702afcc-40e7-4f9b-89e1-577d95075db3 req-ab837c0c-1def-4894-ad99-25b6851c7c26 service nova] Acquired lock "refresh_cache-ee9bcbaa-25a6-4588-b757-2a2ae15b6cf8" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:11:43 user nova-compute[73572]: DEBUG nova.network.neutron [req-0702afcc-40e7-4f9b-89e1-577d95075db3 req-ab837c0c-1def-4894-ad99-25b6851c7c26 service nova] [instance: ee9bcbaa-25a6-4588-b757-2a2ae15b6cf8] Refreshing network info cache for port f47d01ad-ade6-4b38-8b96-ea183c06134c {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 10:11:43 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-a36233cf-267a-41b0-a89a-1cd104e96613 tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] [instance: ee9bcbaa-25a6-4588-b757-2a2ae15b6cf8] Start _get_guest_xml network_info=[{"id": "f47d01ad-ade6-4b38-8b96-ea183c06134c", "address": "fa:16:3e:f9:ca:45", "network": {"id": "529bb981-16ba-47c5-afb0-55f4aa577ecc", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-265382654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9898b65714845e7aea403cc39182df7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf47d01ad-ad", "ovs_interfaceid": "f47d01ad-ade6-4b38-8b96-ea183c06134c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T10:07:33Z,direct_url=<?>,disk_format='qcow2',id=299da0c9-e1c4-48f0-be55-fbe20dd06bc9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5c995f8bbbab4368b67a253e0df3971a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T10:07:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'guest_format': None, 'size': 0, 'encryption_format': None, 'device_type': 'disk', 'image_id': '299da0c9-e1c4-48f0-be55-fbe20dd06bc9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73572) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 10:11:43 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-a36233cf-267a-41b0-a89a-1cd104e96613 tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:11:43 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-a36233cf-267a-41b0-a89a-1cd104e96613 tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:11:43 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-a36233cf-267a-41b0-a89a-1cd104e96613 tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73572) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 10:11:43 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-a36233cf-267a-41b0-a89a-1cd104e96613 tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] CPU controller missing on host. {{(pid=73572) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 10:11:43 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-a36233cf-267a-41b0-a89a-1cd104e96613 tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73572) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 10:11:43 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-a36233cf-267a-41b0-a89a-1cd104e96613 tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] CPU controller found on host. {{(pid=73572) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 10:11:43 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-a36233cf-267a-41b0-a89a-1cd104e96613 tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73572) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 10:11:43 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-a36233cf-267a-41b0-a89a-1cd104e96613 tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T10:07:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T10:07:33Z,direct_url=<?>,disk_format='qcow2',id=299da0c9-e1c4-48f0-be55-fbe20dd06bc9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5c995f8bbbab4368b67a253e0df3971a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T10:07:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 10:11:43 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-a36233cf-267a-41b0-a89a-1cd104e96613 tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] Flavor limits 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 10:11:43 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-a36233cf-267a-41b0-a89a-1cd104e96613 tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] Image limits 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 10:11:43 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-a36233cf-267a-41b0-a89a-1cd104e96613 tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] Flavor pref 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 10:11:43 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-a36233cf-267a-41b0-a89a-1cd104e96613 tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] Image pref 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 10:11:43 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-a36233cf-267a-41b0-a89a-1cd104e96613 tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 10:11:43 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-a36233cf-267a-41b0-a89a-1cd104e96613 tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 10:11:43 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-a36233cf-267a-41b0-a89a-1cd104e96613 tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73572) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 10:11:43 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-a36233cf-267a-41b0-a89a-1cd104e96613 tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] Got 1 possible topologies {{(pid=73572) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 10:11:43 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-a36233cf-267a-41b0-a89a-1cd104e96613 tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 10:11:43 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-a36233cf-267a-41b0-a89a-1cd104e96613 tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 10:11:43 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-a36233cf-267a-41b0-a89a-1cd104e96613 tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T10:11:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1079910466',display_name='tempest-VolumesAdminNegativeTest-server-1079910466',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1079910466',id=5,image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCaJcau7rrfdR3HBjlRDbFHBk+A8rThFiajgOy3KSx+oiPaFDl3xNbwQP3H0+I+NPSaumYh7Y24HyFBNaBDT6hnhIjJIzrW4M9QvwFAosaQa3iWtxP6Z66yPtDZS5WHqMg==',key_name='tempest-keypair-624891862',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a9898b65714845e7aea403cc39182df7',ramdisk_id='',reservation_id='r-ungn8o0c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-119088495',owner_user_name='tempest-VolumesAdminNegativeTest-119088495-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T10:11:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fe58afb632fe4189a29df22dc61fb0ae',uuid=ee9bcbaa-25a6-4588-b757-2a2ae15b6cf8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f47d01ad-ade6-4b38-8b96-ea183c06134c", "address": "fa:16:3e:f9:ca:45", "network": {"id": "529bb981-16ba-47c5-afb0-55f4aa577ecc", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-265382654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9898b65714845e7aea403cc39182df7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf47d01ad-ad", "ovs_interfaceid": "f47d01ad-ade6-4b38-8b96-ea183c06134c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73572) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 10:11:43 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-a36233cf-267a-41b0-a89a-1cd104e96613 tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] Converting VIF {"id": "f47d01ad-ade6-4b38-8b96-ea183c06134c", "address": "fa:16:3e:f9:ca:45", "network": {"id": "529bb981-16ba-47c5-afb0-55f4aa577ecc", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-265382654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9898b65714845e7aea403cc39182df7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf47d01ad-ad", "ovs_interfaceid": "f47d01ad-ade6-4b38-8b96-ea183c06134c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:11:43 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-a36233cf-267a-41b0-a89a-1cd104e96613 tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:ca:45,bridge_name='br-int',has_traffic_filtering=True,id=f47d01ad-ade6-4b38-8b96-ea183c06134c,network=Network(529bb981-16ba-47c5-afb0-55f4aa577ecc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf47d01ad-ad') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:11:43 user nova-compute[73572]: DEBUG nova.objects.instance [None req-a36233cf-267a-41b0-a89a-1cd104e96613 tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] Lazy-loading 'pci_devices' on Instance uuid ee9bcbaa-25a6-4588-b757-2a2ae15b6cf8 {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:11:43 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:11:43 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-a36233cf-267a-41b0-a89a-1cd104e96613 tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] [instance: ee9bcbaa-25a6-4588-b757-2a2ae15b6cf8] End _get_guest_xml xml=<domain type="kvm">
Aug 26 10:11:43 user nova-compute[73572]:   <uuid>ee9bcbaa-25a6-4588-b757-2a2ae15b6cf8</uuid>
Aug 26 10:11:43 user nova-compute[73572]:   <name>instance-00000005</name>
Aug 26 10:11:43 user nova-compute[73572]:   <memory>524288</memory>
Aug 26 10:11:43 user nova-compute[73572]:   <vcpu>1</vcpu>
Aug 26 10:11:43 user nova-compute[73572]:   <metadata>
Aug 26 10:11:43 user nova-compute[73572]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 10:11:43 user nova-compute[73572]:       <nova:package version="0.0.0"/>
Aug 26 10:11:43 user nova-compute[73572]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1079910466</nova:name>
Aug 26 10:11:43 user nova-compute[73572]:       <nova:creationTime>2023-08-26 10:11:43</nova:creationTime>
Aug 26 10:11:43 user nova-compute[73572]:       <nova:flavor name="m1.tiny">
Aug 26 10:11:43 user nova-compute[73572]:         <nova:memory>512</nova:memory>
Aug 26 10:11:43 user nova-compute[73572]:         <nova:disk>1</nova:disk>
Aug 26 10:11:43 user nova-compute[73572]:         <nova:swap>0</nova:swap>
Aug 26 10:11:43 user nova-compute[73572]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 10:11:43 user nova-compute[73572]:         <nova:vcpus>1</nova:vcpus>
Aug 26 10:11:43 user nova-compute[73572]:       </nova:flavor>
Aug 26 10:11:43 user nova-compute[73572]:       <nova:owner>
Aug 26 10:11:43 user nova-compute[73572]:         <nova:user uuid="fe58afb632fe4189a29df22dc61fb0ae">tempest-VolumesAdminNegativeTest-119088495-project-member</nova:user>
Aug 26 10:11:43 user nova-compute[73572]:         <nova:project uuid="a9898b65714845e7aea403cc39182df7">tempest-VolumesAdminNegativeTest-119088495</nova:project>
Aug 26 10:11:43 user nova-compute[73572]:       </nova:owner>
Aug 26 10:11:43 user nova-compute[73572]:       <nova:root type="image" uuid="299da0c9-e1c4-48f0-be55-fbe20dd06bc9"/>
Aug 26 10:11:43 user nova-compute[73572]:       <nova:ports>
Aug 26 10:11:43 user nova-compute[73572]:         <nova:port uuid="f47d01ad-ade6-4b38-8b96-ea183c06134c">
Aug 26 10:11:43 user nova-compute[73572]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 26 10:11:43 user nova-compute[73572]:         </nova:port>
Aug 26 10:11:43 user nova-compute[73572]:       </nova:ports>
Aug 26 10:11:43 user nova-compute[73572]:     </nova:instance>
Aug 26 10:11:43 user nova-compute[73572]:   </metadata>
Aug 26 10:11:43 user nova-compute[73572]:   <sysinfo type="smbios">
Aug 26 10:11:43 user nova-compute[73572]:     <system>
Aug 26 10:11:43 user nova-compute[73572]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 10:11:43 user nova-compute[73572]:       <entry name="product">OpenStack Nova</entry>
Aug 26 10:11:43 user nova-compute[73572]:       <entry name="version">0.0.0</entry>
Aug 26 10:11:43 user nova-compute[73572]:       <entry name="serial">ee9bcbaa-25a6-4588-b757-2a2ae15b6cf8</entry>
Aug 26 10:11:43 user nova-compute[73572]:       <entry name="uuid">ee9bcbaa-25a6-4588-b757-2a2ae15b6cf8</entry>
Aug 26 10:11:43 user nova-compute[73572]:       <entry name="family">Virtual Machine</entry>
Aug 26 10:11:43 user nova-compute[73572]:     </system>
Aug 26 10:11:43 user nova-compute[73572]:   </sysinfo>
Aug 26 10:11:43 user nova-compute[73572]:   <os>
Aug 26 10:11:43 user nova-compute[73572]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 10:11:43 user nova-compute[73572]:     <boot dev="hd"/>
Aug 26 10:11:43 user nova-compute[73572]:     <smbios mode="sysinfo"/>
Aug 26 10:11:43 user nova-compute[73572]:   </os>
Aug 26 10:11:43 user nova-compute[73572]:   <features>
Aug 26 10:11:43 user nova-compute[73572]:     <acpi/>
Aug 26 10:11:43 user nova-compute[73572]:     <apic/>
Aug 26 10:11:43 user nova-compute[73572]:     <vmcoreinfo/>
Aug 26 10:11:43 user nova-compute[73572]:   </features>
Aug 26 10:11:43 user nova-compute[73572]:   <clock offset="utc">
Aug 26 10:11:43 user nova-compute[73572]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 10:11:43 user nova-compute[73572]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 10:11:43 user nova-compute[73572]:     <timer name="hpet" present="no"/>
Aug 26 10:11:43 user nova-compute[73572]:   </clock>
Aug 26 10:11:43 user nova-compute[73572]:   <cpu mode="custom" match="exact">
Aug 26 10:11:43 user nova-compute[73572]:     <model>Nehalem</model>
Aug 26 10:11:43 user nova-compute[73572]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 10:11:43 user nova-compute[73572]:   </cpu>
Aug 26 10:11:43 user nova-compute[73572]:   <devices>
Aug 26 10:11:43 user nova-compute[73572]:     <disk type="file" device="disk">
Aug 26 10:11:43 user nova-compute[73572]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 10:11:43 user nova-compute[73572]:       <source file="/opt/stack/data/nova/instances/ee9bcbaa-25a6-4588-b757-2a2ae15b6cf8/disk"/>
Aug 26 10:11:43 user nova-compute[73572]:       <target dev="vda" bus="virtio"/>
Aug 26 10:11:43 user nova-compute[73572]:     </disk>
Aug 26 10:11:43 user nova-compute[73572]:     <interface type="ethernet">
Aug 26 10:11:43 user nova-compute[73572]:       <mac address="fa:16:3e:f9:ca:45"/>
Aug 26 10:11:43 user nova-compute[73572]:       <model type="virtio"/>
Aug 26 10:11:43 user nova-compute[73572]:       <mtu size="1442"/>
Aug 26 10:11:43 user nova-compute[73572]:       <target dev="tapf47d01ad-ad"/>
Aug 26 10:11:43 user nova-compute[73572]:     </interface>
Aug 26 10:11:43 user nova-compute[73572]:     <serial type="pty">
Aug 26 10:11:43 user nova-compute[73572]:       <log file="/opt/stack/data/nova/instances/ee9bcbaa-25a6-4588-b757-2a2ae15b6cf8/console.log" append="off"/>
Aug 26 10:11:43 user nova-compute[73572]:     </serial>
Aug 26 10:11:43 user nova-compute[73572]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 10:11:43 user nova-compute[73572]:     <video>
Aug 26 10:11:43 user nova-compute[73572]:       <model type="virtio"/>
Aug 26 10:11:43 user nova-compute[73572]:     </video>
Aug 26 10:11:43 user nova-compute[73572]:     <rng model="virtio">
Aug 26 10:11:43 user nova-compute[73572]:       <backend model="random">/dev/urandom</backend>
Aug 26 10:11:43 user nova-compute[73572]:     </rng>
Aug 26 10:11:43 user nova-compute[73572]:     <controller type="usb" index="0" model="none"/>
Aug 26 10:11:43 user nova-compute[73572]:     <memballoon model="virtio">
Aug 26 10:11:43 user nova-compute[73572]:       <stats period="10"/>
Aug 26 10:11:43 user nova-compute[73572]:     </memballoon>
Aug 26 10:11:43 user nova-compute[73572]:   </devices>
Aug 26 10:11:43 user nova-compute[73572]: </domain>
Aug 26 10:11:43 user nova-compute[73572]:  {{(pid=73572) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 10:11:43 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-a36233cf-267a-41b0-a89a-1cd104e96613 tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T10:11:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1079910466',display_name='tempest-VolumesAdminNegativeTest-server-1079910466',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1079910466',id=5,image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCaJcau7rrfdR3HBjlRDbFHBk+A8rThFiajgOy3KSx+oiPaFDl3xNbwQP3H0+I+NPSaumYh7Y24HyFBNaBDT6hnhIjJIzrW4M9QvwFAosaQa3iWtxP6Z66yPtDZS5WHqMg==',key_name='tempest-keypair-624891862',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a9898b65714845e7aea403cc39182df7',ramdisk_id='',reservation_id='r-ungn8o0c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-119088495',owner_user_name='tempest-VolumesAdminNegativeTest-119088495-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T10:11:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fe58afb632fe4189a29df22dc61fb0ae',uuid=ee9bcbaa-25a6-4588-b757-2a2ae15b6cf8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f47d01ad-ade6-4b38-8b96-ea183c06134c", "address": "fa:16:3e:f9:ca:45", "network": {"id": "529bb981-16ba-47c5-afb0-55f4aa577ecc", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-265382654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9898b65714845e7aea403cc39182df7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf47d01ad-ad", "ovs_interfaceid": "f47d01ad-ade6-4b38-8b96-ea183c06134c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 10:11:43 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-a36233cf-267a-41b0-a89a-1cd104e96613 tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] Converting VIF {"id": "f47d01ad-ade6-4b38-8b96-ea183c06134c", "address": "fa:16:3e:f9:ca:45", "network": {"id": "529bb981-16ba-47c5-afb0-55f4aa577ecc", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-265382654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9898b65714845e7aea403cc39182df7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf47d01ad-ad", "ovs_interfaceid": "f47d01ad-ade6-4b38-8b96-ea183c06134c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:11:43 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-a36233cf-267a-41b0-a89a-1cd104e96613 tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:ca:45,bridge_name='br-int',has_traffic_filtering=True,id=f47d01ad-ade6-4b38-8b96-ea183c06134c,network=Network(529bb981-16ba-47c5-afb0-55f4aa577ecc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf47d01ad-ad') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:11:43 user nova-compute[73572]: DEBUG os_vif [None req-a36233cf-267a-41b0-a89a-1cd104e96613 tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:ca:45,bridge_name='br-int',has_traffic_filtering=True,id=f47d01ad-ade6-4b38-8b96-ea183c06134c,network=Network(529bb981-16ba-47c5-afb0-55f4aa577ecc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf47d01ad-ad') {{(pid=73572) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 10:11:43 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:11:43 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:11:43 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 10:11:43 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:11:43 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf47d01ad-ad, may_exist=True, interface_attrs={}) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:11:43 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf47d01ad-ad, col_values=(('external_ids', {'iface-id': 'f47d01ad-ade6-4b38-8b96-ea183c06134c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f9:ca:45', 'vm-uuid': 'ee9bcbaa-25a6-4588-b757-2a2ae15b6cf8'}),), if_exists=True) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:11:43 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:11:43 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:11:43 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:11:43 user nova-compute[73572]: INFO os_vif [None req-a36233cf-267a-41b0-a89a-1cd104e96613 tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:ca:45,bridge_name='br-int',has_traffic_filtering=True,id=f47d01ad-ade6-4b38-8b96-ea183c06134c,network=Network(529bb981-16ba-47c5-afb0-55f4aa577ecc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf47d01ad-ad')
Aug 26 10:11:44 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-a36233cf-267a-41b0-a89a-1cd104e96613 tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] No BDM found with device name vda, not building metadata. {{(pid=73572) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 10:11:44 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-a36233cf-267a-41b0-a89a-1cd104e96613 tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] No VIF found with MAC fa:16:3e:f9:ca:45, not building metadata {{(pid=73572) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 10:11:44 user nova-compute[73572]: DEBUG nova.compute.provider_tree [None req-b138e73f-947b-47be-9bec-df0aaf35f032 tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] Inventory has not changed in ProviderTree for provider: e2cec974-59b2-4c77-a53d-a7f4e5a30d75 {{(pid=73572) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 10:11:44 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-b138e73f-947b-47be-9bec-df0aaf35f032 tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] Inventory has not changed for provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73572) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 10:11:44 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-b138e73f-947b-47be-9bec-df0aaf35f032 tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.729s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:11:44 user nova-compute[73572]: DEBUG nova.compute.manager [None req-b138e73f-947b-47be-9bec-df0aaf35f032 tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] [instance: 8ee427dc-7aa0-4435-b23c-1223f2881df7] Start building networks asynchronously for instance. {{(pid=73572) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 10:11:44 user nova-compute[73572]: DEBUG nova.compute.manager [None req-b138e73f-947b-47be-9bec-df0aaf35f032 tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] [instance: 8ee427dc-7aa0-4435-b23c-1223f2881df7] Allocating IP information in the background. {{(pid=73572) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 10:11:44 user nova-compute[73572]: DEBUG nova.network.neutron [None req-b138e73f-947b-47be-9bec-df0aaf35f032 tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] [instance: 8ee427dc-7aa0-4435-b23c-1223f2881df7] allocate_for_instance() {{(pid=73572) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 10:11:44 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-b138e73f-947b-47be-9bec-df0aaf35f032 tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] [instance: 8ee427dc-7aa0-4435-b23c-1223f2881df7] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Aug 26 10:11:44 user nova-compute[73572]: DEBUG nova.compute.manager [req-fca14931-602e-4ce8-9f1a-9dc68322c510 req-18ad6ec1-1169-4675-b8bb-825bde2c7933 service nova] [instance: c785b609-0068-442f-91f5-d26e888a993f] Received event network-vif-plugged-f01cdcf9-2430-4eb5-bb2d-3d126756dfc1 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:11:44 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-fca14931-602e-4ce8-9f1a-9dc68322c510 req-18ad6ec1-1169-4675-b8bb-825bde2c7933 service nova] Acquiring lock "c785b609-0068-442f-91f5-d26e888a993f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:11:44 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-fca14931-602e-4ce8-9f1a-9dc68322c510 req-18ad6ec1-1169-4675-b8bb-825bde2c7933 service nova] Lock "c785b609-0068-442f-91f5-d26e888a993f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:11:44 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-fca14931-602e-4ce8-9f1a-9dc68322c510 req-18ad6ec1-1169-4675-b8bb-825bde2c7933 service nova] Lock "c785b609-0068-442f-91f5-d26e888a993f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:11:44 user nova-compute[73572]: DEBUG nova.compute.manager [req-fca14931-602e-4ce8-9f1a-9dc68322c510 req-18ad6ec1-1169-4675-b8bb-825bde2c7933 service nova] [instance: c785b609-0068-442f-91f5-d26e888a993f] No waiting events found dispatching network-vif-plugged-f01cdcf9-2430-4eb5-bb2d-3d126756dfc1 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:11:44 user nova-compute[73572]: WARNING nova.compute.manager [req-fca14931-602e-4ce8-9f1a-9dc68322c510 req-18ad6ec1-1169-4675-b8bb-825bde2c7933 service nova] [instance: c785b609-0068-442f-91f5-d26e888a993f] Received unexpected event network-vif-plugged-f01cdcf9-2430-4eb5-bb2d-3d126756dfc1 for instance with vm_state active and task_state None.
Aug 26 10:11:44 user nova-compute[73572]: DEBUG nova.compute.manager [None req-b138e73f-947b-47be-9bec-df0aaf35f032 tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] [instance: 8ee427dc-7aa0-4435-b23c-1223f2881df7] Start building block device mappings for instance. {{(pid=73572) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 10:11:44 user nova-compute[73572]: DEBUG nova.policy [None req-b138e73f-947b-47be-9bec-df0aaf35f032 tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ada5dab545f244e38ed9ce5a23e84af7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9e9d7749db44598b91bc81e3d543b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73572) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 10:11:44 user nova-compute[73572]: DEBUG nova.compute.manager [req-7493762d-b94d-460e-8239-93e319fc3b74 req-b1e99297-266b-414a-ae66-9a46260370f9 service nova] [instance: c555f971-b177-4c26-a38e-09e0e78bf7b9] Received event network-vif-plugged-4ffb7229-16fb-441b-a954-d91308071fb8 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:11:44 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-7493762d-b94d-460e-8239-93e319fc3b74 req-b1e99297-266b-414a-ae66-9a46260370f9 service nova] Acquiring lock "c555f971-b177-4c26-a38e-09e0e78bf7b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:11:44 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-7493762d-b94d-460e-8239-93e319fc3b74 req-b1e99297-266b-414a-ae66-9a46260370f9 service nova] Lock "c555f971-b177-4c26-a38e-09e0e78bf7b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:11:44 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-7493762d-b94d-460e-8239-93e319fc3b74 req-b1e99297-266b-414a-ae66-9a46260370f9 service nova] Lock "c555f971-b177-4c26-a38e-09e0e78bf7b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:11:44 user nova-compute[73572]: DEBUG nova.compute.manager [req-7493762d-b94d-460e-8239-93e319fc3b74 req-b1e99297-266b-414a-ae66-9a46260370f9 service nova] [instance: c555f971-b177-4c26-a38e-09e0e78bf7b9] No waiting events found dispatching network-vif-plugged-4ffb7229-16fb-441b-a954-d91308071fb8 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:11:44 user nova-compute[73572]: WARNING nova.compute.manager [req-7493762d-b94d-460e-8239-93e319fc3b74 req-b1e99297-266b-414a-ae66-9a46260370f9 service nova] [instance: c555f971-b177-4c26-a38e-09e0e78bf7b9] Received unexpected event network-vif-plugged-4ffb7229-16fb-441b-a954-d91308071fb8 for instance with vm_state active and task_state None.
Aug 26 10:11:44 user nova-compute[73572]: DEBUG nova.compute.manager [None req-b138e73f-947b-47be-9bec-df0aaf35f032 tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] [instance: 8ee427dc-7aa0-4435-b23c-1223f2881df7] Start spawning the instance on the hypervisor. {{(pid=73572) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 10:11:44 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-b138e73f-947b-47be-9bec-df0aaf35f032 tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] [instance: 8ee427dc-7aa0-4435-b23c-1223f2881df7] Creating instance directory {{(pid=73572) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 10:11:44 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-b138e73f-947b-47be-9bec-df0aaf35f032 tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] [instance: 8ee427dc-7aa0-4435-b23c-1223f2881df7] Creating image(s)
Aug 26 10:11:44 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-b138e73f-947b-47be-9bec-df0aaf35f032 tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] Acquiring lock "/opt/stack/data/nova/instances/8ee427dc-7aa0-4435-b23c-1223f2881df7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:11:44 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-b138e73f-947b-47be-9bec-df0aaf35f032 tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] Lock "/opt/stack/data/nova/instances/8ee427dc-7aa0-4435-b23c-1223f2881df7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:11:44 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-b138e73f-947b-47be-9bec-df0aaf35f032 tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] Lock "/opt/stack/data/nova/instances/8ee427dc-7aa0-4435-b23c-1223f2881df7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.012s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:11:44 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-b138e73f-947b-47be-9bec-df0aaf35f032 tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] Acquiring lock "b1630a0bd1f65b732f97e7fe5f0e33cb0595e9a3" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:11:44 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-b138e73f-947b-47be-9bec-df0aaf35f032 tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] Lock "b1630a0bd1f65b732f97e7fe5f0e33cb0595e9a3" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:11:45 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-b138e73f-947b-47be-9bec-df0aaf35f032 tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b1630a0bd1f65b732f97e7fe5f0e33cb0595e9a3.part --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:11:45 user nova-compute[73572]: DEBUG nova.network.neutron [req-0702afcc-40e7-4f9b-89e1-577d95075db3 req-ab837c0c-1def-4894-ad99-25b6851c7c26 service nova] [instance: ee9bcbaa-25a6-4588-b757-2a2ae15b6cf8] Updated VIF entry in instance network info cache for port f47d01ad-ade6-4b38-8b96-ea183c06134c. {{(pid=73572) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 10:11:45 user nova-compute[73572]: DEBUG nova.network.neutron [req-0702afcc-40e7-4f9b-89e1-577d95075db3 req-ab837c0c-1def-4894-ad99-25b6851c7c26 service nova] [instance: ee9bcbaa-25a6-4588-b757-2a2ae15b6cf8] Updating instance_info_cache with network_info: [{"id": "f47d01ad-ade6-4b38-8b96-ea183c06134c", "address": "fa:16:3e:f9:ca:45", "network": {"id": "529bb981-16ba-47c5-afb0-55f4aa577ecc", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-265382654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9898b65714845e7aea403cc39182df7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf47d01ad-ad", "ovs_interfaceid": "f47d01ad-ade6-4b38-8b96-ea183c06134c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:11:45 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-0702afcc-40e7-4f9b-89e1-577d95075db3 req-ab837c0c-1def-4894-ad99-25b6851c7c26 service nova] Releasing lock "refresh_cache-ee9bcbaa-25a6-4588-b757-2a2ae15b6cf8" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:11:45 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-b138e73f-947b-47be-9bec-df0aaf35f032 tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b1630a0bd1f65b732f97e7fe5f0e33cb0595e9a3.part --force-share --output=json" returned: 0 in 0.294s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:11:45 user nova-compute[73572]: DEBUG nova.virt.images [None req-b138e73f-947b-47be-9bec-df0aaf35f032 tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] 107ae528-7ed7-4368-95ed-9dc02ab31774 was qcow2, converting to raw {{(pid=73572) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 26 10:11:45 user nova-compute[73572]: DEBUG nova.privsep.utils [None req-b138e73f-947b-47be-9bec-df0aaf35f032 tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73572) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 26 10:11:45 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-b138e73f-947b-47be-9bec-df0aaf35f032 tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b1630a0bd1f65b732f97e7fe5f0e33cb0595e9a3.part /opt/stack/data/nova/instances/_base/b1630a0bd1f65b732f97e7fe5f0e33cb0595e9a3.converted {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:11:46 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:11:46 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-b138e73f-947b-47be-9bec-df0aaf35f032 tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b1630a0bd1f65b732f97e7fe5f0e33cb0595e9a3.part /opt/stack/data/nova/instances/_base/b1630a0bd1f65b732f97e7fe5f0e33cb0595e9a3.converted" returned: 0 in 0.324s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:11:46 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-b138e73f-947b-47be-9bec-df0aaf35f032 tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b1630a0bd1f65b732f97e7fe5f0e33cb0595e9a3.converted --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:11:46 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:11:46 user nova-compute[73572]: DEBUG nova.network.neutron [None req-b138e73f-947b-47be-9bec-df0aaf35f032 tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] [instance: 8ee427dc-7aa0-4435-b23c-1223f2881df7] Successfully created port: 4c3302a3-7301-4cac-b75a-64ca09965157 {{(pid=73572) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 10:11:46 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-b138e73f-947b-47be-9bec-df0aaf35f032 tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b1630a0bd1f65b732f97e7fe5f0e33cb0595e9a3.converted --force-share --output=json" returned: 0 in 0.364s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:11:46 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-b138e73f-947b-47be-9bec-df0aaf35f032 tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] Lock "b1630a0bd1f65b732f97e7fe5f0e33cb0595e9a3" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.702s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:11:46 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-b138e73f-947b-47be-9bec-df0aaf35f032 tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b1630a0bd1f65b732f97e7fe5f0e33cb0595e9a3 --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:11:46 user nova-compute[73572]: DEBUG nova.compute.manager [req-4338413a-0ea3-49ce-9025-7a9a4815dfc6 req-3b49b2d7-4091-4eb3-9593-3cf197639e9b service nova] [instance: c785b609-0068-442f-91f5-d26e888a993f] Received event network-vif-plugged-f01cdcf9-2430-4eb5-bb2d-3d126756dfc1 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:11:46 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-4338413a-0ea3-49ce-9025-7a9a4815dfc6 req-3b49b2d7-4091-4eb3-9593-3cf197639e9b service nova] Acquiring lock "c785b609-0068-442f-91f5-d26e888a993f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:11:46 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-4338413a-0ea3-49ce-9025-7a9a4815dfc6 req-3b49b2d7-4091-4eb3-9593-3cf197639e9b service nova] Lock "c785b609-0068-442f-91f5-d26e888a993f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:11:46 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-4338413a-0ea3-49ce-9025-7a9a4815dfc6 req-3b49b2d7-4091-4eb3-9593-3cf197639e9b service nova] Lock "c785b609-0068-442f-91f5-d26e888a993f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:11:46 user nova-compute[73572]: DEBUG nova.compute.manager [req-4338413a-0ea3-49ce-9025-7a9a4815dfc6 req-3b49b2d7-4091-4eb3-9593-3cf197639e9b service nova] [instance: c785b609-0068-442f-91f5-d26e888a993f] No waiting events found dispatching network-vif-plugged-f01cdcf9-2430-4eb5-bb2d-3d126756dfc1 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:11:46 user nova-compute[73572]: WARNING nova.compute.manager [req-4338413a-0ea3-49ce-9025-7a9a4815dfc6 req-3b49b2d7-4091-4eb3-9593-3cf197639e9b service nova] [instance: c785b609-0068-442f-91f5-d26e888a993f] Received unexpected event network-vif-plugged-f01cdcf9-2430-4eb5-bb2d-3d126756dfc1 for instance with vm_state active and task_state None.
Aug 26 10:11:46 user nova-compute[73572]: DEBUG nova.compute.manager [req-4338413a-0ea3-49ce-9025-7a9a4815dfc6 req-3b49b2d7-4091-4eb3-9593-3cf197639e9b service nova] [instance: 8302d6e7-aaf3-461c-a55e-f2e685d1800d] Received event network-vif-plugged-61c82fb7-2eee-4be0-a37f-669791ea6d9c {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:11:46 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-4338413a-0ea3-49ce-9025-7a9a4815dfc6 req-3b49b2d7-4091-4eb3-9593-3cf197639e9b service nova] Acquiring lock "8302d6e7-aaf3-461c-a55e-f2e685d1800d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:11:46 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-4338413a-0ea3-49ce-9025-7a9a4815dfc6 req-3b49b2d7-4091-4eb3-9593-3cf197639e9b service nova] Lock "8302d6e7-aaf3-461c-a55e-f2e685d1800d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:11:46 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-4338413a-0ea3-49ce-9025-7a9a4815dfc6 req-3b49b2d7-4091-4eb3-9593-3cf197639e9b service nova] Lock "8302d6e7-aaf3-461c-a55e-f2e685d1800d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:11:46 user nova-compute[73572]: DEBUG nova.compute.manager [req-4338413a-0ea3-49ce-9025-7a9a4815dfc6 req-3b49b2d7-4091-4eb3-9593-3cf197639e9b service nova] [instance: 8302d6e7-aaf3-461c-a55e-f2e685d1800d] No waiting events found dispatching network-vif-plugged-61c82fb7-2eee-4be0-a37f-669791ea6d9c {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:11:46 user nova-compute[73572]: WARNING nova.compute.manager [req-4338413a-0ea3-49ce-9025-7a9a4815dfc6 req-3b49b2d7-4091-4eb3-9593-3cf197639e9b service nova] [instance: 8302d6e7-aaf3-461c-a55e-f2e685d1800d] Received unexpected event network-vif-plugged-61c82fb7-2eee-4be0-a37f-669791ea6d9c for instance with vm_state active and task_state None.
Aug 26 10:11:46 user nova-compute[73572]: DEBUG nova.compute.manager [req-4338413a-0ea3-49ce-9025-7a9a4815dfc6 req-3b49b2d7-4091-4eb3-9593-3cf197639e9b service nova] [instance: 8302d6e7-aaf3-461c-a55e-f2e685d1800d] Received event network-vif-plugged-61c82fb7-2eee-4be0-a37f-669791ea6d9c {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:11:46 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-4338413a-0ea3-49ce-9025-7a9a4815dfc6 req-3b49b2d7-4091-4eb3-9593-3cf197639e9b service nova] Acquiring lock "8302d6e7-aaf3-461c-a55e-f2e685d1800d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:11:46 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-4338413a-0ea3-49ce-9025-7a9a4815dfc6 req-3b49b2d7-4091-4eb3-9593-3cf197639e9b service nova] Lock "8302d6e7-aaf3-461c-a55e-f2e685d1800d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:11:46 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-4338413a-0ea3-49ce-9025-7a9a4815dfc6 req-3b49b2d7-4091-4eb3-9593-3cf197639e9b service nova] Lock "8302d6e7-aaf3-461c-a55e-f2e685d1800d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:11:46 user nova-compute[73572]: DEBUG nova.compute.manager [req-4338413a-0ea3-49ce-9025-7a9a4815dfc6 req-3b49b2d7-4091-4eb3-9593-3cf197639e9b service nova] [instance: 8302d6e7-aaf3-461c-a55e-f2e685d1800d] No waiting events found dispatching network-vif-plugged-61c82fb7-2eee-4be0-a37f-669791ea6d9c {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:11:46 user nova-compute[73572]: WARNING nova.compute.manager [req-4338413a-0ea3-49ce-9025-7a9a4815dfc6 req-3b49b2d7-4091-4eb3-9593-3cf197639e9b service nova] [instance: 8302d6e7-aaf3-461c-a55e-f2e685d1800d] Received unexpected event network-vif-plugged-61c82fb7-2eee-4be0-a37f-669791ea6d9c for instance with vm_state active and task_state None.
Aug 26 10:11:46 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-b138e73f-947b-47be-9bec-df0aaf35f032 tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b1630a0bd1f65b732f97e7fe5f0e33cb0595e9a3 --force-share --output=json" returned: 0 in 0.332s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:11:46 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-b138e73f-947b-47be-9bec-df0aaf35f032 tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] Acquiring lock "b1630a0bd1f65b732f97e7fe5f0e33cb0595e9a3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:11:46 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-b138e73f-947b-47be-9bec-df0aaf35f032 tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] Lock "b1630a0bd1f65b732f97e7fe5f0e33cb0595e9a3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.006s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:11:46 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-b138e73f-947b-47be-9bec-df0aaf35f032 tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b1630a0bd1f65b732f97e7fe5f0e33cb0595e9a3 --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:11:47 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-b138e73f-947b-47be-9bec-df0aaf35f032 tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b1630a0bd1f65b732f97e7fe5f0e33cb0595e9a3 --force-share --output=json" returned: 0 in 0.289s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:11:47 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-b138e73f-947b-47be-9bec-df0aaf35f032 tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b1630a0bd1f65b732f97e7fe5f0e33cb0595e9a3,backing_fmt=raw /opt/stack/data/nova/instances/8ee427dc-7aa0-4435-b23c-1223f2881df7/disk 1073741824 {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:11:47 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-b138e73f-947b-47be-9bec-df0aaf35f032 tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b1630a0bd1f65b732f97e7fe5f0e33cb0595e9a3,backing_fmt=raw /opt/stack/data/nova/instances/8ee427dc-7aa0-4435-b23c-1223f2881df7/disk 1073741824" returned: 0 in 0.093s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:11:47 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-b138e73f-947b-47be-9bec-df0aaf35f032 tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] Lock "b1630a0bd1f65b732f97e7fe5f0e33cb0595e9a3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.392s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:11:47 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-b138e73f-947b-47be-9bec-df0aaf35f032 tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b1630a0bd1f65b732f97e7fe5f0e33cb0595e9a3 --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:11:47 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:11:47 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:11:47 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:11:47 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-b138e73f-947b-47be-9bec-df0aaf35f032 tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b1630a0bd1f65b732f97e7fe5f0e33cb0595e9a3 --force-share --output=json" returned: 0 in 0.306s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:11:47 user nova-compute[73572]: DEBUG nova.virt.disk.api [None req-b138e73f-947b-47be-9bec-df0aaf35f032 tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8ee427dc-7aa0-4435-b23c-1223f2881df7/disk. size=1073741824 {{(pid=73572) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 10:11:47 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-b138e73f-947b-47be-9bec-df0aaf35f032 tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ee427dc-7aa0-4435-b23c-1223f2881df7/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:11:47 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-b138e73f-947b-47be-9bec-df0aaf35f032 tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ee427dc-7aa0-4435-b23c-1223f2881df7/disk --force-share --output=json" returned: 0 in 0.255s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:11:47 user nova-compute[73572]: DEBUG nova.virt.disk.api [None req-b138e73f-947b-47be-9bec-df0aaf35f032 tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] Cannot resize image /opt/stack/data/nova/instances/8ee427dc-7aa0-4435-b23c-1223f2881df7/disk to a smaller size. {{(pid=73572) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 10:11:47 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-b138e73f-947b-47be-9bec-df0aaf35f032 tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] [instance: 8ee427dc-7aa0-4435-b23c-1223f2881df7] Created local disks {{(pid=73572) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 10:11:47 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-b138e73f-947b-47be-9bec-df0aaf35f032 tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] [instance: 8ee427dc-7aa0-4435-b23c-1223f2881df7] Ensure instance console log exists: /opt/stack/data/nova/instances/8ee427dc-7aa0-4435-b23c-1223f2881df7/console.log {{(pid=73572) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 10:11:47 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-b138e73f-947b-47be-9bec-df0aaf35f032 tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:11:47 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-b138e73f-947b-47be-9bec-df0aaf35f032 tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:11:47 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-b138e73f-947b-47be-9bec-df0aaf35f032 tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:11:48 user nova-compute[73572]: DEBUG nova.network.neutron [None req-b138e73f-947b-47be-9bec-df0aaf35f032 tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] [instance: 8ee427dc-7aa0-4435-b23c-1223f2881df7] Successfully updated port: 4c3302a3-7301-4cac-b75a-64ca09965157 {{(pid=73572) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 10:11:48 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-b138e73f-947b-47be-9bec-df0aaf35f032 tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] Acquiring lock "refresh_cache-8ee427dc-7aa0-4435-b23c-1223f2881df7" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:11:48 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-b138e73f-947b-47be-9bec-df0aaf35f032 tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] Acquired lock "refresh_cache-8ee427dc-7aa0-4435-b23c-1223f2881df7" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:11:48 user nova-compute[73572]: DEBUG nova.network.neutron [None req-b138e73f-947b-47be-9bec-df0aaf35f032 tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] [instance: 8ee427dc-7aa0-4435-b23c-1223f2881df7] Building network info cache for instance {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 10:11:48 user nova-compute[73572]: DEBUG nova.compute.manager [req-3eb09696-5d6e-40d5-b875-7c034f9e7f98 req-291ec905-4a15-4d5d-a06d-91a629c233f4 service nova] [instance: 8ee427dc-7aa0-4435-b23c-1223f2881df7] Received event network-changed-4c3302a3-7301-4cac-b75a-64ca09965157 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:11:48 user nova-compute[73572]: DEBUG nova.compute.manager [req-3eb09696-5d6e-40d5-b875-7c034f9e7f98 req-291ec905-4a15-4d5d-a06d-91a629c233f4 service nova] [instance: 8ee427dc-7aa0-4435-b23c-1223f2881df7] Refreshing instance network info cache due to event network-changed-4c3302a3-7301-4cac-b75a-64ca09965157. {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 10:11:48 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-3eb09696-5d6e-40d5-b875-7c034f9e7f98 req-291ec905-4a15-4d5d-a06d-91a629c233f4 service nova] Acquiring lock "refresh_cache-8ee427dc-7aa0-4435-b23c-1223f2881df7" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:11:48 user nova-compute[73572]: DEBUG nova.network.neutron [None req-b138e73f-947b-47be-9bec-df0aaf35f032 tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] [instance: 8ee427dc-7aa0-4435-b23c-1223f2881df7] Instance cache missing network info. {{(pid=73572) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 10:11:48 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:11:48 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:11:48 user nova-compute[73572]: DEBUG nova.compute.manager [req-ea593671-e18e-47b4-b5ce-d0407119fc93 req-88f5d6fe-0fc8-4ca0-afaa-62fbb7655ebc service nova] [instance: ee9bcbaa-25a6-4588-b757-2a2ae15b6cf8] Received event network-vif-plugged-f47d01ad-ade6-4b38-8b96-ea183c06134c {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:11:48 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-ea593671-e18e-47b4-b5ce-d0407119fc93 req-88f5d6fe-0fc8-4ca0-afaa-62fbb7655ebc service nova] Acquiring lock "ee9bcbaa-25a6-4588-b757-2a2ae15b6cf8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:11:48 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-ea593671-e18e-47b4-b5ce-d0407119fc93 req-88f5d6fe-0fc8-4ca0-afaa-62fbb7655ebc service nova] Lock "ee9bcbaa-25a6-4588-b757-2a2ae15b6cf8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:11:48 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-ea593671-e18e-47b4-b5ce-d0407119fc93 req-88f5d6fe-0fc8-4ca0-afaa-62fbb7655ebc service nova] Lock "ee9bcbaa-25a6-4588-b757-2a2ae15b6cf8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:11:48 user nova-compute[73572]: DEBUG nova.compute.manager [req-ea593671-e18e-47b4-b5ce-d0407119fc93 req-88f5d6fe-0fc8-4ca0-afaa-62fbb7655ebc service nova] [instance: ee9bcbaa-25a6-4588-b757-2a2ae15b6cf8] No waiting events found dispatching network-vif-plugged-f47d01ad-ade6-4b38-8b96-ea183c06134c {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:11:48 user nova-compute[73572]: WARNING nova.compute.manager [req-ea593671-e18e-47b4-b5ce-d0407119fc93 req-88f5d6fe-0fc8-4ca0-afaa-62fbb7655ebc service nova] [instance: ee9bcbaa-25a6-4588-b757-2a2ae15b6cf8] Received unexpected event network-vif-plugged-f47d01ad-ade6-4b38-8b96-ea183c06134c for instance with vm_state building and task_state spawning.
Aug 26 10:11:48 user nova-compute[73572]: DEBUG nova.compute.manager [req-ea593671-e18e-47b4-b5ce-d0407119fc93 req-88f5d6fe-0fc8-4ca0-afaa-62fbb7655ebc service nova] [instance: ee9bcbaa-25a6-4588-b757-2a2ae15b6cf8] Received event network-vif-plugged-f47d01ad-ade6-4b38-8b96-ea183c06134c {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:11:48 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-ea593671-e18e-47b4-b5ce-d0407119fc93 req-88f5d6fe-0fc8-4ca0-afaa-62fbb7655ebc service nova] Acquiring lock "ee9bcbaa-25a6-4588-b757-2a2ae15b6cf8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:11:48 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-ea593671-e18e-47b4-b5ce-d0407119fc93 req-88f5d6fe-0fc8-4ca0-afaa-62fbb7655ebc service nova] Lock "ee9bcbaa-25a6-4588-b757-2a2ae15b6cf8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:11:48 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-ea593671-e18e-47b4-b5ce-d0407119fc93 req-88f5d6fe-0fc8-4ca0-afaa-62fbb7655ebc service nova] Lock "ee9bcbaa-25a6-4588-b757-2a2ae15b6cf8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:11:48 user nova-compute[73572]: DEBUG nova.compute.manager [req-ea593671-e18e-47b4-b5ce-d0407119fc93 req-88f5d6fe-0fc8-4ca0-afaa-62fbb7655ebc service nova] [instance: ee9bcbaa-25a6-4588-b757-2a2ae15b6cf8] No waiting events found dispatching network-vif-plugged-f47d01ad-ade6-4b38-8b96-ea183c06134c {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:11:48 user nova-compute[73572]: WARNING nova.compute.manager [req-ea593671-e18e-47b4-b5ce-d0407119fc93 req-88f5d6fe-0fc8-4ca0-afaa-62fbb7655ebc service nova] [instance: ee9bcbaa-25a6-4588-b757-2a2ae15b6cf8] Received unexpected event network-vif-plugged-f47d01ad-ade6-4b38-8b96-ea183c06134c for instance with vm_state building and task_state spawning.
Aug 26 10:11:49 user nova-compute[73572]: DEBUG nova.compute.manager [None req-a36233cf-267a-41b0-a89a-1cd104e96613 tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] [instance: ee9bcbaa-25a6-4588-b757-2a2ae15b6cf8] Instance event wait completed in 0 seconds for  {{(pid=73572) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 10:11:49 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-a36233cf-267a-41b0-a89a-1cd104e96613 tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] [instance: ee9bcbaa-25a6-4588-b757-2a2ae15b6cf8] Guest created on hypervisor {{(pid=73572) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 10:11:49 user nova-compute[73572]: DEBUG nova.virt.driver [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Emitting event <LifecycleEvent: 1693044709.4631567, ee9bcbaa-25a6-4588-b757-2a2ae15b6cf8 => Resumed> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:11:49 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: ee9bcbaa-25a6-4588-b757-2a2ae15b6cf8] VM Resumed (Lifecycle Event)
Aug 26 10:11:49 user nova-compute[73572]: INFO nova.virt.libvirt.driver [-] [instance: ee9bcbaa-25a6-4588-b757-2a2ae15b6cf8] Instance spawned successfully.
Aug 26 10:11:49 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-a36233cf-267a-41b0-a89a-1cd104e96613 tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] [instance: ee9bcbaa-25a6-4588-b757-2a2ae15b6cf8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 10:11:49 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: ee9bcbaa-25a6-4588-b757-2a2ae15b6cf8] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:11:49 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-a36233cf-267a-41b0-a89a-1cd104e96613 tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] [instance: ee9bcbaa-25a6-4588-b757-2a2ae15b6cf8] Found default for hw_cdrom_bus of ide {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:11:49 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-a36233cf-267a-41b0-a89a-1cd104e96613 tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] [instance: ee9bcbaa-25a6-4588-b757-2a2ae15b6cf8] Found default for hw_disk_bus of virtio {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:11:49 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-a36233cf-267a-41b0-a89a-1cd104e96613 tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] [instance: ee9bcbaa-25a6-4588-b757-2a2ae15b6cf8] Found default for hw_input_bus of None {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:11:49 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-a36233cf-267a-41b0-a89a-1cd104e96613 tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] [instance: ee9bcbaa-25a6-4588-b757-2a2ae15b6cf8] Found default for hw_pointer_model of None {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:11:49 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-a36233cf-267a-41b0-a89a-1cd104e96613 tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] [instance: ee9bcbaa-25a6-4588-b757-2a2ae15b6cf8] Found default for hw_video_model of virtio {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:11:49 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-a36233cf-267a-41b0-a89a-1cd104e96613 tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] [instance: ee9bcbaa-25a6-4588-b757-2a2ae15b6cf8] Found default for hw_vif_model of virtio {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:11:49 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: ee9bcbaa-25a6-4588-b757-2a2ae15b6cf8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73572) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 10:11:49 user nova-compute[73572]: DEBUG nova.network.neutron [None req-b138e73f-947b-47be-9bec-df0aaf35f032 tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] [instance: 8ee427dc-7aa0-4435-b23c-1223f2881df7] Updating instance_info_cache with network_info: [{"id": "4c3302a3-7301-4cac-b75a-64ca09965157", "address": "fa:16:3e:07:ab:f2", "network": {"id": "c47deaf1-a2c4-4f19-8291-e9784568a77f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1615926461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9e9d7749db44598b91bc81e3d543b84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c3302a3-73", "ovs_interfaceid": "4c3302a3-7301-4cac-b75a-64ca09965157", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:11:49 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: ee9bcbaa-25a6-4588-b757-2a2ae15b6cf8] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 10:11:49 user nova-compute[73572]: DEBUG nova.virt.driver [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Emitting event <LifecycleEvent: 1693044709.4639916, ee9bcbaa-25a6-4588-b757-2a2ae15b6cf8 => Started> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:11:49 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: ee9bcbaa-25a6-4588-b757-2a2ae15b6cf8] VM Started (Lifecycle Event)
Aug 26 10:11:49 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:11:49 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-b138e73f-947b-47be-9bec-df0aaf35f032 tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] Releasing lock "refresh_cache-8ee427dc-7aa0-4435-b23c-1223f2881df7" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:11:49 user nova-compute[73572]: DEBUG nova.compute.manager [None req-b138e73f-947b-47be-9bec-df0aaf35f032 tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] [instance: 8ee427dc-7aa0-4435-b23c-1223f2881df7] Instance network_info: |[{"id": "4c3302a3-7301-4cac-b75a-64ca09965157", "address": "fa:16:3e:07:ab:f2", "network": {"id": "c47deaf1-a2c4-4f19-8291-e9784568a77f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1615926461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9e9d7749db44598b91bc81e3d543b84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c3302a3-73", "ovs_interfaceid": "4c3302a3-7301-4cac-b75a-64ca09965157", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73572) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 10:11:49 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-3eb09696-5d6e-40d5-b875-7c034f9e7f98 req-291ec905-4a15-4d5d-a06d-91a629c233f4 service nova] Acquired lock "refresh_cache-8ee427dc-7aa0-4435-b23c-1223f2881df7" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:11:49 user nova-compute[73572]: DEBUG nova.network.neutron [req-3eb09696-5d6e-40d5-b875-7c034f9e7f98 req-291ec905-4a15-4d5d-a06d-91a629c233f4 service nova] [instance: 8ee427dc-7aa0-4435-b23c-1223f2881df7] Refreshing network info cache for port 4c3302a3-7301-4cac-b75a-64ca09965157 {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 10:11:49 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-b138e73f-947b-47be-9bec-df0aaf35f032 tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] [instance: 8ee427dc-7aa0-4435-b23c-1223f2881df7] Start _get_guest_xml network_info=[{"id": "4c3302a3-7301-4cac-b75a-64ca09965157", "address": "fa:16:3e:07:ab:f2", "network": {"id": "c47deaf1-a2c4-4f19-8291-e9784568a77f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1615926461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9e9d7749db44598b91bc81e3d543b84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c3302a3-73", "ovs_interfaceid": "4c3302a3-7301-4cac-b75a-64ca09965157", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T10:11:32Z,direct_url=<?>,disk_format='qcow2',id=107ae528-7ed7-4368-95ed-9dc02ab31774,min_disk=0,min_ram=0,name='',owner='e1529d8edcb84b08bd626e41434da44e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T10:11:35Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'disk_bus': 'scsi', 'boot_index': 0, 'device_name': '/dev/sda', 'encrypted': False, 'guest_format': None, 'size': 0, 'encryption_format': None, 'device_type': 'disk', 'image_id': '107ae528-7ed7-4368-95ed-9dc02ab31774'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73572) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 10:11:49 user nova-compute[73572]: INFO nova.compute.manager [None req-a36233cf-267a-41b0-a89a-1cd104e96613 tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] [instance: ee9bcbaa-25a6-4588-b757-2a2ae15b6cf8] Took 11.08 seconds to spawn the instance on the hypervisor.
Aug 26 10:11:49 user nova-compute[73572]: DEBUG nova.compute.manager [None req-a36233cf-267a-41b0-a89a-1cd104e96613 tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] [instance: ee9bcbaa-25a6-4588-b757-2a2ae15b6cf8] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:11:49 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: ee9bcbaa-25a6-4588-b757-2a2ae15b6cf8] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:11:49 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-b138e73f-947b-47be-9bec-df0aaf35f032 tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:11:49 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-b138e73f-947b-47be-9bec-df0aaf35f032 tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:11:49 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-b138e73f-947b-47be-9bec-df0aaf35f032 tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73572) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 10:11:49 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-b138e73f-947b-47be-9bec-df0aaf35f032 tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] CPU controller missing on host. {{(pid=73572) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 10:11:49 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: ee9bcbaa-25a6-4588-b757-2a2ae15b6cf8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73572) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 10:11:49 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-b138e73f-947b-47be-9bec-df0aaf35f032 tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73572) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 10:11:49 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-b138e73f-947b-47be-9bec-df0aaf35f032 tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] CPU controller found on host. {{(pid=73572) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 10:11:49 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-b138e73f-947b-47be-9bec-df0aaf35f032 tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73572) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 10:11:49 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-b138e73f-947b-47be-9bec-df0aaf35f032 tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T10:07:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T10:11:32Z,direct_url=<?>,disk_format='qcow2',id=107ae528-7ed7-4368-95ed-9dc02ab31774,min_disk=0,min_ram=0,name='',owner='e1529d8edcb84b08bd626e41434da44e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T10:11:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 10:11:49 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-b138e73f-947b-47be-9bec-df0aaf35f032 tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] Flavor limits 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 10:11:49 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-b138e73f-947b-47be-9bec-df0aaf35f032 tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] Image limits 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 10:11:49 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-b138e73f-947b-47be-9bec-df0aaf35f032 tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] Flavor pref 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 10:11:49 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-b138e73f-947b-47be-9bec-df0aaf35f032 tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] Image pref 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 10:11:49 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-b138e73f-947b-47be-9bec-df0aaf35f032 tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 10:11:49 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-b138e73f-947b-47be-9bec-df0aaf35f032 tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 10:11:49 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-b138e73f-947b-47be-9bec-df0aaf35f032 tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73572) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 10:11:49 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-b138e73f-947b-47be-9bec-df0aaf35f032 tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] Got 1 possible topologies {{(pid=73572) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 10:11:49 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-b138e73f-947b-47be-9bec-df0aaf35f032 tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 10:11:49 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-b138e73f-947b-47be-9bec-df0aaf35f032 tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 10:11:49 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-b138e73f-947b-47be-9bec-df0aaf35f032 tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T10:11:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1306235019',display_name='tempest-AttachSCSIVolumeTestJSON-server-1306235019',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1306235019',id=6,image_ref='107ae528-7ed7-4368-95ed-9dc02ab31774',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBEtv1L64WyEnwYNfL+3NTg0gqRJFXYUc1zbYyRb1Jrc4J0PPg4IZHlNIchoGLdv9EoCx80ImIv/x5E6cbeQml8e0Mkc0X2yEz39VkOhCnHZ4QPaR3Aaf/zevKI78FBYUg==',key_name='tempest-keypair-899525953',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a9e9d7749db44598b91bc81e3d543b84',ramdisk_id='',reservation_id='r-88stocyg',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='107ae528-7ed7-4368-95ed-9dc02ab31774',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1697347357',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1697347357-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T10:11:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ada5dab545f244e38ed9ce5a23e84af7',uuid=8ee427dc-7aa0-4435-b23c-1223f2881df7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4c3302a3-7301-4cac-b75a-64ca09965157", "address": "fa:16:3e:07:ab:f2", "network": {"id": "c47deaf1-a2c4-4f19-8291-e9784568a77f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1615926461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9e9d7749db44598b91bc81e3d543b84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c3302a3-73", "ovs_interfaceid": "4c3302a3-7301-4cac-b75a-64ca09965157", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73572) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 10:11:49 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-b138e73f-947b-47be-9bec-df0aaf35f032 tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] Converting VIF {"id": "4c3302a3-7301-4cac-b75a-64ca09965157", "address": "fa:16:3e:07:ab:f2", "network": {"id": "c47deaf1-a2c4-4f19-8291-e9784568a77f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1615926461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9e9d7749db44598b91bc81e3d543b84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c3302a3-73", "ovs_interfaceid": "4c3302a3-7301-4cac-b75a-64ca09965157", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:11:49 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-b138e73f-947b-47be-9bec-df0aaf35f032 tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:ab:f2,bridge_name='br-int',has_traffic_filtering=True,id=4c3302a3-7301-4cac-b75a-64ca09965157,network=Network(c47deaf1-a2c4-4f19-8291-e9784568a77f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c3302a3-73') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:11:49 user nova-compute[73572]: DEBUG nova.objects.instance [None req-b138e73f-947b-47be-9bec-df0aaf35f032 tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] Lazy-loading 'pci_devices' on Instance uuid 8ee427dc-7aa0-4435-b23c-1223f2881df7 {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:11:49 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: ee9bcbaa-25a6-4588-b757-2a2ae15b6cf8] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 10:11:49 user nova-compute[73572]: INFO nova.compute.manager [None req-a36233cf-267a-41b0-a89a-1cd104e96613 tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] [instance: ee9bcbaa-25a6-4588-b757-2a2ae15b6cf8] Took 12.62 seconds to build instance.
Aug 26 10:11:49 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-b138e73f-947b-47be-9bec-df0aaf35f032 tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] [instance: 8ee427dc-7aa0-4435-b23c-1223f2881df7] End _get_guest_xml xml=<domain type="kvm">
Aug 26 10:11:49 user nova-compute[73572]:   <uuid>8ee427dc-7aa0-4435-b23c-1223f2881df7</uuid>
Aug 26 10:11:49 user nova-compute[73572]:   <name>instance-00000006</name>
Aug 26 10:11:49 user nova-compute[73572]:   <memory>524288</memory>
Aug 26 10:11:49 user nova-compute[73572]:   <vcpu>1</vcpu>
Aug 26 10:11:49 user nova-compute[73572]:   <metadata>
Aug 26 10:11:49 user nova-compute[73572]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 10:11:49 user nova-compute[73572]:       <nova:package version="0.0.0"/>
Aug 26 10:11:49 user nova-compute[73572]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-1306235019</nova:name>
Aug 26 10:11:49 user nova-compute[73572]:       <nova:creationTime>2023-08-26 10:11:49</nova:creationTime>
Aug 26 10:11:49 user nova-compute[73572]:       <nova:flavor name="m1.tiny">
Aug 26 10:11:49 user nova-compute[73572]:         <nova:memory>512</nova:memory>
Aug 26 10:11:49 user nova-compute[73572]:         <nova:disk>1</nova:disk>
Aug 26 10:11:49 user nova-compute[73572]:         <nova:swap>0</nova:swap>
Aug 26 10:11:49 user nova-compute[73572]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 10:11:49 user nova-compute[73572]:         <nova:vcpus>1</nova:vcpus>
Aug 26 10:11:49 user nova-compute[73572]:       </nova:flavor>
Aug 26 10:11:49 user nova-compute[73572]:       <nova:owner>
Aug 26 10:11:49 user nova-compute[73572]:         <nova:user uuid="ada5dab545f244e38ed9ce5a23e84af7">tempest-AttachSCSIVolumeTestJSON-1697347357-project-member</nova:user>
Aug 26 10:11:49 user nova-compute[73572]:         <nova:project uuid="a9e9d7749db44598b91bc81e3d543b84">tempest-AttachSCSIVolumeTestJSON-1697347357</nova:project>
Aug 26 10:11:49 user nova-compute[73572]:       </nova:owner>
Aug 26 10:11:49 user nova-compute[73572]:       <nova:root type="image" uuid="107ae528-7ed7-4368-95ed-9dc02ab31774"/>
Aug 26 10:11:49 user nova-compute[73572]:       <nova:ports>
Aug 26 10:11:49 user nova-compute[73572]:         <nova:port uuid="4c3302a3-7301-4cac-b75a-64ca09965157">
Aug 26 10:11:49 user nova-compute[73572]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 26 10:11:49 user nova-compute[73572]:         </nova:port>
Aug 26 10:11:49 user nova-compute[73572]:       </nova:ports>
Aug 26 10:11:49 user nova-compute[73572]:     </nova:instance>
Aug 26 10:11:49 user nova-compute[73572]:   </metadata>
Aug 26 10:11:49 user nova-compute[73572]:   <sysinfo type="smbios">
Aug 26 10:11:49 user nova-compute[73572]:     <system>
Aug 26 10:11:49 user nova-compute[73572]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 10:11:49 user nova-compute[73572]:       <entry name="product">OpenStack Nova</entry>
Aug 26 10:11:49 user nova-compute[73572]:       <entry name="version">0.0.0</entry>
Aug 26 10:11:49 user nova-compute[73572]:       <entry name="serial">8ee427dc-7aa0-4435-b23c-1223f2881df7</entry>
Aug 26 10:11:49 user nova-compute[73572]:       <entry name="uuid">8ee427dc-7aa0-4435-b23c-1223f2881df7</entry>
Aug 26 10:11:49 user nova-compute[73572]:       <entry name="family">Virtual Machine</entry>
Aug 26 10:11:49 user nova-compute[73572]:     </system>
Aug 26 10:11:49 user nova-compute[73572]:   </sysinfo>
Aug 26 10:11:49 user nova-compute[73572]:   <os>
Aug 26 10:11:49 user nova-compute[73572]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 10:11:49 user nova-compute[73572]:     <boot dev="hd"/>
Aug 26 10:11:49 user nova-compute[73572]:     <smbios mode="sysinfo"/>
Aug 26 10:11:49 user nova-compute[73572]:   </os>
Aug 26 10:11:49 user nova-compute[73572]:   <features>
Aug 26 10:11:49 user nova-compute[73572]:     <acpi/>
Aug 26 10:11:49 user nova-compute[73572]:     <apic/>
Aug 26 10:11:49 user nova-compute[73572]:     <vmcoreinfo/>
Aug 26 10:11:49 user nova-compute[73572]:   </features>
Aug 26 10:11:49 user nova-compute[73572]:   <clock offset="utc">
Aug 26 10:11:49 user nova-compute[73572]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 10:11:49 user nova-compute[73572]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 10:11:49 user nova-compute[73572]:     <timer name="hpet" present="no"/>
Aug 26 10:11:49 user nova-compute[73572]:   </clock>
Aug 26 10:11:49 user nova-compute[73572]:   <cpu mode="custom" match="exact">
Aug 26 10:11:49 user nova-compute[73572]:     <model>Nehalem</model>
Aug 26 10:11:49 user nova-compute[73572]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 10:11:49 user nova-compute[73572]:   </cpu>
Aug 26 10:11:49 user nova-compute[73572]:   <devices>
Aug 26 10:11:49 user nova-compute[73572]:     <disk type="file" device="disk">
Aug 26 10:11:49 user nova-compute[73572]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 10:11:49 user nova-compute[73572]:       <source file="/opt/stack/data/nova/instances/8ee427dc-7aa0-4435-b23c-1223f2881df7/disk"/>
Aug 26 10:11:49 user nova-compute[73572]:       <target dev="sda" bus="scsi"/>
Aug 26 10:11:49 user nova-compute[73572]:       <address type="drive" controller="0" unit="0"/>
Aug 26 10:11:49 user nova-compute[73572]:     </disk>
Aug 26 10:11:49 user nova-compute[73572]:     <disk type="file" device="cdrom">
Aug 26 10:11:49 user nova-compute[73572]:       <driver name="qemu" type="raw" cache="none"/>
Aug 26 10:11:49 user nova-compute[73572]:       <source file="/opt/stack/data/nova/instances/8ee427dc-7aa0-4435-b23c-1223f2881df7/disk.config"/>
Aug 26 10:11:49 user nova-compute[73572]:       <target dev="sdb" bus="scsi"/>
Aug 26 10:11:49 user nova-compute[73572]:       <address type="drive" controller="0" unit="1"/>
Aug 26 10:11:49 user nova-compute[73572]:     </disk>
Aug 26 10:11:49 user nova-compute[73572]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Aug 26 10:11:49 user nova-compute[73572]:     <interface type="ethernet">
Aug 26 10:11:49 user nova-compute[73572]:       <mac address="fa:16:3e:07:ab:f2"/>
Aug 26 10:11:49 user nova-compute[73572]:       <model type="virtio"/>
Aug 26 10:11:49 user nova-compute[73572]:       <mtu size="1442"/>
Aug 26 10:11:49 user nova-compute[73572]:       <target dev="tap4c3302a3-73"/>
Aug 26 10:11:49 user nova-compute[73572]:     </interface>
Aug 26 10:11:49 user nova-compute[73572]:     <serial type="pty">
Aug 26 10:11:49 user nova-compute[73572]:       <log file="/opt/stack/data/nova/instances/8ee427dc-7aa0-4435-b23c-1223f2881df7/console.log" append="off"/>
Aug 26 10:11:49 user nova-compute[73572]:     </serial>
Aug 26 10:11:49 user nova-compute[73572]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 10:11:49 user nova-compute[73572]:     <video>
Aug 26 10:11:49 user nova-compute[73572]:       <model type="virtio"/>
Aug 26 10:11:49 user nova-compute[73572]:     </video>
Aug 26 10:11:49 user nova-compute[73572]:     <rng model="virtio">
Aug 26 10:11:49 user nova-compute[73572]:       <backend model="random">/dev/urandom</backend>
Aug 26 10:11:49 user nova-compute[73572]:     </rng>
Aug 26 10:11:49 user nova-compute[73572]:     <controller type="usb" index="0" model="none"/>
Aug 26 10:11:49 user nova-compute[73572]:     <memballoon model="virtio">
Aug 26 10:11:49 user nova-compute[73572]:       <stats period="10"/>
Aug 26 10:11:49 user nova-compute[73572]:     </memballoon>
Aug 26 10:11:49 user nova-compute[73572]:   </devices>
Aug 26 10:11:49 user nova-compute[73572]: </domain>
Aug 26 10:11:49 user nova-compute[73572]:  {{(pid=73572) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 10:11:49 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-b138e73f-947b-47be-9bec-df0aaf35f032 tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T10:11:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1306235019',display_name='tempest-AttachSCSIVolumeTestJSON-server-1306235019',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1306235019',id=6,image_ref='107ae528-7ed7-4368-95ed-9dc02ab31774',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBEtv1L64WyEnwYNfL+3NTg0gqRJFXYUc1zbYyRb1Jrc4J0PPg4IZHlNIchoGLdv9EoCx80ImIv/x5E6cbeQml8e0Mkc0X2yEz39VkOhCnHZ4QPaR3Aaf/zevKI78FBYUg==',key_name='tempest-keypair-899525953',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a9e9d7749db44598b91bc81e3d543b84',ramdisk_id='',reservation_id='r-88stocyg',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='107ae528-7ed7-4368-95ed-9dc02ab31774',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1697347357',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1697347357-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T10:11:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ada5dab545f244e38ed9ce5a23e84af7',uuid=8ee427dc-7aa0-4435-b23c-1223f2881df7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4c3302a3-7301-4cac-b75a-64ca09965157", "address": "fa:16:3e:07:ab:f2", "network": {"id": "c47deaf1-a2c4-4f19-8291-e9784568a77f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1615926461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9e9d7749db44598b91bc81e3d543b84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c3302a3-73", "ovs_interfaceid": "4c3302a3-7301-4cac-b75a-64ca09965157", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 10:11:49 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-b138e73f-947b-47be-9bec-df0aaf35f032 tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] Converting VIF {"id": "4c3302a3-7301-4cac-b75a-64ca09965157", "address": "fa:16:3e:07:ab:f2", "network": {"id": "c47deaf1-a2c4-4f19-8291-e9784568a77f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1615926461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9e9d7749db44598b91bc81e3d543b84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c3302a3-73", "ovs_interfaceid": "4c3302a3-7301-4cac-b75a-64ca09965157", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:11:49 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-b138e73f-947b-47be-9bec-df0aaf35f032 tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:ab:f2,bridge_name='br-int',has_traffic_filtering=True,id=4c3302a3-7301-4cac-b75a-64ca09965157,network=Network(c47deaf1-a2c4-4f19-8291-e9784568a77f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c3302a3-73') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:11:49 user nova-compute[73572]: DEBUG os_vif [None req-b138e73f-947b-47be-9bec-df0aaf35f032 tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:ab:f2,bridge_name='br-int',has_traffic_filtering=True,id=4c3302a3-7301-4cac-b75a-64ca09965157,network=Network(c47deaf1-a2c4-4f19-8291-e9784568a77f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c3302a3-73') {{(pid=73572) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 10:11:49 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:11:49 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:11:49 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 10:11:49 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:11:49 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4c3302a3-73, may_exist=True, interface_attrs={}) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:11:49 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4c3302a3-73, col_values=(('external_ids', {'iface-id': '4c3302a3-7301-4cac-b75a-64ca09965157', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:07:ab:f2', 'vm-uuid': '8ee427dc-7aa0-4435-b23c-1223f2881df7'}),), if_exists=True) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:11:49 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:11:49 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-a36233cf-267a-41b0-a89a-1cd104e96613 tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] Lock "ee9bcbaa-25a6-4588-b757-2a2ae15b6cf8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.824s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:11:49 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:11:49 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:11:49 user nova-compute[73572]: INFO os_vif [None req-b138e73f-947b-47be-9bec-df0aaf35f032 tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:ab:f2,bridge_name='br-int',has_traffic_filtering=True,id=4c3302a3-7301-4cac-b75a-64ca09965157,network=Network(c47deaf1-a2c4-4f19-8291-e9784568a77f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c3302a3-73')
Aug 26 10:11:50 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-b138e73f-947b-47be-9bec-df0aaf35f032 tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] No BDM found with device name sda, not building metadata. {{(pid=73572) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 10:11:50 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-b138e73f-947b-47be-9bec-df0aaf35f032 tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] No BDM found with device name sdb, not building metadata. {{(pid=73572) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 10:11:50 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-b138e73f-947b-47be-9bec-df0aaf35f032 tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] No VIF found with MAC fa:16:3e:07:ab:f2, not building metadata {{(pid=73572) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 10:11:50 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-b138e73f-947b-47be-9bec-df0aaf35f032 tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] [instance: 8ee427dc-7aa0-4435-b23c-1223f2881df7] Using config drive
Aug 26 10:11:50 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-b138e73f-947b-47be-9bec-df0aaf35f032 tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] [instance: 8ee427dc-7aa0-4435-b23c-1223f2881df7] Creating config drive at /opt/stack/data/nova/instances/8ee427dc-7aa0-4435-b23c-1223f2881df7/disk.config
Aug 26 10:11:50 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-b138e73f-947b-47be-9bec-df0aaf35f032 tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/8ee427dc-7aa0-4435-b23c-1223f2881df7/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpy7fwcdq0 {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:11:50 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-b138e73f-947b-47be-9bec-df0aaf35f032 tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/8ee427dc-7aa0-4435-b23c-1223f2881df7/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpy7fwcdq0" returned: 0 in 0.062s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:11:50 user nova-compute[73572]: DEBUG nova.network.neutron [req-3eb09696-5d6e-40d5-b875-7c034f9e7f98 req-291ec905-4a15-4d5d-a06d-91a629c233f4 service nova] [instance: 8ee427dc-7aa0-4435-b23c-1223f2881df7] Updated VIF entry in instance network info cache for port 4c3302a3-7301-4cac-b75a-64ca09965157. {{(pid=73572) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 10:11:50 user nova-compute[73572]: DEBUG nova.network.neutron [req-3eb09696-5d6e-40d5-b875-7c034f9e7f98 req-291ec905-4a15-4d5d-a06d-91a629c233f4 service nova] [instance: 8ee427dc-7aa0-4435-b23c-1223f2881df7] Updating instance_info_cache with network_info: [{"id": "4c3302a3-7301-4cac-b75a-64ca09965157", "address": "fa:16:3e:07:ab:f2", "network": {"id": "c47deaf1-a2c4-4f19-8291-e9784568a77f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1615926461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9e9d7749db44598b91bc81e3d543b84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c3302a3-73", "ovs_interfaceid": "4c3302a3-7301-4cac-b75a-64ca09965157", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:11:50 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-3eb09696-5d6e-40d5-b875-7c034f9e7f98 req-291ec905-4a15-4d5d-a06d-91a629c233f4 service nova] Releasing lock "refresh_cache-8ee427dc-7aa0-4435-b23c-1223f2881df7" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:11:52 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-c8d13f3b-c8ab-4cb0-8e47-c638b9883e22 tempest-TestVolumeSwap-1919204229 tempest-TestVolumeSwap-1919204229-project-member] Acquiring lock "d2a731d2-13ff-49e5-ab17-80686b622df7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:11:52 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-c8d13f3b-c8ab-4cb0-8e47-c638b9883e22 tempest-TestVolumeSwap-1919204229 tempest-TestVolumeSwap-1919204229-project-member] Lock "d2a731d2-13ff-49e5-ab17-80686b622df7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:11:52 user nova-compute[73572]: DEBUG nova.compute.manager [None req-c8d13f3b-c8ab-4cb0-8e47-c638b9883e22 tempest-TestVolumeSwap-1919204229 tempest-TestVolumeSwap-1919204229-project-member] [instance: d2a731d2-13ff-49e5-ab17-80686b622df7] Starting instance... {{(pid=73572) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 10:11:52 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:11:52 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:11:52 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:11:52 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-c8d13f3b-c8ab-4cb0-8e47-c638b9883e22 tempest-TestVolumeSwap-1919204229 tempest-TestVolumeSwap-1919204229-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:11:52 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-c8d13f3b-c8ab-4cb0-8e47-c638b9883e22 tempest-TestVolumeSwap-1919204229 tempest-TestVolumeSwap-1919204229-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:11:52 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-c8d13f3b-c8ab-4cb0-8e47-c638b9883e22 tempest-TestVolumeSwap-1919204229 tempest-TestVolumeSwap-1919204229-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73572) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 10:11:52 user nova-compute[73572]: INFO nova.compute.claims [None req-c8d13f3b-c8ab-4cb0-8e47-c638b9883e22 tempest-TestVolumeSwap-1919204229 tempest-TestVolumeSwap-1919204229-project-member] [instance: d2a731d2-13ff-49e5-ab17-80686b622df7] Claim successful on node user
Aug 26 10:11:52 user nova-compute[73572]: DEBUG nova.compute.manager [req-f2d184b8-0577-45a4-a23f-b4603a7c2806 req-0ec3bebb-003d-40c7-b62b-ebad595d7d12 service nova] [instance: 8ee427dc-7aa0-4435-b23c-1223f2881df7] Received event network-vif-plugged-4c3302a3-7301-4cac-b75a-64ca09965157 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:11:52 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-f2d184b8-0577-45a4-a23f-b4603a7c2806 req-0ec3bebb-003d-40c7-b62b-ebad595d7d12 service nova] Acquiring lock "8ee427dc-7aa0-4435-b23c-1223f2881df7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:11:52 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-f2d184b8-0577-45a4-a23f-b4603a7c2806 req-0ec3bebb-003d-40c7-b62b-ebad595d7d12 service nova] Lock "8ee427dc-7aa0-4435-b23c-1223f2881df7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:11:52 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-f2d184b8-0577-45a4-a23f-b4603a7c2806 req-0ec3bebb-003d-40c7-b62b-ebad595d7d12 service nova] Lock "8ee427dc-7aa0-4435-b23c-1223f2881df7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:11:52 user nova-compute[73572]: DEBUG nova.compute.manager [req-f2d184b8-0577-45a4-a23f-b4603a7c2806 req-0ec3bebb-003d-40c7-b62b-ebad595d7d12 service nova] [instance: 8ee427dc-7aa0-4435-b23c-1223f2881df7] No waiting events found dispatching network-vif-plugged-4c3302a3-7301-4cac-b75a-64ca09965157 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:11:52 user nova-compute[73572]: WARNING nova.compute.manager [req-f2d184b8-0577-45a4-a23f-b4603a7c2806 req-0ec3bebb-003d-40c7-b62b-ebad595d7d12 service nova] [instance: 8ee427dc-7aa0-4435-b23c-1223f2881df7] Received unexpected event network-vif-plugged-4c3302a3-7301-4cac-b75a-64ca09965157 for instance with vm_state building and task_state spawning.
Aug 26 10:11:53 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:11:53 user nova-compute[73572]: DEBUG nova.compute.provider_tree [None req-c8d13f3b-c8ab-4cb0-8e47-c638b9883e22 tempest-TestVolumeSwap-1919204229 tempest-TestVolumeSwap-1919204229-project-member] Inventory has not changed in ProviderTree for provider: e2cec974-59b2-4c77-a53d-a7f4e5a30d75 {{(pid=73572) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 10:11:53 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-c8d13f3b-c8ab-4cb0-8e47-c638b9883e22 tempest-TestVolumeSwap-1919204229 tempest-TestVolumeSwap-1919204229-project-member] Inventory has not changed for provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73572) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 10:11:53 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:11:53 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-c8d13f3b-c8ab-4cb0-8e47-c638b9883e22 tempest-TestVolumeSwap-1919204229 tempest-TestVolumeSwap-1919204229-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.781s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:11:53 user nova-compute[73572]: DEBUG nova.compute.manager [None req-c8d13f3b-c8ab-4cb0-8e47-c638b9883e22 tempest-TestVolumeSwap-1919204229 tempest-TestVolumeSwap-1919204229-project-member] [instance: d2a731d2-13ff-49e5-ab17-80686b622df7] Start building networks asynchronously for instance. {{(pid=73572) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 10:11:53 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:11:53 user nova-compute[73572]: DEBUG nova.compute.manager [None req-c8d13f3b-c8ab-4cb0-8e47-c638b9883e22 tempest-TestVolumeSwap-1919204229 tempest-TestVolumeSwap-1919204229-project-member] [instance: d2a731d2-13ff-49e5-ab17-80686b622df7] Allocating IP information in the background. {{(pid=73572) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 10:11:53 user nova-compute[73572]: DEBUG nova.network.neutron [None req-c8d13f3b-c8ab-4cb0-8e47-c638b9883e22 tempest-TestVolumeSwap-1919204229 tempest-TestVolumeSwap-1919204229-project-member] [instance: d2a731d2-13ff-49e5-ab17-80686b622df7] allocate_for_instance() {{(pid=73572) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 10:11:53 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-c8d13f3b-c8ab-4cb0-8e47-c638b9883e22 tempest-TestVolumeSwap-1919204229 tempest-TestVolumeSwap-1919204229-project-member] [instance: d2a731d2-13ff-49e5-ab17-80686b622df7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 10:11:53 user nova-compute[73572]: DEBUG nova.compute.manager [None req-c8d13f3b-c8ab-4cb0-8e47-c638b9883e22 tempest-TestVolumeSwap-1919204229 tempest-TestVolumeSwap-1919204229-project-member] [instance: d2a731d2-13ff-49e5-ab17-80686b622df7] Start building block device mappings for instance. {{(pid=73572) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 10:11:53 user nova-compute[73572]: DEBUG nova.policy [None req-c8d13f3b-c8ab-4cb0-8e47-c638b9883e22 tempest-TestVolumeSwap-1919204229 tempest-TestVolumeSwap-1919204229-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e023f93a60c044f59c07bae3620f5811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '093a28613113447b87f3785c80906ba2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73572) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 10:11:53 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:11:53 user nova-compute[73572]: DEBUG nova.compute.manager [None req-c8d13f3b-c8ab-4cb0-8e47-c638b9883e22 tempest-TestVolumeSwap-1919204229 tempest-TestVolumeSwap-1919204229-project-member] [instance: d2a731d2-13ff-49e5-ab17-80686b622df7] Start spawning the instance on the hypervisor. {{(pid=73572) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 10:11:53 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-c8d13f3b-c8ab-4cb0-8e47-c638b9883e22 tempest-TestVolumeSwap-1919204229 tempest-TestVolumeSwap-1919204229-project-member] [instance: d2a731d2-13ff-49e5-ab17-80686b622df7] Creating instance directory {{(pid=73572) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 10:11:53 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-c8d13f3b-c8ab-4cb0-8e47-c638b9883e22 tempest-TestVolumeSwap-1919204229 tempest-TestVolumeSwap-1919204229-project-member] [instance: d2a731d2-13ff-49e5-ab17-80686b622df7] Creating image(s)
Aug 26 10:11:53 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-c8d13f3b-c8ab-4cb0-8e47-c638b9883e22 tempest-TestVolumeSwap-1919204229 tempest-TestVolumeSwap-1919204229-project-member] Acquiring lock "/opt/stack/data/nova/instances/d2a731d2-13ff-49e5-ab17-80686b622df7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:11:53 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-c8d13f3b-c8ab-4cb0-8e47-c638b9883e22 tempest-TestVolumeSwap-1919204229 tempest-TestVolumeSwap-1919204229-project-member] Lock "/opt/stack/data/nova/instances/d2a731d2-13ff-49e5-ab17-80686b622df7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:11:53 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-c8d13f3b-c8ab-4cb0-8e47-c638b9883e22 tempest-TestVolumeSwap-1919204229 tempest-TestVolumeSwap-1919204229-project-member] Lock "/opt/stack/data/nova/instances/d2a731d2-13ff-49e5-ab17-80686b622df7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:11:53 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-c8d13f3b-c8ab-4cb0-8e47-c638b9883e22 tempest-TestVolumeSwap-1919204229 tempest-TestVolumeSwap-1919204229-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:11:54 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-c8d13f3b-c8ab-4cb0-8e47-c638b9883e22 tempest-TestVolumeSwap-1919204229 tempest-TestVolumeSwap-1919204229-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json" returned: 0 in 0.272s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:11:54 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-c8d13f3b-c8ab-4cb0-8e47-c638b9883e22 tempest-TestVolumeSwap-1919204229 tempest-TestVolumeSwap-1919204229-project-member] Acquiring lock "2099350d6f3bcd0de9471c73862d4fe75b049801" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:11:54 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-c8d13f3b-c8ab-4cb0-8e47-c638b9883e22 tempest-TestVolumeSwap-1919204229 tempest-TestVolumeSwap-1919204229-project-member] Lock "2099350d6f3bcd0de9471c73862d4fe75b049801" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:11:54 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-c8d13f3b-c8ab-4cb0-8e47-c638b9883e22 tempest-TestVolumeSwap-1919204229 tempest-TestVolumeSwap-1919204229-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:11:54 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-c8d13f3b-c8ab-4cb0-8e47-c638b9883e22 tempest-TestVolumeSwap-1919204229 tempest-TestVolumeSwap-1919204229-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json" returned: 0 in 0.234s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:11:54 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-c8d13f3b-c8ab-4cb0-8e47-c638b9883e22 tempest-TestVolumeSwap-1919204229 tempest-TestVolumeSwap-1919204229-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801,backing_fmt=raw /opt/stack/data/nova/instances/d2a731d2-13ff-49e5-ab17-80686b622df7/disk 1073741824 {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:11:54 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:11:54 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-c8d13f3b-c8ab-4cb0-8e47-c638b9883e22 tempest-TestVolumeSwap-1919204229 tempest-TestVolumeSwap-1919204229-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801,backing_fmt=raw /opt/stack/data/nova/instances/d2a731d2-13ff-49e5-ab17-80686b622df7/disk 1073741824" returned: 0 in 0.079s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:11:54 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-c8d13f3b-c8ab-4cb0-8e47-c638b9883e22 tempest-TestVolumeSwap-1919204229 tempest-TestVolumeSwap-1919204229-project-member] Lock "2099350d6f3bcd0de9471c73862d4fe75b049801" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.318s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:11:54 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-c8d13f3b-c8ab-4cb0-8e47-c638b9883e22 tempest-TestVolumeSwap-1919204229 tempest-TestVolumeSwap-1919204229-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:11:54 user nova-compute[73572]: DEBUG nova.network.neutron [None req-c8d13f3b-c8ab-4cb0-8e47-c638b9883e22 tempest-TestVolumeSwap-1919204229 tempest-TestVolumeSwap-1919204229-project-member] [instance: d2a731d2-13ff-49e5-ab17-80686b622df7] Successfully created port: a07bf467-f02f-4889-b735-17df0d48853a {{(pid=73572) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 10:11:54 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-c8d13f3b-c8ab-4cb0-8e47-c638b9883e22 tempest-TestVolumeSwap-1919204229 tempest-TestVolumeSwap-1919204229-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json" returned: 0 in 0.191s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:11:54 user nova-compute[73572]: DEBUG nova.virt.disk.api [None req-c8d13f3b-c8ab-4cb0-8e47-c638b9883e22 tempest-TestVolumeSwap-1919204229 tempest-TestVolumeSwap-1919204229-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d2a731d2-13ff-49e5-ab17-80686b622df7/disk. size=1073741824 {{(pid=73572) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 10:11:54 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-c8d13f3b-c8ab-4cb0-8e47-c638b9883e22 tempest-TestVolumeSwap-1919204229 tempest-TestVolumeSwap-1919204229-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2a731d2-13ff-49e5-ab17-80686b622df7/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:11:54 user nova-compute[73572]: DEBUG nova.compute.manager [req-4625af23-c1b1-407b-86d4-338aa70550c9 req-37b9fe13-81e5-432a-81b0-a54415a2e1ff service nova] [instance: 8ee427dc-7aa0-4435-b23c-1223f2881df7] Received event network-vif-plugged-4c3302a3-7301-4cac-b75a-64ca09965157 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:11:54 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-4625af23-c1b1-407b-86d4-338aa70550c9 req-37b9fe13-81e5-432a-81b0-a54415a2e1ff service nova] Acquiring lock "8ee427dc-7aa0-4435-b23c-1223f2881df7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:11:54 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-4625af23-c1b1-407b-86d4-338aa70550c9 req-37b9fe13-81e5-432a-81b0-a54415a2e1ff service nova] Lock "8ee427dc-7aa0-4435-b23c-1223f2881df7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:11:54 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-4625af23-c1b1-407b-86d4-338aa70550c9 req-37b9fe13-81e5-432a-81b0-a54415a2e1ff service nova] Lock "8ee427dc-7aa0-4435-b23c-1223f2881df7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:11:54 user nova-compute[73572]: DEBUG nova.compute.manager [req-4625af23-c1b1-407b-86d4-338aa70550c9 req-37b9fe13-81e5-432a-81b0-a54415a2e1ff service nova] [instance: 8ee427dc-7aa0-4435-b23c-1223f2881df7] No waiting events found dispatching network-vif-plugged-4c3302a3-7301-4cac-b75a-64ca09965157 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:11:54 user nova-compute[73572]: WARNING nova.compute.manager [req-4625af23-c1b1-407b-86d4-338aa70550c9 req-37b9fe13-81e5-432a-81b0-a54415a2e1ff service nova] [instance: 8ee427dc-7aa0-4435-b23c-1223f2881df7] Received unexpected event network-vif-plugged-4c3302a3-7301-4cac-b75a-64ca09965157 for instance with vm_state building and task_state spawning.
Aug 26 10:11:54 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:11:54 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-c8d13f3b-c8ab-4cb0-8e47-c638b9883e22 tempest-TestVolumeSwap-1919204229 tempest-TestVolumeSwap-1919204229-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2a731d2-13ff-49e5-ab17-80686b622df7/disk --force-share --output=json" returned: 0 in 0.272s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:11:54 user nova-compute[73572]: DEBUG nova.virt.disk.api [None req-c8d13f3b-c8ab-4cb0-8e47-c638b9883e22 tempest-TestVolumeSwap-1919204229 tempest-TestVolumeSwap-1919204229-project-member] Cannot resize image /opt/stack/data/nova/instances/d2a731d2-13ff-49e5-ab17-80686b622df7/disk to a smaller size. {{(pid=73572) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 10:11:54 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-c8d13f3b-c8ab-4cb0-8e47-c638b9883e22 tempest-TestVolumeSwap-1919204229 tempest-TestVolumeSwap-1919204229-project-member] [instance: d2a731d2-13ff-49e5-ab17-80686b622df7] Created local disks {{(pid=73572) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 10:11:54 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-c8d13f3b-c8ab-4cb0-8e47-c638b9883e22 tempest-TestVolumeSwap-1919204229 tempest-TestVolumeSwap-1919204229-project-member] [instance: d2a731d2-13ff-49e5-ab17-80686b622df7] Ensure instance console log exists: /opt/stack/data/nova/instances/d2a731d2-13ff-49e5-ab17-80686b622df7/console.log {{(pid=73572) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 10:11:54 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-c8d13f3b-c8ab-4cb0-8e47-c638b9883e22 tempest-TestVolumeSwap-1919204229 tempest-TestVolumeSwap-1919204229-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:11:54 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-c8d13f3b-c8ab-4cb0-8e47-c638b9883e22 tempest-TestVolumeSwap-1919204229 tempest-TestVolumeSwap-1919204229-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:11:54 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-c8d13f3b-c8ab-4cb0-8e47-c638b9883e22 tempest-TestVolumeSwap-1919204229 tempest-TestVolumeSwap-1919204229-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:11:55 user nova-compute[73572]: DEBUG nova.compute.manager [None req-b138e73f-947b-47be-9bec-df0aaf35f032 tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] [instance: 8ee427dc-7aa0-4435-b23c-1223f2881df7] Instance event wait completed in 0 seconds for  {{(pid=73572) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 10:11:55 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-b138e73f-947b-47be-9bec-df0aaf35f032 tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] [instance: 8ee427dc-7aa0-4435-b23c-1223f2881df7] Guest created on hypervisor {{(pid=73572) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 10:11:55 user nova-compute[73572]: DEBUG nova.virt.driver [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Emitting event <LifecycleEvent: 1693044715.240063, 8ee427dc-7aa0-4435-b23c-1223f2881df7 => Resumed> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:11:55 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 8ee427dc-7aa0-4435-b23c-1223f2881df7] VM Resumed (Lifecycle Event)
Aug 26 10:11:55 user nova-compute[73572]: INFO nova.virt.libvirt.driver [-] [instance: 8ee427dc-7aa0-4435-b23c-1223f2881df7] Instance spawned successfully.
Aug 26 10:11:55 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-b138e73f-947b-47be-9bec-df0aaf35f032 tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] [instance: 8ee427dc-7aa0-4435-b23c-1223f2881df7] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 10:11:55 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-b138e73f-947b-47be-9bec-df0aaf35f032 tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] [instance: 8ee427dc-7aa0-4435-b23c-1223f2881df7] Found default for hw_input_bus of None {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:11:55 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-b138e73f-947b-47be-9bec-df0aaf35f032 tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] [instance: 8ee427dc-7aa0-4435-b23c-1223f2881df7] Found default for hw_pointer_model of None {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:11:55 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-b138e73f-947b-47be-9bec-df0aaf35f032 tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] [instance: 8ee427dc-7aa0-4435-b23c-1223f2881df7] Found default for hw_video_model of virtio {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:11:55 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-b138e73f-947b-47be-9bec-df0aaf35f032 tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] [instance: 8ee427dc-7aa0-4435-b23c-1223f2881df7] Found default for hw_vif_model of virtio {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:11:55 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 8ee427dc-7aa0-4435-b23c-1223f2881df7] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:11:55 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 8ee427dc-7aa0-4435-b23c-1223f2881df7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73572) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 10:11:55 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 8ee427dc-7aa0-4435-b23c-1223f2881df7] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 10:11:55 user nova-compute[73572]: DEBUG nova.virt.driver [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Emitting event <LifecycleEvent: 1693044715.2402835, 8ee427dc-7aa0-4435-b23c-1223f2881df7 => Started> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:11:55 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 8ee427dc-7aa0-4435-b23c-1223f2881df7] VM Started (Lifecycle Event)
Aug 26 10:11:55 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 8ee427dc-7aa0-4435-b23c-1223f2881df7] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:11:55 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 8ee427dc-7aa0-4435-b23c-1223f2881df7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73572) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 10:11:55 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 8ee427dc-7aa0-4435-b23c-1223f2881df7] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 10:11:55 user nova-compute[73572]: INFO nova.compute.manager [None req-b138e73f-947b-47be-9bec-df0aaf35f032 tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] [instance: 8ee427dc-7aa0-4435-b23c-1223f2881df7] Took 10.60 seconds to spawn the instance on the hypervisor.
Aug 26 10:11:55 user nova-compute[73572]: DEBUG nova.compute.manager [None req-b138e73f-947b-47be-9bec-df0aaf35f032 tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] [instance: 8ee427dc-7aa0-4435-b23c-1223f2881df7] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:11:55 user nova-compute[73572]: INFO nova.compute.manager [None req-b138e73f-947b-47be-9bec-df0aaf35f032 tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] [instance: 8ee427dc-7aa0-4435-b23c-1223f2881df7] Took 12.92 seconds to build instance.
Aug 26 10:11:55 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-b138e73f-947b-47be-9bec-df0aaf35f032 tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] Lock "8ee427dc-7aa0-4435-b23c-1223f2881df7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.185s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:11:55 user nova-compute[73572]: DEBUG nova.network.neutron [None req-c8d13f3b-c8ab-4cb0-8e47-c638b9883e22 tempest-TestVolumeSwap-1919204229 tempest-TestVolumeSwap-1919204229-project-member] [instance: d2a731d2-13ff-49e5-ab17-80686b622df7] Successfully updated port: a07bf467-f02f-4889-b735-17df0d48853a {{(pid=73572) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 10:11:55 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-c8d13f3b-c8ab-4cb0-8e47-c638b9883e22 tempest-TestVolumeSwap-1919204229 tempest-TestVolumeSwap-1919204229-project-member] Acquiring lock "refresh_cache-d2a731d2-13ff-49e5-ab17-80686b622df7" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:11:55 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-c8d13f3b-c8ab-4cb0-8e47-c638b9883e22 tempest-TestVolumeSwap-1919204229 tempest-TestVolumeSwap-1919204229-project-member] Acquired lock "refresh_cache-d2a731d2-13ff-49e5-ab17-80686b622df7" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:11:55 user nova-compute[73572]: DEBUG nova.network.neutron [None req-c8d13f3b-c8ab-4cb0-8e47-c638b9883e22 tempest-TestVolumeSwap-1919204229 tempest-TestVolumeSwap-1919204229-project-member] [instance: d2a731d2-13ff-49e5-ab17-80686b622df7] Building network info cache for instance {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 10:11:55 user nova-compute[73572]: DEBUG nova.compute.manager [req-2c28d153-da33-42ac-ac4d-ff5c9c489c1e req-fc2ef284-d915-4580-b7f8-c941f5c1ca8a service nova] [instance: d2a731d2-13ff-49e5-ab17-80686b622df7] Received event network-changed-a07bf467-f02f-4889-b735-17df0d48853a {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:11:55 user nova-compute[73572]: DEBUG nova.compute.manager [req-2c28d153-da33-42ac-ac4d-ff5c9c489c1e req-fc2ef284-d915-4580-b7f8-c941f5c1ca8a service nova] [instance: d2a731d2-13ff-49e5-ab17-80686b622df7] Refreshing instance network info cache due to event network-changed-a07bf467-f02f-4889-b735-17df0d48853a. {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 10:11:55 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-2c28d153-da33-42ac-ac4d-ff5c9c489c1e req-fc2ef284-d915-4580-b7f8-c941f5c1ca8a service nova] Acquiring lock "refresh_cache-d2a731d2-13ff-49e5-ab17-80686b622df7" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:11:55 user nova-compute[73572]: DEBUG nova.network.neutron [None req-c8d13f3b-c8ab-4cb0-8e47-c638b9883e22 tempest-TestVolumeSwap-1919204229 tempest-TestVolumeSwap-1919204229-project-member] [instance: d2a731d2-13ff-49e5-ab17-80686b622df7] Instance cache missing network info. {{(pid=73572) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 10:11:56 user nova-compute[73572]: DEBUG nova.network.neutron [None req-c8d13f3b-c8ab-4cb0-8e47-c638b9883e22 tempest-TestVolumeSwap-1919204229 tempest-TestVolumeSwap-1919204229-project-member] [instance: d2a731d2-13ff-49e5-ab17-80686b622df7] Updating instance_info_cache with network_info: [{"id": "a07bf467-f02f-4889-b735-17df0d48853a", "address": "fa:16:3e:2d:a2:9f", "network": {"id": "6881a14a-a8c8-47da-a205-a4958693640c", "bridge": "br-int", "label": "tempest-TestVolumeSwap-627208954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "093a28613113447b87f3785c80906ba2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa07bf467-f0", "ovs_interfaceid": "a07bf467-f02f-4889-b735-17df0d48853a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:11:56 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-c8d13f3b-c8ab-4cb0-8e47-c638b9883e22 tempest-TestVolumeSwap-1919204229 tempest-TestVolumeSwap-1919204229-project-member] Releasing lock "refresh_cache-d2a731d2-13ff-49e5-ab17-80686b622df7" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:11:56 user nova-compute[73572]: DEBUG nova.compute.manager [None req-c8d13f3b-c8ab-4cb0-8e47-c638b9883e22 tempest-TestVolumeSwap-1919204229 tempest-TestVolumeSwap-1919204229-project-member] [instance: d2a731d2-13ff-49e5-ab17-80686b622df7] Instance network_info: |[{"id": "a07bf467-f02f-4889-b735-17df0d48853a", "address": "fa:16:3e:2d:a2:9f", "network": {"id": "6881a14a-a8c8-47da-a205-a4958693640c", "bridge": "br-int", "label": "tempest-TestVolumeSwap-627208954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "093a28613113447b87f3785c80906ba2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa07bf467-f0", "ovs_interfaceid": "a07bf467-f02f-4889-b735-17df0d48853a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73572) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 10:11:56 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-2c28d153-da33-42ac-ac4d-ff5c9c489c1e req-fc2ef284-d915-4580-b7f8-c941f5c1ca8a service nova] Acquired lock "refresh_cache-d2a731d2-13ff-49e5-ab17-80686b622df7" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:11:56 user nova-compute[73572]: DEBUG nova.network.neutron [req-2c28d153-da33-42ac-ac4d-ff5c9c489c1e req-fc2ef284-d915-4580-b7f8-c941f5c1ca8a service nova] [instance: d2a731d2-13ff-49e5-ab17-80686b622df7] Refreshing network info cache for port a07bf467-f02f-4889-b735-17df0d48853a {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 10:11:56 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-c8d13f3b-c8ab-4cb0-8e47-c638b9883e22 tempest-TestVolumeSwap-1919204229 tempest-TestVolumeSwap-1919204229-project-member] [instance: d2a731d2-13ff-49e5-ab17-80686b622df7] Start _get_guest_xml network_info=[{"id": "a07bf467-f02f-4889-b735-17df0d48853a", "address": "fa:16:3e:2d:a2:9f", "network": {"id": "6881a14a-a8c8-47da-a205-a4958693640c", "bridge": "br-int", "label": "tempest-TestVolumeSwap-627208954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "093a28613113447b87f3785c80906ba2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa07bf467-f0", "ovs_interfaceid": "a07bf467-f02f-4889-b735-17df0d48853a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T10:07:33Z,direct_url=<?>,disk_format='qcow2',id=299da0c9-e1c4-48f0-be55-fbe20dd06bc9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5c995f8bbbab4368b67a253e0df3971a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T10:07:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'guest_format': None, 'size': 0, 'encryption_format': None, 'device_type': 'disk', 'image_id': '299da0c9-e1c4-48f0-be55-fbe20dd06bc9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73572) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 10:11:56 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-c8d13f3b-c8ab-4cb0-8e47-c638b9883e22 tempest-TestVolumeSwap-1919204229 tempest-TestVolumeSwap-1919204229-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:11:56 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-c8d13f3b-c8ab-4cb0-8e47-c638b9883e22 tempest-TestVolumeSwap-1919204229 tempest-TestVolumeSwap-1919204229-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:11:56 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-c8d13f3b-c8ab-4cb0-8e47-c638b9883e22 tempest-TestVolumeSwap-1919204229 tempest-TestVolumeSwap-1919204229-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73572) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 10:11:56 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-c8d13f3b-c8ab-4cb0-8e47-c638b9883e22 tempest-TestVolumeSwap-1919204229 tempest-TestVolumeSwap-1919204229-project-member] CPU controller missing on host. {{(pid=73572) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 10:11:56 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-c8d13f3b-c8ab-4cb0-8e47-c638b9883e22 tempest-TestVolumeSwap-1919204229 tempest-TestVolumeSwap-1919204229-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73572) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 10:11:56 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-c8d13f3b-c8ab-4cb0-8e47-c638b9883e22 tempest-TestVolumeSwap-1919204229 tempest-TestVolumeSwap-1919204229-project-member] CPU controller found on host. {{(pid=73572) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 10:11:56 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-c8d13f3b-c8ab-4cb0-8e47-c638b9883e22 tempest-TestVolumeSwap-1919204229 tempest-TestVolumeSwap-1919204229-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73572) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 10:11:56 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-c8d13f3b-c8ab-4cb0-8e47-c638b9883e22 tempest-TestVolumeSwap-1919204229 tempest-TestVolumeSwap-1919204229-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T10:07:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T10:07:33Z,direct_url=<?>,disk_format='qcow2',id=299da0c9-e1c4-48f0-be55-fbe20dd06bc9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5c995f8bbbab4368b67a253e0df3971a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T10:07:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 10:11:56 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-c8d13f3b-c8ab-4cb0-8e47-c638b9883e22 tempest-TestVolumeSwap-1919204229 tempest-TestVolumeSwap-1919204229-project-member] Flavor limits 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 10:11:56 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-c8d13f3b-c8ab-4cb0-8e47-c638b9883e22 tempest-TestVolumeSwap-1919204229 tempest-TestVolumeSwap-1919204229-project-member] Image limits 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 10:11:56 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-c8d13f3b-c8ab-4cb0-8e47-c638b9883e22 tempest-TestVolumeSwap-1919204229 tempest-TestVolumeSwap-1919204229-project-member] Flavor pref 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 10:11:56 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-c8d13f3b-c8ab-4cb0-8e47-c638b9883e22 tempest-TestVolumeSwap-1919204229 tempest-TestVolumeSwap-1919204229-project-member] Image pref 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 10:11:56 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-c8d13f3b-c8ab-4cb0-8e47-c638b9883e22 tempest-TestVolumeSwap-1919204229 tempest-TestVolumeSwap-1919204229-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 10:11:56 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-c8d13f3b-c8ab-4cb0-8e47-c638b9883e22 tempest-TestVolumeSwap-1919204229 tempest-TestVolumeSwap-1919204229-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 10:11:56 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-c8d13f3b-c8ab-4cb0-8e47-c638b9883e22 tempest-TestVolumeSwap-1919204229 tempest-TestVolumeSwap-1919204229-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73572) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 10:11:56 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-c8d13f3b-c8ab-4cb0-8e47-c638b9883e22 tempest-TestVolumeSwap-1919204229 tempest-TestVolumeSwap-1919204229-project-member] Got 1 possible topologies {{(pid=73572) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 10:11:56 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-c8d13f3b-c8ab-4cb0-8e47-c638b9883e22 tempest-TestVolumeSwap-1919204229 tempest-TestVolumeSwap-1919204229-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 10:11:56 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-c8d13f3b-c8ab-4cb0-8e47-c638b9883e22 tempest-TestVolumeSwap-1919204229 tempest-TestVolumeSwap-1919204229-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 10:11:56 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-c8d13f3b-c8ab-4cb0-8e47-c638b9883e22 tempest-TestVolumeSwap-1919204229 tempest-TestVolumeSwap-1919204229-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T10:11:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-585233066',display_name='tempest-TestVolumeSwap-server-585233066',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-585233066',id=7,image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE7lvVaX0yiXG8PU0mRk4tmslldd3pRCdHchcM8Dy1MMJT5OS7HQv09GGP6cHMbFsi7N7JpTFlII+BoiRglGxoR4O7mSR45WN111rHDSK/AfMIZcgfLhqTcecD+Z6jgexg==',key_name='tempest-keypair-1635714976',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='093a28613113447b87f3785c80906ba2',ramdisk_id='',reservation_id='r-a78ndj6e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1919204229',owner_user_name='tempest-TestVolumeSwap-1919204229-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T10:11:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e023f93a60c044f59c07bae3620f5811',uuid=d2a731d2-13ff-49e5-ab17-80686b622df7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a07bf467-f02f-4889-b735-17df0d48853a", "address": "fa:16:3e:2d:a2:9f", "network": {"id": "6881a14a-a8c8-47da-a205-a4958693640c", "bridge": "br-int", "label": "tempest-TestVolumeSwap-627208954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "093a28613113447b87f3785c80906ba2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa07bf467-f0", "ovs_interfaceid": "a07bf467-f02f-4889-b735-17df0d48853a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73572) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 10:11:56 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-c8d13f3b-c8ab-4cb0-8e47-c638b9883e22 tempest-TestVolumeSwap-1919204229 tempest-TestVolumeSwap-1919204229-project-member] Converting VIF {"id": "a07bf467-f02f-4889-b735-17df0d48853a", "address": "fa:16:3e:2d:a2:9f", "network": {"id": "6881a14a-a8c8-47da-a205-a4958693640c", "bridge": "br-int", "label": "tempest-TestVolumeSwap-627208954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "093a28613113447b87f3785c80906ba2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa07bf467-f0", "ovs_interfaceid": "a07bf467-f02f-4889-b735-17df0d48853a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:11:56 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-c8d13f3b-c8ab-4cb0-8e47-c638b9883e22 tempest-TestVolumeSwap-1919204229 tempest-TestVolumeSwap-1919204229-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:a2:9f,bridge_name='br-int',has_traffic_filtering=True,id=a07bf467-f02f-4889-b735-17df0d48853a,network=Network(6881a14a-a8c8-47da-a205-a4958693640c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa07bf467-f0') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:11:56 user nova-compute[73572]: DEBUG nova.objects.instance [None req-c8d13f3b-c8ab-4cb0-8e47-c638b9883e22 tempest-TestVolumeSwap-1919204229 tempest-TestVolumeSwap-1919204229-project-member] Lazy-loading 'pci_devices' on Instance uuid d2a731d2-13ff-49e5-ab17-80686b622df7 {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:11:56 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-c8d13f3b-c8ab-4cb0-8e47-c638b9883e22 tempest-TestVolumeSwap-1919204229 tempest-TestVolumeSwap-1919204229-project-member] [instance: d2a731d2-13ff-49e5-ab17-80686b622df7] End _get_guest_xml xml=<domain type="kvm">
Aug 26 10:11:56 user nova-compute[73572]:   <uuid>d2a731d2-13ff-49e5-ab17-80686b622df7</uuid>
Aug 26 10:11:56 user nova-compute[73572]:   <name>instance-00000007</name>
Aug 26 10:11:56 user nova-compute[73572]:   <memory>524288</memory>
Aug 26 10:11:56 user nova-compute[73572]:   <vcpu>1</vcpu>
Aug 26 10:11:56 user nova-compute[73572]:   <metadata>
Aug 26 10:11:56 user nova-compute[73572]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 10:11:56 user nova-compute[73572]:       <nova:package version="0.0.0"/>
Aug 26 10:11:56 user nova-compute[73572]:       <nova:name>tempest-TestVolumeSwap-server-585233066</nova:name>
Aug 26 10:11:56 user nova-compute[73572]:       <nova:creationTime>2023-08-26 10:11:56</nova:creationTime>
Aug 26 10:11:56 user nova-compute[73572]:       <nova:flavor name="m1.tiny">
Aug 26 10:11:56 user nova-compute[73572]:         <nova:memory>512</nova:memory>
Aug 26 10:11:56 user nova-compute[73572]:         <nova:disk>1</nova:disk>
Aug 26 10:11:56 user nova-compute[73572]:         <nova:swap>0</nova:swap>
Aug 26 10:11:56 user nova-compute[73572]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 10:11:56 user nova-compute[73572]:         <nova:vcpus>1</nova:vcpus>
Aug 26 10:11:56 user nova-compute[73572]:       </nova:flavor>
Aug 26 10:11:56 user nova-compute[73572]:       <nova:owner>
Aug 26 10:11:56 user nova-compute[73572]:         <nova:user uuid="e023f93a60c044f59c07bae3620f5811">tempest-TestVolumeSwap-1919204229-project-member</nova:user>
Aug 26 10:11:56 user nova-compute[73572]:         <nova:project uuid="093a28613113447b87f3785c80906ba2">tempest-TestVolumeSwap-1919204229</nova:project>
Aug 26 10:11:56 user nova-compute[73572]:       </nova:owner>
Aug 26 10:11:56 user nova-compute[73572]:       <nova:root type="image" uuid="299da0c9-e1c4-48f0-be55-fbe20dd06bc9"/>
Aug 26 10:11:56 user nova-compute[73572]:       <nova:ports>
Aug 26 10:11:56 user nova-compute[73572]:         <nova:port uuid="a07bf467-f02f-4889-b735-17df0d48853a">
Aug 26 10:11:56 user nova-compute[73572]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 26 10:11:56 user nova-compute[73572]:         </nova:port>
Aug 26 10:11:56 user nova-compute[73572]:       </nova:ports>
Aug 26 10:11:56 user nova-compute[73572]:     </nova:instance>
Aug 26 10:11:56 user nova-compute[73572]:   </metadata>
Aug 26 10:11:56 user nova-compute[73572]:   <sysinfo type="smbios">
Aug 26 10:11:56 user nova-compute[73572]:     <system>
Aug 26 10:11:56 user nova-compute[73572]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 10:11:56 user nova-compute[73572]:       <entry name="product">OpenStack Nova</entry>
Aug 26 10:11:56 user nova-compute[73572]:       <entry name="version">0.0.0</entry>
Aug 26 10:11:56 user nova-compute[73572]:       <entry name="serial">d2a731d2-13ff-49e5-ab17-80686b622df7</entry>
Aug 26 10:11:56 user nova-compute[73572]:       <entry name="uuid">d2a731d2-13ff-49e5-ab17-80686b622df7</entry>
Aug 26 10:11:56 user nova-compute[73572]:       <entry name="family">Virtual Machine</entry>
Aug 26 10:11:56 user nova-compute[73572]:     </system>
Aug 26 10:11:56 user nova-compute[73572]:   </sysinfo>
Aug 26 10:11:56 user nova-compute[73572]:   <os>
Aug 26 10:11:56 user nova-compute[73572]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 10:11:56 user nova-compute[73572]:     <boot dev="hd"/>
Aug 26 10:11:56 user nova-compute[73572]:     <smbios mode="sysinfo"/>
Aug 26 10:11:56 user nova-compute[73572]:   </os>
Aug 26 10:11:56 user nova-compute[73572]:   <features>
Aug 26 10:11:56 user nova-compute[73572]:     <acpi/>
Aug 26 10:11:56 user nova-compute[73572]:     <apic/>
Aug 26 10:11:56 user nova-compute[73572]:     <vmcoreinfo/>
Aug 26 10:11:56 user nova-compute[73572]:   </features>
Aug 26 10:11:56 user nova-compute[73572]:   <clock offset="utc">
Aug 26 10:11:56 user nova-compute[73572]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 10:11:56 user nova-compute[73572]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 10:11:56 user nova-compute[73572]:     <timer name="hpet" present="no"/>
Aug 26 10:11:56 user nova-compute[73572]:   </clock>
Aug 26 10:11:56 user nova-compute[73572]:   <cpu mode="custom" match="exact">
Aug 26 10:11:56 user nova-compute[73572]:     <model>Nehalem</model>
Aug 26 10:11:56 user nova-compute[73572]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 10:11:56 user nova-compute[73572]:   </cpu>
Aug 26 10:11:56 user nova-compute[73572]:   <devices>
Aug 26 10:11:56 user nova-compute[73572]:     <disk type="file" device="disk">
Aug 26 10:11:56 user nova-compute[73572]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 10:11:56 user nova-compute[73572]:       <source file="/opt/stack/data/nova/instances/d2a731d2-13ff-49e5-ab17-80686b622df7/disk"/>
Aug 26 10:11:56 user nova-compute[73572]:       <target dev="vda" bus="virtio"/>
Aug 26 10:11:56 user nova-compute[73572]:     </disk>
Aug 26 10:11:56 user nova-compute[73572]:     <interface type="ethernet">
Aug 26 10:11:56 user nova-compute[73572]:       <mac address="fa:16:3e:2d:a2:9f"/>
Aug 26 10:11:56 user nova-compute[73572]:       <model type="virtio"/>
Aug 26 10:11:56 user nova-compute[73572]:       <mtu size="1442"/>
Aug 26 10:11:56 user nova-compute[73572]:       <target dev="tapa07bf467-f0"/>
Aug 26 10:11:56 user nova-compute[73572]:     </interface>
Aug 26 10:11:56 user nova-compute[73572]:     <serial type="pty">
Aug 26 10:11:56 user nova-compute[73572]:       <log file="/opt/stack/data/nova/instances/d2a731d2-13ff-49e5-ab17-80686b622df7/console.log" append="off"/>
Aug 26 10:11:56 user nova-compute[73572]:     </serial>
Aug 26 10:11:56 user nova-compute[73572]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 10:11:56 user nova-compute[73572]:     <video>
Aug 26 10:11:56 user nova-compute[73572]:       <model type="virtio"/>
Aug 26 10:11:56 user nova-compute[73572]:     </video>
Aug 26 10:11:56 user nova-compute[73572]:     <rng model="virtio">
Aug 26 10:11:56 user nova-compute[73572]:       <backend model="random">/dev/urandom</backend>
Aug 26 10:11:56 user nova-compute[73572]:     </rng>
Aug 26 10:11:56 user nova-compute[73572]:     <controller type="usb" index="0" model="none"/>
Aug 26 10:11:56 user nova-compute[73572]:     <memballoon model="virtio">
Aug 26 10:11:56 user nova-compute[73572]:       <stats period="10"/>
Aug 26 10:11:56 user nova-compute[73572]:     </memballoon>
Aug 26 10:11:56 user nova-compute[73572]:   </devices>
Aug 26 10:11:56 user nova-compute[73572]: </domain>
Aug 26 10:11:56 user nova-compute[73572]:  {{(pid=73572) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 10:11:56 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-c8d13f3b-c8ab-4cb0-8e47-c638b9883e22 tempest-TestVolumeSwap-1919204229 tempest-TestVolumeSwap-1919204229-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T10:11:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-585233066',display_name='tempest-TestVolumeSwap-server-585233066',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-585233066',id=7,image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE7lvVaX0yiXG8PU0mRk4tmslldd3pRCdHchcM8Dy1MMJT5OS7HQv09GGP6cHMbFsi7N7JpTFlII+BoiRglGxoR4O7mSR45WN111rHDSK/AfMIZcgfLhqTcecD+Z6jgexg==',key_name='tempest-keypair-1635714976',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='093a28613113447b87f3785c80906ba2',ramdisk_id='',reservation_id='r-a78ndj6e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1919204229',owner_user_name='tempest-TestVolumeSwap-1919204229-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T10:11:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e023f93a60c044f59c07bae3620f5811',uuid=d2a731d2-13ff-49e5-ab17-80686b622df7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a07bf467-f02f-4889-b735-17df0d48853a", "address": "fa:16:3e:2d:a2:9f", "network": {"id": "6881a14a-a8c8-47da-a205-a4958693640c", "bridge": "br-int", "label": "tempest-TestVolumeSwap-627208954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "093a28613113447b87f3785c80906ba2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa07bf467-f0", "ovs_interfaceid": "a07bf467-f02f-4889-b735-17df0d48853a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 10:11:56 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-c8d13f3b-c8ab-4cb0-8e47-c638b9883e22 tempest-TestVolumeSwap-1919204229 tempest-TestVolumeSwap-1919204229-project-member] Converting VIF {"id": "a07bf467-f02f-4889-b735-17df0d48853a", "address": "fa:16:3e:2d:a2:9f", "network": {"id": "6881a14a-a8c8-47da-a205-a4958693640c", "bridge": "br-int", "label": "tempest-TestVolumeSwap-627208954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "093a28613113447b87f3785c80906ba2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa07bf467-f0", "ovs_interfaceid": "a07bf467-f02f-4889-b735-17df0d48853a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:11:56 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-c8d13f3b-c8ab-4cb0-8e47-c638b9883e22 tempest-TestVolumeSwap-1919204229 tempest-TestVolumeSwap-1919204229-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:a2:9f,bridge_name='br-int',has_traffic_filtering=True,id=a07bf467-f02f-4889-b735-17df0d48853a,network=Network(6881a14a-a8c8-47da-a205-a4958693640c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa07bf467-f0') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:11:56 user nova-compute[73572]: DEBUG os_vif [None req-c8d13f3b-c8ab-4cb0-8e47-c638b9883e22 tempest-TestVolumeSwap-1919204229 tempest-TestVolumeSwap-1919204229-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:a2:9f,bridge_name='br-int',has_traffic_filtering=True,id=a07bf467-f02f-4889-b735-17df0d48853a,network=Network(6881a14a-a8c8-47da-a205-a4958693640c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa07bf467-f0') {{(pid=73572) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 10:11:56 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:11:56 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:11:56 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 10:11:56 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:11:56 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa07bf467-f0, may_exist=True, interface_attrs={}) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:11:56 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa07bf467-f0, col_values=(('external_ids', {'iface-id': 'a07bf467-f02f-4889-b735-17df0d48853a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2d:a2:9f', 'vm-uuid': 'd2a731d2-13ff-49e5-ab17-80686b622df7'}),), if_exists=True) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:11:56 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:11:56 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:11:56 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:11:56 user nova-compute[73572]: INFO os_vif [None req-c8d13f3b-c8ab-4cb0-8e47-c638b9883e22 tempest-TestVolumeSwap-1919204229 tempest-TestVolumeSwap-1919204229-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:a2:9f,bridge_name='br-int',has_traffic_filtering=True,id=a07bf467-f02f-4889-b735-17df0d48853a,network=Network(6881a14a-a8c8-47da-a205-a4958693640c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa07bf467-f0')
Aug 26 10:11:56 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-c8d13f3b-c8ab-4cb0-8e47-c638b9883e22 tempest-TestVolumeSwap-1919204229 tempest-TestVolumeSwap-1919204229-project-member] No BDM found with device name vda, not building metadata. {{(pid=73572) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 10:11:56 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-c8d13f3b-c8ab-4cb0-8e47-c638b9883e22 tempest-TestVolumeSwap-1919204229 tempest-TestVolumeSwap-1919204229-project-member] No VIF found with MAC fa:16:3e:2d:a2:9f, not building metadata {{(pid=73572) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 10:11:56 user nova-compute[73572]: DEBUG nova.network.neutron [req-2c28d153-da33-42ac-ac4d-ff5c9c489c1e req-fc2ef284-d915-4580-b7f8-c941f5c1ca8a service nova] [instance: d2a731d2-13ff-49e5-ab17-80686b622df7] Updated VIF entry in instance network info cache for port a07bf467-f02f-4889-b735-17df0d48853a. {{(pid=73572) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 10:11:56 user nova-compute[73572]: DEBUG nova.network.neutron [req-2c28d153-da33-42ac-ac4d-ff5c9c489c1e req-fc2ef284-d915-4580-b7f8-c941f5c1ca8a service nova] [instance: d2a731d2-13ff-49e5-ab17-80686b622df7] Updating instance_info_cache with network_info: [{"id": "a07bf467-f02f-4889-b735-17df0d48853a", "address": "fa:16:3e:2d:a2:9f", "network": {"id": "6881a14a-a8c8-47da-a205-a4958693640c", "bridge": "br-int", "label": "tempest-TestVolumeSwap-627208954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "093a28613113447b87f3785c80906ba2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa07bf467-f0", "ovs_interfaceid": "a07bf467-f02f-4889-b735-17df0d48853a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:11:56 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-2c28d153-da33-42ac-ac4d-ff5c9c489c1e req-fc2ef284-d915-4580-b7f8-c941f5c1ca8a service nova] Releasing lock "refresh_cache-d2a731d2-13ff-49e5-ab17-80686b622df7" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:11:58 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:11:58 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:11:58 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:11:58 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:11:58 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:11:58 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:11:58 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:11:58 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:12:00 user nova-compute[73572]: DEBUG nova.virt.driver [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Emitting event <LifecycleEvent: 1693044720.6098588, d2a731d2-13ff-49e5-ab17-80686b622df7 => Resumed> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:12:00 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: d2a731d2-13ff-49e5-ab17-80686b622df7] VM Resumed (Lifecycle Event)
Aug 26 10:12:00 user nova-compute[73572]: DEBUG nova.compute.manager [None req-c8d13f3b-c8ab-4cb0-8e47-c638b9883e22 tempest-TestVolumeSwap-1919204229 tempest-TestVolumeSwap-1919204229-project-member] [instance: d2a731d2-13ff-49e5-ab17-80686b622df7] Instance event wait completed in 0 seconds for  {{(pid=73572) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 10:12:00 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-c8d13f3b-c8ab-4cb0-8e47-c638b9883e22 tempest-TestVolumeSwap-1919204229 tempest-TestVolumeSwap-1919204229-project-member] [instance: d2a731d2-13ff-49e5-ab17-80686b622df7] Guest created on hypervisor {{(pid=73572) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 10:12:00 user nova-compute[73572]: INFO nova.virt.libvirt.driver [-] [instance: d2a731d2-13ff-49e5-ab17-80686b622df7] Instance spawned successfully.
Aug 26 10:12:00 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-c8d13f3b-c8ab-4cb0-8e47-c638b9883e22 tempest-TestVolumeSwap-1919204229 tempest-TestVolumeSwap-1919204229-project-member] [instance: d2a731d2-13ff-49e5-ab17-80686b622df7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 10:12:00 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: d2a731d2-13ff-49e5-ab17-80686b622df7] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:12:00 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: d2a731d2-13ff-49e5-ab17-80686b622df7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73572) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 10:12:00 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-c8d13f3b-c8ab-4cb0-8e47-c638b9883e22 tempest-TestVolumeSwap-1919204229 tempest-TestVolumeSwap-1919204229-project-member] [instance: d2a731d2-13ff-49e5-ab17-80686b622df7] Found default for hw_cdrom_bus of ide {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:12:00 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-c8d13f3b-c8ab-4cb0-8e47-c638b9883e22 tempest-TestVolumeSwap-1919204229 tempest-TestVolumeSwap-1919204229-project-member] [instance: d2a731d2-13ff-49e5-ab17-80686b622df7] Found default for hw_disk_bus of virtio {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:12:00 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-c8d13f3b-c8ab-4cb0-8e47-c638b9883e22 tempest-TestVolumeSwap-1919204229 tempest-TestVolumeSwap-1919204229-project-member] [instance: d2a731d2-13ff-49e5-ab17-80686b622df7] Found default for hw_input_bus of None {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:12:00 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-c8d13f3b-c8ab-4cb0-8e47-c638b9883e22 tempest-TestVolumeSwap-1919204229 tempest-TestVolumeSwap-1919204229-project-member] [instance: d2a731d2-13ff-49e5-ab17-80686b622df7] Found default for hw_pointer_model of None {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:12:00 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-c8d13f3b-c8ab-4cb0-8e47-c638b9883e22 tempest-TestVolumeSwap-1919204229 tempest-TestVolumeSwap-1919204229-project-member] [instance: d2a731d2-13ff-49e5-ab17-80686b622df7] Found default for hw_video_model of virtio {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:12:00 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-c8d13f3b-c8ab-4cb0-8e47-c638b9883e22 tempest-TestVolumeSwap-1919204229 tempest-TestVolumeSwap-1919204229-project-member] [instance: d2a731d2-13ff-49e5-ab17-80686b622df7] Found default for hw_vif_model of virtio {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:12:00 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: d2a731d2-13ff-49e5-ab17-80686b622df7] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 10:12:00 user nova-compute[73572]: DEBUG nova.virt.driver [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Emitting event <LifecycleEvent: 1693044720.6200538, d2a731d2-13ff-49e5-ab17-80686b622df7 => Started> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:12:00 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: d2a731d2-13ff-49e5-ab17-80686b622df7] VM Started (Lifecycle Event)
Aug 26 10:12:00 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: d2a731d2-13ff-49e5-ab17-80686b622df7] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:12:00 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: d2a731d2-13ff-49e5-ab17-80686b622df7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73572) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 10:12:00 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: d2a731d2-13ff-49e5-ab17-80686b622df7] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 10:12:00 user nova-compute[73572]: INFO nova.compute.manager [None req-c8d13f3b-c8ab-4cb0-8e47-c638b9883e22 tempest-TestVolumeSwap-1919204229 tempest-TestVolumeSwap-1919204229-project-member] [instance: d2a731d2-13ff-49e5-ab17-80686b622df7] Took 6.95 seconds to spawn the instance on the hypervisor.
Aug 26 10:12:00 user nova-compute[73572]: DEBUG nova.compute.manager [None req-c8d13f3b-c8ab-4cb0-8e47-c638b9883e22 tempest-TestVolumeSwap-1919204229 tempest-TestVolumeSwap-1919204229-project-member] [instance: d2a731d2-13ff-49e5-ab17-80686b622df7] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:12:00 user nova-compute[73572]: INFO nova.compute.manager [None req-c8d13f3b-c8ab-4cb0-8e47-c638b9883e22 tempest-TestVolumeSwap-1919204229 tempest-TestVolumeSwap-1919204229-project-member] [instance: d2a731d2-13ff-49e5-ab17-80686b622df7] Took 8.32 seconds to build instance.
Aug 26 10:12:00 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-c8d13f3b-c8ab-4cb0-8e47-c638b9883e22 tempest-TestVolumeSwap-1919204229 tempest-TestVolumeSwap-1919204229-project-member] Lock "d2a731d2-13ff-49e5-ab17-80686b622df7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.624s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:12:01 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:12:03 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-54252728-5e1b-4820-a983-fc7cbd19c501 tempest-VolumesAssistedSnapshotsTest-660608201 tempest-VolumesAssistedSnapshotsTest-660608201-project-member] Acquiring lock "bc56542d-af1f-4313-8555-1b2014ff35e7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:12:03 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-54252728-5e1b-4820-a983-fc7cbd19c501 tempest-VolumesAssistedSnapshotsTest-660608201 tempest-VolumesAssistedSnapshotsTest-660608201-project-member] Lock "bc56542d-af1f-4313-8555-1b2014ff35e7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:12:03 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:12:03 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Starting heal instance info cache {{(pid=73572) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 10:12:03 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Rebuilding the list of instances to heal {{(pid=73572) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 10:12:03 user nova-compute[73572]: DEBUG nova.compute.manager [None req-54252728-5e1b-4820-a983-fc7cbd19c501 tempest-VolumesAssistedSnapshotsTest-660608201 tempest-VolumesAssistedSnapshotsTest-660608201-project-member] [instance: bc56542d-af1f-4313-8555-1b2014ff35e7] Starting instance... {{(pid=73572) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 10:12:03 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:12:03 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-54252728-5e1b-4820-a983-fc7cbd19c501 tempest-VolumesAssistedSnapshotsTest-660608201 tempest-VolumesAssistedSnapshotsTest-660608201-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:12:03 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-54252728-5e1b-4820-a983-fc7cbd19c501 tempest-VolumesAssistedSnapshotsTest-660608201 tempest-VolumesAssistedSnapshotsTest-660608201-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:12:03 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-54252728-5e1b-4820-a983-fc7cbd19c501 tempest-VolumesAssistedSnapshotsTest-660608201 tempest-VolumesAssistedSnapshotsTest-660608201-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73572) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 10:12:03 user nova-compute[73572]: INFO nova.compute.claims [None req-54252728-5e1b-4820-a983-fc7cbd19c501 tempest-VolumesAssistedSnapshotsTest-660608201 tempest-VolumesAssistedSnapshotsTest-660608201-project-member] [instance: bc56542d-af1f-4313-8555-1b2014ff35e7] Claim successful on node user
Aug 26 10:12:03 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquiring lock "refresh_cache-61b60a19-597e-4dc1-af0f-a0ec95e9fd24" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:12:03 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquired lock "refresh_cache-61b60a19-597e-4dc1-af0f-a0ec95e9fd24" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:12:03 user nova-compute[73572]: DEBUG nova.network.neutron [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] [instance: 61b60a19-597e-4dc1-af0f-a0ec95e9fd24] Forcefully refreshing network info cache for instance {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 10:12:03 user nova-compute[73572]: DEBUG nova.objects.instance [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lazy-loading 'info_cache' on Instance uuid 61b60a19-597e-4dc1-af0f-a0ec95e9fd24 {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:12:04 user nova-compute[73572]: DEBUG nova.compute.provider_tree [None req-54252728-5e1b-4820-a983-fc7cbd19c501 tempest-VolumesAssistedSnapshotsTest-660608201 tempest-VolumesAssistedSnapshotsTest-660608201-project-member] Inventory has not changed in ProviderTree for provider: e2cec974-59b2-4c77-a53d-a7f4e5a30d75 {{(pid=73572) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 10:12:04 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-54252728-5e1b-4820-a983-fc7cbd19c501 tempest-VolumesAssistedSnapshotsTest-660608201 tempest-VolumesAssistedSnapshotsTest-660608201-project-member] Inventory has not changed for provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73572) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 10:12:04 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-54252728-5e1b-4820-a983-fc7cbd19c501 tempest-VolumesAssistedSnapshotsTest-660608201 tempest-VolumesAssistedSnapshotsTest-660608201-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.638s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:12:04 user nova-compute[73572]: DEBUG nova.compute.manager [None req-54252728-5e1b-4820-a983-fc7cbd19c501 tempest-VolumesAssistedSnapshotsTest-660608201 tempest-VolumesAssistedSnapshotsTest-660608201-project-member] [instance: bc56542d-af1f-4313-8555-1b2014ff35e7] Start building networks asynchronously for instance. {{(pid=73572) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 10:12:04 user nova-compute[73572]: DEBUG nova.compute.manager [None req-54252728-5e1b-4820-a983-fc7cbd19c501 tempest-VolumesAssistedSnapshotsTest-660608201 tempest-VolumesAssistedSnapshotsTest-660608201-project-member] [instance: bc56542d-af1f-4313-8555-1b2014ff35e7] Allocating IP information in the background. {{(pid=73572) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 10:12:04 user nova-compute[73572]: DEBUG nova.network.neutron [None req-54252728-5e1b-4820-a983-fc7cbd19c501 tempest-VolumesAssistedSnapshotsTest-660608201 tempest-VolumesAssistedSnapshotsTest-660608201-project-member] [instance: bc56542d-af1f-4313-8555-1b2014ff35e7] allocate_for_instance() {{(pid=73572) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 10:12:04 user nova-compute[73572]: DEBUG nova.network.neutron [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] [instance: 61b60a19-597e-4dc1-af0f-a0ec95e9fd24] Updating instance_info_cache with network_info: [{"id": "f846939c-c22d-4e0c-9237-404eabf0abd4", "address": "fa:16:3e:46:77:5d", "network": {"id": "07a1c135-6593-4fe1-8020-305e2596db1d", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1106906776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5500e4b0418743abaeca3f853a4908c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf846939c-c2", "ovs_interfaceid": "f846939c-c22d-4e0c-9237-404eabf0abd4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:12:04 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-54252728-5e1b-4820-a983-fc7cbd19c501 tempest-VolumesAssistedSnapshotsTest-660608201 tempest-VolumesAssistedSnapshotsTest-660608201-project-member] [instance: bc56542d-af1f-4313-8555-1b2014ff35e7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 10:12:04 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Releasing lock "refresh_cache-61b60a19-597e-4dc1-af0f-a0ec95e9fd24" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:12:04 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] [instance: 61b60a19-597e-4dc1-af0f-a0ec95e9fd24] Updated the network info_cache for instance {{(pid=73572) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 10:12:04 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:12:04 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Cleaning up deleted instances {{(pid=73572) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 26 10:12:04 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] There are 0 instances to clean {{(pid=73572) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 26 10:12:04 user nova-compute[73572]: DEBUG nova.compute.manager [None req-54252728-5e1b-4820-a983-fc7cbd19c501 tempest-VolumesAssistedSnapshotsTest-660608201 tempest-VolumesAssistedSnapshotsTest-660608201-project-member] [instance: bc56542d-af1f-4313-8555-1b2014ff35e7] Start building block device mappings for instance. {{(pid=73572) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 10:12:04 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:12:04 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73572) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 26 10:12:04 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:12:04 user nova-compute[73572]: DEBUG nova.policy [None req-54252728-5e1b-4820-a983-fc7cbd19c501 tempest-VolumesAssistedSnapshotsTest-660608201 tempest-VolumesAssistedSnapshotsTest-660608201-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '14eb164e4e9540cf9b472033313b321f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233ee4c01bde4dae890bb3cf43348e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73572) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 10:12:04 user nova-compute[73572]: DEBUG nova.compute.manager [None req-54252728-5e1b-4820-a983-fc7cbd19c501 tempest-VolumesAssistedSnapshotsTest-660608201 tempest-VolumesAssistedSnapshotsTest-660608201-project-member] [instance: bc56542d-af1f-4313-8555-1b2014ff35e7] Start spawning the instance on the hypervisor. {{(pid=73572) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 10:12:04 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-54252728-5e1b-4820-a983-fc7cbd19c501 tempest-VolumesAssistedSnapshotsTest-660608201 tempest-VolumesAssistedSnapshotsTest-660608201-project-member] [instance: bc56542d-af1f-4313-8555-1b2014ff35e7] Creating instance directory {{(pid=73572) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 10:12:04 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-54252728-5e1b-4820-a983-fc7cbd19c501 tempest-VolumesAssistedSnapshotsTest-660608201 tempest-VolumesAssistedSnapshotsTest-660608201-project-member] [instance: bc56542d-af1f-4313-8555-1b2014ff35e7] Creating image(s)
Aug 26 10:12:04 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-54252728-5e1b-4820-a983-fc7cbd19c501 tempest-VolumesAssistedSnapshotsTest-660608201 tempest-VolumesAssistedSnapshotsTest-660608201-project-member] Acquiring lock "/opt/stack/data/nova/instances/bc56542d-af1f-4313-8555-1b2014ff35e7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:12:04 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-54252728-5e1b-4820-a983-fc7cbd19c501 tempest-VolumesAssistedSnapshotsTest-660608201 tempest-VolumesAssistedSnapshotsTest-660608201-project-member] Lock "/opt/stack/data/nova/instances/bc56542d-af1f-4313-8555-1b2014ff35e7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:12:04 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-54252728-5e1b-4820-a983-fc7cbd19c501 tempest-VolumesAssistedSnapshotsTest-660608201 tempest-VolumesAssistedSnapshotsTest-660608201-project-member] Lock "/opt/stack/data/nova/instances/bc56542d-af1f-4313-8555-1b2014ff35e7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:12:04 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-54252728-5e1b-4820-a983-fc7cbd19c501 tempest-VolumesAssistedSnapshotsTest-660608201 tempest-VolumesAssistedSnapshotsTest-660608201-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:12:05 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-54252728-5e1b-4820-a983-fc7cbd19c501 tempest-VolumesAssistedSnapshotsTest-660608201 tempest-VolumesAssistedSnapshotsTest-660608201-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json" returned: 0 in 0.230s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:12:05 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-54252728-5e1b-4820-a983-fc7cbd19c501 tempest-VolumesAssistedSnapshotsTest-660608201 tempest-VolumesAssistedSnapshotsTest-660608201-project-member] Acquiring lock "2099350d6f3bcd0de9471c73862d4fe75b049801" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:12:05 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-54252728-5e1b-4820-a983-fc7cbd19c501 tempest-VolumesAssistedSnapshotsTest-660608201 tempest-VolumesAssistedSnapshotsTest-660608201-project-member] Lock "2099350d6f3bcd0de9471c73862d4fe75b049801" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:12:05 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-54252728-5e1b-4820-a983-fc7cbd19c501 tempest-VolumesAssistedSnapshotsTest-660608201 tempest-VolumesAssistedSnapshotsTest-660608201-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:12:05 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-54252728-5e1b-4820-a983-fc7cbd19c501 tempest-VolumesAssistedSnapshotsTest-660608201 tempest-VolumesAssistedSnapshotsTest-660608201-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json" returned: 0 in 0.229s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:12:05 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-54252728-5e1b-4820-a983-fc7cbd19c501 tempest-VolumesAssistedSnapshotsTest-660608201 tempest-VolumesAssistedSnapshotsTest-660608201-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801,backing_fmt=raw /opt/stack/data/nova/instances/bc56542d-af1f-4313-8555-1b2014ff35e7/disk 1073741824 {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:12:05 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-54252728-5e1b-4820-a983-fc7cbd19c501 tempest-VolumesAssistedSnapshotsTest-660608201 tempest-VolumesAssistedSnapshotsTest-660608201-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801,backing_fmt=raw /opt/stack/data/nova/instances/bc56542d-af1f-4313-8555-1b2014ff35e7/disk 1073741824" returned: 0 in 0.056s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:12:05 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-54252728-5e1b-4820-a983-fc7cbd19c501 tempest-VolumesAssistedSnapshotsTest-660608201 tempest-VolumesAssistedSnapshotsTest-660608201-project-member] Lock "2099350d6f3bcd0de9471c73862d4fe75b049801" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.294s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:12:05 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-54252728-5e1b-4820-a983-fc7cbd19c501 tempest-VolumesAssistedSnapshotsTest-660608201 tempest-VolumesAssistedSnapshotsTest-660608201-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:12:05 user nova-compute[73572]: DEBUG nova.network.neutron [None req-54252728-5e1b-4820-a983-fc7cbd19c501 tempest-VolumesAssistedSnapshotsTest-660608201 tempest-VolumesAssistedSnapshotsTest-660608201-project-member] [instance: bc56542d-af1f-4313-8555-1b2014ff35e7] Successfully created port: cc3f2aa1-a2e9-4558-8bcd-d26216e82b37 {{(pid=73572) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 10:12:05 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-54252728-5e1b-4820-a983-fc7cbd19c501 tempest-VolumesAssistedSnapshotsTest-660608201 tempest-VolumesAssistedSnapshotsTest-660608201-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json" returned: 0 in 0.225s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:12:05 user nova-compute[73572]: DEBUG nova.virt.disk.api [None req-54252728-5e1b-4820-a983-fc7cbd19c501 tempest-VolumesAssistedSnapshotsTest-660608201 tempest-VolumesAssistedSnapshotsTest-660608201-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bc56542d-af1f-4313-8555-1b2014ff35e7/disk. size=1073741824 {{(pid=73572) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 10:12:05 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-54252728-5e1b-4820-a983-fc7cbd19c501 tempest-VolumesAssistedSnapshotsTest-660608201 tempest-VolumesAssistedSnapshotsTest-660608201-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc56542d-af1f-4313-8555-1b2014ff35e7/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:12:05 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-54252728-5e1b-4820-a983-fc7cbd19c501 tempest-VolumesAssistedSnapshotsTest-660608201 tempest-VolumesAssistedSnapshotsTest-660608201-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc56542d-af1f-4313-8555-1b2014ff35e7/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:12:05 user nova-compute[73572]: DEBUG nova.virt.disk.api [None req-54252728-5e1b-4820-a983-fc7cbd19c501 tempest-VolumesAssistedSnapshotsTest-660608201 tempest-VolumesAssistedSnapshotsTest-660608201-project-member] Cannot resize image /opt/stack/data/nova/instances/bc56542d-af1f-4313-8555-1b2014ff35e7/disk to a smaller size. {{(pid=73572) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 10:12:05 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-54252728-5e1b-4820-a983-fc7cbd19c501 tempest-VolumesAssistedSnapshotsTest-660608201 tempest-VolumesAssistedSnapshotsTest-660608201-project-member] [instance: bc56542d-af1f-4313-8555-1b2014ff35e7] Created local disks {{(pid=73572) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 10:12:05 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-54252728-5e1b-4820-a983-fc7cbd19c501 tempest-VolumesAssistedSnapshotsTest-660608201 tempest-VolumesAssistedSnapshotsTest-660608201-project-member] [instance: bc56542d-af1f-4313-8555-1b2014ff35e7] Ensure instance console log exists: /opt/stack/data/nova/instances/bc56542d-af1f-4313-8555-1b2014ff35e7/console.log {{(pid=73572) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 10:12:05 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-54252728-5e1b-4820-a983-fc7cbd19c501 tempest-VolumesAssistedSnapshotsTest-660608201 tempest-VolumesAssistedSnapshotsTest-660608201-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:12:05 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-54252728-5e1b-4820-a983-fc7cbd19c501 tempest-VolumesAssistedSnapshotsTest-660608201 tempest-VolumesAssistedSnapshotsTest-660608201-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:12:05 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-54252728-5e1b-4820-a983-fc7cbd19c501 tempest-VolumesAssistedSnapshotsTest-660608201 tempest-VolumesAssistedSnapshotsTest-660608201-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:12:06 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:12:06 user nova-compute[73572]: DEBUG nova.network.neutron [None req-54252728-5e1b-4820-a983-fc7cbd19c501 tempest-VolumesAssistedSnapshotsTest-660608201 tempest-VolumesAssistedSnapshotsTest-660608201-project-member] [instance: bc56542d-af1f-4313-8555-1b2014ff35e7] Successfully updated port: cc3f2aa1-a2e9-4558-8bcd-d26216e82b37 {{(pid=73572) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 10:12:06 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-54252728-5e1b-4820-a983-fc7cbd19c501 tempest-VolumesAssistedSnapshotsTest-660608201 tempest-VolumesAssistedSnapshotsTest-660608201-project-member] Acquiring lock "refresh_cache-bc56542d-af1f-4313-8555-1b2014ff35e7" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:12:06 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-54252728-5e1b-4820-a983-fc7cbd19c501 tempest-VolumesAssistedSnapshotsTest-660608201 tempest-VolumesAssistedSnapshotsTest-660608201-project-member] Acquired lock "refresh_cache-bc56542d-af1f-4313-8555-1b2014ff35e7" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:12:06 user nova-compute[73572]: DEBUG nova.network.neutron [None req-54252728-5e1b-4820-a983-fc7cbd19c501 tempest-VolumesAssistedSnapshotsTest-660608201 tempest-VolumesAssistedSnapshotsTest-660608201-project-member] [instance: bc56542d-af1f-4313-8555-1b2014ff35e7] Building network info cache for instance {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 10:12:06 user nova-compute[73572]: DEBUG nova.compute.manager [req-0ce7df34-aff9-4c93-b44b-6ff3c23f1765 req-0bea5ccd-96e7-455e-a0c4-9ee7b126071a service nova] [instance: bc56542d-af1f-4313-8555-1b2014ff35e7] Received event network-changed-cc3f2aa1-a2e9-4558-8bcd-d26216e82b37 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:12:06 user nova-compute[73572]: DEBUG nova.compute.manager [req-0ce7df34-aff9-4c93-b44b-6ff3c23f1765 req-0bea5ccd-96e7-455e-a0c4-9ee7b126071a service nova] [instance: bc56542d-af1f-4313-8555-1b2014ff35e7] Refreshing instance network info cache due to event network-changed-cc3f2aa1-a2e9-4558-8bcd-d26216e82b37. {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 10:12:06 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-0ce7df34-aff9-4c93-b44b-6ff3c23f1765 req-0bea5ccd-96e7-455e-a0c4-9ee7b126071a service nova] Acquiring lock "refresh_cache-bc56542d-af1f-4313-8555-1b2014ff35e7" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:12:06 user nova-compute[73572]: DEBUG nova.network.neutron [None req-54252728-5e1b-4820-a983-fc7cbd19c501 tempest-VolumesAssistedSnapshotsTest-660608201 tempest-VolumesAssistedSnapshotsTest-660608201-project-member] [instance: bc56542d-af1f-4313-8555-1b2014ff35e7] Instance cache missing network info. {{(pid=73572) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 10:12:06 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:12:06 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:12:06 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:12:06 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73572) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 10:12:07 user nova-compute[73572]: DEBUG nova.network.neutron [None req-54252728-5e1b-4820-a983-fc7cbd19c501 tempest-VolumesAssistedSnapshotsTest-660608201 tempest-VolumesAssistedSnapshotsTest-660608201-project-member] [instance: bc56542d-af1f-4313-8555-1b2014ff35e7] Updating instance_info_cache with network_info: [{"id": "cc3f2aa1-a2e9-4558-8bcd-d26216e82b37", "address": "fa:16:3e:72:9b:7b", "network": {"id": "f44b02ba-9d68-4e71-8b33-e9596581cc5b", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-996168907-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "233ee4c01bde4dae890bb3cf43348e2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc3f2aa1-a2", "ovs_interfaceid": "cc3f2aa1-a2e9-4558-8bcd-d26216e82b37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:12:07 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-54252728-5e1b-4820-a983-fc7cbd19c501 tempest-VolumesAssistedSnapshotsTest-660608201 tempest-VolumesAssistedSnapshotsTest-660608201-project-member] Releasing lock "refresh_cache-bc56542d-af1f-4313-8555-1b2014ff35e7" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:12:07 user nova-compute[73572]: DEBUG nova.compute.manager [None req-54252728-5e1b-4820-a983-fc7cbd19c501 tempest-VolumesAssistedSnapshotsTest-660608201 tempest-VolumesAssistedSnapshotsTest-660608201-project-member] [instance: bc56542d-af1f-4313-8555-1b2014ff35e7] Instance network_info: |[{"id": "cc3f2aa1-a2e9-4558-8bcd-d26216e82b37", "address": "fa:16:3e:72:9b:7b", "network": {"id": "f44b02ba-9d68-4e71-8b33-e9596581cc5b", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-996168907-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "233ee4c01bde4dae890bb3cf43348e2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc3f2aa1-a2", "ovs_interfaceid": "cc3f2aa1-a2e9-4558-8bcd-d26216e82b37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73572) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 10:12:07 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-0ce7df34-aff9-4c93-b44b-6ff3c23f1765 req-0bea5ccd-96e7-455e-a0c4-9ee7b126071a service nova] Acquired lock "refresh_cache-bc56542d-af1f-4313-8555-1b2014ff35e7" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:12:07 user nova-compute[73572]: DEBUG nova.network.neutron [req-0ce7df34-aff9-4c93-b44b-6ff3c23f1765 req-0bea5ccd-96e7-455e-a0c4-9ee7b126071a service nova] [instance: bc56542d-af1f-4313-8555-1b2014ff35e7] Refreshing network info cache for port cc3f2aa1-a2e9-4558-8bcd-d26216e82b37 {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 10:12:07 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-54252728-5e1b-4820-a983-fc7cbd19c501 tempest-VolumesAssistedSnapshotsTest-660608201 tempest-VolumesAssistedSnapshotsTest-660608201-project-member] [instance: bc56542d-af1f-4313-8555-1b2014ff35e7] Start _get_guest_xml network_info=[{"id": "cc3f2aa1-a2e9-4558-8bcd-d26216e82b37", "address": "fa:16:3e:72:9b:7b", "network": {"id": "f44b02ba-9d68-4e71-8b33-e9596581cc5b", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-996168907-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "233ee4c01bde4dae890bb3cf43348e2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc3f2aa1-a2", "ovs_interfaceid": "cc3f2aa1-a2e9-4558-8bcd-d26216e82b37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T10:07:33Z,direct_url=<?>,disk_format='qcow2',id=299da0c9-e1c4-48f0-be55-fbe20dd06bc9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5c995f8bbbab4368b67a253e0df3971a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T10:07:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'guest_format': None, 'size': 0, 'encryption_format': None, 'device_type': 'disk', 'image_id': '299da0c9-e1c4-48f0-be55-fbe20dd06bc9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73572) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 10:12:07 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-54252728-5e1b-4820-a983-fc7cbd19c501 tempest-VolumesAssistedSnapshotsTest-660608201 tempest-VolumesAssistedSnapshotsTest-660608201-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:12:07 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-54252728-5e1b-4820-a983-fc7cbd19c501 tempest-VolumesAssistedSnapshotsTest-660608201 tempest-VolumesAssistedSnapshotsTest-660608201-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:12:07 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-54252728-5e1b-4820-a983-fc7cbd19c501 tempest-VolumesAssistedSnapshotsTest-660608201 tempest-VolumesAssistedSnapshotsTest-660608201-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73572) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 10:12:07 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-54252728-5e1b-4820-a983-fc7cbd19c501 tempest-VolumesAssistedSnapshotsTest-660608201 tempest-VolumesAssistedSnapshotsTest-660608201-project-member] CPU controller missing on host. {{(pid=73572) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 10:12:07 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-54252728-5e1b-4820-a983-fc7cbd19c501 tempest-VolumesAssistedSnapshotsTest-660608201 tempest-VolumesAssistedSnapshotsTest-660608201-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73572) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 10:12:07 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-54252728-5e1b-4820-a983-fc7cbd19c501 tempest-VolumesAssistedSnapshotsTest-660608201 tempest-VolumesAssistedSnapshotsTest-660608201-project-member] CPU controller found on host. {{(pid=73572) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 10:12:07 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-54252728-5e1b-4820-a983-fc7cbd19c501 tempest-VolumesAssistedSnapshotsTest-660608201 tempest-VolumesAssistedSnapshotsTest-660608201-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73572) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 10:12:07 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-54252728-5e1b-4820-a983-fc7cbd19c501 tempest-VolumesAssistedSnapshotsTest-660608201 tempest-VolumesAssistedSnapshotsTest-660608201-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T10:07:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T10:07:33Z,direct_url=<?>,disk_format='qcow2',id=299da0c9-e1c4-48f0-be55-fbe20dd06bc9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5c995f8bbbab4368b67a253e0df3971a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T10:07:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 10:12:07 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-54252728-5e1b-4820-a983-fc7cbd19c501 tempest-VolumesAssistedSnapshotsTest-660608201 tempest-VolumesAssistedSnapshotsTest-660608201-project-member] Flavor limits 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 10:12:07 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-54252728-5e1b-4820-a983-fc7cbd19c501 tempest-VolumesAssistedSnapshotsTest-660608201 tempest-VolumesAssistedSnapshotsTest-660608201-project-member] Image limits 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 10:12:07 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-54252728-5e1b-4820-a983-fc7cbd19c501 tempest-VolumesAssistedSnapshotsTest-660608201 tempest-VolumesAssistedSnapshotsTest-660608201-project-member] Flavor pref 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 10:12:07 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-54252728-5e1b-4820-a983-fc7cbd19c501 tempest-VolumesAssistedSnapshotsTest-660608201 tempest-VolumesAssistedSnapshotsTest-660608201-project-member] Image pref 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 10:12:07 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-54252728-5e1b-4820-a983-fc7cbd19c501 tempest-VolumesAssistedSnapshotsTest-660608201 tempest-VolumesAssistedSnapshotsTest-660608201-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 10:12:07 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-54252728-5e1b-4820-a983-fc7cbd19c501 tempest-VolumesAssistedSnapshotsTest-660608201 tempest-VolumesAssistedSnapshotsTest-660608201-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 10:12:07 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-54252728-5e1b-4820-a983-fc7cbd19c501 tempest-VolumesAssistedSnapshotsTest-660608201 tempest-VolumesAssistedSnapshotsTest-660608201-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73572) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 10:12:07 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-54252728-5e1b-4820-a983-fc7cbd19c501 tempest-VolumesAssistedSnapshotsTest-660608201 tempest-VolumesAssistedSnapshotsTest-660608201-project-member] Got 1 possible topologies {{(pid=73572) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 10:12:07 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-54252728-5e1b-4820-a983-fc7cbd19c501 tempest-VolumesAssistedSnapshotsTest-660608201 tempest-VolumesAssistedSnapshotsTest-660608201-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 10:12:07 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-54252728-5e1b-4820-a983-fc7cbd19c501 tempest-VolumesAssistedSnapshotsTest-660608201 tempest-VolumesAssistedSnapshotsTest-660608201-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 10:12:07 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-54252728-5e1b-4820-a983-fc7cbd19c501 tempest-VolumesAssistedSnapshotsTest-660608201 tempest-VolumesAssistedSnapshotsTest-660608201-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T10:12:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1463926599',display_name='tempest-VolumesAssistedSnapshotsTest-server-1463926599',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1463926599',id=8,image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO59clm+UeS+lSWO5m6hxgTc/vT1Dkw3E1n4U7V2cakRQ9jZyba5XfdE5JtxxprQuirUZeZ/koZSYgvKPvoo0C+8Fgt1XijaGVbE6tKhetRQFB8EdEwrDkJMJlNvTpNpAA==',key_name='tempest-keypair-1194946091',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='233ee4c01bde4dae890bb3cf43348e2d',ramdisk_id='',reservation_id='r-wxcoz1z8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-660608201',owner_user_name='tempest-VolumesAssistedSnapshotsTest-660608201-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T10:12:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='14eb164e4e9540cf9b472033313b321f',uuid=bc56542d-af1f-4313-8555-1b2014ff35e7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cc3f2aa1-a2e9-4558-8bcd-d26216e82b37", "address": "fa:16:3e:72:9b:7b", "network": {"id": "f44b02ba-9d68-4e71-8b33-e9596581cc5b", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-996168907-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "233ee4c01bde4dae890bb3cf43348e2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc3f2aa1-a2", "ovs_interfaceid": "cc3f2aa1-a2e9-4558-8bcd-d26216e82b37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73572) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 10:12:07 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-54252728-5e1b-4820-a983-fc7cbd19c501 tempest-VolumesAssistedSnapshotsTest-660608201 tempest-VolumesAssistedSnapshotsTest-660608201-project-member] Converting VIF {"id": "cc3f2aa1-a2e9-4558-8bcd-d26216e82b37", "address": "fa:16:3e:72:9b:7b", "network": {"id": "f44b02ba-9d68-4e71-8b33-e9596581cc5b", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-996168907-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "233ee4c01bde4dae890bb3cf43348e2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc3f2aa1-a2", "ovs_interfaceid": "cc3f2aa1-a2e9-4558-8bcd-d26216e82b37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:12:07 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-54252728-5e1b-4820-a983-fc7cbd19c501 tempest-VolumesAssistedSnapshotsTest-660608201 tempest-VolumesAssistedSnapshotsTest-660608201-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:9b:7b,bridge_name='br-int',has_traffic_filtering=True,id=cc3f2aa1-a2e9-4558-8bcd-d26216e82b37,network=Network(f44b02ba-9d68-4e71-8b33-e9596581cc5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc3f2aa1-a2') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:12:07 user nova-compute[73572]: DEBUG nova.objects.instance [None req-54252728-5e1b-4820-a983-fc7cbd19c501 tempest-VolumesAssistedSnapshotsTest-660608201 tempest-VolumesAssistedSnapshotsTest-660608201-project-member] Lazy-loading 'pci_devices' on Instance uuid bc56542d-af1f-4313-8555-1b2014ff35e7 {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:12:07 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-54252728-5e1b-4820-a983-fc7cbd19c501 tempest-VolumesAssistedSnapshotsTest-660608201 tempest-VolumesAssistedSnapshotsTest-660608201-project-member] [instance: bc56542d-af1f-4313-8555-1b2014ff35e7] End _get_guest_xml xml=<domain type="kvm">
Aug 26 10:12:07 user nova-compute[73572]:   <uuid>bc56542d-af1f-4313-8555-1b2014ff35e7</uuid>
Aug 26 10:12:07 user nova-compute[73572]:   <name>instance-00000008</name>
Aug 26 10:12:07 user nova-compute[73572]:   <memory>524288</memory>
Aug 26 10:12:07 user nova-compute[73572]:   <vcpu>1</vcpu>
Aug 26 10:12:07 user nova-compute[73572]:   <metadata>
Aug 26 10:12:07 user nova-compute[73572]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 10:12:07 user nova-compute[73572]:       <nova:package version="0.0.0"/>
Aug 26 10:12:07 user nova-compute[73572]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-1463926599</nova:name>
Aug 26 10:12:07 user nova-compute[73572]:       <nova:creationTime>2023-08-26 10:12:07</nova:creationTime>
Aug 26 10:12:07 user nova-compute[73572]:       <nova:flavor name="m1.tiny">
Aug 26 10:12:07 user nova-compute[73572]:         <nova:memory>512</nova:memory>
Aug 26 10:12:07 user nova-compute[73572]:         <nova:disk>1</nova:disk>
Aug 26 10:12:07 user nova-compute[73572]:         <nova:swap>0</nova:swap>
Aug 26 10:12:07 user nova-compute[73572]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 10:12:07 user nova-compute[73572]:         <nova:vcpus>1</nova:vcpus>
Aug 26 10:12:07 user nova-compute[73572]:       </nova:flavor>
Aug 26 10:12:07 user nova-compute[73572]:       <nova:owner>
Aug 26 10:12:07 user nova-compute[73572]:         <nova:user uuid="14eb164e4e9540cf9b472033313b321f">tempest-VolumesAssistedSnapshotsTest-660608201-project-member</nova:user>
Aug 26 10:12:07 user nova-compute[73572]:         <nova:project uuid="233ee4c01bde4dae890bb3cf43348e2d">tempest-VolumesAssistedSnapshotsTest-660608201</nova:project>
Aug 26 10:12:07 user nova-compute[73572]:       </nova:owner>
Aug 26 10:12:07 user nova-compute[73572]:       <nova:root type="image" uuid="299da0c9-e1c4-48f0-be55-fbe20dd06bc9"/>
Aug 26 10:12:07 user nova-compute[73572]:       <nova:ports>
Aug 26 10:12:07 user nova-compute[73572]:         <nova:port uuid="cc3f2aa1-a2e9-4558-8bcd-d26216e82b37">
Aug 26 10:12:07 user nova-compute[73572]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 26 10:12:07 user nova-compute[73572]:         </nova:port>
Aug 26 10:12:07 user nova-compute[73572]:       </nova:ports>
Aug 26 10:12:07 user nova-compute[73572]:     </nova:instance>
Aug 26 10:12:07 user nova-compute[73572]:   </metadata>
Aug 26 10:12:07 user nova-compute[73572]:   <sysinfo type="smbios">
Aug 26 10:12:07 user nova-compute[73572]:     <system>
Aug 26 10:12:07 user nova-compute[73572]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 10:12:07 user nova-compute[73572]:       <entry name="product">OpenStack Nova</entry>
Aug 26 10:12:07 user nova-compute[73572]:       <entry name="version">0.0.0</entry>
Aug 26 10:12:07 user nova-compute[73572]:       <entry name="serial">bc56542d-af1f-4313-8555-1b2014ff35e7</entry>
Aug 26 10:12:07 user nova-compute[73572]:       <entry name="uuid">bc56542d-af1f-4313-8555-1b2014ff35e7</entry>
Aug 26 10:12:07 user nova-compute[73572]:       <entry name="family">Virtual Machine</entry>
Aug 26 10:12:07 user nova-compute[73572]:     </system>
Aug 26 10:12:07 user nova-compute[73572]:   </sysinfo>
Aug 26 10:12:07 user nova-compute[73572]:   <os>
Aug 26 10:12:07 user nova-compute[73572]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 10:12:07 user nova-compute[73572]:     <boot dev="hd"/>
Aug 26 10:12:07 user nova-compute[73572]:     <smbios mode="sysinfo"/>
Aug 26 10:12:07 user nova-compute[73572]:   </os>
Aug 26 10:12:07 user nova-compute[73572]:   <features>
Aug 26 10:12:07 user nova-compute[73572]:     <acpi/>
Aug 26 10:12:07 user nova-compute[73572]:     <apic/>
Aug 26 10:12:07 user nova-compute[73572]:     <vmcoreinfo/>
Aug 26 10:12:07 user nova-compute[73572]:   </features>
Aug 26 10:12:07 user nova-compute[73572]:   <clock offset="utc">
Aug 26 10:12:07 user nova-compute[73572]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 10:12:07 user nova-compute[73572]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 10:12:07 user nova-compute[73572]:     <timer name="hpet" present="no"/>
Aug 26 10:12:07 user nova-compute[73572]:   </clock>
Aug 26 10:12:07 user nova-compute[73572]:   <cpu mode="custom" match="exact">
Aug 26 10:12:07 user nova-compute[73572]:     <model>Nehalem</model>
Aug 26 10:12:07 user nova-compute[73572]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 10:12:07 user nova-compute[73572]:   </cpu>
Aug 26 10:12:07 user nova-compute[73572]:   <devices>
Aug 26 10:12:07 user nova-compute[73572]:     <disk type="file" device="disk">
Aug 26 10:12:07 user nova-compute[73572]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 10:12:07 user nova-compute[73572]:       <source file="/opt/stack/data/nova/instances/bc56542d-af1f-4313-8555-1b2014ff35e7/disk"/>
Aug 26 10:12:07 user nova-compute[73572]:       <target dev="vda" bus="virtio"/>
Aug 26 10:12:07 user nova-compute[73572]:     </disk>
Aug 26 10:12:07 user nova-compute[73572]:     <interface type="ethernet">
Aug 26 10:12:07 user nova-compute[73572]:       <mac address="fa:16:3e:72:9b:7b"/>
Aug 26 10:12:07 user nova-compute[73572]:       <model type="virtio"/>
Aug 26 10:12:07 user nova-compute[73572]:       <mtu size="1442"/>
Aug 26 10:12:07 user nova-compute[73572]:       <target dev="tapcc3f2aa1-a2"/>
Aug 26 10:12:07 user nova-compute[73572]:     </interface>
Aug 26 10:12:07 user nova-compute[73572]:     <serial type="pty">
Aug 26 10:12:07 user nova-compute[73572]:       <log file="/opt/stack/data/nova/instances/bc56542d-af1f-4313-8555-1b2014ff35e7/console.log" append="off"/>
Aug 26 10:12:07 user nova-compute[73572]:     </serial>
Aug 26 10:12:07 user nova-compute[73572]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 10:12:07 user nova-compute[73572]:     <video>
Aug 26 10:12:07 user nova-compute[73572]:       <model type="virtio"/>
Aug 26 10:12:07 user nova-compute[73572]:     </video>
Aug 26 10:12:07 user nova-compute[73572]:     <rng model="virtio">
Aug 26 10:12:07 user nova-compute[73572]:       <backend model="random">/dev/urandom</backend>
Aug 26 10:12:07 user nova-compute[73572]:     </rng>
Aug 26 10:12:07 user nova-compute[73572]:     <controller type="usb" index="0" model="none"/>
Aug 26 10:12:07 user nova-compute[73572]:     <memballoon model="virtio">
Aug 26 10:12:07 user nova-compute[73572]:       <stats period="10"/>
Aug 26 10:12:07 user nova-compute[73572]:     </memballoon>
Aug 26 10:12:07 user nova-compute[73572]:   </devices>
Aug 26 10:12:07 user nova-compute[73572]: </domain>
Aug 26 10:12:07 user nova-compute[73572]:  {{(pid=73572) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 10:12:07 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-54252728-5e1b-4820-a983-fc7cbd19c501 tempest-VolumesAssistedSnapshotsTest-660608201 tempest-VolumesAssistedSnapshotsTest-660608201-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T10:12:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1463926599',display_name='tempest-VolumesAssistedSnapshotsTest-server-1463926599',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1463926599',id=8,image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO59clm+UeS+lSWO5m6hxgTc/vT1Dkw3E1n4U7V2cakRQ9jZyba5XfdE5JtxxprQuirUZeZ/koZSYgvKPvoo0C+8Fgt1XijaGVbE6tKhetRQFB8EdEwrDkJMJlNvTpNpAA==',key_name='tempest-keypair-1194946091',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='233ee4c01bde4dae890bb3cf43348e2d',ramdisk_id='',reservation_id='r-wxcoz1z8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-660608201',owner_user_name='tempest-VolumesAssistedSnapshotsTest-660608201-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T10:12:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='14eb164e4e9540cf9b472033313b321f',uuid=bc56542d-af1f-4313-8555-1b2014ff35e7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cc3f2aa1-a2e9-4558-8bcd-d26216e82b37", "address": "fa:16:3e:72:9b:7b", "network": {"id": "f44b02ba-9d68-4e71-8b33-e9596581cc5b", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-996168907-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "233ee4c01bde4dae890bb3cf43348e2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc3f2aa1-a2", "ovs_interfaceid": "cc3f2aa1-a2e9-4558-8bcd-d26216e82b37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 10:12:07 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-54252728-5e1b-4820-a983-fc7cbd19c501 tempest-VolumesAssistedSnapshotsTest-660608201 tempest-VolumesAssistedSnapshotsTest-660608201-project-member] Converting VIF {"id": "cc3f2aa1-a2e9-4558-8bcd-d26216e82b37", "address": "fa:16:3e:72:9b:7b", "network": {"id": "f44b02ba-9d68-4e71-8b33-e9596581cc5b", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-996168907-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "233ee4c01bde4dae890bb3cf43348e2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc3f2aa1-a2", "ovs_interfaceid": "cc3f2aa1-a2e9-4558-8bcd-d26216e82b37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:12:07 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-54252728-5e1b-4820-a983-fc7cbd19c501 tempest-VolumesAssistedSnapshotsTest-660608201 tempest-VolumesAssistedSnapshotsTest-660608201-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:9b:7b,bridge_name='br-int',has_traffic_filtering=True,id=cc3f2aa1-a2e9-4558-8bcd-d26216e82b37,network=Network(f44b02ba-9d68-4e71-8b33-e9596581cc5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc3f2aa1-a2') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:12:07 user nova-compute[73572]: DEBUG os_vif [None req-54252728-5e1b-4820-a983-fc7cbd19c501 tempest-VolumesAssistedSnapshotsTest-660608201 tempest-VolumesAssistedSnapshotsTest-660608201-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:9b:7b,bridge_name='br-int',has_traffic_filtering=True,id=cc3f2aa1-a2e9-4558-8bcd-d26216e82b37,network=Network(f44b02ba-9d68-4e71-8b33-e9596581cc5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc3f2aa1-a2') {{(pid=73572) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 10:12:07 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:12:07 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:12:07 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 10:12:07 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:12:07 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcc3f2aa1-a2, may_exist=True, interface_attrs={}) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:12:07 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapcc3f2aa1-a2, col_values=(('external_ids', {'iface-id': 'cc3f2aa1-a2e9-4558-8bcd-d26216e82b37', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:72:9b:7b', 'vm-uuid': 'bc56542d-af1f-4313-8555-1b2014ff35e7'}),), if_exists=True) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:12:07 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:12:07 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:12:07 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:12:07 user nova-compute[73572]: INFO os_vif [None req-54252728-5e1b-4820-a983-fc7cbd19c501 tempest-VolumesAssistedSnapshotsTest-660608201 tempest-VolumesAssistedSnapshotsTest-660608201-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:9b:7b,bridge_name='br-int',has_traffic_filtering=True,id=cc3f2aa1-a2e9-4558-8bcd-d26216e82b37,network=Network(f44b02ba-9d68-4e71-8b33-e9596581cc5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc3f2aa1-a2')
Aug 26 10:12:07 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-54252728-5e1b-4820-a983-fc7cbd19c501 tempest-VolumesAssistedSnapshotsTest-660608201 tempest-VolumesAssistedSnapshotsTest-660608201-project-member] No BDM found with device name vda, not building metadata. {{(pid=73572) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 10:12:07 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-54252728-5e1b-4820-a983-fc7cbd19c501 tempest-VolumesAssistedSnapshotsTest-660608201 tempest-VolumesAssistedSnapshotsTest-660608201-project-member] No VIF found with MAC fa:16:3e:72:9b:7b, not building metadata {{(pid=73572) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 10:12:07 user nova-compute[73572]: DEBUG nova.network.neutron [req-0ce7df34-aff9-4c93-b44b-6ff3c23f1765 req-0bea5ccd-96e7-455e-a0c4-9ee7b126071a service nova] [instance: bc56542d-af1f-4313-8555-1b2014ff35e7] Updated VIF entry in instance network info cache for port cc3f2aa1-a2e9-4558-8bcd-d26216e82b37. {{(pid=73572) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 10:12:07 user nova-compute[73572]: DEBUG nova.network.neutron [req-0ce7df34-aff9-4c93-b44b-6ff3c23f1765 req-0bea5ccd-96e7-455e-a0c4-9ee7b126071a service nova] [instance: bc56542d-af1f-4313-8555-1b2014ff35e7] Updating instance_info_cache with network_info: [{"id": "cc3f2aa1-a2e9-4558-8bcd-d26216e82b37", "address": "fa:16:3e:72:9b:7b", "network": {"id": "f44b02ba-9d68-4e71-8b33-e9596581cc5b", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-996168907-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "233ee4c01bde4dae890bb3cf43348e2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc3f2aa1-a2", "ovs_interfaceid": "cc3f2aa1-a2e9-4558-8bcd-d26216e82b37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:12:07 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-0ce7df34-aff9-4c93-b44b-6ff3c23f1765 req-0bea5ccd-96e7-455e-a0c4-9ee7b126071a service nova] Releasing lock "refresh_cache-bc56542d-af1f-4313-8555-1b2014ff35e7" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:12:07 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:12:07 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:12:08 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:12:08 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:12:08 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:12:08 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:12:09 user nova-compute[73572]: DEBUG nova.compute.manager [req-62169487-1ca9-4905-9eaa-a6a14a525bbd req-dc2cd7da-1e89-47d7-8a11-50b840cc5fd5 service nova] [instance: bc56542d-af1f-4313-8555-1b2014ff35e7] Received event network-vif-plugged-cc3f2aa1-a2e9-4558-8bcd-d26216e82b37 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:12:09 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-62169487-1ca9-4905-9eaa-a6a14a525bbd req-dc2cd7da-1e89-47d7-8a11-50b840cc5fd5 service nova] Acquiring lock "bc56542d-af1f-4313-8555-1b2014ff35e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:12:09 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-62169487-1ca9-4905-9eaa-a6a14a525bbd req-dc2cd7da-1e89-47d7-8a11-50b840cc5fd5 service nova] Lock "bc56542d-af1f-4313-8555-1b2014ff35e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:12:09 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-62169487-1ca9-4905-9eaa-a6a14a525bbd req-dc2cd7da-1e89-47d7-8a11-50b840cc5fd5 service nova] Lock "bc56542d-af1f-4313-8555-1b2014ff35e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:12:09 user nova-compute[73572]: DEBUG nova.compute.manager [req-62169487-1ca9-4905-9eaa-a6a14a525bbd req-dc2cd7da-1e89-47d7-8a11-50b840cc5fd5 service nova] [instance: bc56542d-af1f-4313-8555-1b2014ff35e7] No waiting events found dispatching network-vif-plugged-cc3f2aa1-a2e9-4558-8bcd-d26216e82b37 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:12:09 user nova-compute[73572]: WARNING nova.compute.manager [req-62169487-1ca9-4905-9eaa-a6a14a525bbd req-dc2cd7da-1e89-47d7-8a11-50b840cc5fd5 service nova] [instance: bc56542d-af1f-4313-8555-1b2014ff35e7] Received unexpected event network-vif-plugged-cc3f2aa1-a2e9-4558-8bcd-d26216e82b37 for instance with vm_state building and task_state spawning.
Aug 26 10:12:09 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:12:09 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:12:09 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:12:09 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:12:09 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:12:09 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:12:09 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:12:09 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Auditing locally available compute resources for user (node: user) {{(pid=73572) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 10:12:10 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc56542d-af1f-4313-8555-1b2014ff35e7/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:12:10 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc56542d-af1f-4313-8555-1b2014ff35e7/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:12:10 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc56542d-af1f-4313-8555-1b2014ff35e7/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:12:10 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc56542d-af1f-4313-8555-1b2014ff35e7/disk --force-share --output=json" returned: 0 in 0.281s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:12:10 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8302d6e7-aaf3-461c-a55e-f2e685d1800d/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:12:10 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8302d6e7-aaf3-461c-a55e-f2e685d1800d/disk --force-share --output=json" returned: 0 in 0.416s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:12:10 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8302d6e7-aaf3-461c-a55e-f2e685d1800d/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:12:11 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8302d6e7-aaf3-461c-a55e-f2e685d1800d/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:12:11 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c785b609-0068-442f-91f5-d26e888a993f/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:12:11 user nova-compute[73572]: DEBUG nova.compute.manager [req-13331b0f-3060-4e01-84ce-3c1d020c4495 req-51f3f913-f8b3-4236-9c84-ebbc15e14b16 service nova] [instance: bc56542d-af1f-4313-8555-1b2014ff35e7] Received event network-vif-plugged-cc3f2aa1-a2e9-4558-8bcd-d26216e82b37 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:12:11 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-13331b0f-3060-4e01-84ce-3c1d020c4495 req-51f3f913-f8b3-4236-9c84-ebbc15e14b16 service nova] Acquiring lock "bc56542d-af1f-4313-8555-1b2014ff35e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:12:11 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-13331b0f-3060-4e01-84ce-3c1d020c4495 req-51f3f913-f8b3-4236-9c84-ebbc15e14b16 service nova] Lock "bc56542d-af1f-4313-8555-1b2014ff35e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:12:11 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-13331b0f-3060-4e01-84ce-3c1d020c4495 req-51f3f913-f8b3-4236-9c84-ebbc15e14b16 service nova] Lock "bc56542d-af1f-4313-8555-1b2014ff35e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:12:11 user nova-compute[73572]: DEBUG nova.compute.manager [req-13331b0f-3060-4e01-84ce-3c1d020c4495 req-51f3f913-f8b3-4236-9c84-ebbc15e14b16 service nova] [instance: bc56542d-af1f-4313-8555-1b2014ff35e7] No waiting events found dispatching network-vif-plugged-cc3f2aa1-a2e9-4558-8bcd-d26216e82b37 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:12:11 user nova-compute[73572]: WARNING nova.compute.manager [req-13331b0f-3060-4e01-84ce-3c1d020c4495 req-51f3f913-f8b3-4236-9c84-ebbc15e14b16 service nova] [instance: bc56542d-af1f-4313-8555-1b2014ff35e7] Received unexpected event network-vif-plugged-cc3f2aa1-a2e9-4558-8bcd-d26216e82b37 for instance with vm_state building and task_state spawning.
Aug 26 10:12:11 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c785b609-0068-442f-91f5-d26e888a993f/disk --force-share --output=json" returned: 0 in 0.294s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:12:11 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c785b609-0068-442f-91f5-d26e888a993f/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:12:11 user nova-compute[73572]: DEBUG nova.virt.driver [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Emitting event <LifecycleEvent: 1693044731.4660084, bc56542d-af1f-4313-8555-1b2014ff35e7 => Resumed> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:12:11 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: bc56542d-af1f-4313-8555-1b2014ff35e7] VM Resumed (Lifecycle Event)
Aug 26 10:12:11 user nova-compute[73572]: DEBUG nova.compute.manager [None req-54252728-5e1b-4820-a983-fc7cbd19c501 tempest-VolumesAssistedSnapshotsTest-660608201 tempest-VolumesAssistedSnapshotsTest-660608201-project-member] [instance: bc56542d-af1f-4313-8555-1b2014ff35e7] Instance event wait completed in 0 seconds for  {{(pid=73572) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 10:12:11 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-54252728-5e1b-4820-a983-fc7cbd19c501 tempest-VolumesAssistedSnapshotsTest-660608201 tempest-VolumesAssistedSnapshotsTest-660608201-project-member] [instance: bc56542d-af1f-4313-8555-1b2014ff35e7] Guest created on hypervisor {{(pid=73572) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 10:12:11 user nova-compute[73572]: INFO nova.virt.libvirt.driver [-] [instance: bc56542d-af1f-4313-8555-1b2014ff35e7] Instance spawned successfully.
Aug 26 10:12:11 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-54252728-5e1b-4820-a983-fc7cbd19c501 tempest-VolumesAssistedSnapshotsTest-660608201 tempest-VolumesAssistedSnapshotsTest-660608201-project-member] [instance: bc56542d-af1f-4313-8555-1b2014ff35e7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 10:12:11 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: bc56542d-af1f-4313-8555-1b2014ff35e7] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:12:11 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: bc56542d-af1f-4313-8555-1b2014ff35e7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73572) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 10:12:11 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-54252728-5e1b-4820-a983-fc7cbd19c501 tempest-VolumesAssistedSnapshotsTest-660608201 tempest-VolumesAssistedSnapshotsTest-660608201-project-member] [instance: bc56542d-af1f-4313-8555-1b2014ff35e7] Found default for hw_cdrom_bus of ide {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:12:11 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-54252728-5e1b-4820-a983-fc7cbd19c501 tempest-VolumesAssistedSnapshotsTest-660608201 tempest-VolumesAssistedSnapshotsTest-660608201-project-member] [instance: bc56542d-af1f-4313-8555-1b2014ff35e7] Found default for hw_disk_bus of virtio {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:12:11 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-54252728-5e1b-4820-a983-fc7cbd19c501 tempest-VolumesAssistedSnapshotsTest-660608201 tempest-VolumesAssistedSnapshotsTest-660608201-project-member] [instance: bc56542d-af1f-4313-8555-1b2014ff35e7] Found default for hw_input_bus of None {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:12:11 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-54252728-5e1b-4820-a983-fc7cbd19c501 tempest-VolumesAssistedSnapshotsTest-660608201 tempest-VolumesAssistedSnapshotsTest-660608201-project-member] [instance: bc56542d-af1f-4313-8555-1b2014ff35e7] Found default for hw_pointer_model of None {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:12:11 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-54252728-5e1b-4820-a983-fc7cbd19c501 tempest-VolumesAssistedSnapshotsTest-660608201 tempest-VolumesAssistedSnapshotsTest-660608201-project-member] [instance: bc56542d-af1f-4313-8555-1b2014ff35e7] Found default for hw_video_model of virtio {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:12:11 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-54252728-5e1b-4820-a983-fc7cbd19c501 tempest-VolumesAssistedSnapshotsTest-660608201 tempest-VolumesAssistedSnapshotsTest-660608201-project-member] [instance: bc56542d-af1f-4313-8555-1b2014ff35e7] Found default for hw_vif_model of virtio {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:12:11 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: bc56542d-af1f-4313-8555-1b2014ff35e7] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 10:12:11 user nova-compute[73572]: DEBUG nova.virt.driver [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Emitting event <LifecycleEvent: 1693044731.4665008, bc56542d-af1f-4313-8555-1b2014ff35e7 => Started> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:12:11 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: bc56542d-af1f-4313-8555-1b2014ff35e7] VM Started (Lifecycle Event)
Aug 26 10:12:11 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: bc56542d-af1f-4313-8555-1b2014ff35e7] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:12:11 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: bc56542d-af1f-4313-8555-1b2014ff35e7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73572) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 10:12:11 user nova-compute[73572]: INFO nova.compute.manager [None req-54252728-5e1b-4820-a983-fc7cbd19c501 tempest-VolumesAssistedSnapshotsTest-660608201 tempest-VolumesAssistedSnapshotsTest-660608201-project-member] [instance: bc56542d-af1f-4313-8555-1b2014ff35e7] Took 6.72 seconds to spawn the instance on the hypervisor.
Aug 26 10:12:11 user nova-compute[73572]: DEBUG nova.compute.manager [None req-54252728-5e1b-4820-a983-fc7cbd19c501 tempest-VolumesAssistedSnapshotsTest-660608201 tempest-VolumesAssistedSnapshotsTest-660608201-project-member] [instance: bc56542d-af1f-4313-8555-1b2014ff35e7] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:12:11 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: bc56542d-af1f-4313-8555-1b2014ff35e7] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 10:12:11 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c785b609-0068-442f-91f5-d26e888a993f/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:12:11 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ee427dc-7aa0-4435-b23c-1223f2881df7/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:12:11 user nova-compute[73572]: INFO nova.compute.manager [None req-54252728-5e1b-4820-a983-fc7cbd19c501 tempest-VolumesAssistedSnapshotsTest-660608201 tempest-VolumesAssistedSnapshotsTest-660608201-project-member] [instance: bc56542d-af1f-4313-8555-1b2014ff35e7] Took 7.79 seconds to build instance.
Aug 26 10:12:11 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-54252728-5e1b-4820-a983-fc7cbd19c501 tempest-VolumesAssistedSnapshotsTest-660608201 tempest-VolumesAssistedSnapshotsTest-660608201-project-member] Lock "bc56542d-af1f-4313-8555-1b2014ff35e7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.962s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:12:11 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ee427dc-7aa0-4435-b23c-1223f2881df7/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:12:11 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ee427dc-7aa0-4435-b23c-1223f2881df7/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:12:12 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ee427dc-7aa0-4435-b23c-1223f2881df7/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:12:12 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2a731d2-13ff-49e5-ab17-80686b622df7/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:12:12 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:12:12 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2a731d2-13ff-49e5-ab17-80686b622df7/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:12:12 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2a731d2-13ff-49e5-ab17-80686b622df7/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:12:12 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2a731d2-13ff-49e5-ab17-80686b622df7/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:12:12 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee9bcbaa-25a6-4588-b757-2a2ae15b6cf8/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:12:12 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee9bcbaa-25a6-4588-b757-2a2ae15b6cf8/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:12:12 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee9bcbaa-25a6-4588-b757-2a2ae15b6cf8/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:12:13 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee9bcbaa-25a6-4588-b757-2a2ae15b6cf8/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:12:13 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c555f971-b177-4c26-a38e-09e0e78bf7b9/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:12:13 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c555f971-b177-4c26-a38e-09e0e78bf7b9/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:12:13 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c555f971-b177-4c26-a38e-09e0e78bf7b9/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:12:13 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c555f971-b177-4c26-a38e-09e0e78bf7b9/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:12:13 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61b60a19-597e-4dc1-af0f-a0ec95e9fd24/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:12:13 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61b60a19-597e-4dc1-af0f-a0ec95e9fd24/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:12:13 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61b60a19-597e-4dc1-af0f-a0ec95e9fd24/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:12:13 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:12:13 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61b60a19-597e-4dc1-af0f-a0ec95e9fd24/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:12:14 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:12:14 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:12:14 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Hypervisor/Node resource view: name=user free_ram=7443MB free_disk=25.74612808227539GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=73572) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 10:12:14 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:12:14 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:12:15 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance 61b60a19-597e-4dc1-af0f-a0ec95e9fd24 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:12:15 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance c785b609-0068-442f-91f5-d26e888a993f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:12:15 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance 8302d6e7-aaf3-461c-a55e-f2e685d1800d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:12:15 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance c555f971-b177-4c26-a38e-09e0e78bf7b9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:12:15 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance ee9bcbaa-25a6-4588-b757-2a2ae15b6cf8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:12:15 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance 8ee427dc-7aa0-4435-b23c-1223f2881df7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:12:15 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance d2a731d2-13ff-49e5-ab17-80686b622df7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:12:15 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance bc56542d-af1f-4313-8555-1b2014ff35e7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:12:15 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=73572) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 10:12:15 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=73572) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 10:12:15 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Refreshing inventories for resource provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 {{(pid=73572) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 26 10:12:15 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Updating ProviderTree inventory for provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73572) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 26 10:12:15 user nova-compute[73572]: DEBUG nova.compute.provider_tree [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Updating inventory in ProviderTree for provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73572) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 26 10:12:15 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Refreshing aggregate associations for resource provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75, aggregates: None {{(pid=73572) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 26 10:12:15 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Refreshing trait associations for resource provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75, traits: COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSSE3,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE2,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NODE,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_NE2K_PCI {{(pid=73572) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 26 10:12:15 user nova-compute[73572]: DEBUG nova.compute.provider_tree [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Inventory has not changed in ProviderTree for provider: e2cec974-59b2-4c77-a53d-a7f4e5a30d75 {{(pid=73572) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 10:12:15 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Inventory has not changed for provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73572) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 10:12:15 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Compute_service record updated for user:user {{(pid=73572) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 10:12:15 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.153s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:12:16 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:12:17 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:12:18 user nova-compute[73572]: DEBUG nova.compute.manager [req-22d1d218-60b9-42a9-bdf5-4de8f61edd3b req-4bfc98ab-4117-4308-a897-258f3eeabd86 service nova] [instance: d2a731d2-13ff-49e5-ab17-80686b622df7] Received event network-vif-plugged-a07bf467-f02f-4889-b735-17df0d48853a {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:12:18 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-22d1d218-60b9-42a9-bdf5-4de8f61edd3b req-4bfc98ab-4117-4308-a897-258f3eeabd86 service nova] Acquiring lock "d2a731d2-13ff-49e5-ab17-80686b622df7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:12:18 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-22d1d218-60b9-42a9-bdf5-4de8f61edd3b req-4bfc98ab-4117-4308-a897-258f3eeabd86 service nova] Lock "d2a731d2-13ff-49e5-ab17-80686b622df7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:12:18 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-22d1d218-60b9-42a9-bdf5-4de8f61edd3b req-4bfc98ab-4117-4308-a897-258f3eeabd86 service nova] Lock "d2a731d2-13ff-49e5-ab17-80686b622df7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:12:18 user nova-compute[73572]: DEBUG nova.compute.manager [req-22d1d218-60b9-42a9-bdf5-4de8f61edd3b req-4bfc98ab-4117-4308-a897-258f3eeabd86 service nova] [instance: d2a731d2-13ff-49e5-ab17-80686b622df7] No waiting events found dispatching network-vif-plugged-a07bf467-f02f-4889-b735-17df0d48853a {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:12:18 user nova-compute[73572]: WARNING nova.compute.manager [req-22d1d218-60b9-42a9-bdf5-4de8f61edd3b req-4bfc98ab-4117-4308-a897-258f3eeabd86 service nova] [instance: d2a731d2-13ff-49e5-ab17-80686b622df7] Received unexpected event network-vif-plugged-a07bf467-f02f-4889-b735-17df0d48853a for instance with vm_state active and task_state None.
Aug 26 10:12:18 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:12:20 user nova-compute[73572]: DEBUG nova.compute.manager [req-996f759a-c0df-4c8e-902c-a91fb9495b8c req-40d0cef7-bec9-4f51-a3ab-a81423f044d7 service nova] [instance: d2a731d2-13ff-49e5-ab17-80686b622df7] Received event network-vif-plugged-a07bf467-f02f-4889-b735-17df0d48853a {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:12:20 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-996f759a-c0df-4c8e-902c-a91fb9495b8c req-40d0cef7-bec9-4f51-a3ab-a81423f044d7 service nova] Acquiring lock "d2a731d2-13ff-49e5-ab17-80686b622df7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:12:20 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-996f759a-c0df-4c8e-902c-a91fb9495b8c req-40d0cef7-bec9-4f51-a3ab-a81423f044d7 service nova] Lock "d2a731d2-13ff-49e5-ab17-80686b622df7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:12:20 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-996f759a-c0df-4c8e-902c-a91fb9495b8c req-40d0cef7-bec9-4f51-a3ab-a81423f044d7 service nova] Lock "d2a731d2-13ff-49e5-ab17-80686b622df7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:12:20 user nova-compute[73572]: DEBUG nova.compute.manager [req-996f759a-c0df-4c8e-902c-a91fb9495b8c req-40d0cef7-bec9-4f51-a3ab-a81423f044d7 service nova] [instance: d2a731d2-13ff-49e5-ab17-80686b622df7] No waiting events found dispatching network-vif-plugged-a07bf467-f02f-4889-b735-17df0d48853a {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:12:20 user nova-compute[73572]: WARNING nova.compute.manager [req-996f759a-c0df-4c8e-902c-a91fb9495b8c req-40d0cef7-bec9-4f51-a3ab-a81423f044d7 service nova] [instance: d2a731d2-13ff-49e5-ab17-80686b622df7] Received unexpected event network-vif-plugged-a07bf467-f02f-4889-b735-17df0d48853a for instance with vm_state active and task_state None.
Aug 26 10:12:22 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:12:23 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:12:27 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:12:28 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:12:32 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:12:33 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:12:37 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:12:38 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:12:42 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:12:43 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:12:47 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:12:51 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] Acquiring lock "83670c16-3566-4679-8e74-c6451c840315" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:12:51 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] Lock "83670c16-3566-4679-8e74-c6451c840315" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:12:51 user nova-compute[73572]: DEBUG nova.compute.manager [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] [instance: 83670c16-3566-4679-8e74-c6451c840315] Starting instance... {{(pid=73572) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 10:12:51 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:12:51 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:12:51 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73572) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 10:12:51 user nova-compute[73572]: INFO nova.compute.claims [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] [instance: 83670c16-3566-4679-8e74-c6451c840315] Claim successful on node user
Aug 26 10:12:52 user nova-compute[73572]: DEBUG nova.compute.provider_tree [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] Inventory has not changed in ProviderTree for provider: e2cec974-59b2-4c77-a53d-a7f4e5a30d75 {{(pid=73572) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 10:12:52 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] Inventory has not changed for provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73572) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 10:12:52 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.415s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:12:52 user nova-compute[73572]: DEBUG nova.compute.manager [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] [instance: 83670c16-3566-4679-8e74-c6451c840315] Start building networks asynchronously for instance. {{(pid=73572) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 10:12:52 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:12:52 user nova-compute[73572]: DEBUG nova.compute.manager [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] [instance: 83670c16-3566-4679-8e74-c6451c840315] Allocating IP information in the background. {{(pid=73572) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 10:12:52 user nova-compute[73572]: DEBUG nova.network.neutron [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] [instance: 83670c16-3566-4679-8e74-c6451c840315] allocate_for_instance() {{(pid=73572) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 10:12:52 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] [instance: 83670c16-3566-4679-8e74-c6451c840315] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 10:12:52 user nova-compute[73572]: DEBUG nova.compute.manager [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] [instance: 83670c16-3566-4679-8e74-c6451c840315] Start building block device mappings for instance. {{(pid=73572) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 10:12:52 user nova-compute[73572]: INFO nova.virt.block_device [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] [instance: 83670c16-3566-4679-8e74-c6451c840315] Booting with volume 09ba694f-cb2a-4600-abe9-924b41292479 at /dev/vda
Aug 26 10:12:52 user nova-compute[73572]: DEBUG os_brick.utils [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 10:12:52 user nova-compute[73572]: INFO oslo.privsep.daemon [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmpo6lepb7_/privsep.sock']
Aug 26 10:12:52 user nova-compute[73572]: DEBUG nova.policy [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd2269ea682c5489892c05da7db781952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de7931c97d448eaa26d295386b3a999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73572) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 10:12:52 user sudo[84540]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmpo6lepb7_/privsep.sock
Aug 26 10:12:52 user sudo[84540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 26 10:12:53 user nova-compute[73572]: DEBUG nova.network.neutron [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] [instance: 83670c16-3566-4679-8e74-c6451c840315] Successfully created port: 71be4c62-7219-45ca-8047-ab6716b37f6a {{(pid=73572) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 10:12:54 user nova-compute[73572]: DEBUG nova.network.neutron [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] [instance: 83670c16-3566-4679-8e74-c6451c840315] Successfully created port: 41a7ee04-5b67-4da6-a543-0d15187e5813 {{(pid=73572) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 10:12:54 user sudo[84540]: pam_unix(sudo:session): session closed for user root
Aug 26 10:12:54 user nova-compute[73572]: INFO oslo.privsep.daemon [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] Spawned new privsep daemon via rootwrap
Aug 26 10:12:54 user nova-compute[73572]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 26 10:12:54 user nova-compute[73572]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 26 10:12:54 user nova-compute[73572]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Aug 26 10:12:54 user nova-compute[73572]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84543
Aug 26 10:12:54 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[80c2dbe7-bf54-4205-ac51-5551cc48c690]: (2,) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:12:54 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:12:54 user nova-compute[73572]: DEBUG nova.network.neutron [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] [instance: 83670c16-3566-4679-8e74-c6451c840315] Successfully created port: 422eb7ef-4540-462b-a485-afdc38ebccd0 {{(pid=73572) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 10:12:54 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:12:54 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:12:54 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[802ad9de-39f4-478e-b50e-b834cf6fb5c9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:de8a79ed912\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:12:54 user nova-compute[73572]: WARNING os_brick.initiator.connectors.nvmeof [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Aug 26 10:12:54 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:12:54 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:12:54 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[c82e01a0-3449-4930-a04c-b512020b99ac]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:12:54 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:12:54 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:12:54 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[4579853b-84bc-4add-9469-92d088e7dd5d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:12:54 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[f82eef61-738c-4da4-9f91-1f7fb4e5ab97]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:12:54 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] Running cmd (subprocess): nvme version {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:12:54 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] 'nvme version' failed. Not Retrying. {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 10:12:54 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] nvme not present on system {{(pid=73572) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 10:12:54 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:12:54 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 10:12:54 user nova-compute[73572]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 10:12:54 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2794790-967d-4720-9392-3b896c542514]: (4, '') {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:12:54 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.lightos [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73572) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 10:12:54 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.lightos [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73572) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 10:12:54 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.lightos [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] LIGHTOS: no hostnqn found. {{(pid=73572) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 10:12:54 user nova-compute[73572]: DEBUG os_brick.utils [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] <== get_connector_properties: return (2205ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:de8a79ed912', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 10:12:54 user nova-compute[73572]: DEBUG nova.virt.block_device [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] [instance: 83670c16-3566-4679-8e74-c6451c840315] Updating existing volume attachment record: 08670a3e-4742-4ef5-8462-9e446c5ff8d8 {{(pid=73572) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 10:12:55 user nova-compute[73572]: DEBUG nova.network.neutron [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] [instance: 83670c16-3566-4679-8e74-c6451c840315] Successfully created port: 5e85b3cc-9fe4-46aa-a43f-d4acc5ca3c73 {{(pid=73572) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 10:12:56 user nova-compute[73572]: DEBUG nova.network.neutron [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] [instance: 83670c16-3566-4679-8e74-c6451c840315] Successfully created port: 7b7b7362-9dcc-48da-ad4e-9141c676839e {{(pid=73572) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 10:12:56 user nova-compute[73572]: DEBUG nova.network.neutron [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] [instance: 83670c16-3566-4679-8e74-c6451c840315] Successfully updated port: 71be4c62-7219-45ca-8047-ab6716b37f6a {{(pid=73572) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 10:12:56 user nova-compute[73572]: DEBUG nova.compute.manager [req-899fbce7-76e7-4002-845f-f90a5182f382 req-59c221be-0850-49c1-851e-d71d7ea0790b service nova] [instance: 83670c16-3566-4679-8e74-c6451c840315] Received event network-changed-71be4c62-7219-45ca-8047-ab6716b37f6a {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:12:56 user nova-compute[73572]: DEBUG nova.compute.manager [req-899fbce7-76e7-4002-845f-f90a5182f382 req-59c221be-0850-49c1-851e-d71d7ea0790b service nova] [instance: 83670c16-3566-4679-8e74-c6451c840315] Refreshing instance network info cache due to event network-changed-71be4c62-7219-45ca-8047-ab6716b37f6a. {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 10:12:56 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-899fbce7-76e7-4002-845f-f90a5182f382 req-59c221be-0850-49c1-851e-d71d7ea0790b service nova] Acquiring lock "refresh_cache-83670c16-3566-4679-8e74-c6451c840315" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:12:56 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-899fbce7-76e7-4002-845f-f90a5182f382 req-59c221be-0850-49c1-851e-d71d7ea0790b service nova] Acquired lock "refresh_cache-83670c16-3566-4679-8e74-c6451c840315" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:12:56 user nova-compute[73572]: DEBUG nova.network.neutron [req-899fbce7-76e7-4002-845f-f90a5182f382 req-59c221be-0850-49c1-851e-d71d7ea0790b service nova] [instance: 83670c16-3566-4679-8e74-c6451c840315] Refreshing network info cache for port 71be4c62-7219-45ca-8047-ab6716b37f6a {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 10:12:57 user nova-compute[73572]: DEBUG nova.network.neutron [req-899fbce7-76e7-4002-845f-f90a5182f382 req-59c221be-0850-49c1-851e-d71d7ea0790b service nova] [instance: 83670c16-3566-4679-8e74-c6451c840315] Instance cache missing network info. {{(pid=73572) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 10:12:57 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:12:57 user nova-compute[73572]: DEBUG nova.network.neutron [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] [instance: 83670c16-3566-4679-8e74-c6451c840315] Successfully updated port: 84bf04a4-b563-48c5-aa73-5b54cbb4887f {{(pid=73572) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 10:12:57 user nova-compute[73572]: DEBUG nova.network.neutron [req-899fbce7-76e7-4002-845f-f90a5182f382 req-59c221be-0850-49c1-851e-d71d7ea0790b service nova] [instance: 83670c16-3566-4679-8e74-c6451c840315] Updating instance_info_cache with network_info: [] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:12:57 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-899fbce7-76e7-4002-845f-f90a5182f382 req-59c221be-0850-49c1-851e-d71d7ea0790b service nova] Releasing lock "refresh_cache-83670c16-3566-4679-8e74-c6451c840315" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:12:58 user nova-compute[73572]: DEBUG nova.network.neutron [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] [instance: 83670c16-3566-4679-8e74-c6451c840315] Successfully updated port: f4d684f0-2fe0-46e6-8f84-e2c0918a5a82 {{(pid=73572) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 10:12:59 user nova-compute[73572]: DEBUG nova.compute.manager [req-4f8646fd-7513-4a6a-8006-6488963393c2 req-1b6d0764-5138-45d5-80ff-d39c902996d9 service nova] [instance: 83670c16-3566-4679-8e74-c6451c840315] Received event network-changed-84bf04a4-b563-48c5-aa73-5b54cbb4887f {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:12:59 user nova-compute[73572]: DEBUG nova.compute.manager [req-4f8646fd-7513-4a6a-8006-6488963393c2 req-1b6d0764-5138-45d5-80ff-d39c902996d9 service nova] [instance: 83670c16-3566-4679-8e74-c6451c840315] Refreshing instance network info cache due to event network-changed-84bf04a4-b563-48c5-aa73-5b54cbb4887f. {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 10:12:59 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-4f8646fd-7513-4a6a-8006-6488963393c2 req-1b6d0764-5138-45d5-80ff-d39c902996d9 service nova] Acquiring lock "refresh_cache-83670c16-3566-4679-8e74-c6451c840315" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:12:59 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-4f8646fd-7513-4a6a-8006-6488963393c2 req-1b6d0764-5138-45d5-80ff-d39c902996d9 service nova] Acquired lock "refresh_cache-83670c16-3566-4679-8e74-c6451c840315" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:12:59 user nova-compute[73572]: DEBUG nova.network.neutron [req-4f8646fd-7513-4a6a-8006-6488963393c2 req-1b6d0764-5138-45d5-80ff-d39c902996d9 service nova] [instance: 83670c16-3566-4679-8e74-c6451c840315] Refreshing network info cache for port 84bf04a4-b563-48c5-aa73-5b54cbb4887f {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 10:12:59 user nova-compute[73572]: DEBUG nova.network.neutron [req-4f8646fd-7513-4a6a-8006-6488963393c2 req-1b6d0764-5138-45d5-80ff-d39c902996d9 service nova] [instance: 83670c16-3566-4679-8e74-c6451c840315] Instance cache missing network info. {{(pid=73572) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 10:12:59 user nova-compute[73572]: DEBUG nova.network.neutron [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] [instance: 83670c16-3566-4679-8e74-c6451c840315] Successfully updated port: 41a7ee04-5b67-4da6-a543-0d15187e5813 {{(pid=73572) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 10:12:59 user nova-compute[73572]: DEBUG nova.network.neutron [req-4f8646fd-7513-4a6a-8006-6488963393c2 req-1b6d0764-5138-45d5-80ff-d39c902996d9 service nova] [instance: 83670c16-3566-4679-8e74-c6451c840315] Updating instance_info_cache with network_info: [] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:12:59 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-4f8646fd-7513-4a6a-8006-6488963393c2 req-1b6d0764-5138-45d5-80ff-d39c902996d9 service nova] Releasing lock "refresh_cache-83670c16-3566-4679-8e74-c6451c840315" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:12:59 user nova-compute[73572]: DEBUG nova.compute.manager [req-4f8646fd-7513-4a6a-8006-6488963393c2 req-1b6d0764-5138-45d5-80ff-d39c902996d9 service nova] [instance: 83670c16-3566-4679-8e74-c6451c840315] Received event network-changed-f4d684f0-2fe0-46e6-8f84-e2c0918a5a82 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:12:59 user nova-compute[73572]: DEBUG nova.compute.manager [req-4f8646fd-7513-4a6a-8006-6488963393c2 req-1b6d0764-5138-45d5-80ff-d39c902996d9 service nova] [instance: 83670c16-3566-4679-8e74-c6451c840315] Refreshing instance network info cache due to event network-changed-f4d684f0-2fe0-46e6-8f84-e2c0918a5a82. {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 10:12:59 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-4f8646fd-7513-4a6a-8006-6488963393c2 req-1b6d0764-5138-45d5-80ff-d39c902996d9 service nova] Acquiring lock "refresh_cache-83670c16-3566-4679-8e74-c6451c840315" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:12:59 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-4f8646fd-7513-4a6a-8006-6488963393c2 req-1b6d0764-5138-45d5-80ff-d39c902996d9 service nova] Acquired lock "refresh_cache-83670c16-3566-4679-8e74-c6451c840315" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:12:59 user nova-compute[73572]: DEBUG nova.network.neutron [req-4f8646fd-7513-4a6a-8006-6488963393c2 req-1b6d0764-5138-45d5-80ff-d39c902996d9 service nova] [instance: 83670c16-3566-4679-8e74-c6451c840315] Refreshing network info cache for port f4d684f0-2fe0-46e6-8f84-e2c0918a5a82 {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 10:12:59 user nova-compute[73572]: DEBUG nova.network.neutron [req-4f8646fd-7513-4a6a-8006-6488963393c2 req-1b6d0764-5138-45d5-80ff-d39c902996d9 service nova] [instance: 83670c16-3566-4679-8e74-c6451c840315] Instance cache missing network info. {{(pid=73572) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 10:12:59 user nova-compute[73572]: DEBUG nova.network.neutron [req-4f8646fd-7513-4a6a-8006-6488963393c2 req-1b6d0764-5138-45d5-80ff-d39c902996d9 service nova] [instance: 83670c16-3566-4679-8e74-c6451c840315] Updating instance_info_cache with network_info: [] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:12:59 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-4f8646fd-7513-4a6a-8006-6488963393c2 req-1b6d0764-5138-45d5-80ff-d39c902996d9 service nova] Releasing lock "refresh_cache-83670c16-3566-4679-8e74-c6451c840315" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:13:00 user nova-compute[73572]: DEBUG nova.network.neutron [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] [instance: 83670c16-3566-4679-8e74-c6451c840315] Successfully updated port: 422eb7ef-4540-462b-a485-afdc38ebccd0 {{(pid=73572) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 10:13:01 user nova-compute[73572]: DEBUG nova.compute.manager [req-408019f5-95db-45ed-9e53-f086a0b9ed56 req-501c9830-abeb-4819-9676-2925ccff2a7c service nova] [instance: 83670c16-3566-4679-8e74-c6451c840315] Received event network-changed-41a7ee04-5b67-4da6-a543-0d15187e5813 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:13:01 user nova-compute[73572]: DEBUG nova.compute.manager [req-408019f5-95db-45ed-9e53-f086a0b9ed56 req-501c9830-abeb-4819-9676-2925ccff2a7c service nova] [instance: 83670c16-3566-4679-8e74-c6451c840315] Refreshing instance network info cache due to event network-changed-41a7ee04-5b67-4da6-a543-0d15187e5813. {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 10:13:01 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-408019f5-95db-45ed-9e53-f086a0b9ed56 req-501c9830-abeb-4819-9676-2925ccff2a7c service nova] Acquiring lock "refresh_cache-83670c16-3566-4679-8e74-c6451c840315" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:13:01 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-408019f5-95db-45ed-9e53-f086a0b9ed56 req-501c9830-abeb-4819-9676-2925ccff2a7c service nova] Acquired lock "refresh_cache-83670c16-3566-4679-8e74-c6451c840315" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:13:01 user nova-compute[73572]: DEBUG nova.network.neutron [req-408019f5-95db-45ed-9e53-f086a0b9ed56 req-501c9830-abeb-4819-9676-2925ccff2a7c service nova] [instance: 83670c16-3566-4679-8e74-c6451c840315] Refreshing network info cache for port 41a7ee04-5b67-4da6-a543-0d15187e5813 {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 10:13:01 user nova-compute[73572]: DEBUG nova.network.neutron [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] [instance: 83670c16-3566-4679-8e74-c6451c840315] Successfully updated port: 5e85b3cc-9fe4-46aa-a43f-d4acc5ca3c73 {{(pid=73572) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 10:13:01 user nova-compute[73572]: DEBUG nova.network.neutron [req-408019f5-95db-45ed-9e53-f086a0b9ed56 req-501c9830-abeb-4819-9676-2925ccff2a7c service nova] [instance: 83670c16-3566-4679-8e74-c6451c840315] Instance cache missing network info. {{(pid=73572) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 10:13:01 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:13:01 user nova-compute[73572]: DEBUG nova.network.neutron [req-408019f5-95db-45ed-9e53-f086a0b9ed56 req-501c9830-abeb-4819-9676-2925ccff2a7c service nova] [instance: 83670c16-3566-4679-8e74-c6451c840315] Updating instance_info_cache with network_info: [] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:13:01 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-408019f5-95db-45ed-9e53-f086a0b9ed56 req-501c9830-abeb-4819-9676-2925ccff2a7c service nova] Releasing lock "refresh_cache-83670c16-3566-4679-8e74-c6451c840315" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:13:01 user nova-compute[73572]: DEBUG nova.compute.manager [req-408019f5-95db-45ed-9e53-f086a0b9ed56 req-501c9830-abeb-4819-9676-2925ccff2a7c service nova] [instance: 83670c16-3566-4679-8e74-c6451c840315] Received event network-changed-422eb7ef-4540-462b-a485-afdc38ebccd0 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:13:01 user nova-compute[73572]: DEBUG nova.compute.manager [req-408019f5-95db-45ed-9e53-f086a0b9ed56 req-501c9830-abeb-4819-9676-2925ccff2a7c service nova] [instance: 83670c16-3566-4679-8e74-c6451c840315] Refreshing instance network info cache due to event network-changed-422eb7ef-4540-462b-a485-afdc38ebccd0. {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 10:13:01 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-408019f5-95db-45ed-9e53-f086a0b9ed56 req-501c9830-abeb-4819-9676-2925ccff2a7c service nova] Acquiring lock "refresh_cache-83670c16-3566-4679-8e74-c6451c840315" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:13:01 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-408019f5-95db-45ed-9e53-f086a0b9ed56 req-501c9830-abeb-4819-9676-2925ccff2a7c service nova] Acquired lock "refresh_cache-83670c16-3566-4679-8e74-c6451c840315" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:13:01 user nova-compute[73572]: DEBUG nova.network.neutron [req-408019f5-95db-45ed-9e53-f086a0b9ed56 req-501c9830-abeb-4819-9676-2925ccff2a7c service nova] [instance: 83670c16-3566-4679-8e74-c6451c840315] Refreshing network info cache for port 422eb7ef-4540-462b-a485-afdc38ebccd0 {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 10:13:01 user nova-compute[73572]: DEBUG nova.network.neutron [req-408019f5-95db-45ed-9e53-f086a0b9ed56 req-501c9830-abeb-4819-9676-2925ccff2a7c service nova] [instance: 83670c16-3566-4679-8e74-c6451c840315] Instance cache missing network info. {{(pid=73572) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 10:13:01 user nova-compute[73572]: DEBUG nova.network.neutron [req-408019f5-95db-45ed-9e53-f086a0b9ed56 req-501c9830-abeb-4819-9676-2925ccff2a7c service nova] [instance: 83670c16-3566-4679-8e74-c6451c840315] Updating instance_info_cache with network_info: [] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:13:01 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-408019f5-95db-45ed-9e53-f086a0b9ed56 req-501c9830-abeb-4819-9676-2925ccff2a7c service nova] Releasing lock "refresh_cache-83670c16-3566-4679-8e74-c6451c840315" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:13:02 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:13:03 user nova-compute[73572]: DEBUG nova.compute.manager [req-71078c3e-2f73-4b83-9b00-468072e19db3 req-c2048397-74f1-4c2c-af58-6d65b7fead6a service nova] [instance: 83670c16-3566-4679-8e74-c6451c840315] Received event network-changed-5e85b3cc-9fe4-46aa-a43f-d4acc5ca3c73 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:13:03 user nova-compute[73572]: DEBUG nova.compute.manager [req-71078c3e-2f73-4b83-9b00-468072e19db3 req-c2048397-74f1-4c2c-af58-6d65b7fead6a service nova] [instance: 83670c16-3566-4679-8e74-c6451c840315] Refreshing instance network info cache due to event network-changed-5e85b3cc-9fe4-46aa-a43f-d4acc5ca3c73. {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 10:13:03 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-71078c3e-2f73-4b83-9b00-468072e19db3 req-c2048397-74f1-4c2c-af58-6d65b7fead6a service nova] Acquiring lock "refresh_cache-83670c16-3566-4679-8e74-c6451c840315" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:13:03 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-71078c3e-2f73-4b83-9b00-468072e19db3 req-c2048397-74f1-4c2c-af58-6d65b7fead6a service nova] Acquired lock "refresh_cache-83670c16-3566-4679-8e74-c6451c840315" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:13:03 user nova-compute[73572]: DEBUG nova.network.neutron [req-71078c3e-2f73-4b83-9b00-468072e19db3 req-c2048397-74f1-4c2c-af58-6d65b7fead6a service nova] [instance: 83670c16-3566-4679-8e74-c6451c840315] Refreshing network info cache for port 5e85b3cc-9fe4-46aa-a43f-d4acc5ca3c73 {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 10:13:03 user nova-compute[73572]: DEBUG nova.network.neutron [req-71078c3e-2f73-4b83-9b00-468072e19db3 req-c2048397-74f1-4c2c-af58-6d65b7fead6a service nova] [instance: 83670c16-3566-4679-8e74-c6451c840315] Instance cache missing network info. {{(pid=73572) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 10:13:03 user nova-compute[73572]: DEBUG nova.network.neutron [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] [instance: 83670c16-3566-4679-8e74-c6451c840315] Successfully updated port: 7b7b7362-9dcc-48da-ad4e-9141c676839e {{(pid=73572) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 10:13:03 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] Acquiring lock "refresh_cache-83670c16-3566-4679-8e74-c6451c840315" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:13:03 user nova-compute[73572]: DEBUG nova.network.neutron [req-71078c3e-2f73-4b83-9b00-468072e19db3 req-c2048397-74f1-4c2c-af58-6d65b7fead6a service nova] [instance: 83670c16-3566-4679-8e74-c6451c840315] Updating instance_info_cache with network_info: [] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:13:03 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-71078c3e-2f73-4b83-9b00-468072e19db3 req-c2048397-74f1-4c2c-af58-6d65b7fead6a service nova] Releasing lock "refresh_cache-83670c16-3566-4679-8e74-c6451c840315" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:13:03 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] Acquired lock "refresh_cache-83670c16-3566-4679-8e74-c6451c840315" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:13:03 user nova-compute[73572]: DEBUG nova.network.neutron [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] [instance: 83670c16-3566-4679-8e74-c6451c840315] Building network info cache for instance {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 10:13:03 user nova-compute[73572]: DEBUG nova.network.neutron [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] [instance: 83670c16-3566-4679-8e74-c6451c840315] Instance cache missing network info. {{(pid=73572) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 10:13:03 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:13:03 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Starting heal instance info cache {{(pid=73572) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 10:13:03 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:13:03 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquiring lock "refresh_cache-c785b609-0068-442f-91f5-d26e888a993f" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:13:03 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquired lock "refresh_cache-c785b609-0068-442f-91f5-d26e888a993f" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:13:03 user nova-compute[73572]: DEBUG nova.network.neutron [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] [instance: c785b609-0068-442f-91f5-d26e888a993f] Forcefully refreshing network info cache for instance {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 10:13:04 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:13:05 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-705d5ae7-e71b-4f5e-95e6-257f7a1a909a tempest-VolumesNegativeTest-657120278 tempest-VolumesNegativeTest-657120278-project-member] Acquiring lock "0b140c11-1a26-4312-9cec-8054582d15f5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:13:05 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-705d5ae7-e71b-4f5e-95e6-257f7a1a909a tempest-VolumesNegativeTest-657120278 tempest-VolumesNegativeTest-657120278-project-member] Lock "0b140c11-1a26-4312-9cec-8054582d15f5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:13:05 user nova-compute[73572]: DEBUG nova.network.neutron [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] [instance: c785b609-0068-442f-91f5-d26e888a993f] Updating instance_info_cache with network_info: [{"id": "f01cdcf9-2430-4eb5-bb2d-3d126756dfc1", "address": "fa:16:3e:fa:6c:bc", "network": {"id": "991b9dff-5173-4456-a530-b1f7eb5cfa4a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1845930297-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4636f93c5bfc4653804de097aed2882c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf01cdcf9-24", "ovs_interfaceid": "f01cdcf9-2430-4eb5-bb2d-3d126756dfc1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:13:05 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Releasing lock "refresh_cache-c785b609-0068-442f-91f5-d26e888a993f" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:13:05 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] [instance: c785b609-0068-442f-91f5-d26e888a993f] Updated the network info_cache for instance {{(pid=73572) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 10:13:05 user nova-compute[73572]: DEBUG nova.compute.manager [None req-705d5ae7-e71b-4f5e-95e6-257f7a1a909a tempest-VolumesNegativeTest-657120278 tempest-VolumesNegativeTest-657120278-project-member] [instance: 0b140c11-1a26-4312-9cec-8054582d15f5] Starting instance... {{(pid=73572) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 10:13:05 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-705d5ae7-e71b-4f5e-95e6-257f7a1a909a tempest-VolumesNegativeTest-657120278 tempest-VolumesNegativeTest-657120278-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:13:05 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-705d5ae7-e71b-4f5e-95e6-257f7a1a909a tempest-VolumesNegativeTest-657120278 tempest-VolumesNegativeTest-657120278-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:13:05 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-705d5ae7-e71b-4f5e-95e6-257f7a1a909a tempest-VolumesNegativeTest-657120278 tempest-VolumesNegativeTest-657120278-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73572) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 10:13:05 user nova-compute[73572]: INFO nova.compute.claims [None req-705d5ae7-e71b-4f5e-95e6-257f7a1a909a tempest-VolumesNegativeTest-657120278 tempest-VolumesNegativeTest-657120278-project-member] [instance: 0b140c11-1a26-4312-9cec-8054582d15f5] Claim successful on node user
Aug 26 10:13:05 user nova-compute[73572]: DEBUG nova.compute.manager [req-09669d9f-caa8-4c0f-9584-dd448d8b6669 req-c7403aaf-d179-4f74-9d9b-7c3390240a13 service nova] [instance: 83670c16-3566-4679-8e74-c6451c840315] Received event network-changed-7b7b7362-9dcc-48da-ad4e-9141c676839e {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:13:05 user nova-compute[73572]: DEBUG nova.compute.manager [req-09669d9f-caa8-4c0f-9584-dd448d8b6669 req-c7403aaf-d179-4f74-9d9b-7c3390240a13 service nova] [instance: 83670c16-3566-4679-8e74-c6451c840315] Refreshing instance network info cache due to event network-changed-7b7b7362-9dcc-48da-ad4e-9141c676839e. {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 10:13:05 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-09669d9f-caa8-4c0f-9584-dd448d8b6669 req-c7403aaf-d179-4f74-9d9b-7c3390240a13 service nova] Acquiring lock "refresh_cache-83670c16-3566-4679-8e74-c6451c840315" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:13:05 user nova-compute[73572]: DEBUG nova.compute.provider_tree [None req-705d5ae7-e71b-4f5e-95e6-257f7a1a909a tempest-VolumesNegativeTest-657120278 tempest-VolumesNegativeTest-657120278-project-member] Inventory has not changed in ProviderTree for provider: e2cec974-59b2-4c77-a53d-a7f4e5a30d75 {{(pid=73572) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 10:13:05 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-705d5ae7-e71b-4f5e-95e6-257f7a1a909a tempest-VolumesNegativeTest-657120278 tempest-VolumesNegativeTest-657120278-project-member] Inventory has not changed for provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73572) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 10:13:05 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-705d5ae7-e71b-4f5e-95e6-257f7a1a909a tempest-VolumesNegativeTest-657120278 tempest-VolumesNegativeTest-657120278-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.569s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:13:05 user nova-compute[73572]: DEBUG nova.compute.manager [None req-705d5ae7-e71b-4f5e-95e6-257f7a1a909a tempest-VolumesNegativeTest-657120278 tempest-VolumesNegativeTest-657120278-project-member] [instance: 0b140c11-1a26-4312-9cec-8054582d15f5] Start building networks asynchronously for instance. {{(pid=73572) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 10:13:05 user nova-compute[73572]: DEBUG nova.compute.manager [None req-705d5ae7-e71b-4f5e-95e6-257f7a1a909a tempest-VolumesNegativeTest-657120278 tempest-VolumesNegativeTest-657120278-project-member] [instance: 0b140c11-1a26-4312-9cec-8054582d15f5] Allocating IP information in the background. {{(pid=73572) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 10:13:05 user nova-compute[73572]: DEBUG nova.network.neutron [None req-705d5ae7-e71b-4f5e-95e6-257f7a1a909a tempest-VolumesNegativeTest-657120278 tempest-VolumesNegativeTest-657120278-project-member] [instance: 0b140c11-1a26-4312-9cec-8054582d15f5] allocate_for_instance() {{(pid=73572) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 10:13:05 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-705d5ae7-e71b-4f5e-95e6-257f7a1a909a tempest-VolumesNegativeTest-657120278 tempest-VolumesNegativeTest-657120278-project-member] [instance: 0b140c11-1a26-4312-9cec-8054582d15f5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 10:13:05 user nova-compute[73572]: DEBUG nova.compute.manager [None req-705d5ae7-e71b-4f5e-95e6-257f7a1a909a tempest-VolumesNegativeTest-657120278 tempest-VolumesNegativeTest-657120278-project-member] [instance: 0b140c11-1a26-4312-9cec-8054582d15f5] Start building block device mappings for instance. {{(pid=73572) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 10:13:06 user nova-compute[73572]: DEBUG nova.compute.manager [None req-705d5ae7-e71b-4f5e-95e6-257f7a1a909a tempest-VolumesNegativeTest-657120278 tempest-VolumesNegativeTest-657120278-project-member] [instance: 0b140c11-1a26-4312-9cec-8054582d15f5] Start spawning the instance on the hypervisor. {{(pid=73572) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 10:13:06 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-705d5ae7-e71b-4f5e-95e6-257f7a1a909a tempest-VolumesNegativeTest-657120278 tempest-VolumesNegativeTest-657120278-project-member] [instance: 0b140c11-1a26-4312-9cec-8054582d15f5] Creating instance directory {{(pid=73572) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 10:13:06 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-705d5ae7-e71b-4f5e-95e6-257f7a1a909a tempest-VolumesNegativeTest-657120278 tempest-VolumesNegativeTest-657120278-project-member] [instance: 0b140c11-1a26-4312-9cec-8054582d15f5] Creating image(s)
Aug 26 10:13:06 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-705d5ae7-e71b-4f5e-95e6-257f7a1a909a tempest-VolumesNegativeTest-657120278 tempest-VolumesNegativeTest-657120278-project-member] Acquiring lock "/opt/stack/data/nova/instances/0b140c11-1a26-4312-9cec-8054582d15f5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:13:06 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-705d5ae7-e71b-4f5e-95e6-257f7a1a909a tempest-VolumesNegativeTest-657120278 tempest-VolumesNegativeTest-657120278-project-member] Lock "/opt/stack/data/nova/instances/0b140c11-1a26-4312-9cec-8054582d15f5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:13:06 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-705d5ae7-e71b-4f5e-95e6-257f7a1a909a tempest-VolumesNegativeTest-657120278 tempest-VolumesNegativeTest-657120278-project-member] Lock "/opt/stack/data/nova/instances/0b140c11-1a26-4312-9cec-8054582d15f5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:13:06 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-705d5ae7-e71b-4f5e-95e6-257f7a1a909a tempest-VolumesNegativeTest-657120278 tempest-VolumesNegativeTest-657120278-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:13:06 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-705d5ae7-e71b-4f5e-95e6-257f7a1a909a tempest-VolumesNegativeTest-657120278 tempest-VolumesNegativeTest-657120278-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json" returned: 0 in 0.186s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:13:06 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-705d5ae7-e71b-4f5e-95e6-257f7a1a909a tempest-VolumesNegativeTest-657120278 tempest-VolumesNegativeTest-657120278-project-member] Acquiring lock "2099350d6f3bcd0de9471c73862d4fe75b049801" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:13:06 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-705d5ae7-e71b-4f5e-95e6-257f7a1a909a tempest-VolumesNegativeTest-657120278 tempest-VolumesNegativeTest-657120278-project-member] Lock "2099350d6f3bcd0de9471c73862d4fe75b049801" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:13:06 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-705d5ae7-e71b-4f5e-95e6-257f7a1a909a tempest-VolumesNegativeTest-657120278 tempest-VolumesNegativeTest-657120278-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:13:06 user nova-compute[73572]: DEBUG nova.policy [None req-705d5ae7-e71b-4f5e-95e6-257f7a1a909a tempest-VolumesNegativeTest-657120278 tempest-VolumesNegativeTest-657120278-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1a781dc000ee4d5d932181bdf18726ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a94e3a8c40044a7b172fafaf1b0e0b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73572) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 10:13:06 user nova-compute[73572]: DEBUG nova.network.neutron [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] [instance: 83670c16-3566-4679-8e74-c6451c840315] Updating instance_info_cache with network_info: [{"id": "71be4c62-7219-45ca-8047-ab6716b37f6a", "address": "fa:16:3e:5b:5d:84", "network": {"id": "0a1bb03e-917c-4df5-84cc-bd7729b69ab6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-258329362-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9de7931c97d448eaa26d295386b3a999", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71be4c62-72", "ovs_interfaceid": "71be4c62-7219-45ca-8047-ab6716b37f6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "84bf04a4-b563-48c5-aa73-5b54cbb4887f", "address": "fa:16:3e:e2:c6:ae", "network": {"id": "e194b396-7c3f-41f3-99b2-f82b55c779f2", "bridge": "br-int", "label": "tempest-device-tagging-net1-1768943373", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.226", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9de7931c97d448eaa26d295386b3a999", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84bf04a4-b5", "ovs_interfaceid": "84bf04a4-b563-48c5-aa73-5b54cbb4887f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f4d684f0-2fe0-46e6-8f84-e2c0918a5a82", "address": "fa:16:3e:a6:7f:bd", "network": {"id": "e194b396-7c3f-41f3-99b2-f82b55c779f2", "bridge": "br-int", "label": "tempest-device-tagging-net1-1768943373", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.191", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9de7931c97d448eaa26d295386b3a999", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4d684f0-2f", "ovs_interfaceid": "f4d684f0-2fe0-46e6-8f84-e2c0918a5a82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "41a7ee04-5b67-4da6-a543-0d15187e5813", "address": "fa:16:3e:32:50:ef", "network": {"id": "e194b396-7c3f-41f3-99b2-f82b55c779f2", "bridge": "br-int", "label": "tempest-device-tagging-net1-1768943373", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.158", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9de7931c97d448eaa26d295386b3a999", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41a7ee04-5b", "ovs_interfaceid": "41a7ee04-5b67-4da6-a543-0d15187e5813", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "422eb7ef-4540-462b-a485-afdc38ebccd0", "address": "fa:16:3e:79:44:99", "network": {"id": "e194b396-7c3f-41f3-99b2-f82b55c779f2", "bridge": "br-int", "label": "tempest-device-tagging-net1-1768943373", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9de7931c97d448eaa26d295386b3a999", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap422eb7ef-45", "ovs_interfaceid": "422eb7ef-4540-462b-a485-afdc38ebccd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5e85b3cc-9fe4-46aa-a43f-d4acc5ca3c73", "address": "fa:16:3e:fd:33:d1", "network": {"id": "2cfbe057-f10f-4b28-b3bf-98b2ef5103d7", "bridge": "br-int", "label": "tempest-device-tagging-net2-598168548", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9de7931c97d448eaa26d295386b3a999", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e85b3cc-9f", "ovs_interfaceid": "5e85b3cc-9fe4-46aa-a43f-d4acc5ca3c73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7b7b7362-9dcc-48da-ad4e-9141c676839e", "address": "fa:16:3e:0b:b5:3a", "network": {"id": "2cfbe057-f10f-4b28-b3bf-98b2ef5103d7", "bridge": "br-int", "label": "tempest-device-tagging-net2-598168548", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9de7931c97d448eaa26d295386b3a999", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b7b7362-9d", "ovs_interfaceid": "7b7b7362-9dcc-48da-ad4e-9141c676839e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:13:06 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] Releasing lock "refresh_cache-83670c16-3566-4679-8e74-c6451c840315" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:13:06 user nova-compute[73572]: DEBUG nova.compute.manager [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] [instance: 83670c16-3566-4679-8e74-c6451c840315] Instance network_info: |[{"id": "71be4c62-7219-45ca-8047-ab6716b37f6a", "address": "fa:16:3e:5b:5d:84", "network": {"id": "0a1bb03e-917c-4df5-84cc-bd7729b69ab6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-258329362-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9de7931c97d448eaa26d295386b3a999", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71be4c62-72", "ovs_interfaceid": "71be4c62-7219-45ca-8047-ab6716b37f6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "84bf04a4-b563-48c5-aa73-5b54cbb4887f", "address": "fa:16:3e:e2:c6:ae", "network": {"id": "e194b396-7c3f-41f3-99b2-f82b55c779f2", "bridge": "br-int", "label": "tempest-device-tagging-net1-1768943373", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.226", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9de7931c97d448eaa26d295386b3a999", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84bf04a4-b5", "ovs_interfaceid": "84bf04a4-b563-48c5-aa73-5b54cbb4887f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f4d684f0-2fe0-46e6-8f84-e2c0918a5a82", "address": "fa:16:3e:a6:7f:bd", "network": {"id": "e194b396-7c3f-41f3-99b2-f82b55c779f2", "bridge": "br-int", "label": "tempest-device-tagging-net1-1768943373", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.191", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9de7931c97d448eaa26d295386b3a999", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4d684f0-2f", "ovs_interfaceid": "f4d684f0-2fe0-46e6-8f84-e2c0918a5a82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "41a7ee04-5b67-4da6-a543-0d15187e5813", "address": "fa:16:3e:32:50:ef", "network": {"id": "e194b396-7c3f-41f3-99b2-f82b55c779f2", "bridge": "br-int", "label": "tempest-device-tagging-net1-1768943373", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.158", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9de7931c97d448eaa26d295386b3a999", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41a7ee04-5b", "ovs_interfaceid": "41a7ee04-5b67-4da6-a543-0d15187e5813", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "422eb7ef-4540-462b-a485-afdc38ebccd0", "address": "fa:16:3e:79:44:99", "network": {"id": "e194b396-7c3f-41f3-99b2-f82b55c779f2", "bridge": "br-int", "label": "tempest-device-tagging-net1-1768943373", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9de7931c97d448eaa26d295386b3a999", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap422eb7ef-45", "ovs_interfaceid": "422eb7ef-4540-462b-a485-afdc38ebccd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5e85b3cc-9fe4-46aa-a43f-d4acc5ca3c73", "address": "fa:16:3e:fd:33:d1", "network": {"id": "2cfbe057-f10f-4b28-b3bf-98b2ef5103d7", "bridge": "br-int", "label": "tempest-device-tagging-net2-598168548", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9de7931c97d448eaa26d295386b3a999", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e85b3cc-9f", "ovs_interfaceid": "5e85b3cc-9fe4-46aa-a43f-d4acc5ca3c73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7b7b7362-9dcc-48da-ad4e-9141c676839e", "address": "fa:16:3e:0b:b5:3a", "network": {"id": "2cfbe057-f10f-4b28-b3bf-98b2ef5103d7", "bridge": "br-int", "label": "tempest-device-tagging-net2-598168548", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9de7931c97d448eaa26d295386b3a999", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b7b7362-9d", "ovs_interfaceid": "7b7b7362-9dcc-48da-ad4e-9141c676839e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73572) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 10:13:06 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-09669d9f-caa8-4c0f-9584-dd448d8b6669 req-c7403aaf-d179-4f74-9d9b-7c3390240a13 service nova] Acquired lock "refresh_cache-83670c16-3566-4679-8e74-c6451c840315" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:13:06 user nova-compute[73572]: DEBUG nova.network.neutron [req-09669d9f-caa8-4c0f-9584-dd448d8b6669 req-c7403aaf-d179-4f74-9d9b-7c3390240a13 service nova] [instance: 83670c16-3566-4679-8e74-c6451c840315] Refreshing network info cache for port 7b7b7362-9dcc-48da-ad4e-9141c676839e {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 10:13:06 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-705d5ae7-e71b-4f5e-95e6-257f7a1a909a tempest-VolumesNegativeTest-657120278 tempest-VolumesNegativeTest-657120278-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json" returned: 0 in 0.225s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:13:06 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-705d5ae7-e71b-4f5e-95e6-257f7a1a909a tempest-VolumesNegativeTest-657120278 tempest-VolumesNegativeTest-657120278-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801,backing_fmt=raw /opt/stack/data/nova/instances/0b140c11-1a26-4312-9cec-8054582d15f5/disk 1073741824 {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:13:06 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-705d5ae7-e71b-4f5e-95e6-257f7a1a909a tempest-VolumesNegativeTest-657120278 tempest-VolumesNegativeTest-657120278-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801,backing_fmt=raw /opt/stack/data/nova/instances/0b140c11-1a26-4312-9cec-8054582d15f5/disk 1073741824" returned: 0 in 0.055s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:13:06 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-705d5ae7-e71b-4f5e-95e6-257f7a1a909a tempest-VolumesNegativeTest-657120278 tempest-VolumesNegativeTest-657120278-project-member] Lock "2099350d6f3bcd0de9471c73862d4fe75b049801" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.294s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:13:06 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-705d5ae7-e71b-4f5e-95e6-257f7a1a909a tempest-VolumesNegativeTest-657120278 tempest-VolumesNegativeTest-657120278-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:13:06 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-705d5ae7-e71b-4f5e-95e6-257f7a1a909a tempest-VolumesNegativeTest-657120278 tempest-VolumesNegativeTest-657120278-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json" returned: 0 in 0.238s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:13:06 user nova-compute[73572]: DEBUG nova.virt.disk.api [None req-705d5ae7-e71b-4f5e-95e6-257f7a1a909a tempest-VolumesNegativeTest-657120278 tempest-VolumesNegativeTest-657120278-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0b140c11-1a26-4312-9cec-8054582d15f5/disk. size=1073741824 {{(pid=73572) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 10:13:06 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-705d5ae7-e71b-4f5e-95e6-257f7a1a909a tempest-VolumesNegativeTest-657120278 tempest-VolumesNegativeTest-657120278-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b140c11-1a26-4312-9cec-8054582d15f5/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:13:07 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-705d5ae7-e71b-4f5e-95e6-257f7a1a909a tempest-VolumesNegativeTest-657120278 tempest-VolumesNegativeTest-657120278-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b140c11-1a26-4312-9cec-8054582d15f5/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:13:07 user nova-compute[73572]: DEBUG nova.virt.disk.api [None req-705d5ae7-e71b-4f5e-95e6-257f7a1a909a tempest-VolumesNegativeTest-657120278 tempest-VolumesNegativeTest-657120278-project-member] Cannot resize image /opt/stack/data/nova/instances/0b140c11-1a26-4312-9cec-8054582d15f5/disk to a smaller size. {{(pid=73572) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 10:13:07 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-705d5ae7-e71b-4f5e-95e6-257f7a1a909a tempest-VolumesNegativeTest-657120278 tempest-VolumesNegativeTest-657120278-project-member] [instance: 0b140c11-1a26-4312-9cec-8054582d15f5] Created local disks {{(pid=73572) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 10:13:07 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-705d5ae7-e71b-4f5e-95e6-257f7a1a909a tempest-VolumesNegativeTest-657120278 tempest-VolumesNegativeTest-657120278-project-member] [instance: 0b140c11-1a26-4312-9cec-8054582d15f5] Ensure instance console log exists: /opt/stack/data/nova/instances/0b140c11-1a26-4312-9cec-8054582d15f5/console.log {{(pid=73572) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 10:13:07 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-705d5ae7-e71b-4f5e-95e6-257f7a1a909a tempest-VolumesNegativeTest-657120278 tempest-VolumesNegativeTest-657120278-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:13:07 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-705d5ae7-e71b-4f5e-95e6-257f7a1a909a tempest-VolumesNegativeTest-657120278 tempest-VolumesNegativeTest-657120278-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:13:07 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-705d5ae7-e71b-4f5e-95e6-257f7a1a909a tempest-VolumesNegativeTest-657120278 tempest-VolumesNegativeTest-657120278-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:13:07 user nova-compute[73572]: DEBUG nova.network.neutron [req-09669d9f-caa8-4c0f-9584-dd448d8b6669 req-c7403aaf-d179-4f74-9d9b-7c3390240a13 service nova] [instance: 83670c16-3566-4679-8e74-c6451c840315] Updated VIF entry in instance network info cache for port 7b7b7362-9dcc-48da-ad4e-9141c676839e. {{(pid=73572) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 10:13:07 user nova-compute[73572]: DEBUG nova.network.neutron [req-09669d9f-caa8-4c0f-9584-dd448d8b6669 req-c7403aaf-d179-4f74-9d9b-7c3390240a13 service nova] [instance: 83670c16-3566-4679-8e74-c6451c840315] Updating instance_info_cache with network_info: [{"id": "71be4c62-7219-45ca-8047-ab6716b37f6a", "address": "fa:16:3e:5b:5d:84", "network": {"id": "0a1bb03e-917c-4df5-84cc-bd7729b69ab6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-258329362-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9de7931c97d448eaa26d295386b3a999", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71be4c62-72", "ovs_interfaceid": "71be4c62-7219-45ca-8047-ab6716b37f6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "84bf04a4-b563-48c5-aa73-5b54cbb4887f", "address": "fa:16:3e:e2:c6:ae", "network": {"id": "e194b396-7c3f-41f3-99b2-f82b55c779f2", "bridge": "br-int", "label": "tempest-device-tagging-net1-1768943373", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.226", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9de7931c97d448eaa26d295386b3a999", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84bf04a4-b5", "ovs_interfaceid": "84bf04a4-b563-48c5-aa73-5b54cbb4887f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f4d684f0-2fe0-46e6-8f84-e2c0918a5a82", "address": "fa:16:3e:a6:7f:bd", "network": {"id": "e194b396-7c3f-41f3-99b2-f82b55c779f2", "bridge": "br-int", "label": "tempest-device-tagging-net1-1768943373", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.191", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9de7931c97d448eaa26d295386b3a999", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4d684f0-2f", "ovs_interfaceid": "f4d684f0-2fe0-46e6-8f84-e2c0918a5a82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "41a7ee04-5b67-4da6-a543-0d15187e5813", "address": "fa:16:3e:32:50:ef", "network": {"id": "e194b396-7c3f-41f3-99b2-f82b55c779f2", "bridge": "br-int", "label": "tempest-device-tagging-net1-1768943373", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.158", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9de7931c97d448eaa26d295386b3a999", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41a7ee04-5b", "ovs_interfaceid": "41a7ee04-5b67-4da6-a543-0d15187e5813", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "422eb7ef-4540-462b-a485-afdc38ebccd0", "address": "fa:16:3e:79:44:99", "network": {"id": "e194b396-7c3f-41f3-99b2-f82b55c779f2", "bridge": "br-int", "label": "tempest-device-tagging-net1-1768943373", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9de7931c97d448eaa26d295386b3a999", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap422eb7ef-45", "ovs_interfaceid": "422eb7ef-4540-462b-a485-afdc38ebccd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5e85b3cc-9fe4-46aa-a43f-d4acc5ca3c73", "address": "fa:16:3e:fd:33:d1", "network": {"id": "2cfbe057-f10f-4b28-b3bf-98b2ef5103d7", "bridge": "br-int", "label": "tempest-device-tagging-net2-598168548", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9de7931c97d448eaa26d295386b3a999", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e85b3cc-9f", "ovs_interfaceid": "5e85b3cc-9fe4-46aa-a43f-d4acc5ca3c73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7b7b7362-9dcc-48da-ad4e-9141c676839e", "address": "fa:16:3e:0b:b5:3a", "network": {"id": "2cfbe057-f10f-4b28-b3bf-98b2ef5103d7", "bridge": "br-int", "label": "tempest-device-tagging-net2-598168548", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9de7931c97d448eaa26d295386b3a999", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b7b7362-9d", "ovs_interfaceid": "7b7b7362-9dcc-48da-ad4e-9141c676839e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:13:07 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-09669d9f-caa8-4c0f-9584-dd448d8b6669 req-c7403aaf-d179-4f74-9d9b-7c3390240a13 service nova] Releasing lock "refresh_cache-83670c16-3566-4679-8e74-c6451c840315" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:13:07 user nova-compute[73572]: DEBUG nova.network.neutron [None req-705d5ae7-e71b-4f5e-95e6-257f7a1a909a tempest-VolumesNegativeTest-657120278 tempest-VolumesNegativeTest-657120278-project-member] [instance: 0b140c11-1a26-4312-9cec-8054582d15f5] Successfully created port: d8aac17a-7f10-44bf-ab6d-c7105bf7fa02 {{(pid=73572) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 10:13:07 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:13:07 user nova-compute[73572]: INFO nova.virt.block_device [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] [instance: 83670c16-3566-4679-8e74-c6451c840315] Booting with volume 85988ff4-7fac-4a96-a502-74d6ca8189fe at /dev/vdb
Aug 26 10:13:07 user nova-compute[73572]: DEBUG os_brick.utils [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 10:13:07 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:13:07 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:13:07 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[62071b73-d774-4ff1-a1f3-a995520c6f15]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:de8a79ed912\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:13:07 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:13:07 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:13:07 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc6a1060-a183-4f0e-bdd1-a912711550e9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:13:07 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:13:07 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:13:07 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[1175b272-08b7-4456-9846-ed7ce4fb154c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:13:07 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[649d6e28-2c58-484e-9729-abc673bbc21e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:13:07 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] Running cmd (subprocess): nvme version {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:13:07 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] 'nvme version' failed. Not Retrying. {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 10:13:07 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] nvme not present on system {{(pid=73572) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 10:13:07 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:13:07 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 10:13:07 user nova-compute[73572]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 10:13:07 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d351e3b-9c93-46fe-bf80-1df75b145074]: (4, '') {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:13:07 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.lightos [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73572) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 10:13:07 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.lightos [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73572) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 10:13:07 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.lightos [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] LIGHTOS: no hostnqn found. {{(pid=73572) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 10:13:07 user nova-compute[73572]: DEBUG os_brick.utils [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:de8a79ed912', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 10:13:07 user nova-compute[73572]: DEBUG nova.virt.block_device [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] [instance: 83670c16-3566-4679-8e74-c6451c840315] Updating existing volume attachment record: e343cee7-ea44-47f9-92a4-ce437541950b {{(pid=73572) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 10:13:07 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:13:07 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:13:07 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:13:07 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:13:07 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73572) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 10:13:07 user nova-compute[73572]: DEBUG nova.network.neutron [None req-705d5ae7-e71b-4f5e-95e6-257f7a1a909a tempest-VolumesNegativeTest-657120278 tempest-VolumesNegativeTest-657120278-project-member] [instance: 0b140c11-1a26-4312-9cec-8054582d15f5] Successfully updated port: d8aac17a-7f10-44bf-ab6d-c7105bf7fa02 {{(pid=73572) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 10:13:07 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-705d5ae7-e71b-4f5e-95e6-257f7a1a909a tempest-VolumesNegativeTest-657120278 tempest-VolumesNegativeTest-657120278-project-member] Acquiring lock "refresh_cache-0b140c11-1a26-4312-9cec-8054582d15f5" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:13:07 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-705d5ae7-e71b-4f5e-95e6-257f7a1a909a tempest-VolumesNegativeTest-657120278 tempest-VolumesNegativeTest-657120278-project-member] Acquired lock "refresh_cache-0b140c11-1a26-4312-9cec-8054582d15f5" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:13:07 user nova-compute[73572]: DEBUG nova.network.neutron [None req-705d5ae7-e71b-4f5e-95e6-257f7a1a909a tempest-VolumesNegativeTest-657120278 tempest-VolumesNegativeTest-657120278-project-member] [instance: 0b140c11-1a26-4312-9cec-8054582d15f5] Building network info cache for instance {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 10:13:07 user nova-compute[73572]: DEBUG nova.compute.manager [req-dc73fd65-7dee-4d83-a111-74b0d083e4cd req-5ff96f53-e8c2-4d49-beef-7ecf40308e59 service nova] [instance: 0b140c11-1a26-4312-9cec-8054582d15f5] Received event network-changed-d8aac17a-7f10-44bf-ab6d-c7105bf7fa02 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:13:07 user nova-compute[73572]: DEBUG nova.compute.manager [req-dc73fd65-7dee-4d83-a111-74b0d083e4cd req-5ff96f53-e8c2-4d49-beef-7ecf40308e59 service nova] [instance: 0b140c11-1a26-4312-9cec-8054582d15f5] Refreshing instance network info cache due to event network-changed-d8aac17a-7f10-44bf-ab6d-c7105bf7fa02. {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 10:13:07 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-dc73fd65-7dee-4d83-a111-74b0d083e4cd req-5ff96f53-e8c2-4d49-beef-7ecf40308e59 service nova] Acquiring lock "refresh_cache-0b140c11-1a26-4312-9cec-8054582d15f5" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:13:08 user nova-compute[73572]: DEBUG nova.network.neutron [None req-705d5ae7-e71b-4f5e-95e6-257f7a1a909a tempest-VolumesNegativeTest-657120278 tempest-VolumesNegativeTest-657120278-project-member] [instance: 0b140c11-1a26-4312-9cec-8054582d15f5] Instance cache missing network info. {{(pid=73572) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 10:13:08 user nova-compute[73572]: DEBUG nova.network.neutron [None req-705d5ae7-e71b-4f5e-95e6-257f7a1a909a tempest-VolumesNegativeTest-657120278 tempest-VolumesNegativeTest-657120278-project-member] [instance: 0b140c11-1a26-4312-9cec-8054582d15f5] Updating instance_info_cache with network_info: [{"id": "d8aac17a-7f10-44bf-ab6d-c7105bf7fa02", "address": "fa:16:3e:b5:26:69", "network": {"id": "52e6a145-3658-4741-83a6-d3edf9e3b24b", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.115", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "5c995f8bbbab4368b67a253e0df3971a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8aac17a-7f", "ovs_interfaceid": "d8aac17a-7f10-44bf-ab6d-c7105bf7fa02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:13:08 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-705d5ae7-e71b-4f5e-95e6-257f7a1a909a tempest-VolumesNegativeTest-657120278 tempest-VolumesNegativeTest-657120278-project-member] Releasing lock "refresh_cache-0b140c11-1a26-4312-9cec-8054582d15f5" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:13:08 user nova-compute[73572]: DEBUG nova.compute.manager [None req-705d5ae7-e71b-4f5e-95e6-257f7a1a909a tempest-VolumesNegativeTest-657120278 tempest-VolumesNegativeTest-657120278-project-member] [instance: 0b140c11-1a26-4312-9cec-8054582d15f5] Instance network_info: |[{"id": "d8aac17a-7f10-44bf-ab6d-c7105bf7fa02", "address": "fa:16:3e:b5:26:69", "network": {"id": "52e6a145-3658-4741-83a6-d3edf9e3b24b", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.115", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "5c995f8bbbab4368b67a253e0df3971a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8aac17a-7f", "ovs_interfaceid": "d8aac17a-7f10-44bf-ab6d-c7105bf7fa02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73572) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 10:13:08 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-dc73fd65-7dee-4d83-a111-74b0d083e4cd req-5ff96f53-e8c2-4d49-beef-7ecf40308e59 service nova] Acquired lock "refresh_cache-0b140c11-1a26-4312-9cec-8054582d15f5" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:13:08 user nova-compute[73572]: DEBUG nova.network.neutron [req-dc73fd65-7dee-4d83-a111-74b0d083e4cd req-5ff96f53-e8c2-4d49-beef-7ecf40308e59 service nova] [instance: 0b140c11-1a26-4312-9cec-8054582d15f5] Refreshing network info cache for port d8aac17a-7f10-44bf-ab6d-c7105bf7fa02 {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 10:13:08 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-705d5ae7-e71b-4f5e-95e6-257f7a1a909a tempest-VolumesNegativeTest-657120278 tempest-VolumesNegativeTest-657120278-project-member] [instance: 0b140c11-1a26-4312-9cec-8054582d15f5] Start _get_guest_xml network_info=[{"id": "d8aac17a-7f10-44bf-ab6d-c7105bf7fa02", "address": "fa:16:3e:b5:26:69", "network": {"id": "52e6a145-3658-4741-83a6-d3edf9e3b24b", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.115", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "5c995f8bbbab4368b67a253e0df3971a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8aac17a-7f", "ovs_interfaceid": "d8aac17a-7f10-44bf-ab6d-c7105bf7fa02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T10:07:33Z,direct_url=<?>,disk_format='qcow2',id=299da0c9-e1c4-48f0-be55-fbe20dd06bc9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5c995f8bbbab4368b67a253e0df3971a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T10:07:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'guest_format': None, 'size': 0, 'encryption_format': None, 'device_type': 'disk', 'image_id': '299da0c9-e1c4-48f0-be55-fbe20dd06bc9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73572) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 10:13:08 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-705d5ae7-e71b-4f5e-95e6-257f7a1a909a tempest-VolumesNegativeTest-657120278 tempest-VolumesNegativeTest-657120278-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:13:08 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-705d5ae7-e71b-4f5e-95e6-257f7a1a909a tempest-VolumesNegativeTest-657120278 tempest-VolumesNegativeTest-657120278-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:13:08 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-705d5ae7-e71b-4f5e-95e6-257f7a1a909a tempest-VolumesNegativeTest-657120278 tempest-VolumesNegativeTest-657120278-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73572) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 10:13:08 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-705d5ae7-e71b-4f5e-95e6-257f7a1a909a tempest-VolumesNegativeTest-657120278 tempest-VolumesNegativeTest-657120278-project-member] CPU controller missing on host. {{(pid=73572) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 10:13:08 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-705d5ae7-e71b-4f5e-95e6-257f7a1a909a tempest-VolumesNegativeTest-657120278 tempest-VolumesNegativeTest-657120278-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73572) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 10:13:08 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-705d5ae7-e71b-4f5e-95e6-257f7a1a909a tempest-VolumesNegativeTest-657120278 tempest-VolumesNegativeTest-657120278-project-member] CPU controller found on host. {{(pid=73572) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 10:13:08 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-705d5ae7-e71b-4f5e-95e6-257f7a1a909a tempest-VolumesNegativeTest-657120278 tempest-VolumesNegativeTest-657120278-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73572) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 10:13:08 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-705d5ae7-e71b-4f5e-95e6-257f7a1a909a tempest-VolumesNegativeTest-657120278 tempest-VolumesNegativeTest-657120278-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T10:07:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T10:07:33Z,direct_url=<?>,disk_format='qcow2',id=299da0c9-e1c4-48f0-be55-fbe20dd06bc9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5c995f8bbbab4368b67a253e0df3971a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T10:07:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 10:13:08 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-705d5ae7-e71b-4f5e-95e6-257f7a1a909a tempest-VolumesNegativeTest-657120278 tempest-VolumesNegativeTest-657120278-project-member] Flavor limits 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 10:13:08 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-705d5ae7-e71b-4f5e-95e6-257f7a1a909a tempest-VolumesNegativeTest-657120278 tempest-VolumesNegativeTest-657120278-project-member] Image limits 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 10:13:08 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-705d5ae7-e71b-4f5e-95e6-257f7a1a909a tempest-VolumesNegativeTest-657120278 tempest-VolumesNegativeTest-657120278-project-member] Flavor pref 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 10:13:08 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-705d5ae7-e71b-4f5e-95e6-257f7a1a909a tempest-VolumesNegativeTest-657120278 tempest-VolumesNegativeTest-657120278-project-member] Image pref 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 10:13:08 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-705d5ae7-e71b-4f5e-95e6-257f7a1a909a tempest-VolumesNegativeTest-657120278 tempest-VolumesNegativeTest-657120278-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 10:13:08 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-705d5ae7-e71b-4f5e-95e6-257f7a1a909a tempest-VolumesNegativeTest-657120278 tempest-VolumesNegativeTest-657120278-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 10:13:08 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-705d5ae7-e71b-4f5e-95e6-257f7a1a909a tempest-VolumesNegativeTest-657120278 tempest-VolumesNegativeTest-657120278-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73572) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 10:13:08 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-705d5ae7-e71b-4f5e-95e6-257f7a1a909a tempest-VolumesNegativeTest-657120278 tempest-VolumesNegativeTest-657120278-project-member] Got 1 possible topologies {{(pid=73572) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 10:13:08 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-705d5ae7-e71b-4f5e-95e6-257f7a1a909a tempest-VolumesNegativeTest-657120278 tempest-VolumesNegativeTest-657120278-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 10:13:08 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-705d5ae7-e71b-4f5e-95e6-257f7a1a909a tempest-VolumesNegativeTest-657120278 tempest-VolumesNegativeTest-657120278-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 10:13:08 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-705d5ae7-e71b-4f5e-95e6-257f7a1a909a tempest-VolumesNegativeTest-657120278 tempest-VolumesNegativeTest-657120278-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T10:13:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-87296491',display_name='tempest-VolumesNegativeTest-instance-87296491',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-87296491',id=10,image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3a94e3a8c40044a7b172fafaf1b0e0b4',ramdisk_id='',reservation_id='r-vsp7bycm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-657120278',owner_user_name='tempest-VolumesNegativeTest-657120278-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T10:13:06Z,user_data=None,user_id='1a781dc000ee4d5d932181bdf18726ba',uuid=0b140c11-1a26-4312-9cec-8054582d15f5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d8aac17a-7f10-44bf-ab6d-c7105bf7fa02", "address": "fa:16:3e:b5:26:69", "network": {"id": "52e6a145-3658-4741-83a6-d3edf9e3b24b", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.115", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "5c995f8bbbab4368b67a253e0df3971a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8aac17a-7f", "ovs_interfaceid": "d8aac17a-7f10-44bf-ab6d-c7105bf7fa02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73572) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 10:13:08 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-705d5ae7-e71b-4f5e-95e6-257f7a1a909a tempest-VolumesNegativeTest-657120278 tempest-VolumesNegativeTest-657120278-project-member] Converting VIF {"id": "d8aac17a-7f10-44bf-ab6d-c7105bf7fa02", "address": "fa:16:3e:b5:26:69", "network": {"id": "52e6a145-3658-4741-83a6-d3edf9e3b24b", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.115", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "5c995f8bbbab4368b67a253e0df3971a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8aac17a-7f", "ovs_interfaceid": "d8aac17a-7f10-44bf-ab6d-c7105bf7fa02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:13:08 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-705d5ae7-e71b-4f5e-95e6-257f7a1a909a tempest-VolumesNegativeTest-657120278 tempest-VolumesNegativeTest-657120278-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:26:69,bridge_name='br-int',has_traffic_filtering=True,id=d8aac17a-7f10-44bf-ab6d-c7105bf7fa02,network=Network(52e6a145-3658-4741-83a6-d3edf9e3b24b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8aac17a-7f') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:13:08 user nova-compute[73572]: DEBUG nova.objects.instance [None req-705d5ae7-e71b-4f5e-95e6-257f7a1a909a tempest-VolumesNegativeTest-657120278 tempest-VolumesNegativeTest-657120278-project-member] Lazy-loading 'pci_devices' on Instance uuid 0b140c11-1a26-4312-9cec-8054582d15f5 {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:13:08 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-705d5ae7-e71b-4f5e-95e6-257f7a1a909a tempest-VolumesNegativeTest-657120278 tempest-VolumesNegativeTest-657120278-project-member] [instance: 0b140c11-1a26-4312-9cec-8054582d15f5] End _get_guest_xml xml=<domain type="kvm">
Aug 26 10:13:08 user nova-compute[73572]:   <uuid>0b140c11-1a26-4312-9cec-8054582d15f5</uuid>
Aug 26 10:13:08 user nova-compute[73572]:   <name>instance-0000000a</name>
Aug 26 10:13:08 user nova-compute[73572]:   <memory>524288</memory>
Aug 26 10:13:08 user nova-compute[73572]:   <vcpu>1</vcpu>
Aug 26 10:13:08 user nova-compute[73572]:   <metadata>
Aug 26 10:13:08 user nova-compute[73572]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 10:13:08 user nova-compute[73572]:       <nova:package version="0.0.0"/>
Aug 26 10:13:08 user nova-compute[73572]:       <nova:name>tempest-VolumesNegativeTest-instance-87296491</nova:name>
Aug 26 10:13:08 user nova-compute[73572]:       <nova:creationTime>2023-08-26 10:13:08</nova:creationTime>
Aug 26 10:13:08 user nova-compute[73572]:       <nova:flavor name="m1.tiny">
Aug 26 10:13:08 user nova-compute[73572]:         <nova:memory>512</nova:memory>
Aug 26 10:13:08 user nova-compute[73572]:         <nova:disk>1</nova:disk>
Aug 26 10:13:08 user nova-compute[73572]:         <nova:swap>0</nova:swap>
Aug 26 10:13:08 user nova-compute[73572]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 10:13:08 user nova-compute[73572]:         <nova:vcpus>1</nova:vcpus>
Aug 26 10:13:08 user nova-compute[73572]:       </nova:flavor>
Aug 26 10:13:08 user nova-compute[73572]:       <nova:owner>
Aug 26 10:13:08 user nova-compute[73572]:         <nova:user uuid="1a781dc000ee4d5d932181bdf18726ba">tempest-VolumesNegativeTest-657120278-project-member</nova:user>
Aug 26 10:13:08 user nova-compute[73572]:         <nova:project uuid="3a94e3a8c40044a7b172fafaf1b0e0b4">tempest-VolumesNegativeTest-657120278</nova:project>
Aug 26 10:13:08 user nova-compute[73572]:       </nova:owner>
Aug 26 10:13:08 user nova-compute[73572]:       <nova:root type="image" uuid="299da0c9-e1c4-48f0-be55-fbe20dd06bc9"/>
Aug 26 10:13:08 user nova-compute[73572]:       <nova:ports>
Aug 26 10:13:08 user nova-compute[73572]:         <nova:port uuid="d8aac17a-7f10-44bf-ab6d-c7105bf7fa02">
Aug 26 10:13:08 user nova-compute[73572]:           <nova:ip type="fixed" address="192.168.233.115" ipVersion="4"/>
Aug 26 10:13:08 user nova-compute[73572]:         </nova:port>
Aug 26 10:13:08 user nova-compute[73572]:       </nova:ports>
Aug 26 10:13:08 user nova-compute[73572]:     </nova:instance>
Aug 26 10:13:08 user nova-compute[73572]:   </metadata>
Aug 26 10:13:08 user nova-compute[73572]:   <sysinfo type="smbios">
Aug 26 10:13:08 user nova-compute[73572]:     <system>
Aug 26 10:13:08 user nova-compute[73572]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 10:13:08 user nova-compute[73572]:       <entry name="product">OpenStack Nova</entry>
Aug 26 10:13:08 user nova-compute[73572]:       <entry name="version">0.0.0</entry>
Aug 26 10:13:08 user nova-compute[73572]:       <entry name="serial">0b140c11-1a26-4312-9cec-8054582d15f5</entry>
Aug 26 10:13:08 user nova-compute[73572]:       <entry name="uuid">0b140c11-1a26-4312-9cec-8054582d15f5</entry>
Aug 26 10:13:08 user nova-compute[73572]:       <entry name="family">Virtual Machine</entry>
Aug 26 10:13:08 user nova-compute[73572]:     </system>
Aug 26 10:13:08 user nova-compute[73572]:   </sysinfo>
Aug 26 10:13:08 user nova-compute[73572]:   <os>
Aug 26 10:13:08 user nova-compute[73572]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 10:13:08 user nova-compute[73572]:     <boot dev="hd"/>
Aug 26 10:13:08 user nova-compute[73572]:     <smbios mode="sysinfo"/>
Aug 26 10:13:08 user nova-compute[73572]:   </os>
Aug 26 10:13:08 user nova-compute[73572]:   <features>
Aug 26 10:13:08 user nova-compute[73572]:     <acpi/>
Aug 26 10:13:08 user nova-compute[73572]:     <apic/>
Aug 26 10:13:08 user nova-compute[73572]:     <vmcoreinfo/>
Aug 26 10:13:08 user nova-compute[73572]:   </features>
Aug 26 10:13:08 user nova-compute[73572]:   <clock offset="utc">
Aug 26 10:13:08 user nova-compute[73572]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 10:13:08 user nova-compute[73572]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 10:13:08 user nova-compute[73572]:     <timer name="hpet" present="no"/>
Aug 26 10:13:08 user nova-compute[73572]:   </clock>
Aug 26 10:13:08 user nova-compute[73572]:   <cpu mode="custom" match="exact">
Aug 26 10:13:08 user nova-compute[73572]:     <model>Nehalem</model>
Aug 26 10:13:08 user nova-compute[73572]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 10:13:08 user nova-compute[73572]:   </cpu>
Aug 26 10:13:08 user nova-compute[73572]:   <devices>
Aug 26 10:13:08 user nova-compute[73572]:     <disk type="file" device="disk">
Aug 26 10:13:08 user nova-compute[73572]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 10:13:08 user nova-compute[73572]:       <source file="/opt/stack/data/nova/instances/0b140c11-1a26-4312-9cec-8054582d15f5/disk"/>
Aug 26 10:13:08 user nova-compute[73572]:       <target dev="vda" bus="virtio"/>
Aug 26 10:13:08 user nova-compute[73572]:     </disk>
Aug 26 10:13:08 user nova-compute[73572]:     <interface type="ethernet">
Aug 26 10:13:08 user nova-compute[73572]:       <mac address="fa:16:3e:b5:26:69"/>
Aug 26 10:13:08 user nova-compute[73572]:       <model type="virtio"/>
Aug 26 10:13:08 user nova-compute[73572]:       <mtu size="1442"/>
Aug 26 10:13:08 user nova-compute[73572]:       <target dev="tapd8aac17a-7f"/>
Aug 26 10:13:08 user nova-compute[73572]:     </interface>
Aug 26 10:13:08 user nova-compute[73572]:     <serial type="pty">
Aug 26 10:13:08 user nova-compute[73572]:       <log file="/opt/stack/data/nova/instances/0b140c11-1a26-4312-9cec-8054582d15f5/console.log" append="off"/>
Aug 26 10:13:08 user nova-compute[73572]:     </serial>
Aug 26 10:13:08 user nova-compute[73572]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 10:13:08 user nova-compute[73572]:     <video>
Aug 26 10:13:08 user nova-compute[73572]:       <model type="virtio"/>
Aug 26 10:13:08 user nova-compute[73572]:     </video>
Aug 26 10:13:08 user nova-compute[73572]:     <rng model="virtio">
Aug 26 10:13:08 user nova-compute[73572]:       <backend model="random">/dev/urandom</backend>
Aug 26 10:13:08 user nova-compute[73572]:     </rng>
Aug 26 10:13:08 user nova-compute[73572]:     <controller type="usb" index="0" model="none"/>
Aug 26 10:13:08 user nova-compute[73572]:     <memballoon model="virtio">
Aug 26 10:13:08 user nova-compute[73572]:       <stats period="10"/>
Aug 26 10:13:08 user nova-compute[73572]:     </memballoon>
Aug 26 10:13:08 user nova-compute[73572]:   </devices>
Aug 26 10:13:08 user nova-compute[73572]: </domain>
Aug 26 10:13:08 user nova-compute[73572]:  {{(pid=73572) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 10:13:08 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-705d5ae7-e71b-4f5e-95e6-257f7a1a909a tempest-VolumesNegativeTest-657120278 tempest-VolumesNegativeTest-657120278-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T10:13:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-87296491',display_name='tempest-VolumesNegativeTest-instance-87296491',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-87296491',id=10,image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3a94e3a8c40044a7b172fafaf1b0e0b4',ramdisk_id='',reservation_id='r-vsp7bycm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-657120278',owner_user_name='tempest-VolumesNegativeTest-657120278-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T10:13:06Z,user_data=None,user_id='1a781dc000ee4d5d932181bdf18726ba',uuid=0b140c11-1a26-4312-9cec-8054582d15f5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d8aac17a-7f10-44bf-ab6d-c7105bf7fa02", "address": "fa:16:3e:b5:26:69", "network": {"id": "52e6a145-3658-4741-83a6-d3edf9e3b24b", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.115", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "5c995f8bbbab4368b67a253e0df3971a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8aac17a-7f", "ovs_interfaceid": "d8aac17a-7f10-44bf-ab6d-c7105bf7fa02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 10:13:08 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-705d5ae7-e71b-4f5e-95e6-257f7a1a909a tempest-VolumesNegativeTest-657120278 tempest-VolumesNegativeTest-657120278-project-member] Converting VIF {"id": "d8aac17a-7f10-44bf-ab6d-c7105bf7fa02", "address": "fa:16:3e:b5:26:69", "network": {"id": "52e6a145-3658-4741-83a6-d3edf9e3b24b", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.115", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "5c995f8bbbab4368b67a253e0df3971a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8aac17a-7f", "ovs_interfaceid": "d8aac17a-7f10-44bf-ab6d-c7105bf7fa02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:13:08 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-705d5ae7-e71b-4f5e-95e6-257f7a1a909a tempest-VolumesNegativeTest-657120278 tempest-VolumesNegativeTest-657120278-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:26:69,bridge_name='br-int',has_traffic_filtering=True,id=d8aac17a-7f10-44bf-ab6d-c7105bf7fa02,network=Network(52e6a145-3658-4741-83a6-d3edf9e3b24b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8aac17a-7f') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:13:08 user nova-compute[73572]: DEBUG os_vif [None req-705d5ae7-e71b-4f5e-95e6-257f7a1a909a tempest-VolumesNegativeTest-657120278 tempest-VolumesNegativeTest-657120278-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:26:69,bridge_name='br-int',has_traffic_filtering=True,id=d8aac17a-7f10-44bf-ab6d-c7105bf7fa02,network=Network(52e6a145-3658-4741-83a6-d3edf9e3b24b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8aac17a-7f') {{(pid=73572) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 10:13:08 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:13:08 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:13:08 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 10:13:08 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:13:08 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd8aac17a-7f, may_exist=True, interface_attrs={}) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:13:08 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd8aac17a-7f, col_values=(('external_ids', {'iface-id': 'd8aac17a-7f10-44bf-ab6d-c7105bf7fa02', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b5:26:69', 'vm-uuid': '0b140c11-1a26-4312-9cec-8054582d15f5'}),), if_exists=True) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:13:08 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:13:08 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:13:08 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:13:08 user nova-compute[73572]: INFO os_vif [None req-705d5ae7-e71b-4f5e-95e6-257f7a1a909a tempest-VolumesNegativeTest-657120278 tempest-VolumesNegativeTest-657120278-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:26:69,bridge_name='br-int',has_traffic_filtering=True,id=d8aac17a-7f10-44bf-ab6d-c7105bf7fa02,network=Network(52e6a145-3658-4741-83a6-d3edf9e3b24b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8aac17a-7f')
Aug 26 10:13:08 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-705d5ae7-e71b-4f5e-95e6-257f7a1a909a tempest-VolumesNegativeTest-657120278 tempest-VolumesNegativeTest-657120278-project-member] No BDM found with device name vda, not building metadata. {{(pid=73572) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 10:13:08 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-705d5ae7-e71b-4f5e-95e6-257f7a1a909a tempest-VolumesNegativeTest-657120278 tempest-VolumesNegativeTest-657120278-project-member] No VIF found with MAC fa:16:3e:b5:26:69, not building metadata {{(pid=73572) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 10:13:08 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:13:08 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:13:08 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:13:08 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:13:08 user nova-compute[73572]: DEBUG nova.network.neutron [req-dc73fd65-7dee-4d83-a111-74b0d083e4cd req-5ff96f53-e8c2-4d49-beef-7ecf40308e59 service nova] [instance: 0b140c11-1a26-4312-9cec-8054582d15f5] Updated VIF entry in instance network info cache for port d8aac17a-7f10-44bf-ab6d-c7105bf7fa02. {{(pid=73572) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 10:13:08 user nova-compute[73572]: DEBUG nova.network.neutron [req-dc73fd65-7dee-4d83-a111-74b0d083e4cd req-5ff96f53-e8c2-4d49-beef-7ecf40308e59 service nova] [instance: 0b140c11-1a26-4312-9cec-8054582d15f5] Updating instance_info_cache with network_info: [{"id": "d8aac17a-7f10-44bf-ab6d-c7105bf7fa02", "address": "fa:16:3e:b5:26:69", "network": {"id": "52e6a145-3658-4741-83a6-d3edf9e3b24b", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.115", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "5c995f8bbbab4368b67a253e0df3971a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8aac17a-7f", "ovs_interfaceid": "d8aac17a-7f10-44bf-ab6d-c7105bf7fa02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:13:09 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-dc73fd65-7dee-4d83-a111-74b0d083e4cd req-5ff96f53-e8c2-4d49-beef-7ecf40308e59 service nova] Releasing lock "refresh_cache-0b140c11-1a26-4312-9cec-8054582d15f5" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:13:09 user nova-compute[73572]: DEBUG nova.compute.manager [None req-68df53ea-32fb-4c55-b827-7a7a796e0965 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: c785b609-0068-442f-91f5-d26e888a993f] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:13:09 user nova-compute[73572]: INFO nova.compute.manager [None req-68df53ea-32fb-4c55-b827-7a7a796e0965 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: c785b609-0068-442f-91f5-d26e888a993f] instance snapshotting
Aug 26 10:13:09 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-68df53ea-32fb-4c55-b827-7a7a796e0965 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: c785b609-0068-442f-91f5-d26e888a993f] Beginning live snapshot process
Aug 26 10:13:10 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:13:10 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-140fd689-00d9-465f-959a-9b3f06cbcfd7 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] Acquiring lock "c225e50a-3760-43d4-b398-3a663b478873" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:13:10 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-140fd689-00d9-465f-959a-9b3f06cbcfd7 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] Lock "c225e50a-3760-43d4-b398-3a663b478873" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:13:10 user nova-compute[73572]: DEBUG nova.compute.manager [None req-140fd689-00d9-465f-959a-9b3f06cbcfd7 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] [instance: c225e50a-3760-43d4-b398-3a663b478873] Starting instance... {{(pid=73572) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 10:13:10 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:13:10 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:13:10 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-68df53ea-32fb-4c55-b827-7a7a796e0965 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c785b609-0068-442f-91f5-d26e888a993f/disk --force-share --output=json -f qcow2 {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:13:10 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-140fd689-00d9-465f-959a-9b3f06cbcfd7 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:13:10 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-140fd689-00d9-465f-959a-9b3f06cbcfd7 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:13:10 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-140fd689-00d9-465f-959a-9b3f06cbcfd7 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73572) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 10:13:10 user nova-compute[73572]: INFO nova.compute.claims [None req-140fd689-00d9-465f-959a-9b3f06cbcfd7 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] [instance: c225e50a-3760-43d4-b398-3a663b478873] Claim successful on node user
Aug 26 10:13:10 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-68df53ea-32fb-4c55-b827-7a7a796e0965 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c785b609-0068-442f-91f5-d26e888a993f/disk --force-share --output=json -f qcow2" returned: 0 in 0.226s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:13:10 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-68df53ea-32fb-4c55-b827-7a7a796e0965 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c785b609-0068-442f-91f5-d26e888a993f/disk --force-share --output=json -f qcow2 {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:13:10 user nova-compute[73572]: DEBUG nova.compute.manager [req-585fe0f5-910b-42bc-8bcf-1406eca4a52c req-6ca17b4f-5454-4813-9976-c3dcd48c8346 service nova] [instance: 0b140c11-1a26-4312-9cec-8054582d15f5] Received event network-vif-plugged-d8aac17a-7f10-44bf-ab6d-c7105bf7fa02 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:13:10 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-585fe0f5-910b-42bc-8bcf-1406eca4a52c req-6ca17b4f-5454-4813-9976-c3dcd48c8346 service nova] Acquiring lock "0b140c11-1a26-4312-9cec-8054582d15f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:13:10 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-585fe0f5-910b-42bc-8bcf-1406eca4a52c req-6ca17b4f-5454-4813-9976-c3dcd48c8346 service nova] Lock "0b140c11-1a26-4312-9cec-8054582d15f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:13:10 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-585fe0f5-910b-42bc-8bcf-1406eca4a52c req-6ca17b4f-5454-4813-9976-c3dcd48c8346 service nova] Lock "0b140c11-1a26-4312-9cec-8054582d15f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:13:10 user nova-compute[73572]: DEBUG nova.compute.manager [req-585fe0f5-910b-42bc-8bcf-1406eca4a52c req-6ca17b4f-5454-4813-9976-c3dcd48c8346 service nova] [instance: 0b140c11-1a26-4312-9cec-8054582d15f5] No waiting events found dispatching network-vif-plugged-d8aac17a-7f10-44bf-ab6d-c7105bf7fa02 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:13:10 user nova-compute[73572]: WARNING nova.compute.manager [req-585fe0f5-910b-42bc-8bcf-1406eca4a52c req-6ca17b4f-5454-4813-9976-c3dcd48c8346 service nova] [instance: 0b140c11-1a26-4312-9cec-8054582d15f5] Received unexpected event network-vif-plugged-d8aac17a-7f10-44bf-ab6d-c7105bf7fa02 for instance with vm_state building and task_state spawning.
Aug 26 10:13:10 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-68df53ea-32fb-4c55-b827-7a7a796e0965 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c785b609-0068-442f-91f5-d26e888a993f/disk --force-share --output=json -f qcow2" returned: 0 in 0.223s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:13:10 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-68df53ea-32fb-4c55-b827-7a7a796e0965 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:13:10 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:13:10 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:13:10 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-68df53ea-32fb-4c55-b827-7a7a796e0965 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json" returned: 0 in 0.199s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:13:10 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-68df53ea-32fb-4c55-b827-7a7a796e0965 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpvb03d2ce/5d458d8183e4411daa20328e1781c450.delta 1073741824 {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:13:10 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-376d29f4-29c4-4e1a-8e75-fb9494c1b8d2 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] Acquiring lock "b3c0b9c1-4218-4d6e-acac-d5d1dcf4f1b8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:13:10 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-376d29f4-29c4-4e1a-8e75-fb9494c1b8d2 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] Lock "b3c0b9c1-4218-4d6e-acac-d5d1dcf4f1b8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:13:10 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-68df53ea-32fb-4c55-b827-7a7a796e0965 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpvb03d2ce/5d458d8183e4411daa20328e1781c450.delta 1073741824" returned: 0 in 0.090s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:13:10 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-68df53ea-32fb-4c55-b827-7a7a796e0965 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: c785b609-0068-442f-91f5-d26e888a993f] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 26 10:13:10 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-68df53ea-32fb-4c55-b827-7a7a796e0965 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Checking UEFI support for host arch (x86_64) {{(pid=73572) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Aug 26 10:13:10 user nova-compute[73572]: INFO nova.virt.libvirt.host [None req-68df53ea-32fb-4c55-b827-7a7a796e0965 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] UEFI support detected
Aug 26 10:13:11 user nova-compute[73572]: DEBUG nova.compute.manager [None req-376d29f4-29c4-4e1a-8e75-fb9494c1b8d2 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] [instance: b3c0b9c1-4218-4d6e-acac-d5d1dcf4f1b8] Starting instance... {{(pid=73572) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 10:13:11 user nova-compute[73572]: DEBUG nova.compute.provider_tree [None req-140fd689-00d9-465f-959a-9b3f06cbcfd7 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] Inventory has not changed in ProviderTree for provider: e2cec974-59b2-4c77-a53d-a7f4e5a30d75 {{(pid=73572) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 10:13:11 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-140fd689-00d9-465f-959a-9b3f06cbcfd7 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] Inventory has not changed for provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73572) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 10:13:11 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-140fd689-00d9-465f-959a-9b3f06cbcfd7 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.762s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:13:11 user nova-compute[73572]: DEBUG nova.compute.manager [None req-140fd689-00d9-465f-959a-9b3f06cbcfd7 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] [instance: c225e50a-3760-43d4-b398-3a663b478873] Start building networks asynchronously for instance. {{(pid=73572) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 10:13:11 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-376d29f4-29c4-4e1a-8e75-fb9494c1b8d2 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:13:11 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-376d29f4-29c4-4e1a-8e75-fb9494c1b8d2 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:13:11 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-376d29f4-29c4-4e1a-8e75-fb9494c1b8d2 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73572) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 10:13:11 user nova-compute[73572]: INFO nova.compute.claims [None req-376d29f4-29c4-4e1a-8e75-fb9494c1b8d2 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] [instance: b3c0b9c1-4218-4d6e-acac-d5d1dcf4f1b8] Claim successful on node user
Aug 26 10:13:11 user nova-compute[73572]: DEBUG nova.compute.manager [None req-140fd689-00d9-465f-959a-9b3f06cbcfd7 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] [instance: c225e50a-3760-43d4-b398-3a663b478873] Allocating IP information in the background. {{(pid=73572) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 10:13:11 user nova-compute[73572]: DEBUG nova.network.neutron [None req-140fd689-00d9-465f-959a-9b3f06cbcfd7 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] [instance: c225e50a-3760-43d4-b398-3a663b478873] allocate_for_instance() {{(pid=73572) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 10:13:11 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-140fd689-00d9-465f-959a-9b3f06cbcfd7 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] [instance: c225e50a-3760-43d4-b398-3a663b478873] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 10:13:11 user nova-compute[73572]: DEBUG nova.compute.manager [None req-140fd689-00d9-465f-959a-9b3f06cbcfd7 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] [instance: c225e50a-3760-43d4-b398-3a663b478873] Start building block device mappings for instance. {{(pid=73572) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 10:13:11 user nova-compute[73572]: DEBUG nova.policy [None req-140fd689-00d9-465f-959a-9b3f06cbcfd7 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8efee83728774e58a60714e5c72cb1f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e946bd18464231965d43e20f1d2201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73572) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 10:13:11 user nova-compute[73572]: DEBUG nova.compute.manager [None req-140fd689-00d9-465f-959a-9b3f06cbcfd7 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] [instance: c225e50a-3760-43d4-b398-3a663b478873] Start spawning the instance on the hypervisor. {{(pid=73572) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 10:13:11 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-140fd689-00d9-465f-959a-9b3f06cbcfd7 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] [instance: c225e50a-3760-43d4-b398-3a663b478873] Creating instance directory {{(pid=73572) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 10:13:11 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-140fd689-00d9-465f-959a-9b3f06cbcfd7 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] [instance: c225e50a-3760-43d4-b398-3a663b478873] Creating image(s)
Aug 26 10:13:11 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-140fd689-00d9-465f-959a-9b3f06cbcfd7 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] Acquiring lock "/opt/stack/data/nova/instances/c225e50a-3760-43d4-b398-3a663b478873/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:13:11 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-140fd689-00d9-465f-959a-9b3f06cbcfd7 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] Lock "/opt/stack/data/nova/instances/c225e50a-3760-43d4-b398-3a663b478873/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:13:11 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-140fd689-00d9-465f-959a-9b3f06cbcfd7 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] Lock "/opt/stack/data/nova/instances/c225e50a-3760-43d4-b398-3a663b478873/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.012s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:13:11 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-140fd689-00d9-465f-959a-9b3f06cbcfd7 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:13:11 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-140fd689-00d9-465f-959a-9b3f06cbcfd7 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json" returned: 0 in 0.215s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:13:11 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-140fd689-00d9-465f-959a-9b3f06cbcfd7 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] Acquiring lock "2099350d6f3bcd0de9471c73862d4fe75b049801" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:13:11 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-140fd689-00d9-465f-959a-9b3f06cbcfd7 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] Lock "2099350d6f3bcd0de9471c73862d4fe75b049801" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:13:11 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-140fd689-00d9-465f-959a-9b3f06cbcfd7 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:13:11 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:13:11 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-140fd689-00d9-465f-959a-9b3f06cbcfd7 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json" returned: 0 in 0.182s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:13:11 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-140fd689-00d9-465f-959a-9b3f06cbcfd7 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801,backing_fmt=raw /opt/stack/data/nova/instances/c225e50a-3760-43d4-b398-3a663b478873/disk 1073741824 {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:13:11 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-140fd689-00d9-465f-959a-9b3f06cbcfd7 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801,backing_fmt=raw /opt/stack/data/nova/instances/c225e50a-3760-43d4-b398-3a663b478873/disk 1073741824" returned: 0 in 0.057s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:13:11 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-140fd689-00d9-465f-959a-9b3f06cbcfd7 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] Lock "2099350d6f3bcd0de9471c73862d4fe75b049801" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.246s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:13:11 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-140fd689-00d9-465f-959a-9b3f06cbcfd7 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:13:11 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:13:11 user nova-compute[73572]: DEBUG nova.compute.provider_tree [None req-376d29f4-29c4-4e1a-8e75-fb9494c1b8d2 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] Inventory has not changed in ProviderTree for provider: e2cec974-59b2-4c77-a53d-a7f4e5a30d75 {{(pid=73572) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 10:13:11 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-376d29f4-29c4-4e1a-8e75-fb9494c1b8d2 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] Inventory has not changed for provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73572) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 10:13:12 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-376d29f4-29c4-4e1a-8e75-fb9494c1b8d2 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.853s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:13:12 user nova-compute[73572]: DEBUG nova.compute.manager [None req-376d29f4-29c4-4e1a-8e75-fb9494c1b8d2 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] [instance: b3c0b9c1-4218-4d6e-acac-d5d1dcf4f1b8] Start building networks asynchronously for instance. {{(pid=73572) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 10:13:12 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.089s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:13:12 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:13:12 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Auditing locally available compute resources for user (node: user) {{(pid=73572) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 10:13:12 user nova-compute[73572]: DEBUG nova.virt.libvirt.guest [None req-68df53ea-32fb-4c55-b827-7a7a796e0965 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=73572) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 10:13:12 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-140fd689-00d9-465f-959a-9b3f06cbcfd7 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json" returned: 0 in 0.304s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:13:12 user nova-compute[73572]: DEBUG nova.virt.disk.api [None req-140fd689-00d9-465f-959a-9b3f06cbcfd7 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c225e50a-3760-43d4-b398-3a663b478873/disk. size=1073741824 {{(pid=73572) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 10:13:12 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-140fd689-00d9-465f-959a-9b3f06cbcfd7 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c225e50a-3760-43d4-b398-3a663b478873/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:13:12 user nova-compute[73572]: DEBUG nova.network.neutron [None req-140fd689-00d9-465f-959a-9b3f06cbcfd7 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] [instance: c225e50a-3760-43d4-b398-3a663b478873] Successfully created port: e34f65a5-dd72-4d9c-ac50-2e7b1436db5d {{(pid=73572) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 10:13:12 user nova-compute[73572]: DEBUG nova.compute.manager [None req-376d29f4-29c4-4e1a-8e75-fb9494c1b8d2 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] [instance: b3c0b9c1-4218-4d6e-acac-d5d1dcf4f1b8] Allocating IP information in the background. {{(pid=73572) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 10:13:12 user nova-compute[73572]: DEBUG nova.network.neutron [None req-376d29f4-29c4-4e1a-8e75-fb9494c1b8d2 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] [instance: b3c0b9c1-4218-4d6e-acac-d5d1dcf4f1b8] allocate_for_instance() {{(pid=73572) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 10:13:12 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-376d29f4-29c4-4e1a-8e75-fb9494c1b8d2 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] [instance: b3c0b9c1-4218-4d6e-acac-d5d1dcf4f1b8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 10:13:12 user nova-compute[73572]: DEBUG nova.compute.manager [None req-376d29f4-29c4-4e1a-8e75-fb9494c1b8d2 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] [instance: b3c0b9c1-4218-4d6e-acac-d5d1dcf4f1b8] Start building block device mappings for instance. {{(pid=73572) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 10:13:12 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-140fd689-00d9-465f-959a-9b3f06cbcfd7 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c225e50a-3760-43d4-b398-3a663b478873/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:13:12 user nova-compute[73572]: DEBUG nova.virt.disk.api [None req-140fd689-00d9-465f-959a-9b3f06cbcfd7 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] Cannot resize image /opt/stack/data/nova/instances/c225e50a-3760-43d4-b398-3a663b478873/disk to a smaller size. {{(pid=73572) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 10:13:12 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-140fd689-00d9-465f-959a-9b3f06cbcfd7 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] [instance: c225e50a-3760-43d4-b398-3a663b478873] Created local disks {{(pid=73572) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 10:13:12 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-140fd689-00d9-465f-959a-9b3f06cbcfd7 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] [instance: c225e50a-3760-43d4-b398-3a663b478873] Ensure instance console log exists: /opt/stack/data/nova/instances/c225e50a-3760-43d4-b398-3a663b478873/console.log {{(pid=73572) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 10:13:12 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-140fd689-00d9-465f-959a-9b3f06cbcfd7 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:13:12 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-140fd689-00d9-465f-959a-9b3f06cbcfd7 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:13:12 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-140fd689-00d9-465f-959a-9b3f06cbcfd7 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:13:12 user nova-compute[73572]: DEBUG nova.policy [None req-376d29f4-29c4-4e1a-8e75-fb9494c1b8d2 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '257dcb60edca4eebabab0b4db96ba6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71aa440d71d44cd8a51d40bfbcae7f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73572) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 10:13:12 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc56542d-af1f-4313-8555-1b2014ff35e7/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:13:12 user nova-compute[73572]: DEBUG nova.virt.libvirt.guest [None req-68df53ea-32fb-4c55-b827-7a7a796e0965 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] COPY block job progress, current cursor: 26083328 final cursor: 75497472 {{(pid=73572) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 10:13:12 user nova-compute[73572]: DEBUG nova.compute.manager [None req-376d29f4-29c4-4e1a-8e75-fb9494c1b8d2 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] [instance: b3c0b9c1-4218-4d6e-acac-d5d1dcf4f1b8] Start spawning the instance on the hypervisor. {{(pid=73572) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 10:13:12 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-376d29f4-29c4-4e1a-8e75-fb9494c1b8d2 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] [instance: b3c0b9c1-4218-4d6e-acac-d5d1dcf4f1b8] Creating instance directory {{(pid=73572) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 10:13:12 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-376d29f4-29c4-4e1a-8e75-fb9494c1b8d2 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] [instance: b3c0b9c1-4218-4d6e-acac-d5d1dcf4f1b8] Creating image(s)
Aug 26 10:13:12 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-376d29f4-29c4-4e1a-8e75-fb9494c1b8d2 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] Acquiring lock "/opt/stack/data/nova/instances/b3c0b9c1-4218-4d6e-acac-d5d1dcf4f1b8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:13:12 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-376d29f4-29c4-4e1a-8e75-fb9494c1b8d2 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] Lock "/opt/stack/data/nova/instances/b3c0b9c1-4218-4d6e-acac-d5d1dcf4f1b8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:13:12 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-376d29f4-29c4-4e1a-8e75-fb9494c1b8d2 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] Lock "/opt/stack/data/nova/instances/b3c0b9c1-4218-4d6e-acac-d5d1dcf4f1b8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:13:12 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-376d29f4-29c4-4e1a-8e75-fb9494c1b8d2 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:13:12 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc56542d-af1f-4313-8555-1b2014ff35e7/disk --force-share --output=json" returned: 0 in 0.254s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:13:12 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc56542d-af1f-4313-8555-1b2014ff35e7/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:13:12 user nova-compute[73572]: DEBUG nova.compute.manager [req-bfa69d15-3411-4752-8517-26c14666aec5 req-bfbedf99-1a52-4c2b-a62c-76b00d0e41eb service nova] [instance: 0b140c11-1a26-4312-9cec-8054582d15f5] Received event network-vif-plugged-d8aac17a-7f10-44bf-ab6d-c7105bf7fa02 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:13:12 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-bfa69d15-3411-4752-8517-26c14666aec5 req-bfbedf99-1a52-4c2b-a62c-76b00d0e41eb service nova] Acquiring lock "0b140c11-1a26-4312-9cec-8054582d15f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:13:12 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-bfa69d15-3411-4752-8517-26c14666aec5 req-bfbedf99-1a52-4c2b-a62c-76b00d0e41eb service nova] Lock "0b140c11-1a26-4312-9cec-8054582d15f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:13:12 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-bfa69d15-3411-4752-8517-26c14666aec5 req-bfbedf99-1a52-4c2b-a62c-76b00d0e41eb service nova] Lock "0b140c11-1a26-4312-9cec-8054582d15f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:13:12 user nova-compute[73572]: DEBUG nova.compute.manager [req-bfa69d15-3411-4752-8517-26c14666aec5 req-bfbedf99-1a52-4c2b-a62c-76b00d0e41eb service nova] [instance: 0b140c11-1a26-4312-9cec-8054582d15f5] No waiting events found dispatching network-vif-plugged-d8aac17a-7f10-44bf-ab6d-c7105bf7fa02 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:13:12 user nova-compute[73572]: WARNING nova.compute.manager [req-bfa69d15-3411-4752-8517-26c14666aec5 req-bfbedf99-1a52-4c2b-a62c-76b00d0e41eb service nova] [instance: 0b140c11-1a26-4312-9cec-8054582d15f5] Received unexpected event network-vif-plugged-d8aac17a-7f10-44bf-ab6d-c7105bf7fa02 for instance with vm_state building and task_state spawning.
Aug 26 10:13:12 user nova-compute[73572]: DEBUG nova.virt.driver [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Emitting event <LifecycleEvent: 1693044792.7516978, 0b140c11-1a26-4312-9cec-8054582d15f5 => Resumed> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:13:12 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 0b140c11-1a26-4312-9cec-8054582d15f5] VM Resumed (Lifecycle Event)
Aug 26 10:13:12 user nova-compute[73572]: DEBUG nova.compute.manager [None req-705d5ae7-e71b-4f5e-95e6-257f7a1a909a tempest-VolumesNegativeTest-657120278 tempest-VolumesNegativeTest-657120278-project-member] [instance: 0b140c11-1a26-4312-9cec-8054582d15f5] Instance event wait completed in 0 seconds for  {{(pid=73572) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 10:13:12 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-705d5ae7-e71b-4f5e-95e6-257f7a1a909a tempest-VolumesNegativeTest-657120278 tempest-VolumesNegativeTest-657120278-project-member] [instance: 0b140c11-1a26-4312-9cec-8054582d15f5] Guest created on hypervisor {{(pid=73572) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 10:13:12 user nova-compute[73572]: INFO nova.virt.libvirt.driver [-] [instance: 0b140c11-1a26-4312-9cec-8054582d15f5] Instance spawned successfully.
Aug 26 10:13:12 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-705d5ae7-e71b-4f5e-95e6-257f7a1a909a tempest-VolumesNegativeTest-657120278 tempest-VolumesNegativeTest-657120278-project-member] [instance: 0b140c11-1a26-4312-9cec-8054582d15f5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 10:13:12 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 0b140c11-1a26-4312-9cec-8054582d15f5] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:13:12 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 0b140c11-1a26-4312-9cec-8054582d15f5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73572) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 10:13:12 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-705d5ae7-e71b-4f5e-95e6-257f7a1a909a tempest-VolumesNegativeTest-657120278 tempest-VolumesNegativeTest-657120278-project-member] [instance: 0b140c11-1a26-4312-9cec-8054582d15f5] Found default for hw_cdrom_bus of ide {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:13:12 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-705d5ae7-e71b-4f5e-95e6-257f7a1a909a tempest-VolumesNegativeTest-657120278 tempest-VolumesNegativeTest-657120278-project-member] [instance: 0b140c11-1a26-4312-9cec-8054582d15f5] Found default for hw_disk_bus of virtio {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:13:12 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-705d5ae7-e71b-4f5e-95e6-257f7a1a909a tempest-VolumesNegativeTest-657120278 tempest-VolumesNegativeTest-657120278-project-member] [instance: 0b140c11-1a26-4312-9cec-8054582d15f5] Found default for hw_input_bus of None {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:13:12 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-705d5ae7-e71b-4f5e-95e6-257f7a1a909a tempest-VolumesNegativeTest-657120278 tempest-VolumesNegativeTest-657120278-project-member] [instance: 0b140c11-1a26-4312-9cec-8054582d15f5] Found default for hw_pointer_model of None {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:13:12 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-705d5ae7-e71b-4f5e-95e6-257f7a1a909a tempest-VolumesNegativeTest-657120278 tempest-VolumesNegativeTest-657120278-project-member] [instance: 0b140c11-1a26-4312-9cec-8054582d15f5] Found default for hw_video_model of virtio {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:13:12 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-705d5ae7-e71b-4f5e-95e6-257f7a1a909a tempest-VolumesNegativeTest-657120278 tempest-VolumesNegativeTest-657120278-project-member] [instance: 0b140c11-1a26-4312-9cec-8054582d15f5] Found default for hw_vif_model of virtio {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:13:12 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 0b140c11-1a26-4312-9cec-8054582d15f5] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 10:13:12 user nova-compute[73572]: DEBUG nova.virt.driver [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Emitting event <LifecycleEvent: 1693044792.7609785, 0b140c11-1a26-4312-9cec-8054582d15f5 => Started> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:13:12 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 0b140c11-1a26-4312-9cec-8054582d15f5] VM Started (Lifecycle Event)
Aug 26 10:13:12 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 0b140c11-1a26-4312-9cec-8054582d15f5] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:13:12 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 0b140c11-1a26-4312-9cec-8054582d15f5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73572) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 10:13:12 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-376d29f4-29c4-4e1a-8e75-fb9494c1b8d2 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json" returned: 0 in 0.221s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:13:12 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-376d29f4-29c4-4e1a-8e75-fb9494c1b8d2 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] Acquiring lock "2099350d6f3bcd0de9471c73862d4fe75b049801" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:13:12 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-376d29f4-29c4-4e1a-8e75-fb9494c1b8d2 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] Lock "2099350d6f3bcd0de9471c73862d4fe75b049801" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:13:12 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-376d29f4-29c4-4e1a-8e75-fb9494c1b8d2 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:13:12 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 0b140c11-1a26-4312-9cec-8054582d15f5] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 10:13:12 user nova-compute[73572]: INFO nova.compute.manager [None req-705d5ae7-e71b-4f5e-95e6-257f7a1a909a tempest-VolumesNegativeTest-657120278 tempest-VolumesNegativeTest-657120278-project-member] [instance: 0b140c11-1a26-4312-9cec-8054582d15f5] Took 6.82 seconds to spawn the instance on the hypervisor.
Aug 26 10:13:12 user nova-compute[73572]: DEBUG nova.compute.manager [None req-705d5ae7-e71b-4f5e-95e6-257f7a1a909a tempest-VolumesNegativeTest-657120278 tempest-VolumesNegativeTest-657120278-project-member] [instance: 0b140c11-1a26-4312-9cec-8054582d15f5] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:13:12 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc56542d-af1f-4313-8555-1b2014ff35e7/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:13:12 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8302d6e7-aaf3-461c-a55e-f2e685d1800d/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:13:13 user nova-compute[73572]: DEBUG nova.network.neutron [None req-376d29f4-29c4-4e1a-8e75-fb9494c1b8d2 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] [instance: b3c0b9c1-4218-4d6e-acac-d5d1dcf4f1b8] Successfully created port: 6739bb4d-6b93-42f0-b2d9-f97a6a5a9040 {{(pid=73572) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 10:13:13 user nova-compute[73572]: INFO nova.compute.manager [None req-705d5ae7-e71b-4f5e-95e6-257f7a1a909a tempest-VolumesNegativeTest-657120278 tempest-VolumesNegativeTest-657120278-project-member] [instance: 0b140c11-1a26-4312-9cec-8054582d15f5] Took 7.88 seconds to build instance.
Aug 26 10:13:13 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-376d29f4-29c4-4e1a-8e75-fb9494c1b8d2 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json" returned: 0 in 0.196s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:13:13 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-376d29f4-29c4-4e1a-8e75-fb9494c1b8d2 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801,backing_fmt=raw /opt/stack/data/nova/instances/b3c0b9c1-4218-4d6e-acac-d5d1dcf4f1b8/disk 1073741824 {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:13:13 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-705d5ae7-e71b-4f5e-95e6-257f7a1a909a tempest-VolumesNegativeTest-657120278 tempest-VolumesNegativeTest-657120278-project-member] Lock "0b140c11-1a26-4312-9cec-8054582d15f5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.065s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:13:13 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-376d29f4-29c4-4e1a-8e75-fb9494c1b8d2 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801,backing_fmt=raw /opt/stack/data/nova/instances/b3c0b9c1-4218-4d6e-acac-d5d1dcf4f1b8/disk 1073741824" returned: 0 in 0.051s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:13:13 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-376d29f4-29c4-4e1a-8e75-fb9494c1b8d2 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] Lock "2099350d6f3bcd0de9471c73862d4fe75b049801" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.251s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:13:13 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-376d29f4-29c4-4e1a-8e75-fb9494c1b8d2 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:13:13 user nova-compute[73572]: DEBUG nova.virt.libvirt.guest [None req-68df53ea-32fb-4c55-b827-7a7a796e0965 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=73572) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 10:13:13 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8302d6e7-aaf3-461c-a55e-f2e685d1800d/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:13:13 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8302d6e7-aaf3-461c-a55e-f2e685d1800d/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:13:13 user nova-compute[73572]: DEBUG nova.network.neutron [None req-140fd689-00d9-465f-959a-9b3f06cbcfd7 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] [instance: c225e50a-3760-43d4-b398-3a663b478873] Successfully updated port: e34f65a5-dd72-4d9c-ac50-2e7b1436db5d {{(pid=73572) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 10:13:13 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-68df53ea-32fb-4c55-b827-7a7a796e0965 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: c785b609-0068-442f-91f5-d26e888a993f] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 26 10:13:13 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-140fd689-00d9-465f-959a-9b3f06cbcfd7 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] Acquiring lock "refresh_cache-c225e50a-3760-43d4-b398-3a663b478873" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:13:13 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-140fd689-00d9-465f-959a-9b3f06cbcfd7 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] Acquired lock "refresh_cache-c225e50a-3760-43d4-b398-3a663b478873" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:13:13 user nova-compute[73572]: DEBUG nova.network.neutron [None req-140fd689-00d9-465f-959a-9b3f06cbcfd7 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] [instance: c225e50a-3760-43d4-b398-3a663b478873] Building network info cache for instance {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 10:13:13 user nova-compute[73572]: DEBUG nova.compute.manager [req-5d8e069c-7e94-4bf7-8480-5e31d1e23843 req-97952d19-c088-4491-b895-6b41daf94643 service nova] [instance: c225e50a-3760-43d4-b398-3a663b478873] Received event network-changed-e34f65a5-dd72-4d9c-ac50-2e7b1436db5d {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:13:13 user nova-compute[73572]: DEBUG nova.compute.manager [req-5d8e069c-7e94-4bf7-8480-5e31d1e23843 req-97952d19-c088-4491-b895-6b41daf94643 service nova] [instance: c225e50a-3760-43d4-b398-3a663b478873] Refreshing instance network info cache due to event network-changed-e34f65a5-dd72-4d9c-ac50-2e7b1436db5d. {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 10:13:13 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-5d8e069c-7e94-4bf7-8480-5e31d1e23843 req-97952d19-c088-4491-b895-6b41daf94643 service nova] Acquiring lock "refresh_cache-c225e50a-3760-43d4-b398-3a663b478873" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:13:13 user nova-compute[73572]: DEBUG nova.network.neutron [None req-140fd689-00d9-465f-959a-9b3f06cbcfd7 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] [instance: c225e50a-3760-43d4-b398-3a663b478873] Instance cache missing network info. {{(pid=73572) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 10:13:13 user nova-compute[73572]: DEBUG nova.privsep.utils [None req-68df53ea-32fb-4c55-b827-7a7a796e0965 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73572) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 26 10:13:13 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-68df53ea-32fb-4c55-b827-7a7a796e0965 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpvb03d2ce/5d458d8183e4411daa20328e1781c450.delta /opt/stack/data/nova/instances/snapshots/tmpvb03d2ce/5d458d8183e4411daa20328e1781c450 {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:13:13 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-376d29f4-29c4-4e1a-8e75-fb9494c1b8d2 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json" returned: 0 in 0.280s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:13:13 user nova-compute[73572]: DEBUG nova.virt.disk.api [None req-376d29f4-29c4-4e1a-8e75-fb9494c1b8d2 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b3c0b9c1-4218-4d6e-acac-d5d1dcf4f1b8/disk. size=1073741824 {{(pid=73572) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 10:13:13 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-376d29f4-29c4-4e1a-8e75-fb9494c1b8d2 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3c0b9c1-4218-4d6e-acac-d5d1dcf4f1b8/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:13:13 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8302d6e7-aaf3-461c-a55e-f2e685d1800d/disk --force-share --output=json" returned: 0 in 0.272s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:13:13 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c785b609-0068-442f-91f5-d26e888a993f/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:13:13 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:13:13 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-a42577c3-0465-4841-9c9c-00e87be5ed62 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] Acquiring lock "61b60a19-597e-4dc1-af0f-a0ec95e9fd24" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:13:13 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-a42577c3-0465-4841-9c9c-00e87be5ed62 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] Lock "61b60a19-597e-4dc1-af0f-a0ec95e9fd24" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.003s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:13:13 user nova-compute[73572]: DEBUG nova.objects.instance [None req-a42577c3-0465-4841-9c9c-00e87be5ed62 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] Lazy-loading 'flavor' on Instance uuid 61b60a19-597e-4dc1-af0f-a0ec95e9fd24 {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:13:13 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-376d29f4-29c4-4e1a-8e75-fb9494c1b8d2 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3c0b9c1-4218-4d6e-acac-d5d1dcf4f1b8/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:13:13 user nova-compute[73572]: DEBUG nova.virt.disk.api [None req-376d29f4-29c4-4e1a-8e75-fb9494c1b8d2 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] Cannot resize image /opt/stack/data/nova/instances/b3c0b9c1-4218-4d6e-acac-d5d1dcf4f1b8/disk to a smaller size. {{(pid=73572) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 10:13:13 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-376d29f4-29c4-4e1a-8e75-fb9494c1b8d2 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] [instance: b3c0b9c1-4218-4d6e-acac-d5d1dcf4f1b8] Created local disks {{(pid=73572) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 10:13:13 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-376d29f4-29c4-4e1a-8e75-fb9494c1b8d2 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] [instance: b3c0b9c1-4218-4d6e-acac-d5d1dcf4f1b8] Ensure instance console log exists: /opt/stack/data/nova/instances/b3c0b9c1-4218-4d6e-acac-d5d1dcf4f1b8/console.log {{(pid=73572) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 10:13:13 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-376d29f4-29c4-4e1a-8e75-fb9494c1b8d2 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:13:13 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-376d29f4-29c4-4e1a-8e75-fb9494c1b8d2 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:13:13 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-376d29f4-29c4-4e1a-8e75-fb9494c1b8d2 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:13:13 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-a42577c3-0465-4841-9c9c-00e87be5ed62 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] Lock "61b60a19-597e-4dc1-af0f-a0ec95e9fd24" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.137s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:13:13 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c785b609-0068-442f-91f5-d26e888a993f/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:13:13 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c785b609-0068-442f-91f5-d26e888a993f/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:13:13 user nova-compute[73572]: DEBUG nova.network.neutron [None req-140fd689-00d9-465f-959a-9b3f06cbcfd7 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] [instance: c225e50a-3760-43d4-b398-3a663b478873] Updating instance_info_cache with network_info: [{"id": "e34f65a5-dd72-4d9c-ac50-2e7b1436db5d", "address": "fa:16:3e:64:f5:1f", "network": {"id": "f4c05fef-baf8-4c06-876f-1bdccd5a8689", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-169805980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27e946bd18464231965d43e20f1d2201", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape34f65a5-dd", "ovs_interfaceid": "e34f65a5-dd72-4d9c-ac50-2e7b1436db5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:13:13 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-140fd689-00d9-465f-959a-9b3f06cbcfd7 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] Releasing lock "refresh_cache-c225e50a-3760-43d4-b398-3a663b478873" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:13:13 user nova-compute[73572]: DEBUG nova.compute.manager [None req-140fd689-00d9-465f-959a-9b3f06cbcfd7 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] [instance: c225e50a-3760-43d4-b398-3a663b478873] Instance network_info: |[{"id": "e34f65a5-dd72-4d9c-ac50-2e7b1436db5d", "address": "fa:16:3e:64:f5:1f", "network": {"id": "f4c05fef-baf8-4c06-876f-1bdccd5a8689", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-169805980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27e946bd18464231965d43e20f1d2201", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape34f65a5-dd", "ovs_interfaceid": "e34f65a5-dd72-4d9c-ac50-2e7b1436db5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73572) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 10:13:13 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-5d8e069c-7e94-4bf7-8480-5e31d1e23843 req-97952d19-c088-4491-b895-6b41daf94643 service nova] Acquired lock "refresh_cache-c225e50a-3760-43d4-b398-3a663b478873" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:13:13 user nova-compute[73572]: DEBUG nova.network.neutron [req-5d8e069c-7e94-4bf7-8480-5e31d1e23843 req-97952d19-c088-4491-b895-6b41daf94643 service nova] [instance: c225e50a-3760-43d4-b398-3a663b478873] Refreshing network info cache for port e34f65a5-dd72-4d9c-ac50-2e7b1436db5d {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 10:13:13 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-140fd689-00d9-465f-959a-9b3f06cbcfd7 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] [instance: c225e50a-3760-43d4-b398-3a663b478873] Start _get_guest_xml network_info=[{"id": "e34f65a5-dd72-4d9c-ac50-2e7b1436db5d", "address": "fa:16:3e:64:f5:1f", "network": {"id": "f4c05fef-baf8-4c06-876f-1bdccd5a8689", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-169805980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27e946bd18464231965d43e20f1d2201", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape34f65a5-dd", "ovs_interfaceid": "e34f65a5-dd72-4d9c-ac50-2e7b1436db5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T10:07:33Z,direct_url=<?>,disk_format='qcow2',id=299da0c9-e1c4-48f0-be55-fbe20dd06bc9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5c995f8bbbab4368b67a253e0df3971a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T10:07:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'guest_format': None, 'size': 0, 'encryption_format': None, 'device_type': 'disk', 'image_id': '299da0c9-e1c4-48f0-be55-fbe20dd06bc9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73572) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 10:13:13 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-140fd689-00d9-465f-959a-9b3f06cbcfd7 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:13:13 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-140fd689-00d9-465f-959a-9b3f06cbcfd7 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:13:13 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-140fd689-00d9-465f-959a-9b3f06cbcfd7 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73572) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 10:13:13 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-140fd689-00d9-465f-959a-9b3f06cbcfd7 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] CPU controller missing on host. {{(pid=73572) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 10:13:13 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:13:13 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-140fd689-00d9-465f-959a-9b3f06cbcfd7 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73572) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 10:13:13 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-140fd689-00d9-465f-959a-9b3f06cbcfd7 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] CPU controller found on host. {{(pid=73572) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 10:13:13 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-140fd689-00d9-465f-959a-9b3f06cbcfd7 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73572) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 10:13:13 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-140fd689-00d9-465f-959a-9b3f06cbcfd7 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T10:07:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T10:07:33Z,direct_url=<?>,disk_format='qcow2',id=299da0c9-e1c4-48f0-be55-fbe20dd06bc9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5c995f8bbbab4368b67a253e0df3971a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T10:07:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 10:13:13 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-140fd689-00d9-465f-959a-9b3f06cbcfd7 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] Flavor limits 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 10:13:13 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-140fd689-00d9-465f-959a-9b3f06cbcfd7 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] Image limits 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 10:13:13 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-140fd689-00d9-465f-959a-9b3f06cbcfd7 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] Flavor pref 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 10:13:13 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-140fd689-00d9-465f-959a-9b3f06cbcfd7 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] Image pref 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 10:13:13 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-140fd689-00d9-465f-959a-9b3f06cbcfd7 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 10:13:13 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-140fd689-00d9-465f-959a-9b3f06cbcfd7 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 10:13:13 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-140fd689-00d9-465f-959a-9b3f06cbcfd7 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73572) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 10:13:13 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-140fd689-00d9-465f-959a-9b3f06cbcfd7 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] Got 1 possible topologies {{(pid=73572) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 10:13:13 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-140fd689-00d9-465f-959a-9b3f06cbcfd7 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 10:13:13 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-140fd689-00d9-465f-959a-9b3f06cbcfd7 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 10:13:13 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-140fd689-00d9-465f-959a-9b3f06cbcfd7 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T10:13:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1568261567',display_name='tempest-ServersNegativeTestJSON-server-1568261567',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1568261567',id=11,image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='27e946bd18464231965d43e20f1d2201',ramdisk_id='',reservation_id='r-301jj1h3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1661886679',owner_user_name='tempest-ServersNegativeTestJSON-1661886679-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T10:13:11Z,user_data=None,user_id='8efee83728774e58a60714e5c72cb1f2',uuid=c225e50a-3760-43d4-b398-3a663b478873,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e34f65a5-dd72-4d9c-ac50-2e7b1436db5d", "address": "fa:16:3e:64:f5:1f", "network": {"id": "f4c05fef-baf8-4c06-876f-1bdccd5a8689", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-169805980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27e946bd18464231965d43e20f1d2201", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape34f65a5-dd", "ovs_interfaceid": "e34f65a5-dd72-4d9c-ac50-2e7b1436db5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73572) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 10:13:13 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-140fd689-00d9-465f-959a-9b3f06cbcfd7 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] Converting VIF {"id": "e34f65a5-dd72-4d9c-ac50-2e7b1436db5d", "address": "fa:16:3e:64:f5:1f", "network": {"id": "f4c05fef-baf8-4c06-876f-1bdccd5a8689", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-169805980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27e946bd18464231965d43e20f1d2201", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape34f65a5-dd", "ovs_interfaceid": "e34f65a5-dd72-4d9c-ac50-2e7b1436db5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:13:13 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-140fd689-00d9-465f-959a-9b3f06cbcfd7 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:64:f5:1f,bridge_name='br-int',has_traffic_filtering=True,id=e34f65a5-dd72-4d9c-ac50-2e7b1436db5d,network=Network(f4c05fef-baf8-4c06-876f-1bdccd5a8689),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape34f65a5-dd') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:13:13 user nova-compute[73572]: DEBUG nova.objects.instance [None req-140fd689-00d9-465f-959a-9b3f06cbcfd7 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] Lazy-loading 'pci_devices' on Instance uuid c225e50a-3760-43d4-b398-3a663b478873 {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:13:13 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-68df53ea-32fb-4c55-b827-7a7a796e0965 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpvb03d2ce/5d458d8183e4411daa20328e1781c450.delta /opt/stack/data/nova/instances/snapshots/tmpvb03d2ce/5d458d8183e4411daa20328e1781c450" returned: 0 in 0.621s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:13:13 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-68df53ea-32fb-4c55-b827-7a7a796e0965 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: c785b609-0068-442f-91f5-d26e888a993f] Snapshot extracted, beginning image upload
Aug 26 10:13:14 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c785b609-0068-442f-91f5-d26e888a993f/disk --force-share --output=json" returned: 0 in 0.296s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:13:14 user nova-compute[73572]: DEBUG nova.network.neutron [None req-376d29f4-29c4-4e1a-8e75-fb9494c1b8d2 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] [instance: b3c0b9c1-4218-4d6e-acac-d5d1dcf4f1b8] Successfully updated port: 6739bb4d-6b93-42f0-b2d9-f97a6a5a9040 {{(pid=73572) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 10:13:14 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-140fd689-00d9-465f-959a-9b3f06cbcfd7 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] [instance: c225e50a-3760-43d4-b398-3a663b478873] End _get_guest_xml xml=<domain type="kvm">
Aug 26 10:13:14 user nova-compute[73572]:   <uuid>c225e50a-3760-43d4-b398-3a663b478873</uuid>
Aug 26 10:13:14 user nova-compute[73572]:   <name>instance-0000000b</name>
Aug 26 10:13:14 user nova-compute[73572]:   <memory>524288</memory>
Aug 26 10:13:14 user nova-compute[73572]:   <vcpu>1</vcpu>
Aug 26 10:13:14 user nova-compute[73572]:   <metadata>
Aug 26 10:13:14 user nova-compute[73572]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 10:13:14 user nova-compute[73572]:       <nova:package version="0.0.0"/>
Aug 26 10:13:14 user nova-compute[73572]:       <nova:name>tempest-ServersNegativeTestJSON-server-1568261567</nova:name>
Aug 26 10:13:14 user nova-compute[73572]:       <nova:creationTime>2023-08-26 10:13:13</nova:creationTime>
Aug 26 10:13:14 user nova-compute[73572]:       <nova:flavor name="m1.tiny">
Aug 26 10:13:14 user nova-compute[73572]:         <nova:memory>512</nova:memory>
Aug 26 10:13:14 user nova-compute[73572]:         <nova:disk>1</nova:disk>
Aug 26 10:13:14 user nova-compute[73572]:         <nova:swap>0</nova:swap>
Aug 26 10:13:14 user nova-compute[73572]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 10:13:14 user nova-compute[73572]:         <nova:vcpus>1</nova:vcpus>
Aug 26 10:13:14 user nova-compute[73572]:       </nova:flavor>
Aug 26 10:13:14 user nova-compute[73572]:       <nova:owner>
Aug 26 10:13:14 user nova-compute[73572]:         <nova:user uuid="8efee83728774e58a60714e5c72cb1f2">tempest-ServersNegativeTestJSON-1661886679-project-member</nova:user>
Aug 26 10:13:14 user nova-compute[73572]:         <nova:project uuid="27e946bd18464231965d43e20f1d2201">tempest-ServersNegativeTestJSON-1661886679</nova:project>
Aug 26 10:13:14 user nova-compute[73572]:       </nova:owner>
Aug 26 10:13:14 user nova-compute[73572]:       <nova:root type="image" uuid="299da0c9-e1c4-48f0-be55-fbe20dd06bc9"/>
Aug 26 10:13:14 user nova-compute[73572]:       <nova:ports>
Aug 26 10:13:14 user nova-compute[73572]:         <nova:port uuid="e34f65a5-dd72-4d9c-ac50-2e7b1436db5d">
Aug 26 10:13:14 user nova-compute[73572]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 26 10:13:14 user nova-compute[73572]:         </nova:port>
Aug 26 10:13:14 user nova-compute[73572]:       </nova:ports>
Aug 26 10:13:14 user nova-compute[73572]:     </nova:instance>
Aug 26 10:13:14 user nova-compute[73572]:   </metadata>
Aug 26 10:13:14 user nova-compute[73572]:   <sysinfo type="smbios">
Aug 26 10:13:14 user nova-compute[73572]:     <system>
Aug 26 10:13:14 user nova-compute[73572]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 10:13:14 user nova-compute[73572]:       <entry name="product">OpenStack Nova</entry>
Aug 26 10:13:14 user nova-compute[73572]:       <entry name="version">0.0.0</entry>
Aug 26 10:13:14 user nova-compute[73572]:       <entry name="serial">c225e50a-3760-43d4-b398-3a663b478873</entry>
Aug 26 10:13:14 user nova-compute[73572]:       <entry name="uuid">c225e50a-3760-43d4-b398-3a663b478873</entry>
Aug 26 10:13:14 user nova-compute[73572]:       <entry name="family">Virtual Machine</entry>
Aug 26 10:13:14 user nova-compute[73572]:     </system>
Aug 26 10:13:14 user nova-compute[73572]:   </sysinfo>
Aug 26 10:13:14 user nova-compute[73572]:   <os>
Aug 26 10:13:14 user nova-compute[73572]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 10:13:14 user nova-compute[73572]:     <boot dev="hd"/>
Aug 26 10:13:14 user nova-compute[73572]:     <smbios mode="sysinfo"/>
Aug 26 10:13:14 user nova-compute[73572]:   </os>
Aug 26 10:13:14 user nova-compute[73572]:   <features>
Aug 26 10:13:14 user nova-compute[73572]:     <acpi/>
Aug 26 10:13:14 user nova-compute[73572]:     <apic/>
Aug 26 10:13:14 user nova-compute[73572]:     <vmcoreinfo/>
Aug 26 10:13:14 user nova-compute[73572]:   </features>
Aug 26 10:13:14 user nova-compute[73572]:   <clock offset="utc">
Aug 26 10:13:14 user nova-compute[73572]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 10:13:14 user nova-compute[73572]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 10:13:14 user nova-compute[73572]:     <timer name="hpet" present="no"/>
Aug 26 10:13:14 user nova-compute[73572]:   </clock>
Aug 26 10:13:14 user nova-compute[73572]:   <cpu mode="custom" match="exact">
Aug 26 10:13:14 user nova-compute[73572]:     <model>Nehalem</model>
Aug 26 10:13:14 user nova-compute[73572]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 10:13:14 user nova-compute[73572]:   </cpu>
Aug 26 10:13:14 user nova-compute[73572]:   <devices>
Aug 26 10:13:14 user nova-compute[73572]:     <disk type="file" device="disk">
Aug 26 10:13:14 user nova-compute[73572]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 10:13:14 user nova-compute[73572]:       <source file="/opt/stack/data/nova/instances/c225e50a-3760-43d4-b398-3a663b478873/disk"/>
Aug 26 10:13:14 user nova-compute[73572]:       <target dev="vda" bus="virtio"/>
Aug 26 10:13:14 user nova-compute[73572]:     </disk>
Aug 26 10:13:14 user nova-compute[73572]:     <interface type="ethernet">
Aug 26 10:13:14 user nova-compute[73572]:       <mac address="fa:16:3e:64:f5:1f"/>
Aug 26 10:13:14 user nova-compute[73572]:       <model type="virtio"/>
Aug 26 10:13:14 user nova-compute[73572]:       <mtu size="1442"/>
Aug 26 10:13:14 user nova-compute[73572]:       <target dev="tape34f65a5-dd"/>
Aug 26 10:13:14 user nova-compute[73572]:     </interface>
Aug 26 10:13:14 user nova-compute[73572]:     <serial type="pty">
Aug 26 10:13:14 user nova-compute[73572]:       <log file="/opt/stack/data/nova/instances/c225e50a-3760-43d4-b398-3a663b478873/console.log" append="off"/>
Aug 26 10:13:14 user nova-compute[73572]:     </serial>
Aug 26 10:13:14 user nova-compute[73572]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 10:13:14 user nova-compute[73572]:     <video>
Aug 26 10:13:14 user nova-compute[73572]:       <model type="virtio"/>
Aug 26 10:13:14 user nova-compute[73572]:     </video>
Aug 26 10:13:14 user nova-compute[73572]:     <rng model="virtio">
Aug 26 10:13:14 user nova-compute[73572]:       <backend model="random">/dev/urandom</backend>
Aug 26 10:13:14 user nova-compute[73572]:     </rng>
Aug 26 10:13:14 user nova-compute[73572]:     <controller type="usb" index="0" model="none"/>
Aug 26 10:13:14 user nova-compute[73572]:     <memballoon model="virtio">
Aug 26 10:13:14 user nova-compute[73572]:       <stats period="10"/>
Aug 26 10:13:14 user nova-compute[73572]:     </memballoon>
Aug 26 10:13:14 user nova-compute[73572]:   </devices>
Aug 26 10:13:14 user nova-compute[73572]: </domain>
Aug 26 10:13:14 user nova-compute[73572]:  {{(pid=73572) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 10:13:14 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-140fd689-00d9-465f-959a-9b3f06cbcfd7 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T10:13:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1568261567',display_name='tempest-ServersNegativeTestJSON-server-1568261567',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1568261567',id=11,image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='27e946bd18464231965d43e20f1d2201',ramdisk_id='',reservation_id='r-301jj1h3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1661886679',owner_user_name='tempest-ServersNegativeTestJSON-1661886679-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T10:13:11Z,user_data=None,user_id='8efee83728774e58a60714e5c72cb1f2',uuid=c225e50a-3760-43d4-b398-3a663b478873,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e34f65a5-dd72-4d9c-ac50-2e7b1436db5d", "address": "fa:16:3e:64:f5:1f", "network": {"id": "f4c05fef-baf8-4c06-876f-1bdccd5a8689", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-169805980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27e946bd18464231965d43e20f1d2201", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape34f65a5-dd", "ovs_interfaceid": "e34f65a5-dd72-4d9c-ac50-2e7b1436db5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 10:13:14 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-140fd689-00d9-465f-959a-9b3f06cbcfd7 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] Converting VIF {"id": "e34f65a5-dd72-4d9c-ac50-2e7b1436db5d", "address": "fa:16:3e:64:f5:1f", "network": {"id": "f4c05fef-baf8-4c06-876f-1bdccd5a8689", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-169805980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27e946bd18464231965d43e20f1d2201", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape34f65a5-dd", "ovs_interfaceid": "e34f65a5-dd72-4d9c-ac50-2e7b1436db5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:13:14 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-140fd689-00d9-465f-959a-9b3f06cbcfd7 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:64:f5:1f,bridge_name='br-int',has_traffic_filtering=True,id=e34f65a5-dd72-4d9c-ac50-2e7b1436db5d,network=Network(f4c05fef-baf8-4c06-876f-1bdccd5a8689),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape34f65a5-dd') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:13:14 user nova-compute[73572]: DEBUG os_vif [None req-140fd689-00d9-465f-959a-9b3f06cbcfd7 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:f5:1f,bridge_name='br-int',has_traffic_filtering=True,id=e34f65a5-dd72-4d9c-ac50-2e7b1436db5d,network=Network(f4c05fef-baf8-4c06-876f-1bdccd5a8689),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape34f65a5-dd') {{(pid=73572) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 10:13:14 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:13:14 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:13:14 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 10:13:14 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-376d29f4-29c4-4e1a-8e75-fb9494c1b8d2 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] Acquiring lock "refresh_cache-b3c0b9c1-4218-4d6e-acac-d5d1dcf4f1b8" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:13:14 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-376d29f4-29c4-4e1a-8e75-fb9494c1b8d2 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] Acquired lock "refresh_cache-b3c0b9c1-4218-4d6e-acac-d5d1dcf4f1b8" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:13:14 user nova-compute[73572]: DEBUG nova.network.neutron [None req-376d29f4-29c4-4e1a-8e75-fb9494c1b8d2 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] [instance: b3c0b9c1-4218-4d6e-acac-d5d1dcf4f1b8] Building network info cache for instance {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 10:13:14 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:13:14 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape34f65a5-dd, may_exist=True, interface_attrs={}) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:13:14 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape34f65a5-dd, col_values=(('external_ids', {'iface-id': 'e34f65a5-dd72-4d9c-ac50-2e7b1436db5d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:64:f5:1f', 'vm-uuid': 'c225e50a-3760-43d4-b398-3a663b478873'}),), if_exists=True) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:13:14 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:13:14 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:13:14 user nova-compute[73572]: DEBUG nova.compute.manager [req-b5b7cb86-03ed-47c3-8503-a3036455cfa1 req-ecf46810-896a-45a9-a2db-bda207cc403b service nova] [instance: b3c0b9c1-4218-4d6e-acac-d5d1dcf4f1b8] Received event network-changed-6739bb4d-6b93-42f0-b2d9-f97a6a5a9040 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:13:14 user nova-compute[73572]: DEBUG nova.compute.manager [req-b5b7cb86-03ed-47c3-8503-a3036455cfa1 req-ecf46810-896a-45a9-a2db-bda207cc403b service nova] [instance: b3c0b9c1-4218-4d6e-acac-d5d1dcf4f1b8] Refreshing instance network info cache due to event network-changed-6739bb4d-6b93-42f0-b2d9-f97a6a5a9040. {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 10:13:14 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-b5b7cb86-03ed-47c3-8503-a3036455cfa1 req-ecf46810-896a-45a9-a2db-bda207cc403b service nova] Acquiring lock "refresh_cache-b3c0b9c1-4218-4d6e-acac-d5d1dcf4f1b8" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:13:14 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:13:14 user nova-compute[73572]: INFO os_vif [None req-140fd689-00d9-465f-959a-9b3f06cbcfd7 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:f5:1f,bridge_name='br-int',has_traffic_filtering=True,id=e34f65a5-dd72-4d9c-ac50-2e7b1436db5d,network=Network(f4c05fef-baf8-4c06-876f-1bdccd5a8689),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape34f65a5-dd')
Aug 26 10:13:14 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ee427dc-7aa0-4435-b23c-1223f2881df7/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:13:14 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-a42577c3-0465-4841-9c9c-00e87be5ed62 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] Acquiring lock "61b60a19-597e-4dc1-af0f-a0ec95e9fd24" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:13:14 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-a42577c3-0465-4841-9c9c-00e87be5ed62 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] Lock "61b60a19-597e-4dc1-af0f-a0ec95e9fd24" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.003s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:13:14 user nova-compute[73572]: INFO nova.compute.manager [None req-a42577c3-0465-4841-9c9c-00e87be5ed62 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] [instance: 61b60a19-597e-4dc1-af0f-a0ec95e9fd24] Attaching volume 1a37188c-85bf-435f-bc57-e7170c7158ea to /dev/vdb
Aug 26 10:13:14 user nova-compute[73572]: DEBUG nova.network.neutron [None req-376d29f4-29c4-4e1a-8e75-fb9494c1b8d2 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] [instance: b3c0b9c1-4218-4d6e-acac-d5d1dcf4f1b8] Instance cache missing network info. {{(pid=73572) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 10:13:14 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-140fd689-00d9-465f-959a-9b3f06cbcfd7 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] No BDM found with device name vda, not building metadata. {{(pid=73572) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 10:13:14 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-140fd689-00d9-465f-959a-9b3f06cbcfd7 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] No VIF found with MAC fa:16:3e:64:f5:1f, not building metadata {{(pid=73572) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 10:13:14 user nova-compute[73572]: DEBUG os_brick.utils [None req-a42577c3-0465-4841-9c9c-00e87be5ed62 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 10:13:14 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:13:14 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:13:14 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d151eba-1ada-4b74-b70f-d289ce9d73cb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:de8a79ed912\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:13:14 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:13:14 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:13:14 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ff81ab4-765a-48b5-a0c0-055f610702dc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:13:14 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ee427dc-7aa0-4435-b23c-1223f2881df7/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:13:14 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ee427dc-7aa0-4435-b23c-1223f2881df7/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:13:14 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:13:14 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:13:14 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[d12260aa-0ab1-4f37-af6d-f67f9c6c1182]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:13:14 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[35a2d17e-a0e7-46c7-8515-212c67037222]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:13:14 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-a42577c3-0465-4841-9c9c-00e87be5ed62 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] Running cmd (subprocess): nvme version {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:13:14 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-a42577c3-0465-4841-9c9c-00e87be5ed62 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] 'nvme version' failed. Not Retrying. {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 10:13:14 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a42577c3-0465-4841-9c9c-00e87be5ed62 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] nvme not present on system {{(pid=73572) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 10:13:14 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:13:14 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 10:13:14 user nova-compute[73572]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 10:13:14 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[a91cc033-828d-4f00-b82b-0206bf101563]: (4, '') {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:13:14 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.lightos [None req-a42577c3-0465-4841-9c9c-00e87be5ed62 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73572) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 10:13:14 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.lightos [None req-a42577c3-0465-4841-9c9c-00e87be5ed62 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73572) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 10:13:14 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.lightos [None req-a42577c3-0465-4841-9c9c-00e87be5ed62 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] LIGHTOS: no hostnqn found. {{(pid=73572) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 10:13:14 user nova-compute[73572]: DEBUG os_brick.utils [None req-a42577c3-0465-4841-9c9c-00e87be5ed62 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] <== get_connector_properties: return (191ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:de8a79ed912', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 10:13:14 user nova-compute[73572]: DEBUG nova.virt.block_device [None req-a42577c3-0465-4841-9c9c-00e87be5ed62 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] [instance: 61b60a19-597e-4dc1-af0f-a0ec95e9fd24] Updating existing volume attachment record: b1621df0-e7ec-408d-9b7b-d6ad045ed9aa {{(pid=73572) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 10:13:14 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ee427dc-7aa0-4435-b23c-1223f2881df7/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:13:14 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2a731d2-13ff-49e5-ab17-80686b622df7/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:13:14 user nova-compute[73572]: DEBUG nova.network.neutron [req-5d8e069c-7e94-4bf7-8480-5e31d1e23843 req-97952d19-c088-4491-b895-6b41daf94643 service nova] [instance: c225e50a-3760-43d4-b398-3a663b478873] Updated VIF entry in instance network info cache for port e34f65a5-dd72-4d9c-ac50-2e7b1436db5d. {{(pid=73572) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 10:13:14 user nova-compute[73572]: DEBUG nova.network.neutron [req-5d8e069c-7e94-4bf7-8480-5e31d1e23843 req-97952d19-c088-4491-b895-6b41daf94643 service nova] [instance: c225e50a-3760-43d4-b398-3a663b478873] Updating instance_info_cache with network_info: [{"id": "e34f65a5-dd72-4d9c-ac50-2e7b1436db5d", "address": "fa:16:3e:64:f5:1f", "network": {"id": "f4c05fef-baf8-4c06-876f-1bdccd5a8689", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-169805980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27e946bd18464231965d43e20f1d2201", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape34f65a5-dd", "ovs_interfaceid": "e34f65a5-dd72-4d9c-ac50-2e7b1436db5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:13:14 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-5d8e069c-7e94-4bf7-8480-5e31d1e23843 req-97952d19-c088-4491-b895-6b41daf94643 service nova] Releasing lock "refresh_cache-c225e50a-3760-43d4-b398-3a663b478873" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:13:14 user nova-compute[73572]: DEBUG nova.network.neutron [None req-376d29f4-29c4-4e1a-8e75-fb9494c1b8d2 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] [instance: b3c0b9c1-4218-4d6e-acac-d5d1dcf4f1b8] Updating instance_info_cache with network_info: [{"id": "6739bb4d-6b93-42f0-b2d9-f97a6a5a9040", "address": "fa:16:3e:a0:b1:c8", "network": {"id": "c0189896-22a3-47d8-adad-dff6c1e16a8f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2033963461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71aa440d71d44cd8a51d40bfbcae7f5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6739bb4d-6b", "ovs_interfaceid": "6739bb4d-6b93-42f0-b2d9-f97a6a5a9040", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:13:14 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2a731d2-13ff-49e5-ab17-80686b622df7/disk --force-share --output=json" returned: 0 in 0.282s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:13:14 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2a731d2-13ff-49e5-ab17-80686b622df7/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:13:14 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-376d29f4-29c4-4e1a-8e75-fb9494c1b8d2 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] Releasing lock "refresh_cache-b3c0b9c1-4218-4d6e-acac-d5d1dcf4f1b8" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:13:14 user nova-compute[73572]: DEBUG nova.compute.manager [None req-376d29f4-29c4-4e1a-8e75-fb9494c1b8d2 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] [instance: b3c0b9c1-4218-4d6e-acac-d5d1dcf4f1b8] Instance network_info: |[{"id": "6739bb4d-6b93-42f0-b2d9-f97a6a5a9040", "address": "fa:16:3e:a0:b1:c8", "network": {"id": "c0189896-22a3-47d8-adad-dff6c1e16a8f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2033963461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71aa440d71d44cd8a51d40bfbcae7f5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6739bb4d-6b", "ovs_interfaceid": "6739bb4d-6b93-42f0-b2d9-f97a6a5a9040", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73572) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 10:13:14 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-b5b7cb86-03ed-47c3-8503-a3036455cfa1 req-ecf46810-896a-45a9-a2db-bda207cc403b service nova] Acquired lock "refresh_cache-b3c0b9c1-4218-4d6e-acac-d5d1dcf4f1b8" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:13:14 user nova-compute[73572]: DEBUG nova.network.neutron [req-b5b7cb86-03ed-47c3-8503-a3036455cfa1 req-ecf46810-896a-45a9-a2db-bda207cc403b service nova] [instance: b3c0b9c1-4218-4d6e-acac-d5d1dcf4f1b8] Refreshing network info cache for port 6739bb4d-6b93-42f0-b2d9-f97a6a5a9040 {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 10:13:14 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-376d29f4-29c4-4e1a-8e75-fb9494c1b8d2 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] [instance: b3c0b9c1-4218-4d6e-acac-d5d1dcf4f1b8] Start _get_guest_xml network_info=[{"id": "6739bb4d-6b93-42f0-b2d9-f97a6a5a9040", "address": "fa:16:3e:a0:b1:c8", "network": {"id": "c0189896-22a3-47d8-adad-dff6c1e16a8f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2033963461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71aa440d71d44cd8a51d40bfbcae7f5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6739bb4d-6b", "ovs_interfaceid": "6739bb4d-6b93-42f0-b2d9-f97a6a5a9040", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T10:07:33Z,direct_url=<?>,disk_format='qcow2',id=299da0c9-e1c4-48f0-be55-fbe20dd06bc9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5c995f8bbbab4368b67a253e0df3971a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T10:07:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'guest_format': None, 'size': 0, 'encryption_format': None, 'device_type': 'disk', 'image_id': '299da0c9-e1c4-48f0-be55-fbe20dd06bc9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73572) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 10:13:14 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-376d29f4-29c4-4e1a-8e75-fb9494c1b8d2 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:13:14 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-376d29f4-29c4-4e1a-8e75-fb9494c1b8d2 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:13:14 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-376d29f4-29c4-4e1a-8e75-fb9494c1b8d2 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73572) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 10:13:14 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-376d29f4-29c4-4e1a-8e75-fb9494c1b8d2 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] CPU controller missing on host. {{(pid=73572) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 10:13:14 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-376d29f4-29c4-4e1a-8e75-fb9494c1b8d2 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73572) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 10:13:14 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-376d29f4-29c4-4e1a-8e75-fb9494c1b8d2 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] CPU controller found on host. {{(pid=73572) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 10:13:14 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-376d29f4-29c4-4e1a-8e75-fb9494c1b8d2 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73572) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 10:13:14 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-376d29f4-29c4-4e1a-8e75-fb9494c1b8d2 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T10:07:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T10:07:33Z,direct_url=<?>,disk_format='qcow2',id=299da0c9-e1c4-48f0-be55-fbe20dd06bc9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5c995f8bbbab4368b67a253e0df3971a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T10:07:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 10:13:14 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-376d29f4-29c4-4e1a-8e75-fb9494c1b8d2 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] Flavor limits 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 10:13:14 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-376d29f4-29c4-4e1a-8e75-fb9494c1b8d2 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] Image limits 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 10:13:14 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-376d29f4-29c4-4e1a-8e75-fb9494c1b8d2 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] Flavor pref 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 10:13:14 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-376d29f4-29c4-4e1a-8e75-fb9494c1b8d2 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] Image pref 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 10:13:14 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-376d29f4-29c4-4e1a-8e75-fb9494c1b8d2 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 10:13:14 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-376d29f4-29c4-4e1a-8e75-fb9494c1b8d2 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 10:13:14 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-376d29f4-29c4-4e1a-8e75-fb9494c1b8d2 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73572) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 10:13:14 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-376d29f4-29c4-4e1a-8e75-fb9494c1b8d2 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] Got 1 possible topologies {{(pid=73572) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 10:13:14 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-376d29f4-29c4-4e1a-8e75-fb9494c1b8d2 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 10:13:14 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-376d29f4-29c4-4e1a-8e75-fb9494c1b8d2 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 10:13:14 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-376d29f4-29c4-4e1a-8e75-fb9494c1b8d2 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T10:13:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1171385115',display_name='tempest-VolumesActionsTest-instance-1171385115',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1171385115',id=12,image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='71aa440d71d44cd8a51d40bfbcae7f5f',ramdisk_id='',reservation_id='r-ml0ps272',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1871113041',owner_user_name='tempest-VolumesActionsTest-1871113041-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T10:13:12Z,user_data=None,user_id='257dcb60edca4eebabab0b4db96ba6d6',uuid=b3c0b9c1-4218-4d6e-acac-d5d1dcf4f1b8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6739bb4d-6b93-42f0-b2d9-f97a6a5a9040", "address": "fa:16:3e:a0:b1:c8", "network": {"id": "c0189896-22a3-47d8-adad-dff6c1e16a8f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2033963461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71aa440d71d44cd8a51d40bfbcae7f5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6739bb4d-6b", "ovs_interfaceid": "6739bb4d-6b93-42f0-b2d9-f97a6a5a9040", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73572) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 10:13:14 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-376d29f4-29c4-4e1a-8e75-fb9494c1b8d2 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] Converting VIF {"id": "6739bb4d-6b93-42f0-b2d9-f97a6a5a9040", "address": "fa:16:3e:a0:b1:c8", "network": {"id": "c0189896-22a3-47d8-adad-dff6c1e16a8f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2033963461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71aa440d71d44cd8a51d40bfbcae7f5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6739bb4d-6b", "ovs_interfaceid": "6739bb4d-6b93-42f0-b2d9-f97a6a5a9040", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:13:14 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-376d29f4-29c4-4e1a-8e75-fb9494c1b8d2 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a0:b1:c8,bridge_name='br-int',has_traffic_filtering=True,id=6739bb4d-6b93-42f0-b2d9-f97a6a5a9040,network=Network(c0189896-22a3-47d8-adad-dff6c1e16a8f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6739bb4d-6b') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:13:14 user nova-compute[73572]: DEBUG nova.objects.instance [None req-376d29f4-29c4-4e1a-8e75-fb9494c1b8d2 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] Lazy-loading 'pci_devices' on Instance uuid b3c0b9c1-4218-4d6e-acac-d5d1dcf4f1b8 {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:13:14 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-376d29f4-29c4-4e1a-8e75-fb9494c1b8d2 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] [instance: b3c0b9c1-4218-4d6e-acac-d5d1dcf4f1b8] End _get_guest_xml xml=<domain type="kvm">
Aug 26 10:13:14 user nova-compute[73572]:   <uuid>b3c0b9c1-4218-4d6e-acac-d5d1dcf4f1b8</uuid>
Aug 26 10:13:14 user nova-compute[73572]:   <name>instance-0000000c</name>
Aug 26 10:13:14 user nova-compute[73572]:   <memory>524288</memory>
Aug 26 10:13:14 user nova-compute[73572]:   <vcpu>1</vcpu>
Aug 26 10:13:14 user nova-compute[73572]:   <metadata>
Aug 26 10:13:14 user nova-compute[73572]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 10:13:14 user nova-compute[73572]:       <nova:package version="0.0.0"/>
Aug 26 10:13:14 user nova-compute[73572]:       <nova:name>tempest-VolumesActionsTest-instance-1171385115</nova:name>
Aug 26 10:13:14 user nova-compute[73572]:       <nova:creationTime>2023-08-26 10:13:14</nova:creationTime>
Aug 26 10:13:14 user nova-compute[73572]:       <nova:flavor name="m1.tiny">
Aug 26 10:13:14 user nova-compute[73572]:         <nova:memory>512</nova:memory>
Aug 26 10:13:14 user nova-compute[73572]:         <nova:disk>1</nova:disk>
Aug 26 10:13:14 user nova-compute[73572]:         <nova:swap>0</nova:swap>
Aug 26 10:13:14 user nova-compute[73572]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 10:13:14 user nova-compute[73572]:         <nova:vcpus>1</nova:vcpus>
Aug 26 10:13:14 user nova-compute[73572]:       </nova:flavor>
Aug 26 10:13:14 user nova-compute[73572]:       <nova:owner>
Aug 26 10:13:14 user nova-compute[73572]:         <nova:user uuid="257dcb60edca4eebabab0b4db96ba6d6">tempest-VolumesActionsTest-1871113041-project-member</nova:user>
Aug 26 10:13:14 user nova-compute[73572]:         <nova:project uuid="71aa440d71d44cd8a51d40bfbcae7f5f">tempest-VolumesActionsTest-1871113041</nova:project>
Aug 26 10:13:14 user nova-compute[73572]:       </nova:owner>
Aug 26 10:13:14 user nova-compute[73572]:       <nova:root type="image" uuid="299da0c9-e1c4-48f0-be55-fbe20dd06bc9"/>
Aug 26 10:13:14 user nova-compute[73572]:       <nova:ports>
Aug 26 10:13:14 user nova-compute[73572]:         <nova:port uuid="6739bb4d-6b93-42f0-b2d9-f97a6a5a9040">
Aug 26 10:13:14 user nova-compute[73572]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 26 10:13:14 user nova-compute[73572]:         </nova:port>
Aug 26 10:13:14 user nova-compute[73572]:       </nova:ports>
Aug 26 10:13:14 user nova-compute[73572]:     </nova:instance>
Aug 26 10:13:14 user nova-compute[73572]:   </metadata>
Aug 26 10:13:14 user nova-compute[73572]:   <sysinfo type="smbios">
Aug 26 10:13:14 user nova-compute[73572]:     <system>
Aug 26 10:13:14 user nova-compute[73572]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 10:13:14 user nova-compute[73572]:       <entry name="product">OpenStack Nova</entry>
Aug 26 10:13:14 user nova-compute[73572]:       <entry name="version">0.0.0</entry>
Aug 26 10:13:14 user nova-compute[73572]:       <entry name="serial">b3c0b9c1-4218-4d6e-acac-d5d1dcf4f1b8</entry>
Aug 26 10:13:14 user nova-compute[73572]:       <entry name="uuid">b3c0b9c1-4218-4d6e-acac-d5d1dcf4f1b8</entry>
Aug 26 10:13:14 user nova-compute[73572]:       <entry name="family">Virtual Machine</entry>
Aug 26 10:13:14 user nova-compute[73572]:     </system>
Aug 26 10:13:14 user nova-compute[73572]:   </sysinfo>
Aug 26 10:13:14 user nova-compute[73572]:   <os>
Aug 26 10:13:14 user nova-compute[73572]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 10:13:14 user nova-compute[73572]:     <boot dev="hd"/>
Aug 26 10:13:14 user nova-compute[73572]:     <smbios mode="sysinfo"/>
Aug 26 10:13:14 user nova-compute[73572]:   </os>
Aug 26 10:13:14 user nova-compute[73572]:   <features>
Aug 26 10:13:14 user nova-compute[73572]:     <acpi/>
Aug 26 10:13:14 user nova-compute[73572]:     <apic/>
Aug 26 10:13:14 user nova-compute[73572]:     <vmcoreinfo/>
Aug 26 10:13:14 user nova-compute[73572]:   </features>
Aug 26 10:13:14 user nova-compute[73572]:   <clock offset="utc">
Aug 26 10:13:14 user nova-compute[73572]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 10:13:14 user nova-compute[73572]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 10:13:14 user nova-compute[73572]:     <timer name="hpet" present="no"/>
Aug 26 10:13:14 user nova-compute[73572]:   </clock>
Aug 26 10:13:14 user nova-compute[73572]:   <cpu mode="custom" match="exact">
Aug 26 10:13:14 user nova-compute[73572]:     <model>Nehalem</model>
Aug 26 10:13:14 user nova-compute[73572]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 10:13:14 user nova-compute[73572]:   </cpu>
Aug 26 10:13:14 user nova-compute[73572]:   <devices>
Aug 26 10:13:14 user nova-compute[73572]:     <disk type="file" device="disk">
Aug 26 10:13:14 user nova-compute[73572]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 10:13:14 user nova-compute[73572]:       <source file="/opt/stack/data/nova/instances/b3c0b9c1-4218-4d6e-acac-d5d1dcf4f1b8/disk"/>
Aug 26 10:13:14 user nova-compute[73572]:       <target dev="vda" bus="virtio"/>
Aug 26 10:13:14 user nova-compute[73572]:     </disk>
Aug 26 10:13:14 user nova-compute[73572]:     <interface type="ethernet">
Aug 26 10:13:14 user nova-compute[73572]:       <mac address="fa:16:3e:a0:b1:c8"/>
Aug 26 10:13:14 user nova-compute[73572]:       <model type="virtio"/>
Aug 26 10:13:14 user nova-compute[73572]:       <mtu size="1442"/>
Aug 26 10:13:14 user nova-compute[73572]:       <target dev="tap6739bb4d-6b"/>
Aug 26 10:13:14 user nova-compute[73572]:     </interface>
Aug 26 10:13:14 user nova-compute[73572]:     <serial type="pty">
Aug 26 10:13:14 user nova-compute[73572]:       <log file="/opt/stack/data/nova/instances/b3c0b9c1-4218-4d6e-acac-d5d1dcf4f1b8/console.log" append="off"/>
Aug 26 10:13:14 user nova-compute[73572]:     </serial>
Aug 26 10:13:14 user nova-compute[73572]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 10:13:14 user nova-compute[73572]:     <video>
Aug 26 10:13:14 user nova-compute[73572]:       <model type="virtio"/>
Aug 26 10:13:14 user nova-compute[73572]:     </video>
Aug 26 10:13:14 user nova-compute[73572]:     <rng model="virtio">
Aug 26 10:13:14 user nova-compute[73572]:       <backend model="random">/dev/urandom</backend>
Aug 26 10:13:14 user nova-compute[73572]:     </rng>
Aug 26 10:13:14 user nova-compute[73572]:     <controller type="usb" index="0" model="none"/>
Aug 26 10:13:14 user nova-compute[73572]:     <memballoon model="virtio">
Aug 26 10:13:14 user nova-compute[73572]:       <stats period="10"/>
Aug 26 10:13:14 user nova-compute[73572]:     </memballoon>
Aug 26 10:13:14 user nova-compute[73572]:   </devices>
Aug 26 10:13:14 user nova-compute[73572]: </domain>
Aug 26 10:13:14 user nova-compute[73572]:  {{(pid=73572) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 10:13:14 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-376d29f4-29c4-4e1a-8e75-fb9494c1b8d2 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T10:13:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1171385115',display_name='tempest-VolumesActionsTest-instance-1171385115',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1171385115',id=12,image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='71aa440d71d44cd8a51d40bfbcae7f5f',ramdisk_id='',reservation_id='r-ml0ps272',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1871113041',owner_user_name='tempest-VolumesActionsTest-1871113041-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T10:13:12Z,user_data=None,user_id='257dcb60edca4eebabab0b4db96ba6d6',uuid=b3c0b9c1-4218-4d6e-acac-d5d1dcf4f1b8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6739bb4d-6b93-42f0-b2d9-f97a6a5a9040", "address": "fa:16:3e:a0:b1:c8", "network": {"id": "c0189896-22a3-47d8-adad-dff6c1e16a8f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2033963461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71aa440d71d44cd8a51d40bfbcae7f5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6739bb4d-6b", "ovs_interfaceid": "6739bb4d-6b93-42f0-b2d9-f97a6a5a9040", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 10:13:14 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-376d29f4-29c4-4e1a-8e75-fb9494c1b8d2 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] Converting VIF {"id": "6739bb4d-6b93-42f0-b2d9-f97a6a5a9040", "address": "fa:16:3e:a0:b1:c8", "network": {"id": "c0189896-22a3-47d8-adad-dff6c1e16a8f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2033963461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71aa440d71d44cd8a51d40bfbcae7f5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6739bb4d-6b", "ovs_interfaceid": "6739bb4d-6b93-42f0-b2d9-f97a6a5a9040", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:13:14 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-376d29f4-29c4-4e1a-8e75-fb9494c1b8d2 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a0:b1:c8,bridge_name='br-int',has_traffic_filtering=True,id=6739bb4d-6b93-42f0-b2d9-f97a6a5a9040,network=Network(c0189896-22a3-47d8-adad-dff6c1e16a8f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6739bb4d-6b') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:13:14 user nova-compute[73572]: DEBUG os_vif [None req-376d29f4-29c4-4e1a-8e75-fb9494c1b8d2 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:b1:c8,bridge_name='br-int',has_traffic_filtering=True,id=6739bb4d-6b93-42f0-b2d9-f97a6a5a9040,network=Network(c0189896-22a3-47d8-adad-dff6c1e16a8f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6739bb4d-6b') {{(pid=73572) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 10:13:14 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:13:14 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:13:14 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 10:13:14 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:13:14 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6739bb4d-6b, may_exist=True, interface_attrs={}) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:13:14 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6739bb4d-6b, col_values=(('external_ids', {'iface-id': '6739bb4d-6b93-42f0-b2d9-f97a6a5a9040', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a0:b1:c8', 'vm-uuid': 'b3c0b9c1-4218-4d6e-acac-d5d1dcf4f1b8'}),), if_exists=True) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:13:14 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:13:14 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:13:15 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2a731d2-13ff-49e5-ab17-80686b622df7/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:13:15 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:13:15 user nova-compute[73572]: INFO os_vif [None req-376d29f4-29c4-4e1a-8e75-fb9494c1b8d2 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:b1:c8,bridge_name='br-int',has_traffic_filtering=True,id=6739bb4d-6b93-42f0-b2d9-f97a6a5a9040,network=Network(c0189896-22a3-47d8-adad-dff6c1e16a8f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6739bb4d-6b')
Aug 26 10:13:15 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b140c11-1a26-4312-9cec-8054582d15f5/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:13:15 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-376d29f4-29c4-4e1a-8e75-fb9494c1b8d2 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] No BDM found with device name vda, not building metadata. {{(pid=73572) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 10:13:15 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-376d29f4-29c4-4e1a-8e75-fb9494c1b8d2 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] No VIF found with MAC fa:16:3e:a0:b1:c8, not building metadata {{(pid=73572) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 10:13:15 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b140c11-1a26-4312-9cec-8054582d15f5/disk --force-share --output=json" returned: 0 in 0.300s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:13:15 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b140c11-1a26-4312-9cec-8054582d15f5/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:13:15 user nova-compute[73572]: DEBUG nova.network.neutron [req-b5b7cb86-03ed-47c3-8503-a3036455cfa1 req-ecf46810-896a-45a9-a2db-bda207cc403b service nova] [instance: b3c0b9c1-4218-4d6e-acac-d5d1dcf4f1b8] Updated VIF entry in instance network info cache for port 6739bb4d-6b93-42f0-b2d9-f97a6a5a9040. {{(pid=73572) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 10:13:15 user nova-compute[73572]: DEBUG nova.network.neutron [req-b5b7cb86-03ed-47c3-8503-a3036455cfa1 req-ecf46810-896a-45a9-a2db-bda207cc403b service nova] [instance: b3c0b9c1-4218-4d6e-acac-d5d1dcf4f1b8] Updating instance_info_cache with network_info: [{"id": "6739bb4d-6b93-42f0-b2d9-f97a6a5a9040", "address": "fa:16:3e:a0:b1:c8", "network": {"id": "c0189896-22a3-47d8-adad-dff6c1e16a8f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2033963461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71aa440d71d44cd8a51d40bfbcae7f5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6739bb4d-6b", "ovs_interfaceid": "6739bb4d-6b93-42f0-b2d9-f97a6a5a9040", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:13:15 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-b5b7cb86-03ed-47c3-8503-a3036455cfa1 req-ecf46810-896a-45a9-a2db-bda207cc403b service nova] Releasing lock "refresh_cache-b3c0b9c1-4218-4d6e-acac-d5d1dcf4f1b8" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:13:15 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b140c11-1a26-4312-9cec-8054582d15f5/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:13:15 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee9bcbaa-25a6-4588-b757-2a2ae15b6cf8/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:13:15 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee9bcbaa-25a6-4588-b757-2a2ae15b6cf8/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:13:15 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee9bcbaa-25a6-4588-b757-2a2ae15b6cf8/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:13:15 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee9bcbaa-25a6-4588-b757-2a2ae15b6cf8/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:13:16 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c555f971-b177-4c26-a38e-09e0e78bf7b9/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:13:16 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:13:16 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:13:16 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:13:16 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c555f971-b177-4c26-a38e-09e0e78bf7b9/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:13:16 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c555f971-b177-4c26-a38e-09e0e78bf7b9/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:13:16 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:13:16 user nova-compute[73572]: DEBUG nova.compute.manager [req-f48026f3-d10b-4e59-8fe2-f4938177384d req-347bd67b-803f-4a57-880c-8d72c9c49786 service nova] [instance: c555f971-b177-4c26-a38e-09e0e78bf7b9] Received event network-changed-4ffb7229-16fb-441b-a954-d91308071fb8 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:13:16 user nova-compute[73572]: DEBUG nova.compute.manager [req-f48026f3-d10b-4e59-8fe2-f4938177384d req-347bd67b-803f-4a57-880c-8d72c9c49786 service nova] [instance: c555f971-b177-4c26-a38e-09e0e78bf7b9] Refreshing instance network info cache due to event network-changed-4ffb7229-16fb-441b-a954-d91308071fb8. {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 10:13:16 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-f48026f3-d10b-4e59-8fe2-f4938177384d req-347bd67b-803f-4a57-880c-8d72c9c49786 service nova] Acquiring lock "refresh_cache-c555f971-b177-4c26-a38e-09e0e78bf7b9" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:13:16 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-f48026f3-d10b-4e59-8fe2-f4938177384d req-347bd67b-803f-4a57-880c-8d72c9c49786 service nova] Acquired lock "refresh_cache-c555f971-b177-4c26-a38e-09e0e78bf7b9" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:13:16 user nova-compute[73572]: DEBUG nova.network.neutron [req-f48026f3-d10b-4e59-8fe2-f4938177384d req-347bd67b-803f-4a57-880c-8d72c9c49786 service nova] [instance: c555f971-b177-4c26-a38e-09e0e78bf7b9] Refreshing network info cache for port 4ffb7229-16fb-441b-a954-d91308071fb8 {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 10:13:16 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c555f971-b177-4c26-a38e-09e0e78bf7b9/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:13:16 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61b60a19-597e-4dc1-af0f-a0ec95e9fd24/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:13:16 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61b60a19-597e-4dc1-af0f-a0ec95e9fd24/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:13:16 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61b60a19-597e-4dc1-af0f-a0ec95e9fd24/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:13:16 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61b60a19-597e-4dc1-af0f-a0ec95e9fd24/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:13:20 user nova-compute[73572]: DEBUG nova.virt.driver [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Emitting event <LifecycleEvent: 1693044799.702205, c225e50a-3760-43d4-b398-3a663b478873 => Resumed> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:13:20 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: c225e50a-3760-43d4-b398-3a663b478873] VM Resumed (Lifecycle Event)
Aug 26 10:13:20 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:13:20 user nova-compute[73572]: DEBUG nova.compute.manager [req-078b29a0-e900-4bc5-8719-51d4ec06dbd6 req-ddd9d375-34e9-41c0-a17a-3a062d297818 service nova] [instance: b3c0b9c1-4218-4d6e-acac-d5d1dcf4f1b8] Received event network-vif-plugged-6739bb4d-6b93-42f0-b2d9-f97a6a5a9040 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:13:20 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-078b29a0-e900-4bc5-8719-51d4ec06dbd6 req-ddd9d375-34e9-41c0-a17a-3a062d297818 service nova] Acquiring lock "b3c0b9c1-4218-4d6e-acac-d5d1dcf4f1b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:13:20 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-078b29a0-e900-4bc5-8719-51d4ec06dbd6 req-ddd9d375-34e9-41c0-a17a-3a062d297818 service nova] Lock "b3c0b9c1-4218-4d6e-acac-d5d1dcf4f1b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:13:20 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-078b29a0-e900-4bc5-8719-51d4ec06dbd6 req-ddd9d375-34e9-41c0-a17a-3a062d297818 service nova] Lock "b3c0b9c1-4218-4d6e-acac-d5d1dcf4f1b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:13:20 user nova-compute[73572]: DEBUG nova.compute.manager [req-078b29a0-e900-4bc5-8719-51d4ec06dbd6 req-ddd9d375-34e9-41c0-a17a-3a062d297818 service nova] [instance: b3c0b9c1-4218-4d6e-acac-d5d1dcf4f1b8] No waiting events found dispatching network-vif-plugged-6739bb4d-6b93-42f0-b2d9-f97a6a5a9040 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:13:20 user nova-compute[73572]: WARNING nova.compute.manager [req-078b29a0-e900-4bc5-8719-51d4ec06dbd6 req-ddd9d375-34e9-41c0-a17a-3a062d297818 service nova] [instance: b3c0b9c1-4218-4d6e-acac-d5d1dcf4f1b8] Received unexpected event network-vif-plugged-6739bb4d-6b93-42f0-b2d9-f97a6a5a9040 for instance with vm_state building and task_state spawning.
Aug 26 10:13:20 user nova-compute[73572]: DEBUG nova.compute.manager [req-8019e343-a822-4183-87c8-3f9ffacaed2e req-a3ff6199-fa0b-4741-ac10-e4d1fe130686 service nova] [instance: c225e50a-3760-43d4-b398-3a663b478873] Received event network-vif-plugged-e34f65a5-dd72-4d9c-ac50-2e7b1436db5d {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:13:20 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-8019e343-a822-4183-87c8-3f9ffacaed2e req-a3ff6199-fa0b-4741-ac10-e4d1fe130686 service nova] Acquiring lock "c225e50a-3760-43d4-b398-3a663b478873-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:13:20 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-8019e343-a822-4183-87c8-3f9ffacaed2e req-a3ff6199-fa0b-4741-ac10-e4d1fe130686 service nova] Lock "c225e50a-3760-43d4-b398-3a663b478873-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:13:20 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-8019e343-a822-4183-87c8-3f9ffacaed2e req-a3ff6199-fa0b-4741-ac10-e4d1fe130686 service nova] Lock "c225e50a-3760-43d4-b398-3a663b478873-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:13:20 user nova-compute[73572]: DEBUG nova.compute.manager [req-8019e343-a822-4183-87c8-3f9ffacaed2e req-a3ff6199-fa0b-4741-ac10-e4d1fe130686 service nova] [instance: c225e50a-3760-43d4-b398-3a663b478873] No waiting events found dispatching network-vif-plugged-e34f65a5-dd72-4d9c-ac50-2e7b1436db5d {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:13:20 user nova-compute[73572]: WARNING nova.compute.manager [req-8019e343-a822-4183-87c8-3f9ffacaed2e req-a3ff6199-fa0b-4741-ac10-e4d1fe130686 service nova] [instance: c225e50a-3760-43d4-b398-3a663b478873] Received unexpected event network-vif-plugged-e34f65a5-dd72-4d9c-ac50-2e7b1436db5d for instance with vm_state building and task_state spawning.
Aug 26 10:13:20 user nova-compute[73572]: DEBUG nova.compute.manager [req-8019e343-a822-4183-87c8-3f9ffacaed2e req-a3ff6199-fa0b-4741-ac10-e4d1fe130686 service nova] [instance: c225e50a-3760-43d4-b398-3a663b478873] Received event network-vif-plugged-e34f65a5-dd72-4d9c-ac50-2e7b1436db5d {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:13:20 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-8019e343-a822-4183-87c8-3f9ffacaed2e req-a3ff6199-fa0b-4741-ac10-e4d1fe130686 service nova] Acquiring lock "c225e50a-3760-43d4-b398-3a663b478873-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:13:20 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-8019e343-a822-4183-87c8-3f9ffacaed2e req-a3ff6199-fa0b-4741-ac10-e4d1fe130686 service nova] Lock "c225e50a-3760-43d4-b398-3a663b478873-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:13:20 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-8019e343-a822-4183-87c8-3f9ffacaed2e req-a3ff6199-fa0b-4741-ac10-e4d1fe130686 service nova] Lock "c225e50a-3760-43d4-b398-3a663b478873-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:13:20 user nova-compute[73572]: DEBUG nova.compute.manager [req-8019e343-a822-4183-87c8-3f9ffacaed2e req-a3ff6199-fa0b-4741-ac10-e4d1fe130686 service nova] [instance: c225e50a-3760-43d4-b398-3a663b478873] No waiting events found dispatching network-vif-plugged-e34f65a5-dd72-4d9c-ac50-2e7b1436db5d {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:13:20 user nova-compute[73572]: WARNING nova.compute.manager [req-8019e343-a822-4183-87c8-3f9ffacaed2e req-a3ff6199-fa0b-4741-ac10-e4d1fe130686 service nova] [instance: c225e50a-3760-43d4-b398-3a663b478873] Received unexpected event network-vif-plugged-e34f65a5-dd72-4d9c-ac50-2e7b1436db5d for instance with vm_state building and task_state spawning.
Aug 26 10:13:20 user nova-compute[73572]: DEBUG nova.compute.manager [req-9caafaba-1102-4522-aa66-ae0c0d3f8e1c req-a6f4129a-498e-4f86-93b7-d773f207efb6 service nova] [instance: b3c0b9c1-4218-4d6e-acac-d5d1dcf4f1b8] Received event network-vif-plugged-6739bb4d-6b93-42f0-b2d9-f97a6a5a9040 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:13:20 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-9caafaba-1102-4522-aa66-ae0c0d3f8e1c req-a6f4129a-498e-4f86-93b7-d773f207efb6 service nova] Acquiring lock "b3c0b9c1-4218-4d6e-acac-d5d1dcf4f1b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:13:20 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-9caafaba-1102-4522-aa66-ae0c0d3f8e1c req-a6f4129a-498e-4f86-93b7-d773f207efb6 service nova] Lock "b3c0b9c1-4218-4d6e-acac-d5d1dcf4f1b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:13:20 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-9caafaba-1102-4522-aa66-ae0c0d3f8e1c req-a6f4129a-498e-4f86-93b7-d773f207efb6 service nova] Lock "b3c0b9c1-4218-4d6e-acac-d5d1dcf4f1b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:13:20 user nova-compute[73572]: DEBUG nova.compute.manager [req-9caafaba-1102-4522-aa66-ae0c0d3f8e1c req-a6f4129a-498e-4f86-93b7-d773f207efb6 service nova] [instance: b3c0b9c1-4218-4d6e-acac-d5d1dcf4f1b8] No waiting events found dispatching network-vif-plugged-6739bb4d-6b93-42f0-b2d9-f97a6a5a9040 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:13:20 user nova-compute[73572]: WARNING nova.compute.manager [req-9caafaba-1102-4522-aa66-ae0c0d3f8e1c req-a6f4129a-498e-4f86-93b7-d773f207efb6 service nova] [instance: b3c0b9c1-4218-4d6e-acac-d5d1dcf4f1b8] Received unexpected event network-vif-plugged-6739bb4d-6b93-42f0-b2d9-f97a6a5a9040 for instance with vm_state building and task_state spawning.
Aug 26 10:13:20 user nova-compute[73572]: DEBUG nova.compute.manager [None req-140fd689-00d9-465f-959a-9b3f06cbcfd7 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] [instance: c225e50a-3760-43d4-b398-3a663b478873] Instance event wait completed in 0 seconds for  {{(pid=73572) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 10:13:20 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-140fd689-00d9-465f-959a-9b3f06cbcfd7 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] [instance: c225e50a-3760-43d4-b398-3a663b478873] Guest created on hypervisor {{(pid=73572) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 10:13:20 user nova-compute[73572]: DEBUG nova.compute.manager [None req-376d29f4-29c4-4e1a-8e75-fb9494c1b8d2 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] [instance: b3c0b9c1-4218-4d6e-acac-d5d1dcf4f1b8] Instance event wait completed in 0 seconds for  {{(pid=73572) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 10:13:20 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-376d29f4-29c4-4e1a-8e75-fb9494c1b8d2 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] [instance: b3c0b9c1-4218-4d6e-acac-d5d1dcf4f1b8] Guest created on hypervisor {{(pid=73572) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 10:13:20 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: c225e50a-3760-43d4-b398-3a663b478873] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:13:20 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: c225e50a-3760-43d4-b398-3a663b478873] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73572) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 10:13:20 user nova-compute[73572]: INFO nova.virt.libvirt.driver [-] [instance: c225e50a-3760-43d4-b398-3a663b478873] Instance spawned successfully.
Aug 26 10:13:20 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-68df53ea-32fb-4c55-b827-7a7a796e0965 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: c785b609-0068-442f-91f5-d26e888a993f] Snapshot image upload complete
Aug 26 10:13:20 user nova-compute[73572]: INFO nova.compute.manager [None req-68df53ea-32fb-4c55-b827-7a7a796e0965 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: c785b609-0068-442f-91f5-d26e888a993f] Took 10.41 seconds to snapshot the instance on the hypervisor.
Aug 26 10:13:20 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-140fd689-00d9-465f-959a-9b3f06cbcfd7 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] [instance: c225e50a-3760-43d4-b398-3a663b478873] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 10:13:20 user nova-compute[73572]: DEBUG nova.network.neutron [req-f48026f3-d10b-4e59-8fe2-f4938177384d req-347bd67b-803f-4a57-880c-8d72c9c49786 service nova] [instance: c555f971-b177-4c26-a38e-09e0e78bf7b9] Updated VIF entry in instance network info cache for port 4ffb7229-16fb-441b-a954-d91308071fb8. {{(pid=73572) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 10:13:20 user nova-compute[73572]: DEBUG nova.network.neutron [req-f48026f3-d10b-4e59-8fe2-f4938177384d req-347bd67b-803f-4a57-880c-8d72c9c49786 service nova] [instance: c555f971-b177-4c26-a38e-09e0e78bf7b9] Updating instance_info_cache with network_info: [{"id": "4ffb7229-16fb-441b-a954-d91308071fb8", "address": "fa:16:3e:26:32:ef", "network": {"id": "e052e34f-ce84-4612-b48b-2ed8474e7177", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-332746918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4556d14c0dd416fbe13ab2274947dec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ffb7229-16", "ovs_interfaceid": "4ffb7229-16fb-441b-a954-d91308071fb8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:13:20 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: c225e50a-3760-43d4-b398-3a663b478873] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 10:13:20 user nova-compute[73572]: DEBUG nova.virt.driver [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Emitting event <LifecycleEvent: 1693044799.7037807, b3c0b9c1-4218-4d6e-acac-d5d1dcf4f1b8 => Resumed> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:13:20 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: b3c0b9c1-4218-4d6e-acac-d5d1dcf4f1b8] VM Resumed (Lifecycle Event)
Aug 26 10:13:20 user nova-compute[73572]: DEBUG nova.compute.manager [None req-b6f83183-8b38-4755-8f18-f924215ae2ed tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] [instance: c555f971-b177-4c26-a38e-09e0e78bf7b9] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:13:20 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:13:20 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:13:20 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Hypervisor/Node resource view: name=user free_ram=7084MB free_disk=25.6441650390625GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=73572) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 10:13:20 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:13:20 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:13:20 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-f48026f3-d10b-4e59-8fe2-f4938177384d req-347bd67b-803f-4a57-880c-8d72c9c49786 service nova] Releasing lock "refresh_cache-c555f971-b177-4c26-a38e-09e0e78bf7b9" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:13:20 user nova-compute[73572]: INFO nova.virt.libvirt.driver [-] [instance: b3c0b9c1-4218-4d6e-acac-d5d1dcf4f1b8] Instance spawned successfully.
Aug 26 10:13:20 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-376d29f4-29c4-4e1a-8e75-fb9494c1b8d2 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] [instance: b3c0b9c1-4218-4d6e-acac-d5d1dcf4f1b8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 10:13:20 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: b3c0b9c1-4218-4d6e-acac-d5d1dcf4f1b8] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:13:20 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-140fd689-00d9-465f-959a-9b3f06cbcfd7 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] [instance: c225e50a-3760-43d4-b398-3a663b478873] Found default for hw_cdrom_bus of ide {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:13:20 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-140fd689-00d9-465f-959a-9b3f06cbcfd7 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] [instance: c225e50a-3760-43d4-b398-3a663b478873] Found default for hw_disk_bus of virtio {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:13:20 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-140fd689-00d9-465f-959a-9b3f06cbcfd7 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] [instance: c225e50a-3760-43d4-b398-3a663b478873] Found default for hw_input_bus of None {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:13:20 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-140fd689-00d9-465f-959a-9b3f06cbcfd7 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] [instance: c225e50a-3760-43d4-b398-3a663b478873] Found default for hw_pointer_model of None {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:13:20 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-140fd689-00d9-465f-959a-9b3f06cbcfd7 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] [instance: c225e50a-3760-43d4-b398-3a663b478873] Found default for hw_video_model of virtio {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:13:20 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-140fd689-00d9-465f-959a-9b3f06cbcfd7 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] [instance: c225e50a-3760-43d4-b398-3a663b478873] Found default for hw_vif_model of virtio {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:13:20 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: b3c0b9c1-4218-4d6e-acac-d5d1dcf4f1b8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73572) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 10:13:20 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-376d29f4-29c4-4e1a-8e75-fb9494c1b8d2 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] [instance: b3c0b9c1-4218-4d6e-acac-d5d1dcf4f1b8] Found default for hw_cdrom_bus of ide {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:13:20 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-376d29f4-29c4-4e1a-8e75-fb9494c1b8d2 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] [instance: b3c0b9c1-4218-4d6e-acac-d5d1dcf4f1b8] Found default for hw_disk_bus of virtio {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:13:20 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-376d29f4-29c4-4e1a-8e75-fb9494c1b8d2 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] [instance: b3c0b9c1-4218-4d6e-acac-d5d1dcf4f1b8] Found default for hw_input_bus of None {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:13:20 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-376d29f4-29c4-4e1a-8e75-fb9494c1b8d2 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] [instance: b3c0b9c1-4218-4d6e-acac-d5d1dcf4f1b8] Found default for hw_pointer_model of None {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:13:20 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-376d29f4-29c4-4e1a-8e75-fb9494c1b8d2 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] [instance: b3c0b9c1-4218-4d6e-acac-d5d1dcf4f1b8] Found default for hw_video_model of virtio {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:13:20 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-376d29f4-29c4-4e1a-8e75-fb9494c1b8d2 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] [instance: b3c0b9c1-4218-4d6e-acac-d5d1dcf4f1b8] Found default for hw_vif_model of virtio {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:13:20 user nova-compute[73572]: INFO nova.compute.manager [None req-b6f83183-8b38-4755-8f18-f924215ae2ed tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] [instance: c555f971-b177-4c26-a38e-09e0e78bf7b9] instance snapshotting
Aug 26 10:13:20 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: b3c0b9c1-4218-4d6e-acac-d5d1dcf4f1b8] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 10:13:20 user nova-compute[73572]: DEBUG nova.virt.driver [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Emitting event <LifecycleEvent: 1693044799.7041101, c225e50a-3760-43d4-b398-3a663b478873 => Started> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:13:20 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: c225e50a-3760-43d4-b398-3a663b478873] VM Started (Lifecycle Event)
Aug 26 10:13:20 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: c225e50a-3760-43d4-b398-3a663b478873] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:13:20 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: c225e50a-3760-43d4-b398-3a663b478873] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73572) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 10:13:20 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance 61b60a19-597e-4dc1-af0f-a0ec95e9fd24 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:13:20 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance c785b609-0068-442f-91f5-d26e888a993f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:13:20 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance 8302d6e7-aaf3-461c-a55e-f2e685d1800d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:13:20 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance c555f971-b177-4c26-a38e-09e0e78bf7b9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:13:20 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance ee9bcbaa-25a6-4588-b757-2a2ae15b6cf8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:13:20 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance 8ee427dc-7aa0-4435-b23c-1223f2881df7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:13:20 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance d2a731d2-13ff-49e5-ab17-80686b622df7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:13:20 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance bc56542d-af1f-4313-8555-1b2014ff35e7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:13:20 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance 83670c16-3566-4679-8e74-c6451c840315 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:13:20 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance 0b140c11-1a26-4312-9cec-8054582d15f5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:13:20 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance c225e50a-3760-43d4-b398-3a663b478873 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:13:20 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance b3c0b9c1-4218-4d6e-acac-d5d1dcf4f1b8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:13:20 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=73572) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 10:13:20 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=73572) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 10:13:20 user nova-compute[73572]: INFO nova.compute.manager [None req-140fd689-00d9-465f-959a-9b3f06cbcfd7 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] [instance: c225e50a-3760-43d4-b398-3a663b478873] Took 9.20 seconds to spawn the instance on the hypervisor.
Aug 26 10:13:20 user nova-compute[73572]: DEBUG nova.compute.manager [None req-140fd689-00d9-465f-959a-9b3f06cbcfd7 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] [instance: c225e50a-3760-43d4-b398-3a663b478873] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:13:20 user nova-compute[73572]: INFO nova.compute.manager [None req-376d29f4-29c4-4e1a-8e75-fb9494c1b8d2 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] [instance: b3c0b9c1-4218-4d6e-acac-d5d1dcf4f1b8] Took 7.96 seconds to spawn the instance on the hypervisor.
Aug 26 10:13:20 user nova-compute[73572]: DEBUG nova.compute.manager [None req-376d29f4-29c4-4e1a-8e75-fb9494c1b8d2 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] [instance: b3c0b9c1-4218-4d6e-acac-d5d1dcf4f1b8] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:13:20 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: c225e50a-3760-43d4-b398-3a663b478873] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 10:13:20 user nova-compute[73572]: DEBUG nova.virt.driver [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Emitting event <LifecycleEvent: 1693044799.7069063, b3c0b9c1-4218-4d6e-acac-d5d1dcf4f1b8 => Started> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:13:20 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: b3c0b9c1-4218-4d6e-acac-d5d1dcf4f1b8] VM Started (Lifecycle Event)
Aug 26 10:13:20 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: b3c0b9c1-4218-4d6e-acac-d5d1dcf4f1b8] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:13:20 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-b6f83183-8b38-4755-8f18-f924215ae2ed tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] [instance: c555f971-b177-4c26-a38e-09e0e78bf7b9] Beginning live snapshot process
Aug 26 10:13:20 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: b3c0b9c1-4218-4d6e-acac-d5d1dcf4f1b8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73572) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 10:13:20 user nova-compute[73572]: INFO nova.compute.manager [None req-140fd689-00d9-465f-959a-9b3f06cbcfd7 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] [instance: c225e50a-3760-43d4-b398-3a663b478873] Took 10.42 seconds to build instance.
Aug 26 10:13:20 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: b3c0b9c1-4218-4d6e-acac-d5d1dcf4f1b8] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 10:13:20 user nova-compute[73572]: INFO nova.virt.block_device [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] [instance: 83670c16-3566-4679-8e74-c6451c840315] Booting with volume 75ebe4c4-f791-4f09-a9bd-747ade3d70a3 at /dev/vdc
Aug 26 10:13:20 user nova-compute[73572]: INFO nova.compute.manager [None req-376d29f4-29c4-4e1a-8e75-fb9494c1b8d2 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] [instance: b3c0b9c1-4218-4d6e-acac-d5d1dcf4f1b8] Took 9.66 seconds to build instance.
Aug 26 10:13:20 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-140fd689-00d9-465f-959a-9b3f06cbcfd7 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] Lock "c225e50a-3760-43d4-b398-3a663b478873" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.631s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:13:20 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-376d29f4-29c4-4e1a-8e75-fb9494c1b8d2 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] Lock "b3c0b9c1-4218-4d6e-acac-d5d1dcf4f1b8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.818s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:13:20 user nova-compute[73572]: DEBUG os_brick.utils [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 10:13:20 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:13:20 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:13:20 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f65552d-032c-4103-b570-8cf66619eff1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:de8a79ed912\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:13:20 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:13:20 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.026s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:13:20 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b16abfa-bab8-4e94-8b7e-92c07659d820]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:13:20 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:13:20 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-b6f83183-8b38-4755-8f18-f924215ae2ed tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c555f971-b177-4c26-a38e-09e0e78bf7b9/disk --force-share --output=json -f qcow2 {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:13:20 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:13:20 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1d999cc-c7b3-4dc3-9e54-0017a36d0c9e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:13:20 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[359191c9-3235-4fe9-a914-2fdcc8dad5be]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:13:20 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] Running cmd (subprocess): nvme version {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:13:21 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] 'nvme version' failed. Not Retrying. {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 10:13:21 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] nvme not present on system {{(pid=73572) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 10:13:21 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:13:21 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 10:13:21 user nova-compute[73572]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 10:13:21 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fbc5006-a978-4be9-a74d-e7dbc9e05716]: (4, '') {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:13:21 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.lightos [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73572) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 10:13:21 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.lightos [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73572) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 10:13:21 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.lightos [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] LIGHTOS: no hostnqn found. {{(pid=73572) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 10:13:21 user nova-compute[73572]: DEBUG os_brick.utils [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] <== get_connector_properties: return (228ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:de8a79ed912', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 10:13:21 user nova-compute[73572]: DEBUG nova.virt.block_device [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] [instance: 83670c16-3566-4679-8e74-c6451c840315] Updating existing volume attachment record: 525996ef-1140-401c-98bd-dd926811b7ae {{(pid=73572) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 10:13:21 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-b6f83183-8b38-4755-8f18-f924215ae2ed tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c555f971-b177-4c26-a38e-09e0e78bf7b9/disk --force-share --output=json -f qcow2" returned: 0 in 0.219s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:13:21 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-b6f83183-8b38-4755-8f18-f924215ae2ed tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c555f971-b177-4c26-a38e-09e0e78bf7b9/disk --force-share --output=json -f qcow2 {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:13:21 user nova-compute[73572]: DEBUG nova.compute.provider_tree [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Inventory has not changed in ProviderTree for provider: e2cec974-59b2-4c77-a53d-a7f4e5a30d75 {{(pid=73572) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 10:13:21 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Inventory has not changed for provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73572) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 10:13:21 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Compute_service record updated for user:user {{(pid=73572) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 10:13:21 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.922s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:13:21 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-b6f83183-8b38-4755-8f18-f924215ae2ed tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c555f971-b177-4c26-a38e-09e0e78bf7b9/disk --force-share --output=json -f qcow2" returned: 0 in 0.284s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:13:21 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-b6f83183-8b38-4755-8f18-f924215ae2ed tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:13:21 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-b6f83183-8b38-4755-8f18-f924215ae2ed tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json" returned: 0 in 0.199s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:13:21 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-b6f83183-8b38-4755-8f18-f924215ae2ed tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp7cpx2wit/d0bdb7b1c77a4e55808e0e09a7c6d52b.delta 1073741824 {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:13:21 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-b6f83183-8b38-4755-8f18-f924215ae2ed tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp7cpx2wit/d0bdb7b1c77a4e55808e0e09a7c6d52b.delta 1073741824" returned: 0 in 0.052s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:13:21 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-b6f83183-8b38-4755-8f18-f924215ae2ed tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] [instance: c555f971-b177-4c26-a38e-09e0e78bf7b9] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 26 10:13:22 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:13:22 user nova-compute[73572]: DEBUG nova.virt.libvirt.guest [None req-b6f83183-8b38-4755-8f18-f924215ae2ed tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=73572) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 10:13:23 user nova-compute[73572]: DEBUG nova.virt.libvirt.guest [None req-b6f83183-8b38-4755-8f18-f924215ae2ed tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=73572) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 10:13:23 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-b6f83183-8b38-4755-8f18-f924215ae2ed tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] [instance: c555f971-b177-4c26-a38e-09e0e78bf7b9] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 26 10:13:23 user nova-compute[73572]: DEBUG nova.privsep.utils [None req-b6f83183-8b38-4755-8f18-f924215ae2ed tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73572) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 26 10:13:23 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-b6f83183-8b38-4755-8f18-f924215ae2ed tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp7cpx2wit/d0bdb7b1c77a4e55808e0e09a7c6d52b.delta /opt/stack/data/nova/instances/snapshots/tmp7cpx2wit/d0bdb7b1c77a4e55808e0e09a7c6d52b {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:13:23 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-b6f83183-8b38-4755-8f18-f924215ae2ed tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp7cpx2wit/d0bdb7b1c77a4e55808e0e09a7c6d52b.delta /opt/stack/data/nova/instances/snapshots/tmp7cpx2wit/d0bdb7b1c77a4e55808e0e09a7c6d52b" returned: 0 in 0.370s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:13:23 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-b6f83183-8b38-4755-8f18-f924215ae2ed tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] [instance: c555f971-b177-4c26-a38e-09e0e78bf7b9] Snapshot extracted, beginning image upload
Aug 26 10:13:23 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:13:25 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:13:26 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-b6f83183-8b38-4755-8f18-f924215ae2ed tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] [instance: c555f971-b177-4c26-a38e-09e0e78bf7b9] Snapshot image upload complete
Aug 26 10:13:26 user nova-compute[73572]: INFO nova.compute.manager [None req-b6f83183-8b38-4755-8f18-f924215ae2ed tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] [instance: c555f971-b177-4c26-a38e-09e0e78bf7b9] Took 5.81 seconds to snapshot the instance on the hypervisor.
Aug 26 10:13:28 user nova-compute[73572]: DEBUG nova.compute.manager [req-2bdcdff5-797d-4395-ad74-f9390bf0af08 req-b1b15e1f-e05e-45c6-a59b-b1ea24725b9e service nova] [instance: ee9bcbaa-25a6-4588-b757-2a2ae15b6cf8] Received event network-changed-f47d01ad-ade6-4b38-8b96-ea183c06134c {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:13:28 user nova-compute[73572]: DEBUG nova.compute.manager [req-2bdcdff5-797d-4395-ad74-f9390bf0af08 req-b1b15e1f-e05e-45c6-a59b-b1ea24725b9e service nova] [instance: ee9bcbaa-25a6-4588-b757-2a2ae15b6cf8] Refreshing instance network info cache due to event network-changed-f47d01ad-ade6-4b38-8b96-ea183c06134c. {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 10:13:28 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-2bdcdff5-797d-4395-ad74-f9390bf0af08 req-b1b15e1f-e05e-45c6-a59b-b1ea24725b9e service nova] Acquiring lock "refresh_cache-ee9bcbaa-25a6-4588-b757-2a2ae15b6cf8" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:13:28 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-2bdcdff5-797d-4395-ad74-f9390bf0af08 req-b1b15e1f-e05e-45c6-a59b-b1ea24725b9e service nova] Acquired lock "refresh_cache-ee9bcbaa-25a6-4588-b757-2a2ae15b6cf8" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:13:28 user nova-compute[73572]: DEBUG nova.network.neutron [req-2bdcdff5-797d-4395-ad74-f9390bf0af08 req-b1b15e1f-e05e-45c6-a59b-b1ea24725b9e service nova] [instance: ee9bcbaa-25a6-4588-b757-2a2ae15b6cf8] Refreshing network info cache for port f47d01ad-ade6-4b38-8b96-ea183c06134c {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 10:13:28 user nova-compute[73572]: DEBUG nova.network.neutron [req-2bdcdff5-797d-4395-ad74-f9390bf0af08 req-b1b15e1f-e05e-45c6-a59b-b1ea24725b9e service nova] [instance: ee9bcbaa-25a6-4588-b757-2a2ae15b6cf8] Updated VIF entry in instance network info cache for port f47d01ad-ade6-4b38-8b96-ea183c06134c. {{(pid=73572) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 10:13:28 user nova-compute[73572]: DEBUG nova.network.neutron [req-2bdcdff5-797d-4395-ad74-f9390bf0af08 req-b1b15e1f-e05e-45c6-a59b-b1ea24725b9e service nova] [instance: ee9bcbaa-25a6-4588-b757-2a2ae15b6cf8] Updating instance_info_cache with network_info: [{"id": "f47d01ad-ade6-4b38-8b96-ea183c06134c", "address": "fa:16:3e:f9:ca:45", "network": {"id": "529bb981-16ba-47c5-afb0-55f4aa577ecc", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-265382654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9898b65714845e7aea403cc39182df7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf47d01ad-ad", "ovs_interfaceid": "f47d01ad-ade6-4b38-8b96-ea183c06134c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:13:28 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-2bdcdff5-797d-4395-ad74-f9390bf0af08 req-b1b15e1f-e05e-45c6-a59b-b1ea24725b9e service nova] Releasing lock "refresh_cache-ee9bcbaa-25a6-4588-b757-2a2ae15b6cf8" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:13:28 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:13:30 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:13:32 user nova-compute[73572]: DEBUG nova.compute.manager [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] [instance: 83670c16-3566-4679-8e74-c6451c840315] Start spawning the instance on the hypervisor. {{(pid=73572) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 10:13:32 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] [instance: 83670c16-3566-4679-8e74-c6451c840315] Creating instance directory {{(pid=73572) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 10:13:32 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] [instance: 83670c16-3566-4679-8e74-c6451c840315] Creating image(s)
Aug 26 10:13:33 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] [instance: 83670c16-3566-4679-8e74-c6451c840315] Did not create local disks {{(pid=73572) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 26 10:13:33 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] [instance: 83670c16-3566-4679-8e74-c6451c840315] Ensure instance console log exists: /opt/stack/data/nova/instances/83670c16-3566-4679-8e74-c6451c840315/console.log {{(pid=73572) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 10:13:33 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:13:33 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:13:33 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:13:33 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] [instance: 83670c16-3566-4679-8e74-c6451c840315] Start _get_guest_xml network_info=[{"id": "71be4c62-7219-45ca-8047-ab6716b37f6a", "address": "fa:16:3e:5b:5d:84", "network": {"id": "0a1bb03e-917c-4df5-84cc-bd7729b69ab6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-258329362-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9de7931c97d448eaa26d295386b3a999", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71be4c62-72", "ovs_interfaceid": "71be4c62-7219-45ca-8047-ab6716b37f6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "84bf04a4-b563-48c5-aa73-5b54cbb4887f", "address": "fa:16:3e:e2:c6:ae", "network": {"id": "e194b396-7c3f-41f3-99b2-f82b55c779f2", "bridge": "br-int", "label": "tempest-device-tagging-net1-1768943373", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.226", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9de7931c97d448eaa26d295386b3a999", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84bf04a4-b5", "ovs_interfaceid": "84bf04a4-b563-48c5-aa73-5b54cbb4887f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f4d684f0-2fe0-46e6-8f84-e2c0918a5a82", "address": "fa:16:3e:a6:7f:bd", "network": {"id": "e194b396-7c3f-41f3-99b2-f82b55c779f2", "bridge": "br-int", "label": "tempest-device-tagging-net1-1768943373", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.191", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9de7931c97d448eaa26d295386b3a999", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4d684f0-2f", "ovs_interfaceid": "f4d684f0-2fe0-46e6-8f84-e2c0918a5a82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "41a7ee04-5b67-4da6-a543-0d15187e5813", "address": "fa:16:3e:32:50:ef", "network": {"id": "e194b396-7c3f-41f3-99b2-f82b55c779f2", "bridge": "br-int", "label": "tempest-device-tagging-net1-1768943373", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.158", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9de7931c97d448eaa26d295386b3a999", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41a7ee04-5b", "ovs_interfaceid": "41a7ee04-5b67-4da6-a543-0d15187e5813", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "422eb7ef-4540-462b-a485-afdc38ebccd0", "address": "fa:16:3e:79:44:99", "network": {"id": "e194b396-7c3f-41f3-99b2-f82b55c779f2", "bridge": "br-int", "label": "tempest-device-tagging-net1-1768943373", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9de7931c97d448eaa26d295386b3a999", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap422eb7ef-45", "ovs_interfaceid": "422eb7ef-4540-462b-a485-afdc38ebccd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5e85b3cc-9fe4-46aa-a43f-d4acc5ca3c73", "address": "fa:16:3e:fd:33:d1", "network": {"id": "2cfbe057-f10f-4b28-b3bf-98b2ef5103d7", "bridge": "br-int", "label": "tempest-device-tagging-net2-598168548", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9de7931c97d448eaa26d295386b3a999", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e85b3cc-9f", "ovs_interfaceid": "5e85b3cc-9fe4-46aa-a43f-d4acc5ca3c73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7b7b7362-9dcc-48da-ad4e-9141c676839e", "address": "fa:16:3e:0b:b5:3a", "network": {"id": "2cfbe057-f10f-4b28-b3bf-98b2ef5103d7", "bridge": "br-int", "label": "tempest-device-tagging-net2-598168548", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9de7931c97d448eaa26d295386b3a999", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b7b7362-9d", "ovs_interfaceid": "7b7b7362-9dcc-48da-ad4e-9141c676839e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T10:07:33Z,direct_url=<?>,disk_format='qcow2',id=299da0c9-e1c4-48f0-be55-fbe20dd06bc9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5c995f8bbbab4368b67a253e0df3971a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T10:07:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'disk_bus': 'virtio', 'boot_index': 0, 'mount_device': '/dev/vda', 'attachment_id': '08670a3e-4742-4ef5-8462-9e446c5ff8d8', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:09ba694f-cb2a-4600-abe9-924b41292479'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SDlthyJr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '83670c16-3566-4679-8e74-c6451c840315', 'attached_at': '', 'detached_at': '', 'volume_id': '09ba694f-cb2a-4600-abe9-924b41292479', 'serial': '09ba694f-cb2a-4600-abe9-924b41292479'}, 'guest_format': None, 'device_type': 'disk', 'volume_type': None}, {'delete_on_termination': False, 'disk_bus': 'virtio', 'boot_index': 1, 'mount_device': '/dev/vdb', 'attachment_id': 'e343cee7-ea44-47f9-92a4-ce437541950b', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:85988ff4-7fac-4a96-a502-74d6ca8189fe'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MeDnamRS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '83670c16-3566-4679-8e74-c6451c840315', 'attached_at': '', 'detached_at': '', 'volume_id': '85988ff4-7fac-4a96-a502-74d6ca8189fe', 'serial': '85988ff4-7fac-4a96-a502-74d6ca8189fe'}, 'guest_format': None, 'device_type': 'disk', 'volume_type': None}, {'delete_on_termination': False, 'disk_bus': 'virtio', 'boot_index': 2, 'mount_device': '/dev/vdc', 'attachment_id': '525996ef-1140-401c-98bd-dd926811b7ae', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:75ebe4c4-f791-4f09-a9bd-747ade3d70a3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ghQFCVAp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '83670c16-3566-4679-8e74-c6451c840315', 'attached_at': '', 'detached_at': '', 'volume_id': '75ebe4c4-f791-4f09-a9bd-747ade3d70a3', 'serial': '75ebe4c4-f791-4f09-a9bd-747ade3d70a3'}, 'guest_format': None, 'device_type': 'disk', 'volume_type': None} {{(pid=73572) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 10:13:33 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:13:33 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:13:33 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73572) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 10:13:33 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] CPU controller missing on host. {{(pid=73572) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 10:13:33 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73572) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 10:13:33 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] CPU controller found on host. {{(pid=73572) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 10:13:33 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73572) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 10:13:33 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T10:07:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T10:07:33Z,direct_url=<?>,disk_format='qcow2',id=299da0c9-e1c4-48f0-be55-fbe20dd06bc9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5c995f8bbbab4368b67a253e0df3971a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T10:07:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 10:13:33 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] Flavor limits 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 10:13:33 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] Image limits 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 10:13:33 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] Flavor pref 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 10:13:33 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] Image pref 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 10:13:33 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 10:13:33 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 10:13:33 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73572) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 10:13:33 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] Got 1 possible topologies {{(pid=73572) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 10:13:33 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 10:13:33 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 10:13:33 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:13:33 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.003s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:13:33 user nova-compute[73572]: DEBUG os_brick.initiator.connector [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] Factory for ISCSI on None {{(pid=73572) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Aug 26 10:13:33 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.006s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:13:33 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] [instance: 83670c16-3566-4679-8e74-c6451c840315] Calling os-brick to attach iSCSI Volume {{(pid=73572) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 10:13:33 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc89c3d6a10>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:09ba694f-cb2a-4600-abe9-924b41292479'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SDlthyJr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 10:13:33 user nova-compute[73572]: WARNING os_brick.initiator.connectors.base [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 10:13:33 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 10:13:33 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 10:13:33 user nova-compute[73572]: WARNING os_brick.initiator.connectors.base [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 10:13:33 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:09ba694f-cb2a-4600-abe9-924b41292479" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 10:13:33 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:09ba694f-cb2a-4600-abe9-924b41292479" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 10:13:33 user nova-compute[73572]: INFO os_brick.initiator.connectors.iscsi [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 10:13:33 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09ba694f-cb2a-4600-abe9-924b41292479 -p 172.16.0.220:3260 {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:13:33 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09ba694f-cb2a-4600-abe9-924b41292479 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:13:33 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[b89fcbc2-8b83-4d69-a6e9-3032941efa6d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:13:33 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 10:13:33 user nova-compute[73572]:  {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:13:33 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09ba694f-cb2a-4600-abe9-924b41292479 -p 172.16.0.220:3260 --interface default --op new {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:13:33 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09ba694f-cb2a-4600-abe9-924b41292479 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:13:33 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[25bc36fb-031a-4cd6-824f-9252badeb45a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:09ba694f-cb2a-4600-abe9-924b41292479] added\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:13:33 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:09ba694f-cb2a-4600-abe9-924b41292479] added
Aug 26 10:13:33 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:13:33 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09ba694f-cb2a-4600-abe9-924b41292479 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:13:33 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09ba694f-cb2a-4600-abe9-924b41292479 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:13:33 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[70c07819-6601-4854-999f-b3ca11be84cf]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:13:33 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:13:33 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09ba694f-cb2a-4600-abe9-924b41292479 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:13:33 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09ba694f-cb2a-4600-abe9-924b41292479 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:13:33 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[caadbf9b-5eae-4742-a596-f0a7c27982a8]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:13:33 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:13:33 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09ba694f-cb2a-4600-abe9-924b41292479 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SDlthyJr {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:13:33 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09ba694f-cb2a-4600-abe9-924b41292479 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SDlthyJr" returned: 0 in 0.026s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:13:33 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d8a2bc4-7fd1-425a-89ab-dfbdca3c821b]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:13:33 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SDlthyJr'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:13:33 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09ba694f-cb2a-4600-abe9-924b41292479 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:13:33 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09ba694f-cb2a-4600-abe9-924b41292479 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:13:33 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[450b7665-512a-46a2-aebf-e53772e3b5ba]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:13:33 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:13:33 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:13:33 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:13:33 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[51eb8453-46e4-4f7f-8fd9-9f2ad7575ceb]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:13:33 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 26 10:13:33 user nova-compute[73572]:  {{(pid=73572) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 10:13:33 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 26 10:13:33 user nova-compute[73572]:  {{(pid=73572) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 10:13:33 user nova-compute[73572]: WARNING os_brick.initiator.connectors.iscsi [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 26 10:13:33 user nova-compute[73572]: 
Aug 26 10:13:33 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09ba694f-cb2a-4600-abe9-924b41292479 -p 172.16.0.220:3260 --login {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:13:33 user nova-compute[73572]: DEBUG nova.compute.manager [req-814a3928-1c58-494f-a328-4b5aa668daf7 req-416779f0-cb2f-4f6c-8958-7b3a45bff240 service nova] [instance: 8ee427dc-7aa0-4435-b23c-1223f2881df7] Received event network-changed-4c3302a3-7301-4cac-b75a-64ca09965157 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:13:33 user nova-compute[73572]: DEBUG nova.compute.manager [req-814a3928-1c58-494f-a328-4b5aa668daf7 req-416779f0-cb2f-4f6c-8958-7b3a45bff240 service nova] [instance: 8ee427dc-7aa0-4435-b23c-1223f2881df7] Refreshing instance network info cache due to event network-changed-4c3302a3-7301-4cac-b75a-64ca09965157. {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 10:13:33 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-814a3928-1c58-494f-a328-4b5aa668daf7 req-416779f0-cb2f-4f6c-8958-7b3a45bff240 service nova] Acquiring lock "refresh_cache-8ee427dc-7aa0-4435-b23c-1223f2881df7" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:13:33 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-814a3928-1c58-494f-a328-4b5aa668daf7 req-416779f0-cb2f-4f6c-8958-7b3a45bff240 service nova] Acquired lock "refresh_cache-8ee427dc-7aa0-4435-b23c-1223f2881df7" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:13:33 user nova-compute[73572]: DEBUG nova.network.neutron [req-814a3928-1c58-494f-a328-4b5aa668daf7 req-416779f0-cb2f-4f6c-8958-7b3a45bff240 service nova] [instance: 8ee427dc-7aa0-4435-b23c-1223f2881df7] Refreshing network info cache for port 4c3302a3-7301-4cac-b75a-64ca09965157 {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 10:13:33 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09ba694f-cb2a-4600-abe9-924b41292479 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:13:33 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[1614ed52-72de-4fc1-bcd6-62635b3de534]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:09ba694f-cb2a-4600-abe9-924b41292479, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:09ba694f-cb2a-4600-abe9-924b41292479, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:13:33 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:09ba694f-cb2a-4600-abe9-924b41292479, portal: 172.16.0.220,3260]
Aug 26 10:13:33 user nova-compute[73572]: Login to [iface: default, target: iqn.2010-10.org.openstack:09ba694f-cb2a-4600-abe9-924b41292479, portal: 172.16.0.220,3260] successful.
Aug 26 10:13:33 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:13:33 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09ba694f-cb2a-4600-abe9-924b41292479 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:13:33 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09ba694f-cb2a-4600-abe9-924b41292479 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:13:33 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[b29e1a24-17ff-424a-9912-1ba6bdccfe78]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:13:33 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:13:33 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:13:33 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:13:33 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c709f95-66d4-45cf-9c78-9f2ae5e6a6c8]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09ba694f-cb2a-4600-abe9-924b41292479 (non-flash)\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:13:33 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09ba694f-cb2a-4600-abe9-924b41292479 (non-flash)
Aug 26 10:13:33 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 10:13:33 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09ba694f-cb2a-4600-abe9-924b41292479 (non-flash)
Aug 26 10:13:33 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 10:13:33 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:09ba694f-cb2a-4600-abe9-924b41292479" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.309s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 10:13:33 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] Connected to 172.16.0.220:3260 {{(pid=73572) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 10:13:33 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=73572) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 10:13:33 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73572) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 10:13:33 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:13:33 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.040s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:13:33 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[8849dce7-8dde-4b7e-9ffe-80a50bb0df77]: (4, ('- - 0', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:13:33 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: None {{(pid=73572) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 10:13:33 user nova-compute[73572]: DEBUG nova.network.neutron [req-814a3928-1c58-494f-a328-4b5aa668daf7 req-416779f0-cb2f-4f6c-8958-7b3a45bff240 service nova] [instance: 8ee427dc-7aa0-4435-b23c-1223f2881df7] Updated VIF entry in instance network info cache for port 4c3302a3-7301-4cac-b75a-64ca09965157. {{(pid=73572) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 10:13:33 user nova-compute[73572]: DEBUG nova.network.neutron [req-814a3928-1c58-494f-a328-4b5aa668daf7 req-416779f0-cb2f-4f6c-8958-7b3a45bff240 service nova] [instance: 8ee427dc-7aa0-4435-b23c-1223f2881df7] Updating instance_info_cache with network_info: [{"id": "4c3302a3-7301-4cac-b75a-64ca09965157", "address": "fa:16:3e:07:ab:f2", "network": {"id": "c47deaf1-a2c4-4f19-8291-e9784568a77f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1615926461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.228", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9e9d7749db44598b91bc81e3d543b84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c3302a3-73", "ovs_interfaceid": "4c3302a3-7301-4cac-b75a-64ca09965157", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:13:33 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-814a3928-1c58-494f-a328-4b5aa668daf7 req-416779f0-cb2f-4f6c-8958-7b3a45bff240 service nova] Releasing lock "refresh_cache-8ee427dc-7aa0-4435-b23c-1223f2881df7" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:13:33 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:13:34 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73572) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 10:13:34 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SDlthyJr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73572) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 10:13:34 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.368s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 10:13:34 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] <== connect_volume: return (1370ms) {'type': 'block', 'scsi_wwn': '23365323365353936', 'path': '/dev/sdb'} {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 10:13:34 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] [instance: 83670c16-3566-4679-8e74-c6451c840315] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23365323365353936', 'path': '/dev/sdb'} {{(pid=73572) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 10:13:34 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] [instance: 83670c16-3566-4679-8e74-c6451c840315] Calling os-brick to attach iSCSI Volume {{(pid=73572) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 10:13:34 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc89c3d6a10>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:85988ff4-7fac-4a96-a502-74d6ca8189fe'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MeDnamRS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 10:13:34 user nova-compute[73572]: WARNING os_brick.initiator.connectors.base [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 10:13:34 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 10:13:34 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 10:13:34 user nova-compute[73572]: WARNING os_brick.initiator.connectors.base [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 10:13:34 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:85988ff4-7fac-4a96-a502-74d6ca8189fe" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 10:13:34 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:85988ff4-7fac-4a96-a502-74d6ca8189fe" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 10:13:34 user nova-compute[73572]: INFO os_brick.initiator.connectors.iscsi [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 10:13:34 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85988ff4-7fac-4a96-a502-74d6ca8189fe -p 172.16.0.220:3260 {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:13:34 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85988ff4-7fac-4a96-a502-74d6ca8189fe -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:13:34 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdd00782-ef15-4568-bfe5-f308d029c038]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:13:34 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 10:13:34 user nova-compute[73572]:  {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:13:34 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85988ff4-7fac-4a96-a502-74d6ca8189fe -p 172.16.0.220:3260 --interface default --op new {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:13:34 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85988ff4-7fac-4a96-a502-74d6ca8189fe -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:13:34 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[27518b76-0a9b-407a-8bc6-28120f9e0496]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:85988ff4-7fac-4a96-a502-74d6ca8189fe] added\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:13:34 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:85988ff4-7fac-4a96-a502-74d6ca8189fe] added
Aug 26 10:13:34 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:13:34 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85988ff4-7fac-4a96-a502-74d6ca8189fe -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:13:34 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85988ff4-7fac-4a96-a502-74d6ca8189fe -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:13:34 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[754cdc5a-8a35-4e47-b359-5cf9d623f886]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:13:34 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:13:34 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85988ff4-7fac-4a96-a502-74d6ca8189fe -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:13:34 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85988ff4-7fac-4a96-a502-74d6ca8189fe -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:13:34 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc131308-d5fd-4506-ae4d-1e6cba441335]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:13:34 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:13:34 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85988ff4-7fac-4a96-a502-74d6ca8189fe -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MeDnamRS {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:13:34 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85988ff4-7fac-4a96-a502-74d6ca8189fe -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MeDnamRS" returned: 0 in 0.017s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:13:34 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[b332827e-0afd-478e-bcff-8127b90dc9bd]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:13:34 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MeDnamRS'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:13:34 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85988ff4-7fac-4a96-a502-74d6ca8189fe -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:13:34 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85988ff4-7fac-4a96-a502-74d6ca8189fe -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:13:34 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[40dfdc6d-af66-455c-ad67-ee5588be44ff]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:13:34 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:13:34 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:13:34 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:13:34 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c569161-c36b-4eb2-b7f7-3c6a4a8903b7]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09ba694f-cb2a-4600-abe9-924b41292479 (non-flash)\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:13:34 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09ba694f-cb2a-4600-abe9-924b41292479 (non-flash)
Aug 26 10:13:34 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 10:13:34 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09ba694f-cb2a-4600-abe9-924b41292479 (non-flash)
Aug 26 10:13:34 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 10:13:34 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85988ff4-7fac-4a96-a502-74d6ca8189fe -p 172.16.0.220:3260 --login {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:13:34 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85988ff4-7fac-4a96-a502-74d6ca8189fe -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:13:34 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe6fe628-28b6-427a-b765-e15fa4b823b9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:85988ff4-7fac-4a96-a502-74d6ca8189fe, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:85988ff4-7fac-4a96-a502-74d6ca8189fe, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:13:34 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:85988ff4-7fac-4a96-a502-74d6ca8189fe, portal: 172.16.0.220,3260]
Aug 26 10:13:34 user nova-compute[73572]: Login to [iface: default, target: iqn.2010-10.org.openstack:85988ff4-7fac-4a96-a502-74d6ca8189fe, portal: 172.16.0.220,3260] successful.
Aug 26 10:13:34 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:13:34 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85988ff4-7fac-4a96-a502-74d6ca8189fe -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:13:34 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85988ff4-7fac-4a96-a502-74d6ca8189fe -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:13:34 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[0343de1c-9115-4274-a6a7-43d79f1f6506]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:13:34 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:13:34 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:13:34 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:13:34 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca3d3944-38dc-4111-bab1-00cd7c691792]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09ba694f-cb2a-4600-abe9-924b41292479 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85988ff4-7fac-4a96-a502-74d6ca8189fe (non-flash)\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:13:34 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09ba694f-cb2a-4600-abe9-924b41292479 (non-flash)
Aug 26 10:13:34 user nova-compute[73572]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85988ff4-7fac-4a96-a502-74d6ca8189fe (non-flash)
Aug 26 10:13:34 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 10:13:34 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09ba694f-cb2a-4600-abe9-924b41292479 (non-flash)
Aug 26 10:13:34 user nova-compute[73572]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85988ff4-7fac-4a96-a502-74d6ca8189fe (non-flash)
Aug 26 10:13:34 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 10:13:34 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:85988ff4-7fac-4a96-a502-74d6ca8189fe" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.258s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 10:13:34 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] Connected to 172.16.0.220:3260 {{(pid=73572) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 10:13:34 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=73572) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 10:13:34 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73572) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 10:13:34 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:13:34 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:13:34 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[32f487cf-c324-4a2c-b8ed-b0fbe5ba0d87]: (4, ('- - 0', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:13:34 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73572) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 10:13:34 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MeDnamRS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73572) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 10:13:35 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:13:35 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.289s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 10:13:35 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] <== connect_volume: return (1290ms) {'type': 'block', 'scsi_wwn': '26530363537656334', 'path': '/dev/sdc'} {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 10:13:35 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] [instance: 83670c16-3566-4679-8e74-c6451c840315] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26530363537656334', 'path': '/dev/sdc'} {{(pid=73572) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 10:13:35 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] [instance: 83670c16-3566-4679-8e74-c6451c840315] Calling os-brick to attach iSCSI Volume {{(pid=73572) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 10:13:35 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc89c3d6a10>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:75ebe4c4-f791-4f09-a9bd-747ade3d70a3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ghQFCVAp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 10:13:35 user nova-compute[73572]: WARNING os_brick.initiator.connectors.base [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 10:13:35 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 10:13:35 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 10:13:35 user nova-compute[73572]: WARNING os_brick.initiator.connectors.base [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 10:13:35 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:75ebe4c4-f791-4f09-a9bd-747ade3d70a3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 10:13:35 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:75ebe4c4-f791-4f09-a9bd-747ade3d70a3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 10:13:35 user nova-compute[73572]: INFO os_brick.initiator.connectors.iscsi [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 10:13:35 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75ebe4c4-f791-4f09-a9bd-747ade3d70a3 -p 172.16.0.220:3260 {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:13:35 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75ebe4c4-f791-4f09-a9bd-747ade3d70a3 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:13:35 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a3a73f0-c71c-453c-a1f2-88c8d97bf503]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:13:35 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 10:13:35 user nova-compute[73572]:  {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:13:35 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75ebe4c4-f791-4f09-a9bd-747ade3d70a3 -p 172.16.0.220:3260 --interface default --op new {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:13:35 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75ebe4c4-f791-4f09-a9bd-747ade3d70a3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:13:35 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[af8cb5f8-cb95-4e5a-bb84-4d9de74cc44c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:75ebe4c4-f791-4f09-a9bd-747ade3d70a3] added\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:13:35 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:75ebe4c4-f791-4f09-a9bd-747ade3d70a3] added
Aug 26 10:13:35 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:13:35 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75ebe4c4-f791-4f09-a9bd-747ade3d70a3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:13:35 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75ebe4c4-f791-4f09-a9bd-747ade3d70a3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:13:35 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ac2f540-4ac5-4b77-ac7a-bf2ca6f3b3bb]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:13:35 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:13:35 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75ebe4c4-f791-4f09-a9bd-747ade3d70a3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:13:35 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75ebe4c4-f791-4f09-a9bd-747ade3d70a3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:13:35 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fbb7a9b-314d-40f2-a5a5-95bd3766c87c]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:13:35 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:13:35 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75ebe4c4-f791-4f09-a9bd-747ade3d70a3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ghQFCVAp {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:13:35 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75ebe4c4-f791-4f09-a9bd-747ade3d70a3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ghQFCVAp" returned: 0 in 0.020s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:13:35 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5276913-f681-4763-9aae-b4e47d15f7b2]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:13:35 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ghQFCVAp'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:13:35 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75ebe4c4-f791-4f09-a9bd-747ade3d70a3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:13:35 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75ebe4c4-f791-4f09-a9bd-747ade3d70a3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:13:35 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fb2f2d3-b7f1-4bd4-92f7-fe4d3fd5b33f]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:13:35 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:13:35 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:13:36 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:13:36 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f750fe2-4074-4812-83f2-2fb4be80d466]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09ba694f-cb2a-4600-abe9-924b41292479 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85988ff4-7fac-4a96-a502-74d6ca8189fe (non-flash)\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:13:36 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09ba694f-cb2a-4600-abe9-924b41292479 (non-flash)
Aug 26 10:13:36 user nova-compute[73572]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85988ff4-7fac-4a96-a502-74d6ca8189fe (non-flash)
Aug 26 10:13:36 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 10:13:36 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09ba694f-cb2a-4600-abe9-924b41292479 (non-flash)
Aug 26 10:13:36 user nova-compute[73572]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85988ff4-7fac-4a96-a502-74d6ca8189fe (non-flash)
Aug 26 10:13:36 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 10:13:36 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75ebe4c4-f791-4f09-a9bd-747ade3d70a3 -p 172.16.0.220:3260 --login {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:13:36 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75ebe4c4-f791-4f09-a9bd-747ade3d70a3 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:13:36 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[64379ffc-a94f-4313-a5dd-ce695886d204]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:75ebe4c4-f791-4f09-a9bd-747ade3d70a3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:75ebe4c4-f791-4f09-a9bd-747ade3d70a3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:13:36 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:75ebe4c4-f791-4f09-a9bd-747ade3d70a3, portal: 172.16.0.220,3260]
Aug 26 10:13:36 user nova-compute[73572]: Login to [iface: default, target: iqn.2010-10.org.openstack:75ebe4c4-f791-4f09-a9bd-747ade3d70a3, portal: 172.16.0.220,3260] successful.
Aug 26 10:13:36 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:13:36 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75ebe4c4-f791-4f09-a9bd-747ade3d70a3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:13:36 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75ebe4c4-f791-4f09-a9bd-747ade3d70a3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:13:36 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9ddf2a9-73d8-42ce-a9bc-a169bb03e98c]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:13:36 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:13:36 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:13:36 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:13:36 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c341dfa-8470-476e-a69e-dc5ee63b8ced]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09ba694f-cb2a-4600-abe9-924b41292479 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85988ff4-7fac-4a96-a502-74d6ca8189fe (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75ebe4c4-f791-4f09-a9bd-747ade3d70a3 (non-flash)\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:13:36 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09ba694f-cb2a-4600-abe9-924b41292479 (non-flash)
Aug 26 10:13:36 user nova-compute[73572]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85988ff4-7fac-4a96-a502-74d6ca8189fe (non-flash)
Aug 26 10:13:36 user nova-compute[73572]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75ebe4c4-f791-4f09-a9bd-747ade3d70a3 (non-flash)
Aug 26 10:13:36 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 10:13:36 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09ba694f-cb2a-4600-abe9-924b41292479 (non-flash)
Aug 26 10:13:36 user nova-compute[73572]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85988ff4-7fac-4a96-a502-74d6ca8189fe (non-flash)
Aug 26 10:13:36 user nova-compute[73572]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75ebe4c4-f791-4f09-a9bd-747ade3d70a3 (non-flash)
Aug 26 10:13:36 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 10:13:36 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:75ebe4c4-f791-4f09-a9bd-747ade3d70a3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.295s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 10:13:36 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] Connected to 172.16.0.220:3260 {{(pid=73572) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 10:13:36 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=73572) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 10:13:36 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73572) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 10:13:36 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:13:36 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:13:36 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddfda312-db79-4b4c-9864-2972f3a696c4]: (4, ('- - 0', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:13:36 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73572) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 10:13:36 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ghQFCVAp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73572) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 10:13:37 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.327s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 10:13:37 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] <== connect_volume: return (1329ms) {'type': 'block', 'scsi_wwn': '23332383734666362', 'path': '/dev/sdd'} {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 10:13:37 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] [instance: 83670c16-3566-4679-8e74-c6451c840315] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23332383734666362', 'path': '/dev/sdd'} {{(pid=73572) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 10:13:37 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T10:12:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1879326179',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1879326179',id=9,image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM3oCFCh6aSyMKnKXD2N01fKLoLdTwSLEkitnN27bC0tybJXZUg58irUKFfKhM+F56mUQ6TT+wCANqJX5C6Y4Kdsag44eqLZjU/ENlptljpGrrUDZwWsVYQykcGl3CUZJQ==',key_name='tempest-keypair-123856006',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9de7931c97d448eaa26d295386b3a999',ramdisk_id='',reservation_id='r-9p350v4l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1188843039',owner_user_name='tempest-TaggedBootDevicesTest-1188843039-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T10:12:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d2269ea682c5489892c05da7db781952',uuid=83670c16-3566-4679-8e74-c6451c840315,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "71be4c62-7219-45ca-8047-ab6716b37f6a", "address": "fa:16:3e:5b:5d:84", "network": {"id": "0a1bb03e-917c-4df5-84cc-bd7729b69ab6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-258329362-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9de7931c97d448eaa26d295386b3a999", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71be4c62-72", "ovs_interfaceid": "71be4c62-7219-45ca-8047-ab6716b37f6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73572) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 10:13:37 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] Converting VIF {"id": "71be4c62-7219-45ca-8047-ab6716b37f6a", "address": "fa:16:3e:5b:5d:84", "network": {"id": "0a1bb03e-917c-4df5-84cc-bd7729b69ab6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-258329362-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9de7931c97d448eaa26d295386b3a999", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71be4c62-72", "ovs_interfaceid": "71be4c62-7219-45ca-8047-ab6716b37f6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:13:37 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:5d:84,bridge_name='br-int',has_traffic_filtering=True,id=71be4c62-7219-45ca-8047-ab6716b37f6a,network=Network(0a1bb03e-917c-4df5-84cc-bd7729b69ab6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71be4c62-72') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:13:37 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T10:12:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1879326179',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1879326179',id=9,image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM3oCFCh6aSyMKnKXD2N01fKLoLdTwSLEkitnN27bC0tybJXZUg58irUKFfKhM+F56mUQ6TT+wCANqJX5C6Y4Kdsag44eqLZjU/ENlptljpGrrUDZwWsVYQykcGl3CUZJQ==',key_name='tempest-keypair-123856006',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9de7931c97d448eaa26d295386b3a999',ramdisk_id='',reservation_id='r-9p350v4l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1188843039',owner_user_name='tempest-TaggedBootDevicesTest-1188843039-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T10:12:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d2269ea682c5489892c05da7db781952',uuid=83670c16-3566-4679-8e74-c6451c840315,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "84bf04a4-b563-48c5-aa73-5b54cbb4887f", "address": "fa:16:3e:e2:c6:ae", "network": {"id": "e194b396-7c3f-41f3-99b2-f82b55c779f2", "bridge": "br-int", "label": "tempest-device-tagging-net1-1768943373", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.226", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9de7931c97d448eaa26d295386b3a999", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84bf04a4-b5", "ovs_interfaceid": "84bf04a4-b563-48c5-aa73-5b54cbb4887f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73572) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 10:13:37 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] Converting VIF {"id": "84bf04a4-b563-48c5-aa73-5b54cbb4887f", "address": "fa:16:3e:e2:c6:ae", "network": {"id": "e194b396-7c3f-41f3-99b2-f82b55c779f2", "bridge": "br-int", "label": "tempest-device-tagging-net1-1768943373", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.226", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9de7931c97d448eaa26d295386b3a999", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84bf04a4-b5", "ovs_interfaceid": "84bf04a4-b563-48c5-aa73-5b54cbb4887f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:13:37 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:c6:ae,bridge_name='br-int',has_traffic_filtering=True,id=84bf04a4-b563-48c5-aa73-5b54cbb4887f,network=Network(e194b396-7c3f-41f3-99b2-f82b55c779f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap84bf04a4-b5') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:13:37 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T10:12:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1879326179',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1879326179',id=9,image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM3oCFCh6aSyMKnKXD2N01fKLoLdTwSLEkitnN27bC0tybJXZUg58irUKFfKhM+F56mUQ6TT+wCANqJX5C6Y4Kdsag44eqLZjU/ENlptljpGrrUDZwWsVYQykcGl3CUZJQ==',key_name='tempest-keypair-123856006',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9de7931c97d448eaa26d295386b3a999',ramdisk_id='',reservation_id='r-9p350v4l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1188843039',owner_user_name='tempest-TaggedBootDevicesTest-1188843039-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T10:12:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d2269ea682c5489892c05da7db781952',uuid=83670c16-3566-4679-8e74-c6451c840315,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f4d684f0-2fe0-46e6-8f84-e2c0918a5a82", "address": "fa:16:3e:a6:7f:bd", "network": {"id": "e194b396-7c3f-41f3-99b2-f82b55c779f2", "bridge": "br-int", "label": "tempest-device-tagging-net1-1768943373", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.191", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9de7931c97d448eaa26d295386b3a999", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4d684f0-2f", "ovs_interfaceid": "f4d684f0-2fe0-46e6-8f84-e2c0918a5a82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73572) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 10:13:37 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] Converting VIF {"id": "f4d684f0-2fe0-46e6-8f84-e2c0918a5a82", "address": "fa:16:3e:a6:7f:bd", "network": {"id": "e194b396-7c3f-41f3-99b2-f82b55c779f2", "bridge": "br-int", "label": "tempest-device-tagging-net1-1768943373", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.191", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9de7931c97d448eaa26d295386b3a999", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4d684f0-2f", "ovs_interfaceid": "f4d684f0-2fe0-46e6-8f84-e2c0918a5a82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:13:37 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:7f:bd,bridge_name='br-int',has_traffic_filtering=True,id=f4d684f0-2fe0-46e6-8f84-e2c0918a5a82,network=Network(e194b396-7c3f-41f3-99b2-f82b55c779f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf4d684f0-2f') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:13:37 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T10:12:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1879326179',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1879326179',id=9,image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM3oCFCh6aSyMKnKXD2N01fKLoLdTwSLEkitnN27bC0tybJXZUg58irUKFfKhM+F56mUQ6TT+wCANqJX5C6Y4Kdsag44eqLZjU/ENlptljpGrrUDZwWsVYQykcGl3CUZJQ==',key_name='tempest-keypair-123856006',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9de7931c97d448eaa26d295386b3a999',ramdisk_id='',reservation_id='r-9p350v4l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1188843039',owner_user_name='tempest-TaggedBootDevicesTest-1188843039-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T10:12:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d2269ea682c5489892c05da7db781952',uuid=83670c16-3566-4679-8e74-c6451c840315,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "41a7ee04-5b67-4da6-a543-0d15187e5813", "address": "fa:16:3e:32:50:ef", "network": {"id": "e194b396-7c3f-41f3-99b2-f82b55c779f2", "bridge": "br-int", "label": "tempest-device-tagging-net1-1768943373", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.158", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9de7931c97d448eaa26d295386b3a999", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41a7ee04-5b", "ovs_interfaceid": "41a7ee04-5b67-4da6-a543-0d15187e5813", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73572) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 10:13:37 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] Converting VIF {"id": "41a7ee04-5b67-4da6-a543-0d15187e5813", "address": "fa:16:3e:32:50:ef", "network": {"id": "e194b396-7c3f-41f3-99b2-f82b55c779f2", "bridge": "br-int", "label": "tempest-device-tagging-net1-1768943373", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.158", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9de7931c97d448eaa26d295386b3a999", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41a7ee04-5b", "ovs_interfaceid": "41a7ee04-5b67-4da6-a543-0d15187e5813", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:13:37 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:50:ef,bridge_name='br-int',has_traffic_filtering=True,id=41a7ee04-5b67-4da6-a543-0d15187e5813,network=Network(e194b396-7c3f-41f3-99b2-f82b55c779f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41a7ee04-5b') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:13:37 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T10:12:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1879326179',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1879326179',id=9,image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM3oCFCh6aSyMKnKXD2N01fKLoLdTwSLEkitnN27bC0tybJXZUg58irUKFfKhM+F56mUQ6TT+wCANqJX5C6Y4Kdsag44eqLZjU/ENlptljpGrrUDZwWsVYQykcGl3CUZJQ==',key_name='tempest-keypair-123856006',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9de7931c97d448eaa26d295386b3a999',ramdisk_id='',reservation_id='r-9p350v4l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1188843039',owner_user_name='tempest-TaggedBootDevicesTest-1188843039-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T10:12:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d2269ea682c5489892c05da7db781952',uuid=83670c16-3566-4679-8e74-c6451c840315,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "422eb7ef-4540-462b-a485-afdc38ebccd0", "address": "fa:16:3e:79:44:99", "network": {"id": "e194b396-7c3f-41f3-99b2-f82b55c779f2", "bridge": "br-int", "label": "tempest-device-tagging-net1-1768943373", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9de7931c97d448eaa26d295386b3a999", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap422eb7ef-45", "ovs_interfaceid": "422eb7ef-4540-462b-a485-afdc38ebccd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73572) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 10:13:37 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] Converting VIF {"id": "422eb7ef-4540-462b-a485-afdc38ebccd0", "address": "fa:16:3e:79:44:99", "network": {"id": "e194b396-7c3f-41f3-99b2-f82b55c779f2", "bridge": "br-int", "label": "tempest-device-tagging-net1-1768943373", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9de7931c97d448eaa26d295386b3a999", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap422eb7ef-45", "ovs_interfaceid": "422eb7ef-4540-462b-a485-afdc38ebccd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:13:37 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:44:99,bridge_name='br-int',has_traffic_filtering=True,id=422eb7ef-4540-462b-a485-afdc38ebccd0,network=Network(e194b396-7c3f-41f3-99b2-f82b55c779f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap422eb7ef-45') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:13:37 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T10:12:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1879326179',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1879326179',id=9,image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM3oCFCh6aSyMKnKXD2N01fKLoLdTwSLEkitnN27bC0tybJXZUg58irUKFfKhM+F56mUQ6TT+wCANqJX5C6Y4Kdsag44eqLZjU/ENlptljpGrrUDZwWsVYQykcGl3CUZJQ==',key_name='tempest-keypair-123856006',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9de7931c97d448eaa26d295386b3a999',ramdisk_id='',reservation_id='r-9p350v4l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1188843039',owner_user_name='tempest-TaggedBootDevicesTest-1188843039-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T10:12:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d2269ea682c5489892c05da7db781952',uuid=83670c16-3566-4679-8e74-c6451c840315,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5e85b3cc-9fe4-46aa-a43f-d4acc5ca3c73", "address": "fa:16:3e:fd:33:d1", "network": {"id": "2cfbe057-f10f-4b28-b3bf-98b2ef5103d7", "bridge": "br-int", "label": "tempest-device-tagging-net2-598168548", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9de7931c97d448eaa26d295386b3a999", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e85b3cc-9f", "ovs_interfaceid": "5e85b3cc-9fe4-46aa-a43f-d4acc5ca3c73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73572) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 10:13:37 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] Converting VIF {"id": "5e85b3cc-9fe4-46aa-a43f-d4acc5ca3c73", "address": "fa:16:3e:fd:33:d1", "network": {"id": "2cfbe057-f10f-4b28-b3bf-98b2ef5103d7", "bridge": "br-int", "label": "tempest-device-tagging-net2-598168548", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9de7931c97d448eaa26d295386b3a999", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e85b3cc-9f", "ovs_interfaceid": "5e85b3cc-9fe4-46aa-a43f-d4acc5ca3c73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:13:37 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:33:d1,bridge_name='br-int',has_traffic_filtering=True,id=5e85b3cc-9fe4-46aa-a43f-d4acc5ca3c73,network=Network(2cfbe057-f10f-4b28-b3bf-98b2ef5103d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e85b3cc-9f') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:13:37 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T10:12:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1879326179',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1879326179',id=9,image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM3oCFCh6aSyMKnKXD2N01fKLoLdTwSLEkitnN27bC0tybJXZUg58irUKFfKhM+F56mUQ6TT+wCANqJX5C6Y4Kdsag44eqLZjU/ENlptljpGrrUDZwWsVYQykcGl3CUZJQ==',key_name='tempest-keypair-123856006',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9de7931c97d448eaa26d295386b3a999',ramdisk_id='',reservation_id='r-9p350v4l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1188843039',owner_user_name='tempest-TaggedBootDevicesTest-1188843039-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T10:12:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d2269ea682c5489892c05da7db781952',uuid=83670c16-3566-4679-8e74-c6451c840315,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7b7b7362-9dcc-48da-ad4e-9141c676839e", "address": "fa:16:3e:0b:b5:3a", "network": {"id": "2cfbe057-f10f-4b28-b3bf-98b2ef5103d7", "bridge": "br-int", "label": "tempest-device-tagging-net2-598168548", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9de7931c97d448eaa26d295386b3a999", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b7b7362-9d", "ovs_interfaceid": "7b7b7362-9dcc-48da-ad4e-9141c676839e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73572) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 10:13:37 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] Converting VIF {"id": "7b7b7362-9dcc-48da-ad4e-9141c676839e", "address": "fa:16:3e:0b:b5:3a", "network": {"id": "2cfbe057-f10f-4b28-b3bf-98b2ef5103d7", "bridge": "br-int", "label": "tempest-device-tagging-net2-598168548", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9de7931c97d448eaa26d295386b3a999", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b7b7362-9d", "ovs_interfaceid": "7b7b7362-9dcc-48da-ad4e-9141c676839e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:13:37 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0b:b5:3a,bridge_name='br-int',has_traffic_filtering=True,id=7b7b7362-9dcc-48da-ad4e-9141c676839e,network=Network(2cfbe057-f10f-4b28-b3bf-98b2ef5103d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b7b7362-9d') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:13:37 user nova-compute[73572]: DEBUG nova.objects.instance [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] Lazy-loading 'pci_devices' on Instance uuid 83670c16-3566-4679-8e74-c6451c840315 {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:13:37 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] [instance: 83670c16-3566-4679-8e74-c6451c840315] End _get_guest_xml xml=<domain type="kvm">
Aug 26 10:13:37 user nova-compute[73572]:   <uuid>83670c16-3566-4679-8e74-c6451c840315</uuid>
Aug 26 10:13:37 user nova-compute[73572]:   <name>instance-00000009</name>
Aug 26 10:13:37 user nova-compute[73572]:   <memory>524288</memory>
Aug 26 10:13:37 user nova-compute[73572]:   <vcpu>1</vcpu>
Aug 26 10:13:37 user nova-compute[73572]:   <metadata>
Aug 26 10:13:37 user nova-compute[73572]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 10:13:37 user nova-compute[73572]:       <nova:package version="0.0.0"/>
Aug 26 10:13:37 user nova-compute[73572]:       <nova:name>tempest-device-tagging-server-1879326179</nova:name>
Aug 26 10:13:37 user nova-compute[73572]:       <nova:creationTime>2023-08-26 10:13:33</nova:creationTime>
Aug 26 10:13:37 user nova-compute[73572]:       <nova:flavor name="m1.tiny">
Aug 26 10:13:37 user nova-compute[73572]:         <nova:memory>512</nova:memory>
Aug 26 10:13:37 user nova-compute[73572]:         <nova:disk>1</nova:disk>
Aug 26 10:13:37 user nova-compute[73572]:         <nova:swap>0</nova:swap>
Aug 26 10:13:37 user nova-compute[73572]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 10:13:37 user nova-compute[73572]:         <nova:vcpus>1</nova:vcpus>
Aug 26 10:13:37 user nova-compute[73572]:       </nova:flavor>
Aug 26 10:13:37 user nova-compute[73572]:       <nova:owner>
Aug 26 10:13:37 user nova-compute[73572]:         <nova:user uuid="d2269ea682c5489892c05da7db781952">tempest-TaggedBootDevicesTest-1188843039-project-member</nova:user>
Aug 26 10:13:37 user nova-compute[73572]:         <nova:project uuid="9de7931c97d448eaa26d295386b3a999">tempest-TaggedBootDevicesTest-1188843039</nova:project>
Aug 26 10:13:37 user nova-compute[73572]:       </nova:owner>
Aug 26 10:13:37 user nova-compute[73572]:       <nova:root type="image" uuid="299da0c9-e1c4-48f0-be55-fbe20dd06bc9"/>
Aug 26 10:13:37 user nova-compute[73572]:       <nova:ports>
Aug 26 10:13:37 user nova-compute[73572]:         <nova:port uuid="71be4c62-7219-45ca-8047-ab6716b37f6a">
Aug 26 10:13:37 user nova-compute[73572]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 26 10:13:37 user nova-compute[73572]:         </nova:port>
Aug 26 10:13:37 user nova-compute[73572]:         <nova:port uuid="84bf04a4-b563-48c5-aa73-5b54cbb4887f">
Aug 26 10:13:37 user nova-compute[73572]:           <nova:ip type="fixed" address="10.1.1.226" ipVersion="4"/>
Aug 26 10:13:37 user nova-compute[73572]:         </nova:port>
Aug 26 10:13:37 user nova-compute[73572]:         <nova:port uuid="f4d684f0-2fe0-46e6-8f84-e2c0918a5a82">
Aug 26 10:13:37 user nova-compute[73572]:           <nova:ip type="fixed" address="10.1.1.191" ipVersion="4"/>
Aug 26 10:13:37 user nova-compute[73572]:         </nova:port>
Aug 26 10:13:37 user nova-compute[73572]:         <nova:port uuid="41a7ee04-5b67-4da6-a543-0d15187e5813">
Aug 26 10:13:37 user nova-compute[73572]:           <nova:ip type="fixed" address="10.1.1.158" ipVersion="4"/>
Aug 26 10:13:37 user nova-compute[73572]:         </nova:port>
Aug 26 10:13:37 user nova-compute[73572]:         <nova:port uuid="422eb7ef-4540-462b-a485-afdc38ebccd0">
Aug 26 10:13:37 user nova-compute[73572]:           <nova:ip type="fixed" address="10.1.1.203" ipVersion="4"/>
Aug 26 10:13:37 user nova-compute[73572]:         </nova:port>
Aug 26 10:13:37 user nova-compute[73572]:         <nova:port uuid="5e85b3cc-9fe4-46aa-a43f-d4acc5ca3c73">
Aug 26 10:13:37 user nova-compute[73572]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Aug 26 10:13:37 user nova-compute[73572]:         </nova:port>
Aug 26 10:13:37 user nova-compute[73572]:         <nova:port uuid="7b7b7362-9dcc-48da-ad4e-9141c676839e">
Aug 26 10:13:37 user nova-compute[73572]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Aug 26 10:13:37 user nova-compute[73572]:         </nova:port>
Aug 26 10:13:37 user nova-compute[73572]:       </nova:ports>
Aug 26 10:13:37 user nova-compute[73572]:     </nova:instance>
Aug 26 10:13:37 user nova-compute[73572]:   </metadata>
Aug 26 10:13:37 user nova-compute[73572]:   <sysinfo type="smbios">
Aug 26 10:13:37 user nova-compute[73572]:     <system>
Aug 26 10:13:37 user nova-compute[73572]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 10:13:37 user nova-compute[73572]:       <entry name="product">OpenStack Nova</entry>
Aug 26 10:13:37 user nova-compute[73572]:       <entry name="version">0.0.0</entry>
Aug 26 10:13:37 user nova-compute[73572]:       <entry name="serial">83670c16-3566-4679-8e74-c6451c840315</entry>
Aug 26 10:13:37 user nova-compute[73572]:       <entry name="uuid">83670c16-3566-4679-8e74-c6451c840315</entry>
Aug 26 10:13:37 user nova-compute[73572]:       <entry name="family">Virtual Machine</entry>
Aug 26 10:13:37 user nova-compute[73572]:     </system>
Aug 26 10:13:37 user nova-compute[73572]:   </sysinfo>
Aug 26 10:13:37 user nova-compute[73572]:   <os>
Aug 26 10:13:37 user nova-compute[73572]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 10:13:37 user nova-compute[73572]:     <boot dev="hd"/>
Aug 26 10:13:37 user nova-compute[73572]:     <smbios mode="sysinfo"/>
Aug 26 10:13:37 user nova-compute[73572]:   </os>
Aug 26 10:13:37 user nova-compute[73572]:   <features>
Aug 26 10:13:37 user nova-compute[73572]:     <acpi/>
Aug 26 10:13:37 user nova-compute[73572]:     <apic/>
Aug 26 10:13:37 user nova-compute[73572]:     <vmcoreinfo/>
Aug 26 10:13:37 user nova-compute[73572]:   </features>
Aug 26 10:13:37 user nova-compute[73572]:   <clock offset="utc">
Aug 26 10:13:37 user nova-compute[73572]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 10:13:37 user nova-compute[73572]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 10:13:37 user nova-compute[73572]:     <timer name="hpet" present="no"/>
Aug 26 10:13:37 user nova-compute[73572]:   </clock>
Aug 26 10:13:37 user nova-compute[73572]:   <cpu mode="custom" match="exact">
Aug 26 10:13:37 user nova-compute[73572]:     <model>Nehalem</model>
Aug 26 10:13:37 user nova-compute[73572]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 10:13:37 user nova-compute[73572]:   </cpu>
Aug 26 10:13:37 user nova-compute[73572]:   <devices>
Aug 26 10:13:37 user nova-compute[73572]:     <disk type="file" device="cdrom">
Aug 26 10:13:37 user nova-compute[73572]:       <driver name="qemu" type="raw" cache="none"/>
Aug 26 10:13:37 user nova-compute[73572]:       <source file="/opt/stack/data/nova/instances/83670c16-3566-4679-8e74-c6451c840315/disk.config"/>
Aug 26 10:13:37 user nova-compute[73572]:       <target dev="hda" bus="ide"/>
Aug 26 10:13:37 user nova-compute[73572]:     </disk>
Aug 26 10:13:37 user nova-compute[73572]:     <disk type="block" device="disk">
Aug 26 10:13:37 user nova-compute[73572]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 10:13:37 user nova-compute[73572]:       <source dev="/dev/sdb"/>
Aug 26 10:13:37 user nova-compute[73572]:       <target dev="vda" bus="virtio"/>
Aug 26 10:13:37 user nova-compute[73572]:       <serial>09ba694f-cb2a-4600-abe9-924b41292479</serial>
Aug 26 10:13:37 user nova-compute[73572]:     </disk>
Aug 26 10:13:37 user nova-compute[73572]:     <disk type="block" device="disk">
Aug 26 10:13:37 user nova-compute[73572]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 10:13:37 user nova-compute[73572]:       <source dev="/dev/sdc"/>
Aug 26 10:13:37 user nova-compute[73572]:       <target dev="vdb" bus="virtio"/>
Aug 26 10:13:37 user nova-compute[73572]:       <serial>85988ff4-7fac-4a96-a502-74d6ca8189fe</serial>
Aug 26 10:13:37 user nova-compute[73572]:     </disk>
Aug 26 10:13:37 user nova-compute[73572]:     <disk type="block" device="disk">
Aug 26 10:13:37 user nova-compute[73572]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 10:13:37 user nova-compute[73572]:       <source dev="/dev/sdd"/>
Aug 26 10:13:37 user nova-compute[73572]:       <target dev="vdc" bus="virtio"/>
Aug 26 10:13:37 user nova-compute[73572]:       <serial>75ebe4c4-f791-4f09-a9bd-747ade3d70a3</serial>
Aug 26 10:13:37 user nova-compute[73572]:     </disk>
Aug 26 10:13:37 user nova-compute[73572]:     <interface type="ethernet">
Aug 26 10:13:37 user nova-compute[73572]:       <mac address="fa:16:3e:5b:5d:84"/>
Aug 26 10:13:37 user nova-compute[73572]:       <model type="virtio"/>
Aug 26 10:13:37 user nova-compute[73572]:       <mtu size="1442"/>
Aug 26 10:13:37 user nova-compute[73572]:       <target dev="tap71be4c62-72"/>
Aug 26 10:13:37 user nova-compute[73572]:     </interface>
Aug 26 10:13:37 user nova-compute[73572]:     <interface type="ethernet">
Aug 26 10:13:37 user nova-compute[73572]:       <mac address="fa:16:3e:e2:c6:ae"/>
Aug 26 10:13:37 user nova-compute[73572]:       <model type="virtio"/>
Aug 26 10:13:37 user nova-compute[73572]:       <mtu size="1442"/>
Aug 26 10:13:37 user nova-compute[73572]:       <target dev="tap84bf04a4-b5"/>
Aug 26 10:13:37 user nova-compute[73572]:     </interface>
Aug 26 10:13:37 user nova-compute[73572]:     <interface type="ethernet">
Aug 26 10:13:37 user nova-compute[73572]:       <mac address="fa:16:3e:a6:7f:bd"/>
Aug 26 10:13:37 user nova-compute[73572]:       <model type="virtio"/>
Aug 26 10:13:37 user nova-compute[73572]:       <mtu size="1442"/>
Aug 26 10:13:37 user nova-compute[73572]:       <target dev="tapf4d684f0-2f"/>
Aug 26 10:13:37 user nova-compute[73572]:     </interface>
Aug 26 10:13:37 user nova-compute[73572]:     <interface type="ethernet">
Aug 26 10:13:37 user nova-compute[73572]:       <mac address="fa:16:3e:32:50:ef"/>
Aug 26 10:13:37 user nova-compute[73572]:       <model type="virtio"/>
Aug 26 10:13:37 user nova-compute[73572]:       <mtu size="1442"/>
Aug 26 10:13:37 user nova-compute[73572]:       <target dev="tap41a7ee04-5b"/>
Aug 26 10:13:37 user nova-compute[73572]:     </interface>
Aug 26 10:13:37 user nova-compute[73572]:     <interface type="ethernet">
Aug 26 10:13:37 user nova-compute[73572]:       <mac address="fa:16:3e:79:44:99"/>
Aug 26 10:13:37 user nova-compute[73572]:       <model type="virtio"/>
Aug 26 10:13:37 user nova-compute[73572]:       <mtu size="1442"/>
Aug 26 10:13:37 user nova-compute[73572]:       <target dev="tap422eb7ef-45"/>
Aug 26 10:13:37 user nova-compute[73572]:     </interface>
Aug 26 10:13:37 user nova-compute[73572]:     <interface type="ethernet">
Aug 26 10:13:37 user nova-compute[73572]:       <mac address="fa:16:3e:fd:33:d1"/>
Aug 26 10:13:37 user nova-compute[73572]:       <model type="virtio"/>
Aug 26 10:13:37 user nova-compute[73572]:       <mtu size="1442"/>
Aug 26 10:13:37 user nova-compute[73572]:       <target dev="tap5e85b3cc-9f"/>
Aug 26 10:13:37 user nova-compute[73572]:     </interface>
Aug 26 10:13:37 user nova-compute[73572]:     <interface type="ethernet">
Aug 26 10:13:37 user nova-compute[73572]:       <mac address="fa:16:3e:0b:b5:3a"/>
Aug 26 10:13:37 user nova-compute[73572]:       <model type="virtio"/>
Aug 26 10:13:37 user nova-compute[73572]:       <mtu size="1442"/>
Aug 26 10:13:37 user nova-compute[73572]:       <target dev="tap7b7b7362-9d"/>
Aug 26 10:13:37 user nova-compute[73572]:     </interface>
Aug 26 10:13:37 user nova-compute[73572]:     <serial type="pty">
Aug 26 10:13:37 user nova-compute[73572]:       <log file="/opt/stack/data/nova/instances/83670c16-3566-4679-8e74-c6451c840315/console.log" append="off"/>
Aug 26 10:13:37 user nova-compute[73572]:     </serial>
Aug 26 10:13:37 user nova-compute[73572]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 10:13:37 user nova-compute[73572]:     <video>
Aug 26 10:13:37 user nova-compute[73572]:       <model type="virtio"/>
Aug 26 10:13:37 user nova-compute[73572]:     </video>
Aug 26 10:13:37 user nova-compute[73572]:     <rng model="virtio">
Aug 26 10:13:37 user nova-compute[73572]:       <backend model="random">/dev/urandom</backend>
Aug 26 10:13:37 user nova-compute[73572]:     </rng>
Aug 26 10:13:37 user nova-compute[73572]:     <controller type="usb" index="0" model="none"/>
Aug 26 10:13:37 user nova-compute[73572]:     <memballoon model="virtio">
Aug 26 10:13:37 user nova-compute[73572]:       <stats period="10"/>
Aug 26 10:13:37 user nova-compute[73572]:     </memballoon>
Aug 26 10:13:37 user nova-compute[73572]:   </devices>
Aug 26 10:13:37 user nova-compute[73572]: </domain>
Aug 26 10:13:37 user nova-compute[73572]:  {{(pid=73572) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 10:13:37 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T10:12:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1879326179',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1879326179',id=9,image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM3oCFCh6aSyMKnKXD2N01fKLoLdTwSLEkitnN27bC0tybJXZUg58irUKFfKhM+F56mUQ6TT+wCANqJX5C6Y4Kdsag44eqLZjU/ENlptljpGrrUDZwWsVYQykcGl3CUZJQ==',key_name='tempest-keypair-123856006',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9de7931c97d448eaa26d295386b3a999',ramdisk_id='',reservation_id='r-9p350v4l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1188843039',owner_user_name='tempest-TaggedBootDevicesTest-1188843039-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T10:12:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d2269ea682c5489892c05da7db781952',uuid=83670c16-3566-4679-8e74-c6451c840315,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "71be4c62-7219-45ca-8047-ab6716b37f6a", "address": "fa:16:3e:5b:5d:84", "network": {"id": "0a1bb03e-917c-4df5-84cc-bd7729b69ab6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-258329362-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9de7931c97d448eaa26d295386b3a999", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71be4c62-72", "ovs_interfaceid": "71be4c62-7219-45ca-8047-ab6716b37f6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 10:13:37 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] Converting VIF {"id": "71be4c62-7219-45ca-8047-ab6716b37f6a", "address": "fa:16:3e:5b:5d:84", "network": {"id": "0a1bb03e-917c-4df5-84cc-bd7729b69ab6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-258329362-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9de7931c97d448eaa26d295386b3a999", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71be4c62-72", "ovs_interfaceid": "71be4c62-7219-45ca-8047-ab6716b37f6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:13:37 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:5d:84,bridge_name='br-int',has_traffic_filtering=True,id=71be4c62-7219-45ca-8047-ab6716b37f6a,network=Network(0a1bb03e-917c-4df5-84cc-bd7729b69ab6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71be4c62-72') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:13:37 user nova-compute[73572]: DEBUG os_vif [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:5d:84,bridge_name='br-int',has_traffic_filtering=True,id=71be4c62-7219-45ca-8047-ab6716b37f6a,network=Network(0a1bb03e-917c-4df5-84cc-bd7729b69ab6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71be4c62-72') {{(pid=73572) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 10:13:37 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:13:37 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:13:37 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 10:13:37 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:13:37 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap71be4c62-72, may_exist=True, interface_attrs={}) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:13:37 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap71be4c62-72, col_values=(('external_ids', {'iface-id': '71be4c62-7219-45ca-8047-ab6716b37f6a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5b:5d:84', 'vm-uuid': '83670c16-3566-4679-8e74-c6451c840315'}),), if_exists=True) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:13:37 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:13:37 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:13:37 user nova-compute[73572]: INFO os_vif [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:5d:84,bridge_name='br-int',has_traffic_filtering=True,id=71be4c62-7219-45ca-8047-ab6716b37f6a,network=Network(0a1bb03e-917c-4df5-84cc-bd7729b69ab6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71be4c62-72')
Aug 26 10:13:37 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T10:12:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1879326179',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1879326179',id=9,image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM3oCFCh6aSyMKnKXD2N01fKLoLdTwSLEkitnN27bC0tybJXZUg58irUKFfKhM+F56mUQ6TT+wCANqJX5C6Y4Kdsag44eqLZjU/ENlptljpGrrUDZwWsVYQykcGl3CUZJQ==',key_name='tempest-keypair-123856006',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9de7931c97d448eaa26d295386b3a999',ramdisk_id='',reservation_id='r-9p350v4l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1188843039',owner_user_name='tempest-TaggedBootDevicesTest-1188843039-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T10:12:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d2269ea682c5489892c05da7db781952',uuid=83670c16-3566-4679-8e74-c6451c840315,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "84bf04a4-b563-48c5-aa73-5b54cbb4887f", "address": "fa:16:3e:e2:c6:ae", "network": {"id": "e194b396-7c3f-41f3-99b2-f82b55c779f2", "bridge": "br-int", "label": "tempest-device-tagging-net1-1768943373", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.226", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9de7931c97d448eaa26d295386b3a999", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84bf04a4-b5", "ovs_interfaceid": "84bf04a4-b563-48c5-aa73-5b54cbb4887f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73572) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 10:13:37 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] Converting VIF {"id": "84bf04a4-b563-48c5-aa73-5b54cbb4887f", "address": "fa:16:3e:e2:c6:ae", "network": {"id": "e194b396-7c3f-41f3-99b2-f82b55c779f2", "bridge": "br-int", "label": "tempest-device-tagging-net1-1768943373", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.226", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9de7931c97d448eaa26d295386b3a999", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84bf04a4-b5", "ovs_interfaceid": "84bf04a4-b563-48c5-aa73-5b54cbb4887f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:13:37 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:c6:ae,bridge_name='br-int',has_traffic_filtering=True,id=84bf04a4-b563-48c5-aa73-5b54cbb4887f,network=Network(e194b396-7c3f-41f3-99b2-f82b55c779f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap84bf04a4-b5') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:13:37 user nova-compute[73572]: DEBUG os_vif [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:c6:ae,bridge_name='br-int',has_traffic_filtering=True,id=84bf04a4-b563-48c5-aa73-5b54cbb4887f,network=Network(e194b396-7c3f-41f3-99b2-f82b55c779f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap84bf04a4-b5') {{(pid=73572) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 10:13:37 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:13:37 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:13:37 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 10:13:37 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:13:37 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap84bf04a4-b5, may_exist=True, interface_attrs={}) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:13:37 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap84bf04a4-b5, col_values=(('external_ids', {'iface-id': '84bf04a4-b563-48c5-aa73-5b54cbb4887f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e2:c6:ae', 'vm-uuid': '83670c16-3566-4679-8e74-c6451c840315'}),), if_exists=True) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:13:37 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:13:37 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:13:37 user nova-compute[73572]: INFO os_vif [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:c6:ae,bridge_name='br-int',has_traffic_filtering=True,id=84bf04a4-b563-48c5-aa73-5b54cbb4887f,network=Network(e194b396-7c3f-41f3-99b2-f82b55c779f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap84bf04a4-b5')
Aug 26 10:13:37 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T10:12:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1879326179',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1879326179',id=9,image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM3oCFCh6aSyMKnKXD2N01fKLoLdTwSLEkitnN27bC0tybJXZUg58irUKFfKhM+F56mUQ6TT+wCANqJX5C6Y4Kdsag44eqLZjU/ENlptljpGrrUDZwWsVYQykcGl3CUZJQ==',key_name='tempest-keypair-123856006',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9de7931c97d448eaa26d295386b3a999',ramdisk_id='',reservation_id='r-9p350v4l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1188843039',owner_user_name='tempest-TaggedBootDevicesTest-1188843039-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T10:12:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d2269ea682c5489892c05da7db781952',uuid=83670c16-3566-4679-8e74-c6451c840315,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f4d684f0-2fe0-46e6-8f84-e2c0918a5a82", "address": "fa:16:3e:a6:7f:bd", "network": {"id": "e194b396-7c3f-41f3-99b2-f82b55c779f2", "bridge": "br-int", "label": "tempest-device-tagging-net1-1768943373", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.191", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9de7931c97d448eaa26d295386b3a999", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4d684f0-2f", "ovs_interfaceid": "f4d684f0-2fe0-46e6-8f84-e2c0918a5a82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73572) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 10:13:37 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] Converting VIF {"id": "f4d684f0-2fe0-46e6-8f84-e2c0918a5a82", "address": "fa:16:3e:a6:7f:bd", "network": {"id": "e194b396-7c3f-41f3-99b2-f82b55c779f2", "bridge": "br-int", "label": "tempest-device-tagging-net1-1768943373", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.191", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9de7931c97d448eaa26d295386b3a999", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4d684f0-2f", "ovs_interfaceid": "f4d684f0-2fe0-46e6-8f84-e2c0918a5a82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:13:37 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:7f:bd,bridge_name='br-int',has_traffic_filtering=True,id=f4d684f0-2fe0-46e6-8f84-e2c0918a5a82,network=Network(e194b396-7c3f-41f3-99b2-f82b55c779f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf4d684f0-2f') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:13:37 user nova-compute[73572]: DEBUG os_vif [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:7f:bd,bridge_name='br-int',has_traffic_filtering=True,id=f4d684f0-2fe0-46e6-8f84-e2c0918a5a82,network=Network(e194b396-7c3f-41f3-99b2-f82b55c779f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf4d684f0-2f') {{(pid=73572) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 10:13:37 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:13:37 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:13:37 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 10:13:37 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:13:37 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf4d684f0-2f, may_exist=True, interface_attrs={}) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:13:37 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf4d684f0-2f, col_values=(('external_ids', {'iface-id': 'f4d684f0-2fe0-46e6-8f84-e2c0918a5a82', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a6:7f:bd', 'vm-uuid': '83670c16-3566-4679-8e74-c6451c840315'}),), if_exists=True) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:13:37 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:13:37 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:13:37 user nova-compute[73572]: INFO os_vif [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:7f:bd,bridge_name='br-int',has_traffic_filtering=True,id=f4d684f0-2fe0-46e6-8f84-e2c0918a5a82,network=Network(e194b396-7c3f-41f3-99b2-f82b55c779f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf4d684f0-2f')
Aug 26 10:13:37 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T10:12:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1879326179',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1879326179',id=9,image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM3oCFCh6aSyMKnKXD2N01fKLoLdTwSLEkitnN27bC0tybJXZUg58irUKFfKhM+F56mUQ6TT+wCANqJX5C6Y4Kdsag44eqLZjU/ENlptljpGrrUDZwWsVYQykcGl3CUZJQ==',key_name='tempest-keypair-123856006',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9de7931c97d448eaa26d295386b3a999',ramdisk_id='',reservation_id='r-9p350v4l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1188843039',owner_user_name='tempest-TaggedBootDevicesTest-1188843039-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T10:12:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d2269ea682c5489892c05da7db781952',uuid=83670c16-3566-4679-8e74-c6451c840315,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "41a7ee04-5b67-4da6-a543-0d15187e5813", "address": "fa:16:3e:32:50:ef", "network": {"id": "e194b396-7c3f-41f3-99b2-f82b55c779f2", "bridge": "br-int", "label": "tempest-device-tagging-net1-1768943373", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.158", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9de7931c97d448eaa26d295386b3a999", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41a7ee04-5b", "ovs_interfaceid": "41a7ee04-5b67-4da6-a543-0d15187e5813", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 10:13:37 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] Converting VIF {"id": "41a7ee04-5b67-4da6-a543-0d15187e5813", "address": "fa:16:3e:32:50:ef", "network": {"id": "e194b396-7c3f-41f3-99b2-f82b55c779f2", "bridge": "br-int", "label": "tempest-device-tagging-net1-1768943373", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.158", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9de7931c97d448eaa26d295386b3a999", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41a7ee04-5b", "ovs_interfaceid": "41a7ee04-5b67-4da6-a543-0d15187e5813", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:13:37 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:50:ef,bridge_name='br-int',has_traffic_filtering=True,id=41a7ee04-5b67-4da6-a543-0d15187e5813,network=Network(e194b396-7c3f-41f3-99b2-f82b55c779f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41a7ee04-5b') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:13:37 user nova-compute[73572]: DEBUG os_vif [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:50:ef,bridge_name='br-int',has_traffic_filtering=True,id=41a7ee04-5b67-4da6-a543-0d15187e5813,network=Network(e194b396-7c3f-41f3-99b2-f82b55c779f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41a7ee04-5b') {{(pid=73572) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 10:13:37 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:13:37 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:13:37 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 10:13:37 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:13:37 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap41a7ee04-5b, may_exist=True, interface_attrs={}) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:13:37 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap41a7ee04-5b, col_values=(('external_ids', {'iface-id': '41a7ee04-5b67-4da6-a543-0d15187e5813', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:32:50:ef', 'vm-uuid': '83670c16-3566-4679-8e74-c6451c840315'}),), if_exists=True) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:13:37 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:13:37 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:13:37 user nova-compute[73572]: INFO os_vif [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:50:ef,bridge_name='br-int',has_traffic_filtering=True,id=41a7ee04-5b67-4da6-a543-0d15187e5813,network=Network(e194b396-7c3f-41f3-99b2-f82b55c779f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41a7ee04-5b')
Aug 26 10:13:37 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T10:12:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1879326179',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1879326179',id=9,image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM3oCFCh6aSyMKnKXD2N01fKLoLdTwSLEkitnN27bC0tybJXZUg58irUKFfKhM+F56mUQ6TT+wCANqJX5C6Y4Kdsag44eqLZjU/ENlptljpGrrUDZwWsVYQykcGl3CUZJQ==',key_name='tempest-keypair-123856006',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9de7931c97d448eaa26d295386b3a999',ramdisk_id='',reservation_id='r-9p350v4l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1188843039',owner_user_name='tempest-TaggedBootDevicesTest-1188843039-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T10:12:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d2269ea682c5489892c05da7db781952',uuid=83670c16-3566-4679-8e74-c6451c840315,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "422eb7ef-4540-462b-a485-afdc38ebccd0", "address": "fa:16:3e:79:44:99", "network": {"id": "e194b396-7c3f-41f3-99b2-f82b55c779f2", "bridge": "br-int", "label": "tempest-device-tagging-net1-1768943373", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9de7931c97d448eaa26d295386b3a999", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap422eb7ef-45", "ovs_interfaceid": "422eb7ef-4540-462b-a485-afdc38ebccd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 10:13:37 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] Converting VIF {"id": "422eb7ef-4540-462b-a485-afdc38ebccd0", "address": "fa:16:3e:79:44:99", "network": {"id": "e194b396-7c3f-41f3-99b2-f82b55c779f2", "bridge": "br-int", "label": "tempest-device-tagging-net1-1768943373", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9de7931c97d448eaa26d295386b3a999", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap422eb7ef-45", "ovs_interfaceid": "422eb7ef-4540-462b-a485-afdc38ebccd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:13:37 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:44:99,bridge_name='br-int',has_traffic_filtering=True,id=422eb7ef-4540-462b-a485-afdc38ebccd0,network=Network(e194b396-7c3f-41f3-99b2-f82b55c779f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap422eb7ef-45') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:13:37 user nova-compute[73572]: DEBUG os_vif [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:44:99,bridge_name='br-int',has_traffic_filtering=True,id=422eb7ef-4540-462b-a485-afdc38ebccd0,network=Network(e194b396-7c3f-41f3-99b2-f82b55c779f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap422eb7ef-45') {{(pid=73572) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 10:13:37 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:13:37 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:13:37 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 10:13:37 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:13:37 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap422eb7ef-45, may_exist=True, interface_attrs={}) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:13:37 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap422eb7ef-45, col_values=(('external_ids', {'iface-id': '422eb7ef-4540-462b-a485-afdc38ebccd0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:79:44:99', 'vm-uuid': '83670c16-3566-4679-8e74-c6451c840315'}),), if_exists=True) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:13:37 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:13:37 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:13:37 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:13:37 user nova-compute[73572]: INFO os_vif [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:44:99,bridge_name='br-int',has_traffic_filtering=True,id=422eb7ef-4540-462b-a485-afdc38ebccd0,network=Network(e194b396-7c3f-41f3-99b2-f82b55c779f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap422eb7ef-45')
Aug 26 10:13:37 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T10:12:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1879326179',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1879326179',id=9,image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM3oCFCh6aSyMKnKXD2N01fKLoLdTwSLEkitnN27bC0tybJXZUg58irUKFfKhM+F56mUQ6TT+wCANqJX5C6Y4Kdsag44eqLZjU/ENlptljpGrrUDZwWsVYQykcGl3CUZJQ==',key_name='tempest-keypair-123856006',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9de7931c97d448eaa26d295386b3a999',ramdisk_id='',reservation_id='r-9p350v4l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1188843039',owner_user_name='tempest-TaggedBootDevicesTest-1188843039-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T10:12:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d2269ea682c5489892c05da7db781952',uuid=83670c16-3566-4679-8e74-c6451c840315,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5e85b3cc-9fe4-46aa-a43f-d4acc5ca3c73", "address": "fa:16:3e:fd:33:d1", "network": {"id": "2cfbe057-f10f-4b28-b3bf-98b2ef5103d7", "bridge": "br-int", "label": "tempest-device-tagging-net2-598168548", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9de7931c97d448eaa26d295386b3a999", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e85b3cc-9f", "ovs_interfaceid": "5e85b3cc-9fe4-46aa-a43f-d4acc5ca3c73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 10:13:37 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] Converting VIF {"id": "5e85b3cc-9fe4-46aa-a43f-d4acc5ca3c73", "address": "fa:16:3e:fd:33:d1", "network": {"id": "2cfbe057-f10f-4b28-b3bf-98b2ef5103d7", "bridge": "br-int", "label": "tempest-device-tagging-net2-598168548", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9de7931c97d448eaa26d295386b3a999", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e85b3cc-9f", "ovs_interfaceid": "5e85b3cc-9fe4-46aa-a43f-d4acc5ca3c73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:13:37 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:33:d1,bridge_name='br-int',has_traffic_filtering=True,id=5e85b3cc-9fe4-46aa-a43f-d4acc5ca3c73,network=Network(2cfbe057-f10f-4b28-b3bf-98b2ef5103d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e85b3cc-9f') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:13:37 user nova-compute[73572]: DEBUG os_vif [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:33:d1,bridge_name='br-int',has_traffic_filtering=True,id=5e85b3cc-9fe4-46aa-a43f-d4acc5ca3c73,network=Network(2cfbe057-f10f-4b28-b3bf-98b2ef5103d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e85b3cc-9f') {{(pid=73572) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 10:13:37 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:13:37 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:13:37 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 10:13:37 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:13:37 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5e85b3cc-9f, may_exist=True, interface_attrs={}) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:13:37 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5e85b3cc-9f, col_values=(('external_ids', {'iface-id': '5e85b3cc-9fe4-46aa-a43f-d4acc5ca3c73', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fd:33:d1', 'vm-uuid': '83670c16-3566-4679-8e74-c6451c840315'}),), if_exists=True) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:13:37 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:13:37 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:13:37 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:13:37 user nova-compute[73572]: INFO os_vif [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:33:d1,bridge_name='br-int',has_traffic_filtering=True,id=5e85b3cc-9fe4-46aa-a43f-d4acc5ca3c73,network=Network(2cfbe057-f10f-4b28-b3bf-98b2ef5103d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e85b3cc-9f')
Aug 26 10:13:37 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T10:12:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1879326179',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1879326179',id=9,image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM3oCFCh6aSyMKnKXD2N01fKLoLdTwSLEkitnN27bC0tybJXZUg58irUKFfKhM+F56mUQ6TT+wCANqJX5C6Y4Kdsag44eqLZjU/ENlptljpGrrUDZwWsVYQykcGl3CUZJQ==',key_name='tempest-keypair-123856006',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9de7931c97d448eaa26d295386b3a999',ramdisk_id='',reservation_id='r-9p350v4l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1188843039',owner_user_name='tempest-TaggedBootDevicesTest-1188843039-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T10:12:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d2269ea682c5489892c05da7db781952',uuid=83670c16-3566-4679-8e74-c6451c840315,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7b7b7362-9dcc-48da-ad4e-9141c676839e", "address": "fa:16:3e:0b:b5:3a", "network": {"id": "2cfbe057-f10f-4b28-b3bf-98b2ef5103d7", "bridge": "br-int", "label": "tempest-device-tagging-net2-598168548", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9de7931c97d448eaa26d295386b3a999", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b7b7362-9d", "ovs_interfaceid": "7b7b7362-9dcc-48da-ad4e-9141c676839e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 10:13:37 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] Converting VIF {"id": "7b7b7362-9dcc-48da-ad4e-9141c676839e", "address": "fa:16:3e:0b:b5:3a", "network": {"id": "2cfbe057-f10f-4b28-b3bf-98b2ef5103d7", "bridge": "br-int", "label": "tempest-device-tagging-net2-598168548", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9de7931c97d448eaa26d295386b3a999", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b7b7362-9d", "ovs_interfaceid": "7b7b7362-9dcc-48da-ad4e-9141c676839e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:13:37 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0b:b5:3a,bridge_name='br-int',has_traffic_filtering=True,id=7b7b7362-9dcc-48da-ad4e-9141c676839e,network=Network(2cfbe057-f10f-4b28-b3bf-98b2ef5103d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b7b7362-9d') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:13:37 user nova-compute[73572]: DEBUG os_vif [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:b5:3a,bridge_name='br-int',has_traffic_filtering=True,id=7b7b7362-9dcc-48da-ad4e-9141c676839e,network=Network(2cfbe057-f10f-4b28-b3bf-98b2ef5103d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b7b7362-9d') {{(pid=73572) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 10:13:37 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:13:37 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:13:37 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 10:13:37 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:13:37 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7b7b7362-9d, may_exist=True, interface_attrs={}) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:13:37 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7b7b7362-9d, col_values=(('external_ids', {'iface-id': '7b7b7362-9dcc-48da-ad4e-9141c676839e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0b:b5:3a', 'vm-uuid': '83670c16-3566-4679-8e74-c6451c840315'}),), if_exists=True) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:13:37 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:13:37 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:13:37 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:13:37 user nova-compute[73572]: INFO os_vif [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:b5:3a,bridge_name='br-int',has_traffic_filtering=True,id=7b7b7362-9dcc-48da-ad4e-9141c676839e,network=Network(2cfbe057-f10f-4b28-b3bf-98b2ef5103d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b7b7362-9d')
Aug 26 10:13:37 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] No BDM found with device name hda, not building metadata. {{(pid=73572) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 10:13:37 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] No BDM found with device name vdc, not building metadata. {{(pid=73572) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 10:13:37 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] No VIF found with MAC fa:16:3e:5b:5d:84, not building metadata {{(pid=73572) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 10:13:37 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] No VIF found with MAC fa:16:3e:79:44:99, not building metadata {{(pid=73572) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 10:13:37 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] [instance: 83670c16-3566-4679-8e74-c6451c840315] Using config drive
Aug 26 10:13:37 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] [instance: 83670c16-3566-4679-8e74-c6451c840315] Creating config drive at /opt/stack/data/nova/instances/83670c16-3566-4679-8e74-c6451c840315/disk.config
Aug 26 10:13:37 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/83670c16-3566-4679-8e74-c6451c840315/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp4ldasizp {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:13:37 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/83670c16-3566-4679-8e74-c6451c840315/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp4ldasizp" returned: 0 in 0.060s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:13:38 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-3e98968b-f363-46d7-a0c6-45ab779dde1f tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] Acquiring lock "8ee427dc-7aa0-4435-b23c-1223f2881df7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:13:38 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-3e98968b-f363-46d7-a0c6-45ab779dde1f tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] Lock "8ee427dc-7aa0-4435-b23c-1223f2881df7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:13:38 user nova-compute[73572]: DEBUG nova.objects.instance [None req-3e98968b-f363-46d7-a0c6-45ab779dde1f tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] Lazy-loading 'flavor' on Instance uuid 8ee427dc-7aa0-4435-b23c-1223f2881df7 {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:13:38 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-3e98968b-f363-46d7-a0c6-45ab779dde1f tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] Lock "8ee427dc-7aa0-4435-b23c-1223f2881df7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:13:38 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-3e98968b-f363-46d7-a0c6-45ab779dde1f tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] Acquiring lock "8ee427dc-7aa0-4435-b23c-1223f2881df7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:13:38 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-3e98968b-f363-46d7-a0c6-45ab779dde1f tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] Lock "8ee427dc-7aa0-4435-b23c-1223f2881df7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:13:38 user nova-compute[73572]: INFO nova.compute.manager [None req-3e98968b-f363-46d7-a0c6-45ab779dde1f tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] [instance: 8ee427dc-7aa0-4435-b23c-1223f2881df7] Attaching volume c5be97e0-c3f1-4751-a0d7-32e45c899c06 to /dev/sdc
Aug 26 10:13:38 user nova-compute[73572]: DEBUG os_brick.utils [None req-3e98968b-f363-46d7-a0c6-45ab779dde1f tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 10:13:38 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:13:38 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:13:38 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[e30fbad4-6fc8-4057-bfcd-226bbe75cc20]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:de8a79ed912\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:13:38 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:13:38 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:13:38 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[033b22d1-007c-4874-bade-42e21e7c7610]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:13:38 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:13:38 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:13:38 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[38622466-ddef-48be-b5d0-5d8e865dd620]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:13:38 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a847ccb-2531-4884-8063-442b6eee6101]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:13:38 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-3e98968b-f363-46d7-a0c6-45ab779dde1f tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] Running cmd (subprocess): nvme version {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:13:38 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-3e98968b-f363-46d7-a0c6-45ab779dde1f tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] 'nvme version' failed. Not Retrying. {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 10:13:38 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3e98968b-f363-46d7-a0c6-45ab779dde1f tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] nvme not present on system {{(pid=73572) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 10:13:38 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:13:38 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 10:13:38 user nova-compute[73572]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 10:13:38 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[70531bc8-3e05-4d8b-b00e-2088dd0f5e9a]: (4, '') {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:13:38 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.lightos [None req-3e98968b-f363-46d7-a0c6-45ab779dde1f tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73572) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 10:13:38 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.lightos [None req-3e98968b-f363-46d7-a0c6-45ab779dde1f tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73572) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 10:13:38 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.lightos [None req-3e98968b-f363-46d7-a0c6-45ab779dde1f tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] LIGHTOS: no hostnqn found. {{(pid=73572) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 10:13:38 user nova-compute[73572]: DEBUG os_brick.utils [None req-3e98968b-f363-46d7-a0c6-45ab779dde1f tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:de8a79ed912', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 10:13:38 user nova-compute[73572]: DEBUG nova.virt.block_device [None req-3e98968b-f363-46d7-a0c6-45ab779dde1f tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] [instance: 8ee427dc-7aa0-4435-b23c-1223f2881df7] Updating existing volume attachment record: 94960cb0-9123-4276-bc5c-39c4f44c1274 {{(pid=73572) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 10:13:38 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:13:39 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:13:39 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:13:39 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:13:39 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:13:39 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-c43f8196-cf94-4074-8d29-80d70ddfda3e tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] Acquiring lock "ee9bcbaa-25a6-4588-b757-2a2ae15b6cf8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:13:39 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-c43f8196-cf94-4074-8d29-80d70ddfda3e tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] Lock "ee9bcbaa-25a6-4588-b757-2a2ae15b6cf8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:13:39 user nova-compute[73572]: DEBUG nova.objects.instance [None req-c43f8196-cf94-4074-8d29-80d70ddfda3e tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] Lazy-loading 'flavor' on Instance uuid ee9bcbaa-25a6-4588-b757-2a2ae15b6cf8 {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:13:39 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:13:39 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-c43f8196-cf94-4074-8d29-80d70ddfda3e tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] Lock "ee9bcbaa-25a6-4588-b757-2a2ae15b6cf8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.107s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:13:39 user nova-compute[73572]: DEBUG nova.compute.manager [req-55b46d1a-34c6-46be-a26c-08ed51b88566 req-b41476c4-4979-4a80-9550-0ec3082c9c70 service nova] [instance: 83670c16-3566-4679-8e74-c6451c840315] Received event network-vif-plugged-71be4c62-7219-45ca-8047-ab6716b37f6a {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:13:39 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-55b46d1a-34c6-46be-a26c-08ed51b88566 req-b41476c4-4979-4a80-9550-0ec3082c9c70 service nova] Acquiring lock "83670c16-3566-4679-8e74-c6451c840315-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:13:39 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-55b46d1a-34c6-46be-a26c-08ed51b88566 req-b41476c4-4979-4a80-9550-0ec3082c9c70 service nova] Lock "83670c16-3566-4679-8e74-c6451c840315-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:13:39 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-55b46d1a-34c6-46be-a26c-08ed51b88566 req-b41476c4-4979-4a80-9550-0ec3082c9c70 service nova] Lock "83670c16-3566-4679-8e74-c6451c840315-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:13:39 user nova-compute[73572]: DEBUG nova.compute.manager [req-55b46d1a-34c6-46be-a26c-08ed51b88566 req-b41476c4-4979-4a80-9550-0ec3082c9c70 service nova] [instance: 83670c16-3566-4679-8e74-c6451c840315] No waiting events found dispatching network-vif-plugged-71be4c62-7219-45ca-8047-ab6716b37f6a {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:13:39 user nova-compute[73572]: WARNING nova.compute.manager [req-55b46d1a-34c6-46be-a26c-08ed51b88566 req-b41476c4-4979-4a80-9550-0ec3082c9c70 service nova] [instance: 83670c16-3566-4679-8e74-c6451c840315] Received unexpected event network-vif-plugged-71be4c62-7219-45ca-8047-ab6716b37f6a for instance with vm_state building and task_state spawning.
Aug 26 10:13:39 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:13:39 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:13:39 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:13:39 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-c43f8196-cf94-4074-8d29-80d70ddfda3e tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] Acquiring lock "ee9bcbaa-25a6-4588-b757-2a2ae15b6cf8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:13:39 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-c43f8196-cf94-4074-8d29-80d70ddfda3e tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] Lock "ee9bcbaa-25a6-4588-b757-2a2ae15b6cf8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:13:39 user nova-compute[73572]: INFO nova.compute.manager [None req-c43f8196-cf94-4074-8d29-80d70ddfda3e tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] [instance: ee9bcbaa-25a6-4588-b757-2a2ae15b6cf8] Attaching volume 99c74791-0bdd-4261-a580-f456f29cbadb to /dev/vdb
Aug 26 10:13:40 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:13:40 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:13:40 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:13:40 user nova-compute[73572]: DEBUG os_brick.utils [None req-c43f8196-cf94-4074-8d29-80d70ddfda3e tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 10:13:40 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:13:40 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:13:40 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:13:40 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:13:40 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[18a1795f-1138-4bcc-90ee-6a81b9bc9c7d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:de8a79ed912\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:13:40 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:13:40 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:13:40 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[a14a3442-49fe-4a86-be8f-b825f2811c26]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:13:40 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:13:40 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:13:40 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[88f85a76-2c8d-462c-9fed-5a1ca010ab20]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:13:40 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[004a900b-da7a-450b-b8c8-97b2ccbe5f5e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:13:40 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-c43f8196-cf94-4074-8d29-80d70ddfda3e tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] Running cmd (subprocess): nvme version {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:13:40 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-c43f8196-cf94-4074-8d29-80d70ddfda3e tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] 'nvme version' failed. Not Retrying. {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 10:13:40 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c43f8196-cf94-4074-8d29-80d70ddfda3e tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] nvme not present on system {{(pid=73572) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 10:13:40 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:13:40 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 10:13:40 user nova-compute[73572]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 10:13:40 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6c569d9-b157-45bc-ad0b-f3afa1b77bcb]: (4, '') {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:13:40 user nova-compute[73572]: DEBUG nova.compute.manager [req-76f663a8-feef-4cc0-8a25-25b00d727f46 req-14ce3ae9-97ce-4efc-b6c4-608172ebbe28 service nova] [instance: 83670c16-3566-4679-8e74-c6451c840315] Received event network-vif-plugged-f4d684f0-2fe0-46e6-8f84-e2c0918a5a82 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:13:40 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-76f663a8-feef-4cc0-8a25-25b00d727f46 req-14ce3ae9-97ce-4efc-b6c4-608172ebbe28 service nova] Acquiring lock "83670c16-3566-4679-8e74-c6451c840315-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:13:40 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-76f663a8-feef-4cc0-8a25-25b00d727f46 req-14ce3ae9-97ce-4efc-b6c4-608172ebbe28 service nova] Lock "83670c16-3566-4679-8e74-c6451c840315-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:13:40 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-76f663a8-feef-4cc0-8a25-25b00d727f46 req-14ce3ae9-97ce-4efc-b6c4-608172ebbe28 service nova] Lock "83670c16-3566-4679-8e74-c6451c840315-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:13:40 user nova-compute[73572]: DEBUG nova.compute.manager [req-76f663a8-feef-4cc0-8a25-25b00d727f46 req-14ce3ae9-97ce-4efc-b6c4-608172ebbe28 service nova] [instance: 83670c16-3566-4679-8e74-c6451c840315] No waiting events found dispatching network-vif-plugged-f4d684f0-2fe0-46e6-8f84-e2c0918a5a82 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:13:40 user nova-compute[73572]: WARNING nova.compute.manager [req-76f663a8-feef-4cc0-8a25-25b00d727f46 req-14ce3ae9-97ce-4efc-b6c4-608172ebbe28 service nova] [instance: 83670c16-3566-4679-8e74-c6451c840315] Received unexpected event network-vif-plugged-f4d684f0-2fe0-46e6-8f84-e2c0918a5a82 for instance with vm_state building and task_state spawning.
Aug 26 10:13:40 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:13:40 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.lightos [None req-c43f8196-cf94-4074-8d29-80d70ddfda3e tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73572) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 10:13:40 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.lightos [None req-c43f8196-cf94-4074-8d29-80d70ddfda3e tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73572) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 10:13:40 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.lightos [None req-c43f8196-cf94-4074-8d29-80d70ddfda3e tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] LIGHTOS: no hostnqn found. {{(pid=73572) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 10:13:40 user nova-compute[73572]: DEBUG os_brick.utils [None req-c43f8196-cf94-4074-8d29-80d70ddfda3e tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] <== get_connector_properties: return (159ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:de8a79ed912', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 10:13:40 user nova-compute[73572]: DEBUG nova.virt.block_device [None req-c43f8196-cf94-4074-8d29-80d70ddfda3e tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] [instance: ee9bcbaa-25a6-4588-b757-2a2ae15b6cf8] Updating existing volume attachment record: 6b891bbe-7f40-45e4-94f9-3f82da49c368 {{(pid=73572) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 10:13:40 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:13:40 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:13:40 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:13:40 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:13:40 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:13:40 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:13:40 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:13:40 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:13:41 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:13:41 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:13:41 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:13:41 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:13:41 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:13:41 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:13:41 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:13:41 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:13:41 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:13:41 user nova-compute[73572]: DEBUG nova.compute.manager [req-93df1d62-e637-4a93-a6ad-a80cbd1e3c4d req-e91f6bc3-a1a6-4162-8fa9-1d7e4335926d service nova] [instance: 83670c16-3566-4679-8e74-c6451c840315] Received event network-vif-plugged-71be4c62-7219-45ca-8047-ab6716b37f6a {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:13:41 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-93df1d62-e637-4a93-a6ad-a80cbd1e3c4d req-e91f6bc3-a1a6-4162-8fa9-1d7e4335926d service nova] Acquiring lock "83670c16-3566-4679-8e74-c6451c840315-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:13:41 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-93df1d62-e637-4a93-a6ad-a80cbd1e3c4d req-e91f6bc3-a1a6-4162-8fa9-1d7e4335926d service nova] Lock "83670c16-3566-4679-8e74-c6451c840315-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:13:41 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-93df1d62-e637-4a93-a6ad-a80cbd1e3c4d req-e91f6bc3-a1a6-4162-8fa9-1d7e4335926d service nova] Lock "83670c16-3566-4679-8e74-c6451c840315-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:13:41 user nova-compute[73572]: DEBUG nova.compute.manager [req-93df1d62-e637-4a93-a6ad-a80cbd1e3c4d req-e91f6bc3-a1a6-4162-8fa9-1d7e4335926d service nova] [instance: 83670c16-3566-4679-8e74-c6451c840315] No waiting events found dispatching network-vif-plugged-71be4c62-7219-45ca-8047-ab6716b37f6a {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:13:41 user nova-compute[73572]: WARNING nova.compute.manager [req-93df1d62-e637-4a93-a6ad-a80cbd1e3c4d req-e91f6bc3-a1a6-4162-8fa9-1d7e4335926d service nova] [instance: 83670c16-3566-4679-8e74-c6451c840315] Received unexpected event network-vif-plugged-71be4c62-7219-45ca-8047-ab6716b37f6a for instance with vm_state building and task_state spawning.
Aug 26 10:13:41 user nova-compute[73572]: DEBUG nova.compute.manager [req-93df1d62-e637-4a93-a6ad-a80cbd1e3c4d req-e91f6bc3-a1a6-4162-8fa9-1d7e4335926d service nova] [instance: 83670c16-3566-4679-8e74-c6451c840315] Received event network-vif-plugged-84bf04a4-b563-48c5-aa73-5b54cbb4887f {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:13:41 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-93df1d62-e637-4a93-a6ad-a80cbd1e3c4d req-e91f6bc3-a1a6-4162-8fa9-1d7e4335926d service nova] Acquiring lock "83670c16-3566-4679-8e74-c6451c840315-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:13:41 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-93df1d62-e637-4a93-a6ad-a80cbd1e3c4d req-e91f6bc3-a1a6-4162-8fa9-1d7e4335926d service nova] Lock "83670c16-3566-4679-8e74-c6451c840315-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:13:41 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-93df1d62-e637-4a93-a6ad-a80cbd1e3c4d req-e91f6bc3-a1a6-4162-8fa9-1d7e4335926d service nova] Lock "83670c16-3566-4679-8e74-c6451c840315-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:13:41 user nova-compute[73572]: DEBUG nova.compute.manager [req-93df1d62-e637-4a93-a6ad-a80cbd1e3c4d req-e91f6bc3-a1a6-4162-8fa9-1d7e4335926d service nova] [instance: 83670c16-3566-4679-8e74-c6451c840315] No waiting events found dispatching network-vif-plugged-84bf04a4-b563-48c5-aa73-5b54cbb4887f {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:13:41 user nova-compute[73572]: WARNING nova.compute.manager [req-93df1d62-e637-4a93-a6ad-a80cbd1e3c4d req-e91f6bc3-a1a6-4162-8fa9-1d7e4335926d service nova] [instance: 83670c16-3566-4679-8e74-c6451c840315] Received unexpected event network-vif-plugged-84bf04a4-b563-48c5-aa73-5b54cbb4887f for instance with vm_state building and task_state spawning.
Aug 26 10:13:41 user nova-compute[73572]: DEBUG nova.compute.manager [req-93df1d62-e637-4a93-a6ad-a80cbd1e3c4d req-e91f6bc3-a1a6-4162-8fa9-1d7e4335926d service nova] [instance: 83670c16-3566-4679-8e74-c6451c840315] Received event network-vif-plugged-84bf04a4-b563-48c5-aa73-5b54cbb4887f {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:13:41 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-93df1d62-e637-4a93-a6ad-a80cbd1e3c4d req-e91f6bc3-a1a6-4162-8fa9-1d7e4335926d service nova] Acquiring lock "83670c16-3566-4679-8e74-c6451c840315-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:13:41 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-93df1d62-e637-4a93-a6ad-a80cbd1e3c4d req-e91f6bc3-a1a6-4162-8fa9-1d7e4335926d service nova] Lock "83670c16-3566-4679-8e74-c6451c840315-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:13:41 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-93df1d62-e637-4a93-a6ad-a80cbd1e3c4d req-e91f6bc3-a1a6-4162-8fa9-1d7e4335926d service nova] Lock "83670c16-3566-4679-8e74-c6451c840315-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:13:41 user nova-compute[73572]: DEBUG nova.compute.manager [req-93df1d62-e637-4a93-a6ad-a80cbd1e3c4d req-e91f6bc3-a1a6-4162-8fa9-1d7e4335926d service nova] [instance: 83670c16-3566-4679-8e74-c6451c840315] No waiting events found dispatching network-vif-plugged-84bf04a4-b563-48c5-aa73-5b54cbb4887f {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:13:41 user nova-compute[73572]: WARNING nova.compute.manager [req-93df1d62-e637-4a93-a6ad-a80cbd1e3c4d req-e91f6bc3-a1a6-4162-8fa9-1d7e4335926d service nova] [instance: 83670c16-3566-4679-8e74-c6451c840315] Received unexpected event network-vif-plugged-84bf04a4-b563-48c5-aa73-5b54cbb4887f for instance with vm_state building and task_state spawning.
Aug 26 10:13:41 user nova-compute[73572]: DEBUG nova.compute.manager [req-93df1d62-e637-4a93-a6ad-a80cbd1e3c4d req-e91f6bc3-a1a6-4162-8fa9-1d7e4335926d service nova] [instance: 83670c16-3566-4679-8e74-c6451c840315] Received event network-vif-plugged-41a7ee04-5b67-4da6-a543-0d15187e5813 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:13:41 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-93df1d62-e637-4a93-a6ad-a80cbd1e3c4d req-e91f6bc3-a1a6-4162-8fa9-1d7e4335926d service nova] Acquiring lock "83670c16-3566-4679-8e74-c6451c840315-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:13:41 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-93df1d62-e637-4a93-a6ad-a80cbd1e3c4d req-e91f6bc3-a1a6-4162-8fa9-1d7e4335926d service nova] Lock "83670c16-3566-4679-8e74-c6451c840315-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:13:41 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-93df1d62-e637-4a93-a6ad-a80cbd1e3c4d req-e91f6bc3-a1a6-4162-8fa9-1d7e4335926d service nova] Lock "83670c16-3566-4679-8e74-c6451c840315-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:13:41 user nova-compute[73572]: DEBUG nova.compute.manager [req-93df1d62-e637-4a93-a6ad-a80cbd1e3c4d req-e91f6bc3-a1a6-4162-8fa9-1d7e4335926d service nova] [instance: 83670c16-3566-4679-8e74-c6451c840315] No waiting events found dispatching network-vif-plugged-41a7ee04-5b67-4da6-a543-0d15187e5813 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:13:41 user nova-compute[73572]: WARNING nova.compute.manager [req-93df1d62-e637-4a93-a6ad-a80cbd1e3c4d req-e91f6bc3-a1a6-4162-8fa9-1d7e4335926d service nova] [instance: 83670c16-3566-4679-8e74-c6451c840315] Received unexpected event network-vif-plugged-41a7ee04-5b67-4da6-a543-0d15187e5813 for instance with vm_state building and task_state spawning.
Aug 26 10:13:41 user nova-compute[73572]: DEBUG nova.compute.manager [req-93df1d62-e637-4a93-a6ad-a80cbd1e3c4d req-e91f6bc3-a1a6-4162-8fa9-1d7e4335926d service nova] [instance: 83670c16-3566-4679-8e74-c6451c840315] Received event network-vif-plugged-41a7ee04-5b67-4da6-a543-0d15187e5813 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:13:41 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-93df1d62-e637-4a93-a6ad-a80cbd1e3c4d req-e91f6bc3-a1a6-4162-8fa9-1d7e4335926d service nova] Acquiring lock "83670c16-3566-4679-8e74-c6451c840315-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:13:41 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-93df1d62-e637-4a93-a6ad-a80cbd1e3c4d req-e91f6bc3-a1a6-4162-8fa9-1d7e4335926d service nova] Lock "83670c16-3566-4679-8e74-c6451c840315-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:13:41 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-93df1d62-e637-4a93-a6ad-a80cbd1e3c4d req-e91f6bc3-a1a6-4162-8fa9-1d7e4335926d service nova] Lock "83670c16-3566-4679-8e74-c6451c840315-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:13:41 user nova-compute[73572]: DEBUG nova.compute.manager [req-93df1d62-e637-4a93-a6ad-a80cbd1e3c4d req-e91f6bc3-a1a6-4162-8fa9-1d7e4335926d service nova] [instance: 83670c16-3566-4679-8e74-c6451c840315] No waiting events found dispatching network-vif-plugged-41a7ee04-5b67-4da6-a543-0d15187e5813 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:13:41 user nova-compute[73572]: WARNING nova.compute.manager [req-93df1d62-e637-4a93-a6ad-a80cbd1e3c4d req-e91f6bc3-a1a6-4162-8fa9-1d7e4335926d service nova] [instance: 83670c16-3566-4679-8e74-c6451c840315] Received unexpected event network-vif-plugged-41a7ee04-5b67-4da6-a543-0d15187e5813 for instance with vm_state building and task_state spawning.
Aug 26 10:13:41 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:13:41 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:13:41 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:13:42 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:13:42 user nova-compute[73572]: DEBUG nova.compute.manager [req-65870093-d2b9-463b-84c8-1feec2535a00 req-67540321-6bfa-4260-8464-5022d2b0556f service nova] [instance: 83670c16-3566-4679-8e74-c6451c840315] Received event network-vif-plugged-f4d684f0-2fe0-46e6-8f84-e2c0918a5a82 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:13:42 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-65870093-d2b9-463b-84c8-1feec2535a00 req-67540321-6bfa-4260-8464-5022d2b0556f service nova] Acquiring lock "83670c16-3566-4679-8e74-c6451c840315-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:13:42 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-65870093-d2b9-463b-84c8-1feec2535a00 req-67540321-6bfa-4260-8464-5022d2b0556f service nova] Lock "83670c16-3566-4679-8e74-c6451c840315-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:13:42 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-65870093-d2b9-463b-84c8-1feec2535a00 req-67540321-6bfa-4260-8464-5022d2b0556f service nova] Lock "83670c16-3566-4679-8e74-c6451c840315-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:13:42 user nova-compute[73572]: DEBUG nova.compute.manager [req-65870093-d2b9-463b-84c8-1feec2535a00 req-67540321-6bfa-4260-8464-5022d2b0556f service nova] [instance: 83670c16-3566-4679-8e74-c6451c840315] No waiting events found dispatching network-vif-plugged-f4d684f0-2fe0-46e6-8f84-e2c0918a5a82 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:13:42 user nova-compute[73572]: WARNING nova.compute.manager [req-65870093-d2b9-463b-84c8-1feec2535a00 req-67540321-6bfa-4260-8464-5022d2b0556f service nova] [instance: 83670c16-3566-4679-8e74-c6451c840315] Received unexpected event network-vif-plugged-f4d684f0-2fe0-46e6-8f84-e2c0918a5a82 for instance with vm_state building and task_state spawning.
Aug 26 10:13:42 user nova-compute[73572]: DEBUG nova.compute.manager [req-65870093-d2b9-463b-84c8-1feec2535a00 req-67540321-6bfa-4260-8464-5022d2b0556f service nova] [instance: 83670c16-3566-4679-8e74-c6451c840315] Received event network-vif-plugged-5e85b3cc-9fe4-46aa-a43f-d4acc5ca3c73 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:13:42 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-65870093-d2b9-463b-84c8-1feec2535a00 req-67540321-6bfa-4260-8464-5022d2b0556f service nova] Acquiring lock "83670c16-3566-4679-8e74-c6451c840315-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:13:42 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-65870093-d2b9-463b-84c8-1feec2535a00 req-67540321-6bfa-4260-8464-5022d2b0556f service nova] Lock "83670c16-3566-4679-8e74-c6451c840315-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:13:42 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-65870093-d2b9-463b-84c8-1feec2535a00 req-67540321-6bfa-4260-8464-5022d2b0556f service nova] Lock "83670c16-3566-4679-8e74-c6451c840315-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:13:42 user nova-compute[73572]: DEBUG nova.compute.manager [req-65870093-d2b9-463b-84c8-1feec2535a00 req-67540321-6bfa-4260-8464-5022d2b0556f service nova] [instance: 83670c16-3566-4679-8e74-c6451c840315] No waiting events found dispatching network-vif-plugged-5e85b3cc-9fe4-46aa-a43f-d4acc5ca3c73 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:13:42 user nova-compute[73572]: WARNING nova.compute.manager [req-65870093-d2b9-463b-84c8-1feec2535a00 req-67540321-6bfa-4260-8464-5022d2b0556f service nova] [instance: 83670c16-3566-4679-8e74-c6451c840315] Received unexpected event network-vif-plugged-5e85b3cc-9fe4-46aa-a43f-d4acc5ca3c73 for instance with vm_state building and task_state spawning.
Aug 26 10:13:42 user nova-compute[73572]: DEBUG nova.compute.manager [req-65870093-d2b9-463b-84c8-1feec2535a00 req-67540321-6bfa-4260-8464-5022d2b0556f service nova] [instance: 83670c16-3566-4679-8e74-c6451c840315] Received event network-vif-plugged-5e85b3cc-9fe4-46aa-a43f-d4acc5ca3c73 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:13:42 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-65870093-d2b9-463b-84c8-1feec2535a00 req-67540321-6bfa-4260-8464-5022d2b0556f service nova] Acquiring lock "83670c16-3566-4679-8e74-c6451c840315-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:13:42 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-65870093-d2b9-463b-84c8-1feec2535a00 req-67540321-6bfa-4260-8464-5022d2b0556f service nova] Lock "83670c16-3566-4679-8e74-c6451c840315-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:13:42 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-65870093-d2b9-463b-84c8-1feec2535a00 req-67540321-6bfa-4260-8464-5022d2b0556f service nova] Lock "83670c16-3566-4679-8e74-c6451c840315-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:13:42 user nova-compute[73572]: DEBUG nova.compute.manager [req-65870093-d2b9-463b-84c8-1feec2535a00 req-67540321-6bfa-4260-8464-5022d2b0556f service nova] [instance: 83670c16-3566-4679-8e74-c6451c840315] No waiting events found dispatching network-vif-plugged-5e85b3cc-9fe4-46aa-a43f-d4acc5ca3c73 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:13:42 user nova-compute[73572]: WARNING nova.compute.manager [req-65870093-d2b9-463b-84c8-1feec2535a00 req-67540321-6bfa-4260-8464-5022d2b0556f service nova] [instance: 83670c16-3566-4679-8e74-c6451c840315] Received unexpected event network-vif-plugged-5e85b3cc-9fe4-46aa-a43f-d4acc5ca3c73 for instance with vm_state building and task_state spawning.
Aug 26 10:13:42 user nova-compute[73572]: DEBUG nova.compute.manager [req-65870093-d2b9-463b-84c8-1feec2535a00 req-67540321-6bfa-4260-8464-5022d2b0556f service nova] [instance: 83670c16-3566-4679-8e74-c6451c840315] Received event network-vif-plugged-7b7b7362-9dcc-48da-ad4e-9141c676839e {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:13:42 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-65870093-d2b9-463b-84c8-1feec2535a00 req-67540321-6bfa-4260-8464-5022d2b0556f service nova] Acquiring lock "83670c16-3566-4679-8e74-c6451c840315-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:13:42 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-65870093-d2b9-463b-84c8-1feec2535a00 req-67540321-6bfa-4260-8464-5022d2b0556f service nova] Lock "83670c16-3566-4679-8e74-c6451c840315-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:13:42 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-65870093-d2b9-463b-84c8-1feec2535a00 req-67540321-6bfa-4260-8464-5022d2b0556f service nova] Lock "83670c16-3566-4679-8e74-c6451c840315-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:13:42 user nova-compute[73572]: DEBUG nova.compute.manager [req-65870093-d2b9-463b-84c8-1feec2535a00 req-67540321-6bfa-4260-8464-5022d2b0556f service nova] [instance: 83670c16-3566-4679-8e74-c6451c840315] No waiting events found dispatching network-vif-plugged-7b7b7362-9dcc-48da-ad4e-9141c676839e {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:13:42 user nova-compute[73572]: WARNING nova.compute.manager [req-65870093-d2b9-463b-84c8-1feec2535a00 req-67540321-6bfa-4260-8464-5022d2b0556f service nova] [instance: 83670c16-3566-4679-8e74-c6451c840315] Received unexpected event network-vif-plugged-7b7b7362-9dcc-48da-ad4e-9141c676839e for instance with vm_state building and task_state spawning.
Aug 26 10:13:42 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:13:42 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:13:42 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:13:43 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:13:43 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:13:43 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:13:43 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:13:43 user nova-compute[73572]: DEBUG nova.compute.manager [req-75c52e38-7636-460c-9dd6-ba054413b0e5 req-ee7db26c-9651-4c18-9e0e-219fe31a28d5 service nova] [instance: 83670c16-3566-4679-8e74-c6451c840315] Received event network-vif-plugged-422eb7ef-4540-462b-a485-afdc38ebccd0 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:13:43 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-75c52e38-7636-460c-9dd6-ba054413b0e5 req-ee7db26c-9651-4c18-9e0e-219fe31a28d5 service nova] Acquiring lock "83670c16-3566-4679-8e74-c6451c840315-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:13:43 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-75c52e38-7636-460c-9dd6-ba054413b0e5 req-ee7db26c-9651-4c18-9e0e-219fe31a28d5 service nova] Lock "83670c16-3566-4679-8e74-c6451c840315-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:13:43 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-75c52e38-7636-460c-9dd6-ba054413b0e5 req-ee7db26c-9651-4c18-9e0e-219fe31a28d5 service nova] Lock "83670c16-3566-4679-8e74-c6451c840315-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:13:43 user nova-compute[73572]: DEBUG nova.compute.manager [req-75c52e38-7636-460c-9dd6-ba054413b0e5 req-ee7db26c-9651-4c18-9e0e-219fe31a28d5 service nova] [instance: 83670c16-3566-4679-8e74-c6451c840315] No waiting events found dispatching network-vif-plugged-422eb7ef-4540-462b-a485-afdc38ebccd0 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:13:43 user nova-compute[73572]: WARNING nova.compute.manager [req-75c52e38-7636-460c-9dd6-ba054413b0e5 req-ee7db26c-9651-4c18-9e0e-219fe31a28d5 service nova] [instance: 83670c16-3566-4679-8e74-c6451c840315] Received unexpected event network-vif-plugged-422eb7ef-4540-462b-a485-afdc38ebccd0 for instance with vm_state building and task_state spawning.
Aug 26 10:13:43 user nova-compute[73572]: DEBUG nova.compute.manager [req-75c52e38-7636-460c-9dd6-ba054413b0e5 req-ee7db26c-9651-4c18-9e0e-219fe31a28d5 service nova] [instance: 83670c16-3566-4679-8e74-c6451c840315] Received event network-vif-plugged-422eb7ef-4540-462b-a485-afdc38ebccd0 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:13:43 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-75c52e38-7636-460c-9dd6-ba054413b0e5 req-ee7db26c-9651-4c18-9e0e-219fe31a28d5 service nova] Acquiring lock "83670c16-3566-4679-8e74-c6451c840315-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:13:43 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-75c52e38-7636-460c-9dd6-ba054413b0e5 req-ee7db26c-9651-4c18-9e0e-219fe31a28d5 service nova] Lock "83670c16-3566-4679-8e74-c6451c840315-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:13:43 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-75c52e38-7636-460c-9dd6-ba054413b0e5 req-ee7db26c-9651-4c18-9e0e-219fe31a28d5 service nova] Lock "83670c16-3566-4679-8e74-c6451c840315-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:13:43 user nova-compute[73572]: DEBUG nova.compute.manager [req-75c52e38-7636-460c-9dd6-ba054413b0e5 req-ee7db26c-9651-4c18-9e0e-219fe31a28d5 service nova] [instance: 83670c16-3566-4679-8e74-c6451c840315] No waiting events found dispatching network-vif-plugged-422eb7ef-4540-462b-a485-afdc38ebccd0 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:13:43 user nova-compute[73572]: WARNING nova.compute.manager [req-75c52e38-7636-460c-9dd6-ba054413b0e5 req-ee7db26c-9651-4c18-9e0e-219fe31a28d5 service nova] [instance: 83670c16-3566-4679-8e74-c6451c840315] Received unexpected event network-vif-plugged-422eb7ef-4540-462b-a485-afdc38ebccd0 for instance with vm_state building and task_state spawning.
Aug 26 10:13:43 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:13:44 user nova-compute[73572]: DEBUG nova.virt.driver [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Emitting event <LifecycleEvent: 1693044824.0797806, 83670c16-3566-4679-8e74-c6451c840315 => Resumed> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:13:44 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 83670c16-3566-4679-8e74-c6451c840315] VM Resumed (Lifecycle Event)
Aug 26 10:13:44 user nova-compute[73572]: DEBUG nova.compute.manager [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] [instance: 83670c16-3566-4679-8e74-c6451c840315] Instance event wait completed in 0 seconds for  {{(pid=73572) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 10:13:44 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] [instance: 83670c16-3566-4679-8e74-c6451c840315] Guest created on hypervisor {{(pid=73572) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 10:13:44 user nova-compute[73572]: INFO nova.virt.libvirt.driver [-] [instance: 83670c16-3566-4679-8e74-c6451c840315] Instance spawned successfully.
Aug 26 10:13:44 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] [instance: 83670c16-3566-4679-8e74-c6451c840315] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 10:13:44 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 83670c16-3566-4679-8e74-c6451c840315] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:13:44 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 83670c16-3566-4679-8e74-c6451c840315] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73572) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 10:13:44 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] [instance: 83670c16-3566-4679-8e74-c6451c840315] Found default for hw_cdrom_bus of ide {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:13:44 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] [instance: 83670c16-3566-4679-8e74-c6451c840315] Found default for hw_disk_bus of virtio {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:13:44 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] [instance: 83670c16-3566-4679-8e74-c6451c840315] Found default for hw_input_bus of None {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:13:44 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] [instance: 83670c16-3566-4679-8e74-c6451c840315] Found default for hw_pointer_model of None {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:13:44 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] [instance: 83670c16-3566-4679-8e74-c6451c840315] Found default for hw_video_model of virtio {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:13:44 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] [instance: 83670c16-3566-4679-8e74-c6451c840315] Found default for hw_vif_model of virtio {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:13:44 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 83670c16-3566-4679-8e74-c6451c840315] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 10:13:44 user nova-compute[73572]: DEBUG nova.virt.driver [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Emitting event <LifecycleEvent: 1693044824.0883787, 83670c16-3566-4679-8e74-c6451c840315 => Started> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:13:44 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 83670c16-3566-4679-8e74-c6451c840315] VM Started (Lifecycle Event)
Aug 26 10:13:44 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 83670c16-3566-4679-8e74-c6451c840315] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:13:44 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 83670c16-3566-4679-8e74-c6451c840315] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73572) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 10:13:44 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 83670c16-3566-4679-8e74-c6451c840315] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 10:13:44 user nova-compute[73572]: INFO nova.compute.manager [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] [instance: 83670c16-3566-4679-8e74-c6451c840315] Took 11.23 seconds to spawn the instance on the hypervisor.
Aug 26 10:13:44 user nova-compute[73572]: DEBUG nova.compute.manager [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] [instance: 83670c16-3566-4679-8e74-c6451c840315] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:13:44 user nova-compute[73572]: INFO nova.compute.manager [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] [instance: 83670c16-3566-4679-8e74-c6451c840315] Took 52.47 seconds to build instance.
Aug 26 10:13:44 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-1bc932c1-f59b-4e3a-9fd0-571cb0c844d3 tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] Lock "83670c16-3566-4679-8e74-c6451c840315" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 52.578s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:13:44 user nova-compute[73572]: DEBUG nova.compute.manager [req-0947eb1a-a05d-49a2-9aaf-0da0f31b78ca req-ae748a44-c705-434e-b076-d6bd7160ed0f service nova] [instance: 83670c16-3566-4679-8e74-c6451c840315] Received event network-vif-plugged-7b7b7362-9dcc-48da-ad4e-9141c676839e {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:13:44 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-0947eb1a-a05d-49a2-9aaf-0da0f31b78ca req-ae748a44-c705-434e-b076-d6bd7160ed0f service nova] Acquiring lock "83670c16-3566-4679-8e74-c6451c840315-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:13:44 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-0947eb1a-a05d-49a2-9aaf-0da0f31b78ca req-ae748a44-c705-434e-b076-d6bd7160ed0f service nova] Lock "83670c16-3566-4679-8e74-c6451c840315-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:13:44 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-0947eb1a-a05d-49a2-9aaf-0da0f31b78ca req-ae748a44-c705-434e-b076-d6bd7160ed0f service nova] Lock "83670c16-3566-4679-8e74-c6451c840315-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:13:44 user nova-compute[73572]: DEBUG nova.compute.manager [req-0947eb1a-a05d-49a2-9aaf-0da0f31b78ca req-ae748a44-c705-434e-b076-d6bd7160ed0f service nova] [instance: 83670c16-3566-4679-8e74-c6451c840315] No waiting events found dispatching network-vif-plugged-7b7b7362-9dcc-48da-ad4e-9141c676839e {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:13:44 user nova-compute[73572]: WARNING nova.compute.manager [req-0947eb1a-a05d-49a2-9aaf-0da0f31b78ca req-ae748a44-c705-434e-b076-d6bd7160ed0f service nova] [instance: 83670c16-3566-4679-8e74-c6451c840315] Received unexpected event network-vif-plugged-7b7b7362-9dcc-48da-ad4e-9141c676839e for instance with vm_state active and task_state None.
Aug 26 10:13:44 user nova-compute[73572]: DEBUG nova.compute.manager [req-0947eb1a-a05d-49a2-9aaf-0da0f31b78ca req-ae748a44-c705-434e-b076-d6bd7160ed0f service nova] [instance: d2a731d2-13ff-49e5-ab17-80686b622df7] Received event network-changed-a07bf467-f02f-4889-b735-17df0d48853a {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:13:44 user nova-compute[73572]: DEBUG nova.compute.manager [req-0947eb1a-a05d-49a2-9aaf-0da0f31b78ca req-ae748a44-c705-434e-b076-d6bd7160ed0f service nova] [instance: d2a731d2-13ff-49e5-ab17-80686b622df7] Refreshing instance network info cache due to event network-changed-a07bf467-f02f-4889-b735-17df0d48853a. {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 10:13:44 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-0947eb1a-a05d-49a2-9aaf-0da0f31b78ca req-ae748a44-c705-434e-b076-d6bd7160ed0f service nova] Acquiring lock "refresh_cache-d2a731d2-13ff-49e5-ab17-80686b622df7" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:13:44 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-0947eb1a-a05d-49a2-9aaf-0da0f31b78ca req-ae748a44-c705-434e-b076-d6bd7160ed0f service nova] Acquired lock "refresh_cache-d2a731d2-13ff-49e5-ab17-80686b622df7" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:13:44 user nova-compute[73572]: DEBUG nova.network.neutron [req-0947eb1a-a05d-49a2-9aaf-0da0f31b78ca req-ae748a44-c705-434e-b076-d6bd7160ed0f service nova] [instance: d2a731d2-13ff-49e5-ab17-80686b622df7] Refreshing network info cache for port a07bf467-f02f-4889-b735-17df0d48853a {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 10:13:44 user nova-compute[73572]: DEBUG nova.network.neutron [req-0947eb1a-a05d-49a2-9aaf-0da0f31b78ca req-ae748a44-c705-434e-b076-d6bd7160ed0f service nova] [instance: d2a731d2-13ff-49e5-ab17-80686b622df7] Updated VIF entry in instance network info cache for port a07bf467-f02f-4889-b735-17df0d48853a. {{(pid=73572) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 10:13:44 user nova-compute[73572]: DEBUG nova.network.neutron [req-0947eb1a-a05d-49a2-9aaf-0da0f31b78ca req-ae748a44-c705-434e-b076-d6bd7160ed0f service nova] [instance: d2a731d2-13ff-49e5-ab17-80686b622df7] Updating instance_info_cache with network_info: [{"id": "a07bf467-f02f-4889-b735-17df0d48853a", "address": "fa:16:3e:2d:a2:9f", "network": {"id": "6881a14a-a8c8-47da-a205-a4958693640c", "bridge": "br-int", "label": "tempest-TestVolumeSwap-627208954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "093a28613113447b87f3785c80906ba2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa07bf467-f0", "ovs_interfaceid": "a07bf467-f02f-4889-b735-17df0d48853a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:13:44 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-0947eb1a-a05d-49a2-9aaf-0da0f31b78ca req-ae748a44-c705-434e-b076-d6bd7160ed0f service nova] Releasing lock "refresh_cache-d2a731d2-13ff-49e5-ab17-80686b622df7" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:13:45 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a42577c3-0465-4841-9c9c-00e87be5ed62 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] [instance: 61b60a19-597e-4dc1-af0f-a0ec95e9fd24] Calling os-brick to attach iSCSI Volume {{(pid=73572) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 10:13:45 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-a42577c3-0465-4841-9c9c-00e87be5ed62 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc89c3d6a10>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:1a37188c-85bf-435f-bc57-e7170c7158ea'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TMCgFywt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 10:13:45 user nova-compute[73572]: WARNING os_brick.initiator.connectors.base [None req-a42577c3-0465-4841-9c9c-00e87be5ed62 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 10:13:45 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-a42577c3-0465-4841-9c9c-00e87be5ed62 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 10:13:45 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-a42577c3-0465-4841-9c9c-00e87be5ed62 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 10:13:45 user nova-compute[73572]: WARNING os_brick.initiator.connectors.base [None req-a42577c3-0465-4841-9c9c-00e87be5ed62 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 10:13:45 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-a42577c3-0465-4841-9c9c-00e87be5ed62 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1a37188c-85bf-435f-bc57-e7170c7158ea" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 10:13:45 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-a42577c3-0465-4841-9c9c-00e87be5ed62 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1a37188c-85bf-435f-bc57-e7170c7158ea" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 10:13:45 user nova-compute[73572]: INFO os_brick.initiator.connectors.iscsi [None req-a42577c3-0465-4841-9c9c-00e87be5ed62 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 10:13:45 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a37188c-85bf-435f-bc57-e7170c7158ea -p 172.16.0.220:3260 {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:13:45 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a37188c-85bf-435f-bc57-e7170c7158ea -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:13:45 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fc02991-ca1e-4d64-a5cd-1d85a5d1d9bb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:13:45 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-a42577c3-0465-4841-9c9c-00e87be5ed62 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 10:13:45 user nova-compute[73572]:  {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:13:45 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a37188c-85bf-435f-bc57-e7170c7158ea -p 172.16.0.220:3260 --interface default --op new {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:13:45 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a37188c-85bf-435f-bc57-e7170c7158ea -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:13:45 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[f717c000-eac5-4d4e-a3dc-e00e7d27e733]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1a37188c-85bf-435f-bc57-e7170c7158ea] added\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:13:45 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-a42577c3-0465-4841-9c9c-00e87be5ed62 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1a37188c-85bf-435f-bc57-e7170c7158ea] added
Aug 26 10:13:45 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:13:45 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a37188c-85bf-435f-bc57-e7170c7158ea -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:13:45 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a37188c-85bf-435f-bc57-e7170c7158ea -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:13:45 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7da1653-987c-4f24-b2b0-986281042322]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:13:45 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-a42577c3-0465-4841-9c9c-00e87be5ed62 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:13:45 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a37188c-85bf-435f-bc57-e7170c7158ea -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:13:45 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a37188c-85bf-435f-bc57-e7170c7158ea -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:13:45 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e391eb6-f362-4982-ae0d-f00099ea87df]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:13:45 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-a42577c3-0465-4841-9c9c-00e87be5ed62 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:13:45 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a37188c-85bf-435f-bc57-e7170c7158ea -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TMCgFywt {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:13:45 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a37188c-85bf-435f-bc57-e7170c7158ea -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TMCgFywt" returned: 0 in 0.029s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:13:45 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c94a95e-a3c0-47a7-a11f-6c1fa7f945cf]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:13:45 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-a42577c3-0465-4841-9c9c-00e87be5ed62 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TMCgFywt'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:13:45 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a37188c-85bf-435f-bc57-e7170c7158ea -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:13:45 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a37188c-85bf-435f-bc57-e7170c7158ea -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:13:45 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8df2ba5-3be8-4249-8760-e1345372c06f]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:13:45 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-a42577c3-0465-4841-9c9c-00e87be5ed62 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:13:45 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:13:45 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:13:45 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe81f40b-7a52-4d06-9893-02a88369af48]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09ba694f-cb2a-4600-abe9-924b41292479 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85988ff4-7fac-4a96-a502-74d6ca8189fe (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75ebe4c4-f791-4f09-a9bd-747ade3d70a3 (non-flash)\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:13:45 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-a42577c3-0465-4841-9c9c-00e87be5ed62 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09ba694f-cb2a-4600-abe9-924b41292479 (non-flash)
Aug 26 10:13:45 user nova-compute[73572]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85988ff4-7fac-4a96-a502-74d6ca8189fe (non-flash)
Aug 26 10:13:45 user nova-compute[73572]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75ebe4c4-f791-4f09-a9bd-747ade3d70a3 (non-flash)
Aug 26 10:13:45 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 10:13:45 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-a42577c3-0465-4841-9c9c-00e87be5ed62 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09ba694f-cb2a-4600-abe9-924b41292479 (non-flash)
Aug 26 10:13:45 user nova-compute[73572]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85988ff4-7fac-4a96-a502-74d6ca8189fe (non-flash)
Aug 26 10:13:45 user nova-compute[73572]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75ebe4c4-f791-4f09-a9bd-747ade3d70a3 (non-flash)
Aug 26 10:13:45 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 10:13:45 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a37188c-85bf-435f-bc57-e7170c7158ea -p 172.16.0.220:3260 --login {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:13:45 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-dcb82f90-fbb9-4343-a3ba-3e46101f6f7c tempest-TestVolumeSwap-1919204229 tempest-TestVolumeSwap-1919204229-project-member] Acquiring lock "d2a731d2-13ff-49e5-ab17-80686b622df7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:13:45 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-dcb82f90-fbb9-4343-a3ba-3e46101f6f7c tempest-TestVolumeSwap-1919204229 tempest-TestVolumeSwap-1919204229-project-member] Lock "d2a731d2-13ff-49e5-ab17-80686b622df7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:13:45 user nova-compute[73572]: DEBUG nova.objects.instance [None req-dcb82f90-fbb9-4343-a3ba-3e46101f6f7c tempest-TestVolumeSwap-1919204229 tempest-TestVolumeSwap-1919204229-project-member] Lazy-loading 'flavor' on Instance uuid d2a731d2-13ff-49e5-ab17-80686b622df7 {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:13:45 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a37188c-85bf-435f-bc57-e7170c7158ea -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:13:45 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[4189a712-fe18-4b58-8dca-5e10b4ca78c9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1a37188c-85bf-435f-bc57-e7170c7158ea, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1a37188c-85bf-435f-bc57-e7170c7158ea, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:13:45 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-a42577c3-0465-4841-9c9c-00e87be5ed62 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1a37188c-85bf-435f-bc57-e7170c7158ea, portal: 172.16.0.220,3260]
Aug 26 10:13:45 user nova-compute[73572]: Login to [iface: default, target: iqn.2010-10.org.openstack:1a37188c-85bf-435f-bc57-e7170c7158ea, portal: 172.16.0.220,3260] successful.
Aug 26 10:13:45 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:13:46 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a37188c-85bf-435f-bc57-e7170c7158ea -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:13:46 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-dcb82f90-fbb9-4343-a3ba-3e46101f6f7c tempest-TestVolumeSwap-1919204229 tempest-TestVolumeSwap-1919204229-project-member] Lock "d2a731d2-13ff-49e5-ab17-80686b622df7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:13:46 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a37188c-85bf-435f-bc57-e7170c7158ea -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:13:46 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[725e784b-9f99-4b35-a37a-7cf3c9bd0825]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:13:46 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-a42577c3-0465-4841-9c9c-00e87be5ed62 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:13:46 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:13:46 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:13:46 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a12fc84-614d-4d46-a38d-37fe351f38e8]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09ba694f-cb2a-4600-abe9-924b41292479 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85988ff4-7fac-4a96-a502-74d6ca8189fe (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75ebe4c4-f791-4f09-a9bd-747ade3d70a3 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a37188c-85bf-435f-bc57-e7170c7158ea (non-flash)\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:13:46 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-a42577c3-0465-4841-9c9c-00e87be5ed62 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09ba694f-cb2a-4600-abe9-924b41292479 (non-flash)
Aug 26 10:13:46 user nova-compute[73572]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85988ff4-7fac-4a96-a502-74d6ca8189fe (non-flash)
Aug 26 10:13:46 user nova-compute[73572]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75ebe4c4-f791-4f09-a9bd-747ade3d70a3 (non-flash)
Aug 26 10:13:46 user nova-compute[73572]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a37188c-85bf-435f-bc57-e7170c7158ea (non-flash)
Aug 26 10:13:46 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 10:13:46 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-a42577c3-0465-4841-9c9c-00e87be5ed62 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09ba694f-cb2a-4600-abe9-924b41292479 (non-flash)
Aug 26 10:13:46 user nova-compute[73572]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85988ff4-7fac-4a96-a502-74d6ca8189fe (non-flash)
Aug 26 10:13:46 user nova-compute[73572]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75ebe4c4-f791-4f09-a9bd-747ade3d70a3 (non-flash)
Aug 26 10:13:46 user nova-compute[73572]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a37188c-85bf-435f-bc57-e7170c7158ea (non-flash)
Aug 26 10:13:46 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 10:13:46 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-a42577c3-0465-4841-9c9c-00e87be5ed62 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1a37188c-85bf-435f-bc57-e7170c7158ea" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.327s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 10:13:46 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-a42577c3-0465-4841-9c9c-00e87be5ed62 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] Connected to 172.16.0.220:3260 {{(pid=73572) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 10:13:46 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-a42577c3-0465-4841-9c9c-00e87be5ed62 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] HCTL ('36', '-', '-', 0) found on session 5 with lun 0 {{(pid=73572) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 10:13:46 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-a42577c3-0465-4841-9c9c-00e87be5ed62 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73572) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 10:13:46 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:13:46 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.056s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:13:46 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[02e852c4-9d48-4065-81a6-8ccc959a3619]: (4, ('- - 0', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:13:46 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-a42577c3-0465-4841-9c9c-00e87be5ed62 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73572) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 10:13:46 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-a42577c3-0465-4841-9c9c-00e87be5ed62 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TMCgFywt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73572) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 10:13:46 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-dcb82f90-fbb9-4343-a3ba-3e46101f6f7c tempest-TestVolumeSwap-1919204229 tempest-TestVolumeSwap-1919204229-project-member] Acquiring lock "d2a731d2-13ff-49e5-ab17-80686b622df7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:13:46 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-dcb82f90-fbb9-4343-a3ba-3e46101f6f7c tempest-TestVolumeSwap-1919204229 tempest-TestVolumeSwap-1919204229-project-member] Lock "d2a731d2-13ff-49e5-ab17-80686b622df7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:13:46 user nova-compute[73572]: INFO nova.compute.manager [None req-dcb82f90-fbb9-4343-a3ba-3e46101f6f7c tempest-TestVolumeSwap-1919204229 tempest-TestVolumeSwap-1919204229-project-member] [instance: d2a731d2-13ff-49e5-ab17-80686b622df7] Attaching volume 9a00bb86-2eab-48d3-afc5-20fdd62650ae to /dev/vdb
Aug 26 10:13:46 user nova-compute[73572]: DEBUG os_brick.utils [None req-dcb82f90-fbb9-4343-a3ba-3e46101f6f7c tempest-TestVolumeSwap-1919204229 tempest-TestVolumeSwap-1919204229-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 10:13:46 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:13:46 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:13:46 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[99962339-c924-4c9c-841f-bd6763dfb57b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:de8a79ed912\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:13:46 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:13:46 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:13:46 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fcfc602-10fb-4874-ba06-a11bfa38895b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:13:46 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:13:46 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:13:46 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[d43ac243-7671-49a6-a468-fe1968188d9c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:13:46 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[83139188-eda5-4d71-a3fb-5fd4007a9797]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:13:46 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-dcb82f90-fbb9-4343-a3ba-3e46101f6f7c tempest-TestVolumeSwap-1919204229 tempest-TestVolumeSwap-1919204229-project-member] Running cmd (subprocess): nvme version {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:13:46 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-dcb82f90-fbb9-4343-a3ba-3e46101f6f7c tempest-TestVolumeSwap-1919204229 tempest-TestVolumeSwap-1919204229-project-member] 'nvme version' failed. Not Retrying. {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 10:13:46 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.nvmeof [None req-dcb82f90-fbb9-4343-a3ba-3e46101f6f7c tempest-TestVolumeSwap-1919204229 tempest-TestVolumeSwap-1919204229-project-member] nvme not present on system {{(pid=73572) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 10:13:46 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:13:46 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 10:13:46 user nova-compute[73572]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 10:13:46 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cfa52ca-e023-4656-8dbf-825a5927e693]: (4, '') {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:13:46 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.lightos [None req-dcb82f90-fbb9-4343-a3ba-3e46101f6f7c tempest-TestVolumeSwap-1919204229 tempest-TestVolumeSwap-1919204229-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73572) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 10:13:46 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.lightos [None req-dcb82f90-fbb9-4343-a3ba-3e46101f6f7c tempest-TestVolumeSwap-1919204229 tempest-TestVolumeSwap-1919204229-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73572) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 10:13:46 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.lightos [None req-dcb82f90-fbb9-4343-a3ba-3e46101f6f7c tempest-TestVolumeSwap-1919204229 tempest-TestVolumeSwap-1919204229-project-member] LIGHTOS: no hostnqn found. {{(pid=73572) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 10:13:46 user nova-compute[73572]: DEBUG os_brick.utils [None req-dcb82f90-fbb9-4343-a3ba-3e46101f6f7c tempest-TestVolumeSwap-1919204229 tempest-TestVolumeSwap-1919204229-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:de8a79ed912', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 10:13:46 user nova-compute[73572]: DEBUG nova.virt.block_device [None req-dcb82f90-fbb9-4343-a3ba-3e46101f6f7c tempest-TestVolumeSwap-1919204229 tempest-TestVolumeSwap-1919204229-project-member] [instance: d2a731d2-13ff-49e5-ab17-80686b622df7] Updating existing volume attachment record: e076ae3f-e364-4703-ab78-5b2239c5f353 {{(pid=73572) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 10:13:47 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-a42577c3-0465-4841-9c9c-00e87be5ed62 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.403s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 10:13:47 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-a42577c3-0465-4841-9c9c-00e87be5ed62 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] <== connect_volume: return (1405ms) {'type': 'block', 'scsi_wwn': '23462636661613661', 'path': '/dev/sde'} {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 10:13:47 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a42577c3-0465-4841-9c9c-00e87be5ed62 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] [instance: 61b60a19-597e-4dc1-af0f-a0ec95e9fd24] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23462636661613661', 'path': '/dev/sde'} {{(pid=73572) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 10:13:47 user nova-compute[73572]: DEBUG nova.objects.instance [None req-a42577c3-0465-4841-9c9c-00e87be5ed62 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] Lazy-loading 'flavor' on Instance uuid 61b60a19-597e-4dc1-af0f-a0ec95e9fd24 {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:13:47 user nova-compute[73572]: DEBUG nova.virt.libvirt.guest [None req-a42577c3-0465-4841-9c9c-00e87be5ed62 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 10:13:47 user nova-compute[73572]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 10:13:47 user nova-compute[73572]:   <source dev="/dev/sde"/>
Aug 26 10:13:47 user nova-compute[73572]:   <target dev="vdb" bus="virtio"/>
Aug 26 10:13:47 user nova-compute[73572]:   <serial>1a37188c-85bf-435f-bc57-e7170c7158ea</serial>
Aug 26 10:13:47 user nova-compute[73572]: </disk>
Aug 26 10:13:47 user nova-compute[73572]:  {{(pid=73572) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 10:13:47 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:13:47 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-a42577c3-0465-4841-9c9c-00e87be5ed62 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] No BDM found with device name vda, not building metadata. {{(pid=73572) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 10:13:47 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-a42577c3-0465-4841-9c9c-00e87be5ed62 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73572) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 10:13:47 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-a42577c3-0465-4841-9c9c-00e87be5ed62 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] No VIF found with MAC fa:16:3e:46:77:5d, not building metadata {{(pid=73572) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 10:13:48 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:13:51 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3e98968b-f363-46d7-a0c6-45ab779dde1f tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] [instance: 8ee427dc-7aa0-4435-b23c-1223f2881df7] Calling os-brick to attach iSCSI Volume {{(pid=73572) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 10:13:51 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e98968b-f363-46d7-a0c6-45ab779dde1f tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc89c3d6a10>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:c5be97e0-c3f1-4751-a0d7-32e45c899c06'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LqhoRQHy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 10:13:51 user nova-compute[73572]: WARNING os_brick.initiator.connectors.base [None req-3e98968b-f363-46d7-a0c6-45ab779dde1f tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 10:13:51 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-3e98968b-f363-46d7-a0c6-45ab779dde1f tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 10:13:51 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-3e98968b-f363-46d7-a0c6-45ab779dde1f tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 10:13:51 user nova-compute[73572]: WARNING os_brick.initiator.connectors.base [None req-3e98968b-f363-46d7-a0c6-45ab779dde1f tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 10:13:51 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-3e98968b-f363-46d7-a0c6-45ab779dde1f tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c5be97e0-c3f1-4751-a0d7-32e45c899c06" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 10:13:51 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-3e98968b-f363-46d7-a0c6-45ab779dde1f tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c5be97e0-c3f1-4751-a0d7-32e45c899c06" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 10:13:51 user nova-compute[73572]: INFO os_brick.initiator.connectors.iscsi [None req-3e98968b-f363-46d7-a0c6-45ab779dde1f tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 10:13:51 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5be97e0-c3f1-4751-a0d7-32e45c899c06 -p 172.16.0.220:3260 {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:13:51 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5be97e0-c3f1-4751-a0d7-32e45c899c06 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:13:51 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[2470303d-53df-4483-8169-69f6db8c0b89]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:13:51 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e98968b-f363-46d7-a0c6-45ab779dde1f tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 10:13:51 user nova-compute[73572]:  {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:13:51 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5be97e0-c3f1-4751-a0d7-32e45c899c06 -p 172.16.0.220:3260 --interface default --op new {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:13:51 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5be97e0-c3f1-4751-a0d7-32e45c899c06 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:13:51 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[a51d7ae0-0d54-438f-a6fc-73ee96f3f21f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c5be97e0-c3f1-4751-a0d7-32e45c899c06] added\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:13:51 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e98968b-f363-46d7-a0c6-45ab779dde1f tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c5be97e0-c3f1-4751-a0d7-32e45c899c06] added
Aug 26 10:13:51 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:13:51 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5be97e0-c3f1-4751-a0d7-32e45c899c06 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:13:51 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5be97e0-c3f1-4751-a0d7-32e45c899c06 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:13:51 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0da587a-d10d-4c2a-bc23-525ec09a7b31]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:13:51 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e98968b-f363-46d7-a0c6-45ab779dde1f tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:13:51 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5be97e0-c3f1-4751-a0d7-32e45c899c06 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:13:51 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5be97e0-c3f1-4751-a0d7-32e45c899c06 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:13:51 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[126b615b-073d-46e4-b02c-0cc9cc453498]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:13:51 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e98968b-f363-46d7-a0c6-45ab779dde1f tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:13:51 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5be97e0-c3f1-4751-a0d7-32e45c899c06 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LqhoRQHy {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:13:51 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5be97e0-c3f1-4751-a0d7-32e45c899c06 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LqhoRQHy" returned: 0 in 0.023s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:13:51 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[40c76bf7-4d3c-4100-9ceb-9fa70ca789a3]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:13:51 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e98968b-f363-46d7-a0c6-45ab779dde1f tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LqhoRQHy'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:13:51 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5be97e0-c3f1-4751-a0d7-32e45c899c06 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:13:51 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5be97e0-c3f1-4751-a0d7-32e45c899c06 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:13:51 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b16c321-f8a0-4171-8455-3af519933f38]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:13:51 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e98968b-f363-46d7-a0c6-45ab779dde1f tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:13:51 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:13:51 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:13:51 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b98b456-0d90-4ed5-bf40-e52ebef5e07b]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09ba694f-cb2a-4600-abe9-924b41292479 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85988ff4-7fac-4a96-a502-74d6ca8189fe (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75ebe4c4-f791-4f09-a9bd-747ade3d70a3 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a37188c-85bf-435f-bc57-e7170c7158ea (non-flash)\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:13:51 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e98968b-f363-46d7-a0c6-45ab779dde1f tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09ba694f-cb2a-4600-abe9-924b41292479 (non-flash)
Aug 26 10:13:51 user nova-compute[73572]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85988ff4-7fac-4a96-a502-74d6ca8189fe (non-flash)
Aug 26 10:13:51 user nova-compute[73572]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75ebe4c4-f791-4f09-a9bd-747ade3d70a3 (non-flash)
Aug 26 10:13:51 user nova-compute[73572]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a37188c-85bf-435f-bc57-e7170c7158ea (non-flash)
Aug 26 10:13:51 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 10:13:51 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e98968b-f363-46d7-a0c6-45ab779dde1f tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09ba694f-cb2a-4600-abe9-924b41292479 (non-flash)
Aug 26 10:13:51 user nova-compute[73572]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85988ff4-7fac-4a96-a502-74d6ca8189fe (non-flash)
Aug 26 10:13:51 user nova-compute[73572]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75ebe4c4-f791-4f09-a9bd-747ade3d70a3 (non-flash)
Aug 26 10:13:51 user nova-compute[73572]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a37188c-85bf-435f-bc57-e7170c7158ea (non-flash)
Aug 26 10:13:51 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 10:13:51 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5be97e0-c3f1-4751-a0d7-32e45c899c06 -p 172.16.0.220:3260 --login {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:13:51 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5be97e0-c3f1-4751-a0d7-32e45c899c06 -p 172.16.0.220:3260 --login" returned: 0 in 0.087s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:13:51 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[d89517b2-5f01-4174-9267-78eeb62d6edd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c5be97e0-c3f1-4751-a0d7-32e45c899c06, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c5be97e0-c3f1-4751-a0d7-32e45c899c06, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:13:51 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e98968b-f363-46d7-a0c6-45ab779dde1f tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c5be97e0-c3f1-4751-a0d7-32e45c899c06, portal: 172.16.0.220,3260]
Aug 26 10:13:51 user nova-compute[73572]: Login to [iface: default, target: iqn.2010-10.org.openstack:c5be97e0-c3f1-4751-a0d7-32e45c899c06, portal: 172.16.0.220,3260] successful.
Aug 26 10:13:51 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:13:51 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5be97e0-c3f1-4751-a0d7-32e45c899c06 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:13:51 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5be97e0-c3f1-4751-a0d7-32e45c899c06 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:13:51 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cd00bef-c90a-4a2a-95f1-6cd52661b6e5]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:13:51 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e98968b-f363-46d7-a0c6-45ab779dde1f tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:13:51 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:13:51 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:13:51 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d7f17a7-eeef-4efa-9108-e19d291901d4]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09ba694f-cb2a-4600-abe9-924b41292479 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85988ff4-7fac-4a96-a502-74d6ca8189fe (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75ebe4c4-f791-4f09-a9bd-747ade3d70a3 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a37188c-85bf-435f-bc57-e7170c7158ea (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5be97e0-c3f1-4751-a0d7-32e45c899c06 (non-flash)\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:13:51 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e98968b-f363-46d7-a0c6-45ab779dde1f tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09ba694f-cb2a-4600-abe9-924b41292479 (non-flash)
Aug 26 10:13:51 user nova-compute[73572]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85988ff4-7fac-4a96-a502-74d6ca8189fe (non-flash)
Aug 26 10:13:51 user nova-compute[73572]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75ebe4c4-f791-4f09-a9bd-747ade3d70a3 (non-flash)
Aug 26 10:13:51 user nova-compute[73572]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a37188c-85bf-435f-bc57-e7170c7158ea (non-flash)
Aug 26 10:13:51 user nova-compute[73572]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5be97e0-c3f1-4751-a0d7-32e45c899c06 (non-flash)
Aug 26 10:13:51 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 10:13:51 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e98968b-f363-46d7-a0c6-45ab779dde1f tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09ba694f-cb2a-4600-abe9-924b41292479 (non-flash)
Aug 26 10:13:51 user nova-compute[73572]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85988ff4-7fac-4a96-a502-74d6ca8189fe (non-flash)
Aug 26 10:13:51 user nova-compute[73572]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75ebe4c4-f791-4f09-a9bd-747ade3d70a3 (non-flash)
Aug 26 10:13:51 user nova-compute[73572]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a37188c-85bf-435f-bc57-e7170c7158ea (non-flash)
Aug 26 10:13:51 user nova-compute[73572]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5be97e0-c3f1-4751-a0d7-32e45c899c06 (non-flash)
Aug 26 10:13:51 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 10:13:51 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-3e98968b-f363-46d7-a0c6-45ab779dde1f tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c5be97e0-c3f1-4751-a0d7-32e45c899c06" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.330s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 10:13:51 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e98968b-f363-46d7-a0c6-45ab779dde1f tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] Connected to 172.16.0.220:3260 {{(pid=73572) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 10:13:51 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-3e98968b-f363-46d7-a0c6-45ab779dde1f tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] HCTL ('37', '-', '-', 0) found on session 6 with lun 0 {{(pid=73572) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 10:13:51 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-3e98968b-f363-46d7-a0c6-45ab779dde1f tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=73572) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 10:13:51 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:13:51 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.018s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:13:51 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[14578d5f-dd29-4ef4-9139-b190f23f956a]: (4, ('- - 0', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:13:51 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-3e98968b-f363-46d7-a0c6-45ab779dde1f tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] Searching for a device in session 6 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=73572) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 10:13:51 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e98968b-f363-46d7-a0c6-45ab779dde1f tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LqhoRQHy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73572) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 10:13:51 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-a42577c3-0465-4841-9c9c-00e87be5ed62 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] Lock "61b60a19-597e-4dc1-af0f-a0ec95e9fd24" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 37.425s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:13:52 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:13:52 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-3e98968b-f363-46d7-a0c6-45ab779dde1f tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.373s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 10:13:52 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e98968b-f363-46d7-a0c6-45ab779dde1f tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] <== connect_volume: return (1375ms) {'type': 'block', 'scsi_wwn': '26630353063393137', 'path': '/dev/sdf'} {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 10:13:52 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3e98968b-f363-46d7-a0c6-45ab779dde1f tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] [instance: 8ee427dc-7aa0-4435-b23c-1223f2881df7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26630353063393137', 'path': '/dev/sdf'} {{(pid=73572) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 10:13:52 user nova-compute[73572]: DEBUG nova.objects.instance [None req-3e98968b-f363-46d7-a0c6-45ab779dde1f tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] Lazy-loading 'flavor' on Instance uuid 8ee427dc-7aa0-4435-b23c-1223f2881df7 {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:13:52 user nova-compute[73572]: DEBUG nova.virt.libvirt.guest [None req-3e98968b-f363-46d7-a0c6-45ab779dde1f tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 10:13:52 user nova-compute[73572]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 10:13:52 user nova-compute[73572]:   <source dev="/dev/sdf"/>
Aug 26 10:13:52 user nova-compute[73572]:   <target dev="sdc" bus="scsi"/>
Aug 26 10:13:52 user nova-compute[73572]:   <serial>c5be97e0-c3f1-4751-a0d7-32e45c899c06</serial>
Aug 26 10:13:52 user nova-compute[73572]:   <address type="drive" controller="0" unit="2"/>
Aug 26 10:13:52 user nova-compute[73572]: </disk>
Aug 26 10:13:52 user nova-compute[73572]:  {{(pid=73572) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 10:13:52 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-f8a0b07c-b6cd-493a-b775-9ada92dc0410 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] Acquiring lock "61b60a19-597e-4dc1-af0f-a0ec95e9fd24" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:13:52 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-f8a0b07c-b6cd-493a-b775-9ada92dc0410 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] Lock "61b60a19-597e-4dc1-af0f-a0ec95e9fd24" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:13:52 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-f8a0b07c-b6cd-493a-b775-9ada92dc0410 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] Acquiring lock "61b60a19-597e-4dc1-af0f-a0ec95e9fd24-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:13:52 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-f8a0b07c-b6cd-493a-b775-9ada92dc0410 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] Lock "61b60a19-597e-4dc1-af0f-a0ec95e9fd24-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:13:52 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-f8a0b07c-b6cd-493a-b775-9ada92dc0410 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] Lock "61b60a19-597e-4dc1-af0f-a0ec95e9fd24-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:13:52 user nova-compute[73572]: INFO nova.compute.manager [None req-f8a0b07c-b6cd-493a-b775-9ada92dc0410 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] [instance: 61b60a19-597e-4dc1-af0f-a0ec95e9fd24] Terminating instance
Aug 26 10:13:52 user nova-compute[73572]: DEBUG nova.compute.manager [None req-f8a0b07c-b6cd-493a-b775-9ada92dc0410 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] [instance: 61b60a19-597e-4dc1-af0f-a0ec95e9fd24] Start destroying the instance on the hypervisor. {{(pid=73572) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 10:13:52 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:13:52 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:13:52 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:13:52 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:13:52 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c43f8196-cf94-4074-8d29-80d70ddfda3e tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] [instance: ee9bcbaa-25a6-4588-b757-2a2ae15b6cf8] Calling os-brick to attach iSCSI Volume {{(pid=73572) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 10:13:52 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-c43f8196-cf94-4074-8d29-80d70ddfda3e tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc89c3d6a10>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:99c74791-0bdd-4261-a580-f456f29cbadb'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DgXUbqiC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 10:13:52 user nova-compute[73572]: WARNING os_brick.initiator.connectors.base [None req-c43f8196-cf94-4074-8d29-80d70ddfda3e tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 10:13:52 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-c43f8196-cf94-4074-8d29-80d70ddfda3e tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 10:13:52 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-c43f8196-cf94-4074-8d29-80d70ddfda3e tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 10:13:52 user nova-compute[73572]: WARNING os_brick.initiator.connectors.base [None req-c43f8196-cf94-4074-8d29-80d70ddfda3e tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 10:13:52 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-c43f8196-cf94-4074-8d29-80d70ddfda3e tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:99c74791-0bdd-4261-a580-f456f29cbadb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 10:13:52 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-c43f8196-cf94-4074-8d29-80d70ddfda3e tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:99c74791-0bdd-4261-a580-f456f29cbadb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 10:13:52 user nova-compute[73572]: INFO os_brick.initiator.connectors.iscsi [None req-c43f8196-cf94-4074-8d29-80d70ddfda3e tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 10:13:52 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99c74791-0bdd-4261-a580-f456f29cbadb -p 172.16.0.220:3260 {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:13:53 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99c74791-0bdd-4261-a580-f456f29cbadb -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:13:53 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b50f07a-7682-449a-9a7a-263398287c6d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:13:53 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-c43f8196-cf94-4074-8d29-80d70ddfda3e tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 10:13:53 user nova-compute[73572]:  {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:13:53 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99c74791-0bdd-4261-a580-f456f29cbadb -p 172.16.0.220:3260 --interface default --op new {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:13:53 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99c74791-0bdd-4261-a580-f456f29cbadb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:13:53 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[f279fb52-52f0-47cb-a1b2-b2a05575d2b6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:99c74791-0bdd-4261-a580-f456f29cbadb] added\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:13:53 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-c43f8196-cf94-4074-8d29-80d70ddfda3e tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:99c74791-0bdd-4261-a580-f456f29cbadb] added
Aug 26 10:13:53 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:13:53 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99c74791-0bdd-4261-a580-f456f29cbadb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:13:53 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99c74791-0bdd-4261-a580-f456f29cbadb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:13:53 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[5383b5d1-bcd9-418a-808d-2a2f70003e23]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:13:53 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-c43f8196-cf94-4074-8d29-80d70ddfda3e tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:13:53 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99c74791-0bdd-4261-a580-f456f29cbadb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:13:53 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99c74791-0bdd-4261-a580-f456f29cbadb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:13:53 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[101dec99-7557-436f-815c-f8ee98747abb]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:13:53 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-c43f8196-cf94-4074-8d29-80d70ddfda3e tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:13:53 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99c74791-0bdd-4261-a580-f456f29cbadb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DgXUbqiC {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:13:53 user nova-compute[73572]: DEBUG nova.compute.manager [req-aacbd59a-fb79-47c4-ba28-14bf5210416f req-3173759f-86bf-4da1-8f05-82d09711b5d7 service nova] [instance: 61b60a19-597e-4dc1-af0f-a0ec95e9fd24] Received event network-vif-unplugged-f846939c-c22d-4e0c-9237-404eabf0abd4 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:13:53 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-aacbd59a-fb79-47c4-ba28-14bf5210416f req-3173759f-86bf-4da1-8f05-82d09711b5d7 service nova] Acquiring lock "61b60a19-597e-4dc1-af0f-a0ec95e9fd24-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:13:53 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-aacbd59a-fb79-47c4-ba28-14bf5210416f req-3173759f-86bf-4da1-8f05-82d09711b5d7 service nova] Lock "61b60a19-597e-4dc1-af0f-a0ec95e9fd24-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:13:53 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-aacbd59a-fb79-47c4-ba28-14bf5210416f req-3173759f-86bf-4da1-8f05-82d09711b5d7 service nova] Lock "61b60a19-597e-4dc1-af0f-a0ec95e9fd24-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:13:53 user nova-compute[73572]: DEBUG nova.compute.manager [req-aacbd59a-fb79-47c4-ba28-14bf5210416f req-3173759f-86bf-4da1-8f05-82d09711b5d7 service nova] [instance: 61b60a19-597e-4dc1-af0f-a0ec95e9fd24] No waiting events found dispatching network-vif-unplugged-f846939c-c22d-4e0c-9237-404eabf0abd4 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:13:53 user nova-compute[73572]: DEBUG nova.compute.manager [req-aacbd59a-fb79-47c4-ba28-14bf5210416f req-3173759f-86bf-4da1-8f05-82d09711b5d7 service nova] [instance: 61b60a19-597e-4dc1-af0f-a0ec95e9fd24] Received event network-vif-unplugged-f846939c-c22d-4e0c-9237-404eabf0abd4 for instance with task_state deleting. {{(pid=73572) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 10:13:53 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-3e98968b-f363-46d7-a0c6-45ab779dde1f tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] No BDM found with device name sda, not building metadata. {{(pid=73572) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 10:13:53 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-3e98968b-f363-46d7-a0c6-45ab779dde1f tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] No BDM found with device name sdb, not building metadata. {{(pid=73572) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 10:13:53 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-3e98968b-f363-46d7-a0c6-45ab779dde1f tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] No BDM found with device name sdc, not building metadata. {{(pid=73572) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 10:13:53 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-3e98968b-f363-46d7-a0c6-45ab779dde1f tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] No VIF found with MAC fa:16:3e:07:ab:f2, not building metadata {{(pid=73572) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 10:13:53 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99c74791-0bdd-4261-a580-f456f29cbadb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DgXUbqiC" returned: 0 in 0.022s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:13:53 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[555b6b91-d5ac-42ea-867f-82f556cf59aa]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:13:53 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-c43f8196-cf94-4074-8d29-80d70ddfda3e tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DgXUbqiC'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:13:53 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99c74791-0bdd-4261-a580-f456f29cbadb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:13:53 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99c74791-0bdd-4261-a580-f456f29cbadb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:13:53 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[f74e9598-377d-4d06-8806-17ee421e95d3]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:13:53 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-c43f8196-cf94-4074-8d29-80d70ddfda3e tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:13:53 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:13:53 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:13:53 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[5921f3db-0ec8-4c65-8f06-efffde618c33]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09ba694f-cb2a-4600-abe9-924b41292479 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85988ff4-7fac-4a96-a502-74d6ca8189fe (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75ebe4c4-f791-4f09-a9bd-747ade3d70a3 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a37188c-85bf-435f-bc57-e7170c7158ea (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5be97e0-c3f1-4751-a0d7-32e45c899c06 (non-flash)\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:13:53 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-c43f8196-cf94-4074-8d29-80d70ddfda3e tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09ba694f-cb2a-4600-abe9-924b41292479 (non-flash)
Aug 26 10:13:53 user nova-compute[73572]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85988ff4-7fac-4a96-a502-74d6ca8189fe (non-flash)
Aug 26 10:13:53 user nova-compute[73572]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75ebe4c4-f791-4f09-a9bd-747ade3d70a3 (non-flash)
Aug 26 10:13:53 user nova-compute[73572]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a37188c-85bf-435f-bc57-e7170c7158ea (non-flash)
Aug 26 10:13:53 user nova-compute[73572]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5be97e0-c3f1-4751-a0d7-32e45c899c06 (non-flash)
Aug 26 10:13:53 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 10:13:53 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-c43f8196-cf94-4074-8d29-80d70ddfda3e tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09ba694f-cb2a-4600-abe9-924b41292479 (non-flash)
Aug 26 10:13:53 user nova-compute[73572]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85988ff4-7fac-4a96-a502-74d6ca8189fe (non-flash)
Aug 26 10:13:53 user nova-compute[73572]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75ebe4c4-f791-4f09-a9bd-747ade3d70a3 (non-flash)
Aug 26 10:13:53 user nova-compute[73572]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a37188c-85bf-435f-bc57-e7170c7158ea (non-flash)
Aug 26 10:13:53 user nova-compute[73572]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5be97e0-c3f1-4751-a0d7-32e45c899c06 (non-flash)
Aug 26 10:13:53 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 10:13:53 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99c74791-0bdd-4261-a580-f456f29cbadb -p 172.16.0.220:3260 --login {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:13:53 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-3e98968b-f363-46d7-a0c6-45ab779dde1f tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] Lock "8ee427dc-7aa0-4435-b23c-1223f2881df7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.947s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:13:53 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99c74791-0bdd-4261-a580-f456f29cbadb -p 172.16.0.220:3260 --login" returned: 0 in 0.090s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:13:53 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[449efd73-c451-499f-a33d-661b457c2d98]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:99c74791-0bdd-4261-a580-f456f29cbadb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:99c74791-0bdd-4261-a580-f456f29cbadb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:13:53 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-c43f8196-cf94-4074-8d29-80d70ddfda3e tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:99c74791-0bdd-4261-a580-f456f29cbadb, portal: 172.16.0.220,3260]
Aug 26 10:13:53 user nova-compute[73572]: Login to [iface: default, target: iqn.2010-10.org.openstack:99c74791-0bdd-4261-a580-f456f29cbadb, portal: 172.16.0.220,3260] successful.
Aug 26 10:13:53 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:13:53 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99c74791-0bdd-4261-a580-f456f29cbadb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:13:53 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99c74791-0bdd-4261-a580-f456f29cbadb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:13:53 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[823e3620-ead2-48a6-bd26-37abc6f36b1d]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:13:53 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-c43f8196-cf94-4074-8d29-80d70ddfda3e tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:13:53 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:13:53 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:13:53 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9f037d2-74f4-42ae-b0c1-57a65df18f5b]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09ba694f-cb2a-4600-abe9-924b41292479 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85988ff4-7fac-4a96-a502-74d6ca8189fe (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75ebe4c4-f791-4f09-a9bd-747ade3d70a3 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a37188c-85bf-435f-bc57-e7170c7158ea (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5be97e0-c3f1-4751-a0d7-32e45c899c06 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99c74791-0bdd-4261-a580-f456f29cbadb (non-flash)\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:13:53 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-c43f8196-cf94-4074-8d29-80d70ddfda3e tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09ba694f-cb2a-4600-abe9-924b41292479 (non-flash)
Aug 26 10:13:53 user nova-compute[73572]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85988ff4-7fac-4a96-a502-74d6ca8189fe (non-flash)
Aug 26 10:13:53 user nova-compute[73572]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75ebe4c4-f791-4f09-a9bd-747ade3d70a3 (non-flash)
Aug 26 10:13:53 user nova-compute[73572]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a37188c-85bf-435f-bc57-e7170c7158ea (non-flash)
Aug 26 10:13:53 user nova-compute[73572]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5be97e0-c3f1-4751-a0d7-32e45c899c06 (non-flash)
Aug 26 10:13:53 user nova-compute[73572]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99c74791-0bdd-4261-a580-f456f29cbadb (non-flash)
Aug 26 10:13:53 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 10:13:53 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-c43f8196-cf94-4074-8d29-80d70ddfda3e tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09ba694f-cb2a-4600-abe9-924b41292479 (non-flash)
Aug 26 10:13:53 user nova-compute[73572]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85988ff4-7fac-4a96-a502-74d6ca8189fe (non-flash)
Aug 26 10:13:53 user nova-compute[73572]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75ebe4c4-f791-4f09-a9bd-747ade3d70a3 (non-flash)
Aug 26 10:13:53 user nova-compute[73572]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a37188c-85bf-435f-bc57-e7170c7158ea (non-flash)
Aug 26 10:13:53 user nova-compute[73572]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5be97e0-c3f1-4751-a0d7-32e45c899c06 (non-flash)
Aug 26 10:13:53 user nova-compute[73572]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99c74791-0bdd-4261-a580-f456f29cbadb (non-flash)
Aug 26 10:13:53 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 10:13:53 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-c43f8196-cf94-4074-8d29-80d70ddfda3e tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:99c74791-0bdd-4261-a580-f456f29cbadb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.387s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 10:13:53 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-c43f8196-cf94-4074-8d29-80d70ddfda3e tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] Connected to 172.16.0.220:3260 {{(pid=73572) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 10:13:53 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-c43f8196-cf94-4074-8d29-80d70ddfda3e tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] HCTL ('38', '-', '-', 0) found on session 7 with lun 0 {{(pid=73572) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 10:13:53 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-c43f8196-cf94-4074-8d29-80d70ddfda3e tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=73572) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 10:13:53 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:13:53 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.028s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:13:53 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2a8c992-ac49-4e79-a8f4-ffdf332a0f86]: (4, ('- - 0', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:13:53 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-c43f8196-cf94-4074-8d29-80d70ddfda3e tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] Searching for a device in session 7 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=73572) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 10:13:53 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-c43f8196-cf94-4074-8d29-80d70ddfda3e tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DgXUbqiC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73572) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 10:13:53 user nova-compute[73572]: INFO nova.virt.libvirt.driver [-] [instance: 61b60a19-597e-4dc1-af0f-a0ec95e9fd24] Instance destroyed successfully.
Aug 26 10:13:53 user nova-compute[73572]: DEBUG nova.objects.instance [None req-f8a0b07c-b6cd-493a-b775-9ada92dc0410 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] Lazy-loading 'resources' on Instance uuid 61b60a19-597e-4dc1-af0f-a0ec95e9fd24 {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:13:53 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-f8a0b07c-b6cd-493a-b775-9ada92dc0410 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T10:11:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1967617769',display_name='tempest-DeleteServersTestJSON-server-1967617769',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1967617769',id=1,image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T10:11:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5500e4b0418743abaeca3f853a4908c4',ramdisk_id='',reservation_id='r-hfk0l9n9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-1148500196',owner_user_name='tempest-DeleteServersTestJSON-1148500196-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T10:11:29Z,user_data=None,user_id='5373e9f0d5924f65807259963192e12a',uuid=61b60a19-597e-4dc1-af0f-a0ec95e9fd24,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f846939c-c22d-4e0c-9237-404eabf0abd4", "address": "fa:16:3e:46:77:5d", "network": {"id": "07a1c135-6593-4fe1-8020-305e2596db1d", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1106906776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5500e4b0418743abaeca3f853a4908c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf846939c-c2", "ovs_interfaceid": "f846939c-c22d-4e0c-9237-404eabf0abd4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 10:13:53 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-f8a0b07c-b6cd-493a-b775-9ada92dc0410 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] Converting VIF {"id": "f846939c-c22d-4e0c-9237-404eabf0abd4", "address": "fa:16:3e:46:77:5d", "network": {"id": "07a1c135-6593-4fe1-8020-305e2596db1d", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1106906776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5500e4b0418743abaeca3f853a4908c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf846939c-c2", "ovs_interfaceid": "f846939c-c22d-4e0c-9237-404eabf0abd4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:13:53 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-f8a0b07c-b6cd-493a-b775-9ada92dc0410 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:46:77:5d,bridge_name='br-int',has_traffic_filtering=True,id=f846939c-c22d-4e0c-9237-404eabf0abd4,network=Network(07a1c135-6593-4fe1-8020-305e2596db1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf846939c-c2') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:13:53 user nova-compute[73572]: DEBUG os_vif [None req-f8a0b07c-b6cd-493a-b775-9ada92dc0410 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:46:77:5d,bridge_name='br-int',has_traffic_filtering=True,id=f846939c-c22d-4e0c-9237-404eabf0abd4,network=Network(07a1c135-6593-4fe1-8020-305e2596db1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf846939c-c2') {{(pid=73572) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 10:13:53 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:13:53 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf846939c-c2, bridge=br-int, if_exists=True) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:13:53 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:13:53 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:13:53 user nova-compute[73572]: INFO os_vif [None req-f8a0b07c-b6cd-493a-b775-9ada92dc0410 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:46:77:5d,bridge_name='br-int',has_traffic_filtering=True,id=f846939c-c22d-4e0c-9237-404eabf0abd4,network=Network(07a1c135-6593-4fe1-8020-305e2596db1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf846939c-c2')
Aug 26 10:13:53 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f8a0b07c-b6cd-493a-b775-9ada92dc0410 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] [instance: 61b60a19-597e-4dc1-af0f-a0ec95e9fd24] calling os-brick to detach iSCSI Volume {{(pid=73572) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 10:13:53 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8a0b07c-b6cd-493a-b775-9ada92dc0410 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc89c3d6a10>, {'target_iqns': ['iqn.2010-10.org.openstack:1a37188c-85bf-435f-bc57-e7170c7158ea'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TMCgFywt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 10:13:53 user nova-compute[73572]: WARNING os_brick.initiator.connectors.base [None req-f8a0b07c-b6cd-493a-b775-9ada92dc0410 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 10:13:53 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-f8a0b07c-b6cd-493a-b775-9ada92dc0410 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 10:13:53 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:13:53 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-3567f8ae-bfa2-498d-92b5-05c7195e54b5 tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] Acquiring lock "8ee427dc-7aa0-4435-b23c-1223f2881df7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:13:53 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-3567f8ae-bfa2-498d-92b5-05c7195e54b5 tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] Lock "8ee427dc-7aa0-4435-b23c-1223f2881df7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:13:53 user nova-compute[73572]: INFO nova.compute.manager [None req-3567f8ae-bfa2-498d-92b5-05c7195e54b5 tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] [instance: 8ee427dc-7aa0-4435-b23c-1223f2881df7] Detaching volume c5be97e0-c3f1-4751-a0d7-32e45c899c06
Aug 26 10:13:54 user nova-compute[73572]: INFO nova.virt.block_device [None req-3567f8ae-bfa2-498d-92b5-05c7195e54b5 tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] [instance: 8ee427dc-7aa0-4435-b23c-1223f2881df7] Attempting to driver detach volume c5be97e0-c3f1-4751-a0d7-32e45c899c06 from mountpoint /dev/sdc
Aug 26 10:13:54 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-3567f8ae-bfa2-498d-92b5-05c7195e54b5 tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] Attempting to detach device sdc from instance 8ee427dc-7aa0-4435-b23c-1223f2881df7 from the persistent domain config. {{(pid=73572) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 10:13:54 user nova-compute[73572]: DEBUG nova.virt.libvirt.guest [None req-3567f8ae-bfa2-498d-92b5-05c7195e54b5 tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 10:13:54 user nova-compute[73572]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 10:13:54 user nova-compute[73572]:   <source dev="/dev/sdf"/>
Aug 26 10:13:54 user nova-compute[73572]:   <target dev="sdc" bus="scsi"/>
Aug 26 10:13:54 user nova-compute[73572]:   <serial>c5be97e0-c3f1-4751-a0d7-32e45c899c06</serial>
Aug 26 10:13:54 user nova-compute[73572]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Aug 26 10:13:54 user nova-compute[73572]: </disk>
Aug 26 10:13:54 user nova-compute[73572]:  {{(pid=73572) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 10:13:54 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-3567f8ae-bfa2-498d-92b5-05c7195e54b5 tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] Successfully detached device sdc from instance 8ee427dc-7aa0-4435-b23c-1223f2881df7 from the persistent domain config.
Aug 26 10:13:54 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-3567f8ae-bfa2-498d-92b5-05c7195e54b5 tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance 8ee427dc-7aa0-4435-b23c-1223f2881df7 from the live domain config. {{(pid=73572) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 10:13:54 user nova-compute[73572]: DEBUG nova.virt.libvirt.guest [None req-3567f8ae-bfa2-498d-92b5-05c7195e54b5 tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 10:13:54 user nova-compute[73572]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 10:13:54 user nova-compute[73572]:   <source dev="/dev/sdf"/>
Aug 26 10:13:54 user nova-compute[73572]:   <target dev="sdc" bus="scsi"/>
Aug 26 10:13:54 user nova-compute[73572]:   <serial>c5be97e0-c3f1-4751-a0d7-32e45c899c06</serial>
Aug 26 10:13:54 user nova-compute[73572]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Aug 26 10:13:54 user nova-compute[73572]: </disk>
Aug 26 10:13:54 user nova-compute[73572]:  {{(pid=73572) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 10:13:54 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-c43f8196-cf94-4074-8d29-80d70ddfda3e tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.444s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 10:13:54 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-c43f8196-cf94-4074-8d29-80d70ddfda3e tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] <== connect_volume: return (1446ms) {'type': 'block', 'scsi_wwn': '23537626638336236', 'path': '/dev/sdg'} {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 10:13:54 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c43f8196-cf94-4074-8d29-80d70ddfda3e tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] [instance: ee9bcbaa-25a6-4588-b757-2a2ae15b6cf8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23537626638336236', 'path': '/dev/sdg'} {{(pid=73572) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 10:13:54 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-f8a0b07c-b6cd-493a-b775-9ada92dc0410 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.934s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 10:13:54 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8a0b07c-b6cd-493a-b775-9ada92dc0410 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1a37188c-85bf-435f-bc57-e7170c7158ea', 0)] {{(pid=73572) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 10:13:54 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:13:54 user nova-compute[73572]: DEBUG nova.objects.instance [None req-c43f8196-cf94-4074-8d29-80d70ddfda3e tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] Lazy-loading 'flavor' on Instance uuid ee9bcbaa-25a6-4588-b757-2a2ae15b6cf8 {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:13:54 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:13:54 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[28049c17-3551-42ba-9ce4-6eef8c220719]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:09ba694f-cb2a-4600-abe9-924b41292479\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1a37188c-85bf-435f-bc57-e7170c7158ea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:75ebe4c4-f791-4f09-a9bd-747ade3d70a3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:85988ff4-7fac-4a96-a502-74d6ca8189fe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:99c74791-0bdd-4261-a580-f456f29cbadb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c5be97e0-c3f1-4751-a0d7-32e45c899c06\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:13:54 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:13:54 user nova-compute[73572]: DEBUG nova.virt.libvirt.guest [None req-c43f8196-cf94-4074-8d29-80d70ddfda3e tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 10:13:54 user nova-compute[73572]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 10:13:54 user nova-compute[73572]:   <source dev="/dev/sdg"/>
Aug 26 10:13:54 user nova-compute[73572]:   <target dev="vdb" bus="virtio"/>
Aug 26 10:13:54 user nova-compute[73572]:   <serial>99c74791-0bdd-4261-a580-f456f29cbadb</serial>
Aug 26 10:13:54 user nova-compute[73572]: </disk>
Aug 26 10:13:54 user nova-compute[73572]:  {{(pid=73572) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 10:13:54 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:13:54 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[f80feb06-ed04-4b1a-ab56-ad329b0e2557]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09ba694f-cb2a-4600-abe9-924b41292479 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85988ff4-7fac-4a96-a502-74d6ca8189fe (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75ebe4c4-f791-4f09-a9bd-747ade3d70a3 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a37188c-85bf-435f-bc57-e7170c7158ea (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5be97e0-c3f1-4751-a0d7-32e45c899c06 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99c74791-0bdd-4261-a580-f456f29cbadb (non-flash)\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:13:54 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8a0b07c-b6cd-493a-b775-9ada92dc0410 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09ba694f-cb2a-4600-abe9-924b41292479 (non-flash)
Aug 26 10:13:54 user nova-compute[73572]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85988ff4-7fac-4a96-a502-74d6ca8189fe (non-flash)
Aug 26 10:13:54 user nova-compute[73572]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75ebe4c4-f791-4f09-a9bd-747ade3d70a3 (non-flash)
Aug 26 10:13:54 user nova-compute[73572]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a37188c-85bf-435f-bc57-e7170c7158ea (non-flash)
Aug 26 10:13:54 user nova-compute[73572]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5be97e0-c3f1-4751-a0d7-32e45c899c06 (non-flash)
Aug 26 10:13:54 user nova-compute[73572]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99c74791-0bdd-4261-a580-f456f29cbadb (non-flash)
Aug 26 10:13:54 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 10:13:54 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8a0b07c-b6cd-493a-b775-9ada92dc0410 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09ba694f-cb2a-4600-abe9-924b41292479 (non-flash)
Aug 26 10:13:54 user nova-compute[73572]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85988ff4-7fac-4a96-a502-74d6ca8189fe (non-flash)
Aug 26 10:13:54 user nova-compute[73572]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75ebe4c4-f791-4f09-a9bd-747ade3d70a3 (non-flash)
Aug 26 10:13:54 user nova-compute[73572]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a37188c-85bf-435f-bc57-e7170c7158ea (non-flash)
Aug 26 10:13:54 user nova-compute[73572]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5be97e0-c3f1-4751-a0d7-32e45c899c06 (non-flash)
Aug 26 10:13:54 user nova-compute[73572]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99c74791-0bdd-4261-a580-f456f29cbadb (non-flash)
Aug 26 10:13:54 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 10:13:54 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8a0b07c-b6cd-493a-b775-9ada92dc0410 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc89c3c9fc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1a37188c-85bf-435f-bc57-e7170c7158ea'): ({'sde'}, set())}) {{(pid=73572) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 10:13:54 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-f8a0b07c-b6cd-493a-b775-9ada92dc0410 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] Removing single pathed devices sde {{(pid=73572) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 10:13:54 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:13:54 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Received event <DeviceRemovedEvent: 1693044834.5176532, 8ee427dc-7aa0-4435-b23c-1223f2881df7 => scsi0-0-0-2> from libvirt while the driver is waiting for it; dispatched. {{(pid=73572) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 10:13:54 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-3567f8ae-bfa2-498d-92b5-05c7195e54b5 tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance 8ee427dc-7aa0-4435-b23c-1223f2881df7 {{(pid=73572) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 10:13:54 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-3567f8ae-bfa2-498d-92b5-05c7195e54b5 tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] Successfully detached device sdc from instance 8ee427dc-7aa0-4435-b23c-1223f2881df7 from the live domain config.
Aug 26 10:13:54 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:13:54 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[7094bb9d-d2d0-4233-bd06-bc4544b264b1]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:13:54 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3567f8ae-bfa2-498d-92b5-05c7195e54b5 tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] [instance: 8ee427dc-7aa0-4435-b23c-1223f2881df7] calling os-brick to detach iSCSI Volume {{(pid=73572) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 10:13:54 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-3567f8ae-bfa2-498d-92b5-05c7195e54b5 tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc89c3d6a10>, {'target_iqns': ['iqn.2010-10.org.openstack:c5be97e0-c3f1-4751-a0d7-32e45c899c06'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LqhoRQHy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 10:13:54 user nova-compute[73572]: WARNING os_brick.initiator.connectors.base [None req-3567f8ae-bfa2-498d-92b5-05c7195e54b5 tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 10:13:54 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-3567f8ae-bfa2-498d-92b5-05c7195e54b5 tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 10:13:54 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:13:54 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:13:54 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[52ee1e6a-9660-47ad-b9e6-3093c8b4488c]: (4, ('ok\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:13:54 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-f8a0b07c-b6cd-493a-b775-9ada92dc0410 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] Flushing IO for device /dev/sde {{(pid=73572) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 10:13:54 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:13:54 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:13:54 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[80ebfe13-a5f2-439b-bd1a-6584d2d83f55]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:13:54 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-f8a0b07c-b6cd-493a-b775-9ada92dc0410 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73572) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 10:13:54 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:13:54 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.049s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:13:54 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[a867b632-05d8-454c-8a4a-bb5f6e053eaa]: (4, ('1', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:13:54 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-f8a0b07c-b6cd-493a-b775-9ada92dc0410 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73572) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 10:13:54 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-f8a0b07c-b6cd-493a-b775-9ada92dc0410 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] SCSI volumes sde have been removed. {{(pid=73572) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 10:13:54 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8a0b07c-b6cd-493a-b775-9ada92dc0410 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1a37188c-85bf-435f-bc57-e7170c7158ea')] {{(pid=73572) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 10:13:54 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a37188c-85bf-435f-bc57-e7170c7158ea -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:13:54 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a37188c-85bf-435f-bc57-e7170c7158ea -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:13:54 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[05f44950-3e59-4448-a65a-c3a8540c92d1]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:13:54 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8a0b07c-b6cd-493a-b775-9ada92dc0410 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:13:54 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a37188c-85bf-435f-bc57-e7170c7158ea -p 172.16.0.220:3260 --logout {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:13:54 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a37188c-85bf-435f-bc57-e7170c7158ea -p 172.16.0.220:3260 --logout" returned: 0 in 0.083s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:13:54 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[a20164b5-9c98-42c3-a778-164a67f69749]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:1a37188c-85bf-435f-bc57-e7170c7158ea, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:1a37188c-85bf-435f-bc57-e7170c7158ea, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:13:54 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8a0b07c-b6cd-493a-b775-9ada92dc0410 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:1a37188c-85bf-435f-bc57-e7170c7158ea, portal: 172.16.0.220,3260]
Aug 26 10:13:54 user nova-compute[73572]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:1a37188c-85bf-435f-bc57-e7170c7158ea, portal: 172.16.0.220,3260] successful.
Aug 26 10:13:54 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:13:54 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a37188c-85bf-435f-bc57-e7170c7158ea -p 172.16.0.220:3260 --op delete {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:13:54 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a37188c-85bf-435f-bc57-e7170c7158ea -p 172.16.0.220:3260 --op delete" returned: 0 in 0.041s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:13:54 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7cc19a1-2a7e-4b3b-a9b8-2f336054ddef]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:13:54 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8a0b07c-b6cd-493a-b775-9ada92dc0410 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:13:54 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-f8a0b07c-b6cd-493a-b775-9ada92dc0410 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.368s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 10:13:54 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8a0b07c-b6cd-493a-b775-9ada92dc0410 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] <== disconnect_volume: return (1302ms) None {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 10:13:54 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f8a0b07c-b6cd-493a-b775-9ada92dc0410 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] [instance: 61b60a19-597e-4dc1-af0f-a0ec95e9fd24] Disconnected iSCSI Volume {{(pid=73572) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 10:13:54 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-f8a0b07c-b6cd-493a-b775-9ada92dc0410 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] [instance: 61b60a19-597e-4dc1-af0f-a0ec95e9fd24] Deleting instance files /opt/stack/data/nova/instances/61b60a19-597e-4dc1-af0f-a0ec95e9fd24_del
Aug 26 10:13:54 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-f8a0b07c-b6cd-493a-b775-9ada92dc0410 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] [instance: 61b60a19-597e-4dc1-af0f-a0ec95e9fd24] Deletion of /opt/stack/data/nova/instances/61b60a19-597e-4dc1-af0f-a0ec95e9fd24_del complete
Aug 26 10:13:54 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-3567f8ae-bfa2-498d-92b5-05c7195e54b5 tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.268s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 10:13:54 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-3567f8ae-bfa2-498d-92b5-05c7195e54b5 tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c5be97e0-c3f1-4751-a0d7-32e45c899c06', 0)] {{(pid=73572) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 10:13:54 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:13:54 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:13:54 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee084fe7-962b-4a6b-9c59-0b7b96497399]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:09ba694f-cb2a-4600-abe9-924b41292479\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:75ebe4c4-f791-4f09-a9bd-747ade3d70a3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:85988ff4-7fac-4a96-a502-74d6ca8189fe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:99c74791-0bdd-4261-a580-f456f29cbadb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c5be97e0-c3f1-4751-a0d7-32e45c899c06\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:13:54 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:13:54 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:13:54 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[e697b13e-bc52-472b-a3a1-2bb2b15942be]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09ba694f-cb2a-4600-abe9-924b41292479 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85988ff4-7fac-4a96-a502-74d6ca8189fe (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75ebe4c4-f791-4f09-a9bd-747ade3d70a3 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5be97e0-c3f1-4751-a0d7-32e45c899c06 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99c74791-0bdd-4261-a580-f456f29cbadb (non-flash)\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:13:54 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-3567f8ae-bfa2-498d-92b5-05c7195e54b5 tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09ba694f-cb2a-4600-abe9-924b41292479 (non-flash)
Aug 26 10:13:54 user nova-compute[73572]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85988ff4-7fac-4a96-a502-74d6ca8189fe (non-flash)
Aug 26 10:13:54 user nova-compute[73572]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75ebe4c4-f791-4f09-a9bd-747ade3d70a3 (non-flash)
Aug 26 10:13:54 user nova-compute[73572]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5be97e0-c3f1-4751-a0d7-32e45c899c06 (non-flash)
Aug 26 10:13:54 user nova-compute[73572]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99c74791-0bdd-4261-a580-f456f29cbadb (non-flash)
Aug 26 10:13:54 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 10:13:54 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-3567f8ae-bfa2-498d-92b5-05c7195e54b5 tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09ba694f-cb2a-4600-abe9-924b41292479 (non-flash)
Aug 26 10:13:54 user nova-compute[73572]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85988ff4-7fac-4a96-a502-74d6ca8189fe (non-flash)
Aug 26 10:13:54 user nova-compute[73572]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75ebe4c4-f791-4f09-a9bd-747ade3d70a3 (non-flash)
Aug 26 10:13:54 user nova-compute[73572]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5be97e0-c3f1-4751-a0d7-32e45c899c06 (non-flash)
Aug 26 10:13:54 user nova-compute[73572]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99c74791-0bdd-4261-a580-f456f29cbadb (non-flash)
Aug 26 10:13:54 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 10:13:54 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-3567f8ae-bfa2-498d-92b5-05c7195e54b5 tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc89c3e3be0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c5be97e0-c3f1-4751-a0d7-32e45c899c06'): ({'sdf'}, set())}) {{(pid=73572) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 10:13:54 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-3567f8ae-bfa2-498d-92b5-05c7195e54b5 tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] Removing single pathed devices sdf {{(pid=73572) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 10:13:54 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:13:54 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:13:54 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f1ef1ae-747f-4226-803b-e745cd6fdd45]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:13:54 user nova-compute[73572]: INFO nova.compute.manager [None req-f8a0b07c-b6cd-493a-b775-9ada92dc0410 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] [instance: 61b60a19-597e-4dc1-af0f-a0ec95e9fd24] Took 2.32 seconds to destroy the instance on the hypervisor.
Aug 26 10:13:54 user nova-compute[73572]: DEBUG oslo.service.loopingcall [None req-f8a0b07c-b6cd-493a-b775-9ada92dc0410 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73572) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 10:13:54 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:13:54 user nova-compute[73572]: DEBUG nova.compute.manager [-] [instance: 61b60a19-597e-4dc1-af0f-a0ec95e9fd24] Deallocating network for instance {{(pid=73572) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 10:13:54 user nova-compute[73572]: DEBUG nova.network.neutron [-] [instance: 61b60a19-597e-4dc1-af0f-a0ec95e9fd24] deallocate_for_instance() {{(pid=73572) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 10:13:54 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.025s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:13:54 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7be0087-e073-4560-9fc6-9019b10157e5]: (4, ('ok\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:13:54 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-3567f8ae-bfa2-498d-92b5-05c7195e54b5 tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] Flushing IO for device /dev/sdf {{(pid=73572) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 10:13:54 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:13:54 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.023s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:13:54 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[9165d658-5f47-401b-a36f-d0827641f172]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:13:54 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-3567f8ae-bfa2-498d-92b5-05c7195e54b5 tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=73572) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 10:13:54 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:13:54 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-c43f8196-cf94-4074-8d29-80d70ddfda3e tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] No BDM found with device name vda, not building metadata. {{(pid=73572) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 10:13:54 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-c43f8196-cf94-4074-8d29-80d70ddfda3e tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73572) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 10:13:54 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-c43f8196-cf94-4074-8d29-80d70ddfda3e tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] No VIF found with MAC fa:16:3e:f9:ca:45, not building metadata {{(pid=73572) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 10:13:55 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.050s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:13:55 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[34c23131-8f1c-4c6c-abe3-5bf2c908092e]: (4, ('1', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:13:55 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-3567f8ae-bfa2-498d-92b5-05c7195e54b5 tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=73572) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 10:13:55 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-3567f8ae-bfa2-498d-92b5-05c7195e54b5 tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] SCSI volumes sdf have been removed. {{(pid=73572) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 10:13:55 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-3567f8ae-bfa2-498d-92b5-05c7195e54b5 tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c5be97e0-c3f1-4751-a0d7-32e45c899c06')] {{(pid=73572) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 10:13:55 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5be97e0-c3f1-4751-a0d7-32e45c899c06 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:13:55 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5be97e0-c3f1-4751-a0d7-32e45c899c06 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:13:55 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[196d375d-fb33-4807-bc41-38d8e40c42a6]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:13:55 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-3567f8ae-bfa2-498d-92b5-05c7195e54b5 tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:13:55 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5be97e0-c3f1-4751-a0d7-32e45c899c06 -p 172.16.0.220:3260 --logout {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:13:55 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-c43f8196-cf94-4074-8d29-80d70ddfda3e tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] Lock "ee9bcbaa-25a6-4588-b757-2a2ae15b6cf8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 15.222s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:13:55 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5be97e0-c3f1-4751-a0d7-32e45c899c06 -p 172.16.0.220:3260 --logout" returned: 0 in 0.096s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:13:55 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[27f9aa09-20cc-4348-8364-7f4af41d0828]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:c5be97e0-c3f1-4751-a0d7-32e45c899c06, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:c5be97e0-c3f1-4751-a0d7-32e45c899c06, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:13:55 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-3567f8ae-bfa2-498d-92b5-05c7195e54b5 tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:c5be97e0-c3f1-4751-a0d7-32e45c899c06, portal: 172.16.0.220,3260]
Aug 26 10:13:55 user nova-compute[73572]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:c5be97e0-c3f1-4751-a0d7-32e45c899c06, portal: 172.16.0.220,3260] successful.
Aug 26 10:13:55 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:13:55 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5be97e0-c3f1-4751-a0d7-32e45c899c06 -p 172.16.0.220:3260 --op delete {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:13:55 user nova-compute[73572]: DEBUG nova.compute.manager [req-00140f9c-50a4-4c8b-8f53-05c8aaa94df1 req-e198094f-0a3b-469a-91b8-10976443ad14 service nova] [instance: bc56542d-af1f-4313-8555-1b2014ff35e7] Received event network-changed-cc3f2aa1-a2e9-4558-8bcd-d26216e82b37 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:13:55 user nova-compute[73572]: DEBUG nova.compute.manager [req-00140f9c-50a4-4c8b-8f53-05c8aaa94df1 req-e198094f-0a3b-469a-91b8-10976443ad14 service nova] [instance: bc56542d-af1f-4313-8555-1b2014ff35e7] Refreshing instance network info cache due to event network-changed-cc3f2aa1-a2e9-4558-8bcd-d26216e82b37. {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 10:13:55 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-00140f9c-50a4-4c8b-8f53-05c8aaa94df1 req-e198094f-0a3b-469a-91b8-10976443ad14 service nova] Acquiring lock "refresh_cache-bc56542d-af1f-4313-8555-1b2014ff35e7" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:13:55 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-00140f9c-50a4-4c8b-8f53-05c8aaa94df1 req-e198094f-0a3b-469a-91b8-10976443ad14 service nova] Acquired lock "refresh_cache-bc56542d-af1f-4313-8555-1b2014ff35e7" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:13:55 user nova-compute[73572]: DEBUG nova.network.neutron [req-00140f9c-50a4-4c8b-8f53-05c8aaa94df1 req-e198094f-0a3b-469a-91b8-10976443ad14 service nova] [instance: bc56542d-af1f-4313-8555-1b2014ff35e7] Refreshing network info cache for port cc3f2aa1-a2e9-4558-8bcd-d26216e82b37 {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 10:13:55 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5be97e0-c3f1-4751-a0d7-32e45c899c06 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.049s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:13:55 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae0f4e88-b23a-435a-a171-98dc3eee6b02]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:13:55 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-3567f8ae-bfa2-498d-92b5-05c7195e54b5 tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:13:55 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-3567f8ae-bfa2-498d-92b5-05c7195e54b5 tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.421s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 10:13:55 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-3567f8ae-bfa2-498d-92b5-05c7195e54b5 tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] <== disconnect_volume: return (690ms) None {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 10:13:55 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3567f8ae-bfa2-498d-92b5-05c7195e54b5 tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] [instance: 8ee427dc-7aa0-4435-b23c-1223f2881df7] Disconnected iSCSI Volume {{(pid=73572) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 10:13:55 user nova-compute[73572]: DEBUG nova.compute.manager [req-f1160294-9659-4b2d-9bcb-26e1454c89c3 req-826f6dbd-224f-4e57-b563-771dd43765f1 service nova] [instance: 61b60a19-597e-4dc1-af0f-a0ec95e9fd24] Received event network-vif-plugged-f846939c-c22d-4e0c-9237-404eabf0abd4 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:13:55 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-f1160294-9659-4b2d-9bcb-26e1454c89c3 req-826f6dbd-224f-4e57-b563-771dd43765f1 service nova] Acquiring lock "61b60a19-597e-4dc1-af0f-a0ec95e9fd24-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:13:55 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-f1160294-9659-4b2d-9bcb-26e1454c89c3 req-826f6dbd-224f-4e57-b563-771dd43765f1 service nova] Lock "61b60a19-597e-4dc1-af0f-a0ec95e9fd24-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:13:55 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-f1160294-9659-4b2d-9bcb-26e1454c89c3 req-826f6dbd-224f-4e57-b563-771dd43765f1 service nova] Lock "61b60a19-597e-4dc1-af0f-a0ec95e9fd24-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:13:55 user nova-compute[73572]: DEBUG nova.compute.manager [req-f1160294-9659-4b2d-9bcb-26e1454c89c3 req-826f6dbd-224f-4e57-b563-771dd43765f1 service nova] [instance: 61b60a19-597e-4dc1-af0f-a0ec95e9fd24] No waiting events found dispatching network-vif-plugged-f846939c-c22d-4e0c-9237-404eabf0abd4 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:13:55 user nova-compute[73572]: WARNING nova.compute.manager [req-f1160294-9659-4b2d-9bcb-26e1454c89c3 req-826f6dbd-224f-4e57-b563-771dd43765f1 service nova] [instance: 61b60a19-597e-4dc1-af0f-a0ec95e9fd24] Received unexpected event network-vif-plugged-f846939c-c22d-4e0c-9237-404eabf0abd4 for instance with vm_state active and task_state deleting.
Aug 26 10:13:55 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-2460cea7-39a4-4fcc-83ae-a7d44d9a0cbb tempest-VolumesAssistedSnapshotsTest-512654069 tempest-VolumesAssistedSnapshotsTest-512654069-project-admin] Acquiring lock "bc56542d-af1f-4313-8555-1b2014ff35e7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:13:55 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-2460cea7-39a4-4fcc-83ae-a7d44d9a0cbb tempest-VolumesAssistedSnapshotsTest-512654069 tempest-VolumesAssistedSnapshotsTest-512654069-project-admin] Lock "bc56542d-af1f-4313-8555-1b2014ff35e7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:13:55 user nova-compute[73572]: DEBUG nova.objects.instance [None req-2460cea7-39a4-4fcc-83ae-a7d44d9a0cbb tempest-VolumesAssistedSnapshotsTest-512654069 tempest-VolumesAssistedSnapshotsTest-512654069-project-admin] Lazy-loading 'flavor' on Instance uuid bc56542d-af1f-4313-8555-1b2014ff35e7 {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:13:55 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-2460cea7-39a4-4fcc-83ae-a7d44d9a0cbb tempest-VolumesAssistedSnapshotsTest-512654069 tempest-VolumesAssistedSnapshotsTest-512654069-project-admin] Lock "bc56542d-af1f-4313-8555-1b2014ff35e7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.116s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:13:55 user nova-compute[73572]: DEBUG nova.network.neutron [-] [instance: 61b60a19-597e-4dc1-af0f-a0ec95e9fd24] Updating instance_info_cache with network_info: [] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:13:55 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-2460cea7-39a4-4fcc-83ae-a7d44d9a0cbb tempest-VolumesAssistedSnapshotsTest-512654069 tempest-VolumesAssistedSnapshotsTest-512654069-project-admin] Acquiring lock "bc56542d-af1f-4313-8555-1b2014ff35e7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:13:55 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-2460cea7-39a4-4fcc-83ae-a7d44d9a0cbb tempest-VolumesAssistedSnapshotsTest-512654069 tempest-VolumesAssistedSnapshotsTest-512654069-project-admin] Lock "bc56542d-af1f-4313-8555-1b2014ff35e7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:13:55 user nova-compute[73572]: INFO nova.compute.manager [None req-2460cea7-39a4-4fcc-83ae-a7d44d9a0cbb tempest-VolumesAssistedSnapshotsTest-512654069 tempest-VolumesAssistedSnapshotsTest-512654069-project-admin] [instance: bc56542d-af1f-4313-8555-1b2014ff35e7] Attaching volume 4424a3fb-3e02-4aea-91af-bd569a2d90f1 to /dev/vdb
Aug 26 10:13:55 user nova-compute[73572]: INFO nova.compute.manager [-] [instance: 61b60a19-597e-4dc1-af0f-a0ec95e9fd24] Took 0.97 seconds to deallocate network for instance.
Aug 26 10:13:56 user nova-compute[73572]: DEBUG nova.network.neutron [req-00140f9c-50a4-4c8b-8f53-05c8aaa94df1 req-e198094f-0a3b-469a-91b8-10976443ad14 service nova] [instance: bc56542d-af1f-4313-8555-1b2014ff35e7] Updated VIF entry in instance network info cache for port cc3f2aa1-a2e9-4558-8bcd-d26216e82b37. {{(pid=73572) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 10:13:56 user nova-compute[73572]: DEBUG nova.network.neutron [req-00140f9c-50a4-4c8b-8f53-05c8aaa94df1 req-e198094f-0a3b-469a-91b8-10976443ad14 service nova] [instance: bc56542d-af1f-4313-8555-1b2014ff35e7] Updating instance_info_cache with network_info: [{"id": "cc3f2aa1-a2e9-4558-8bcd-d26216e82b37", "address": "fa:16:3e:72:9b:7b", "network": {"id": "f44b02ba-9d68-4e71-8b33-e9596581cc5b", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-996168907-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "233ee4c01bde4dae890bb3cf43348e2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc3f2aa1-a2", "ovs_interfaceid": "cc3f2aa1-a2e9-4558-8bcd-d26216e82b37", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:13:56 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-00140f9c-50a4-4c8b-8f53-05c8aaa94df1 req-e198094f-0a3b-469a-91b8-10976443ad14 service nova] Releasing lock "refresh_cache-bc56542d-af1f-4313-8555-1b2014ff35e7" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:13:56 user nova-compute[73572]: DEBUG nova.objects.instance [None req-3567f8ae-bfa2-498d-92b5-05c7195e54b5 tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] Lazy-loading 'flavor' on Instance uuid 8ee427dc-7aa0-4435-b23c-1223f2881df7 {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:13:56 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-3567f8ae-bfa2-498d-92b5-05c7195e54b5 tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] Lock "8ee427dc-7aa0-4435-b23c-1223f2881df7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.350s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:13:56 user nova-compute[73572]: DEBUG os_brick.utils [None req-2460cea7-39a4-4fcc-83ae-a7d44d9a0cbb tempest-VolumesAssistedSnapshotsTest-512654069 tempest-VolumesAssistedSnapshotsTest-512654069-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 10:13:56 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:13:56 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:13:56 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[af894244-ade7-4bb2-9139-4d40b4a28333]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:de8a79ed912\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:13:56 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:13:56 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:13:56 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f4c14dd-8849-44db-81e3-6bfafe18ed01]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:13:56 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:13:56 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:13:56 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd30f9d6-b05f-478b-a163-99e612c11fd5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:13:56 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[d05958e5-00c3-4736-8181-55eef6f35866]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:13:56 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-2460cea7-39a4-4fcc-83ae-a7d44d9a0cbb tempest-VolumesAssistedSnapshotsTest-512654069 tempest-VolumesAssistedSnapshotsTest-512654069-project-admin] Running cmd (subprocess): nvme version {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:13:56 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-2460cea7-39a4-4fcc-83ae-a7d44d9a0cbb tempest-VolumesAssistedSnapshotsTest-512654069 tempest-VolumesAssistedSnapshotsTest-512654069-project-admin] 'nvme version' failed. Not Retrying. {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 10:13:56 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2460cea7-39a4-4fcc-83ae-a7d44d9a0cbb tempest-VolumesAssistedSnapshotsTest-512654069 tempest-VolumesAssistedSnapshotsTest-512654069-project-admin] nvme not present on system {{(pid=73572) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 10:13:56 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:13:56 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 10:13:56 user nova-compute[73572]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 10:13:56 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bc25563-6798-487d-aa54-66a2b530c45d]: (4, '') {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:13:56 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.lightos [None req-2460cea7-39a4-4fcc-83ae-a7d44d9a0cbb tempest-VolumesAssistedSnapshotsTest-512654069 tempest-VolumesAssistedSnapshotsTest-512654069-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73572) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 10:13:56 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.lightos [None req-2460cea7-39a4-4fcc-83ae-a7d44d9a0cbb tempest-VolumesAssistedSnapshotsTest-512654069 tempest-VolumesAssistedSnapshotsTest-512654069-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73572) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 10:13:56 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.lightos [None req-2460cea7-39a4-4fcc-83ae-a7d44d9a0cbb tempest-VolumesAssistedSnapshotsTest-512654069 tempest-VolumesAssistedSnapshotsTest-512654069-project-admin] LIGHTOS: no hostnqn found. {{(pid=73572) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 10:13:56 user nova-compute[73572]: DEBUG os_brick.utils [None req-2460cea7-39a4-4fcc-83ae-a7d44d9a0cbb tempest-VolumesAssistedSnapshotsTest-512654069 tempest-VolumesAssistedSnapshotsTest-512654069-project-admin] <== get_connector_properties: return (153ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:de8a79ed912', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 10:13:56 user nova-compute[73572]: DEBUG nova.virt.block_device [None req-2460cea7-39a4-4fcc-83ae-a7d44d9a0cbb tempest-VolumesAssistedSnapshotsTest-512654069 tempest-VolumesAssistedSnapshotsTest-512654069-project-admin] [instance: bc56542d-af1f-4313-8555-1b2014ff35e7] Updating existing volume attachment record: 71c13596-4257-4716-a65c-c483b4b88430 {{(pid=73572) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 10:13:57 user nova-compute[73572]: DEBUG nova.compute.manager [req-3e0842e1-3097-4e40-9f5c-be82776718c6 req-52968cf5-9b51-420f-8c61-012d997530af service nova] [instance: 61b60a19-597e-4dc1-af0f-a0ec95e9fd24] Received event network-vif-deleted-f846939c-c22d-4e0c-9237-404eabf0abd4 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:13:58 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:13:58 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:13:59 user nova-compute[73572]: INFO nova.compute.manager [None req-f8a0b07c-b6cd-493a-b775-9ada92dc0410 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] [instance: 61b60a19-597e-4dc1-af0f-a0ec95e9fd24] Took 3.42 seconds to detach 1 volumes for instance.
Aug 26 10:13:59 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-f8a0b07c-b6cd-493a-b775-9ada92dc0410 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:13:59 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-f8a0b07c-b6cd-493a-b775-9ada92dc0410 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:13:59 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dcb82f90-fbb9-4343-a3ba-3e46101f6f7c tempest-TestVolumeSwap-1919204229 tempest-TestVolumeSwap-1919204229-project-member] [instance: d2a731d2-13ff-49e5-ab17-80686b622df7] Calling os-brick to attach iSCSI Volume {{(pid=73572) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 10:13:59 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcb82f90-fbb9-4343-a3ba-3e46101f6f7c tempest-TestVolumeSwap-1919204229 tempest-TestVolumeSwap-1919204229-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc89c3d6a10>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:9a00bb86-2eab-48d3-afc5-20fdd62650ae'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IUzhMJwv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 10:13:59 user nova-compute[73572]: WARNING os_brick.initiator.connectors.base [None req-dcb82f90-fbb9-4343-a3ba-3e46101f6f7c tempest-TestVolumeSwap-1919204229 tempest-TestVolumeSwap-1919204229-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 10:13:59 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-dcb82f90-fbb9-4343-a3ba-3e46101f6f7c tempest-TestVolumeSwap-1919204229 tempest-TestVolumeSwap-1919204229-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 10:13:59 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-dcb82f90-fbb9-4343-a3ba-3e46101f6f7c tempest-TestVolumeSwap-1919204229 tempest-TestVolumeSwap-1919204229-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 10:13:59 user nova-compute[73572]: WARNING os_brick.initiator.connectors.base [None req-dcb82f90-fbb9-4343-a3ba-3e46101f6f7c tempest-TestVolumeSwap-1919204229 tempest-TestVolumeSwap-1919204229-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 10:13:59 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-dcb82f90-fbb9-4343-a3ba-3e46101f6f7c tempest-TestVolumeSwap-1919204229 tempest-TestVolumeSwap-1919204229-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9a00bb86-2eab-48d3-afc5-20fdd62650ae" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 10:13:59 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-dcb82f90-fbb9-4343-a3ba-3e46101f6f7c tempest-TestVolumeSwap-1919204229 tempest-TestVolumeSwap-1919204229-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9a00bb86-2eab-48d3-afc5-20fdd62650ae" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 10:13:59 user nova-compute[73572]: INFO os_brick.initiator.connectors.iscsi [None req-dcb82f90-fbb9-4343-a3ba-3e46101f6f7c tempest-TestVolumeSwap-1919204229 tempest-TestVolumeSwap-1919204229-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 10:13:59 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a00bb86-2eab-48d3-afc5-20fdd62650ae -p 172.16.0.220:3260 {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:13:59 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a00bb86-2eab-48d3-afc5-20fdd62650ae -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:13:59 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6e2c5a2-5f1b-46c9-88e0-03b29107eb41]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:13:59 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcb82f90-fbb9-4343-a3ba-3e46101f6f7c tempest-TestVolumeSwap-1919204229 tempest-TestVolumeSwap-1919204229-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 10:13:59 user nova-compute[73572]:  {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:13:59 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a00bb86-2eab-48d3-afc5-20fdd62650ae -p 172.16.0.220:3260 --interface default --op new {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:13:59 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a00bb86-2eab-48d3-afc5-20fdd62650ae -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.031s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:13:59 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a99d012-8843-4147-aafa-3cc005f78915]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9a00bb86-2eab-48d3-afc5-20fdd62650ae] added\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:13:59 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcb82f90-fbb9-4343-a3ba-3e46101f6f7c tempest-TestVolumeSwap-1919204229 tempest-TestVolumeSwap-1919204229-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9a00bb86-2eab-48d3-afc5-20fdd62650ae] added
Aug 26 10:13:59 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:13:59 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a00bb86-2eab-48d3-afc5-20fdd62650ae -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:13:59 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a00bb86-2eab-48d3-afc5-20fdd62650ae -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.033s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:13:59 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[af22b277-bc85-4cae-813a-ce8ad0a82da2]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:13:59 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcb82f90-fbb9-4343-a3ba-3e46101f6f7c tempest-TestVolumeSwap-1919204229 tempest-TestVolumeSwap-1919204229-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:13:59 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a00bb86-2eab-48d3-afc5-20fdd62650ae -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:13:59 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a00bb86-2eab-48d3-afc5-20fdd62650ae -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:13:59 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[7639fcfd-9d42-4c40-9a4a-22bcae800361]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:13:59 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcb82f90-fbb9-4343-a3ba-3e46101f6f7c tempest-TestVolumeSwap-1919204229 tempest-TestVolumeSwap-1919204229-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:13:59 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a00bb86-2eab-48d3-afc5-20fdd62650ae -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IUzhMJwv {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:13:59 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a00bb86-2eab-48d3-afc5-20fdd62650ae -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IUzhMJwv" returned: 0 in 0.023s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:13:59 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a5f5f2a-a065-4759-adf2-8b5af81974a6]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:13:59 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcb82f90-fbb9-4343-a3ba-3e46101f6f7c tempest-TestVolumeSwap-1919204229 tempest-TestVolumeSwap-1919204229-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IUzhMJwv'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:13:59 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a00bb86-2eab-48d3-afc5-20fdd62650ae -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:13:59 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a00bb86-2eab-48d3-afc5-20fdd62650ae -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:13:59 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[494564b9-723b-4bce-a829-0a928bfb929e]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:13:59 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcb82f90-fbb9-4343-a3ba-3e46101f6f7c tempest-TestVolumeSwap-1919204229 tempest-TestVolumeSwap-1919204229-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:13:59 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:13:59 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:13:59 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[154344fc-a897-4e1e-889a-6b16c8d12f8d]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09ba694f-cb2a-4600-abe9-924b41292479 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85988ff4-7fac-4a96-a502-74d6ca8189fe (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75ebe4c4-f791-4f09-a9bd-747ade3d70a3 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99c74791-0bdd-4261-a580-f456f29cbadb (non-flash)\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:13:59 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcb82f90-fbb9-4343-a3ba-3e46101f6f7c tempest-TestVolumeSwap-1919204229 tempest-TestVolumeSwap-1919204229-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09ba694f-cb2a-4600-abe9-924b41292479 (non-flash)
Aug 26 10:13:59 user nova-compute[73572]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85988ff4-7fac-4a96-a502-74d6ca8189fe (non-flash)
Aug 26 10:13:59 user nova-compute[73572]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75ebe4c4-f791-4f09-a9bd-747ade3d70a3 (non-flash)
Aug 26 10:13:59 user nova-compute[73572]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99c74791-0bdd-4261-a580-f456f29cbadb (non-flash)
Aug 26 10:13:59 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 10:13:59 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcb82f90-fbb9-4343-a3ba-3e46101f6f7c tempest-TestVolumeSwap-1919204229 tempest-TestVolumeSwap-1919204229-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09ba694f-cb2a-4600-abe9-924b41292479 (non-flash)
Aug 26 10:13:59 user nova-compute[73572]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85988ff4-7fac-4a96-a502-74d6ca8189fe (non-flash)
Aug 26 10:13:59 user nova-compute[73572]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75ebe4c4-f791-4f09-a9bd-747ade3d70a3 (non-flash)
Aug 26 10:13:59 user nova-compute[73572]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99c74791-0bdd-4261-a580-f456f29cbadb (non-flash)
Aug 26 10:13:59 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 10:13:59 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a00bb86-2eab-48d3-afc5-20fdd62650ae -p 172.16.0.220:3260 --login {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:13:59 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-e4b41784-c4d5-47fd-a2f9-7817a333bcab tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] Acquiring lock "8ee427dc-7aa0-4435-b23c-1223f2881df7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:13:59 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-e4b41784-c4d5-47fd-a2f9-7817a333bcab tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] Lock "8ee427dc-7aa0-4435-b23c-1223f2881df7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:13:59 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-e4b41784-c4d5-47fd-a2f9-7817a333bcab tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] Acquiring lock "8ee427dc-7aa0-4435-b23c-1223f2881df7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:13:59 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-e4b41784-c4d5-47fd-a2f9-7817a333bcab tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] Lock "8ee427dc-7aa0-4435-b23c-1223f2881df7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:13:59 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-e4b41784-c4d5-47fd-a2f9-7817a333bcab tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] Lock "8ee427dc-7aa0-4435-b23c-1223f2881df7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:13:59 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a00bb86-2eab-48d3-afc5-20fdd62650ae -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:13:59 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[c59cc120-c86b-43ed-ae16-23ffa867c64d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9a00bb86-2eab-48d3-afc5-20fdd62650ae, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9a00bb86-2eab-48d3-afc5-20fdd62650ae, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:13:59 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcb82f90-fbb9-4343-a3ba-3e46101f6f7c tempest-TestVolumeSwap-1919204229 tempest-TestVolumeSwap-1919204229-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9a00bb86-2eab-48d3-afc5-20fdd62650ae, portal: 172.16.0.220,3260]
Aug 26 10:13:59 user nova-compute[73572]: Login to [iface: default, target: iqn.2010-10.org.openstack:9a00bb86-2eab-48d3-afc5-20fdd62650ae, portal: 172.16.0.220,3260] successful.
Aug 26 10:13:59 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:13:59 user nova-compute[73572]: INFO nova.compute.manager [None req-e4b41784-c4d5-47fd-a2f9-7817a333bcab tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] [instance: 8ee427dc-7aa0-4435-b23c-1223f2881df7] Terminating instance
Aug 26 10:13:59 user nova-compute[73572]: DEBUG nova.compute.manager [None req-e4b41784-c4d5-47fd-a2f9-7817a333bcab tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] [instance: 8ee427dc-7aa0-4435-b23c-1223f2881df7] Start destroying the instance on the hypervisor. {{(pid=73572) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 10:13:59 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a00bb86-2eab-48d3-afc5-20fdd62650ae -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:13:59 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a00bb86-2eab-48d3-afc5-20fdd62650ae -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:13:59 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0e24c2b-1952-4262-97c9-8e11bd8e1be2]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:13:59 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcb82f90-fbb9-4343-a3ba-3e46101f6f7c tempest-TestVolumeSwap-1919204229 tempest-TestVolumeSwap-1919204229-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:13:59 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:13:59 user nova-compute[73572]: DEBUG nova.compute.provider_tree [None req-f8a0b07c-b6cd-493a-b775-9ada92dc0410 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] Inventory has not changed in ProviderTree for provider: e2cec974-59b2-4c77-a53d-a7f4e5a30d75 {{(pid=73572) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 10:13:59 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:13:59 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b387fa1-8469-4e0d-b4c3-a0aa22a54721]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09ba694f-cb2a-4600-abe9-924b41292479 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85988ff4-7fac-4a96-a502-74d6ca8189fe (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75ebe4c4-f791-4f09-a9bd-747ade3d70a3 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99c74791-0bdd-4261-a580-f456f29cbadb (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a00bb86-2eab-48d3-afc5-20fdd62650ae (non-flash)\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:13:59 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcb82f90-fbb9-4343-a3ba-3e46101f6f7c tempest-TestVolumeSwap-1919204229 tempest-TestVolumeSwap-1919204229-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09ba694f-cb2a-4600-abe9-924b41292479 (non-flash)
Aug 26 10:13:59 user nova-compute[73572]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85988ff4-7fac-4a96-a502-74d6ca8189fe (non-flash)
Aug 26 10:13:59 user nova-compute[73572]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75ebe4c4-f791-4f09-a9bd-747ade3d70a3 (non-flash)
Aug 26 10:13:59 user nova-compute[73572]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99c74791-0bdd-4261-a580-f456f29cbadb (non-flash)
Aug 26 10:13:59 user nova-compute[73572]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a00bb86-2eab-48d3-afc5-20fdd62650ae (non-flash)
Aug 26 10:13:59 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 10:13:59 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcb82f90-fbb9-4343-a3ba-3e46101f6f7c tempest-TestVolumeSwap-1919204229 tempest-TestVolumeSwap-1919204229-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09ba694f-cb2a-4600-abe9-924b41292479 (non-flash)
Aug 26 10:13:59 user nova-compute[73572]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85988ff4-7fac-4a96-a502-74d6ca8189fe (non-flash)
Aug 26 10:13:59 user nova-compute[73572]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75ebe4c4-f791-4f09-a9bd-747ade3d70a3 (non-flash)
Aug 26 10:13:59 user nova-compute[73572]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99c74791-0bdd-4261-a580-f456f29cbadb (non-flash)
Aug 26 10:13:59 user nova-compute[73572]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a00bb86-2eab-48d3-afc5-20fdd62650ae (non-flash)
Aug 26 10:13:59 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 10:13:59 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-dcb82f90-fbb9-4343-a3ba-3e46101f6f7c tempest-TestVolumeSwap-1919204229 tempest-TestVolumeSwap-1919204229-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9a00bb86-2eab-48d3-afc5-20fdd62650ae" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.371s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 10:13:59 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcb82f90-fbb9-4343-a3ba-3e46101f6f7c tempest-TestVolumeSwap-1919204229 tempest-TestVolumeSwap-1919204229-project-member] Connected to 172.16.0.220:3260 {{(pid=73572) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 10:13:59 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-dcb82f90-fbb9-4343-a3ba-3e46101f6f7c tempest-TestVolumeSwap-1919204229 tempest-TestVolumeSwap-1919204229-project-member] HCTL ('36', '-', '-', 0) found on session 8 with lun 0 {{(pid=73572) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 10:13:59 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-dcb82f90-fbb9-4343-a3ba-3e46101f6f7c tempest-TestVolumeSwap-1919204229 tempest-TestVolumeSwap-1919204229-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73572) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 10:13:59 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:13:59 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-f8a0b07c-b6cd-493a-b775-9ada92dc0410 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] Inventory has not changed for provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73572) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 10:13:59 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:13:59 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.028s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:13:59 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1f1142e-f03c-4168-8471-c6cf0faef8ac]: (4, ('- - 0', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:13:59 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-dcb82f90-fbb9-4343-a3ba-3e46101f6f7c tempest-TestVolumeSwap-1919204229 tempest-TestVolumeSwap-1919204229-project-member] Searching for a device in session 8 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73572) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 10:13:59 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcb82f90-fbb9-4343-a3ba-3e46101f6f7c tempest-TestVolumeSwap-1919204229 tempest-TestVolumeSwap-1919204229-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IUzhMJwv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73572) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 10:13:59 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:13:59 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-fafaaaf6-c35e-41bd-96b5-6fdc2572e987 tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] Acquiring lock "ee9bcbaa-25a6-4588-b757-2a2ae15b6cf8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:13:59 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-fafaaaf6-c35e-41bd-96b5-6fdc2572e987 tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] Lock "ee9bcbaa-25a6-4588-b757-2a2ae15b6cf8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:13:59 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:13:59 user nova-compute[73572]: INFO nova.compute.manager [None req-fafaaaf6-c35e-41bd-96b5-6fdc2572e987 tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] [instance: ee9bcbaa-25a6-4588-b757-2a2ae15b6cf8] Detaching volume 99c74791-0bdd-4261-a580-f456f29cbadb
Aug 26 10:13:59 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-f8a0b07c-b6cd-493a-b775-9ada92dc0410 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.539s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:13:59 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:13:59 user nova-compute[73572]: INFO nova.scheduler.client.report [None req-f8a0b07c-b6cd-493a-b775-9ada92dc0410 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] Deleted allocations for instance 61b60a19-597e-4dc1-af0f-a0ec95e9fd24
Aug 26 10:13:59 user nova-compute[73572]: INFO nova.virt.block_device [None req-fafaaaf6-c35e-41bd-96b5-6fdc2572e987 tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] [instance: ee9bcbaa-25a6-4588-b757-2a2ae15b6cf8] Attempting to driver detach volume 99c74791-0bdd-4261-a580-f456f29cbadb from mountpoint /dev/vdb
Aug 26 10:14:00 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-fafaaaf6-c35e-41bd-96b5-6fdc2572e987 tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] Attempting to detach device vdb from instance ee9bcbaa-25a6-4588-b757-2a2ae15b6cf8 from the persistent domain config. {{(pid=73572) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 10:14:00 user nova-compute[73572]: DEBUG nova.virt.libvirt.guest [None req-fafaaaf6-c35e-41bd-96b5-6fdc2572e987 tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 10:14:00 user nova-compute[73572]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 10:14:00 user nova-compute[73572]:   <source dev="/dev/sdg"/>
Aug 26 10:14:00 user nova-compute[73572]:   <target dev="vdb" bus="virtio"/>
Aug 26 10:14:00 user nova-compute[73572]:   <serial>99c74791-0bdd-4261-a580-f456f29cbadb</serial>
Aug 26 10:14:00 user nova-compute[73572]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 10:14:00 user nova-compute[73572]: </disk>
Aug 26 10:14:00 user nova-compute[73572]:  {{(pid=73572) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 10:14:00 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-fafaaaf6-c35e-41bd-96b5-6fdc2572e987 tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] Successfully detached device vdb from instance ee9bcbaa-25a6-4588-b757-2a2ae15b6cf8 from the persistent domain config.
Aug 26 10:14:00 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-fafaaaf6-c35e-41bd-96b5-6fdc2572e987 tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ee9bcbaa-25a6-4588-b757-2a2ae15b6cf8 from the live domain config. {{(pid=73572) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 10:14:00 user nova-compute[73572]: DEBUG nova.virt.libvirt.guest [None req-fafaaaf6-c35e-41bd-96b5-6fdc2572e987 tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 10:14:00 user nova-compute[73572]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 10:14:00 user nova-compute[73572]:   <source dev="/dev/sdg"/>
Aug 26 10:14:00 user nova-compute[73572]:   <target dev="vdb" bus="virtio"/>
Aug 26 10:14:00 user nova-compute[73572]:   <serial>99c74791-0bdd-4261-a580-f456f29cbadb</serial>
Aug 26 10:14:00 user nova-compute[73572]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 10:14:00 user nova-compute[73572]: </disk>
Aug 26 10:14:00 user nova-compute[73572]:  {{(pid=73572) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 10:14:00 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-f8a0b07c-b6cd-493a-b775-9ada92dc0410 tempest-DeleteServersTestJSON-1148500196 tempest-DeleteServersTestJSON-1148500196-project-member] Lock "61b60a19-597e-4dc1-af0f-a0ec95e9fd24" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.591s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:14:00 user nova-compute[73572]: DEBUG nova.compute.manager [req-89b36303-aa9f-49a7-8a37-22f669de7df4 req-313ff8fe-bdaf-4acd-867d-fe6e06ef6618 service nova] [instance: 8ee427dc-7aa0-4435-b23c-1223f2881df7] Received event network-vif-unplugged-4c3302a3-7301-4cac-b75a-64ca09965157 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:14:00 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-89b36303-aa9f-49a7-8a37-22f669de7df4 req-313ff8fe-bdaf-4acd-867d-fe6e06ef6618 service nova] Acquiring lock "8ee427dc-7aa0-4435-b23c-1223f2881df7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:14:00 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-89b36303-aa9f-49a7-8a37-22f669de7df4 req-313ff8fe-bdaf-4acd-867d-fe6e06ef6618 service nova] Lock "8ee427dc-7aa0-4435-b23c-1223f2881df7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:14:00 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-89b36303-aa9f-49a7-8a37-22f669de7df4 req-313ff8fe-bdaf-4acd-867d-fe6e06ef6618 service nova] Lock "8ee427dc-7aa0-4435-b23c-1223f2881df7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:14:00 user nova-compute[73572]: DEBUG nova.compute.manager [req-89b36303-aa9f-49a7-8a37-22f669de7df4 req-313ff8fe-bdaf-4acd-867d-fe6e06ef6618 service nova] [instance: 8ee427dc-7aa0-4435-b23c-1223f2881df7] No waiting events found dispatching network-vif-unplugged-4c3302a3-7301-4cac-b75a-64ca09965157 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:14:00 user nova-compute[73572]: DEBUG nova.compute.manager [req-89b36303-aa9f-49a7-8a37-22f669de7df4 req-313ff8fe-bdaf-4acd-867d-fe6e06ef6618 service nova] [instance: 8ee427dc-7aa0-4435-b23c-1223f2881df7] Received event network-vif-unplugged-4c3302a3-7301-4cac-b75a-64ca09965157 for instance with task_state deleting. {{(pid=73572) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 10:14:00 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Received event <DeviceRemovedEvent: 1693044840.7973824, ee9bcbaa-25a6-4588-b757-2a2ae15b6cf8 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73572) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 10:14:00 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-fafaaaf6-c35e-41bd-96b5-6fdc2572e987 tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ee9bcbaa-25a6-4588-b757-2a2ae15b6cf8 {{(pid=73572) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 10:14:00 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-fafaaaf6-c35e-41bd-96b5-6fdc2572e987 tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] Successfully detached device vdb from instance ee9bcbaa-25a6-4588-b757-2a2ae15b6cf8 from the live domain config.
Aug 26 10:14:00 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fafaaaf6-c35e-41bd-96b5-6fdc2572e987 tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] [instance: ee9bcbaa-25a6-4588-b757-2a2ae15b6cf8] calling os-brick to detach iSCSI Volume {{(pid=73572) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 10:14:00 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-fafaaaf6-c35e-41bd-96b5-6fdc2572e987 tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc89c3d6a10>, {'target_iqns': ['iqn.2010-10.org.openstack:99c74791-0bdd-4261-a580-f456f29cbadb'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DgXUbqiC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 10:14:00 user nova-compute[73572]: WARNING os_brick.initiator.connectors.base [None req-fafaaaf6-c35e-41bd-96b5-6fdc2572e987 tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 10:14:00 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-fafaaaf6-c35e-41bd-96b5-6fdc2572e987 tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 10:14:00 user nova-compute[73572]: INFO nova.virt.libvirt.driver [-] [instance: 8ee427dc-7aa0-4435-b23c-1223f2881df7] Instance destroyed successfully.
Aug 26 10:14:00 user nova-compute[73572]: DEBUG nova.objects.instance [None req-e4b41784-c4d5-47fd-a2f9-7817a333bcab tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] Lazy-loading 'resources' on Instance uuid 8ee427dc-7aa0-4435-b23c-1223f2881df7 {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:14:00 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-e4b41784-c4d5-47fd-a2f9-7817a333bcab tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T10:11:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1306235019',display_name='tempest-AttachSCSIVolumeTestJSON-server-1306235019',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1306235019',id=6,image_ref='107ae528-7ed7-4368-95ed-9dc02ab31774',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBEtv1L64WyEnwYNfL+3NTg0gqRJFXYUc1zbYyRb1Jrc4J0PPg4IZHlNIchoGLdv9EoCx80ImIv/x5E6cbeQml8e0Mkc0X2yEz39VkOhCnHZ4QPaR3Aaf/zevKI78FBYUg==',key_name='tempest-keypair-899525953',keypairs=<?>,launch_index=0,launched_at=2023-08-26T10:11:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a9e9d7749db44598b91bc81e3d543b84',ramdisk_id='',reservation_id='r-88stocyg',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='107ae528-7ed7-4368-95ed-9dc02ab31774',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1697347357',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1697347357-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T10:11:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ada5dab545f244e38ed9ce5a23e84af7',uuid=8ee427dc-7aa0-4435-b23c-1223f2881df7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4c3302a3-7301-4cac-b75a-64ca09965157", "address": "fa:16:3e:07:ab:f2", "network": {"id": "c47deaf1-a2c4-4f19-8291-e9784568a77f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1615926461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.228", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9e9d7749db44598b91bc81e3d543b84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c3302a3-73", "ovs_interfaceid": "4c3302a3-7301-4cac-b75a-64ca09965157", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 10:14:00 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-e4b41784-c4d5-47fd-a2f9-7817a333bcab tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] Converting VIF {"id": "4c3302a3-7301-4cac-b75a-64ca09965157", "address": "fa:16:3e:07:ab:f2", "network": {"id": "c47deaf1-a2c4-4f19-8291-e9784568a77f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1615926461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.228", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9e9d7749db44598b91bc81e3d543b84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c3302a3-73", "ovs_interfaceid": "4c3302a3-7301-4cac-b75a-64ca09965157", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:14:00 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-e4b41784-c4d5-47fd-a2f9-7817a333bcab tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:07:ab:f2,bridge_name='br-int',has_traffic_filtering=True,id=4c3302a3-7301-4cac-b75a-64ca09965157,network=Network(c47deaf1-a2c4-4f19-8291-e9784568a77f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c3302a3-73') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:14:00 user nova-compute[73572]: DEBUG os_vif [None req-e4b41784-c4d5-47fd-a2f9-7817a333bcab tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:07:ab:f2,bridge_name='br-int',has_traffic_filtering=True,id=4c3302a3-7301-4cac-b75a-64ca09965157,network=Network(c47deaf1-a2c4-4f19-8291-e9784568a77f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c3302a3-73') {{(pid=73572) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 10:14:00 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-dcb82f90-fbb9-4343-a3ba-3e46101f6f7c tempest-TestVolumeSwap-1919204229 tempest-TestVolumeSwap-1919204229-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.459s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 10:14:00 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcb82f90-fbb9-4343-a3ba-3e46101f6f7c tempest-TestVolumeSwap-1919204229 tempest-TestVolumeSwap-1919204229-project-member] <== connect_volume: return (1461ms) {'type': 'block', 'scsi_wwn': '26265663232313263', 'path': '/dev/sde'} {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 10:14:00 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dcb82f90-fbb9-4343-a3ba-3e46101f6f7c tempest-TestVolumeSwap-1919204229 tempest-TestVolumeSwap-1919204229-project-member] [instance: d2a731d2-13ff-49e5-ab17-80686b622df7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26265663232313263', 'path': '/dev/sde'} {{(pid=73572) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 10:14:00 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:14:00 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4c3302a3-73, bridge=br-int, if_exists=True) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:14:00 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-fafaaaf6-c35e-41bd-96b5-6fdc2572e987 tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.053s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 10:14:00 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-fafaaaf6-c35e-41bd-96b5-6fdc2572e987 tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:99c74791-0bdd-4261-a580-f456f29cbadb', 0)] {{(pid=73572) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 10:14:00 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:14:00 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:14:00 user nova-compute[73572]: INFO os_vif [None req-e4b41784-c4d5-47fd-a2f9-7817a333bcab tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:07:ab:f2,bridge_name='br-int',has_traffic_filtering=True,id=4c3302a3-7301-4cac-b75a-64ca09965157,network=Network(c47deaf1-a2c4-4f19-8291-e9784568a77f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c3302a3-73')
Aug 26 10:14:00 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-e4b41784-c4d5-47fd-a2f9-7817a333bcab tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] [instance: 8ee427dc-7aa0-4435-b23c-1223f2881df7] Deleting instance files /opt/stack/data/nova/instances/8ee427dc-7aa0-4435-b23c-1223f2881df7_del
Aug 26 10:14:00 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-e4b41784-c4d5-47fd-a2f9-7817a333bcab tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] [instance: 8ee427dc-7aa0-4435-b23c-1223f2881df7] Deletion of /opt/stack/data/nova/instances/8ee427dc-7aa0-4435-b23c-1223f2881df7_del complete
Aug 26 10:14:00 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:14:00 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[03a97caa-54ab-4f8a-874f-571e994aa5a7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:09ba694f-cb2a-4600-abe9-924b41292479\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:75ebe4c4-f791-4f09-a9bd-747ade3d70a3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:85988ff4-7fac-4a96-a502-74d6ca8189fe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:99c74791-0bdd-4261-a580-f456f29cbadb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9a00bb86-2eab-48d3-afc5-20fdd62650ae\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:14:00 user nova-compute[73572]: DEBUG nova.objects.instance [None req-dcb82f90-fbb9-4343-a3ba-3e46101f6f7c tempest-TestVolumeSwap-1919204229 tempest-TestVolumeSwap-1919204229-project-member] Lazy-loading 'flavor' on Instance uuid d2a731d2-13ff-49e5-ab17-80686b622df7 {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:14:00 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:14:00 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:14:00 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdf87422-af80-41f8-bc27-d17a567e7ad4]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09ba694f-cb2a-4600-abe9-924b41292479 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85988ff4-7fac-4a96-a502-74d6ca8189fe (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75ebe4c4-f791-4f09-a9bd-747ade3d70a3 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99c74791-0bdd-4261-a580-f456f29cbadb (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a00bb86-2eab-48d3-afc5-20fdd62650ae (non-flash)\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:14:00 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-fafaaaf6-c35e-41bd-96b5-6fdc2572e987 tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09ba694f-cb2a-4600-abe9-924b41292479 (non-flash)
Aug 26 10:14:00 user nova-compute[73572]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85988ff4-7fac-4a96-a502-74d6ca8189fe (non-flash)
Aug 26 10:14:00 user nova-compute[73572]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75ebe4c4-f791-4f09-a9bd-747ade3d70a3 (non-flash)
Aug 26 10:14:00 user nova-compute[73572]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99c74791-0bdd-4261-a580-f456f29cbadb (non-flash)
Aug 26 10:14:00 user nova-compute[73572]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a00bb86-2eab-48d3-afc5-20fdd62650ae (non-flash)
Aug 26 10:14:00 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 10:14:00 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-fafaaaf6-c35e-41bd-96b5-6fdc2572e987 tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09ba694f-cb2a-4600-abe9-924b41292479 (non-flash)
Aug 26 10:14:00 user nova-compute[73572]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85988ff4-7fac-4a96-a502-74d6ca8189fe (non-flash)
Aug 26 10:14:00 user nova-compute[73572]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75ebe4c4-f791-4f09-a9bd-747ade3d70a3 (non-flash)
Aug 26 10:14:00 user nova-compute[73572]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99c74791-0bdd-4261-a580-f456f29cbadb (non-flash)
Aug 26 10:14:00 user nova-compute[73572]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a00bb86-2eab-48d3-afc5-20fdd62650ae (non-flash)
Aug 26 10:14:00 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 10:14:00 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-fafaaaf6-c35e-41bd-96b5-6fdc2572e987 tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc89c3c93f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:99c74791-0bdd-4261-a580-f456f29cbadb'): ({'sdg'}, set())}) {{(pid=73572) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 10:14:00 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-fafaaaf6-c35e-41bd-96b5-6fdc2572e987 tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] Removing single pathed devices sdg {{(pid=73572) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 10:14:00 user nova-compute[73572]: DEBUG nova.virt.libvirt.guest [None req-dcb82f90-fbb9-4343-a3ba-3e46101f6f7c tempest-TestVolumeSwap-1919204229 tempest-TestVolumeSwap-1919204229-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 10:14:00 user nova-compute[73572]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 10:14:00 user nova-compute[73572]:   <source dev="/dev/sde"/>
Aug 26 10:14:00 user nova-compute[73572]:   <target dev="vdb" bus="virtio"/>
Aug 26 10:14:00 user nova-compute[73572]:   <serial>9a00bb86-2eab-48d3-afc5-20fdd62650ae</serial>
Aug 26 10:14:00 user nova-compute[73572]: </disk>
Aug 26 10:14:00 user nova-compute[73572]:  {{(pid=73572) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 10:14:00 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:14:00 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:14:00 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[500e1f04-4b94-4a44-afc5-a6e5e23c6f86]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:14:00 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:14:00 user nova-compute[73572]: INFO nova.compute.manager [None req-e4b41784-c4d5-47fd-a2f9-7817a333bcab tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] [instance: 8ee427dc-7aa0-4435-b23c-1223f2881df7] Took 1.26 seconds to destroy the instance on the hypervisor.
Aug 26 10:14:00 user nova-compute[73572]: DEBUG oslo.service.loopingcall [None req-e4b41784-c4d5-47fd-a2f9-7817a333bcab tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73572) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 10:14:00 user nova-compute[73572]: DEBUG nova.compute.manager [-] [instance: 8ee427dc-7aa0-4435-b23c-1223f2881df7] Deallocating network for instance {{(pid=73572) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 10:14:00 user nova-compute[73572]: DEBUG nova.network.neutron [-] [instance: 8ee427dc-7aa0-4435-b23c-1223f2881df7] deallocate_for_instance() {{(pid=73572) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 10:14:00 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.021s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:14:00 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[11b453a6-3cc1-44b8-84c5-0caa4fa2555f]: (4, ('ok\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:14:00 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-fafaaaf6-c35e-41bd-96b5-6fdc2572e987 tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] Flushing IO for device /dev/sdg {{(pid=73572) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 10:14:00 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:14:01 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.020s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:14:01 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[943a75f7-ca34-49c6-8d0e-b8e9e7a86b49]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:14:01 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-fafaaaf6-c35e-41bd-96b5-6fdc2572e987 tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=73572) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 10:14:01 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:14:01 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.048s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:14:01 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[904ceeae-3bcf-4ef1-b197-4297c8de5fa1]: (4, ('1', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:14:01 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-fafaaaf6-c35e-41bd-96b5-6fdc2572e987 tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=73572) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 10:14:01 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-fafaaaf6-c35e-41bd-96b5-6fdc2572e987 tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] SCSI volumes sdg have been removed. {{(pid=73572) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 10:14:01 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-fafaaaf6-c35e-41bd-96b5-6fdc2572e987 tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:99c74791-0bdd-4261-a580-f456f29cbadb')] {{(pid=73572) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 10:14:01 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99c74791-0bdd-4261-a580-f456f29cbadb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:14:01 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99c74791-0bdd-4261-a580-f456f29cbadb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:14:01 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaa39376-8fa0-41cf-bfff-288c22e8d060]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:14:01 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-fafaaaf6-c35e-41bd-96b5-6fdc2572e987 tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:14:01 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99c74791-0bdd-4261-a580-f456f29cbadb -p 172.16.0.220:3260 --logout {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:14:01 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99c74791-0bdd-4261-a580-f456f29cbadb -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:14:01 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a363e2d-a83c-4ced-abbf-c02dbc95b5ae]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:99c74791-0bdd-4261-a580-f456f29cbadb, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:99c74791-0bdd-4261-a580-f456f29cbadb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:14:01 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-fafaaaf6-c35e-41bd-96b5-6fdc2572e987 tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:99c74791-0bdd-4261-a580-f456f29cbadb, portal: 172.16.0.220,3260]
Aug 26 10:14:01 user nova-compute[73572]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:99c74791-0bdd-4261-a580-f456f29cbadb, portal: 172.16.0.220,3260] successful.
Aug 26 10:14:01 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:14:01 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99c74791-0bdd-4261-a580-f456f29cbadb -p 172.16.0.220:3260 --op delete {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:14:01 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99c74791-0bdd-4261-a580-f456f29cbadb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:14:01 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[07b0acc8-2239-4597-9021-9afaf4d53f76]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:14:01 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-fafaaaf6-c35e-41bd-96b5-6fdc2572e987 tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:14:01 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-fafaaaf6-c35e-41bd-96b5-6fdc2572e987 tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.338s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 10:14:01 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-fafaaaf6-c35e-41bd-96b5-6fdc2572e987 tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] <== disconnect_volume: return (390ms) None {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 10:14:01 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fafaaaf6-c35e-41bd-96b5-6fdc2572e987 tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] [instance: ee9bcbaa-25a6-4588-b757-2a2ae15b6cf8] Disconnected iSCSI Volume {{(pid=73572) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 10:14:01 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-dcb82f90-fbb9-4343-a3ba-3e46101f6f7c tempest-TestVolumeSwap-1919204229 tempest-TestVolumeSwap-1919204229-project-member] No BDM found with device name vda, not building metadata. {{(pid=73572) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 10:14:01 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-dcb82f90-fbb9-4343-a3ba-3e46101f6f7c tempest-TestVolumeSwap-1919204229 tempest-TestVolumeSwap-1919204229-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73572) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 10:14:01 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-dcb82f90-fbb9-4343-a3ba-3e46101f6f7c tempest-TestVolumeSwap-1919204229 tempest-TestVolumeSwap-1919204229-project-member] No VIF found with MAC fa:16:3e:2d:a2:9f, not building metadata {{(pid=73572) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 10:14:01 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-dcb82f90-fbb9-4343-a3ba-3e46101f6f7c tempest-TestVolumeSwap-1919204229 tempest-TestVolumeSwap-1919204229-project-member] Lock "d2a731d2-13ff-49e5-ab17-80686b622df7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 15.613s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:14:02 user nova-compute[73572]: DEBUG nova.compute.manager [req-d95685d4-ae10-4ec3-bca1-82b2879160ec req-8c71281e-4492-47be-bd52-a02712f28a75 service nova] [instance: 8ee427dc-7aa0-4435-b23c-1223f2881df7] Received event network-vif-plugged-4c3302a3-7301-4cac-b75a-64ca09965157 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:14:02 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-d95685d4-ae10-4ec3-bca1-82b2879160ec req-8c71281e-4492-47be-bd52-a02712f28a75 service nova] Acquiring lock "8ee427dc-7aa0-4435-b23c-1223f2881df7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:14:02 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-d95685d4-ae10-4ec3-bca1-82b2879160ec req-8c71281e-4492-47be-bd52-a02712f28a75 service nova] Lock "8ee427dc-7aa0-4435-b23c-1223f2881df7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:14:02 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-d95685d4-ae10-4ec3-bca1-82b2879160ec req-8c71281e-4492-47be-bd52-a02712f28a75 service nova] Lock "8ee427dc-7aa0-4435-b23c-1223f2881df7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:14:02 user nova-compute[73572]: DEBUG nova.compute.manager [req-d95685d4-ae10-4ec3-bca1-82b2879160ec req-8c71281e-4492-47be-bd52-a02712f28a75 service nova] [instance: 8ee427dc-7aa0-4435-b23c-1223f2881df7] No waiting events found dispatching network-vif-plugged-4c3302a3-7301-4cac-b75a-64ca09965157 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:14:02 user nova-compute[73572]: WARNING nova.compute.manager [req-d95685d4-ae10-4ec3-bca1-82b2879160ec req-8c71281e-4492-47be-bd52-a02712f28a75 service nova] [instance: 8ee427dc-7aa0-4435-b23c-1223f2881df7] Received unexpected event network-vif-plugged-4c3302a3-7301-4cac-b75a-64ca09965157 for instance with vm_state active and task_state deleting.
Aug 26 10:14:02 user nova-compute[73572]: DEBUG nova.objects.instance [None req-fafaaaf6-c35e-41bd-96b5-6fdc2572e987 tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] Lazy-loading 'flavor' on Instance uuid ee9bcbaa-25a6-4588-b757-2a2ae15b6cf8 {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:14:02 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-fafaaaf6-c35e-41bd-96b5-6fdc2572e987 tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] Lock "ee9bcbaa-25a6-4588-b757-2a2ae15b6cf8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.960s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:14:03 user nova-compute[73572]: DEBUG nova.network.neutron [-] [instance: 8ee427dc-7aa0-4435-b23c-1223f2881df7] Updating instance_info_cache with network_info: [] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:14:03 user nova-compute[73572]: INFO nova.compute.manager [-] [instance: 8ee427dc-7aa0-4435-b23c-1223f2881df7] Took 2.18 seconds to deallocate network for instance.
Aug 26 10:14:03 user nova-compute[73572]: DEBUG nova.compute.manager [req-3b928b93-a659-4d21-983c-7a4592237a9b req-c13bbf98-3ce7-4c4f-bd5b-0b0326c81893 service nova] [instance: 8ee427dc-7aa0-4435-b23c-1223f2881df7] Received event network-vif-deleted-4c3302a3-7301-4cac-b75a-64ca09965157 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:14:03 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-e4b41784-c4d5-47fd-a2f9-7817a333bcab tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:14:03 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-e4b41784-c4d5-47fd-a2f9-7817a333bcab tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:14:03 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-e74da60b-5f05-43fc-9489-ef79e69997a9 tempest-TestVolumeSwap-269763820 tempest-TestVolumeSwap-269763820-project-admin] Acquiring lock "d2a731d2-13ff-49e5-ab17-80686b622df7" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:14:03 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-e74da60b-5f05-43fc-9489-ef79e69997a9 tempest-TestVolumeSwap-269763820 tempest-TestVolumeSwap-269763820-project-admin] Lock "d2a731d2-13ff-49e5-ab17-80686b622df7" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:14:03 user nova-compute[73572]: DEBUG os_brick.utils [None req-e74da60b-5f05-43fc-9489-ef79e69997a9 tempest-TestVolumeSwap-269763820 tempest-TestVolumeSwap-269763820-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 10:14:03 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:14:03 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:14:03 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[dee01d31-d16e-41f4-a23b-6ffec117beb6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:de8a79ed912\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:14:03 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:14:03 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:14:03 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[8884596e-4a98-4d41-9163-144a80fa656d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:14:03 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:14:03 user nova-compute[73572]: DEBUG nova.compute.provider_tree [None req-e4b41784-c4d5-47fd-a2f9-7817a333bcab tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] Inventory has not changed in ProviderTree for provider: e2cec974-59b2-4c77-a53d-a7f4e5a30d75 {{(pid=73572) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 10:14:03 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:14:03 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-e4b41784-c4d5-47fd-a2f9-7817a333bcab tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] Inventory has not changed for provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73572) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 10:14:03 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[c53a5a9e-5e2d-4712-b301-ee4fd89fc64c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:14:03 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fb9792a-8172-4c49-9833-4ff79ed7ae1e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:14:03 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-e74da60b-5f05-43fc-9489-ef79e69997a9 tempest-TestVolumeSwap-269763820 tempest-TestVolumeSwap-269763820-project-admin] Running cmd (subprocess): nvme version {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:14:03 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-e74da60b-5f05-43fc-9489-ef79e69997a9 tempest-TestVolumeSwap-269763820 tempest-TestVolumeSwap-269763820-project-admin] 'nvme version' failed. Not Retrying. {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 10:14:03 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e74da60b-5f05-43fc-9489-ef79e69997a9 tempest-TestVolumeSwap-269763820 tempest-TestVolumeSwap-269763820-project-admin] nvme not present on system {{(pid=73572) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 10:14:03 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-e4b41784-c4d5-47fd-a2f9-7817a333bcab tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.469s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:14:03 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:14:03 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 10:14:03 user nova-compute[73572]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 10:14:03 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[a99ab8b0-02a5-49f6-afa8-efb786780dbd]: (4, '') {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:14:03 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.lightos [None req-e74da60b-5f05-43fc-9489-ef79e69997a9 tempest-TestVolumeSwap-269763820 tempest-TestVolumeSwap-269763820-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73572) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 10:14:03 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.lightos [None req-e74da60b-5f05-43fc-9489-ef79e69997a9 tempest-TestVolumeSwap-269763820 tempest-TestVolumeSwap-269763820-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73572) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 10:14:03 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.lightos [None req-e74da60b-5f05-43fc-9489-ef79e69997a9 tempest-TestVolumeSwap-269763820 tempest-TestVolumeSwap-269763820-project-admin] LIGHTOS: no hostnqn found. {{(pid=73572) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 10:14:03 user nova-compute[73572]: DEBUG os_brick.utils [None req-e74da60b-5f05-43fc-9489-ef79e69997a9 tempest-TestVolumeSwap-269763820 tempest-TestVolumeSwap-269763820-project-admin] <== get_connector_properties: return (150ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:de8a79ed912', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 10:14:03 user nova-compute[73572]: INFO nova.scheduler.client.report [None req-e4b41784-c4d5-47fd-a2f9-7817a333bcab tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] Deleted allocations for instance 8ee427dc-7aa0-4435-b23c-1223f2881df7
Aug 26 10:14:03 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:14:03 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Starting heal instance info cache {{(pid=73572) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 10:14:03 user nova-compute[73572]: INFO nova.compute.manager [None req-e74da60b-5f05-43fc-9489-ef79e69997a9 tempest-TestVolumeSwap-269763820 tempest-TestVolumeSwap-269763820-project-admin] [instance: d2a731d2-13ff-49e5-ab17-80686b622df7] Swapping volume 9a00bb86-2eab-48d3-afc5-20fdd62650ae for c383a00f-3f34-40ef-a526-7425cfc92877
Aug 26 10:14:03 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-e4b41784-c4d5-47fd-a2f9-7817a333bcab tempest-AttachSCSIVolumeTestJSON-1697347357 tempest-AttachSCSIVolumeTestJSON-1697347357-project-member] Lock "8ee427dc-7aa0-4435-b23c-1223f2881df7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.221s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:14:03 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:14:03 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquiring lock "refresh_cache-8302d6e7-aaf3-461c-a55e-f2e685d1800d" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:14:03 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquired lock "refresh_cache-8302d6e7-aaf3-461c-a55e-f2e685d1800d" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:14:03 user nova-compute[73572]: DEBUG nova.network.neutron [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] [instance: 8302d6e7-aaf3-461c-a55e-f2e685d1800d] Forcefully refreshing network info cache for instance {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 10:14:04 user nova-compute[73572]: DEBUG nova.network.neutron [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] [instance: 8302d6e7-aaf3-461c-a55e-f2e685d1800d] Updating instance_info_cache with network_info: [{"id": "61c82fb7-2eee-4be0-a37f-669791ea6d9c", "address": "fa:16:3e:6a:1a:9f", "network": {"id": "f4c05fef-baf8-4c06-876f-1bdccd5a8689", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-169805980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27e946bd18464231965d43e20f1d2201", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61c82fb7-2e", "ovs_interfaceid": "61c82fb7-2eee-4be0-a37f-669791ea6d9c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:14:04 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Releasing lock "refresh_cache-8302d6e7-aaf3-461c-a55e-f2e685d1800d" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:14:04 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] [instance: 8302d6e7-aaf3-461c-a55e-f2e685d1800d] Updated the network info_cache for instance {{(pid=73572) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 10:14:05 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:14:07 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:14:07 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:14:07 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73572) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 10:14:08 user nova-compute[73572]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693044833.4274619, 61b60a19-597e-4dc1-af0f-a0ec95e9fd24 => Stopped> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:14:08 user nova-compute[73572]: INFO nova.compute.manager [-] [instance: 61b60a19-597e-4dc1-af0f-a0ec95e9fd24] VM Stopped (Lifecycle Event)
Aug 26 10:14:08 user nova-compute[73572]: DEBUG nova.compute.manager [None req-fd042393-73b8-42ad-abf3-350bb66ff04c None None] [instance: 61b60a19-597e-4dc1-af0f-a0ec95e9fd24] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:14:08 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:14:08 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:14:09 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2460cea7-39a4-4fcc-83ae-a7d44d9a0cbb tempest-VolumesAssistedSnapshotsTest-512654069 tempest-VolumesAssistedSnapshotsTest-512654069-project-admin] [instance: bc56542d-af1f-4313-8555-1b2014ff35e7] Calling os-brick to attach iSCSI Volume {{(pid=73572) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 10:14:09 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-2460cea7-39a4-4fcc-83ae-a7d44d9a0cbb tempest-VolumesAssistedSnapshotsTest-512654069 tempest-VolumesAssistedSnapshotsTest-512654069-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc89c3d6a10>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:4424a3fb-3e02-4aea-91af-bd569a2d90f1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YbndKNej', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 10:14:09 user nova-compute[73572]: WARNING os_brick.initiator.connectors.base [None req-2460cea7-39a4-4fcc-83ae-a7d44d9a0cbb tempest-VolumesAssistedSnapshotsTest-512654069 tempest-VolumesAssistedSnapshotsTest-512654069-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 10:14:09 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-2460cea7-39a4-4fcc-83ae-a7d44d9a0cbb tempest-VolumesAssistedSnapshotsTest-512654069 tempest-VolumesAssistedSnapshotsTest-512654069-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 10:14:09 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-2460cea7-39a4-4fcc-83ae-a7d44d9a0cbb tempest-VolumesAssistedSnapshotsTest-512654069 tempest-VolumesAssistedSnapshotsTest-512654069-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 10:14:09 user nova-compute[73572]: WARNING os_brick.initiator.connectors.base [None req-2460cea7-39a4-4fcc-83ae-a7d44d9a0cbb tempest-VolumesAssistedSnapshotsTest-512654069 tempest-VolumesAssistedSnapshotsTest-512654069-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 10:14:09 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-2460cea7-39a4-4fcc-83ae-a7d44d9a0cbb tempest-VolumesAssistedSnapshotsTest-512654069 tempest-VolumesAssistedSnapshotsTest-512654069-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4424a3fb-3e02-4aea-91af-bd569a2d90f1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 10:14:09 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-2460cea7-39a4-4fcc-83ae-a7d44d9a0cbb tempest-VolumesAssistedSnapshotsTest-512654069 tempest-VolumesAssistedSnapshotsTest-512654069-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4424a3fb-3e02-4aea-91af-bd569a2d90f1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 10:14:09 user nova-compute[73572]: INFO os_brick.initiator.connectors.iscsi [None req-2460cea7-39a4-4fcc-83ae-a7d44d9a0cbb tempest-VolumesAssistedSnapshotsTest-512654069 tempest-VolumesAssistedSnapshotsTest-512654069-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 10:14:09 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4424a3fb-3e02-4aea-91af-bd569a2d90f1 -p 172.16.0.220:3260 {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:14:09 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4424a3fb-3e02-4aea-91af-bd569a2d90f1 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:14:09 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[f105e6bb-99a0-4259-af7b-430b0593bd93]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:14:09 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-2460cea7-39a4-4fcc-83ae-a7d44d9a0cbb tempest-VolumesAssistedSnapshotsTest-512654069 tempest-VolumesAssistedSnapshotsTest-512654069-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 10:14:09 user nova-compute[73572]:  {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:14:09 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4424a3fb-3e02-4aea-91af-bd569a2d90f1 -p 172.16.0.220:3260 --interface default --op new {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:14:09 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4424a3fb-3e02-4aea-91af-bd569a2d90f1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:14:09 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc12c56f-a5f2-4b66-8fbc-0b2803c48a3d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4424a3fb-3e02-4aea-91af-bd569a2d90f1] added\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:14:09 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-2460cea7-39a4-4fcc-83ae-a7d44d9a0cbb tempest-VolumesAssistedSnapshotsTest-512654069 tempest-VolumesAssistedSnapshotsTest-512654069-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4424a3fb-3e02-4aea-91af-bd569a2d90f1] added
Aug 26 10:14:09 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:14:09 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4424a3fb-3e02-4aea-91af-bd569a2d90f1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:14:09 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4424a3fb-3e02-4aea-91af-bd569a2d90f1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.032s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:14:09 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bda73ec-dc04-41fb-a60f-761ff90db7a6]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:14:09 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-2460cea7-39a4-4fcc-83ae-a7d44d9a0cbb tempest-VolumesAssistedSnapshotsTest-512654069 tempest-VolumesAssistedSnapshotsTest-512654069-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:14:09 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4424a3fb-3e02-4aea-91af-bd569a2d90f1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:14:09 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4424a3fb-3e02-4aea-91af-bd569a2d90f1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:14:09 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[412da297-e1ff-4e72-8620-000396ea003e]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:14:09 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:14:09 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-2460cea7-39a4-4fcc-83ae-a7d44d9a0cbb tempest-VolumesAssistedSnapshotsTest-512654069 tempest-VolumesAssistedSnapshotsTest-512654069-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:14:09 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4424a3fb-3e02-4aea-91af-bd569a2d90f1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YbndKNej {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:14:09 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4424a3fb-3e02-4aea-91af-bd569a2d90f1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YbndKNej" returned: 0 in 0.021s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:14:09 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[533f96ec-497c-40e4-9d3f-8c2c56bf5b83]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:14:09 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-2460cea7-39a4-4fcc-83ae-a7d44d9a0cbb tempest-VolumesAssistedSnapshotsTest-512654069 tempest-VolumesAssistedSnapshotsTest-512654069-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YbndKNej'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:14:09 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4424a3fb-3e02-4aea-91af-bd569a2d90f1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:14:09 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4424a3fb-3e02-4aea-91af-bd569a2d90f1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:14:09 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[f22eb695-ca9e-4bc1-b574-4578ec19d150]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:14:09 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-2460cea7-39a4-4fcc-83ae-a7d44d9a0cbb tempest-VolumesAssistedSnapshotsTest-512654069 tempest-VolumesAssistedSnapshotsTest-512654069-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:14:09 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:14:09 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:14:09 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[18254838-a927-4e5f-ba9d-215a9fee98af]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09ba694f-cb2a-4600-abe9-924b41292479 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85988ff4-7fac-4a96-a502-74d6ca8189fe (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75ebe4c4-f791-4f09-a9bd-747ade3d70a3 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a00bb86-2eab-48d3-afc5-20fdd62650ae (non-flash)\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:14:09 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-2460cea7-39a4-4fcc-83ae-a7d44d9a0cbb tempest-VolumesAssistedSnapshotsTest-512654069 tempest-VolumesAssistedSnapshotsTest-512654069-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09ba694f-cb2a-4600-abe9-924b41292479 (non-flash)
Aug 26 10:14:09 user nova-compute[73572]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85988ff4-7fac-4a96-a502-74d6ca8189fe (non-flash)
Aug 26 10:14:09 user nova-compute[73572]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75ebe4c4-f791-4f09-a9bd-747ade3d70a3 (non-flash)
Aug 26 10:14:09 user nova-compute[73572]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a00bb86-2eab-48d3-afc5-20fdd62650ae (non-flash)
Aug 26 10:14:09 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 10:14:09 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-2460cea7-39a4-4fcc-83ae-a7d44d9a0cbb tempest-VolumesAssistedSnapshotsTest-512654069 tempest-VolumesAssistedSnapshotsTest-512654069-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09ba694f-cb2a-4600-abe9-924b41292479 (non-flash)
Aug 26 10:14:09 user nova-compute[73572]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85988ff4-7fac-4a96-a502-74d6ca8189fe (non-flash)
Aug 26 10:14:09 user nova-compute[73572]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75ebe4c4-f791-4f09-a9bd-747ade3d70a3 (non-flash)
Aug 26 10:14:09 user nova-compute[73572]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a00bb86-2eab-48d3-afc5-20fdd62650ae (non-flash)
Aug 26 10:14:09 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 10:14:09 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4424a3fb-3e02-4aea-91af-bd569a2d90f1 -p 172.16.0.220:3260 --login {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:14:09 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4424a3fb-3e02-4aea-91af-bd569a2d90f1 -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:14:09 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[1705a004-12e1-4bb4-b254-8c657f8d66ea]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4424a3fb-3e02-4aea-91af-bd569a2d90f1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4424a3fb-3e02-4aea-91af-bd569a2d90f1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:14:09 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-2460cea7-39a4-4fcc-83ae-a7d44d9a0cbb tempest-VolumesAssistedSnapshotsTest-512654069 tempest-VolumesAssistedSnapshotsTest-512654069-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4424a3fb-3e02-4aea-91af-bd569a2d90f1, portal: 172.16.0.220,3260]
Aug 26 10:14:09 user nova-compute[73572]: Login to [iface: default, target: iqn.2010-10.org.openstack:4424a3fb-3e02-4aea-91af-bd569a2d90f1, portal: 172.16.0.220,3260] successful.
Aug 26 10:14:09 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:14:09 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4424a3fb-3e02-4aea-91af-bd569a2d90f1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:14:09 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4424a3fb-3e02-4aea-91af-bd569a2d90f1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:14:09 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[94dab019-ba72-4fbd-aa37-acc573d66688]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:14:09 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-2460cea7-39a4-4fcc-83ae-a7d44d9a0cbb tempest-VolumesAssistedSnapshotsTest-512654069 tempest-VolumesAssistedSnapshotsTest-512654069-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:14:09 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:14:10 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:14:10 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb6a5720-199e-4a55-a363-e4eb42ffbe0c]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09ba694f-cb2a-4600-abe9-924b41292479 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85988ff4-7fac-4a96-a502-74d6ca8189fe (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75ebe4c4-f791-4f09-a9bd-747ade3d70a3 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a00bb86-2eab-48d3-afc5-20fdd62650ae (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4424a3fb-3e02-4aea-91af-bd569a2d90f1 (non-flash)\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:14:10 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-2460cea7-39a4-4fcc-83ae-a7d44d9a0cbb tempest-VolumesAssistedSnapshotsTest-512654069 tempest-VolumesAssistedSnapshotsTest-512654069-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09ba694f-cb2a-4600-abe9-924b41292479 (non-flash)
Aug 26 10:14:10 user nova-compute[73572]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85988ff4-7fac-4a96-a502-74d6ca8189fe (non-flash)
Aug 26 10:14:10 user nova-compute[73572]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75ebe4c4-f791-4f09-a9bd-747ade3d70a3 (non-flash)
Aug 26 10:14:10 user nova-compute[73572]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a00bb86-2eab-48d3-afc5-20fdd62650ae (non-flash)
Aug 26 10:14:10 user nova-compute[73572]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4424a3fb-3e02-4aea-91af-bd569a2d90f1 (non-flash)
Aug 26 10:14:10 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 10:14:10 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-2460cea7-39a4-4fcc-83ae-a7d44d9a0cbb tempest-VolumesAssistedSnapshotsTest-512654069 tempest-VolumesAssistedSnapshotsTest-512654069-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09ba694f-cb2a-4600-abe9-924b41292479 (non-flash)
Aug 26 10:14:10 user nova-compute[73572]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85988ff4-7fac-4a96-a502-74d6ca8189fe (non-flash)
Aug 26 10:14:10 user nova-compute[73572]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75ebe4c4-f791-4f09-a9bd-747ade3d70a3 (non-flash)
Aug 26 10:14:10 user nova-compute[73572]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a00bb86-2eab-48d3-afc5-20fdd62650ae (non-flash)
Aug 26 10:14:10 user nova-compute[73572]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4424a3fb-3e02-4aea-91af-bd569a2d90f1 (non-flash)
Aug 26 10:14:10 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 10:14:10 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-2460cea7-39a4-4fcc-83ae-a7d44d9a0cbb tempest-VolumesAssistedSnapshotsTest-512654069 tempest-VolumesAssistedSnapshotsTest-512654069-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4424a3fb-3e02-4aea-91af-bd569a2d90f1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.311s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 10:14:10 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-2460cea7-39a4-4fcc-83ae-a7d44d9a0cbb tempest-VolumesAssistedSnapshotsTest-512654069 tempest-VolumesAssistedSnapshotsTest-512654069-project-admin] Connected to 172.16.0.220:3260 {{(pid=73572) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 10:14:10 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-2460cea7-39a4-4fcc-83ae-a7d44d9a0cbb tempest-VolumesAssistedSnapshotsTest-512654069 tempest-VolumesAssistedSnapshotsTest-512654069-project-admin] HCTL ('37', '-', '-', 0) found on session 9 with lun 0 {{(pid=73572) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 10:14:10 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-2460cea7-39a4-4fcc-83ae-a7d44d9a0cbb tempest-VolumesAssistedSnapshotsTest-512654069 tempest-VolumesAssistedSnapshotsTest-512654069-project-admin] Scanning host 37 c: -, t: -, l: 0) {{(pid=73572) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 10:14:10 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:14:10 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.016s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:14:10 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cff45c7-ed3b-4ed5-b8f1-29e8c1d3210f]: (4, ('- - 0', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:14:10 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-2460cea7-39a4-4fcc-83ae-a7d44d9a0cbb tempest-VolumesAssistedSnapshotsTest-512654069 tempest-VolumesAssistedSnapshotsTest-512654069-project-admin] Searching for a device in session 9 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=73572) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 10:14:10 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-2460cea7-39a4-4fcc-83ae-a7d44d9a0cbb tempest-VolumesAssistedSnapshotsTest-512654069 tempest-VolumesAssistedSnapshotsTest-512654069-project-admin] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YbndKNej', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73572) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 10:14:10 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:14:10 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:14:10 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:14:11 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-2460cea7-39a4-4fcc-83ae-a7d44d9a0cbb tempest-VolumesAssistedSnapshotsTest-512654069 tempest-VolumesAssistedSnapshotsTest-512654069-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.349s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 10:14:11 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-2460cea7-39a4-4fcc-83ae-a7d44d9a0cbb tempest-VolumesAssistedSnapshotsTest-512654069 tempest-VolumesAssistedSnapshotsTest-512654069-project-admin] <== connect_volume: return (1350ms) {'type': 'block', 'scsi_wwn': '23633386665343961', 'path': '/dev/sdf'} {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 10:14:11 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2460cea7-39a4-4fcc-83ae-a7d44d9a0cbb tempest-VolumesAssistedSnapshotsTest-512654069 tempest-VolumesAssistedSnapshotsTest-512654069-project-admin] [instance: bc56542d-af1f-4313-8555-1b2014ff35e7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23633386665343961', 'path': '/dev/sdf'} {{(pid=73572) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 10:14:11 user nova-compute[73572]: DEBUG nova.objects.instance [None req-2460cea7-39a4-4fcc-83ae-a7d44d9a0cbb tempest-VolumesAssistedSnapshotsTest-512654069 tempest-VolumesAssistedSnapshotsTest-512654069-project-admin] Lazy-loading 'flavor' on Instance uuid bc56542d-af1f-4313-8555-1b2014ff35e7 {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:14:11 user nova-compute[73572]: DEBUG nova.virt.libvirt.guest [None req-2460cea7-39a4-4fcc-83ae-a7d44d9a0cbb tempest-VolumesAssistedSnapshotsTest-512654069 tempest-VolumesAssistedSnapshotsTest-512654069-project-admin] attach device xml: <disk type="block" device="disk">
Aug 26 10:14:11 user nova-compute[73572]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 10:14:11 user nova-compute[73572]:   <source dev="/dev/sdf"/>
Aug 26 10:14:11 user nova-compute[73572]:   <target dev="vdb" bus="virtio"/>
Aug 26 10:14:11 user nova-compute[73572]:   <serial>4424a3fb-3e02-4aea-91af-bd569a2d90f1</serial>
Aug 26 10:14:11 user nova-compute[73572]: </disk>
Aug 26 10:14:11 user nova-compute[73572]:  {{(pid=73572) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 10:14:11 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-2460cea7-39a4-4fcc-83ae-a7d44d9a0cbb tempest-VolumesAssistedSnapshotsTest-512654069 tempest-VolumesAssistedSnapshotsTest-512654069-project-admin] No BDM found with device name vda, not building metadata. {{(pid=73572) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 10:14:11 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-2460cea7-39a4-4fcc-83ae-a7d44d9a0cbb tempest-VolumesAssistedSnapshotsTest-512654069 tempest-VolumesAssistedSnapshotsTest-512654069-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=73572) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 10:14:11 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-2460cea7-39a4-4fcc-83ae-a7d44d9a0cbb tempest-VolumesAssistedSnapshotsTest-512654069 tempest-VolumesAssistedSnapshotsTest-512654069-project-admin] No VIF found with MAC fa:16:3e:72:9b:7b, not building metadata {{(pid=73572) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 10:14:11 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-2460cea7-39a4-4fcc-83ae-a7d44d9a0cbb tempest-VolumesAssistedSnapshotsTest-512654069 tempest-VolumesAssistedSnapshotsTest-512654069-project-admin] Lock "bc56542d-af1f-4313-8555-1b2014ff35e7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 15.755s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:14:12 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-a585469f-f4b7-4cec-b960-fbbb06d58af7 tempest-VolumesAssistedSnapshotsTest-1465128422 tempest-VolumesAssistedSnapshotsTest-1465128422-project] [instance: bc56542d-af1f-4313-8555-1b2014ff35e7] volume_snapshot_create: create_info: {'snapshot_id': '9cf52cb0-513f-4962-a36d-0d0840d71db1', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=73572) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3566}}
Aug 26 10:14:12 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-a585469f-f4b7-4cec-b960-fbbb06d58af7 tempest-VolumesAssistedSnapshotsTest-1465128422 tempest-VolumesAssistedSnapshotsTest-1465128422-project] [instance: bc56542d-af1f-4313-8555-1b2014ff35e7] snap xml: <domainsnapshot>
Aug 26 10:14:12 user nova-compute[73572]:   <disks>
Aug 26 10:14:12 user nova-compute[73572]:     <disk name="/dev/sdf" snapshot="external" type="file">
Aug 26 10:14:12 user nova-compute[73572]:       <source file="/dev/new_file"/>
Aug 26 10:14:12 user nova-compute[73572]:     </disk>
Aug 26 10:14:12 user nova-compute[73572]:     <disk name="vda" snapshot="no"/>
Aug 26 10:14:12 user nova-compute[73572]:   </disks>
Aug 26 10:14:12 user nova-compute[73572]: </domainsnapshot>
Aug 26 10:14:12 user nova-compute[73572]:  {{(pid=73572) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3507}}
Aug 26 10:14:12 user nova-compute[73572]: DEBUG nova.objects.instance [None req-a585469f-f4b7-4cec-b960-fbbb06d58af7 tempest-VolumesAssistedSnapshotsTest-1465128422 tempest-VolumesAssistedSnapshotsTest-1465128422-project] Lazy-loading 'system_metadata' on Instance uuid bc56542d-af1f-4313-8555-1b2014ff35e7 {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:14:12 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-a585469f-f4b7-4cec-b960-fbbb06d58af7 tempest-VolumesAssistedSnapshotsTest-1465128422 tempest-VolumesAssistedSnapshotsTest-1465128422-project] [instance: bc56542d-af1f-4313-8555-1b2014ff35e7] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 26 10:14:12 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-9eb7e01e-3ec6-4fa7-911a-7c10f6f27a26 tempest-VolumesAssistedSnapshotsTest-1465128422 tempest-VolumesAssistedSnapshotsTest-1465128422-project] [instance: bc56542d-af1f-4313-8555-1b2014ff35e7] volume_snapshot_delete: delete_info: {'volume_id': '4424a3fb-3e02-4aea-91af-bd569a2d90f1'} {{(pid=73572) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3667}}
Aug 26 10:14:12 user nova-compute[73572]: ERROR nova.virt.libvirt.driver [None req-9eb7e01e-3ec6-4fa7-911a-7c10f6f27a26 tempest-VolumesAssistedSnapshotsTest-1465128422 tempest-VolumesAssistedSnapshotsTest-1465128422-project] [instance: bc56542d-af1f-4313-8555-1b2014ff35e7] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Aug 26 10:14:12 user nova-compute[73572]: ERROR nova.virt.libvirt.driver [instance: bc56542d-af1f-4313-8555-1b2014ff35e7] Traceback (most recent call last):
Aug 26 10:14:12 user nova-compute[73572]: ERROR nova.virt.libvirt.driver [instance: bc56542d-af1f-4313-8555-1b2014ff35e7]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3840, in volume_snapshot_delete
Aug 26 10:14:12 user nova-compute[73572]: ERROR nova.virt.libvirt.driver [instance: bc56542d-af1f-4313-8555-1b2014ff35e7]     self._volume_snapshot_delete(context, instance, volume_id,
Aug 26 10:14:12 user nova-compute[73572]: ERROR nova.virt.libvirt.driver [instance: bc56542d-af1f-4313-8555-1b2014ff35e7]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3670, in _volume_snapshot_delete
Aug 26 10:14:12 user nova-compute[73572]: ERROR nova.virt.libvirt.driver [instance: bc56542d-af1f-4313-8555-1b2014ff35e7]     if delete_info['type'] != 'qcow2':
Aug 26 10:14:12 user nova-compute[73572]: ERROR nova.virt.libvirt.driver [instance: bc56542d-af1f-4313-8555-1b2014ff35e7] KeyError: 'type'
Aug 26 10:14:12 user nova-compute[73572]: ERROR nova.virt.libvirt.driver [instance: bc56542d-af1f-4313-8555-1b2014ff35e7] 
Aug 26 10:14:12 user nova-compute[73572]: ERROR nova.virt.libvirt.driver [None req-a585469f-f4b7-4cec-b960-fbbb06d58af7 tempest-VolumesAssistedSnapshotsTest-1465128422 tempest-VolumesAssistedSnapshotsTest-1465128422-project] [instance: bc56542d-af1f-4313-8555-1b2014ff35e7] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 26 10:14:12 user nova-compute[73572]: ERROR nova.virt.libvirt.driver [instance: bc56542d-af1f-4313-8555-1b2014ff35e7] Traceback (most recent call last):
Aug 26 10:14:12 user nova-compute[73572]: ERROR nova.virt.libvirt.driver [instance: bc56542d-af1f-4313-8555-1b2014ff35e7]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 26 10:14:12 user nova-compute[73572]: ERROR nova.virt.libvirt.driver [instance: bc56542d-af1f-4313-8555-1b2014ff35e7]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 26 10:14:12 user nova-compute[73572]: ERROR nova.virt.libvirt.driver [instance: bc56542d-af1f-4313-8555-1b2014ff35e7]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 26 10:14:12 user nova-compute[73572]: ERROR nova.virt.libvirt.driver [instance: bc56542d-af1f-4313-8555-1b2014ff35e7]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 26 10:14:12 user nova-compute[73572]: ERROR nova.virt.libvirt.driver [instance: bc56542d-af1f-4313-8555-1b2014ff35e7]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 26 10:14:12 user nova-compute[73572]: ERROR nova.virt.libvirt.driver [instance: bc56542d-af1f-4313-8555-1b2014ff35e7]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 26 10:14:12 user nova-compute[73572]: ERROR nova.virt.libvirt.driver [instance: bc56542d-af1f-4313-8555-1b2014ff35e7]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 26 10:14:12 user nova-compute[73572]: ERROR nova.virt.libvirt.driver [instance: bc56542d-af1f-4313-8555-1b2014ff35e7]     rv = execute(f, *args, **kwargs)
Aug 26 10:14:12 user nova-compute[73572]: ERROR nova.virt.libvirt.driver [instance: bc56542d-af1f-4313-8555-1b2014ff35e7]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 26 10:14:12 user nova-compute[73572]: ERROR nova.virt.libvirt.driver [instance: bc56542d-af1f-4313-8555-1b2014ff35e7]     six.reraise(c, e, tb)
Aug 26 10:14:12 user nova-compute[73572]: ERROR nova.virt.libvirt.driver [instance: bc56542d-af1f-4313-8555-1b2014ff35e7]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 26 10:14:12 user nova-compute[73572]: ERROR nova.virt.libvirt.driver [instance: bc56542d-af1f-4313-8555-1b2014ff35e7]     raise value
Aug 26 10:14:12 user nova-compute[73572]: ERROR nova.virt.libvirt.driver [instance: bc56542d-af1f-4313-8555-1b2014ff35e7]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 26 10:14:12 user nova-compute[73572]: ERROR nova.virt.libvirt.driver [instance: bc56542d-af1f-4313-8555-1b2014ff35e7]     rv = meth(*args, **kwargs)
Aug 26 10:14:12 user nova-compute[73572]: ERROR nova.virt.libvirt.driver [instance: bc56542d-af1f-4313-8555-1b2014ff35e7]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 26 10:14:12 user nova-compute[73572]: ERROR nova.virt.libvirt.driver [instance: bc56542d-af1f-4313-8555-1b2014ff35e7]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 26 10:14:12 user nova-compute[73572]: ERROR nova.virt.libvirt.driver [instance: bc56542d-af1f-4313-8555-1b2014ff35e7] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 26 10:14:12 user nova-compute[73572]: ERROR nova.virt.libvirt.driver [instance: bc56542d-af1f-4313-8555-1b2014ff35e7] 
Aug 26 10:14:12 user nova-compute[73572]: ERROR nova.virt.libvirt.driver [None req-a585469f-f4b7-4cec-b960-fbbb06d58af7 tempest-VolumesAssistedSnapshotsTest-1465128422 tempest-VolumesAssistedSnapshotsTest-1465128422-project] [instance: bc56542d-af1f-4313-8555-1b2014ff35e7] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 26 10:14:12 user nova-compute[73572]: ERROR nova.virt.libvirt.driver [instance: bc56542d-af1f-4313-8555-1b2014ff35e7] Traceback (most recent call last):
Aug 26 10:14:12 user nova-compute[73572]: ERROR nova.virt.libvirt.driver [instance: bc56542d-af1f-4313-8555-1b2014ff35e7]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3584, in volume_snapshot_create
Aug 26 10:14:12 user nova-compute[73572]: ERROR nova.virt.libvirt.driver [instance: bc56542d-af1f-4313-8555-1b2014ff35e7]     self._volume_snapshot_create(context, instance, guest,
Aug 26 10:14:12 user nova-compute[73572]: ERROR nova.virt.libvirt.driver [instance: bc56542d-af1f-4313-8555-1b2014ff35e7]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 26 10:14:12 user nova-compute[73572]: ERROR nova.virt.libvirt.driver [instance: bc56542d-af1f-4313-8555-1b2014ff35e7]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 26 10:14:12 user nova-compute[73572]: ERROR nova.virt.libvirt.driver [instance: bc56542d-af1f-4313-8555-1b2014ff35e7]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 26 10:14:12 user nova-compute[73572]: ERROR nova.virt.libvirt.driver [instance: bc56542d-af1f-4313-8555-1b2014ff35e7]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 26 10:14:12 user nova-compute[73572]: ERROR nova.virt.libvirt.driver [instance: bc56542d-af1f-4313-8555-1b2014ff35e7]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 26 10:14:12 user nova-compute[73572]: ERROR nova.virt.libvirt.driver [instance: bc56542d-af1f-4313-8555-1b2014ff35e7]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 26 10:14:12 user nova-compute[73572]: ERROR nova.virt.libvirt.driver [instance: bc56542d-af1f-4313-8555-1b2014ff35e7]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 26 10:14:12 user nova-compute[73572]: ERROR nova.virt.libvirt.driver [instance: bc56542d-af1f-4313-8555-1b2014ff35e7]     rv = execute(f, *args, **kwargs)
Aug 26 10:14:12 user nova-compute[73572]: ERROR nova.virt.libvirt.driver [instance: bc56542d-af1f-4313-8555-1b2014ff35e7]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 26 10:14:12 user nova-compute[73572]: ERROR nova.virt.libvirt.driver [instance: bc56542d-af1f-4313-8555-1b2014ff35e7]     six.reraise(c, e, tb)
Aug 26 10:14:12 user nova-compute[73572]: ERROR nova.virt.libvirt.driver [instance: bc56542d-af1f-4313-8555-1b2014ff35e7]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 26 10:14:12 user nova-compute[73572]: ERROR nova.virt.libvirt.driver [instance: bc56542d-af1f-4313-8555-1b2014ff35e7]     raise value
Aug 26 10:14:12 user nova-compute[73572]: ERROR nova.virt.libvirt.driver [instance: bc56542d-af1f-4313-8555-1b2014ff35e7]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 26 10:14:12 user nova-compute[73572]: ERROR nova.virt.libvirt.driver [instance: bc56542d-af1f-4313-8555-1b2014ff35e7]     rv = meth(*args, **kwargs)
Aug 26 10:14:12 user nova-compute[73572]: ERROR nova.virt.libvirt.driver [instance: bc56542d-af1f-4313-8555-1b2014ff35e7]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 26 10:14:12 user nova-compute[73572]: ERROR nova.virt.libvirt.driver [instance: bc56542d-af1f-4313-8555-1b2014ff35e7]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 26 10:14:12 user nova-compute[73572]: ERROR nova.virt.libvirt.driver [instance: bc56542d-af1f-4313-8555-1b2014ff35e7] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 26 10:14:12 user nova-compute[73572]: ERROR nova.virt.libvirt.driver [instance: bc56542d-af1f-4313-8555-1b2014ff35e7] 
Aug 26 10:14:12 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:14:12 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:14:12 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:14:12 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:14:12 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Auditing locally available compute resources for user (node: user) {{(pid=73572) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 10:14:12 user nova-compute[73572]: ERROR nova.virt.libvirt.driver [None req-a585469f-f4b7-4cec-b960-fbbb06d58af7 tempest-VolumesAssistedSnapshotsTest-1465128422 tempest-VolumesAssistedSnapshotsTest-1465128422-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot 9cf52cb0-513f-4962-a36d-0d0840d71db1 could not be found.
Aug 26 10:14:12 user nova-compute[73572]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 26 10:14:12 user nova-compute[73572]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3584, in volume_snapshot_create
Aug 26 10:14:12 user nova-compute[73572]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Aug 26 10:14:12 user nova-compute[73572]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 26 10:14:12 user nova-compute[73572]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 26 10:14:12 user nova-compute[73572]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 26 10:14:12 user nova-compute[73572]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 26 10:14:12 user nova-compute[73572]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 26 10:14:12 user nova-compute[73572]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 26 10:14:12 user nova-compute[73572]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 26 10:14:12 user nova-compute[73572]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Aug 26 10:14:12 user nova-compute[73572]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 26 10:14:12 user nova-compute[73572]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Aug 26 10:14:12 user nova-compute[73572]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 26 10:14:12 user nova-compute[73572]: ERROR nova.virt.libvirt.driver     raise value
Aug 26 10:14:12 user nova-compute[73572]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 26 10:14:12 user nova-compute[73572]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Aug 26 10:14:12 user nova-compute[73572]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 26 10:14:12 user nova-compute[73572]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 26 10:14:12 user nova-compute[73572]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 26 10:14:12 user nova-compute[73572]: ERROR nova.virt.libvirt.driver 
Aug 26 10:14:12 user nova-compute[73572]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 26 10:14:12 user nova-compute[73572]: ERROR nova.virt.libvirt.driver 
Aug 26 10:14:12 user nova-compute[73572]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 26 10:14:12 user nova-compute[73572]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 26 10:14:12 user nova-compute[73572]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 26 10:14:12 user nova-compute[73572]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 26 10:14:12 user nova-compute[73572]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 26 10:14:12 user nova-compute[73572]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 26 10:14:12 user nova-compute[73572]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 26 10:14:12 user nova-compute[73572]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 26 10:14:12 user nova-compute[73572]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 26 10:14:12 user nova-compute[73572]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 26 10:14:12 user nova-compute[73572]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 26 10:14:12 user nova-compute[73572]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 26 10:14:12 user nova-compute[73572]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 26 10:14:12 user nova-compute[73572]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 26 10:14:12 user nova-compute[73572]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 26 10:14:12 user nova-compute[73572]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot 9cf52cb0-513f-4962-a36d-0d0840d71db1 could not be found. (HTTP 404) (Request-ID: req-e2024ee3-1adc-4818-af13-b9fc930f7b92)
Aug 26 10:14:12 user nova-compute[73572]: ERROR nova.virt.libvirt.driver 
Aug 26 10:14:12 user nova-compute[73572]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 26 10:14:12 user nova-compute[73572]: ERROR nova.virt.libvirt.driver 
Aug 26 10:14:12 user nova-compute[73572]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 26 10:14:12 user nova-compute[73572]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3406, in _volume_snapshot_update_status
Aug 26 10:14:12 user nova-compute[73572]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Aug 26 10:14:12 user nova-compute[73572]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Aug 26 10:14:12 user nova-compute[73572]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Aug 26 10:14:12 user nova-compute[73572]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Aug 26 10:14:12 user nova-compute[73572]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Aug 26 10:14:12 user nova-compute[73572]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Aug 26 10:14:12 user nova-compute[73572]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Aug 26 10:14:12 user nova-compute[73572]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 26 10:14:12 user nova-compute[73572]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 26 10:14:12 user nova-compute[73572]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 26 10:14:12 user nova-compute[73572]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 26 10:14:12 user nova-compute[73572]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 26 10:14:12 user nova-compute[73572]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 26 10:14:12 user nova-compute[73572]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 26 10:14:12 user nova-compute[73572]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 26 10:14:12 user nova-compute[73572]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 26 10:14:12 user nova-compute[73572]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 26 10:14:12 user nova-compute[73572]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 26 10:14:12 user nova-compute[73572]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 26 10:14:12 user nova-compute[73572]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 26 10:14:12 user nova-compute[73572]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 26 10:14:12 user nova-compute[73572]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot 9cf52cb0-513f-4962-a36d-0d0840d71db1 could not be found.
Aug 26 10:14:12 user nova-compute[73572]: ERROR nova.virt.libvirt.driver 
Aug 26 10:14:12 user nova-compute[73572]: ERROR nova.virt.libvirt.driver [None req-9eb7e01e-3ec6-4fa7-911a-7c10f6f27a26 tempest-VolumesAssistedSnapshotsTest-1465128422 tempest-VolumesAssistedSnapshotsTest-1465128422-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Aug 26 10:14:12 user nova-compute[73572]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 26 10:14:12 user nova-compute[73572]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3840, in volume_snapshot_delete
Aug 26 10:14:12 user nova-compute[73572]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Aug 26 10:14:12 user nova-compute[73572]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3670, in _volume_snapshot_delete
Aug 26 10:14:12 user nova-compute[73572]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Aug 26 10:14:12 user nova-compute[73572]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Aug 26 10:14:12 user nova-compute[73572]: ERROR nova.virt.libvirt.driver 
Aug 26 10:14:12 user nova-compute[73572]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 26 10:14:12 user nova-compute[73572]: ERROR nova.virt.libvirt.driver 
Aug 26 10:14:12 user nova-compute[73572]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 26 10:14:12 user nova-compute[73572]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 26 10:14:12 user nova-compute[73572]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 26 10:14:12 user nova-compute[73572]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 26 10:14:12 user nova-compute[73572]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 26 10:14:12 user nova-compute[73572]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 26 10:14:12 user nova-compute[73572]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 26 10:14:12 user nova-compute[73572]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 26 10:14:12 user nova-compute[73572]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 26 10:14:12 user nova-compute[73572]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 26 10:14:12 user nova-compute[73572]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 26 10:14:12 user nova-compute[73572]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 26 10:14:12 user nova-compute[73572]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 26 10:14:12 user nova-compute[73572]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 26 10:14:12 user nova-compute[73572]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 26 10:14:12 user nova-compute[73572]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-a4215e1e-185e-4b8d-beee-cc106306b370)
Aug 26 10:14:12 user nova-compute[73572]: ERROR nova.virt.libvirt.driver 
Aug 26 10:14:12 user nova-compute[73572]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 26 10:14:12 user nova-compute[73572]: ERROR nova.virt.libvirt.driver 
Aug 26 10:14:12 user nova-compute[73572]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 26 10:14:12 user nova-compute[73572]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3406, in _volume_snapshot_update_status
Aug 26 10:14:12 user nova-compute[73572]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Aug 26 10:14:12 user nova-compute[73572]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Aug 26 10:14:12 user nova-compute[73572]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Aug 26 10:14:12 user nova-compute[73572]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Aug 26 10:14:12 user nova-compute[73572]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Aug 26 10:14:12 user nova-compute[73572]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Aug 26 10:14:12 user nova-compute[73572]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Aug 26 10:14:12 user nova-compute[73572]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 26 10:14:12 user nova-compute[73572]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 26 10:14:12 user nova-compute[73572]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 26 10:14:12 user nova-compute[73572]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 26 10:14:12 user nova-compute[73572]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 26 10:14:12 user nova-compute[73572]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 26 10:14:12 user nova-compute[73572]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 26 10:14:12 user nova-compute[73572]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 26 10:14:12 user nova-compute[73572]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 26 10:14:12 user nova-compute[73572]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 26 10:14:12 user nova-compute[73572]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 26 10:14:12 user nova-compute[73572]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 26 10:14:12 user nova-compute[73572]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 26 10:14:12 user nova-compute[73572]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 26 10:14:12 user nova-compute[73572]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Aug 26 10:14:12 user nova-compute[73572]: ERROR nova.virt.libvirt.driver 
Aug 26 10:14:12 user nova-compute[73572]: ERROR oslo_messaging.rpc.server [None req-a585469f-f4b7-4cec-b960-fbbb06d58af7 tempest-VolumesAssistedSnapshotsTest-1465128422 tempest-VolumesAssistedSnapshotsTest-1465128422-project] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 26 10:14:12 user nova-compute[73572]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Aug 26 10:14:12 user nova-compute[73572]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Aug 26 10:14:12 user nova-compute[73572]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Aug 26 10:14:12 user nova-compute[73572]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Aug 26 10:14:12 user nova-compute[73572]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Aug 26 10:14:12 user nova-compute[73572]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Aug 26 10:14:12 user nova-compute[73572]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Aug 26 10:14:12 user nova-compute[73572]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Aug 26 10:14:12 user nova-compute[73572]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Aug 26 10:14:12 user nova-compute[73572]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Aug 26 10:14:12 user nova-compute[73572]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 26 10:14:12 user nova-compute[73572]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 26 10:14:12 user nova-compute[73572]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 26 10:14:12 user nova-compute[73572]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 26 10:14:12 user nova-compute[73572]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 26 10:14:12 user nova-compute[73572]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Aug 26 10:14:12 user nova-compute[73572]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Aug 26 10:14:12 user nova-compute[73572]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4425, in volume_snapshot_create
Aug 26 10:14:12 user nova-compute[73572]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Aug 26 10:14:12 user nova-compute[73572]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3587, in volume_snapshot_create
Aug 26 10:14:12 user nova-compute[73572]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 26 10:14:12 user nova-compute[73572]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 26 10:14:12 user nova-compute[73572]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 26 10:14:12 user nova-compute[73572]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 26 10:14:12 user nova-compute[73572]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 26 10:14:12 user nova-compute[73572]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3584, in volume_snapshot_create
Aug 26 10:14:12 user nova-compute[73572]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Aug 26 10:14:12 user nova-compute[73572]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 26 10:14:12 user nova-compute[73572]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 26 10:14:12 user nova-compute[73572]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 26 10:14:12 user nova-compute[73572]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 26 10:14:12 user nova-compute[73572]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 26 10:14:12 user nova-compute[73572]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 26 10:14:12 user nova-compute[73572]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 26 10:14:12 user nova-compute[73572]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Aug 26 10:14:12 user nova-compute[73572]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 26 10:14:12 user nova-compute[73572]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Aug 26 10:14:12 user nova-compute[73572]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 26 10:14:12 user nova-compute[73572]: ERROR oslo_messaging.rpc.server     raise value
Aug 26 10:14:12 user nova-compute[73572]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 26 10:14:12 user nova-compute[73572]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Aug 26 10:14:12 user nova-compute[73572]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 26 10:14:12 user nova-compute[73572]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 26 10:14:12 user nova-compute[73572]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 26 10:14:12 user nova-compute[73572]: ERROR oslo_messaging.rpc.server 
Aug 26 10:14:12 user nova-compute[73572]: ERROR oslo_messaging.rpc.server [None req-9eb7e01e-3ec6-4fa7-911a-7c10f6f27a26 tempest-VolumesAssistedSnapshotsTest-1465128422 tempest-VolumesAssistedSnapshotsTest-1465128422-project] Exception during message handling: KeyError: 'type'
Aug 26 10:14:12 user nova-compute[73572]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Aug 26 10:14:12 user nova-compute[73572]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Aug 26 10:14:12 user nova-compute[73572]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Aug 26 10:14:12 user nova-compute[73572]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Aug 26 10:14:12 user nova-compute[73572]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Aug 26 10:14:12 user nova-compute[73572]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Aug 26 10:14:12 user nova-compute[73572]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Aug 26 10:14:12 user nova-compute[73572]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Aug 26 10:14:12 user nova-compute[73572]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Aug 26 10:14:12 user nova-compute[73572]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Aug 26 10:14:12 user nova-compute[73572]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 26 10:14:12 user nova-compute[73572]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 26 10:14:12 user nova-compute[73572]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 26 10:14:12 user nova-compute[73572]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 26 10:14:12 user nova-compute[73572]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 26 10:14:12 user nova-compute[73572]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Aug 26 10:14:12 user nova-compute[73572]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Aug 26 10:14:12 user nova-compute[73572]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4437, in volume_snapshot_delete
Aug 26 10:14:12 user nova-compute[73572]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Aug 26 10:14:12 user nova-compute[73572]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3843, in volume_snapshot_delete
Aug 26 10:14:12 user nova-compute[73572]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 26 10:14:12 user nova-compute[73572]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 26 10:14:12 user nova-compute[73572]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 26 10:14:12 user nova-compute[73572]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 26 10:14:12 user nova-compute[73572]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 26 10:14:12 user nova-compute[73572]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3840, in volume_snapshot_delete
Aug 26 10:14:12 user nova-compute[73572]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Aug 26 10:14:12 user nova-compute[73572]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3670, in _volume_snapshot_delete
Aug 26 10:14:12 user nova-compute[73572]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Aug 26 10:14:12 user nova-compute[73572]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Aug 26 10:14:12 user nova-compute[73572]: ERROR oslo_messaging.rpc.server 
Aug 26 10:14:13 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc56542d-af1f-4313-8555-1b2014ff35e7/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:14:13 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-ea45212a-dca7-4efd-99ed-c018c0cfb82d tempest-VolumesAssistedSnapshotsTest-512654069 tempest-VolumesAssistedSnapshotsTest-512654069-project-admin] Acquiring lock "bc56542d-af1f-4313-8555-1b2014ff35e7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:14:13 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-ea45212a-dca7-4efd-99ed-c018c0cfb82d tempest-VolumesAssistedSnapshotsTest-512654069 tempest-VolumesAssistedSnapshotsTest-512654069-project-admin] Lock "bc56542d-af1f-4313-8555-1b2014ff35e7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:14:13 user nova-compute[73572]: INFO nova.compute.manager [None req-ea45212a-dca7-4efd-99ed-c018c0cfb82d tempest-VolumesAssistedSnapshotsTest-512654069 tempest-VolumesAssistedSnapshotsTest-512654069-project-admin] [instance: bc56542d-af1f-4313-8555-1b2014ff35e7] Detaching volume 4424a3fb-3e02-4aea-91af-bd569a2d90f1
Aug 26 10:14:13 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc56542d-af1f-4313-8555-1b2014ff35e7/disk --force-share --output=json" returned: 0 in 0.302s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:14:13 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc56542d-af1f-4313-8555-1b2014ff35e7/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:14:13 user nova-compute[73572]: INFO nova.virt.block_device [None req-ea45212a-dca7-4efd-99ed-c018c0cfb82d tempest-VolumesAssistedSnapshotsTest-512654069 tempest-VolumesAssistedSnapshotsTest-512654069-project-admin] [instance: bc56542d-af1f-4313-8555-1b2014ff35e7] Attempting to driver detach volume 4424a3fb-3e02-4aea-91af-bd569a2d90f1 from mountpoint /dev/vdb
Aug 26 10:14:13 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-ea45212a-dca7-4efd-99ed-c018c0cfb82d tempest-VolumesAssistedSnapshotsTest-512654069 tempest-VolumesAssistedSnapshotsTest-512654069-project-admin] Attempting to detach device vdb from instance bc56542d-af1f-4313-8555-1b2014ff35e7 from the persistent domain config. {{(pid=73572) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 10:14:13 user nova-compute[73572]: DEBUG nova.virt.libvirt.guest [None req-ea45212a-dca7-4efd-99ed-c018c0cfb82d tempest-VolumesAssistedSnapshotsTest-512654069 tempest-VolumesAssistedSnapshotsTest-512654069-project-admin] detach device xml: <disk type="block" device="disk">
Aug 26 10:14:13 user nova-compute[73572]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 10:14:13 user nova-compute[73572]:   <source dev="/dev/sdf"/>
Aug 26 10:14:13 user nova-compute[73572]:   <target dev="vdb" bus="virtio"/>
Aug 26 10:14:13 user nova-compute[73572]:   <serial>4424a3fb-3e02-4aea-91af-bd569a2d90f1</serial>
Aug 26 10:14:13 user nova-compute[73572]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 10:14:13 user nova-compute[73572]: </disk>
Aug 26 10:14:13 user nova-compute[73572]:  {{(pid=73572) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 10:14:13 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-ea45212a-dca7-4efd-99ed-c018c0cfb82d tempest-VolumesAssistedSnapshotsTest-512654069 tempest-VolumesAssistedSnapshotsTest-512654069-project-admin] Successfully detached device vdb from instance bc56542d-af1f-4313-8555-1b2014ff35e7 from the persistent domain config.
Aug 26 10:14:13 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-ea45212a-dca7-4efd-99ed-c018c0cfb82d tempest-VolumesAssistedSnapshotsTest-512654069 tempest-VolumesAssistedSnapshotsTest-512654069-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance bc56542d-af1f-4313-8555-1b2014ff35e7 from the live domain config. {{(pid=73572) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 10:14:13 user nova-compute[73572]: DEBUG nova.virt.libvirt.guest [None req-ea45212a-dca7-4efd-99ed-c018c0cfb82d tempest-VolumesAssistedSnapshotsTest-512654069 tempest-VolumesAssistedSnapshotsTest-512654069-project-admin] detach device xml: <disk type="block" device="disk">
Aug 26 10:14:13 user nova-compute[73572]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 10:14:13 user nova-compute[73572]:   <source dev="/dev/sdf"/>
Aug 26 10:14:13 user nova-compute[73572]:   <target dev="vdb" bus="virtio"/>
Aug 26 10:14:13 user nova-compute[73572]:   <serial>4424a3fb-3e02-4aea-91af-bd569a2d90f1</serial>
Aug 26 10:14:13 user nova-compute[73572]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 10:14:13 user nova-compute[73572]: </disk>
Aug 26 10:14:13 user nova-compute[73572]:  {{(pid=73572) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 10:14:13 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc56542d-af1f-4313-8555-1b2014ff35e7/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:14:13 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=73572) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 10:14:13 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8302d6e7-aaf3-461c-a55e-f2e685d1800d/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:14:13 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8302d6e7-aaf3-461c-a55e-f2e685d1800d/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:14:13 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8302d6e7-aaf3-461c-a55e-f2e685d1800d/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:14:13 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8302d6e7-aaf3-461c-a55e-f2e685d1800d/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:14:13 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c785b609-0068-442f-91f5-d26e888a993f/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:14:13 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:14:13 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Received event <DeviceRemovedEvent: 1693044853.9297206, bc56542d-af1f-4313-8555-1b2014ff35e7 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73572) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 10:14:13 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-ea45212a-dca7-4efd-99ed-c018c0cfb82d tempest-VolumesAssistedSnapshotsTest-512654069 tempest-VolumesAssistedSnapshotsTest-512654069-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance bc56542d-af1f-4313-8555-1b2014ff35e7 {{(pid=73572) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 10:14:13 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-ea45212a-dca7-4efd-99ed-c018c0cfb82d tempest-VolumesAssistedSnapshotsTest-512654069 tempest-VolumesAssistedSnapshotsTest-512654069-project-admin] Successfully detached device vdb from instance bc56542d-af1f-4313-8555-1b2014ff35e7 from the live domain config.
Aug 26 10:14:13 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ea45212a-dca7-4efd-99ed-c018c0cfb82d tempest-VolumesAssistedSnapshotsTest-512654069 tempest-VolumesAssistedSnapshotsTest-512654069-project-admin] [instance: bc56542d-af1f-4313-8555-1b2014ff35e7] calling os-brick to detach iSCSI Volume {{(pid=73572) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 10:14:13 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea45212a-dca7-4efd-99ed-c018c0cfb82d tempest-VolumesAssistedSnapshotsTest-512654069 tempest-VolumesAssistedSnapshotsTest-512654069-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc89c3d6a10>, {'target_iqns': ['iqn.2010-10.org.openstack:4424a3fb-3e02-4aea-91af-bd569a2d90f1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YbndKNej', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 10:14:13 user nova-compute[73572]: WARNING os_brick.initiator.connectors.base [None req-ea45212a-dca7-4efd-99ed-c018c0cfb82d tempest-VolumesAssistedSnapshotsTest-512654069 tempest-VolumesAssistedSnapshotsTest-512654069-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 10:14:13 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-ea45212a-dca7-4efd-99ed-c018c0cfb82d tempest-VolumesAssistedSnapshotsTest-512654069 tempest-VolumesAssistedSnapshotsTest-512654069-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 10:14:13 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-ea45212a-dca7-4efd-99ed-c018c0cfb82d tempest-VolumesAssistedSnapshotsTest-512654069 tempest-VolumesAssistedSnapshotsTest-512654069-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 10:14:13 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea45212a-dca7-4efd-99ed-c018c0cfb82d tempest-VolumesAssistedSnapshotsTest-512654069 tempest-VolumesAssistedSnapshotsTest-512654069-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4424a3fb-3e02-4aea-91af-bd569a2d90f1', 0)] {{(pid=73572) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 10:14:13 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:14:14 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:14:14 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a404046-462d-447f-9ce2-f0f9a1324e03]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:09ba694f-cb2a-4600-abe9-924b41292479\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4424a3fb-3e02-4aea-91af-bd569a2d90f1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:75ebe4c4-f791-4f09-a9bd-747ade3d70a3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:85988ff4-7fac-4a96-a502-74d6ca8189fe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9a00bb86-2eab-48d3-afc5-20fdd62650ae\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:14:14 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:14:14 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:14:14 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[6060f537-b2ab-4a1f-bbf4-45709bbd1f6d]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09ba694f-cb2a-4600-abe9-924b41292479 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85988ff4-7fac-4a96-a502-74d6ca8189fe (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75ebe4c4-f791-4f09-a9bd-747ade3d70a3 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a00bb86-2eab-48d3-afc5-20fdd62650ae (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4424a3fb-3e02-4aea-91af-bd569a2d90f1 (non-flash)\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:14:14 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea45212a-dca7-4efd-99ed-c018c0cfb82d tempest-VolumesAssistedSnapshotsTest-512654069 tempest-VolumesAssistedSnapshotsTest-512654069-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09ba694f-cb2a-4600-abe9-924b41292479 (non-flash)
Aug 26 10:14:14 user nova-compute[73572]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85988ff4-7fac-4a96-a502-74d6ca8189fe (non-flash)
Aug 26 10:14:14 user nova-compute[73572]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75ebe4c4-f791-4f09-a9bd-747ade3d70a3 (non-flash)
Aug 26 10:14:14 user nova-compute[73572]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a00bb86-2eab-48d3-afc5-20fdd62650ae (non-flash)
Aug 26 10:14:14 user nova-compute[73572]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4424a3fb-3e02-4aea-91af-bd569a2d90f1 (non-flash)
Aug 26 10:14:14 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 10:14:14 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea45212a-dca7-4efd-99ed-c018c0cfb82d tempest-VolumesAssistedSnapshotsTest-512654069 tempest-VolumesAssistedSnapshotsTest-512654069-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09ba694f-cb2a-4600-abe9-924b41292479 (non-flash)
Aug 26 10:14:14 user nova-compute[73572]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85988ff4-7fac-4a96-a502-74d6ca8189fe (non-flash)
Aug 26 10:14:14 user nova-compute[73572]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75ebe4c4-f791-4f09-a9bd-747ade3d70a3 (non-flash)
Aug 26 10:14:14 user nova-compute[73572]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a00bb86-2eab-48d3-afc5-20fdd62650ae (non-flash)
Aug 26 10:14:14 user nova-compute[73572]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4424a3fb-3e02-4aea-91af-bd569a2d90f1 (non-flash)
Aug 26 10:14:14 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 10:14:14 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea45212a-dca7-4efd-99ed-c018c0cfb82d tempest-VolumesAssistedSnapshotsTest-512654069 tempest-VolumesAssistedSnapshotsTest-512654069-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc878d3bbe0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4424a3fb-3e02-4aea-91af-bd569a2d90f1'): ({'sdf'}, set())}) {{(pid=73572) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 10:14:14 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-ea45212a-dca7-4efd-99ed-c018c0cfb82d tempest-VolumesAssistedSnapshotsTest-512654069 tempest-VolumesAssistedSnapshotsTest-512654069-project-admin] Removing single pathed devices sdf {{(pid=73572) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 10:14:14 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:14:14 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:14:14 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ccc4b2f-12ac-4766-a441-33e934ed5b96]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:14:14 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:14:14 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c785b609-0068-442f-91f5-d26e888a993f/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:14:14 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c785b609-0068-442f-91f5-d26e888a993f/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:14:14 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.117s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:14:14 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[4be0240e-5aea-4138-9852-6fb87bdf53cd]: (4, ('ok\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:14:14 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-ea45212a-dca7-4efd-99ed-c018c0cfb82d tempest-VolumesAssistedSnapshotsTest-512654069 tempest-VolumesAssistedSnapshotsTest-512654069-project-admin] Flushing IO for device /dev/sdf {{(pid=73572) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 10:14:14 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:14:14 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:14:14 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[42151e6d-236e-4bf0-a9e2-085c462c7dc1]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:14:14 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-ea45212a-dca7-4efd-99ed-c018c0cfb82d tempest-VolumesAssistedSnapshotsTest-512654069 tempest-VolumesAssistedSnapshotsTest-512654069-project-admin] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=73572) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 10:14:14 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:14:14 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.047s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:14:14 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[c91b426c-73a6-4729-a18e-c40e50b36e38]: (4, ('1', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:14:14 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-ea45212a-dca7-4efd-99ed-c018c0cfb82d tempest-VolumesAssistedSnapshotsTest-512654069 tempest-VolumesAssistedSnapshotsTest-512654069-project-admin] Checking to see if SCSI volumes sdf have been removed. {{(pid=73572) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 10:14:14 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-ea45212a-dca7-4efd-99ed-c018c0cfb82d tempest-VolumesAssistedSnapshotsTest-512654069 tempest-VolumesAssistedSnapshotsTest-512654069-project-admin] SCSI volumes sdf have been removed. {{(pid=73572) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 10:14:14 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea45212a-dca7-4efd-99ed-c018c0cfb82d tempest-VolumesAssistedSnapshotsTest-512654069 tempest-VolumesAssistedSnapshotsTest-512654069-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4424a3fb-3e02-4aea-91af-bd569a2d90f1')] {{(pid=73572) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 10:14:14 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4424a3fb-3e02-4aea-91af-bd569a2d90f1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:14:14 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4424a3fb-3e02-4aea-91af-bd569a2d90f1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:14:14 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[68751c2a-6204-45ae-afd3-a4ffe4332a97]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:14:14 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea45212a-dca7-4efd-99ed-c018c0cfb82d tempest-VolumesAssistedSnapshotsTest-512654069 tempest-VolumesAssistedSnapshotsTest-512654069-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:14:14 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4424a3fb-3e02-4aea-91af-bd569a2d90f1 -p 172.16.0.220:3260 --logout {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:14:14 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c785b609-0068-442f-91f5-d26e888a993f/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:14:14 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c225e50a-3760-43d4-b398-3a663b478873/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:14:14 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4424a3fb-3e02-4aea-91af-bd569a2d90f1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:14:14 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cecf521-2492-45a6-9c1c-732610b7e265]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:4424a3fb-3e02-4aea-91af-bd569a2d90f1, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:4424a3fb-3e02-4aea-91af-bd569a2d90f1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:14:14 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea45212a-dca7-4efd-99ed-c018c0cfb82d tempest-VolumesAssistedSnapshotsTest-512654069 tempest-VolumesAssistedSnapshotsTest-512654069-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:4424a3fb-3e02-4aea-91af-bd569a2d90f1, portal: 172.16.0.220,3260]
Aug 26 10:14:14 user nova-compute[73572]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:4424a3fb-3e02-4aea-91af-bd569a2d90f1, portal: 172.16.0.220,3260] successful.
Aug 26 10:14:14 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:14:14 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4424a3fb-3e02-4aea-91af-bd569a2d90f1 -p 172.16.0.220:3260 --op delete {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:14:14 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4424a3fb-3e02-4aea-91af-bd569a2d90f1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:14:14 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f1e97cb-dd49-4cc5-8547-e307442e5223]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:14:14 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea45212a-dca7-4efd-99ed-c018c0cfb82d tempest-VolumesAssistedSnapshotsTest-512654069 tempest-VolumesAssistedSnapshotsTest-512654069-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:14:14 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-ea45212a-dca7-4efd-99ed-c018c0cfb82d tempest-VolumesAssistedSnapshotsTest-512654069 tempest-VolumesAssistedSnapshotsTest-512654069-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.418s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 10:14:14 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea45212a-dca7-4efd-99ed-c018c0cfb82d tempest-VolumesAssistedSnapshotsTest-512654069 tempest-VolumesAssistedSnapshotsTest-512654069-project-admin] <== disconnect_volume: return (421ms) None {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 10:14:14 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ea45212a-dca7-4efd-99ed-c018c0cfb82d tempest-VolumesAssistedSnapshotsTest-512654069 tempest-VolumesAssistedSnapshotsTest-512654069-project-admin] [instance: bc56542d-af1f-4313-8555-1b2014ff35e7] Disconnected iSCSI Volume {{(pid=73572) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 10:14:14 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c225e50a-3760-43d4-b398-3a663b478873/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:14:14 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c225e50a-3760-43d4-b398-3a663b478873/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:14:14 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c225e50a-3760-43d4-b398-3a663b478873/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:14:14 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2a731d2-13ff-49e5-ab17-80686b622df7/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:14:14 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2a731d2-13ff-49e5-ab17-80686b622df7/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:14:14 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2a731d2-13ff-49e5-ab17-80686b622df7/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:14:15 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2a731d2-13ff-49e5-ab17-80686b622df7/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:14:15 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=73572) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 10:14:15 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b140c11-1a26-4312-9cec-8054582d15f5/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:14:15 user nova-compute[73572]: DEBUG nova.objects.instance [None req-ea45212a-dca7-4efd-99ed-c018c0cfb82d tempest-VolumesAssistedSnapshotsTest-512654069 tempest-VolumesAssistedSnapshotsTest-512654069-project-admin] Lazy-loading 'flavor' on Instance uuid bc56542d-af1f-4313-8555-1b2014ff35e7 {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:14:15 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-ea45212a-dca7-4efd-99ed-c018c0cfb82d tempest-VolumesAssistedSnapshotsTest-512654069 tempest-VolumesAssistedSnapshotsTest-512654069-project-admin] Lock "bc56542d-af1f-4313-8555-1b2014ff35e7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.101s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:14:15 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b140c11-1a26-4312-9cec-8054582d15f5/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:14:15 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b140c11-1a26-4312-9cec-8054582d15f5/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:14:15 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b140c11-1a26-4312-9cec-8054582d15f5/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:14:15 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee9bcbaa-25a6-4588-b757-2a2ae15b6cf8/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:14:15 user nova-compute[73572]: DEBUG nova.compute.manager [None req-e74da60b-5f05-43fc-9489-ef79e69997a9 tempest-TestVolumeSwap-269763820 tempest-TestVolumeSwap-269763820-project-admin] [instance: d2a731d2-13ff-49e5-ab17-80686b622df7] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:c383a00f-3f34-40ef-a526-7425cfc92877'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cfJeYboX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd2a731d2-13ff-49e5-ab17-80686b622df7', 'attached_at': '', 'detached_at': '', 'volume_id': 'c383a00f-3f34-40ef-a526-7425cfc92877', 'serial': 'c383a00f-3f34-40ef-a526-7425cfc92877'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:9a00bb86-2eab-48d3-afc5-20fdd62650ae'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IUzhMJwv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': 'd2a731d2-13ff-49e5-ab17-80686b622df7', 'attached_at': '', 'detached_at': '', 'volume_id': '9a00bb86-2eab-48d3-afc5-20fdd62650ae', 'serial'} {{(pid=73572) _swap_volume /opt/stack/nova/nova/compute/manager.py:7702}}
Aug 26 10:14:15 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee9bcbaa-25a6-4588-b757-2a2ae15b6cf8/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:14:15 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee9bcbaa-25a6-4588-b757-2a2ae15b6cf8/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:14:15 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e74da60b-5f05-43fc-9489-ef79e69997a9 tempest-TestVolumeSwap-269763820 tempest-TestVolumeSwap-269763820-project-admin] [instance: d2a731d2-13ff-49e5-ab17-80686b622df7] Calling os-brick to attach iSCSI Volume {{(pid=73572) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 10:14:15 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-e74da60b-5f05-43fc-9489-ef79e69997a9 tempest-TestVolumeSwap-269763820 tempest-TestVolumeSwap-269763820-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc89c3d6a10>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:c383a00f-3f34-40ef-a526-7425cfc92877'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cfJeYboX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 10:14:15 user nova-compute[73572]: WARNING os_brick.initiator.connectors.base [None req-e74da60b-5f05-43fc-9489-ef79e69997a9 tempest-TestVolumeSwap-269763820 tempest-TestVolumeSwap-269763820-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 10:14:15 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-e74da60b-5f05-43fc-9489-ef79e69997a9 tempest-TestVolumeSwap-269763820 tempest-TestVolumeSwap-269763820-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 10:14:15 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-e74da60b-5f05-43fc-9489-ef79e69997a9 tempest-TestVolumeSwap-269763820 tempest-TestVolumeSwap-269763820-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 10:14:15 user nova-compute[73572]: WARNING os_brick.initiator.connectors.base [None req-e74da60b-5f05-43fc-9489-ef79e69997a9 tempest-TestVolumeSwap-269763820 tempest-TestVolumeSwap-269763820-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 10:14:15 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-e74da60b-5f05-43fc-9489-ef79e69997a9 tempest-TestVolumeSwap-269763820 tempest-TestVolumeSwap-269763820-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c383a00f-3f34-40ef-a526-7425cfc92877" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 10:14:15 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-e74da60b-5f05-43fc-9489-ef79e69997a9 tempest-TestVolumeSwap-269763820 tempest-TestVolumeSwap-269763820-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c383a00f-3f34-40ef-a526-7425cfc92877" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 10:14:15 user nova-compute[73572]: INFO os_brick.initiator.connectors.iscsi [None req-e74da60b-5f05-43fc-9489-ef79e69997a9 tempest-TestVolumeSwap-269763820 tempest-TestVolumeSwap-269763820-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 10:14:15 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c383a00f-3f34-40ef-a526-7425cfc92877 -p 172.16.0.220:3260 {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:14:15 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c383a00f-3f34-40ef-a526-7425cfc92877 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:14:15 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[6de79ec7-e7a9-488e-9090-9d2ebf31e3e3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:14:15 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-e74da60b-5f05-43fc-9489-ef79e69997a9 tempest-TestVolumeSwap-269763820 tempest-TestVolumeSwap-269763820-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 10:14:15 user nova-compute[73572]:  {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:14:15 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c383a00f-3f34-40ef-a526-7425cfc92877 -p 172.16.0.220:3260 --interface default --op new {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:14:15 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c383a00f-3f34-40ef-a526-7425cfc92877 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:14:15 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[87ee611b-1511-4f53-b99f-30aea01bcea9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c383a00f-3f34-40ef-a526-7425cfc92877] added\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:14:15 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-e74da60b-5f05-43fc-9489-ef79e69997a9 tempest-TestVolumeSwap-269763820 tempest-TestVolumeSwap-269763820-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c383a00f-3f34-40ef-a526-7425cfc92877] added
Aug 26 10:14:15 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:14:15 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c383a00f-3f34-40ef-a526-7425cfc92877 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:14:15 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c383a00f-3f34-40ef-a526-7425cfc92877 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:14:15 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[997eb215-abc5-47c5-bf1a-5c39b26ca960]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:14:15 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-e74da60b-5f05-43fc-9489-ef79e69997a9 tempest-TestVolumeSwap-269763820 tempest-TestVolumeSwap-269763820-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:14:15 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c383a00f-3f34-40ef-a526-7425cfc92877 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:14:15 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c383a00f-3f34-40ef-a526-7425cfc92877 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:14:15 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[74ba3dcb-6ce8-4f62-83e9-c027ae23b758]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:14:15 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-e74da60b-5f05-43fc-9489-ef79e69997a9 tempest-TestVolumeSwap-269763820 tempest-TestVolumeSwap-269763820-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:14:15 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c383a00f-3f34-40ef-a526-7425cfc92877 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cfJeYboX {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:14:15 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c383a00f-3f34-40ef-a526-7425cfc92877 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cfJeYboX" returned: 0 in 0.019s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:14:15 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ee6fa2f-7fa4-4c61-862a-fca10eccd250]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:14:15 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-e74da60b-5f05-43fc-9489-ef79e69997a9 tempest-TestVolumeSwap-269763820 tempest-TestVolumeSwap-269763820-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cfJeYboX'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:14:15 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c383a00f-3f34-40ef-a526-7425cfc92877 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:14:15 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c383a00f-3f34-40ef-a526-7425cfc92877 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:14:15 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f6978d2-82fc-4d5c-a8bc-842de8552a58]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:14:15 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-e74da60b-5f05-43fc-9489-ef79e69997a9 tempest-TestVolumeSwap-269763820 tempest-TestVolumeSwap-269763820-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:14:15 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee9bcbaa-25a6-4588-b757-2a2ae15b6cf8/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:14:15 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:14:15 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3c0b9c1-4218-4d6e-acac-d5d1dcf4f1b8/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:14:15 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:14:15 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d516892-80ea-46bd-878b-6cdd128639a1]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09ba694f-cb2a-4600-abe9-924b41292479 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85988ff4-7fac-4a96-a502-74d6ca8189fe (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75ebe4c4-f791-4f09-a9bd-747ade3d70a3 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a00bb86-2eab-48d3-afc5-20fdd62650ae (non-flash)\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:14:15 user nova-compute[73572]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693044840.8233323, 8ee427dc-7aa0-4435-b23c-1223f2881df7 => Stopped> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:14:15 user nova-compute[73572]: INFO nova.compute.manager [-] [instance: 8ee427dc-7aa0-4435-b23c-1223f2881df7] VM Stopped (Lifecycle Event)
Aug 26 10:14:15 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-e74da60b-5f05-43fc-9489-ef79e69997a9 tempest-TestVolumeSwap-269763820 tempest-TestVolumeSwap-269763820-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09ba694f-cb2a-4600-abe9-924b41292479 (non-flash)
Aug 26 10:14:15 user nova-compute[73572]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85988ff4-7fac-4a96-a502-74d6ca8189fe (non-flash)
Aug 26 10:14:15 user nova-compute[73572]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75ebe4c4-f791-4f09-a9bd-747ade3d70a3 (non-flash)
Aug 26 10:14:15 user nova-compute[73572]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a00bb86-2eab-48d3-afc5-20fdd62650ae (non-flash)
Aug 26 10:14:15 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 10:14:15 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-e74da60b-5f05-43fc-9489-ef79e69997a9 tempest-TestVolumeSwap-269763820 tempest-TestVolumeSwap-269763820-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09ba694f-cb2a-4600-abe9-924b41292479 (non-flash)
Aug 26 10:14:15 user nova-compute[73572]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85988ff4-7fac-4a96-a502-74d6ca8189fe (non-flash)
Aug 26 10:14:15 user nova-compute[73572]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75ebe4c4-f791-4f09-a9bd-747ade3d70a3 (non-flash)
Aug 26 10:14:15 user nova-compute[73572]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a00bb86-2eab-48d3-afc5-20fdd62650ae (non-flash)
Aug 26 10:14:15 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 10:14:15 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c383a00f-3f34-40ef-a526-7425cfc92877 -p 172.16.0.220:3260 --login {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:14:15 user nova-compute[73572]: DEBUG nova.compute.manager [None req-d669a027-89dc-4f14-a8b2-9df3ae6e216b None None] [instance: 8ee427dc-7aa0-4435-b23c-1223f2881df7] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:14:15 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:14:15 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c383a00f-3f34-40ef-a526-7425cfc92877 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:14:15 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3e143b0-8cd3-48cc-9379-2e40094585a6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c383a00f-3f34-40ef-a526-7425cfc92877, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c383a00f-3f34-40ef-a526-7425cfc92877, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:14:15 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-e74da60b-5f05-43fc-9489-ef79e69997a9 tempest-TestVolumeSwap-269763820 tempest-TestVolumeSwap-269763820-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c383a00f-3f34-40ef-a526-7425cfc92877, portal: 172.16.0.220,3260]
Aug 26 10:14:15 user nova-compute[73572]: Login to [iface: default, target: iqn.2010-10.org.openstack:c383a00f-3f34-40ef-a526-7425cfc92877, portal: 172.16.0.220,3260] successful.
Aug 26 10:14:15 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:14:15 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c383a00f-3f34-40ef-a526-7425cfc92877 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:14:15 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c383a00f-3f34-40ef-a526-7425cfc92877 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:14:15 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[47b65eaf-c9b4-4aa3-b47d-f334e4c19232]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:14:15 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-e74da60b-5f05-43fc-9489-ef79e69997a9 tempest-TestVolumeSwap-269763820 tempest-TestVolumeSwap-269763820-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:14:15 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:14:15 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:14:15 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[68868dff-46a5-4cc0-a551-00f14df74a4d]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c383a00f-3f34-40ef-a526-7425cfc92877 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09ba694f-cb2a-4600-abe9-924b41292479 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85988ff4-7fac-4a96-a502-74d6ca8189fe (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75ebe4c4-f791-4f09-a9bd-747ade3d70a3 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a00bb86-2eab-48d3-afc5-20fdd62650ae (non-flash)\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:14:15 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-e74da60b-5f05-43fc-9489-ef79e69997a9 tempest-TestVolumeSwap-269763820 tempest-TestVolumeSwap-269763820-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c383a00f-3f34-40ef-a526-7425cfc92877 (non-flash)
Aug 26 10:14:15 user nova-compute[73572]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09ba694f-cb2a-4600-abe9-924b41292479 (non-flash)
Aug 26 10:14:15 user nova-compute[73572]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85988ff4-7fac-4a96-a502-74d6ca8189fe (non-flash)
Aug 26 10:14:15 user nova-compute[73572]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75ebe4c4-f791-4f09-a9bd-747ade3d70a3 (non-flash)
Aug 26 10:14:15 user nova-compute[73572]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a00bb86-2eab-48d3-afc5-20fdd62650ae (non-flash)
Aug 26 10:14:15 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 10:14:15 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-e74da60b-5f05-43fc-9489-ef79e69997a9 tempest-TestVolumeSwap-269763820 tempest-TestVolumeSwap-269763820-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c383a00f-3f34-40ef-a526-7425cfc92877 (non-flash)
Aug 26 10:14:15 user nova-compute[73572]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09ba694f-cb2a-4600-abe9-924b41292479 (non-flash)
Aug 26 10:14:15 user nova-compute[73572]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85988ff4-7fac-4a96-a502-74d6ca8189fe (non-flash)
Aug 26 10:14:15 user nova-compute[73572]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75ebe4c4-f791-4f09-a9bd-747ade3d70a3 (non-flash)
Aug 26 10:14:15 user nova-compute[73572]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a00bb86-2eab-48d3-afc5-20fdd62650ae (non-flash)
Aug 26 10:14:15 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 10:14:15 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-e74da60b-5f05-43fc-9489-ef79e69997a9 tempest-TestVolumeSwap-269763820 tempest-TestVolumeSwap-269763820-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c383a00f-3f34-40ef-a526-7425cfc92877" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.315s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 10:14:15 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-e74da60b-5f05-43fc-9489-ef79e69997a9 tempest-TestVolumeSwap-269763820 tempest-TestVolumeSwap-269763820-project-admin] Connected to 172.16.0.220:3260 {{(pid=73572) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 10:14:15 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-e74da60b-5f05-43fc-9489-ef79e69997a9 tempest-TestVolumeSwap-269763820 tempest-TestVolumeSwap-269763820-project-admin] HCTL ('37', '-', '-', 0) found on session 10 with lun 0 {{(pid=73572) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 10:14:15 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-e74da60b-5f05-43fc-9489-ef79e69997a9 tempest-TestVolumeSwap-269763820 tempest-TestVolumeSwap-269763820-project-admin] Scanning host 37 c: -, t: -, l: 0) {{(pid=73572) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 10:14:15 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:14:15 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3c0b9c1-4218-4d6e-acac-d5d1dcf4f1b8/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:14:15 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3c0b9c1-4218-4d6e-acac-d5d1dcf4f1b8/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:14:16 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.019s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:14:16 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a077c12-3d0a-4e2f-b1f6-7a783135a1a3]: (4, ('- - 0', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:14:16 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-e74da60b-5f05-43fc-9489-ef79e69997a9 tempest-TestVolumeSwap-269763820 tempest-TestVolumeSwap-269763820-project-admin] Searching for a device in session 10 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=73572) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 10:14:16 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-e74da60b-5f05-43fc-9489-ef79e69997a9 tempest-TestVolumeSwap-269763820 tempest-TestVolumeSwap-269763820-project-admin] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cfJeYboX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73572) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 10:14:16 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3c0b9c1-4218-4d6e-acac-d5d1dcf4f1b8/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:14:16 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c555f971-b177-4c26-a38e-09e0e78bf7b9/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:14:16 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c555f971-b177-4c26-a38e-09e0e78bf7b9/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:14:16 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c555f971-b177-4c26-a38e-09e0e78bf7b9/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:14:16 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c555f971-b177-4c26-a38e-09e0e78bf7b9/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:14:16 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73572) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 10:14:16 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73572) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 10:14:16 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=73572) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 10:14:17 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:14:17 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:14:17 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Hypervisor/Node resource view: name=user free_ram=7040MB free_disk=25.496002197265625GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=73572) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 10:14:17 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:14:17 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:14:17 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-e74da60b-5f05-43fc-9489-ef79e69997a9 tempest-TestVolumeSwap-269763820 tempest-TestVolumeSwap-269763820-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.380s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 10:14:17 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-e74da60b-5f05-43fc-9489-ef79e69997a9 tempest-TestVolumeSwap-269763820 tempest-TestVolumeSwap-269763820-project-admin] <== connect_volume: return (1383ms) {'type': 'block', 'scsi_wwn': '23630613531346439', 'path': '/dev/sdf'} {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 10:14:17 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e74da60b-5f05-43fc-9489-ef79e69997a9 tempest-TestVolumeSwap-269763820 tempest-TestVolumeSwap-269763820-project-admin] [instance: d2a731d2-13ff-49e5-ab17-80686b622df7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23630613531346439', 'path': '/dev/sdf'} {{(pid=73572) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 10:14:17 user nova-compute[73572]: DEBUG nova.objects.instance [None req-e74da60b-5f05-43fc-9489-ef79e69997a9 tempest-TestVolumeSwap-269763820 tempest-TestVolumeSwap-269763820-project-admin] Lazy-loading 'flavor' on Instance uuid d2a731d2-13ff-49e5-ab17-80686b622df7 {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:14:17 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance c785b609-0068-442f-91f5-d26e888a993f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:14:17 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance 8302d6e7-aaf3-461c-a55e-f2e685d1800d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:14:17 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance c555f971-b177-4c26-a38e-09e0e78bf7b9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:14:17 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance ee9bcbaa-25a6-4588-b757-2a2ae15b6cf8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:14:17 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance d2a731d2-13ff-49e5-ab17-80686b622df7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:14:17 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance bc56542d-af1f-4313-8555-1b2014ff35e7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:14:17 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance 83670c16-3566-4679-8e74-c6451c840315 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:14:17 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance 0b140c11-1a26-4312-9cec-8054582d15f5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:14:17 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance c225e50a-3760-43d4-b398-3a663b478873 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:14:17 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance b3c0b9c1-4218-4d6e-acac-d5d1dcf4f1b8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:14:17 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=73572) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 10:14:17 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=73572) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 10:14:17 user nova-compute[73572]: DEBUG nova.compute.provider_tree [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Inventory has not changed in ProviderTree for provider: e2cec974-59b2-4c77-a53d-a7f4e5a30d75 {{(pid=73572) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 10:14:17 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Inventory has not changed for provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73572) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 10:14:17 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Compute_service record updated for user:user {{(pid=73572) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 10:14:17 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.410s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:14:17 user nova-compute[73572]: DEBUG nova.virt.libvirt.guest [None req-e74da60b-5f05-43fc-9489-ef79e69997a9 tempest-TestVolumeSwap-269763820 tempest-TestVolumeSwap-269763820-project-admin] COPY block job progress, current cursor: 9437184 final cursor: 1073741824 {{(pid=73572) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 10:14:17 user nova-compute[73572]: DEBUG nova.virt.libvirt.guest [None req-e74da60b-5f05-43fc-9489-ef79e69997a9 tempest-TestVolumeSwap-269763820 tempest-TestVolumeSwap-269763820-project-admin] COPY block job progress, current cursor: 119537664 final cursor: 1073741824 {{(pid=73572) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 10:14:18 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:14:18 user nova-compute[73572]: DEBUG nova.virt.libvirt.guest [None req-e74da60b-5f05-43fc-9489-ef79e69997a9 tempest-TestVolumeSwap-269763820 tempest-TestVolumeSwap-269763820-project-admin] COPY block job progress, current cursor: 239075328 final cursor: 1073741824 {{(pid=73572) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 10:14:18 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:14:18 user nova-compute[73572]: DEBUG nova.virt.libvirt.guest [None req-e74da60b-5f05-43fc-9489-ef79e69997a9 tempest-TestVolumeSwap-269763820 tempest-TestVolumeSwap-269763820-project-admin] COPY block job progress, current cursor: 384827392 final cursor: 1073741824 {{(pid=73572) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 10:14:19 user nova-compute[73572]: DEBUG nova.virt.libvirt.guest [None req-e74da60b-5f05-43fc-9489-ef79e69997a9 tempest-TestVolumeSwap-269763820 tempest-TestVolumeSwap-269763820-project-admin] COPY block job progress, current cursor: 521142272 final cursor: 1073741824 {{(pid=73572) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 10:14:20 user nova-compute[73572]: DEBUG nova.virt.libvirt.guest [None req-e74da60b-5f05-43fc-9489-ef79e69997a9 tempest-TestVolumeSwap-269763820 tempest-TestVolumeSwap-269763820-project-admin] COPY block job progress, current cursor: 689963008 final cursor: 1073741824 {{(pid=73572) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 10:14:20 user nova-compute[73572]: DEBUG nova.virt.libvirt.guest [None req-e74da60b-5f05-43fc-9489-ef79e69997a9 tempest-TestVolumeSwap-269763820 tempest-TestVolumeSwap-269763820-project-admin] COPY block job progress, current cursor: 816840704 final cursor: 1073741824 {{(pid=73572) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 10:14:20 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:14:21 user nova-compute[73572]: DEBUG nova.virt.libvirt.guest [None req-e74da60b-5f05-43fc-9489-ef79e69997a9 tempest-TestVolumeSwap-269763820 tempest-TestVolumeSwap-269763820-project-admin] COPY block job progress, current cursor: 964689920 final cursor: 1073741824 {{(pid=73572) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 10:14:21 user nova-compute[73572]: DEBUG nova.virt.libvirt.guest [None req-e74da60b-5f05-43fc-9489-ef79e69997a9 tempest-TestVolumeSwap-269763820 tempest-TestVolumeSwap-269763820-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=73572) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 10:14:21 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e74da60b-5f05-43fc-9489-ef79e69997a9 tempest-TestVolumeSwap-269763820 tempest-TestVolumeSwap-269763820-project-admin] [instance: d2a731d2-13ff-49e5-ab17-80686b622df7] calling os-brick to detach iSCSI Volume {{(pid=73572) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 10:14:21 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-e74da60b-5f05-43fc-9489-ef79e69997a9 tempest-TestVolumeSwap-269763820 tempest-TestVolumeSwap-269763820-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc89c3d6a10>, {'target_iqns': ['iqn.2010-10.org.openstack:9a00bb86-2eab-48d3-afc5-20fdd62650ae'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IUzhMJwv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 10:14:21 user nova-compute[73572]: WARNING os_brick.initiator.connectors.base [None req-e74da60b-5f05-43fc-9489-ef79e69997a9 tempest-TestVolumeSwap-269763820 tempest-TestVolumeSwap-269763820-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 10:14:21 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-e74da60b-5f05-43fc-9489-ef79e69997a9 tempest-TestVolumeSwap-269763820 tempest-TestVolumeSwap-269763820-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 10:14:21 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-e74da60b-5f05-43fc-9489-ef79e69997a9 tempest-TestVolumeSwap-269763820 tempest-TestVolumeSwap-269763820-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 10:14:21 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-e74da60b-5f05-43fc-9489-ef79e69997a9 tempest-TestVolumeSwap-269763820 tempest-TestVolumeSwap-269763820-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9a00bb86-2eab-48d3-afc5-20fdd62650ae', 0)] {{(pid=73572) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 10:14:21 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:14:21 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:14:21 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[45f140ba-726b-4edf-b118-924a247b6818]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:09ba694f-cb2a-4600-abe9-924b41292479\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:75ebe4c4-f791-4f09-a9bd-747ade3d70a3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:85988ff4-7fac-4a96-a502-74d6ca8189fe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9a00bb86-2eab-48d3-afc5-20fdd62650ae\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c383a00f-3f34-40ef-a526-7425cfc92877\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:14:21 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:14:21 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:14:21 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[c26022ab-6ad6-4f2b-8e08-89a8330d0f67]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c383a00f-3f34-40ef-a526-7425cfc92877 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09ba694f-cb2a-4600-abe9-924b41292479 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85988ff4-7fac-4a96-a502-74d6ca8189fe (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75ebe4c4-f791-4f09-a9bd-747ade3d70a3 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a00bb86-2eab-48d3-afc5-20fdd62650ae (non-flash)\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:14:21 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-e74da60b-5f05-43fc-9489-ef79e69997a9 tempest-TestVolumeSwap-269763820 tempest-TestVolumeSwap-269763820-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c383a00f-3f34-40ef-a526-7425cfc92877 (non-flash)
Aug 26 10:14:21 user nova-compute[73572]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09ba694f-cb2a-4600-abe9-924b41292479 (non-flash)
Aug 26 10:14:21 user nova-compute[73572]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85988ff4-7fac-4a96-a502-74d6ca8189fe (non-flash)
Aug 26 10:14:21 user nova-compute[73572]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75ebe4c4-f791-4f09-a9bd-747ade3d70a3 (non-flash)
Aug 26 10:14:21 user nova-compute[73572]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a00bb86-2eab-48d3-afc5-20fdd62650ae (non-flash)
Aug 26 10:14:21 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 10:14:21 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-e74da60b-5f05-43fc-9489-ef79e69997a9 tempest-TestVolumeSwap-269763820 tempest-TestVolumeSwap-269763820-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c383a00f-3f34-40ef-a526-7425cfc92877 (non-flash)
Aug 26 10:14:21 user nova-compute[73572]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09ba694f-cb2a-4600-abe9-924b41292479 (non-flash)
Aug 26 10:14:21 user nova-compute[73572]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85988ff4-7fac-4a96-a502-74d6ca8189fe (non-flash)
Aug 26 10:14:21 user nova-compute[73572]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75ebe4c4-f791-4f09-a9bd-747ade3d70a3 (non-flash)
Aug 26 10:14:21 user nova-compute[73572]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a00bb86-2eab-48d3-afc5-20fdd62650ae (non-flash)
Aug 26 10:14:21 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 10:14:21 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-e74da60b-5f05-43fc-9489-ef79e69997a9 tempest-TestVolumeSwap-269763820 tempest-TestVolumeSwap-269763820-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc878dce3b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9a00bb86-2eab-48d3-afc5-20fdd62650ae'): ({'sde'}, set())}) {{(pid=73572) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 10:14:21 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-e74da60b-5f05-43fc-9489-ef79e69997a9 tempest-TestVolumeSwap-269763820 tempest-TestVolumeSwap-269763820-project-admin] Removing single pathed devices sde {{(pid=73572) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 10:14:21 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:14:21 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:14:21 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[047215c2-7c6f-4d31-9074-366c002c4c47]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:14:21 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:14:21 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.017s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:14:21 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[177fb987-ac7b-40c7-aed8-c3f18208da81]: (4, ('ok\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:14:21 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-e74da60b-5f05-43fc-9489-ef79e69997a9 tempest-TestVolumeSwap-269763820 tempest-TestVolumeSwap-269763820-project-admin] Flushing IO for device /dev/sde {{(pid=73572) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 10:14:21 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:14:21 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:14:21 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[3658f2c4-3cb5-4f50-bcf5-bcecfe5ece1f]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:14:21 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-e74da60b-5f05-43fc-9489-ef79e69997a9 tempest-TestVolumeSwap-269763820 tempest-TestVolumeSwap-269763820-project-admin] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73572) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 10:14:21 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:14:21 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.046s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:14:21 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4f4cc0a-cf57-4624-ad45-5f5e0c000d88]: (4, ('1', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:14:21 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-e74da60b-5f05-43fc-9489-ef79e69997a9 tempest-TestVolumeSwap-269763820 tempest-TestVolumeSwap-269763820-project-admin] Checking to see if SCSI volumes sde have been removed. {{(pid=73572) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 10:14:21 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-e74da60b-5f05-43fc-9489-ef79e69997a9 tempest-TestVolumeSwap-269763820 tempest-TestVolumeSwap-269763820-project-admin] SCSI volumes sde have been removed. {{(pid=73572) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 10:14:21 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-e74da60b-5f05-43fc-9489-ef79e69997a9 tempest-TestVolumeSwap-269763820 tempest-TestVolumeSwap-269763820-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9a00bb86-2eab-48d3-afc5-20fdd62650ae')] {{(pid=73572) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 10:14:21 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a00bb86-2eab-48d3-afc5-20fdd62650ae -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:14:21 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a00bb86-2eab-48d3-afc5-20fdd62650ae -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:14:21 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[019c1727-62a4-478b-92b3-6b554ae34352]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:14:21 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-e74da60b-5f05-43fc-9489-ef79e69997a9 tempest-TestVolumeSwap-269763820 tempest-TestVolumeSwap-269763820-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:14:21 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a00bb86-2eab-48d3-afc5-20fdd62650ae -p 172.16.0.220:3260 --logout {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:14:21 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a00bb86-2eab-48d3-afc5-20fdd62650ae -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:14:21 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fc417bb-0743-4760-8902-33f96a9c0f22]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:9a00bb86-2eab-48d3-afc5-20fdd62650ae, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:9a00bb86-2eab-48d3-afc5-20fdd62650ae, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:14:21 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-e74da60b-5f05-43fc-9489-ef79e69997a9 tempest-TestVolumeSwap-269763820 tempest-TestVolumeSwap-269763820-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:9a00bb86-2eab-48d3-afc5-20fdd62650ae, portal: 172.16.0.220,3260]
Aug 26 10:14:21 user nova-compute[73572]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:9a00bb86-2eab-48d3-afc5-20fdd62650ae, portal: 172.16.0.220,3260] successful.
Aug 26 10:14:21 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:14:21 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a00bb86-2eab-48d3-afc5-20fdd62650ae -p 172.16.0.220:3260 --op delete {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:14:21 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a00bb86-2eab-48d3-afc5-20fdd62650ae -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:14:21 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2969a3a-44a1-48a5-b04e-c73d46b7ace5]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:14:21 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-e74da60b-5f05-43fc-9489-ef79e69997a9 tempest-TestVolumeSwap-269763820 tempest-TestVolumeSwap-269763820-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:14:21 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-e74da60b-5f05-43fc-9489-ef79e69997a9 tempest-TestVolumeSwap-269763820 tempest-TestVolumeSwap-269763820-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.285s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 10:14:21 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-e74da60b-5f05-43fc-9489-ef79e69997a9 tempest-TestVolumeSwap-269763820 tempest-TestVolumeSwap-269763820-project-admin] <== disconnect_volume: return (286ms) None {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 10:14:21 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e74da60b-5f05-43fc-9489-ef79e69997a9 tempest-TestVolumeSwap-269763820 tempest-TestVolumeSwap-269763820-project-admin] [instance: d2a731d2-13ff-49e5-ab17-80686b622df7] Disconnected iSCSI Volume {{(pid=73572) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 10:14:21 user nova-compute[73572]: DEBUG nova.compute.manager [None req-e74da60b-5f05-43fc-9489-ef79e69997a9 tempest-TestVolumeSwap-269763820 tempest-TestVolumeSwap-269763820-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:c383a00f-3f34-40ef-a526-7425cfc92877'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cfJeYboX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': 'd2a731d2-13ff-49e5-ab17-80686b622df7', 'attached_at': '', 'detached_at': '', 'volume_id': 'c383a00f-3f34-40ef-a526-7425cfc92877', 'serial'} {{(pid=73572) _swap_volume /opt/stack/nova/nova/compute/manager.py:7711}}
Aug 26 10:14:21 user nova-compute[73572]: DEBUG nova.compute.manager [None req-e74da60b-5f05-43fc-9489-ef79e69997a9 tempest-TestVolumeSwap-269763820 tempest-TestVolumeSwap-269763820-project-admin] [instance: d2a731d2-13ff-49e5-ab17-80686b622df7] swap_volume: removing Cinder connection for volume 9a00bb86-2eab-48d3-afc5-20fdd62650ae {{(pid=73572) _swap_volume /opt/stack/nova/nova/compute/manager.py:7756}}
Aug 26 10:14:22 user nova-compute[73572]: DEBUG nova.compute.manager [None req-e74da60b-5f05-43fc-9489-ef79e69997a9 tempest-TestVolumeSwap-269763820 tempest-TestVolumeSwap-269763820-project-admin] [instance: d2a731d2-13ff-49e5-ab17-80686b622df7] swap_volume: Updating volume 9a00bb86-2eab-48d3-afc5-20fdd62650ae BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqns": ["iqn.2010-10.org.openstack:c383a00f-3f34-40ef-a526-7425cfc92877"], "target_portals": ["172.16.0.220:3260"], "target_luns": [0], "target_discovered": false, "auth_method": "CHAP", "auth_username": "cfJeYboX", "auth_password": "PHl2Kgd0iFSmat", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdf", "volume_id": "c383a00f-3f34-40ef-a526-7425cfc92877"}, "status": "reserved", "instance": "d2a731d2-13ff-49e5-ab17-80686b622df7", "attached_at": "", "detached_at": "", "volume_id": "c383a00f-3f34-40ef-a526-7425cfc92877", "serial": "c383a00f-3f34-40ef-a526-7425cfc92877"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': 'c383a00f-3f34-40ef-a526-7425cfc92877', 'no_device': None, 'attachment_id': 'c9e0e306-f1d6-42dc-bfa2-3663477c2365'} {{(pid=73572) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7904}}
Aug 26 10:14:22 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-e74da60b-5f05-43fc-9489-ef79e69997a9 tempest-TestVolumeSwap-269763820 tempest-TestVolumeSwap-269763820-project-admin] Lock "d2a731d2-13ff-49e5-ab17-80686b622df7" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 19.205s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:14:23 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-a98b8ece-1576-4d8c-8230-9d701cd466a1 tempest-TestVolumeSwap-269763820 tempest-TestVolumeSwap-269763820-project-admin] Acquiring lock "d2a731d2-13ff-49e5-ab17-80686b622df7" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:14:23 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-a98b8ece-1576-4d8c-8230-9d701cd466a1 tempest-TestVolumeSwap-269763820 tempest-TestVolumeSwap-269763820-project-admin] Lock "d2a731d2-13ff-49e5-ab17-80686b622df7" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:14:23 user nova-compute[73572]: DEBUG os_brick.utils [None req-a98b8ece-1576-4d8c-8230-9d701cd466a1 tempest-TestVolumeSwap-269763820 tempest-TestVolumeSwap-269763820-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 10:14:23 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:14:23 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:14:23 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b4b8b5c-5630-4c79-81ae-c3573ab71854]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:de8a79ed912\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:14:23 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:14:23 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:14:23 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea708417-0bfc-48ee-975a-d5f668ea3460]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:14:23 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:14:23 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:14:23 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[eee368ab-be9f-418f-8c4f-ad4e45f0ff09]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:14:23 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cfba1f5-1c39-4397-b05f-c74f895155f9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:14:23 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-a98b8ece-1576-4d8c-8230-9d701cd466a1 tempest-TestVolumeSwap-269763820 tempest-TestVolumeSwap-269763820-project-admin] Running cmd (subprocess): nvme version {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:14:23 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-a98b8ece-1576-4d8c-8230-9d701cd466a1 tempest-TestVolumeSwap-269763820 tempest-TestVolumeSwap-269763820-project-admin] 'nvme version' failed. Not Retrying. {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 10:14:23 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a98b8ece-1576-4d8c-8230-9d701cd466a1 tempest-TestVolumeSwap-269763820 tempest-TestVolumeSwap-269763820-project-admin] nvme not present on system {{(pid=73572) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 10:14:23 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:14:23 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 10:14:23 user nova-compute[73572]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 10:14:23 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[f62e58f7-8e05-4a3d-b6c2-5656eb4bee9a]: (4, '') {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:14:23 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.lightos [None req-a98b8ece-1576-4d8c-8230-9d701cd466a1 tempest-TestVolumeSwap-269763820 tempest-TestVolumeSwap-269763820-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73572) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 10:14:23 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.lightos [None req-a98b8ece-1576-4d8c-8230-9d701cd466a1 tempest-TestVolumeSwap-269763820 tempest-TestVolumeSwap-269763820-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73572) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 10:14:23 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.lightos [None req-a98b8ece-1576-4d8c-8230-9d701cd466a1 tempest-TestVolumeSwap-269763820 tempest-TestVolumeSwap-269763820-project-admin] LIGHTOS: no hostnqn found. {{(pid=73572) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 10:14:23 user nova-compute[73572]: DEBUG os_brick.utils [None req-a98b8ece-1576-4d8c-8230-9d701cd466a1 tempest-TestVolumeSwap-269763820 tempest-TestVolumeSwap-269763820-project-admin] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:de8a79ed912', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 10:14:23 user nova-compute[73572]: INFO nova.compute.manager [None req-a98b8ece-1576-4d8c-8230-9d701cd466a1 tempest-TestVolumeSwap-269763820 tempest-TestVolumeSwap-269763820-project-admin] [instance: d2a731d2-13ff-49e5-ab17-80686b622df7] Swapping volume c383a00f-3f34-40ef-a526-7425cfc92877 for 9a00bb86-2eab-48d3-afc5-20fdd62650ae
Aug 26 10:14:25 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:14:28 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:14:30 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:14:34 user nova-compute[73572]: DEBUG nova.compute.manager [None req-a98b8ece-1576-4d8c-8230-9d701cd466a1 tempest-TestVolumeSwap-269763820 tempest-TestVolumeSwap-269763820-project-admin] [instance: d2a731d2-13ff-49e5-ab17-80686b622df7] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:9a00bb86-2eab-48d3-afc5-20fdd62650ae'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IUzhMJwv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd2a731d2-13ff-49e5-ab17-80686b622df7', 'attached_at': '', 'detached_at': '', 'volume_id': '9a00bb86-2eab-48d3-afc5-20fdd62650ae', 'serial': '9a00bb86-2eab-48d3-afc5-20fdd62650ae'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:c383a00f-3f34-40ef-a526-7425cfc92877'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cfJeYboX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf', 'volume_id': 'c383a00f-3f34-40ef-a526-7425cfc92877'}, 'status': 'reserved', 'instance': 'd2a731d2-13ff-49e5-ab17-80686b622df7', 'attached_at': '', 'detached_at': '', 'volume_id': 'c383a00f-3f34-40ef-a526-7425cfc92877', 'serial'} {{(pid=73572) _swap_volume /opt/stack/nova/nova/compute/manager.py:7702}}
Aug 26 10:14:34 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a98b8ece-1576-4d8c-8230-9d701cd466a1 tempest-TestVolumeSwap-269763820 tempest-TestVolumeSwap-269763820-project-admin] [instance: d2a731d2-13ff-49e5-ab17-80686b622df7] Calling os-brick to attach iSCSI Volume {{(pid=73572) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 10:14:34 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-a98b8ece-1576-4d8c-8230-9d701cd466a1 tempest-TestVolumeSwap-269763820 tempest-TestVolumeSwap-269763820-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc89c3d6a10>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:9a00bb86-2eab-48d3-afc5-20fdd62650ae'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IUzhMJwv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 10:14:34 user nova-compute[73572]: WARNING os_brick.initiator.connectors.base [None req-a98b8ece-1576-4d8c-8230-9d701cd466a1 tempest-TestVolumeSwap-269763820 tempest-TestVolumeSwap-269763820-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 10:14:34 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-a98b8ece-1576-4d8c-8230-9d701cd466a1 tempest-TestVolumeSwap-269763820 tempest-TestVolumeSwap-269763820-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 10:14:34 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-a98b8ece-1576-4d8c-8230-9d701cd466a1 tempest-TestVolumeSwap-269763820 tempest-TestVolumeSwap-269763820-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 10:14:34 user nova-compute[73572]: WARNING os_brick.initiator.connectors.base [None req-a98b8ece-1576-4d8c-8230-9d701cd466a1 tempest-TestVolumeSwap-269763820 tempest-TestVolumeSwap-269763820-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 10:14:34 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-a98b8ece-1576-4d8c-8230-9d701cd466a1 tempest-TestVolumeSwap-269763820 tempest-TestVolumeSwap-269763820-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9a00bb86-2eab-48d3-afc5-20fdd62650ae" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 10:14:34 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-a98b8ece-1576-4d8c-8230-9d701cd466a1 tempest-TestVolumeSwap-269763820 tempest-TestVolumeSwap-269763820-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9a00bb86-2eab-48d3-afc5-20fdd62650ae" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 10:14:34 user nova-compute[73572]: INFO os_brick.initiator.connectors.iscsi [None req-a98b8ece-1576-4d8c-8230-9d701cd466a1 tempest-TestVolumeSwap-269763820 tempest-TestVolumeSwap-269763820-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 10:14:34 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a00bb86-2eab-48d3-afc5-20fdd62650ae -p 172.16.0.220:3260 {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:14:34 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a00bb86-2eab-48d3-afc5-20fdd62650ae -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:14:34 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[80620180-0b53-49d7-b745-cac7635ee50e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:14:34 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-a98b8ece-1576-4d8c-8230-9d701cd466a1 tempest-TestVolumeSwap-269763820 tempest-TestVolumeSwap-269763820-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 10:14:34 user nova-compute[73572]:  {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:14:34 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a00bb86-2eab-48d3-afc5-20fdd62650ae -p 172.16.0.220:3260 --interface default --op new {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:14:34 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a00bb86-2eab-48d3-afc5-20fdd62650ae -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:14:34 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[4acdf05b-7727-4964-8023-26b1baef6c95]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9a00bb86-2eab-48d3-afc5-20fdd62650ae] added\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:14:34 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-a98b8ece-1576-4d8c-8230-9d701cd466a1 tempest-TestVolumeSwap-269763820 tempest-TestVolumeSwap-269763820-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9a00bb86-2eab-48d3-afc5-20fdd62650ae] added
Aug 26 10:14:34 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:14:34 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a00bb86-2eab-48d3-afc5-20fdd62650ae -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:14:34 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a00bb86-2eab-48d3-afc5-20fdd62650ae -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:14:34 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[29450cd3-de31-4d43-bb97-75fc130ae8e7]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:14:34 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-a98b8ece-1576-4d8c-8230-9d701cd466a1 tempest-TestVolumeSwap-269763820 tempest-TestVolumeSwap-269763820-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:14:34 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a00bb86-2eab-48d3-afc5-20fdd62650ae -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:14:34 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a00bb86-2eab-48d3-afc5-20fdd62650ae -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:14:34 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e01f454-b501-48da-9c7e-8920bbb6f97e]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:14:34 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-a98b8ece-1576-4d8c-8230-9d701cd466a1 tempest-TestVolumeSwap-269763820 tempest-TestVolumeSwap-269763820-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:14:34 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a00bb86-2eab-48d3-afc5-20fdd62650ae -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IUzhMJwv {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:14:34 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a00bb86-2eab-48d3-afc5-20fdd62650ae -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IUzhMJwv" returned: 0 in 0.017s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:14:34 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef6ad518-d822-433e-8bfe-9851f1e2072b]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:14:34 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-a98b8ece-1576-4d8c-8230-9d701cd466a1 tempest-TestVolumeSwap-269763820 tempest-TestVolumeSwap-269763820-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IUzhMJwv'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:14:34 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a00bb86-2eab-48d3-afc5-20fdd62650ae -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:14:34 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a00bb86-2eab-48d3-afc5-20fdd62650ae -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:14:34 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c76051a-8d5a-4c61-b01d-34d8619354fb]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:14:34 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-a98b8ece-1576-4d8c-8230-9d701cd466a1 tempest-TestVolumeSwap-269763820 tempest-TestVolumeSwap-269763820-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:14:34 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:14:34 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:14:34 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[71d21409-dc8a-496d-9437-056453a1c7a0]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c383a00f-3f34-40ef-a526-7425cfc92877 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09ba694f-cb2a-4600-abe9-924b41292479 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85988ff4-7fac-4a96-a502-74d6ca8189fe (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75ebe4c4-f791-4f09-a9bd-747ade3d70a3 (non-flash)\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:14:34 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-a98b8ece-1576-4d8c-8230-9d701cd466a1 tempest-TestVolumeSwap-269763820 tempest-TestVolumeSwap-269763820-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c383a00f-3f34-40ef-a526-7425cfc92877 (non-flash)
Aug 26 10:14:34 user nova-compute[73572]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09ba694f-cb2a-4600-abe9-924b41292479 (non-flash)
Aug 26 10:14:34 user nova-compute[73572]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85988ff4-7fac-4a96-a502-74d6ca8189fe (non-flash)
Aug 26 10:14:34 user nova-compute[73572]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75ebe4c4-f791-4f09-a9bd-747ade3d70a3 (non-flash)
Aug 26 10:14:34 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 10:14:34 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-a98b8ece-1576-4d8c-8230-9d701cd466a1 tempest-TestVolumeSwap-269763820 tempest-TestVolumeSwap-269763820-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c383a00f-3f34-40ef-a526-7425cfc92877 (non-flash)
Aug 26 10:14:34 user nova-compute[73572]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09ba694f-cb2a-4600-abe9-924b41292479 (non-flash)
Aug 26 10:14:34 user nova-compute[73572]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85988ff4-7fac-4a96-a502-74d6ca8189fe (non-flash)
Aug 26 10:14:34 user nova-compute[73572]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75ebe4c4-f791-4f09-a9bd-747ade3d70a3 (non-flash)
Aug 26 10:14:34 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 10:14:34 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a00bb86-2eab-48d3-afc5-20fdd62650ae -p 172.16.0.220:3260 --login {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:14:34 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a00bb86-2eab-48d3-afc5-20fdd62650ae -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:14:34 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[d81ad501-cabc-429c-92ec-2f07b80ea027]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9a00bb86-2eab-48d3-afc5-20fdd62650ae, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9a00bb86-2eab-48d3-afc5-20fdd62650ae, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:14:34 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-a98b8ece-1576-4d8c-8230-9d701cd466a1 tempest-TestVolumeSwap-269763820 tempest-TestVolumeSwap-269763820-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9a00bb86-2eab-48d3-afc5-20fdd62650ae, portal: 172.16.0.220,3260]
Aug 26 10:14:34 user nova-compute[73572]: Login to [iface: default, target: iqn.2010-10.org.openstack:9a00bb86-2eab-48d3-afc5-20fdd62650ae, portal: 172.16.0.220,3260] successful.
Aug 26 10:14:34 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:14:35 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a00bb86-2eab-48d3-afc5-20fdd62650ae -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:14:35 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a00bb86-2eab-48d3-afc5-20fdd62650ae -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:14:35 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b76d7df-3b2e-46bb-a17b-98156b60d407]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:14:35 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-a98b8ece-1576-4d8c-8230-9d701cd466a1 tempest-TestVolumeSwap-269763820 tempest-TestVolumeSwap-269763820-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:14:35 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:14:35 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:14:35 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[24b905a2-e24f-49c6-8f9a-3a3a7aab6290]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c383a00f-3f34-40ef-a526-7425cfc92877 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a00bb86-2eab-48d3-afc5-20fdd62650ae (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09ba694f-cb2a-4600-abe9-924b41292479 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85988ff4-7fac-4a96-a502-74d6ca8189fe (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75ebe4c4-f791-4f09-a9bd-747ade3d70a3 (non-flash)\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:14:35 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-a98b8ece-1576-4d8c-8230-9d701cd466a1 tempest-TestVolumeSwap-269763820 tempest-TestVolumeSwap-269763820-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c383a00f-3f34-40ef-a526-7425cfc92877 (non-flash)
Aug 26 10:14:35 user nova-compute[73572]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a00bb86-2eab-48d3-afc5-20fdd62650ae (non-flash)
Aug 26 10:14:35 user nova-compute[73572]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09ba694f-cb2a-4600-abe9-924b41292479 (non-flash)
Aug 26 10:14:35 user nova-compute[73572]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85988ff4-7fac-4a96-a502-74d6ca8189fe (non-flash)
Aug 26 10:14:35 user nova-compute[73572]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75ebe4c4-f791-4f09-a9bd-747ade3d70a3 (non-flash)
Aug 26 10:14:35 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 10:14:35 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-a98b8ece-1576-4d8c-8230-9d701cd466a1 tempest-TestVolumeSwap-269763820 tempest-TestVolumeSwap-269763820-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c383a00f-3f34-40ef-a526-7425cfc92877 (non-flash)
Aug 26 10:14:35 user nova-compute[73572]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a00bb86-2eab-48d3-afc5-20fdd62650ae (non-flash)
Aug 26 10:14:35 user nova-compute[73572]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09ba694f-cb2a-4600-abe9-924b41292479 (non-flash)
Aug 26 10:14:35 user nova-compute[73572]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85988ff4-7fac-4a96-a502-74d6ca8189fe (non-flash)
Aug 26 10:14:35 user nova-compute[73572]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75ebe4c4-f791-4f09-a9bd-747ade3d70a3 (non-flash)
Aug 26 10:14:35 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 10:14:35 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-a98b8ece-1576-4d8c-8230-9d701cd466a1 tempest-TestVolumeSwap-269763820 tempest-TestVolumeSwap-269763820-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9a00bb86-2eab-48d3-afc5-20fdd62650ae" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.285s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 10:14:35 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-a98b8ece-1576-4d8c-8230-9d701cd466a1 tempest-TestVolumeSwap-269763820 tempest-TestVolumeSwap-269763820-project-admin] Connected to 172.16.0.220:3260 {{(pid=73572) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 10:14:35 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-a98b8ece-1576-4d8c-8230-9d701cd466a1 tempest-TestVolumeSwap-269763820 tempest-TestVolumeSwap-269763820-project-admin] HCTL ('36', '-', '-', 0) found on session 11 with lun 0 {{(pid=73572) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 10:14:35 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-a98b8ece-1576-4d8c-8230-9d701cd466a1 tempest-TestVolumeSwap-269763820 tempest-TestVolumeSwap-269763820-project-admin] Scanning host 36 c: -, t: -, l: 0) {{(pid=73572) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 10:14:35 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:14:35 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:14:35 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[a796e9cf-39e6-4735-bc12-97a6c0171b1d]: (4, ('- - 0', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:14:35 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-a98b8ece-1576-4d8c-8230-9d701cd466a1 tempest-TestVolumeSwap-269763820 tempest-TestVolumeSwap-269763820-project-admin] Searching for a device in session 11 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73572) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 10:14:35 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-a98b8ece-1576-4d8c-8230-9d701cd466a1 tempest-TestVolumeSwap-269763820 tempest-TestVolumeSwap-269763820-project-admin] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IUzhMJwv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73572) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 10:14:35 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:14:36 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-a98b8ece-1576-4d8c-8230-9d701cd466a1 tempest-TestVolumeSwap-269763820 tempest-TestVolumeSwap-269763820-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.319s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 10:14:36 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-a98b8ece-1576-4d8c-8230-9d701cd466a1 tempest-TestVolumeSwap-269763820 tempest-TestVolumeSwap-269763820-project-admin] <== connect_volume: return (1320ms) {'type': 'block', 'scsi_wwn': '26265663232313263', 'path': '/dev/sde'} {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 10:14:36 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a98b8ece-1576-4d8c-8230-9d701cd466a1 tempest-TestVolumeSwap-269763820 tempest-TestVolumeSwap-269763820-project-admin] [instance: d2a731d2-13ff-49e5-ab17-80686b622df7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26265663232313263', 'path': '/dev/sde'} {{(pid=73572) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 10:14:36 user nova-compute[73572]: DEBUG nova.objects.instance [None req-a98b8ece-1576-4d8c-8230-9d701cd466a1 tempest-TestVolumeSwap-269763820 tempest-TestVolumeSwap-269763820-project-admin] Lazy-loading 'flavor' on Instance uuid d2a731d2-13ff-49e5-ab17-80686b622df7 {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:14:36 user nova-compute[73572]: DEBUG nova.virt.libvirt.guest [None req-a98b8ece-1576-4d8c-8230-9d701cd466a1 tempest-TestVolumeSwap-269763820 tempest-TestVolumeSwap-269763820-project-admin] COPY block job progress, current cursor: 7340032 final cursor: 1073741824 {{(pid=73572) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 10:14:37 user nova-compute[73572]: DEBUG nova.virt.libvirt.guest [None req-a98b8ece-1576-4d8c-8230-9d701cd466a1 tempest-TestVolumeSwap-269763820 tempest-TestVolumeSwap-269763820-project-admin] COPY block job progress, current cursor: 143654912 final cursor: 1073741824 {{(pid=73572) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 10:14:37 user nova-compute[73572]: DEBUG nova.virt.libvirt.guest [None req-a98b8ece-1576-4d8c-8230-9d701cd466a1 tempest-TestVolumeSwap-269763820 tempest-TestVolumeSwap-269763820-project-admin] COPY block job progress, current cursor: 257949696 final cursor: 1073741824 {{(pid=73572) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 10:14:38 user nova-compute[73572]: DEBUG nova.virt.libvirt.guest [None req-a98b8ece-1576-4d8c-8230-9d701cd466a1 tempest-TestVolumeSwap-269763820 tempest-TestVolumeSwap-269763820-project-admin] COPY block job progress, current cursor: 443547648 final cursor: 1073741824 {{(pid=73572) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 10:14:38 user nova-compute[73572]: DEBUG nova.virt.libvirt.guest [None req-a98b8ece-1576-4d8c-8230-9d701cd466a1 tempest-TestVolumeSwap-269763820 tempest-TestVolumeSwap-269763820-project-admin] COPY block job progress, current cursor: 590348288 final cursor: 1073741824 {{(pid=73572) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 10:14:39 user nova-compute[73572]: DEBUG nova.virt.libvirt.guest [None req-a98b8ece-1576-4d8c-8230-9d701cd466a1 tempest-TestVolumeSwap-269763820 tempest-TestVolumeSwap-269763820-project-admin] COPY block job progress, current cursor: 782237696 final cursor: 1073741824 {{(pid=73572) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 10:14:39 user nova-compute[73572]: DEBUG nova.virt.libvirt.guest [None req-a98b8ece-1576-4d8c-8230-9d701cd466a1 tempest-TestVolumeSwap-269763820 tempest-TestVolumeSwap-269763820-project-admin] COPY block job progress, current cursor: 924844032 final cursor: 1073741824 {{(pid=73572) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 10:14:40 user nova-compute[73572]: DEBUG nova.virt.libvirt.guest [None req-a98b8ece-1576-4d8c-8230-9d701cd466a1 tempest-TestVolumeSwap-269763820 tempest-TestVolumeSwap-269763820-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=73572) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 10:14:40 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a98b8ece-1576-4d8c-8230-9d701cd466a1 tempest-TestVolumeSwap-269763820 tempest-TestVolumeSwap-269763820-project-admin] [instance: d2a731d2-13ff-49e5-ab17-80686b622df7] calling os-brick to detach iSCSI Volume {{(pid=73572) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 10:14:40 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-a98b8ece-1576-4d8c-8230-9d701cd466a1 tempest-TestVolumeSwap-269763820 tempest-TestVolumeSwap-269763820-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc89c3d6a10>, {'target_iqns': ['iqn.2010-10.org.openstack:c383a00f-3f34-40ef-a526-7425cfc92877'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cfJeYboX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf', 'volume_id': 'c383a00f-3f34-40ef-a526-7425cfc92877'}, None), 'kwargs': False}}" {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 10:14:40 user nova-compute[73572]: WARNING os_brick.initiator.connectors.base [None req-a98b8ece-1576-4d8c-8230-9d701cd466a1 tempest-TestVolumeSwap-269763820 tempest-TestVolumeSwap-269763820-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 10:14:40 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-a98b8ece-1576-4d8c-8230-9d701cd466a1 tempest-TestVolumeSwap-269763820 tempest-TestVolumeSwap-269763820-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 10:14:40 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-a98b8ece-1576-4d8c-8230-9d701cd466a1 tempest-TestVolumeSwap-269763820 tempest-TestVolumeSwap-269763820-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 10:14:40 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-a98b8ece-1576-4d8c-8230-9d701cd466a1 tempest-TestVolumeSwap-269763820 tempest-TestVolumeSwap-269763820-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c383a00f-3f34-40ef-a526-7425cfc92877', 0)] {{(pid=73572) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 10:14:40 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:14:40 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:14:40 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cbb560a-08f2-462b-befb-eb7b57a1fa71]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:09ba694f-cb2a-4600-abe9-924b41292479\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:75ebe4c4-f791-4f09-a9bd-747ade3d70a3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:85988ff4-7fac-4a96-a502-74d6ca8189fe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9a00bb86-2eab-48d3-afc5-20fdd62650ae\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c383a00f-3f34-40ef-a526-7425cfc92877\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:14:40 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:14:40 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:14:40 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3d05b12-d13b-488e-a0ab-49c6b0693ed7]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c383a00f-3f34-40ef-a526-7425cfc92877 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a00bb86-2eab-48d3-afc5-20fdd62650ae (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09ba694f-cb2a-4600-abe9-924b41292479 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85988ff4-7fac-4a96-a502-74d6ca8189fe (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75ebe4c4-f791-4f09-a9bd-747ade3d70a3 (non-flash)\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:14:40 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-a98b8ece-1576-4d8c-8230-9d701cd466a1 tempest-TestVolumeSwap-269763820 tempest-TestVolumeSwap-269763820-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c383a00f-3f34-40ef-a526-7425cfc92877 (non-flash)
Aug 26 10:14:40 user nova-compute[73572]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a00bb86-2eab-48d3-afc5-20fdd62650ae (non-flash)
Aug 26 10:14:40 user nova-compute[73572]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09ba694f-cb2a-4600-abe9-924b41292479 (non-flash)
Aug 26 10:14:40 user nova-compute[73572]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85988ff4-7fac-4a96-a502-74d6ca8189fe (non-flash)
Aug 26 10:14:40 user nova-compute[73572]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75ebe4c4-f791-4f09-a9bd-747ade3d70a3 (non-flash)
Aug 26 10:14:40 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 10:14:40 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-a98b8ece-1576-4d8c-8230-9d701cd466a1 tempest-TestVolumeSwap-269763820 tempest-TestVolumeSwap-269763820-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c383a00f-3f34-40ef-a526-7425cfc92877 (non-flash)
Aug 26 10:14:40 user nova-compute[73572]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a00bb86-2eab-48d3-afc5-20fdd62650ae (non-flash)
Aug 26 10:14:40 user nova-compute[73572]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09ba694f-cb2a-4600-abe9-924b41292479 (non-flash)
Aug 26 10:14:40 user nova-compute[73572]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85988ff4-7fac-4a96-a502-74d6ca8189fe (non-flash)
Aug 26 10:14:40 user nova-compute[73572]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75ebe4c4-f791-4f09-a9bd-747ade3d70a3 (non-flash)
Aug 26 10:14:40 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 10:14:40 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-a98b8ece-1576-4d8c-8230-9d701cd466a1 tempest-TestVolumeSwap-269763820 tempest-TestVolumeSwap-269763820-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc89c352dd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c383a00f-3f34-40ef-a526-7425cfc92877'): ({'sdf'}, set())}) {{(pid=73572) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 10:14:40 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-a98b8ece-1576-4d8c-8230-9d701cd466a1 tempest-TestVolumeSwap-269763820 tempest-TestVolumeSwap-269763820-project-admin] Removing single pathed devices sdf {{(pid=73572) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 10:14:40 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:14:40 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:14:40 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[229c7ada-81e8-4b28-89ab-eb24356686fe]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:14:40 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:14:40 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:14:40 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d92e780-11d2-443f-a2b3-e2e2f58ef853]: (4, ('ok\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:14:40 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-a98b8ece-1576-4d8c-8230-9d701cd466a1 tempest-TestVolumeSwap-269763820 tempest-TestVolumeSwap-269763820-project-admin] Flushing IO for device /dev/sdf {{(pid=73572) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 10:14:40 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:14:40 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:14:40 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[c18d69d0-392d-47d4-9473-8e3af68c5fb5]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:14:40 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-a98b8ece-1576-4d8c-8230-9d701cd466a1 tempest-TestVolumeSwap-269763820 tempest-TestVolumeSwap-269763820-project-admin] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=73572) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 10:14:40 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:14:40 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.053s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:14:40 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecc36b58-018f-463d-a6d5-f25dd55bafb1]: (4, ('1', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:14:40 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-a98b8ece-1576-4d8c-8230-9d701cd466a1 tempest-TestVolumeSwap-269763820 tempest-TestVolumeSwap-269763820-project-admin] Checking to see if SCSI volumes sdf have been removed. {{(pid=73572) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 10:14:40 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-a98b8ece-1576-4d8c-8230-9d701cd466a1 tempest-TestVolumeSwap-269763820 tempest-TestVolumeSwap-269763820-project-admin] SCSI volumes sdf have been removed. {{(pid=73572) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 10:14:40 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-a98b8ece-1576-4d8c-8230-9d701cd466a1 tempest-TestVolumeSwap-269763820 tempest-TestVolumeSwap-269763820-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c383a00f-3f34-40ef-a526-7425cfc92877')] {{(pid=73572) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 10:14:40 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c383a00f-3f34-40ef-a526-7425cfc92877 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:14:40 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c383a00f-3f34-40ef-a526-7425cfc92877 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:14:40 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb4ae958-dff9-4b73-9363-9f739019a2eb]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:14:40 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-a98b8ece-1576-4d8c-8230-9d701cd466a1 tempest-TestVolumeSwap-269763820 tempest-TestVolumeSwap-269763820-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:14:40 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c383a00f-3f34-40ef-a526-7425cfc92877 -p 172.16.0.220:3260 --logout {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:14:40 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c383a00f-3f34-40ef-a526-7425cfc92877 -p 172.16.0.220:3260 --logout" returned: 0 in 0.079s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:14:40 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee1d7378-09ef-4336-a99c-3b90f3d2ff42]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:c383a00f-3f34-40ef-a526-7425cfc92877, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:c383a00f-3f34-40ef-a526-7425cfc92877, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:14:40 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-a98b8ece-1576-4d8c-8230-9d701cd466a1 tempest-TestVolumeSwap-269763820 tempest-TestVolumeSwap-269763820-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:c383a00f-3f34-40ef-a526-7425cfc92877, portal: 172.16.0.220,3260]
Aug 26 10:14:40 user nova-compute[73572]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:c383a00f-3f34-40ef-a526-7425cfc92877, portal: 172.16.0.220,3260] successful.
Aug 26 10:14:40 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:14:40 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c383a00f-3f34-40ef-a526-7425cfc92877 -p 172.16.0.220:3260 --op delete {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:14:40 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c383a00f-3f34-40ef-a526-7425cfc92877 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:14:40 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e96a075-6bab-42fa-ae9e-d4832c39e8f6]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:14:40 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-a98b8ece-1576-4d8c-8230-9d701cd466a1 tempest-TestVolumeSwap-269763820 tempest-TestVolumeSwap-269763820-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:14:40 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-a98b8ece-1576-4d8c-8230-9d701cd466a1 tempest-TestVolumeSwap-269763820 tempest-TestVolumeSwap-269763820-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.319s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 10:14:40 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-a98b8ece-1576-4d8c-8230-9d701cd466a1 tempest-TestVolumeSwap-269763820 tempest-TestVolumeSwap-269763820-project-admin] <== disconnect_volume: return (320ms) None {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 10:14:40 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a98b8ece-1576-4d8c-8230-9d701cd466a1 tempest-TestVolumeSwap-269763820 tempest-TestVolumeSwap-269763820-project-admin] [instance: d2a731d2-13ff-49e5-ab17-80686b622df7] Disconnected iSCSI Volume {{(pid=73572) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 10:14:40 user nova-compute[73572]: DEBUG nova.compute.manager [None req-a98b8ece-1576-4d8c-8230-9d701cd466a1 tempest-TestVolumeSwap-269763820 tempest-TestVolumeSwap-269763820-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:9a00bb86-2eab-48d3-afc5-20fdd62650ae'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IUzhMJwv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': 'd2a731d2-13ff-49e5-ab17-80686b622df7', 'attached_at': '', 'detached_at': '', 'volume_id': '9a00bb86-2eab-48d3-afc5-20fdd62650ae', 'serial'} {{(pid=73572) _swap_volume /opt/stack/nova/nova/compute/manager.py:7711}}
Aug 26 10:14:40 user nova-compute[73572]: DEBUG nova.compute.manager [None req-a98b8ece-1576-4d8c-8230-9d701cd466a1 tempest-TestVolumeSwap-269763820 tempest-TestVolumeSwap-269763820-project-admin] [instance: d2a731d2-13ff-49e5-ab17-80686b622df7] swap_volume: removing Cinder connection for volume c383a00f-3f34-40ef-a526-7425cfc92877 {{(pid=73572) _swap_volume /opt/stack/nova/nova/compute/manager.py:7756}}
Aug 26 10:14:40 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:14:41 user nova-compute[73572]: DEBUG nova.compute.manager [None req-a98b8ece-1576-4d8c-8230-9d701cd466a1 tempest-TestVolumeSwap-269763820 tempest-TestVolumeSwap-269763820-project-admin] [instance: d2a731d2-13ff-49e5-ab17-80686b622df7] swap_volume: Updating volume c383a00f-3f34-40ef-a526-7425cfc92877 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqns": ["iqn.2010-10.org.openstack:9a00bb86-2eab-48d3-afc5-20fdd62650ae"], "target_portals": ["172.16.0.220:3260"], "target_luns": [0], "target_discovered": false, "auth_method": "CHAP", "auth_username": "IUzhMJwv", "auth_password": "FINJ10umWcEC7b", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sde", "volume_id": "9a00bb86-2eab-48d3-afc5-20fdd62650ae"}, "status": "reserved", "instance": "d2a731d2-13ff-49e5-ab17-80686b622df7", "attached_at": "", "detached_at": "", "volume_id": "9a00bb86-2eab-48d3-afc5-20fdd62650ae", "serial": "9a00bb86-2eab-48d3-afc5-20fdd62650ae"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '9a00bb86-2eab-48d3-afc5-20fdd62650ae', 'no_device': None, 'attachment_id': '6778b7ef-d9f5-4aaa-8d5b-b065f61116d2'} {{(pid=73572) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7904}}
Aug 26 10:14:41 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-a98b8ece-1576-4d8c-8230-9d701cd466a1 tempest-TestVolumeSwap-269763820 tempest-TestVolumeSwap-269763820-project-admin] Lock "d2a731d2-13ff-49e5-ab17-80686b622df7" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 18.077s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:14:42 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-5337a57e-d810-436f-a769-cc4590db1efa tempest-TestVolumeSwap-1919204229 tempest-TestVolumeSwap-1919204229-project-member] Acquiring lock "d2a731d2-13ff-49e5-ab17-80686b622df7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:14:42 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-5337a57e-d810-436f-a769-cc4590db1efa tempest-TestVolumeSwap-1919204229 tempest-TestVolumeSwap-1919204229-project-member] Lock "d2a731d2-13ff-49e5-ab17-80686b622df7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:14:42 user nova-compute[73572]: INFO nova.compute.manager [None req-5337a57e-d810-436f-a769-cc4590db1efa tempest-TestVolumeSwap-1919204229 tempest-TestVolumeSwap-1919204229-project-member] [instance: d2a731d2-13ff-49e5-ab17-80686b622df7] Detaching volume 9a00bb86-2eab-48d3-afc5-20fdd62650ae
Aug 26 10:14:42 user nova-compute[73572]: INFO nova.virt.block_device [None req-5337a57e-d810-436f-a769-cc4590db1efa tempest-TestVolumeSwap-1919204229 tempest-TestVolumeSwap-1919204229-project-member] [instance: d2a731d2-13ff-49e5-ab17-80686b622df7] Attempting to driver detach volume 9a00bb86-2eab-48d3-afc5-20fdd62650ae from mountpoint /dev/vdb
Aug 26 10:14:42 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-5337a57e-d810-436f-a769-cc4590db1efa tempest-TestVolumeSwap-1919204229 tempest-TestVolumeSwap-1919204229-project-member] Attempting to detach device vdb from instance d2a731d2-13ff-49e5-ab17-80686b622df7 from the persistent domain config. {{(pid=73572) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 10:14:42 user nova-compute[73572]: DEBUG nova.virt.libvirt.guest [None req-5337a57e-d810-436f-a769-cc4590db1efa tempest-TestVolumeSwap-1919204229 tempest-TestVolumeSwap-1919204229-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 10:14:42 user nova-compute[73572]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 10:14:42 user nova-compute[73572]:   <source dev="/dev/sde"/>
Aug 26 10:14:42 user nova-compute[73572]:   <target dev="vdb" bus="virtio"/>
Aug 26 10:14:42 user nova-compute[73572]:   <serial>9a00bb86-2eab-48d3-afc5-20fdd62650ae</serial>
Aug 26 10:14:42 user nova-compute[73572]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 10:14:42 user nova-compute[73572]: </disk>
Aug 26 10:14:42 user nova-compute[73572]:  {{(pid=73572) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 10:14:42 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-5337a57e-d810-436f-a769-cc4590db1efa tempest-TestVolumeSwap-1919204229 tempest-TestVolumeSwap-1919204229-project-member] Successfully detached device vdb from instance d2a731d2-13ff-49e5-ab17-80686b622df7 from the persistent domain config.
Aug 26 10:14:42 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-5337a57e-d810-436f-a769-cc4590db1efa tempest-TestVolumeSwap-1919204229 tempest-TestVolumeSwap-1919204229-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d2a731d2-13ff-49e5-ab17-80686b622df7 from the live domain config. {{(pid=73572) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 10:14:42 user nova-compute[73572]: DEBUG nova.virt.libvirt.guest [None req-5337a57e-d810-436f-a769-cc4590db1efa tempest-TestVolumeSwap-1919204229 tempest-TestVolumeSwap-1919204229-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 10:14:42 user nova-compute[73572]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 10:14:42 user nova-compute[73572]:   <source dev="/dev/sde"/>
Aug 26 10:14:42 user nova-compute[73572]:   <target dev="vdb" bus="virtio"/>
Aug 26 10:14:42 user nova-compute[73572]:   <serial>9a00bb86-2eab-48d3-afc5-20fdd62650ae</serial>
Aug 26 10:14:42 user nova-compute[73572]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 10:14:42 user nova-compute[73572]: </disk>
Aug 26 10:14:42 user nova-compute[73572]:  {{(pid=73572) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 10:14:42 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Received event <DeviceRemovedEvent: 1693044882.8299582, d2a731d2-13ff-49e5-ab17-80686b622df7 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73572) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 10:14:42 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-5337a57e-d810-436f-a769-cc4590db1efa tempest-TestVolumeSwap-1919204229 tempest-TestVolumeSwap-1919204229-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d2a731d2-13ff-49e5-ab17-80686b622df7 {{(pid=73572) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 10:14:42 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-5337a57e-d810-436f-a769-cc4590db1efa tempest-TestVolumeSwap-1919204229 tempest-TestVolumeSwap-1919204229-project-member] Successfully detached device vdb from instance d2a731d2-13ff-49e5-ab17-80686b622df7 from the live domain config.
Aug 26 10:14:42 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5337a57e-d810-436f-a769-cc4590db1efa tempest-TestVolumeSwap-1919204229 tempest-TestVolumeSwap-1919204229-project-member] [instance: d2a731d2-13ff-49e5-ab17-80686b622df7] calling os-brick to detach iSCSI Volume {{(pid=73572) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 10:14:42 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-5337a57e-d810-436f-a769-cc4590db1efa tempest-TestVolumeSwap-1919204229 tempest-TestVolumeSwap-1919204229-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc89c3d6a10>, {'target_iqns': ['iqn.2010-10.org.openstack:9a00bb86-2eab-48d3-afc5-20fdd62650ae'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IUzhMJwv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde', 'volume_id': '9a00bb86-2eab-48d3-afc5-20fdd62650ae'}, None), 'kwargs': False}}" {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 10:14:42 user nova-compute[73572]: WARNING os_brick.initiator.connectors.base [None req-5337a57e-d810-436f-a769-cc4590db1efa tempest-TestVolumeSwap-1919204229 tempest-TestVolumeSwap-1919204229-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 10:14:42 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-5337a57e-d810-436f-a769-cc4590db1efa tempest-TestVolumeSwap-1919204229 tempest-TestVolumeSwap-1919204229-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 10:14:42 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-5337a57e-d810-436f-a769-cc4590db1efa tempest-TestVolumeSwap-1919204229 tempest-TestVolumeSwap-1919204229-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 10:14:42 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-5337a57e-d810-436f-a769-cc4590db1efa tempest-TestVolumeSwap-1919204229 tempest-TestVolumeSwap-1919204229-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9a00bb86-2eab-48d3-afc5-20fdd62650ae', 0)] {{(pid=73572) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 10:14:42 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:14:42 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:14:42 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[4721f9c6-09d0-4c22-b7bb-0b089c78c2a5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:09ba694f-cb2a-4600-abe9-924b41292479\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:75ebe4c4-f791-4f09-a9bd-747ade3d70a3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:85988ff4-7fac-4a96-a502-74d6ca8189fe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9a00bb86-2eab-48d3-afc5-20fdd62650ae\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:14:42 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:14:42 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:14:42 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f6b5448-d157-4ca2-9e05-7e090a5f859f]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a00bb86-2eab-48d3-afc5-20fdd62650ae (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09ba694f-cb2a-4600-abe9-924b41292479 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85988ff4-7fac-4a96-a502-74d6ca8189fe (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75ebe4c4-f791-4f09-a9bd-747ade3d70a3 (non-flash)\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:14:42 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-5337a57e-d810-436f-a769-cc4590db1efa tempest-TestVolumeSwap-1919204229 tempest-TestVolumeSwap-1919204229-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a00bb86-2eab-48d3-afc5-20fdd62650ae (non-flash)
Aug 26 10:14:42 user nova-compute[73572]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09ba694f-cb2a-4600-abe9-924b41292479 (non-flash)
Aug 26 10:14:42 user nova-compute[73572]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85988ff4-7fac-4a96-a502-74d6ca8189fe (non-flash)
Aug 26 10:14:42 user nova-compute[73572]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75ebe4c4-f791-4f09-a9bd-747ade3d70a3 (non-flash)
Aug 26 10:14:42 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 10:14:42 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-5337a57e-d810-436f-a769-cc4590db1efa tempest-TestVolumeSwap-1919204229 tempest-TestVolumeSwap-1919204229-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a00bb86-2eab-48d3-afc5-20fdd62650ae (non-flash)
Aug 26 10:14:42 user nova-compute[73572]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09ba694f-cb2a-4600-abe9-924b41292479 (non-flash)
Aug 26 10:14:42 user nova-compute[73572]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85988ff4-7fac-4a96-a502-74d6ca8189fe (non-flash)
Aug 26 10:14:42 user nova-compute[73572]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75ebe4c4-f791-4f09-a9bd-747ade3d70a3 (non-flash)
Aug 26 10:14:42 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 10:14:42 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-5337a57e-d810-436f-a769-cc4590db1efa tempest-TestVolumeSwap-1919204229 tempest-TestVolumeSwap-1919204229-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc89c1717e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9a00bb86-2eab-48d3-afc5-20fdd62650ae'): ({'sde'}, set())}) {{(pid=73572) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 10:14:42 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-5337a57e-d810-436f-a769-cc4590db1efa tempest-TestVolumeSwap-1919204229 tempest-TestVolumeSwap-1919204229-project-member] Removing single pathed devices sde {{(pid=73572) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 10:14:42 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:14:42 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:14:42 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b7e2898-6987-4c98-a5f3-72d96e8afd7f]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:14:42 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:14:42 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.022s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:14:42 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9ae6d7a-d202-470e-8ab5-88f0091a2150]: (4, ('ok\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:14:42 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-5337a57e-d810-436f-a769-cc4590db1efa tempest-TestVolumeSwap-1919204229 tempest-TestVolumeSwap-1919204229-project-member] Flushing IO for device /dev/sde {{(pid=73572) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 10:14:42 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:14:42 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:14:42 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[2588d9b6-8a8e-4d50-9cb5-7ed78320bcbe]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:14:42 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-5337a57e-d810-436f-a769-cc4590db1efa tempest-TestVolumeSwap-1919204229 tempest-TestVolumeSwap-1919204229-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73572) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 10:14:42 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:14:43 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.040s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:14:43 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[90e39f9d-c4b0-42a8-a2c1-763545440b13]: (4, ('1', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:14:43 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-5337a57e-d810-436f-a769-cc4590db1efa tempest-TestVolumeSwap-1919204229 tempest-TestVolumeSwap-1919204229-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73572) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 10:14:43 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-5337a57e-d810-436f-a769-cc4590db1efa tempest-TestVolumeSwap-1919204229 tempest-TestVolumeSwap-1919204229-project-member] SCSI volumes sde have been removed. {{(pid=73572) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 10:14:43 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-5337a57e-d810-436f-a769-cc4590db1efa tempest-TestVolumeSwap-1919204229 tempest-TestVolumeSwap-1919204229-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9a00bb86-2eab-48d3-afc5-20fdd62650ae')] {{(pid=73572) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 10:14:43 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a00bb86-2eab-48d3-afc5-20fdd62650ae -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:14:43 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a00bb86-2eab-48d3-afc5-20fdd62650ae -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:14:43 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[d038f084-84c9-40cb-bc05-28d03a4b352f]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:14:43 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-5337a57e-d810-436f-a769-cc4590db1efa tempest-TestVolumeSwap-1919204229 tempest-TestVolumeSwap-1919204229-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:14:43 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a00bb86-2eab-48d3-afc5-20fdd62650ae -p 172.16.0.220:3260 --logout {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:14:43 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a00bb86-2eab-48d3-afc5-20fdd62650ae -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:14:43 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ef3ad79-ea55-489a-82e7-57b267e36249]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:9a00bb86-2eab-48d3-afc5-20fdd62650ae, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:9a00bb86-2eab-48d3-afc5-20fdd62650ae, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:14:43 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-5337a57e-d810-436f-a769-cc4590db1efa tempest-TestVolumeSwap-1919204229 tempest-TestVolumeSwap-1919204229-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:9a00bb86-2eab-48d3-afc5-20fdd62650ae, portal: 172.16.0.220,3260]
Aug 26 10:14:43 user nova-compute[73572]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:9a00bb86-2eab-48d3-afc5-20fdd62650ae, portal: 172.16.0.220,3260] successful.
Aug 26 10:14:43 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:14:43 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a00bb86-2eab-48d3-afc5-20fdd62650ae -p 172.16.0.220:3260 --op delete {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:14:43 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a00bb86-2eab-48d3-afc5-20fdd62650ae -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:14:43 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5ca288b-6f7e-4fc6-bb94-e75057cade62]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:14:43 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-5337a57e-d810-436f-a769-cc4590db1efa tempest-TestVolumeSwap-1919204229 tempest-TestVolumeSwap-1919204229-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:14:43 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-5337a57e-d810-436f-a769-cc4590db1efa tempest-TestVolumeSwap-1919204229 tempest-TestVolumeSwap-1919204229-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.294s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 10:14:43 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-5337a57e-d810-436f-a769-cc4590db1efa tempest-TestVolumeSwap-1919204229 tempest-TestVolumeSwap-1919204229-project-member] <== disconnect_volume: return (295ms) None {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 10:14:43 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5337a57e-d810-436f-a769-cc4590db1efa tempest-TestVolumeSwap-1919204229 tempest-TestVolumeSwap-1919204229-project-member] [instance: d2a731d2-13ff-49e5-ab17-80686b622df7] Disconnected iSCSI Volume {{(pid=73572) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 10:14:43 user nova-compute[73572]: DEBUG nova.objects.instance [None req-5337a57e-d810-436f-a769-cc4590db1efa tempest-TestVolumeSwap-1919204229 tempest-TestVolumeSwap-1919204229-project-member] Lazy-loading 'flavor' on Instance uuid d2a731d2-13ff-49e5-ab17-80686b622df7 {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:14:44 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-5337a57e-d810-436f-a769-cc4590db1efa tempest-TestVolumeSwap-1919204229 tempest-TestVolumeSwap-1919204229-project-member] Lock "d2a731d2-13ff-49e5-ab17-80686b622df7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.814s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:14:45 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:14:50 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:14:50 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:14:51 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-046c7dec-8b64-4e63-b790-5b73e61d095f tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] Acquiring lock "32a28361-567b-4bd4-9f4f-d9cfac2c9388" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:14:51 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-046c7dec-8b64-4e63-b790-5b73e61d095f tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] Lock "32a28361-567b-4bd4-9f4f-d9cfac2c9388" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.006s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:14:51 user nova-compute[73572]: DEBUG nova.compute.manager [None req-046c7dec-8b64-4e63-b790-5b73e61d095f tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] [instance: 32a28361-567b-4bd4-9f4f-d9cfac2c9388] Starting instance... {{(pid=73572) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 10:14:51 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-046c7dec-8b64-4e63-b790-5b73e61d095f tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:14:51 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-046c7dec-8b64-4e63-b790-5b73e61d095f tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:14:51 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-046c7dec-8b64-4e63-b790-5b73e61d095f tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73572) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 10:14:51 user nova-compute[73572]: INFO nova.compute.claims [None req-046c7dec-8b64-4e63-b790-5b73e61d095f tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] [instance: 32a28361-567b-4bd4-9f4f-d9cfac2c9388] Claim successful on node user
Aug 26 10:14:51 user nova-compute[73572]: DEBUG nova.compute.provider_tree [None req-046c7dec-8b64-4e63-b790-5b73e61d095f tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] Inventory has not changed in ProviderTree for provider: e2cec974-59b2-4c77-a53d-a7f4e5a30d75 {{(pid=73572) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 10:14:51 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-046c7dec-8b64-4e63-b790-5b73e61d095f tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] Inventory has not changed for provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73572) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 10:14:51 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-046c7dec-8b64-4e63-b790-5b73e61d095f tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.522s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:14:51 user nova-compute[73572]: DEBUG nova.compute.manager [None req-046c7dec-8b64-4e63-b790-5b73e61d095f tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] [instance: 32a28361-567b-4bd4-9f4f-d9cfac2c9388] Start building networks asynchronously for instance. {{(pid=73572) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 10:14:51 user nova-compute[73572]: DEBUG nova.compute.manager [None req-046c7dec-8b64-4e63-b790-5b73e61d095f tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] [instance: 32a28361-567b-4bd4-9f4f-d9cfac2c9388] Allocating IP information in the background. {{(pid=73572) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 10:14:51 user nova-compute[73572]: DEBUG nova.network.neutron [None req-046c7dec-8b64-4e63-b790-5b73e61d095f tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] [instance: 32a28361-567b-4bd4-9f4f-d9cfac2c9388] allocate_for_instance() {{(pid=73572) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 10:14:51 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-046c7dec-8b64-4e63-b790-5b73e61d095f tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] [instance: 32a28361-567b-4bd4-9f4f-d9cfac2c9388] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 10:14:51 user nova-compute[73572]: DEBUG nova.compute.manager [None req-046c7dec-8b64-4e63-b790-5b73e61d095f tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] [instance: 32a28361-567b-4bd4-9f4f-d9cfac2c9388] Start building block device mappings for instance. {{(pid=73572) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 10:14:52 user nova-compute[73572]: DEBUG nova.compute.manager [None req-046c7dec-8b64-4e63-b790-5b73e61d095f tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] [instance: 32a28361-567b-4bd4-9f4f-d9cfac2c9388] Start spawning the instance on the hypervisor. {{(pid=73572) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 10:14:52 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-046c7dec-8b64-4e63-b790-5b73e61d095f tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] [instance: 32a28361-567b-4bd4-9f4f-d9cfac2c9388] Creating instance directory {{(pid=73572) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 10:14:52 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-046c7dec-8b64-4e63-b790-5b73e61d095f tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] [instance: 32a28361-567b-4bd4-9f4f-d9cfac2c9388] Creating image(s)
Aug 26 10:14:52 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-046c7dec-8b64-4e63-b790-5b73e61d095f tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] Acquiring lock "/opt/stack/data/nova/instances/32a28361-567b-4bd4-9f4f-d9cfac2c9388/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:14:52 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-046c7dec-8b64-4e63-b790-5b73e61d095f tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] Lock "/opt/stack/data/nova/instances/32a28361-567b-4bd4-9f4f-d9cfac2c9388/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:14:52 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-046c7dec-8b64-4e63-b790-5b73e61d095f tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] Lock "/opt/stack/data/nova/instances/32a28361-567b-4bd4-9f4f-d9cfac2c9388/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:14:52 user nova-compute[73572]: DEBUG nova.policy [None req-046c7dec-8b64-4e63-b790-5b73e61d095f tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fe58afb632fe4189a29df22dc61fb0ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9898b65714845e7aea403cc39182df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73572) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 10:14:52 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-046c7dec-8b64-4e63-b790-5b73e61d095f tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:14:52 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-046c7dec-8b64-4e63-b790-5b73e61d095f tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json" returned: 0 in 0.183s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:14:52 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-046c7dec-8b64-4e63-b790-5b73e61d095f tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] Acquiring lock "2099350d6f3bcd0de9471c73862d4fe75b049801" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:14:52 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-046c7dec-8b64-4e63-b790-5b73e61d095f tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] Lock "2099350d6f3bcd0de9471c73862d4fe75b049801" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:14:52 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-046c7dec-8b64-4e63-b790-5b73e61d095f tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:14:52 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-046c7dec-8b64-4e63-b790-5b73e61d095f tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json" returned: 0 in 0.167s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:14:52 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-046c7dec-8b64-4e63-b790-5b73e61d095f tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801,backing_fmt=raw /opt/stack/data/nova/instances/32a28361-567b-4bd4-9f4f-d9cfac2c9388/disk 1073741824 {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:14:52 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-046c7dec-8b64-4e63-b790-5b73e61d095f tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801,backing_fmt=raw /opt/stack/data/nova/instances/32a28361-567b-4bd4-9f4f-d9cfac2c9388/disk 1073741824" returned: 0 in 0.055s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:14:52 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-046c7dec-8b64-4e63-b790-5b73e61d095f tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] Lock "2099350d6f3bcd0de9471c73862d4fe75b049801" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.230s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:14:52 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-046c7dec-8b64-4e63-b790-5b73e61d095f tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:14:52 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-046c7dec-8b64-4e63-b790-5b73e61d095f tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json" returned: 0 in 0.182s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:14:52 user nova-compute[73572]: DEBUG nova.virt.disk.api [None req-046c7dec-8b64-4e63-b790-5b73e61d095f tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] Checking if we can resize image /opt/stack/data/nova/instances/32a28361-567b-4bd4-9f4f-d9cfac2c9388/disk. size=1073741824 {{(pid=73572) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 10:14:52 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-046c7dec-8b64-4e63-b790-5b73e61d095f tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32a28361-567b-4bd4-9f4f-d9cfac2c9388/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:14:52 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-046c7dec-8b64-4e63-b790-5b73e61d095f tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32a28361-567b-4bd4-9f4f-d9cfac2c9388/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:14:52 user nova-compute[73572]: DEBUG nova.virt.disk.api [None req-046c7dec-8b64-4e63-b790-5b73e61d095f tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] Cannot resize image /opt/stack/data/nova/instances/32a28361-567b-4bd4-9f4f-d9cfac2c9388/disk to a smaller size. {{(pid=73572) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 10:14:52 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-046c7dec-8b64-4e63-b790-5b73e61d095f tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] [instance: 32a28361-567b-4bd4-9f4f-d9cfac2c9388] Created local disks {{(pid=73572) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 10:14:52 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-046c7dec-8b64-4e63-b790-5b73e61d095f tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] [instance: 32a28361-567b-4bd4-9f4f-d9cfac2c9388] Ensure instance console log exists: /opt/stack/data/nova/instances/32a28361-567b-4bd4-9f4f-d9cfac2c9388/console.log {{(pid=73572) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 10:14:52 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-046c7dec-8b64-4e63-b790-5b73e61d095f tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:14:52 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-046c7dec-8b64-4e63-b790-5b73e61d095f tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:14:52 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-046c7dec-8b64-4e63-b790-5b73e61d095f tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:14:53 user nova-compute[73572]: DEBUG nova.network.neutron [None req-046c7dec-8b64-4e63-b790-5b73e61d095f tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] [instance: 32a28361-567b-4bd4-9f4f-d9cfac2c9388] Successfully created port: 47632d74-7b97-49f3-946c-0568247c7f7b {{(pid=73572) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 10:14:54 user nova-compute[73572]: DEBUG nova.network.neutron [None req-046c7dec-8b64-4e63-b790-5b73e61d095f tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] [instance: 32a28361-567b-4bd4-9f4f-d9cfac2c9388] Successfully updated port: 47632d74-7b97-49f3-946c-0568247c7f7b {{(pid=73572) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 10:14:54 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-046c7dec-8b64-4e63-b790-5b73e61d095f tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] Acquiring lock "refresh_cache-32a28361-567b-4bd4-9f4f-d9cfac2c9388" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:14:54 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-046c7dec-8b64-4e63-b790-5b73e61d095f tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] Acquired lock "refresh_cache-32a28361-567b-4bd4-9f4f-d9cfac2c9388" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:14:54 user nova-compute[73572]: DEBUG nova.network.neutron [None req-046c7dec-8b64-4e63-b790-5b73e61d095f tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] [instance: 32a28361-567b-4bd4-9f4f-d9cfac2c9388] Building network info cache for instance {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 10:14:54 user nova-compute[73572]: DEBUG nova.compute.manager [req-e4c6f0b9-658b-4aea-86f7-cc8757a610b5 req-72bb73e3-4f16-4953-8753-7e929b7b877c service nova] [instance: 32a28361-567b-4bd4-9f4f-d9cfac2c9388] Received event network-changed-47632d74-7b97-49f3-946c-0568247c7f7b {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:14:54 user nova-compute[73572]: DEBUG nova.compute.manager [req-e4c6f0b9-658b-4aea-86f7-cc8757a610b5 req-72bb73e3-4f16-4953-8753-7e929b7b877c service nova] [instance: 32a28361-567b-4bd4-9f4f-d9cfac2c9388] Refreshing instance network info cache due to event network-changed-47632d74-7b97-49f3-946c-0568247c7f7b. {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 10:14:54 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-e4c6f0b9-658b-4aea-86f7-cc8757a610b5 req-72bb73e3-4f16-4953-8753-7e929b7b877c service nova] Acquiring lock "refresh_cache-32a28361-567b-4bd4-9f4f-d9cfac2c9388" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:14:54 user nova-compute[73572]: DEBUG nova.network.neutron [None req-046c7dec-8b64-4e63-b790-5b73e61d095f tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] [instance: 32a28361-567b-4bd4-9f4f-d9cfac2c9388] Instance cache missing network info. {{(pid=73572) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 10:14:54 user nova-compute[73572]: DEBUG nova.network.neutron [None req-046c7dec-8b64-4e63-b790-5b73e61d095f tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] [instance: 32a28361-567b-4bd4-9f4f-d9cfac2c9388] Updating instance_info_cache with network_info: [{"id": "47632d74-7b97-49f3-946c-0568247c7f7b", "address": "fa:16:3e:a5:f4:74", "network": {"id": "529bb981-16ba-47c5-afb0-55f4aa577ecc", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-265382654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9898b65714845e7aea403cc39182df7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47632d74-7b", "ovs_interfaceid": "47632d74-7b97-49f3-946c-0568247c7f7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:14:54 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-046c7dec-8b64-4e63-b790-5b73e61d095f tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] Releasing lock "refresh_cache-32a28361-567b-4bd4-9f4f-d9cfac2c9388" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:14:54 user nova-compute[73572]: DEBUG nova.compute.manager [None req-046c7dec-8b64-4e63-b790-5b73e61d095f tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] [instance: 32a28361-567b-4bd4-9f4f-d9cfac2c9388] Instance network_info: |[{"id": "47632d74-7b97-49f3-946c-0568247c7f7b", "address": "fa:16:3e:a5:f4:74", "network": {"id": "529bb981-16ba-47c5-afb0-55f4aa577ecc", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-265382654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9898b65714845e7aea403cc39182df7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47632d74-7b", "ovs_interfaceid": "47632d74-7b97-49f3-946c-0568247c7f7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73572) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 10:14:54 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-e4c6f0b9-658b-4aea-86f7-cc8757a610b5 req-72bb73e3-4f16-4953-8753-7e929b7b877c service nova] Acquired lock "refresh_cache-32a28361-567b-4bd4-9f4f-d9cfac2c9388" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:14:54 user nova-compute[73572]: DEBUG nova.network.neutron [req-e4c6f0b9-658b-4aea-86f7-cc8757a610b5 req-72bb73e3-4f16-4953-8753-7e929b7b877c service nova] [instance: 32a28361-567b-4bd4-9f4f-d9cfac2c9388] Refreshing network info cache for port 47632d74-7b97-49f3-946c-0568247c7f7b {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 10:14:54 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-046c7dec-8b64-4e63-b790-5b73e61d095f tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] [instance: 32a28361-567b-4bd4-9f4f-d9cfac2c9388] Start _get_guest_xml network_info=[{"id": "47632d74-7b97-49f3-946c-0568247c7f7b", "address": "fa:16:3e:a5:f4:74", "network": {"id": "529bb981-16ba-47c5-afb0-55f4aa577ecc", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-265382654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9898b65714845e7aea403cc39182df7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47632d74-7b", "ovs_interfaceid": "47632d74-7b97-49f3-946c-0568247c7f7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T10:07:33Z,direct_url=<?>,disk_format='qcow2',id=299da0c9-e1c4-48f0-be55-fbe20dd06bc9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5c995f8bbbab4368b67a253e0df3971a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T10:07:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'guest_format': None, 'size': 0, 'encryption_format': None, 'device_type': 'disk', 'image_id': '299da0c9-e1c4-48f0-be55-fbe20dd06bc9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73572) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 10:14:54 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-046c7dec-8b64-4e63-b790-5b73e61d095f tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:14:54 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-046c7dec-8b64-4e63-b790-5b73e61d095f tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:14:54 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-046c7dec-8b64-4e63-b790-5b73e61d095f tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73572) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 10:14:54 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-046c7dec-8b64-4e63-b790-5b73e61d095f tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] CPU controller missing on host. {{(pid=73572) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 10:14:54 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-046c7dec-8b64-4e63-b790-5b73e61d095f tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73572) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 10:14:54 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-046c7dec-8b64-4e63-b790-5b73e61d095f tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] CPU controller found on host. {{(pid=73572) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 10:14:54 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-046c7dec-8b64-4e63-b790-5b73e61d095f tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73572) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 10:14:54 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-046c7dec-8b64-4e63-b790-5b73e61d095f tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T10:07:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T10:07:33Z,direct_url=<?>,disk_format='qcow2',id=299da0c9-e1c4-48f0-be55-fbe20dd06bc9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5c995f8bbbab4368b67a253e0df3971a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T10:07:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 10:14:54 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-046c7dec-8b64-4e63-b790-5b73e61d095f tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] Flavor limits 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 10:14:54 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-046c7dec-8b64-4e63-b790-5b73e61d095f tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] Image limits 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 10:14:54 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-046c7dec-8b64-4e63-b790-5b73e61d095f tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] Flavor pref 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 10:14:54 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-046c7dec-8b64-4e63-b790-5b73e61d095f tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] Image pref 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 10:14:54 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-046c7dec-8b64-4e63-b790-5b73e61d095f tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 10:14:54 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-046c7dec-8b64-4e63-b790-5b73e61d095f tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 10:14:54 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-046c7dec-8b64-4e63-b790-5b73e61d095f tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73572) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 10:14:54 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-046c7dec-8b64-4e63-b790-5b73e61d095f tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] Got 1 possible topologies {{(pid=73572) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 10:14:54 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-046c7dec-8b64-4e63-b790-5b73e61d095f tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 10:14:54 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-046c7dec-8b64-4e63-b790-5b73e61d095f tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 10:14:54 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-046c7dec-8b64-4e63-b790-5b73e61d095f tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T10:14:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-135214525',display_name='tempest-VolumesAdminNegativeTest-server-135214525',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-135214525',id=13,image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a9898b65714845e7aea403cc39182df7',ramdisk_id='',reservation_id='r-mf7osq3t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-119088495',owner_user_name='tempest-VolumesAdminNegativeTest-119088495-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T10:14:52Z,user_data=None,user_id='fe58afb632fe4189a29df22dc61fb0ae',uuid=32a28361-567b-4bd4-9f4f-d9cfac2c9388,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "47632d74-7b97-49f3-946c-0568247c7f7b", "address": "fa:16:3e:a5:f4:74", "network": {"id": "529bb981-16ba-47c5-afb0-55f4aa577ecc", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-265382654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9898b65714845e7aea403cc39182df7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47632d74-7b", "ovs_interfaceid": "47632d74-7b97-49f3-946c-0568247c7f7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73572) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 10:14:54 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-046c7dec-8b64-4e63-b790-5b73e61d095f tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] Converting VIF {"id": "47632d74-7b97-49f3-946c-0568247c7f7b", "address": "fa:16:3e:a5:f4:74", "network": {"id": "529bb981-16ba-47c5-afb0-55f4aa577ecc", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-265382654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9898b65714845e7aea403cc39182df7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47632d74-7b", "ovs_interfaceid": "47632d74-7b97-49f3-946c-0568247c7f7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:14:54 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-046c7dec-8b64-4e63-b790-5b73e61d095f tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a5:f4:74,bridge_name='br-int',has_traffic_filtering=True,id=47632d74-7b97-49f3-946c-0568247c7f7b,network=Network(529bb981-16ba-47c5-afb0-55f4aa577ecc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47632d74-7b') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:14:54 user nova-compute[73572]: DEBUG nova.objects.instance [None req-046c7dec-8b64-4e63-b790-5b73e61d095f tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] Lazy-loading 'pci_devices' on Instance uuid 32a28361-567b-4bd4-9f4f-d9cfac2c9388 {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:14:54 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-046c7dec-8b64-4e63-b790-5b73e61d095f tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] [instance: 32a28361-567b-4bd4-9f4f-d9cfac2c9388] End _get_guest_xml xml=<domain type="kvm">
Aug 26 10:14:54 user nova-compute[73572]:   <uuid>32a28361-567b-4bd4-9f4f-d9cfac2c9388</uuid>
Aug 26 10:14:54 user nova-compute[73572]:   <name>instance-0000000d</name>
Aug 26 10:14:54 user nova-compute[73572]:   <memory>524288</memory>
Aug 26 10:14:54 user nova-compute[73572]:   <vcpu>1</vcpu>
Aug 26 10:14:54 user nova-compute[73572]:   <metadata>
Aug 26 10:14:54 user nova-compute[73572]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 10:14:54 user nova-compute[73572]:       <nova:package version="0.0.0"/>
Aug 26 10:14:54 user nova-compute[73572]:       <nova:name>tempest-VolumesAdminNegativeTest-server-135214525</nova:name>
Aug 26 10:14:54 user nova-compute[73572]:       <nova:creationTime>2023-08-26 10:14:54</nova:creationTime>
Aug 26 10:14:54 user nova-compute[73572]:       <nova:flavor name="m1.tiny">
Aug 26 10:14:54 user nova-compute[73572]:         <nova:memory>512</nova:memory>
Aug 26 10:14:54 user nova-compute[73572]:         <nova:disk>1</nova:disk>
Aug 26 10:14:54 user nova-compute[73572]:         <nova:swap>0</nova:swap>
Aug 26 10:14:54 user nova-compute[73572]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 10:14:54 user nova-compute[73572]:         <nova:vcpus>1</nova:vcpus>
Aug 26 10:14:54 user nova-compute[73572]:       </nova:flavor>
Aug 26 10:14:54 user nova-compute[73572]:       <nova:owner>
Aug 26 10:14:54 user nova-compute[73572]:         <nova:user uuid="fe58afb632fe4189a29df22dc61fb0ae">tempest-VolumesAdminNegativeTest-119088495-project-member</nova:user>
Aug 26 10:14:54 user nova-compute[73572]:         <nova:project uuid="a9898b65714845e7aea403cc39182df7">tempest-VolumesAdminNegativeTest-119088495</nova:project>
Aug 26 10:14:54 user nova-compute[73572]:       </nova:owner>
Aug 26 10:14:54 user nova-compute[73572]:       <nova:root type="image" uuid="299da0c9-e1c4-48f0-be55-fbe20dd06bc9"/>
Aug 26 10:14:54 user nova-compute[73572]:       <nova:ports>
Aug 26 10:14:54 user nova-compute[73572]:         <nova:port uuid="47632d74-7b97-49f3-946c-0568247c7f7b">
Aug 26 10:14:54 user nova-compute[73572]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 26 10:14:54 user nova-compute[73572]:         </nova:port>
Aug 26 10:14:54 user nova-compute[73572]:       </nova:ports>
Aug 26 10:14:54 user nova-compute[73572]:     </nova:instance>
Aug 26 10:14:54 user nova-compute[73572]:   </metadata>
Aug 26 10:14:54 user nova-compute[73572]:   <sysinfo type="smbios">
Aug 26 10:14:54 user nova-compute[73572]:     <system>
Aug 26 10:14:54 user nova-compute[73572]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 10:14:54 user nova-compute[73572]:       <entry name="product">OpenStack Nova</entry>
Aug 26 10:14:54 user nova-compute[73572]:       <entry name="version">0.0.0</entry>
Aug 26 10:14:54 user nova-compute[73572]:       <entry name="serial">32a28361-567b-4bd4-9f4f-d9cfac2c9388</entry>
Aug 26 10:14:54 user nova-compute[73572]:       <entry name="uuid">32a28361-567b-4bd4-9f4f-d9cfac2c9388</entry>
Aug 26 10:14:54 user nova-compute[73572]:       <entry name="family">Virtual Machine</entry>
Aug 26 10:14:54 user nova-compute[73572]:     </system>
Aug 26 10:14:54 user nova-compute[73572]:   </sysinfo>
Aug 26 10:14:54 user nova-compute[73572]:   <os>
Aug 26 10:14:54 user nova-compute[73572]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 10:14:54 user nova-compute[73572]:     <boot dev="hd"/>
Aug 26 10:14:54 user nova-compute[73572]:     <smbios mode="sysinfo"/>
Aug 26 10:14:54 user nova-compute[73572]:   </os>
Aug 26 10:14:54 user nova-compute[73572]:   <features>
Aug 26 10:14:54 user nova-compute[73572]:     <acpi/>
Aug 26 10:14:54 user nova-compute[73572]:     <apic/>
Aug 26 10:14:54 user nova-compute[73572]:     <vmcoreinfo/>
Aug 26 10:14:54 user nova-compute[73572]:   </features>
Aug 26 10:14:54 user nova-compute[73572]:   <clock offset="utc">
Aug 26 10:14:54 user nova-compute[73572]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 10:14:54 user nova-compute[73572]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 10:14:54 user nova-compute[73572]:     <timer name="hpet" present="no"/>
Aug 26 10:14:54 user nova-compute[73572]:   </clock>
Aug 26 10:14:54 user nova-compute[73572]:   <cpu mode="custom" match="exact">
Aug 26 10:14:54 user nova-compute[73572]:     <model>Nehalem</model>
Aug 26 10:14:54 user nova-compute[73572]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 10:14:54 user nova-compute[73572]:   </cpu>
Aug 26 10:14:54 user nova-compute[73572]:   <devices>
Aug 26 10:14:54 user nova-compute[73572]:     <disk type="file" device="disk">
Aug 26 10:14:54 user nova-compute[73572]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 10:14:54 user nova-compute[73572]:       <source file="/opt/stack/data/nova/instances/32a28361-567b-4bd4-9f4f-d9cfac2c9388/disk"/>
Aug 26 10:14:54 user nova-compute[73572]:       <target dev="vda" bus="virtio"/>
Aug 26 10:14:54 user nova-compute[73572]:     </disk>
Aug 26 10:14:54 user nova-compute[73572]:     <interface type="ethernet">
Aug 26 10:14:54 user nova-compute[73572]:       <mac address="fa:16:3e:a5:f4:74"/>
Aug 26 10:14:54 user nova-compute[73572]:       <model type="virtio"/>
Aug 26 10:14:54 user nova-compute[73572]:       <mtu size="1442"/>
Aug 26 10:14:54 user nova-compute[73572]:       <target dev="tap47632d74-7b"/>
Aug 26 10:14:54 user nova-compute[73572]:     </interface>
Aug 26 10:14:54 user nova-compute[73572]:     <serial type="pty">
Aug 26 10:14:54 user nova-compute[73572]:       <log file="/opt/stack/data/nova/instances/32a28361-567b-4bd4-9f4f-d9cfac2c9388/console.log" append="off"/>
Aug 26 10:14:54 user nova-compute[73572]:     </serial>
Aug 26 10:14:54 user nova-compute[73572]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 10:14:54 user nova-compute[73572]:     <video>
Aug 26 10:14:54 user nova-compute[73572]:       <model type="virtio"/>
Aug 26 10:14:54 user nova-compute[73572]:     </video>
Aug 26 10:14:54 user nova-compute[73572]:     <rng model="virtio">
Aug 26 10:14:54 user nova-compute[73572]:       <backend model="random">/dev/urandom</backend>
Aug 26 10:14:54 user nova-compute[73572]:     </rng>
Aug 26 10:14:54 user nova-compute[73572]:     <controller type="usb" index="0" model="none"/>
Aug 26 10:14:54 user nova-compute[73572]:     <memballoon model="virtio">
Aug 26 10:14:54 user nova-compute[73572]:       <stats period="10"/>
Aug 26 10:14:54 user nova-compute[73572]:     </memballoon>
Aug 26 10:14:54 user nova-compute[73572]:   </devices>
Aug 26 10:14:54 user nova-compute[73572]: </domain>
Aug 26 10:14:54 user nova-compute[73572]:  {{(pid=73572) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 10:14:54 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-046c7dec-8b64-4e63-b790-5b73e61d095f tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T10:14:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-135214525',display_name='tempest-VolumesAdminNegativeTest-server-135214525',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-135214525',id=13,image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a9898b65714845e7aea403cc39182df7',ramdisk_id='',reservation_id='r-mf7osq3t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-119088495',owner_user_name='tempest-VolumesAdminNegativeTest-119088495-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T10:14:52Z,user_data=None,user_id='fe58afb632fe4189a29df22dc61fb0ae',uuid=32a28361-567b-4bd4-9f4f-d9cfac2c9388,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "47632d74-7b97-49f3-946c-0568247c7f7b", "address": "fa:16:3e:a5:f4:74", "network": {"id": "529bb981-16ba-47c5-afb0-55f4aa577ecc", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-265382654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9898b65714845e7aea403cc39182df7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47632d74-7b", "ovs_interfaceid": "47632d74-7b97-49f3-946c-0568247c7f7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 10:14:54 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-046c7dec-8b64-4e63-b790-5b73e61d095f tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] Converting VIF {"id": "47632d74-7b97-49f3-946c-0568247c7f7b", "address": "fa:16:3e:a5:f4:74", "network": {"id": "529bb981-16ba-47c5-afb0-55f4aa577ecc", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-265382654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9898b65714845e7aea403cc39182df7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47632d74-7b", "ovs_interfaceid": "47632d74-7b97-49f3-946c-0568247c7f7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:14:54 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-046c7dec-8b64-4e63-b790-5b73e61d095f tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a5:f4:74,bridge_name='br-int',has_traffic_filtering=True,id=47632d74-7b97-49f3-946c-0568247c7f7b,network=Network(529bb981-16ba-47c5-afb0-55f4aa577ecc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47632d74-7b') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:14:54 user nova-compute[73572]: DEBUG os_vif [None req-046c7dec-8b64-4e63-b790-5b73e61d095f tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:f4:74,bridge_name='br-int',has_traffic_filtering=True,id=47632d74-7b97-49f3-946c-0568247c7f7b,network=Network(529bb981-16ba-47c5-afb0-55f4aa577ecc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47632d74-7b') {{(pid=73572) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 10:14:54 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:14:54 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:14:54 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 10:14:54 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:14:54 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap47632d74-7b, may_exist=True, interface_attrs={}) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:14:54 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap47632d74-7b, col_values=(('external_ids', {'iface-id': '47632d74-7b97-49f3-946c-0568247c7f7b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a5:f4:74', 'vm-uuid': '32a28361-567b-4bd4-9f4f-d9cfac2c9388'}),), if_exists=True) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:14:54 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:14:54 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:14:54 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:14:54 user nova-compute[73572]: INFO os_vif [None req-046c7dec-8b64-4e63-b790-5b73e61d095f tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:f4:74,bridge_name='br-int',has_traffic_filtering=True,id=47632d74-7b97-49f3-946c-0568247c7f7b,network=Network(529bb981-16ba-47c5-afb0-55f4aa577ecc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47632d74-7b')
Aug 26 10:14:54 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-046c7dec-8b64-4e63-b790-5b73e61d095f tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] No BDM found with device name vda, not building metadata. {{(pid=73572) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 10:14:54 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-046c7dec-8b64-4e63-b790-5b73e61d095f tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] No VIF found with MAC fa:16:3e:a5:f4:74, not building metadata {{(pid=73572) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 10:14:54 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:14:55 user nova-compute[73572]: DEBUG nova.network.neutron [req-e4c6f0b9-658b-4aea-86f7-cc8757a610b5 req-72bb73e3-4f16-4953-8753-7e929b7b877c service nova] [instance: 32a28361-567b-4bd4-9f4f-d9cfac2c9388] Updated VIF entry in instance network info cache for port 47632d74-7b97-49f3-946c-0568247c7f7b. {{(pid=73572) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 10:14:55 user nova-compute[73572]: DEBUG nova.network.neutron [req-e4c6f0b9-658b-4aea-86f7-cc8757a610b5 req-72bb73e3-4f16-4953-8753-7e929b7b877c service nova] [instance: 32a28361-567b-4bd4-9f4f-d9cfac2c9388] Updating instance_info_cache with network_info: [{"id": "47632d74-7b97-49f3-946c-0568247c7f7b", "address": "fa:16:3e:a5:f4:74", "network": {"id": "529bb981-16ba-47c5-afb0-55f4aa577ecc", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-265382654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9898b65714845e7aea403cc39182df7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47632d74-7b", "ovs_interfaceid": "47632d74-7b97-49f3-946c-0568247c7f7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:14:55 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-e4c6f0b9-658b-4aea-86f7-cc8757a610b5 req-72bb73e3-4f16-4953-8753-7e929b7b877c service nova] Releasing lock "refresh_cache-32a28361-567b-4bd4-9f4f-d9cfac2c9388" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:14:55 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-91d31d38-9b4f-449f-bf52-e555a4575f9d tempest-VolumesNegativeTest-657120278 tempest-VolumesNegativeTest-657120278-project-member] Acquiring lock "0b140c11-1a26-4312-9cec-8054582d15f5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:14:55 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-91d31d38-9b4f-449f-bf52-e555a4575f9d tempest-VolumesNegativeTest-657120278 tempest-VolumesNegativeTest-657120278-project-member] Lock "0b140c11-1a26-4312-9cec-8054582d15f5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:14:55 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-91d31d38-9b4f-449f-bf52-e555a4575f9d tempest-VolumesNegativeTest-657120278 tempest-VolumesNegativeTest-657120278-project-member] Acquiring lock "0b140c11-1a26-4312-9cec-8054582d15f5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:14:55 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-91d31d38-9b4f-449f-bf52-e555a4575f9d tempest-VolumesNegativeTest-657120278 tempest-VolumesNegativeTest-657120278-project-member] Lock "0b140c11-1a26-4312-9cec-8054582d15f5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:14:55 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-91d31d38-9b4f-449f-bf52-e555a4575f9d tempest-VolumesNegativeTest-657120278 tempest-VolumesNegativeTest-657120278-project-member] Lock "0b140c11-1a26-4312-9cec-8054582d15f5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:14:55 user nova-compute[73572]: INFO nova.compute.manager [None req-91d31d38-9b4f-449f-bf52-e555a4575f9d tempest-VolumesNegativeTest-657120278 tempest-VolumesNegativeTest-657120278-project-member] [instance: 0b140c11-1a26-4312-9cec-8054582d15f5] Terminating instance
Aug 26 10:14:55 user nova-compute[73572]: DEBUG nova.compute.manager [None req-91d31d38-9b4f-449f-bf52-e555a4575f9d tempest-VolumesNegativeTest-657120278 tempest-VolumesNegativeTest-657120278-project-member] [instance: 0b140c11-1a26-4312-9cec-8054582d15f5] Start destroying the instance on the hypervisor. {{(pid=73572) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 10:14:55 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:14:55 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:14:55 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:14:55 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:14:56 user nova-compute[73572]: DEBUG nova.compute.manager [req-ef7711c6-f61d-4f3d-b8b9-0f16739bda41 req-a209804e-713c-4615-a4db-453d358f66d7 service nova] [instance: 0b140c11-1a26-4312-9cec-8054582d15f5] Received event network-vif-unplugged-d8aac17a-7f10-44bf-ab6d-c7105bf7fa02 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:14:56 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-ef7711c6-f61d-4f3d-b8b9-0f16739bda41 req-a209804e-713c-4615-a4db-453d358f66d7 service nova] Acquiring lock "0b140c11-1a26-4312-9cec-8054582d15f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:14:56 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-ef7711c6-f61d-4f3d-b8b9-0f16739bda41 req-a209804e-713c-4615-a4db-453d358f66d7 service nova] Lock "0b140c11-1a26-4312-9cec-8054582d15f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:14:56 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-ef7711c6-f61d-4f3d-b8b9-0f16739bda41 req-a209804e-713c-4615-a4db-453d358f66d7 service nova] Lock "0b140c11-1a26-4312-9cec-8054582d15f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:14:56 user nova-compute[73572]: DEBUG nova.compute.manager [req-ef7711c6-f61d-4f3d-b8b9-0f16739bda41 req-a209804e-713c-4615-a4db-453d358f66d7 service nova] [instance: 0b140c11-1a26-4312-9cec-8054582d15f5] No waiting events found dispatching network-vif-unplugged-d8aac17a-7f10-44bf-ab6d-c7105bf7fa02 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:14:56 user nova-compute[73572]: DEBUG nova.compute.manager [req-ef7711c6-f61d-4f3d-b8b9-0f16739bda41 req-a209804e-713c-4615-a4db-453d358f66d7 service nova] [instance: 0b140c11-1a26-4312-9cec-8054582d15f5] Received event network-vif-unplugged-d8aac17a-7f10-44bf-ab6d-c7105bf7fa02 for instance with task_state deleting. {{(pid=73572) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 10:14:56 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:14:56 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:14:56 user nova-compute[73572]: INFO nova.virt.libvirt.driver [-] [instance: 0b140c11-1a26-4312-9cec-8054582d15f5] Instance destroyed successfully.
Aug 26 10:14:56 user nova-compute[73572]: DEBUG nova.objects.instance [None req-91d31d38-9b4f-449f-bf52-e555a4575f9d tempest-VolumesNegativeTest-657120278 tempest-VolumesNegativeTest-657120278-project-member] Lazy-loading 'resources' on Instance uuid 0b140c11-1a26-4312-9cec-8054582d15f5 {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:14:56 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:14:56 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-91d31d38-9b4f-449f-bf52-e555a4575f9d tempest-VolumesNegativeTest-657120278 tempest-VolumesNegativeTest-657120278-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T10:13:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-87296491',display_name='tempest-VolumesNegativeTest-instance-87296491',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-87296491',id=10,image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T10:13:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3a94e3a8c40044a7b172fafaf1b0e0b4',ramdisk_id='',reservation_id='r-vsp7bycm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-657120278',owner_user_name='tempest-VolumesNegativeTest-657120278-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T10:13:13Z,user_data=None,user_id='1a781dc000ee4d5d932181bdf18726ba',uuid=0b140c11-1a26-4312-9cec-8054582d15f5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d8aac17a-7f10-44bf-ab6d-c7105bf7fa02", "address": "fa:16:3e:b5:26:69", "network": {"id": "52e6a145-3658-4741-83a6-d3edf9e3b24b", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.115", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "5c995f8bbbab4368b67a253e0df3971a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8aac17a-7f", "ovs_interfaceid": "d8aac17a-7f10-44bf-ab6d-c7105bf7fa02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 10:14:56 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-91d31d38-9b4f-449f-bf52-e555a4575f9d tempest-VolumesNegativeTest-657120278 tempest-VolumesNegativeTest-657120278-project-member] Converting VIF {"id": "d8aac17a-7f10-44bf-ab6d-c7105bf7fa02", "address": "fa:16:3e:b5:26:69", "network": {"id": "52e6a145-3658-4741-83a6-d3edf9e3b24b", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.115", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "5c995f8bbbab4368b67a253e0df3971a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8aac17a-7f", "ovs_interfaceid": "d8aac17a-7f10-44bf-ab6d-c7105bf7fa02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:14:56 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-91d31d38-9b4f-449f-bf52-e555a4575f9d tempest-VolumesNegativeTest-657120278 tempest-VolumesNegativeTest-657120278-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:26:69,bridge_name='br-int',has_traffic_filtering=True,id=d8aac17a-7f10-44bf-ab6d-c7105bf7fa02,network=Network(52e6a145-3658-4741-83a6-d3edf9e3b24b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8aac17a-7f') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:14:56 user nova-compute[73572]: DEBUG os_vif [None req-91d31d38-9b4f-449f-bf52-e555a4575f9d tempest-VolumesNegativeTest-657120278 tempest-VolumesNegativeTest-657120278-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:26:69,bridge_name='br-int',has_traffic_filtering=True,id=d8aac17a-7f10-44bf-ab6d-c7105bf7fa02,network=Network(52e6a145-3658-4741-83a6-d3edf9e3b24b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8aac17a-7f') {{(pid=73572) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 10:14:56 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:14:56 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd8aac17a-7f, bridge=br-int, if_exists=True) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:14:56 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:14:56 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:14:56 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:14:56 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:14:56 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:14:56 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:14:56 user nova-compute[73572]: INFO os_vif [None req-91d31d38-9b4f-449f-bf52-e555a4575f9d tempest-VolumesNegativeTest-657120278 tempest-VolumesNegativeTest-657120278-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:26:69,bridge_name='br-int',has_traffic_filtering=True,id=d8aac17a-7f10-44bf-ab6d-c7105bf7fa02,network=Network(52e6a145-3658-4741-83a6-d3edf9e3b24b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8aac17a-7f')
Aug 26 10:14:56 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-91d31d38-9b4f-449f-bf52-e555a4575f9d tempest-VolumesNegativeTest-657120278 tempest-VolumesNegativeTest-657120278-project-member] [instance: 0b140c11-1a26-4312-9cec-8054582d15f5] Deleting instance files /opt/stack/data/nova/instances/0b140c11-1a26-4312-9cec-8054582d15f5_del
Aug 26 10:14:56 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-91d31d38-9b4f-449f-bf52-e555a4575f9d tempest-VolumesNegativeTest-657120278 tempest-VolumesNegativeTest-657120278-project-member] [instance: 0b140c11-1a26-4312-9cec-8054582d15f5] Deletion of /opt/stack/data/nova/instances/0b140c11-1a26-4312-9cec-8054582d15f5_del complete
Aug 26 10:14:57 user nova-compute[73572]: INFO nova.compute.manager [None req-91d31d38-9b4f-449f-bf52-e555a4575f9d tempest-VolumesNegativeTest-657120278 tempest-VolumesNegativeTest-657120278-project-member] [instance: 0b140c11-1a26-4312-9cec-8054582d15f5] Took 1.28 seconds to destroy the instance on the hypervisor.
Aug 26 10:14:57 user nova-compute[73572]: DEBUG oslo.service.loopingcall [None req-91d31d38-9b4f-449f-bf52-e555a4575f9d tempest-VolumesNegativeTest-657120278 tempest-VolumesNegativeTest-657120278-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73572) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 10:14:57 user nova-compute[73572]: DEBUG nova.compute.manager [-] [instance: 0b140c11-1a26-4312-9cec-8054582d15f5] Deallocating network for instance {{(pid=73572) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 10:14:57 user nova-compute[73572]: DEBUG nova.network.neutron [-] [instance: 0b140c11-1a26-4312-9cec-8054582d15f5] deallocate_for_instance() {{(pid=73572) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 10:14:57 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:14:57 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:14:57 user nova-compute[73572]: DEBUG nova.network.neutron [-] [instance: 0b140c11-1a26-4312-9cec-8054582d15f5] Updating instance_info_cache with network_info: [] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:14:57 user nova-compute[73572]: INFO nova.compute.manager [-] [instance: 0b140c11-1a26-4312-9cec-8054582d15f5] Took 0.57 seconds to deallocate network for instance.
Aug 26 10:14:57 user nova-compute[73572]: DEBUG nova.compute.manager [req-c40a55e1-a9f5-49ce-957d-13f1a56b4131 req-7404272f-017b-461f-8091-86c471008886 service nova] [instance: 0b140c11-1a26-4312-9cec-8054582d15f5] Received event network-vif-deleted-d8aac17a-7f10-44bf-ab6d-c7105bf7fa02 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:14:57 user nova-compute[73572]: INFO nova.compute.manager [req-c40a55e1-a9f5-49ce-957d-13f1a56b4131 req-7404272f-017b-461f-8091-86c471008886 service nova] [instance: 0b140c11-1a26-4312-9cec-8054582d15f5] Neutron deleted interface d8aac17a-7f10-44bf-ab6d-c7105bf7fa02; detaching it from the instance and deleting it from the info cache
Aug 26 10:14:57 user nova-compute[73572]: DEBUG nova.network.neutron [req-c40a55e1-a9f5-49ce-957d-13f1a56b4131 req-7404272f-017b-461f-8091-86c471008886 service nova] [instance: 0b140c11-1a26-4312-9cec-8054582d15f5] Updating instance_info_cache with network_info: [] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:14:57 user nova-compute[73572]: DEBUG nova.compute.manager [req-c40a55e1-a9f5-49ce-957d-13f1a56b4131 req-7404272f-017b-461f-8091-86c471008886 service nova] [instance: 0b140c11-1a26-4312-9cec-8054582d15f5] Detach interface failed, port_id=d8aac17a-7f10-44bf-ab6d-c7105bf7fa02, reason: Instance 0b140c11-1a26-4312-9cec-8054582d15f5 could not be found. {{(pid=73572) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 10:14:57 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-91d31d38-9b4f-449f-bf52-e555a4575f9d tempest-VolumesNegativeTest-657120278 tempest-VolumesNegativeTest-657120278-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:14:57 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-91d31d38-9b4f-449f-bf52-e555a4575f9d tempest-VolumesNegativeTest-657120278 tempest-VolumesNegativeTest-657120278-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:14:57 user nova-compute[73572]: DEBUG nova.compute.provider_tree [None req-91d31d38-9b4f-449f-bf52-e555a4575f9d tempest-VolumesNegativeTest-657120278 tempest-VolumesNegativeTest-657120278-project-member] Inventory has not changed in ProviderTree for provider: e2cec974-59b2-4c77-a53d-a7f4e5a30d75 {{(pid=73572) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 10:14:58 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-91d31d38-9b4f-449f-bf52-e555a4575f9d tempest-VolumesNegativeTest-657120278 tempest-VolumesNegativeTest-657120278-project-member] Inventory has not changed for provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73572) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 10:14:58 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-91d31d38-9b4f-449f-bf52-e555a4575f9d tempest-VolumesNegativeTest-657120278 tempest-VolumesNegativeTest-657120278-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.401s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:14:58 user nova-compute[73572]: INFO nova.scheduler.client.report [None req-91d31d38-9b4f-449f-bf52-e555a4575f9d tempest-VolumesNegativeTest-657120278 tempest-VolumesNegativeTest-657120278-project-member] Deleted allocations for instance 0b140c11-1a26-4312-9cec-8054582d15f5
Aug 26 10:14:58 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-91d31d38-9b4f-449f-bf52-e555a4575f9d tempest-VolumesNegativeTest-657120278 tempest-VolumesNegativeTest-657120278-project-member] Lock "0b140c11-1a26-4312-9cec-8054582d15f5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.473s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:14:58 user nova-compute[73572]: DEBUG nova.compute.manager [req-2d7cbbfb-1ec1-46ec-aa10-7f7dbf0cf2e8 req-f774d0e8-0fba-4915-85c1-e70092bd5f4e service nova] [instance: 0b140c11-1a26-4312-9cec-8054582d15f5] Received event network-vif-plugged-d8aac17a-7f10-44bf-ab6d-c7105bf7fa02 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:14:58 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-2d7cbbfb-1ec1-46ec-aa10-7f7dbf0cf2e8 req-f774d0e8-0fba-4915-85c1-e70092bd5f4e service nova] Acquiring lock "0b140c11-1a26-4312-9cec-8054582d15f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:14:58 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-2d7cbbfb-1ec1-46ec-aa10-7f7dbf0cf2e8 req-f774d0e8-0fba-4915-85c1-e70092bd5f4e service nova] Lock "0b140c11-1a26-4312-9cec-8054582d15f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:14:58 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-2d7cbbfb-1ec1-46ec-aa10-7f7dbf0cf2e8 req-f774d0e8-0fba-4915-85c1-e70092bd5f4e service nova] Lock "0b140c11-1a26-4312-9cec-8054582d15f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:14:58 user nova-compute[73572]: DEBUG nova.compute.manager [req-2d7cbbfb-1ec1-46ec-aa10-7f7dbf0cf2e8 req-f774d0e8-0fba-4915-85c1-e70092bd5f4e service nova] [instance: 0b140c11-1a26-4312-9cec-8054582d15f5] No waiting events found dispatching network-vif-plugged-d8aac17a-7f10-44bf-ab6d-c7105bf7fa02 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:14:58 user nova-compute[73572]: WARNING nova.compute.manager [req-2d7cbbfb-1ec1-46ec-aa10-7f7dbf0cf2e8 req-f774d0e8-0fba-4915-85c1-e70092bd5f4e service nova] [instance: 0b140c11-1a26-4312-9cec-8054582d15f5] Received unexpected event network-vif-plugged-d8aac17a-7f10-44bf-ab6d-c7105bf7fa02 for instance with vm_state deleted and task_state None.
Aug 26 10:14:58 user nova-compute[73572]: DEBUG nova.compute.manager [req-2d7cbbfb-1ec1-46ec-aa10-7f7dbf0cf2e8 req-f774d0e8-0fba-4915-85c1-e70092bd5f4e service nova] [instance: 32a28361-567b-4bd4-9f4f-d9cfac2c9388] Received event network-vif-plugged-47632d74-7b97-49f3-946c-0568247c7f7b {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:14:58 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-2d7cbbfb-1ec1-46ec-aa10-7f7dbf0cf2e8 req-f774d0e8-0fba-4915-85c1-e70092bd5f4e service nova] Acquiring lock "32a28361-567b-4bd4-9f4f-d9cfac2c9388-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:14:58 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-2d7cbbfb-1ec1-46ec-aa10-7f7dbf0cf2e8 req-f774d0e8-0fba-4915-85c1-e70092bd5f4e service nova] Lock "32a28361-567b-4bd4-9f4f-d9cfac2c9388-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:14:58 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-2d7cbbfb-1ec1-46ec-aa10-7f7dbf0cf2e8 req-f774d0e8-0fba-4915-85c1-e70092bd5f4e service nova] Lock "32a28361-567b-4bd4-9f4f-d9cfac2c9388-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:14:58 user nova-compute[73572]: DEBUG nova.compute.manager [req-2d7cbbfb-1ec1-46ec-aa10-7f7dbf0cf2e8 req-f774d0e8-0fba-4915-85c1-e70092bd5f4e service nova] [instance: 32a28361-567b-4bd4-9f4f-d9cfac2c9388] No waiting events found dispatching network-vif-plugged-47632d74-7b97-49f3-946c-0568247c7f7b {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:14:58 user nova-compute[73572]: WARNING nova.compute.manager [req-2d7cbbfb-1ec1-46ec-aa10-7f7dbf0cf2e8 req-f774d0e8-0fba-4915-85c1-e70092bd5f4e service nova] [instance: 32a28361-567b-4bd4-9f4f-d9cfac2c9388] Received unexpected event network-vif-plugged-47632d74-7b97-49f3-946c-0568247c7f7b for instance with vm_state building and task_state spawning.
Aug 26 10:14:58 user nova-compute[73572]: DEBUG nova.compute.manager [req-2d7cbbfb-1ec1-46ec-aa10-7f7dbf0cf2e8 req-f774d0e8-0fba-4915-85c1-e70092bd5f4e service nova] [instance: 32a28361-567b-4bd4-9f4f-d9cfac2c9388] Received event network-vif-plugged-47632d74-7b97-49f3-946c-0568247c7f7b {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:14:58 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-2d7cbbfb-1ec1-46ec-aa10-7f7dbf0cf2e8 req-f774d0e8-0fba-4915-85c1-e70092bd5f4e service nova] Acquiring lock "32a28361-567b-4bd4-9f4f-d9cfac2c9388-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:14:58 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-2d7cbbfb-1ec1-46ec-aa10-7f7dbf0cf2e8 req-f774d0e8-0fba-4915-85c1-e70092bd5f4e service nova] Lock "32a28361-567b-4bd4-9f4f-d9cfac2c9388-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:14:58 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-2d7cbbfb-1ec1-46ec-aa10-7f7dbf0cf2e8 req-f774d0e8-0fba-4915-85c1-e70092bd5f4e service nova] Lock "32a28361-567b-4bd4-9f4f-d9cfac2c9388-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:14:58 user nova-compute[73572]: DEBUG nova.compute.manager [req-2d7cbbfb-1ec1-46ec-aa10-7f7dbf0cf2e8 req-f774d0e8-0fba-4915-85c1-e70092bd5f4e service nova] [instance: 32a28361-567b-4bd4-9f4f-d9cfac2c9388] No waiting events found dispatching network-vif-plugged-47632d74-7b97-49f3-946c-0568247c7f7b {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:14:58 user nova-compute[73572]: WARNING nova.compute.manager [req-2d7cbbfb-1ec1-46ec-aa10-7f7dbf0cf2e8 req-f774d0e8-0fba-4915-85c1-e70092bd5f4e service nova] [instance: 32a28361-567b-4bd4-9f4f-d9cfac2c9388] Received unexpected event network-vif-plugged-47632d74-7b97-49f3-946c-0568247c7f7b for instance with vm_state building and task_state spawning.
Aug 26 10:14:58 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:14:59 user nova-compute[73572]: DEBUG nova.virt.driver [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Emitting event <LifecycleEvent: 1693044899.0904682, 32a28361-567b-4bd4-9f4f-d9cfac2c9388 => Resumed> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:14:59 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 32a28361-567b-4bd4-9f4f-d9cfac2c9388] VM Resumed (Lifecycle Event)
Aug 26 10:14:59 user nova-compute[73572]: DEBUG nova.compute.manager [None req-046c7dec-8b64-4e63-b790-5b73e61d095f tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] [instance: 32a28361-567b-4bd4-9f4f-d9cfac2c9388] Instance event wait completed in 0 seconds for  {{(pid=73572) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 10:14:59 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-046c7dec-8b64-4e63-b790-5b73e61d095f tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] [instance: 32a28361-567b-4bd4-9f4f-d9cfac2c9388] Guest created on hypervisor {{(pid=73572) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 10:14:59 user nova-compute[73572]: INFO nova.virt.libvirt.driver [-] [instance: 32a28361-567b-4bd4-9f4f-d9cfac2c9388] Instance spawned successfully.
Aug 26 10:14:59 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-046c7dec-8b64-4e63-b790-5b73e61d095f tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] [instance: 32a28361-567b-4bd4-9f4f-d9cfac2c9388] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 10:14:59 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 32a28361-567b-4bd4-9f4f-d9cfac2c9388] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:14:59 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 32a28361-567b-4bd4-9f4f-d9cfac2c9388] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73572) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 10:14:59 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-046c7dec-8b64-4e63-b790-5b73e61d095f tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] [instance: 32a28361-567b-4bd4-9f4f-d9cfac2c9388] Found default for hw_cdrom_bus of ide {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:14:59 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-046c7dec-8b64-4e63-b790-5b73e61d095f tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] [instance: 32a28361-567b-4bd4-9f4f-d9cfac2c9388] Found default for hw_disk_bus of virtio {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:14:59 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-046c7dec-8b64-4e63-b790-5b73e61d095f tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] [instance: 32a28361-567b-4bd4-9f4f-d9cfac2c9388] Found default for hw_input_bus of None {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:14:59 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-046c7dec-8b64-4e63-b790-5b73e61d095f tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] [instance: 32a28361-567b-4bd4-9f4f-d9cfac2c9388] Found default for hw_pointer_model of None {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:14:59 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-046c7dec-8b64-4e63-b790-5b73e61d095f tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] [instance: 32a28361-567b-4bd4-9f4f-d9cfac2c9388] Found default for hw_video_model of virtio {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:14:59 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-046c7dec-8b64-4e63-b790-5b73e61d095f tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] [instance: 32a28361-567b-4bd4-9f4f-d9cfac2c9388] Found default for hw_vif_model of virtio {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:14:59 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 32a28361-567b-4bd4-9f4f-d9cfac2c9388] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 10:14:59 user nova-compute[73572]: DEBUG nova.virt.driver [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Emitting event <LifecycleEvent: 1693044899.092758, 32a28361-567b-4bd4-9f4f-d9cfac2c9388 => Started> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:14:59 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 32a28361-567b-4bd4-9f4f-d9cfac2c9388] VM Started (Lifecycle Event)
Aug 26 10:14:59 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 32a28361-567b-4bd4-9f4f-d9cfac2c9388] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:14:59 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 32a28361-567b-4bd4-9f4f-d9cfac2c9388] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73572) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 10:14:59 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 32a28361-567b-4bd4-9f4f-d9cfac2c9388] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 10:14:59 user nova-compute[73572]: INFO nova.compute.manager [None req-046c7dec-8b64-4e63-b790-5b73e61d095f tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] [instance: 32a28361-567b-4bd4-9f4f-d9cfac2c9388] Took 7.09 seconds to spawn the instance on the hypervisor.
Aug 26 10:14:59 user nova-compute[73572]: DEBUG nova.compute.manager [None req-046c7dec-8b64-4e63-b790-5b73e61d095f tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] [instance: 32a28361-567b-4bd4-9f4f-d9cfac2c9388] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:14:59 user nova-compute[73572]: INFO nova.compute.manager [None req-046c7dec-8b64-4e63-b790-5b73e61d095f tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] [instance: 32a28361-567b-4bd4-9f4f-d9cfac2c9388] Took 7.96 seconds to build instance.
Aug 26 10:14:59 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-046c7dec-8b64-4e63-b790-5b73e61d095f tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] Lock "32a28361-567b-4bd4-9f4f-d9cfac2c9388" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.082s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:15:00 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-cbbce299-296b-42f3-9eb9-6fbcf7f7b709 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] Acquiring lock "c225e50a-3760-43d4-b398-3a663b478873" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:15:00 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-cbbce299-296b-42f3-9eb9-6fbcf7f7b709 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] Lock "c225e50a-3760-43d4-b398-3a663b478873" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:15:00 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-cbbce299-296b-42f3-9eb9-6fbcf7f7b709 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] Acquiring lock "c225e50a-3760-43d4-b398-3a663b478873-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:15:00 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-cbbce299-296b-42f3-9eb9-6fbcf7f7b709 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] Lock "c225e50a-3760-43d4-b398-3a663b478873-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:15:00 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-cbbce299-296b-42f3-9eb9-6fbcf7f7b709 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] Lock "c225e50a-3760-43d4-b398-3a663b478873-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:15:00 user nova-compute[73572]: INFO nova.compute.manager [None req-cbbce299-296b-42f3-9eb9-6fbcf7f7b709 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] [instance: c225e50a-3760-43d4-b398-3a663b478873] Terminating instance
Aug 26 10:15:00 user nova-compute[73572]: DEBUG nova.compute.manager [None req-cbbce299-296b-42f3-9eb9-6fbcf7f7b709 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] [instance: c225e50a-3760-43d4-b398-3a663b478873] Start destroying the instance on the hypervisor. {{(pid=73572) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 10:15:00 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:15:00 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:15:01 user nova-compute[73572]: DEBUG nova.compute.manager [req-9588ec37-50b4-4fea-98f5-f463234eba06 req-0d74c9ee-65c6-4e5f-affa-205f49e475be service nova] [instance: c225e50a-3760-43d4-b398-3a663b478873] Received event network-vif-unplugged-e34f65a5-dd72-4d9c-ac50-2e7b1436db5d {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:15:01 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-9588ec37-50b4-4fea-98f5-f463234eba06 req-0d74c9ee-65c6-4e5f-affa-205f49e475be service nova] Acquiring lock "c225e50a-3760-43d4-b398-3a663b478873-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:15:01 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-9588ec37-50b4-4fea-98f5-f463234eba06 req-0d74c9ee-65c6-4e5f-affa-205f49e475be service nova] Lock "c225e50a-3760-43d4-b398-3a663b478873-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:15:01 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-9588ec37-50b4-4fea-98f5-f463234eba06 req-0d74c9ee-65c6-4e5f-affa-205f49e475be service nova] Lock "c225e50a-3760-43d4-b398-3a663b478873-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:15:01 user nova-compute[73572]: DEBUG nova.compute.manager [req-9588ec37-50b4-4fea-98f5-f463234eba06 req-0d74c9ee-65c6-4e5f-affa-205f49e475be service nova] [instance: c225e50a-3760-43d4-b398-3a663b478873] No waiting events found dispatching network-vif-unplugged-e34f65a5-dd72-4d9c-ac50-2e7b1436db5d {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:15:01 user nova-compute[73572]: DEBUG nova.compute.manager [req-9588ec37-50b4-4fea-98f5-f463234eba06 req-0d74c9ee-65c6-4e5f-affa-205f49e475be service nova] [instance: c225e50a-3760-43d4-b398-3a663b478873] Received event network-vif-unplugged-e34f65a5-dd72-4d9c-ac50-2e7b1436db5d for instance with task_state deleting. {{(pid=73572) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 10:15:01 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:15:01 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:15:01 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:15:01 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:15:01 user nova-compute[73572]: INFO nova.virt.libvirt.driver [-] [instance: c225e50a-3760-43d4-b398-3a663b478873] Instance destroyed successfully.
Aug 26 10:15:01 user nova-compute[73572]: DEBUG nova.objects.instance [None req-cbbce299-296b-42f3-9eb9-6fbcf7f7b709 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] Lazy-loading 'resources' on Instance uuid c225e50a-3760-43d4-b398-3a663b478873 {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:15:01 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-cbbce299-296b-42f3-9eb9-6fbcf7f7b709 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T10:13:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1568261567',display_name='tempest-ServersNegativeTestJSON-server-1568261567',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1568261567',id=11,image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T10:13:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='27e946bd18464231965d43e20f1d2201',ramdisk_id='',reservation_id='r-301jj1h3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1661886679',owner_user_name='tempest-ServersNegativeTestJSON-1661886679-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T10:13:21Z,user_data=None,user_id='8efee83728774e58a60714e5c72cb1f2',uuid=c225e50a-3760-43d4-b398-3a663b478873,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e34f65a5-dd72-4d9c-ac50-2e7b1436db5d", "address": "fa:16:3e:64:f5:1f", "network": {"id": "f4c05fef-baf8-4c06-876f-1bdccd5a8689", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-169805980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27e946bd18464231965d43e20f1d2201", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape34f65a5-dd", "ovs_interfaceid": "e34f65a5-dd72-4d9c-ac50-2e7b1436db5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 10:15:01 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-cbbce299-296b-42f3-9eb9-6fbcf7f7b709 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] Converting VIF {"id": "e34f65a5-dd72-4d9c-ac50-2e7b1436db5d", "address": "fa:16:3e:64:f5:1f", "network": {"id": "f4c05fef-baf8-4c06-876f-1bdccd5a8689", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-169805980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27e946bd18464231965d43e20f1d2201", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape34f65a5-dd", "ovs_interfaceid": "e34f65a5-dd72-4d9c-ac50-2e7b1436db5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:15:01 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-cbbce299-296b-42f3-9eb9-6fbcf7f7b709 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:64:f5:1f,bridge_name='br-int',has_traffic_filtering=True,id=e34f65a5-dd72-4d9c-ac50-2e7b1436db5d,network=Network(f4c05fef-baf8-4c06-876f-1bdccd5a8689),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape34f65a5-dd') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:15:01 user nova-compute[73572]: DEBUG os_vif [None req-cbbce299-296b-42f3-9eb9-6fbcf7f7b709 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:f5:1f,bridge_name='br-int',has_traffic_filtering=True,id=e34f65a5-dd72-4d9c-ac50-2e7b1436db5d,network=Network(f4c05fef-baf8-4c06-876f-1bdccd5a8689),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape34f65a5-dd') {{(pid=73572) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 10:15:01 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:15:01 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape34f65a5-dd, bridge=br-int, if_exists=True) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:15:01 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:15:01 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:15:01 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:15:01 user nova-compute[73572]: INFO os_vif [None req-cbbce299-296b-42f3-9eb9-6fbcf7f7b709 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:f5:1f,bridge_name='br-int',has_traffic_filtering=True,id=e34f65a5-dd72-4d9c-ac50-2e7b1436db5d,network=Network(f4c05fef-baf8-4c06-876f-1bdccd5a8689),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape34f65a5-dd')
Aug 26 10:15:01 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-cbbce299-296b-42f3-9eb9-6fbcf7f7b709 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] [instance: c225e50a-3760-43d4-b398-3a663b478873] Deleting instance files /opt/stack/data/nova/instances/c225e50a-3760-43d4-b398-3a663b478873_del
Aug 26 10:15:01 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-cbbce299-296b-42f3-9eb9-6fbcf7f7b709 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] [instance: c225e50a-3760-43d4-b398-3a663b478873] Deletion of /opt/stack/data/nova/instances/c225e50a-3760-43d4-b398-3a663b478873_del complete
Aug 26 10:15:01 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:15:01 user nova-compute[73572]: INFO nova.compute.manager [None req-cbbce299-296b-42f3-9eb9-6fbcf7f7b709 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] [instance: c225e50a-3760-43d4-b398-3a663b478873] Took 0.95 seconds to destroy the instance on the hypervisor.
Aug 26 10:15:01 user nova-compute[73572]: DEBUG oslo.service.loopingcall [None req-cbbce299-296b-42f3-9eb9-6fbcf7f7b709 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73572) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 10:15:01 user nova-compute[73572]: DEBUG nova.compute.manager [-] [instance: c225e50a-3760-43d4-b398-3a663b478873] Deallocating network for instance {{(pid=73572) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 10:15:01 user nova-compute[73572]: DEBUG nova.network.neutron [-] [instance: c225e50a-3760-43d4-b398-3a663b478873] deallocate_for_instance() {{(pid=73572) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 10:15:01 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:15:01 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:15:02 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-07a7669f-fc82-4e47-bd24-d72f34e94d1e tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] Acquiring lock "b3c0b9c1-4218-4d6e-acac-d5d1dcf4f1b8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:15:02 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-07a7669f-fc82-4e47-bd24-d72f34e94d1e tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] Lock "b3c0b9c1-4218-4d6e-acac-d5d1dcf4f1b8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:15:02 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-07a7669f-fc82-4e47-bd24-d72f34e94d1e tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] Acquiring lock "b3c0b9c1-4218-4d6e-acac-d5d1dcf4f1b8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:15:02 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-07a7669f-fc82-4e47-bd24-d72f34e94d1e tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] Lock "b3c0b9c1-4218-4d6e-acac-d5d1dcf4f1b8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:15:02 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-07a7669f-fc82-4e47-bd24-d72f34e94d1e tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] Lock "b3c0b9c1-4218-4d6e-acac-d5d1dcf4f1b8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:15:02 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:15:02 user nova-compute[73572]: INFO nova.compute.manager [None req-07a7669f-fc82-4e47-bd24-d72f34e94d1e tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] [instance: b3c0b9c1-4218-4d6e-acac-d5d1dcf4f1b8] Terminating instance
Aug 26 10:15:02 user nova-compute[73572]: DEBUG nova.compute.manager [None req-07a7669f-fc82-4e47-bd24-d72f34e94d1e tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] [instance: b3c0b9c1-4218-4d6e-acac-d5d1dcf4f1b8] Start destroying the instance on the hypervisor. {{(pid=73572) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 10:15:02 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:15:02 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:15:02 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:15:02 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:15:02 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:15:02 user nova-compute[73572]: DEBUG nova.compute.manager [req-8a98f797-df4a-4ea3-82cd-9552d70bc4cf req-4bf4380a-0875-4d1a-a0e7-7d9862b66139 service nova] [instance: b3c0b9c1-4218-4d6e-acac-d5d1dcf4f1b8] Received event network-vif-unplugged-6739bb4d-6b93-42f0-b2d9-f97a6a5a9040 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:15:02 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-8a98f797-df4a-4ea3-82cd-9552d70bc4cf req-4bf4380a-0875-4d1a-a0e7-7d9862b66139 service nova] Acquiring lock "b3c0b9c1-4218-4d6e-acac-d5d1dcf4f1b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:15:02 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-8a98f797-df4a-4ea3-82cd-9552d70bc4cf req-4bf4380a-0875-4d1a-a0e7-7d9862b66139 service nova] Lock "b3c0b9c1-4218-4d6e-acac-d5d1dcf4f1b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:15:02 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-8a98f797-df4a-4ea3-82cd-9552d70bc4cf req-4bf4380a-0875-4d1a-a0e7-7d9862b66139 service nova] Lock "b3c0b9c1-4218-4d6e-acac-d5d1dcf4f1b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:15:02 user nova-compute[73572]: DEBUG nova.compute.manager [req-8a98f797-df4a-4ea3-82cd-9552d70bc4cf req-4bf4380a-0875-4d1a-a0e7-7d9862b66139 service nova] [instance: b3c0b9c1-4218-4d6e-acac-d5d1dcf4f1b8] No waiting events found dispatching network-vif-unplugged-6739bb4d-6b93-42f0-b2d9-f97a6a5a9040 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:15:02 user nova-compute[73572]: DEBUG nova.compute.manager [req-8a98f797-df4a-4ea3-82cd-9552d70bc4cf req-4bf4380a-0875-4d1a-a0e7-7d9862b66139 service nova] [instance: b3c0b9c1-4218-4d6e-acac-d5d1dcf4f1b8] Received event network-vif-unplugged-6739bb4d-6b93-42f0-b2d9-f97a6a5a9040 for instance with task_state deleting. {{(pid=73572) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 10:15:02 user nova-compute[73572]: DEBUG nova.network.neutron [-] [instance: c225e50a-3760-43d4-b398-3a663b478873] Updating instance_info_cache with network_info: [] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:15:02 user nova-compute[73572]: INFO nova.compute.manager [-] [instance: c225e50a-3760-43d4-b398-3a663b478873] Took 1.32 seconds to deallocate network for instance.
Aug 26 10:15:02 user nova-compute[73572]: INFO nova.virt.libvirt.driver [-] [instance: b3c0b9c1-4218-4d6e-acac-d5d1dcf4f1b8] Instance destroyed successfully.
Aug 26 10:15:02 user nova-compute[73572]: DEBUG nova.objects.instance [None req-07a7669f-fc82-4e47-bd24-d72f34e94d1e tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] Lazy-loading 'resources' on Instance uuid b3c0b9c1-4218-4d6e-acac-d5d1dcf4f1b8 {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:15:03 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-07a7669f-fc82-4e47-bd24-d72f34e94d1e tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T10:13:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1171385115',display_name='tempest-VolumesActionsTest-instance-1171385115',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1171385115',id=12,image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T10:13:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='71aa440d71d44cd8a51d40bfbcae7f5f',ramdisk_id='',reservation_id='r-ml0ps272',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1871113041',owner_user_name='tempest-VolumesActionsTest-1871113041-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T10:13:21Z,user_data=None,user_id='257dcb60edca4eebabab0b4db96ba6d6',uuid=b3c0b9c1-4218-4d6e-acac-d5d1dcf4f1b8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6739bb4d-6b93-42f0-b2d9-f97a6a5a9040", "address": "fa:16:3e:a0:b1:c8", "network": {"id": "c0189896-22a3-47d8-adad-dff6c1e16a8f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2033963461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71aa440d71d44cd8a51d40bfbcae7f5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6739bb4d-6b", "ovs_interfaceid": "6739bb4d-6b93-42f0-b2d9-f97a6a5a9040", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 10:15:03 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-07a7669f-fc82-4e47-bd24-d72f34e94d1e tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] Converting VIF {"id": "6739bb4d-6b93-42f0-b2d9-f97a6a5a9040", "address": "fa:16:3e:a0:b1:c8", "network": {"id": "c0189896-22a3-47d8-adad-dff6c1e16a8f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2033963461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71aa440d71d44cd8a51d40bfbcae7f5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6739bb4d-6b", "ovs_interfaceid": "6739bb4d-6b93-42f0-b2d9-f97a6a5a9040", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:15:03 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-07a7669f-fc82-4e47-bd24-d72f34e94d1e tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a0:b1:c8,bridge_name='br-int',has_traffic_filtering=True,id=6739bb4d-6b93-42f0-b2d9-f97a6a5a9040,network=Network(c0189896-22a3-47d8-adad-dff6c1e16a8f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6739bb4d-6b') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:15:03 user nova-compute[73572]: DEBUG os_vif [None req-07a7669f-fc82-4e47-bd24-d72f34e94d1e tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:b1:c8,bridge_name='br-int',has_traffic_filtering=True,id=6739bb4d-6b93-42f0-b2d9-f97a6a5a9040,network=Network(c0189896-22a3-47d8-adad-dff6c1e16a8f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6739bb4d-6b') {{(pid=73572) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 10:15:03 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:15:03 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6739bb4d-6b, bridge=br-int, if_exists=True) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:15:03 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:15:03 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:15:03 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-cbbce299-296b-42f3-9eb9-6fbcf7f7b709 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:15:03 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-cbbce299-296b-42f3-9eb9-6fbcf7f7b709 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:15:03 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:15:03 user nova-compute[73572]: INFO os_vif [None req-07a7669f-fc82-4e47-bd24-d72f34e94d1e tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:b1:c8,bridge_name='br-int',has_traffic_filtering=True,id=6739bb4d-6b93-42f0-b2d9-f97a6a5a9040,network=Network(c0189896-22a3-47d8-adad-dff6c1e16a8f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6739bb4d-6b')
Aug 26 10:15:03 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-07a7669f-fc82-4e47-bd24-d72f34e94d1e tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] [instance: b3c0b9c1-4218-4d6e-acac-d5d1dcf4f1b8] Deleting instance files /opt/stack/data/nova/instances/b3c0b9c1-4218-4d6e-acac-d5d1dcf4f1b8_del
Aug 26 10:15:03 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-07a7669f-fc82-4e47-bd24-d72f34e94d1e tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] [instance: b3c0b9c1-4218-4d6e-acac-d5d1dcf4f1b8] Deletion of /opt/stack/data/nova/instances/b3c0b9c1-4218-4d6e-acac-d5d1dcf4f1b8_del complete
Aug 26 10:15:03 user nova-compute[73572]: DEBUG nova.compute.manager [req-25c003b1-7722-40df-aada-c10509d4876a req-10ccad36-5140-41cf-b641-b4d5245cefa6 service nova] [instance: c225e50a-3760-43d4-b398-3a663b478873] Received event network-vif-plugged-e34f65a5-dd72-4d9c-ac50-2e7b1436db5d {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:15:03 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-25c003b1-7722-40df-aada-c10509d4876a req-10ccad36-5140-41cf-b641-b4d5245cefa6 service nova] Acquiring lock "c225e50a-3760-43d4-b398-3a663b478873-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:15:03 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-25c003b1-7722-40df-aada-c10509d4876a req-10ccad36-5140-41cf-b641-b4d5245cefa6 service nova] Lock "c225e50a-3760-43d4-b398-3a663b478873-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:15:03 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-25c003b1-7722-40df-aada-c10509d4876a req-10ccad36-5140-41cf-b641-b4d5245cefa6 service nova] Lock "c225e50a-3760-43d4-b398-3a663b478873-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:15:03 user nova-compute[73572]: DEBUG nova.compute.manager [req-25c003b1-7722-40df-aada-c10509d4876a req-10ccad36-5140-41cf-b641-b4d5245cefa6 service nova] [instance: c225e50a-3760-43d4-b398-3a663b478873] No waiting events found dispatching network-vif-plugged-e34f65a5-dd72-4d9c-ac50-2e7b1436db5d {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:15:03 user nova-compute[73572]: WARNING nova.compute.manager [req-25c003b1-7722-40df-aada-c10509d4876a req-10ccad36-5140-41cf-b641-b4d5245cefa6 service nova] [instance: c225e50a-3760-43d4-b398-3a663b478873] Received unexpected event network-vif-plugged-e34f65a5-dd72-4d9c-ac50-2e7b1436db5d for instance with vm_state deleted and task_state None.
Aug 26 10:15:03 user nova-compute[73572]: DEBUG nova.compute.manager [req-25c003b1-7722-40df-aada-c10509d4876a req-10ccad36-5140-41cf-b641-b4d5245cefa6 service nova] [instance: c225e50a-3760-43d4-b398-3a663b478873] Received event network-vif-plugged-e34f65a5-dd72-4d9c-ac50-2e7b1436db5d {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:15:03 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-25c003b1-7722-40df-aada-c10509d4876a req-10ccad36-5140-41cf-b641-b4d5245cefa6 service nova] Acquiring lock "c225e50a-3760-43d4-b398-3a663b478873-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:15:03 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-25c003b1-7722-40df-aada-c10509d4876a req-10ccad36-5140-41cf-b641-b4d5245cefa6 service nova] Lock "c225e50a-3760-43d4-b398-3a663b478873-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:15:03 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-25c003b1-7722-40df-aada-c10509d4876a req-10ccad36-5140-41cf-b641-b4d5245cefa6 service nova] Lock "c225e50a-3760-43d4-b398-3a663b478873-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:15:03 user nova-compute[73572]: DEBUG nova.compute.manager [req-25c003b1-7722-40df-aada-c10509d4876a req-10ccad36-5140-41cf-b641-b4d5245cefa6 service nova] [instance: c225e50a-3760-43d4-b398-3a663b478873] No waiting events found dispatching network-vif-plugged-e34f65a5-dd72-4d9c-ac50-2e7b1436db5d {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:15:03 user nova-compute[73572]: WARNING nova.compute.manager [req-25c003b1-7722-40df-aada-c10509d4876a req-10ccad36-5140-41cf-b641-b4d5245cefa6 service nova] [instance: c225e50a-3760-43d4-b398-3a663b478873] Received unexpected event network-vif-plugged-e34f65a5-dd72-4d9c-ac50-2e7b1436db5d for instance with vm_state deleted and task_state None.
Aug 26 10:15:03 user nova-compute[73572]: DEBUG nova.compute.manager [req-25c003b1-7722-40df-aada-c10509d4876a req-10ccad36-5140-41cf-b641-b4d5245cefa6 service nova] [instance: c225e50a-3760-43d4-b398-3a663b478873] Received event network-vif-plugged-e34f65a5-dd72-4d9c-ac50-2e7b1436db5d {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:15:03 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-25c003b1-7722-40df-aada-c10509d4876a req-10ccad36-5140-41cf-b641-b4d5245cefa6 service nova] Acquiring lock "c225e50a-3760-43d4-b398-3a663b478873-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:15:03 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-25c003b1-7722-40df-aada-c10509d4876a req-10ccad36-5140-41cf-b641-b4d5245cefa6 service nova] Lock "c225e50a-3760-43d4-b398-3a663b478873-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:15:03 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-25c003b1-7722-40df-aada-c10509d4876a req-10ccad36-5140-41cf-b641-b4d5245cefa6 service nova] Lock "c225e50a-3760-43d4-b398-3a663b478873-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:15:03 user nova-compute[73572]: DEBUG nova.compute.manager [req-25c003b1-7722-40df-aada-c10509d4876a req-10ccad36-5140-41cf-b641-b4d5245cefa6 service nova] [instance: c225e50a-3760-43d4-b398-3a663b478873] No waiting events found dispatching network-vif-plugged-e34f65a5-dd72-4d9c-ac50-2e7b1436db5d {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:15:03 user nova-compute[73572]: WARNING nova.compute.manager [req-25c003b1-7722-40df-aada-c10509d4876a req-10ccad36-5140-41cf-b641-b4d5245cefa6 service nova] [instance: c225e50a-3760-43d4-b398-3a663b478873] Received unexpected event network-vif-plugged-e34f65a5-dd72-4d9c-ac50-2e7b1436db5d for instance with vm_state deleted and task_state None.
Aug 26 10:15:03 user nova-compute[73572]: DEBUG nova.compute.manager [req-25c003b1-7722-40df-aada-c10509d4876a req-10ccad36-5140-41cf-b641-b4d5245cefa6 service nova] [instance: c225e50a-3760-43d4-b398-3a663b478873] Received event network-vif-plugged-e34f65a5-dd72-4d9c-ac50-2e7b1436db5d {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:15:03 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-25c003b1-7722-40df-aada-c10509d4876a req-10ccad36-5140-41cf-b641-b4d5245cefa6 service nova] Acquiring lock "c225e50a-3760-43d4-b398-3a663b478873-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:15:03 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-25c003b1-7722-40df-aada-c10509d4876a req-10ccad36-5140-41cf-b641-b4d5245cefa6 service nova] Lock "c225e50a-3760-43d4-b398-3a663b478873-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:15:03 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-25c003b1-7722-40df-aada-c10509d4876a req-10ccad36-5140-41cf-b641-b4d5245cefa6 service nova] Lock "c225e50a-3760-43d4-b398-3a663b478873-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:15:03 user nova-compute[73572]: DEBUG nova.compute.manager [req-25c003b1-7722-40df-aada-c10509d4876a req-10ccad36-5140-41cf-b641-b4d5245cefa6 service nova] [instance: c225e50a-3760-43d4-b398-3a663b478873] No waiting events found dispatching network-vif-plugged-e34f65a5-dd72-4d9c-ac50-2e7b1436db5d {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:15:03 user nova-compute[73572]: WARNING nova.compute.manager [req-25c003b1-7722-40df-aada-c10509d4876a req-10ccad36-5140-41cf-b641-b4d5245cefa6 service nova] [instance: c225e50a-3760-43d4-b398-3a663b478873] Received unexpected event network-vif-plugged-e34f65a5-dd72-4d9c-ac50-2e7b1436db5d for instance with vm_state deleted and task_state None.
Aug 26 10:15:03 user nova-compute[73572]: DEBUG nova.compute.manager [req-25c003b1-7722-40df-aada-c10509d4876a req-10ccad36-5140-41cf-b641-b4d5245cefa6 service nova] [instance: c225e50a-3760-43d4-b398-3a663b478873] Received event network-vif-deleted-e34f65a5-dd72-4d9c-ac50-2e7b1436db5d {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:15:03 user nova-compute[73572]: INFO nova.compute.manager [None req-07a7669f-fc82-4e47-bd24-d72f34e94d1e tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] [instance: b3c0b9c1-4218-4d6e-acac-d5d1dcf4f1b8] Took 1.11 seconds to destroy the instance on the hypervisor.
Aug 26 10:15:03 user nova-compute[73572]: DEBUG oslo.service.loopingcall [None req-07a7669f-fc82-4e47-bd24-d72f34e94d1e tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73572) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 10:15:03 user nova-compute[73572]: DEBUG nova.compute.manager [-] [instance: b3c0b9c1-4218-4d6e-acac-d5d1dcf4f1b8] Deallocating network for instance {{(pid=73572) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 10:15:03 user nova-compute[73572]: DEBUG nova.network.neutron [-] [instance: b3c0b9c1-4218-4d6e-acac-d5d1dcf4f1b8] deallocate_for_instance() {{(pid=73572) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 10:15:03 user nova-compute[73572]: DEBUG nova.compute.provider_tree [None req-cbbce299-296b-42f3-9eb9-6fbcf7f7b709 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] Inventory has not changed in ProviderTree for provider: e2cec974-59b2-4c77-a53d-a7f4e5a30d75 {{(pid=73572) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 10:15:03 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-cbbce299-296b-42f3-9eb9-6fbcf7f7b709 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] Inventory has not changed for provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73572) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 10:15:03 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-cbbce299-296b-42f3-9eb9-6fbcf7f7b709 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.582s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:15:03 user nova-compute[73572]: INFO nova.scheduler.client.report [None req-cbbce299-296b-42f3-9eb9-6fbcf7f7b709 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] Deleted allocations for instance c225e50a-3760-43d4-b398-3a663b478873
Aug 26 10:15:03 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-cbbce299-296b-42f3-9eb9-6fbcf7f7b709 tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] Lock "c225e50a-3760-43d4-b398-3a663b478873" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.160s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:15:04 user nova-compute[73572]: DEBUG nova.network.neutron [-] [instance: b3c0b9c1-4218-4d6e-acac-d5d1dcf4f1b8] Updating instance_info_cache with network_info: [] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:15:04 user nova-compute[73572]: INFO nova.compute.manager [-] [instance: b3c0b9c1-4218-4d6e-acac-d5d1dcf4f1b8] Took 1.13 seconds to deallocate network for instance.
Aug 26 10:15:04 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-07a7669f-fc82-4e47-bd24-d72f34e94d1e tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:15:04 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-07a7669f-fc82-4e47-bd24-d72f34e94d1e tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:15:04 user nova-compute[73572]: DEBUG nova.compute.manager [req-451f312c-1e8d-4554-82c8-65e146317a09 req-95ecb9a0-c6ce-4f89-92ef-3f691b2de69a service nova] [instance: b3c0b9c1-4218-4d6e-acac-d5d1dcf4f1b8] Received event network-vif-plugged-6739bb4d-6b93-42f0-b2d9-f97a6a5a9040 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:15:04 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-451f312c-1e8d-4554-82c8-65e146317a09 req-95ecb9a0-c6ce-4f89-92ef-3f691b2de69a service nova] Acquiring lock "b3c0b9c1-4218-4d6e-acac-d5d1dcf4f1b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:15:04 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-451f312c-1e8d-4554-82c8-65e146317a09 req-95ecb9a0-c6ce-4f89-92ef-3f691b2de69a service nova] Lock "b3c0b9c1-4218-4d6e-acac-d5d1dcf4f1b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:15:04 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-451f312c-1e8d-4554-82c8-65e146317a09 req-95ecb9a0-c6ce-4f89-92ef-3f691b2de69a service nova] Lock "b3c0b9c1-4218-4d6e-acac-d5d1dcf4f1b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:15:04 user nova-compute[73572]: DEBUG nova.compute.manager [req-451f312c-1e8d-4554-82c8-65e146317a09 req-95ecb9a0-c6ce-4f89-92ef-3f691b2de69a service nova] [instance: b3c0b9c1-4218-4d6e-acac-d5d1dcf4f1b8] No waiting events found dispatching network-vif-plugged-6739bb4d-6b93-42f0-b2d9-f97a6a5a9040 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:15:04 user nova-compute[73572]: WARNING nova.compute.manager [req-451f312c-1e8d-4554-82c8-65e146317a09 req-95ecb9a0-c6ce-4f89-92ef-3f691b2de69a service nova] [instance: b3c0b9c1-4218-4d6e-acac-d5d1dcf4f1b8] Received unexpected event network-vif-plugged-6739bb4d-6b93-42f0-b2d9-f97a6a5a9040 for instance with vm_state deleted and task_state None.
Aug 26 10:15:04 user nova-compute[73572]: DEBUG nova.compute.provider_tree [None req-07a7669f-fc82-4e47-bd24-d72f34e94d1e tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] Inventory has not changed in ProviderTree for provider: e2cec974-59b2-4c77-a53d-a7f4e5a30d75 {{(pid=73572) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 10:15:04 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:15:04 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Starting heal instance info cache {{(pid=73572) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 10:15:04 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-07a7669f-fc82-4e47-bd24-d72f34e94d1e tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] Inventory has not changed for provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73572) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 10:15:04 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-07a7669f-fc82-4e47-bd24-d72f34e94d1e tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.454s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:15:04 user nova-compute[73572]: INFO nova.scheduler.client.report [None req-07a7669f-fc82-4e47-bd24-d72f34e94d1e tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] Deleted allocations for instance b3c0b9c1-4218-4d6e-acac-d5d1dcf4f1b8
Aug 26 10:15:04 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquiring lock "refresh_cache-c555f971-b177-4c26-a38e-09e0e78bf7b9" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:15:04 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquired lock "refresh_cache-c555f971-b177-4c26-a38e-09e0e78bf7b9" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:15:04 user nova-compute[73572]: DEBUG nova.network.neutron [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] [instance: c555f971-b177-4c26-a38e-09e0e78bf7b9] Forcefully refreshing network info cache for instance {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 10:15:05 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-07a7669f-fc82-4e47-bd24-d72f34e94d1e tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] Lock "b3c0b9c1-4218-4d6e-acac-d5d1dcf4f1b8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.952s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:15:05 user nova-compute[73572]: DEBUG nova.compute.manager [req-56506dbc-7726-42b7-b383-e942a55f3ea1 req-4dda22a6-bf26-489b-8839-4b5d68ad49c2 service nova] [instance: b3c0b9c1-4218-4d6e-acac-d5d1dcf4f1b8] Received event network-vif-deleted-6739bb4d-6b93-42f0-b2d9-f97a6a5a9040 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:15:06 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:15:06 user nova-compute[73572]: DEBUG nova.network.neutron [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] [instance: c555f971-b177-4c26-a38e-09e0e78bf7b9] Updating instance_info_cache with network_info: [{"id": "4ffb7229-16fb-441b-a954-d91308071fb8", "address": "fa:16:3e:26:32:ef", "network": {"id": "e052e34f-ce84-4612-b48b-2ed8474e7177", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-332746918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4556d14c0dd416fbe13ab2274947dec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ffb7229-16", "ovs_interfaceid": "4ffb7229-16fb-441b-a954-d91308071fb8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:15:06 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Releasing lock "refresh_cache-c555f971-b177-4c26-a38e-09e0e78bf7b9" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:15:06 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] [instance: c555f971-b177-4c26-a38e-09e0e78bf7b9] Updated the network info_cache for instance {{(pid=73572) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 10:15:06 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:15:07 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:15:07 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73572) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 10:15:08 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:15:09 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:15:09 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-93cf4380-2392-4ace-97a9-0b80c4bf1870 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] Acquiring lock "c555f971-b177-4c26-a38e-09e0e78bf7b9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:15:09 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-93cf4380-2392-4ace-97a9-0b80c4bf1870 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] Lock "c555f971-b177-4c26-a38e-09e0e78bf7b9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:15:09 user nova-compute[73572]: DEBUG nova.objects.instance [None req-93cf4380-2392-4ace-97a9-0b80c4bf1870 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] Lazy-loading 'flavor' on Instance uuid c555f971-b177-4c26-a38e-09e0e78bf7b9 {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:15:09 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-93cf4380-2392-4ace-97a9-0b80c4bf1870 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] Lock "c555f971-b177-4c26-a38e-09e0e78bf7b9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.114s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:15:09 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-93cf4380-2392-4ace-97a9-0b80c4bf1870 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] Acquiring lock "c555f971-b177-4c26-a38e-09e0e78bf7b9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:15:09 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-93cf4380-2392-4ace-97a9-0b80c4bf1870 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] Lock "c555f971-b177-4c26-a38e-09e0e78bf7b9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:15:09 user nova-compute[73572]: INFO nova.compute.manager [None req-93cf4380-2392-4ace-97a9-0b80c4bf1870 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] [instance: c555f971-b177-4c26-a38e-09e0e78bf7b9] Attaching volume ac5c1ee2-3656-49b3-942f-5fc992dc001b to /dev/vdb
Aug 26 10:15:09 user nova-compute[73572]: DEBUG os_brick.utils [None req-93cf4380-2392-4ace-97a9-0b80c4bf1870 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 10:15:09 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:15:09 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.023s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:15:09 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[69b5ab5c-2739-42b3-963f-c8f3975763c3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:de8a79ed912\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:15:09 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:15:09 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:15:09 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:15:09 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[6edd3fbe-87ba-4f79-a9df-8c51a8091ec4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:15:09 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:15:09 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:15:09 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[64d4fad6-fb74-48f8-9815-6656aef55be7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:15:09 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d550ca6-5c6a-48f0-be6c-c4595985b1a5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:15:09 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-93cf4380-2392-4ace-97a9-0b80c4bf1870 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] Running cmd (subprocess): nvme version {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:15:09 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-93cf4380-2392-4ace-97a9-0b80c4bf1870 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] 'nvme version' failed. Not Retrying. {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 10:15:09 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.nvmeof [None req-93cf4380-2392-4ace-97a9-0b80c4bf1870 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] nvme not present on system {{(pid=73572) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 10:15:09 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:15:09 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 10:15:09 user nova-compute[73572]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 10:15:09 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[532e341a-303b-4fbc-9bc0-4f4112d6a433]: (4, '') {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:15:09 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.lightos [None req-93cf4380-2392-4ace-97a9-0b80c4bf1870 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73572) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 10:15:09 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.lightos [None req-93cf4380-2392-4ace-97a9-0b80c4bf1870 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73572) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 10:15:09 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.lightos [None req-93cf4380-2392-4ace-97a9-0b80c4bf1870 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] LIGHTOS: no hostnqn found. {{(pid=73572) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 10:15:09 user nova-compute[73572]: DEBUG os_brick.utils [None req-93cf4380-2392-4ace-97a9-0b80c4bf1870 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:de8a79ed912', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 10:15:09 user nova-compute[73572]: DEBUG nova.virt.block_device [None req-93cf4380-2392-4ace-97a9-0b80c4bf1870 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] [instance: c555f971-b177-4c26-a38e-09e0e78bf7b9] Updating existing volume attachment record: 5ee88ad3-c295-4423-b9ee-f2939264ed0b {{(pid=73572) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 10:15:10 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:15:10 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:15:10 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:15:11 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-1e258a7f-6e52-41d1-bc86-d49c3d8692c9 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Acquiring lock "14fab12e-52be-4fe6-8777-bc7ebf3c25f1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:15:11 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-1e258a7f-6e52-41d1-bc86-d49c3d8692c9 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Lock "14fab12e-52be-4fe6-8777-bc7ebf3c25f1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:15:11 user nova-compute[73572]: DEBUG nova.compute.manager [None req-1e258a7f-6e52-41d1-bc86-d49c3d8692c9 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: 14fab12e-52be-4fe6-8777-bc7ebf3c25f1] Starting instance... {{(pid=73572) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 10:15:11 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-1dd0676a-6f86-4221-9e76-643ff0c83a03 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Acquiring lock "00c47a06-2bf8-427d-bcb1-304688584511" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:15:11 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-1dd0676a-6f86-4221-9e76-643ff0c83a03 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Lock "00c47a06-2bf8-427d-bcb1-304688584511" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:15:11 user nova-compute[73572]: DEBUG nova.compute.manager [None req-1dd0676a-6f86-4221-9e76-643ff0c83a03 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] [instance: 00c47a06-2bf8-427d-bcb1-304688584511] Starting instance... {{(pid=73572) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 10:15:11 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-1e258a7f-6e52-41d1-bc86-d49c3d8692c9 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:15:11 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-1e258a7f-6e52-41d1-bc86-d49c3d8692c9 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:15:11 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-1e258a7f-6e52-41d1-bc86-d49c3d8692c9 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73572) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 10:15:11 user nova-compute[73572]: INFO nova.compute.claims [None req-1e258a7f-6e52-41d1-bc86-d49c3d8692c9 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: 14fab12e-52be-4fe6-8777-bc7ebf3c25f1] Claim successful on node user
Aug 26 10:15:11 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-1dd0676a-6f86-4221-9e76-643ff0c83a03 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:15:11 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:15:11 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:15:11 user nova-compute[73572]: DEBUG nova.compute.provider_tree [None req-1e258a7f-6e52-41d1-bc86-d49c3d8692c9 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Inventory has not changed in ProviderTree for provider: e2cec974-59b2-4c77-a53d-a7f4e5a30d75 {{(pid=73572) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 10:15:11 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:15:11 user nova-compute[73572]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693044896.831607, 0b140c11-1a26-4312-9cec-8054582d15f5 => Stopped> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:15:11 user nova-compute[73572]: INFO nova.compute.manager [-] [instance: 0b140c11-1a26-4312-9cec-8054582d15f5] VM Stopped (Lifecycle Event)
Aug 26 10:15:11 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-1e258a7f-6e52-41d1-bc86-d49c3d8692c9 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Inventory has not changed for provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73572) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 10:15:11 user nova-compute[73572]: DEBUG nova.compute.manager [None req-f6086b4a-e9c4-4ac1-95bf-4feb20cace96 None None] [instance: 0b140c11-1a26-4312-9cec-8054582d15f5] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:15:11 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-1e258a7f-6e52-41d1-bc86-d49c3d8692c9 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.628s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:15:11 user nova-compute[73572]: DEBUG nova.compute.manager [None req-1e258a7f-6e52-41d1-bc86-d49c3d8692c9 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: 14fab12e-52be-4fe6-8777-bc7ebf3c25f1] Start building networks asynchronously for instance. {{(pid=73572) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 10:15:11 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-1dd0676a-6f86-4221-9e76-643ff0c83a03 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.578s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:15:11 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-1dd0676a-6f86-4221-9e76-643ff0c83a03 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73572) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 10:15:11 user nova-compute[73572]: INFO nova.compute.claims [None req-1dd0676a-6f86-4221-9e76-643ff0c83a03 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] [instance: 00c47a06-2bf8-427d-bcb1-304688584511] Claim successful on node user
Aug 26 10:15:11 user nova-compute[73572]: DEBUG nova.compute.manager [None req-1e258a7f-6e52-41d1-bc86-d49c3d8692c9 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: 14fab12e-52be-4fe6-8777-bc7ebf3c25f1] Allocating IP information in the background. {{(pid=73572) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 10:15:11 user nova-compute[73572]: DEBUG nova.network.neutron [None req-1e258a7f-6e52-41d1-bc86-d49c3d8692c9 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: 14fab12e-52be-4fe6-8777-bc7ebf3c25f1] allocate_for_instance() {{(pid=73572) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 10:15:11 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-1e258a7f-6e52-41d1-bc86-d49c3d8692c9 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: 14fab12e-52be-4fe6-8777-bc7ebf3c25f1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 10:15:12 user nova-compute[73572]: DEBUG nova.compute.manager [None req-1e258a7f-6e52-41d1-bc86-d49c3d8692c9 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: 14fab12e-52be-4fe6-8777-bc7ebf3c25f1] Start building block device mappings for instance. {{(pid=73572) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 10:15:12 user nova-compute[73572]: DEBUG nova.policy [None req-1e258a7f-6e52-41d1-bc86-d49c3d8692c9 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '07f3538038a14713af3bbe420f1fb03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4636f93c5bfc4653804de097aed2882c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73572) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 10:15:12 user nova-compute[73572]: INFO nova.virt.block_device [None req-1e258a7f-6e52-41d1-bc86-d49c3d8692c9 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: 14fab12e-52be-4fe6-8777-bc7ebf3c25f1] Booting with blank volume at /dev/vda
Aug 26 10:15:12 user nova-compute[73572]: DEBUG nova.compute.provider_tree [None req-1dd0676a-6f86-4221-9e76-643ff0c83a03 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Inventory has not changed in ProviderTree for provider: e2cec974-59b2-4c77-a53d-a7f4e5a30d75 {{(pid=73572) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 10:15:12 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-1dd0676a-6f86-4221-9e76-643ff0c83a03 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Inventory has not changed for provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73572) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 10:15:12 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-acc52716-aea6-4d4a-9149-c6110a3c274f tempest-VolumesAssistedSnapshotsTest-660608201 tempest-VolumesAssistedSnapshotsTest-660608201-project-member] Acquiring lock "bc56542d-af1f-4313-8555-1b2014ff35e7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:15:12 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-acc52716-aea6-4d4a-9149-c6110a3c274f tempest-VolumesAssistedSnapshotsTest-660608201 tempest-VolumesAssistedSnapshotsTest-660608201-project-member] Lock "bc56542d-af1f-4313-8555-1b2014ff35e7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:15:12 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-acc52716-aea6-4d4a-9149-c6110a3c274f tempest-VolumesAssistedSnapshotsTest-660608201 tempest-VolumesAssistedSnapshotsTest-660608201-project-member] Acquiring lock "bc56542d-af1f-4313-8555-1b2014ff35e7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:15:12 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-acc52716-aea6-4d4a-9149-c6110a3c274f tempest-VolumesAssistedSnapshotsTest-660608201 tempest-VolumesAssistedSnapshotsTest-660608201-project-member] Lock "bc56542d-af1f-4313-8555-1b2014ff35e7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:15:12 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-acc52716-aea6-4d4a-9149-c6110a3c274f tempest-VolumesAssistedSnapshotsTest-660608201 tempest-VolumesAssistedSnapshotsTest-660608201-project-member] Lock "bc56542d-af1f-4313-8555-1b2014ff35e7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:15:12 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-1dd0676a-6f86-4221-9e76-643ff0c83a03 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.567s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:15:12 user nova-compute[73572]: DEBUG nova.compute.manager [None req-1dd0676a-6f86-4221-9e76-643ff0c83a03 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] [instance: 00c47a06-2bf8-427d-bcb1-304688584511] Start building networks asynchronously for instance. {{(pid=73572) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 10:15:12 user nova-compute[73572]: INFO nova.compute.manager [None req-acc52716-aea6-4d4a-9149-c6110a3c274f tempest-VolumesAssistedSnapshotsTest-660608201 tempest-VolumesAssistedSnapshotsTest-660608201-project-member] [instance: bc56542d-af1f-4313-8555-1b2014ff35e7] Terminating instance
Aug 26 10:15:12 user nova-compute[73572]: DEBUG nova.compute.manager [None req-acc52716-aea6-4d4a-9149-c6110a3c274f tempest-VolumesAssistedSnapshotsTest-660608201 tempest-VolumesAssistedSnapshotsTest-660608201-project-member] [instance: bc56542d-af1f-4313-8555-1b2014ff35e7] Start destroying the instance on the hypervisor. {{(pid=73572) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 10:15:12 user nova-compute[73572]: DEBUG nova.compute.manager [None req-1dd0676a-6f86-4221-9e76-643ff0c83a03 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] [instance: 00c47a06-2bf8-427d-bcb1-304688584511] Allocating IP information in the background. {{(pid=73572) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 10:15:12 user nova-compute[73572]: DEBUG nova.network.neutron [None req-1dd0676a-6f86-4221-9e76-643ff0c83a03 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] [instance: 00c47a06-2bf8-427d-bcb1-304688584511] allocate_for_instance() {{(pid=73572) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 10:15:12 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:15:12 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-1dd0676a-6f86-4221-9e76-643ff0c83a03 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] [instance: 00c47a06-2bf8-427d-bcb1-304688584511] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 10:15:12 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:15:12 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:15:12 user nova-compute[73572]: DEBUG nova.compute.manager [None req-1dd0676a-6f86-4221-9e76-643ff0c83a03 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] [instance: 00c47a06-2bf8-427d-bcb1-304688584511] Start building block device mappings for instance. {{(pid=73572) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 10:15:12 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:15:12 user nova-compute[73572]: DEBUG nova.compute.manager [None req-1dd0676a-6f86-4221-9e76-643ff0c83a03 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] [instance: 00c47a06-2bf8-427d-bcb1-304688584511] Start spawning the instance on the hypervisor. {{(pid=73572) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 10:15:12 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-1dd0676a-6f86-4221-9e76-643ff0c83a03 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] [instance: 00c47a06-2bf8-427d-bcb1-304688584511] Creating instance directory {{(pid=73572) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 10:15:12 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-1dd0676a-6f86-4221-9e76-643ff0c83a03 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] [instance: 00c47a06-2bf8-427d-bcb1-304688584511] Creating image(s)
Aug 26 10:15:12 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-1dd0676a-6f86-4221-9e76-643ff0c83a03 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Acquiring lock "/opt/stack/data/nova/instances/00c47a06-2bf8-427d-bcb1-304688584511/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:15:12 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-1dd0676a-6f86-4221-9e76-643ff0c83a03 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Lock "/opt/stack/data/nova/instances/00c47a06-2bf8-427d-bcb1-304688584511/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:15:12 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-1dd0676a-6f86-4221-9e76-643ff0c83a03 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Lock "/opt/stack/data/nova/instances/00c47a06-2bf8-427d-bcb1-304688584511/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:15:12 user nova-compute[73572]: DEBUG nova.policy [None req-1dd0676a-6f86-4221-9e76-643ff0c83a03 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2a2ef00486924f318ff1e7e502e835a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084df935eab842e58bad79afad7090f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73572) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 10:15:12 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-1dd0676a-6f86-4221-9e76-643ff0c83a03 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:15:13 user nova-compute[73572]: DEBUG nova.network.neutron [None req-1e258a7f-6e52-41d1-bc86-d49c3d8692c9 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: 14fab12e-52be-4fe6-8777-bc7ebf3c25f1] Successfully created port: 1b2121f4-88b1-4815-9329-3c9e3172a2f6 {{(pid=73572) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 10:15:13 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:15:13 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-1dd0676a-6f86-4221-9e76-643ff0c83a03 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json" returned: 0 in 0.214s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:15:13 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-1dd0676a-6f86-4221-9e76-643ff0c83a03 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Acquiring lock "2099350d6f3bcd0de9471c73862d4fe75b049801" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:15:13 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-1dd0676a-6f86-4221-9e76-643ff0c83a03 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Lock "2099350d6f3bcd0de9471c73862d4fe75b049801" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.005s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:15:13 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-1dd0676a-6f86-4221-9e76-643ff0c83a03 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:15:13 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-1dd0676a-6f86-4221-9e76-643ff0c83a03 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json" returned: 0 in 0.214s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:15:13 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-1dd0676a-6f86-4221-9e76-643ff0c83a03 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801,backing_fmt=raw /opt/stack/data/nova/instances/00c47a06-2bf8-427d-bcb1-304688584511/disk 1073741824 {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:15:13 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:15:13 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:15:13 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:15:13 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-1dd0676a-6f86-4221-9e76-643ff0c83a03 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801,backing_fmt=raw /opt/stack/data/nova/instances/00c47a06-2bf8-427d-bcb1-304688584511/disk 1073741824" returned: 0 in 0.101s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:15:13 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-1dd0676a-6f86-4221-9e76-643ff0c83a03 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Lock "2099350d6f3bcd0de9471c73862d4fe75b049801" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.322s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:15:13 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-1dd0676a-6f86-4221-9e76-643ff0c83a03 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:15:13 user nova-compute[73572]: INFO nova.virt.libvirt.driver [-] [instance: bc56542d-af1f-4313-8555-1b2014ff35e7] Instance destroyed successfully.
Aug 26 10:15:13 user nova-compute[73572]: DEBUG nova.objects.instance [None req-acc52716-aea6-4d4a-9149-c6110a3c274f tempest-VolumesAssistedSnapshotsTest-660608201 tempest-VolumesAssistedSnapshotsTest-660608201-project-member] Lazy-loading 'resources' on Instance uuid bc56542d-af1f-4313-8555-1b2014ff35e7 {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:15:13 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-acc52716-aea6-4d4a-9149-c6110a3c274f tempest-VolumesAssistedSnapshotsTest-660608201 tempest-VolumesAssistedSnapshotsTest-660608201-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T10:12:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1463926599',display_name='tempest-VolumesAssistedSnapshotsTest-server-1463926599',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1463926599',id=8,image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO59clm+UeS+lSWO5m6hxgTc/vT1Dkw3E1n4U7V2cakRQ9jZyba5XfdE5JtxxprQuirUZeZ/koZSYgvKPvoo0C+8Fgt1XijaGVbE6tKhetRQFB8EdEwrDkJMJlNvTpNpAA==',key_name='tempest-keypair-1194946091',keypairs=<?>,launch_index=0,launched_at=2023-08-26T10:12:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='233ee4c01bde4dae890bb3cf43348e2d',ramdisk_id='',reservation_id='r-wxcoz1z8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-660608201',owner_user_name='tempest-VolumesAssistedSnapshotsTest-660608201-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T10:12:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='14eb164e4e9540cf9b472033313b321f',uuid=bc56542d-af1f-4313-8555-1b2014ff35e7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cc3f2aa1-a2e9-4558-8bcd-d26216e82b37", "address": "fa:16:3e:72:9b:7b", "network": {"id": "f44b02ba-9d68-4e71-8b33-e9596581cc5b", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-996168907-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "233ee4c01bde4dae890bb3cf43348e2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc3f2aa1-a2", "ovs_interfaceid": "cc3f2aa1-a2e9-4558-8bcd-d26216e82b37", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 10:15:13 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-acc52716-aea6-4d4a-9149-c6110a3c274f tempest-VolumesAssistedSnapshotsTest-660608201 tempest-VolumesAssistedSnapshotsTest-660608201-project-member] Converting VIF {"id": "cc3f2aa1-a2e9-4558-8bcd-d26216e82b37", "address": "fa:16:3e:72:9b:7b", "network": {"id": "f44b02ba-9d68-4e71-8b33-e9596581cc5b", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-996168907-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "233ee4c01bde4dae890bb3cf43348e2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc3f2aa1-a2", "ovs_interfaceid": "cc3f2aa1-a2e9-4558-8bcd-d26216e82b37", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:15:13 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-acc52716-aea6-4d4a-9149-c6110a3c274f tempest-VolumesAssistedSnapshotsTest-660608201 tempest-VolumesAssistedSnapshotsTest-660608201-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:72:9b:7b,bridge_name='br-int',has_traffic_filtering=True,id=cc3f2aa1-a2e9-4558-8bcd-d26216e82b37,network=Network(f44b02ba-9d68-4e71-8b33-e9596581cc5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc3f2aa1-a2') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:15:13 user nova-compute[73572]: DEBUG os_vif [None req-acc52716-aea6-4d4a-9149-c6110a3c274f tempest-VolumesAssistedSnapshotsTest-660608201 tempest-VolumesAssistedSnapshotsTest-660608201-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:72:9b:7b,bridge_name='br-int',has_traffic_filtering=True,id=cc3f2aa1-a2e9-4558-8bcd-d26216e82b37,network=Network(f44b02ba-9d68-4e71-8b33-e9596581cc5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc3f2aa1-a2') {{(pid=73572) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 10:15:13 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:15:13 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcc3f2aa1-a2, bridge=br-int, if_exists=True) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:15:13 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:15:13 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:15:13 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:15:13 user nova-compute[73572]: INFO os_vif [None req-acc52716-aea6-4d4a-9149-c6110a3c274f tempest-VolumesAssistedSnapshotsTest-660608201 tempest-VolumesAssistedSnapshotsTest-660608201-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:72:9b:7b,bridge_name='br-int',has_traffic_filtering=True,id=cc3f2aa1-a2e9-4558-8bcd-d26216e82b37,network=Network(f44b02ba-9d68-4e71-8b33-e9596581cc5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc3f2aa1-a2')
Aug 26 10:15:13 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-acc52716-aea6-4d4a-9149-c6110a3c274f tempest-VolumesAssistedSnapshotsTest-660608201 tempest-VolumesAssistedSnapshotsTest-660608201-project-member] [instance: bc56542d-af1f-4313-8555-1b2014ff35e7] Deleting instance files /opt/stack/data/nova/instances/bc56542d-af1f-4313-8555-1b2014ff35e7_del
Aug 26 10:15:13 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-acc52716-aea6-4d4a-9149-c6110a3c274f tempest-VolumesAssistedSnapshotsTest-660608201 tempest-VolumesAssistedSnapshotsTest-660608201-project-member] [instance: bc56542d-af1f-4313-8555-1b2014ff35e7] Deletion of /opt/stack/data/nova/instances/bc56542d-af1f-4313-8555-1b2014ff35e7_del complete
Aug 26 10:15:13 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:15:13 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-1dd0676a-6f86-4221-9e76-643ff0c83a03 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json" returned: 0 in 0.232s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:15:13 user nova-compute[73572]: DEBUG nova.virt.disk.api [None req-1dd0676a-6f86-4221-9e76-643ff0c83a03 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Checking if we can resize image /opt/stack/data/nova/instances/00c47a06-2bf8-427d-bcb1-304688584511/disk. size=1073741824 {{(pid=73572) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 10:15:13 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-1dd0676a-6f86-4221-9e76-643ff0c83a03 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00c47a06-2bf8-427d-bcb1-304688584511/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:15:13 user nova-compute[73572]: DEBUG nova.compute.manager [req-e95d7a83-e0b8-405e-8dbe-e254fb7ae24b req-84e20307-3e15-4967-bf2e-bb879d372b66 service nova] [instance: bc56542d-af1f-4313-8555-1b2014ff35e7] Received event network-vif-unplugged-cc3f2aa1-a2e9-4558-8bcd-d26216e82b37 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:15:13 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-e95d7a83-e0b8-405e-8dbe-e254fb7ae24b req-84e20307-3e15-4967-bf2e-bb879d372b66 service nova] Acquiring lock "bc56542d-af1f-4313-8555-1b2014ff35e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:15:13 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-e95d7a83-e0b8-405e-8dbe-e254fb7ae24b req-84e20307-3e15-4967-bf2e-bb879d372b66 service nova] Lock "bc56542d-af1f-4313-8555-1b2014ff35e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:15:13 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-e95d7a83-e0b8-405e-8dbe-e254fb7ae24b req-84e20307-3e15-4967-bf2e-bb879d372b66 service nova] Lock "bc56542d-af1f-4313-8555-1b2014ff35e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:15:13 user nova-compute[73572]: DEBUG nova.compute.manager [req-e95d7a83-e0b8-405e-8dbe-e254fb7ae24b req-84e20307-3e15-4967-bf2e-bb879d372b66 service nova] [instance: bc56542d-af1f-4313-8555-1b2014ff35e7] No waiting events found dispatching network-vif-unplugged-cc3f2aa1-a2e9-4558-8bcd-d26216e82b37 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:15:13 user nova-compute[73572]: DEBUG nova.compute.manager [req-e95d7a83-e0b8-405e-8dbe-e254fb7ae24b req-84e20307-3e15-4967-bf2e-bb879d372b66 service nova] [instance: bc56542d-af1f-4313-8555-1b2014ff35e7] Received event network-vif-unplugged-cc3f2aa1-a2e9-4558-8bcd-d26216e82b37 for instance with task_state deleting. {{(pid=73572) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 10:15:13 user nova-compute[73572]: INFO nova.compute.manager [None req-acc52716-aea6-4d4a-9149-c6110a3c274f tempest-VolumesAssistedSnapshotsTest-660608201 tempest-VolumesAssistedSnapshotsTest-660608201-project-member] [instance: bc56542d-af1f-4313-8555-1b2014ff35e7] Took 1.22 seconds to destroy the instance on the hypervisor.
Aug 26 10:15:13 user nova-compute[73572]: DEBUG oslo.service.loopingcall [None req-acc52716-aea6-4d4a-9149-c6110a3c274f tempest-VolumesAssistedSnapshotsTest-660608201 tempest-VolumesAssistedSnapshotsTest-660608201-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73572) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 10:15:13 user nova-compute[73572]: DEBUG nova.compute.manager [-] [instance: bc56542d-af1f-4313-8555-1b2014ff35e7] Deallocating network for instance {{(pid=73572) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 10:15:13 user nova-compute[73572]: DEBUG nova.network.neutron [-] [instance: bc56542d-af1f-4313-8555-1b2014ff35e7] deallocate_for_instance() {{(pid=73572) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 10:15:13 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-1dd0676a-6f86-4221-9e76-643ff0c83a03 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00c47a06-2bf8-427d-bcb1-304688584511/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:15:13 user nova-compute[73572]: DEBUG nova.virt.disk.api [None req-1dd0676a-6f86-4221-9e76-643ff0c83a03 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Cannot resize image /opt/stack/data/nova/instances/00c47a06-2bf8-427d-bcb1-304688584511/disk to a smaller size. {{(pid=73572) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 10:15:13 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-1dd0676a-6f86-4221-9e76-643ff0c83a03 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] [instance: 00c47a06-2bf8-427d-bcb1-304688584511] Created local disks {{(pid=73572) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 10:15:13 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-1dd0676a-6f86-4221-9e76-643ff0c83a03 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] [instance: 00c47a06-2bf8-427d-bcb1-304688584511] Ensure instance console log exists: /opt/stack/data/nova/instances/00c47a06-2bf8-427d-bcb1-304688584511/console.log {{(pid=73572) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 10:15:13 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-1dd0676a-6f86-4221-9e76-643ff0c83a03 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:15:13 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-1dd0676a-6f86-4221-9e76-643ff0c83a03 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:15:13 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-1dd0676a-6f86-4221-9e76-643ff0c83a03 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:15:13 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:15:13 user nova-compute[73572]: DEBUG nova.network.neutron [None req-1e258a7f-6e52-41d1-bc86-d49c3d8692c9 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: 14fab12e-52be-4fe6-8777-bc7ebf3c25f1] Successfully updated port: 1b2121f4-88b1-4815-9329-3c9e3172a2f6 {{(pid=73572) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 10:15:14 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:15:14 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:15:14 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-1e258a7f-6e52-41d1-bc86-d49c3d8692c9 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Acquiring lock "refresh_cache-14fab12e-52be-4fe6-8777-bc7ebf3c25f1" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:15:14 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-1e258a7f-6e52-41d1-bc86-d49c3d8692c9 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Acquired lock "refresh_cache-14fab12e-52be-4fe6-8777-bc7ebf3c25f1" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:15:14 user nova-compute[73572]: DEBUG nova.network.neutron [None req-1e258a7f-6e52-41d1-bc86-d49c3d8692c9 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: 14fab12e-52be-4fe6-8777-bc7ebf3c25f1] Building network info cache for instance {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 10:15:14 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:15:14 user nova-compute[73572]: DEBUG nova.compute.manager [req-1004fc8f-67cf-4b3a-8d9f-976cf55784dc req-67903578-1932-46ae-81fa-0cb23a2e7f27 service nova] [instance: 14fab12e-52be-4fe6-8777-bc7ebf3c25f1] Received event network-changed-1b2121f4-88b1-4815-9329-3c9e3172a2f6 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:15:14 user nova-compute[73572]: DEBUG nova.compute.manager [req-1004fc8f-67cf-4b3a-8d9f-976cf55784dc req-67903578-1932-46ae-81fa-0cb23a2e7f27 service nova] [instance: 14fab12e-52be-4fe6-8777-bc7ebf3c25f1] Refreshing instance network info cache due to event network-changed-1b2121f4-88b1-4815-9329-3c9e3172a2f6. {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 10:15:14 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-1004fc8f-67cf-4b3a-8d9f-976cf55784dc req-67903578-1932-46ae-81fa-0cb23a2e7f27 service nova] Acquiring lock "refresh_cache-14fab12e-52be-4fe6-8777-bc7ebf3c25f1" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:15:14 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:15:14 user nova-compute[73572]: DEBUG nova.network.neutron [None req-1e258a7f-6e52-41d1-bc86-d49c3d8692c9 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: 14fab12e-52be-4fe6-8777-bc7ebf3c25f1] Instance cache missing network info. {{(pid=73572) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 10:15:14 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:15:14 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:15:14 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:15:14 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:15:14 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:15:14 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:15:14 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:15:14 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Auditing locally available compute resources for user (node: user) {{(pid=73572) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 10:15:14 user nova-compute[73572]: DEBUG nova.network.neutron [None req-1e258a7f-6e52-41d1-bc86-d49c3d8692c9 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: 14fab12e-52be-4fe6-8777-bc7ebf3c25f1] Updating instance_info_cache with network_info: [{"id": "1b2121f4-88b1-4815-9329-3c9e3172a2f6", "address": "fa:16:3e:b0:35:f5", "network": {"id": "991b9dff-5173-4456-a530-b1f7eb5cfa4a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1845930297-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4636f93c5bfc4653804de097aed2882c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b2121f4-88", "ovs_interfaceid": "1b2121f4-88b1-4815-9329-3c9e3172a2f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:15:14 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-1e258a7f-6e52-41d1-bc86-d49c3d8692c9 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Releasing lock "refresh_cache-14fab12e-52be-4fe6-8777-bc7ebf3c25f1" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:15:14 user nova-compute[73572]: DEBUG nova.compute.manager [None req-1e258a7f-6e52-41d1-bc86-d49c3d8692c9 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: 14fab12e-52be-4fe6-8777-bc7ebf3c25f1] Instance network_info: |[{"id": "1b2121f4-88b1-4815-9329-3c9e3172a2f6", "address": "fa:16:3e:b0:35:f5", "network": {"id": "991b9dff-5173-4456-a530-b1f7eb5cfa4a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1845930297-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4636f93c5bfc4653804de097aed2882c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b2121f4-88", "ovs_interfaceid": "1b2121f4-88b1-4815-9329-3c9e3172a2f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73572) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 10:15:14 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-1004fc8f-67cf-4b3a-8d9f-976cf55784dc req-67903578-1932-46ae-81fa-0cb23a2e7f27 service nova] Acquired lock "refresh_cache-14fab12e-52be-4fe6-8777-bc7ebf3c25f1" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:15:14 user nova-compute[73572]: DEBUG nova.network.neutron [req-1004fc8f-67cf-4b3a-8d9f-976cf55784dc req-67903578-1932-46ae-81fa-0cb23a2e7f27 service nova] [instance: 14fab12e-52be-4fe6-8777-bc7ebf3c25f1] Refreshing network info cache for port 1b2121f4-88b1-4815-9329-3c9e3172a2f6 {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 10:15:15 user nova-compute[73572]: DEBUG nova.network.neutron [None req-1dd0676a-6f86-4221-9e76-643ff0c83a03 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] [instance: 00c47a06-2bf8-427d-bcb1-304688584511] Successfully created port: d18bfeb9-ad63-41d9-8d66-56df3d3306d8 {{(pid=73572) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 10:15:15 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8302d6e7-aaf3-461c-a55e-f2e685d1800d/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:15:15 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8302d6e7-aaf3-461c-a55e-f2e685d1800d/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:15:15 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8302d6e7-aaf3-461c-a55e-f2e685d1800d/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:15:15 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8302d6e7-aaf3-461c-a55e-f2e685d1800d/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:15:15 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c785b609-0068-442f-91f5-d26e888a993f/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:15:15 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c785b609-0068-442f-91f5-d26e888a993f/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:15:15 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c785b609-0068-442f-91f5-d26e888a993f/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:15:15 user nova-compute[73572]: DEBUG nova.compute.manager [req-5e875dc1-6c69-4e3b-8662-aea9826a5810 req-f33802bf-1769-4853-affd-1c7bce4cf391 service nova] [instance: bc56542d-af1f-4313-8555-1b2014ff35e7] Received event network-vif-plugged-cc3f2aa1-a2e9-4558-8bcd-d26216e82b37 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:15:15 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-5e875dc1-6c69-4e3b-8662-aea9826a5810 req-f33802bf-1769-4853-affd-1c7bce4cf391 service nova] Acquiring lock "bc56542d-af1f-4313-8555-1b2014ff35e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:15:15 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-5e875dc1-6c69-4e3b-8662-aea9826a5810 req-f33802bf-1769-4853-affd-1c7bce4cf391 service nova] Lock "bc56542d-af1f-4313-8555-1b2014ff35e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:15:15 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-5e875dc1-6c69-4e3b-8662-aea9826a5810 req-f33802bf-1769-4853-affd-1c7bce4cf391 service nova] Lock "bc56542d-af1f-4313-8555-1b2014ff35e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:15:15 user nova-compute[73572]: DEBUG nova.compute.manager [req-5e875dc1-6c69-4e3b-8662-aea9826a5810 req-f33802bf-1769-4853-affd-1c7bce4cf391 service nova] [instance: bc56542d-af1f-4313-8555-1b2014ff35e7] No waiting events found dispatching network-vif-plugged-cc3f2aa1-a2e9-4558-8bcd-d26216e82b37 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:15:15 user nova-compute[73572]: WARNING nova.compute.manager [req-5e875dc1-6c69-4e3b-8662-aea9826a5810 req-f33802bf-1769-4853-affd-1c7bce4cf391 service nova] [instance: bc56542d-af1f-4313-8555-1b2014ff35e7] Received unexpected event network-vif-plugged-cc3f2aa1-a2e9-4558-8bcd-d26216e82b37 for instance with vm_state active and task_state deleting.
Aug 26 10:15:15 user nova-compute[73572]: DEBUG nova.compute.manager [req-5e875dc1-6c69-4e3b-8662-aea9826a5810 req-f33802bf-1769-4853-affd-1c7bce4cf391 service nova] [instance: bc56542d-af1f-4313-8555-1b2014ff35e7] Received event network-vif-plugged-cc3f2aa1-a2e9-4558-8bcd-d26216e82b37 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:15:15 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-5e875dc1-6c69-4e3b-8662-aea9826a5810 req-f33802bf-1769-4853-affd-1c7bce4cf391 service nova] Acquiring lock "bc56542d-af1f-4313-8555-1b2014ff35e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:15:15 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-5e875dc1-6c69-4e3b-8662-aea9826a5810 req-f33802bf-1769-4853-affd-1c7bce4cf391 service nova] Lock "bc56542d-af1f-4313-8555-1b2014ff35e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:15:15 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-5e875dc1-6c69-4e3b-8662-aea9826a5810 req-f33802bf-1769-4853-affd-1c7bce4cf391 service nova] Lock "bc56542d-af1f-4313-8555-1b2014ff35e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:15:15 user nova-compute[73572]: DEBUG nova.compute.manager [req-5e875dc1-6c69-4e3b-8662-aea9826a5810 req-f33802bf-1769-4853-affd-1c7bce4cf391 service nova] [instance: bc56542d-af1f-4313-8555-1b2014ff35e7] No waiting events found dispatching network-vif-plugged-cc3f2aa1-a2e9-4558-8bcd-d26216e82b37 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:15:15 user nova-compute[73572]: WARNING nova.compute.manager [req-5e875dc1-6c69-4e3b-8662-aea9826a5810 req-f33802bf-1769-4853-affd-1c7bce4cf391 service nova] [instance: bc56542d-af1f-4313-8555-1b2014ff35e7] Received unexpected event network-vif-plugged-cc3f2aa1-a2e9-4558-8bcd-d26216e82b37 for instance with vm_state active and task_state deleting.
Aug 26 10:15:15 user nova-compute[73572]: DEBUG nova.compute.manager [req-5e875dc1-6c69-4e3b-8662-aea9826a5810 req-f33802bf-1769-4853-affd-1c7bce4cf391 service nova] [instance: bc56542d-af1f-4313-8555-1b2014ff35e7] Received event network-vif-plugged-cc3f2aa1-a2e9-4558-8bcd-d26216e82b37 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:15:15 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-5e875dc1-6c69-4e3b-8662-aea9826a5810 req-f33802bf-1769-4853-affd-1c7bce4cf391 service nova] Acquiring lock "bc56542d-af1f-4313-8555-1b2014ff35e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:15:15 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-5e875dc1-6c69-4e3b-8662-aea9826a5810 req-f33802bf-1769-4853-affd-1c7bce4cf391 service nova] Lock "bc56542d-af1f-4313-8555-1b2014ff35e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:15:15 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-5e875dc1-6c69-4e3b-8662-aea9826a5810 req-f33802bf-1769-4853-affd-1c7bce4cf391 service nova] Lock "bc56542d-af1f-4313-8555-1b2014ff35e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:15:15 user nova-compute[73572]: DEBUG nova.compute.manager [req-5e875dc1-6c69-4e3b-8662-aea9826a5810 req-f33802bf-1769-4853-affd-1c7bce4cf391 service nova] [instance: bc56542d-af1f-4313-8555-1b2014ff35e7] No waiting events found dispatching network-vif-plugged-cc3f2aa1-a2e9-4558-8bcd-d26216e82b37 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:15:15 user nova-compute[73572]: WARNING nova.compute.manager [req-5e875dc1-6c69-4e3b-8662-aea9826a5810 req-f33802bf-1769-4853-affd-1c7bce4cf391 service nova] [instance: bc56542d-af1f-4313-8555-1b2014ff35e7] Received unexpected event network-vif-plugged-cc3f2aa1-a2e9-4558-8bcd-d26216e82b37 for instance with vm_state active and task_state deleting.
Aug 26 10:15:15 user nova-compute[73572]: DEBUG nova.compute.manager [req-5e875dc1-6c69-4e3b-8662-aea9826a5810 req-f33802bf-1769-4853-affd-1c7bce4cf391 service nova] [instance: bc56542d-af1f-4313-8555-1b2014ff35e7] Received event network-vif-unplugged-cc3f2aa1-a2e9-4558-8bcd-d26216e82b37 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:15:15 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-5e875dc1-6c69-4e3b-8662-aea9826a5810 req-f33802bf-1769-4853-affd-1c7bce4cf391 service nova] Acquiring lock "bc56542d-af1f-4313-8555-1b2014ff35e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:15:15 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-5e875dc1-6c69-4e3b-8662-aea9826a5810 req-f33802bf-1769-4853-affd-1c7bce4cf391 service nova] Lock "bc56542d-af1f-4313-8555-1b2014ff35e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:15:15 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-5e875dc1-6c69-4e3b-8662-aea9826a5810 req-f33802bf-1769-4853-affd-1c7bce4cf391 service nova] Lock "bc56542d-af1f-4313-8555-1b2014ff35e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:15:15 user nova-compute[73572]: DEBUG nova.compute.manager [req-5e875dc1-6c69-4e3b-8662-aea9826a5810 req-f33802bf-1769-4853-affd-1c7bce4cf391 service nova] [instance: bc56542d-af1f-4313-8555-1b2014ff35e7] No waiting events found dispatching network-vif-unplugged-cc3f2aa1-a2e9-4558-8bcd-d26216e82b37 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:15:15 user nova-compute[73572]: DEBUG nova.compute.manager [req-5e875dc1-6c69-4e3b-8662-aea9826a5810 req-f33802bf-1769-4853-affd-1c7bce4cf391 service nova] [instance: bc56542d-af1f-4313-8555-1b2014ff35e7] Received event network-vif-unplugged-cc3f2aa1-a2e9-4558-8bcd-d26216e82b37 for instance with task_state deleting. {{(pid=73572) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 10:15:15 user nova-compute[73572]: DEBUG nova.compute.manager [req-5e875dc1-6c69-4e3b-8662-aea9826a5810 req-f33802bf-1769-4853-affd-1c7bce4cf391 service nova] [instance: bc56542d-af1f-4313-8555-1b2014ff35e7] Received event network-vif-plugged-cc3f2aa1-a2e9-4558-8bcd-d26216e82b37 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:15:15 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-5e875dc1-6c69-4e3b-8662-aea9826a5810 req-f33802bf-1769-4853-affd-1c7bce4cf391 service nova] Acquiring lock "bc56542d-af1f-4313-8555-1b2014ff35e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:15:15 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-5e875dc1-6c69-4e3b-8662-aea9826a5810 req-f33802bf-1769-4853-affd-1c7bce4cf391 service nova] Lock "bc56542d-af1f-4313-8555-1b2014ff35e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:15:15 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-5e875dc1-6c69-4e3b-8662-aea9826a5810 req-f33802bf-1769-4853-affd-1c7bce4cf391 service nova] Lock "bc56542d-af1f-4313-8555-1b2014ff35e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:15:15 user nova-compute[73572]: DEBUG nova.compute.manager [req-5e875dc1-6c69-4e3b-8662-aea9826a5810 req-f33802bf-1769-4853-affd-1c7bce4cf391 service nova] [instance: bc56542d-af1f-4313-8555-1b2014ff35e7] No waiting events found dispatching network-vif-plugged-cc3f2aa1-a2e9-4558-8bcd-d26216e82b37 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:15:15 user nova-compute[73572]: WARNING nova.compute.manager [req-5e875dc1-6c69-4e3b-8662-aea9826a5810 req-f33802bf-1769-4853-affd-1c7bce4cf391 service nova] [instance: bc56542d-af1f-4313-8555-1b2014ff35e7] Received unexpected event network-vif-plugged-cc3f2aa1-a2e9-4558-8bcd-d26216e82b37 for instance with vm_state active and task_state deleting.
Aug 26 10:15:15 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:15:15 user nova-compute[73572]: DEBUG nova.network.neutron [req-1004fc8f-67cf-4b3a-8d9f-976cf55784dc req-67903578-1932-46ae-81fa-0cb23a2e7f27 service nova] [instance: 14fab12e-52be-4fe6-8777-bc7ebf3c25f1] Updated VIF entry in instance network info cache for port 1b2121f4-88b1-4815-9329-3c9e3172a2f6. {{(pid=73572) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 10:15:15 user nova-compute[73572]: DEBUG nova.network.neutron [req-1004fc8f-67cf-4b3a-8d9f-976cf55784dc req-67903578-1932-46ae-81fa-0cb23a2e7f27 service nova] [instance: 14fab12e-52be-4fe6-8777-bc7ebf3c25f1] Updating instance_info_cache with network_info: [{"id": "1b2121f4-88b1-4815-9329-3c9e3172a2f6", "address": "fa:16:3e:b0:35:f5", "network": {"id": "991b9dff-5173-4456-a530-b1f7eb5cfa4a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1845930297-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4636f93c5bfc4653804de097aed2882c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b2121f4-88", "ovs_interfaceid": "1b2121f4-88b1-4815-9329-3c9e3172a2f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:15:15 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-1004fc8f-67cf-4b3a-8d9f-976cf55784dc req-67903578-1932-46ae-81fa-0cb23a2e7f27 service nova] Releasing lock "refresh_cache-14fab12e-52be-4fe6-8777-bc7ebf3c25f1" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:15:15 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c785b609-0068-442f-91f5-d26e888a993f/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:15:15 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32a28361-567b-4bd4-9f4f-d9cfac2c9388/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:15:16 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32a28361-567b-4bd4-9f4f-d9cfac2c9388/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:15:16 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32a28361-567b-4bd4-9f4f-d9cfac2c9388/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:15:16 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32a28361-567b-4bd4-9f4f-d9cfac2c9388/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:15:16 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2a731d2-13ff-49e5-ab17-80686b622df7/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:15:16 user nova-compute[73572]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693044901.3657315, c225e50a-3760-43d4-b398-3a663b478873 => Stopped> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:15:16 user nova-compute[73572]: INFO nova.compute.manager [-] [instance: c225e50a-3760-43d4-b398-3a663b478873] VM Stopped (Lifecycle Event)
Aug 26 10:15:16 user nova-compute[73572]: DEBUG nova.compute.manager [None req-41a72210-f93b-44fc-9659-b4d0012e71b9 None None] [instance: c225e50a-3760-43d4-b398-3a663b478873] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:15:16 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2a731d2-13ff-49e5-ab17-80686b622df7/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:15:16 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2a731d2-13ff-49e5-ab17-80686b622df7/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:15:16 user nova-compute[73572]: DEBUG nova.network.neutron [-] [instance: bc56542d-af1f-4313-8555-1b2014ff35e7] Updating instance_info_cache with network_info: [] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:15:16 user nova-compute[73572]: DEBUG nova.compute.manager [req-dc6e767f-c036-4fd7-8c99-0c4849e338f3 req-d7938583-4720-41b5-b075-5a8adcd00649 service nova] [instance: bc56542d-af1f-4313-8555-1b2014ff35e7] Received event network-vif-deleted-cc3f2aa1-a2e9-4558-8bcd-d26216e82b37 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:15:16 user nova-compute[73572]: INFO nova.compute.manager [req-dc6e767f-c036-4fd7-8c99-0c4849e338f3 req-d7938583-4720-41b5-b075-5a8adcd00649 service nova] [instance: bc56542d-af1f-4313-8555-1b2014ff35e7] Neutron deleted interface cc3f2aa1-a2e9-4558-8bcd-d26216e82b37; detaching it from the instance and deleting it from the info cache
Aug 26 10:15:16 user nova-compute[73572]: DEBUG nova.network.neutron [req-dc6e767f-c036-4fd7-8c99-0c4849e338f3 req-d7938583-4720-41b5-b075-5a8adcd00649 service nova] [instance: bc56542d-af1f-4313-8555-1b2014ff35e7] Updating instance_info_cache with network_info: [] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:15:16 user nova-compute[73572]: INFO nova.compute.manager [-] [instance: bc56542d-af1f-4313-8555-1b2014ff35e7] Took 3.03 seconds to deallocate network for instance.
Aug 26 10:15:16 user nova-compute[73572]: DEBUG nova.compute.manager [req-dc6e767f-c036-4fd7-8c99-0c4849e338f3 req-d7938583-4720-41b5-b075-5a8adcd00649 service nova] [instance: bc56542d-af1f-4313-8555-1b2014ff35e7] Detach interface failed, port_id=cc3f2aa1-a2e9-4558-8bcd-d26216e82b37, reason: Instance bc56542d-af1f-4313-8555-1b2014ff35e7 could not be found. {{(pid=73572) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 10:15:16 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2a731d2-13ff-49e5-ab17-80686b622df7/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:15:16 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee9bcbaa-25a6-4588-b757-2a2ae15b6cf8/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:15:16 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-acc52716-aea6-4d4a-9149-c6110a3c274f tempest-VolumesAssistedSnapshotsTest-660608201 tempest-VolumesAssistedSnapshotsTest-660608201-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:15:16 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-acc52716-aea6-4d4a-9149-c6110a3c274f tempest-VolumesAssistedSnapshotsTest-660608201 tempest-VolumesAssistedSnapshotsTest-660608201-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.003s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:15:16 user nova-compute[73572]: DEBUG nova.network.neutron [None req-1dd0676a-6f86-4221-9e76-643ff0c83a03 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] [instance: 00c47a06-2bf8-427d-bcb1-304688584511] Successfully updated port: d18bfeb9-ad63-41d9-8d66-56df3d3306d8 {{(pid=73572) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 10:15:16 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-1dd0676a-6f86-4221-9e76-643ff0c83a03 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Acquiring lock "refresh_cache-00c47a06-2bf8-427d-bcb1-304688584511" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:15:16 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-1dd0676a-6f86-4221-9e76-643ff0c83a03 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Acquired lock "refresh_cache-00c47a06-2bf8-427d-bcb1-304688584511" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:15:16 user nova-compute[73572]: DEBUG nova.network.neutron [None req-1dd0676a-6f86-4221-9e76-643ff0c83a03 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] [instance: 00c47a06-2bf8-427d-bcb1-304688584511] Building network info cache for instance {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 10:15:17 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee9bcbaa-25a6-4588-b757-2a2ae15b6cf8/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:15:17 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee9bcbaa-25a6-4588-b757-2a2ae15b6cf8/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:15:17 user nova-compute[73572]: DEBUG nova.network.neutron [None req-1dd0676a-6f86-4221-9e76-643ff0c83a03 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] [instance: 00c47a06-2bf8-427d-bcb1-304688584511] Instance cache missing network info. {{(pid=73572) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 10:15:17 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee9bcbaa-25a6-4588-b757-2a2ae15b6cf8/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:15:17 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c555f971-b177-4c26-a38e-09e0e78bf7b9/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:15:17 user nova-compute[73572]: DEBUG nova.compute.provider_tree [None req-acc52716-aea6-4d4a-9149-c6110a3c274f tempest-VolumesAssistedSnapshotsTest-660608201 tempest-VolumesAssistedSnapshotsTest-660608201-project-member] Inventory has not changed in ProviderTree for provider: e2cec974-59b2-4c77-a53d-a7f4e5a30d75 {{(pid=73572) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 10:15:17 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-acc52716-aea6-4d4a-9149-c6110a3c274f tempest-VolumesAssistedSnapshotsTest-660608201 tempest-VolumesAssistedSnapshotsTest-660608201-project-member] Inventory has not changed for provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73572) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 10:15:17 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:15:17 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-acc52716-aea6-4d4a-9149-c6110a3c274f tempest-VolumesAssistedSnapshotsTest-660608201 tempest-VolumesAssistedSnapshotsTest-660608201-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.516s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:15:17 user nova-compute[73572]: INFO nova.scheduler.client.report [None req-acc52716-aea6-4d4a-9149-c6110a3c274f tempest-VolumesAssistedSnapshotsTest-660608201 tempest-VolumesAssistedSnapshotsTest-660608201-project-member] Deleted allocations for instance bc56542d-af1f-4313-8555-1b2014ff35e7
Aug 26 10:15:17 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c555f971-b177-4c26-a38e-09e0e78bf7b9/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:15:17 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c555f971-b177-4c26-a38e-09e0e78bf7b9/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:15:17 user nova-compute[73572]: DEBUG nova.network.neutron [None req-1dd0676a-6f86-4221-9e76-643ff0c83a03 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] [instance: 00c47a06-2bf8-427d-bcb1-304688584511] Updating instance_info_cache with network_info: [{"id": "d18bfeb9-ad63-41d9-8d66-56df3d3306d8", "address": "fa:16:3e:a2:f2:f4", "network": {"id": "81543fb3-a8fe-4e9c-8180-c65fa4dcc9e1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-469390371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "084df935eab842e58bad79afad7090f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd18bfeb9-ad", "ovs_interfaceid": "d18bfeb9-ad63-41d9-8d66-56df3d3306d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:15:17 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-1dd0676a-6f86-4221-9e76-643ff0c83a03 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Releasing lock "refresh_cache-00c47a06-2bf8-427d-bcb1-304688584511" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:15:17 user nova-compute[73572]: DEBUG nova.compute.manager [None req-1dd0676a-6f86-4221-9e76-643ff0c83a03 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] [instance: 00c47a06-2bf8-427d-bcb1-304688584511] Instance network_info: |[{"id": "d18bfeb9-ad63-41d9-8d66-56df3d3306d8", "address": "fa:16:3e:a2:f2:f4", "network": {"id": "81543fb3-a8fe-4e9c-8180-c65fa4dcc9e1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-469390371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "084df935eab842e58bad79afad7090f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd18bfeb9-ad", "ovs_interfaceid": "d18bfeb9-ad63-41d9-8d66-56df3d3306d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73572) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 10:15:17 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-1dd0676a-6f86-4221-9e76-643ff0c83a03 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] [instance: 00c47a06-2bf8-427d-bcb1-304688584511] Start _get_guest_xml network_info=[{"id": "d18bfeb9-ad63-41d9-8d66-56df3d3306d8", "address": "fa:16:3e:a2:f2:f4", "network": {"id": "81543fb3-a8fe-4e9c-8180-c65fa4dcc9e1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-469390371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "084df935eab842e58bad79afad7090f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd18bfeb9-ad", "ovs_interfaceid": "d18bfeb9-ad63-41d9-8d66-56df3d3306d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T10:07:33Z,direct_url=<?>,disk_format='qcow2',id=299da0c9-e1c4-48f0-be55-fbe20dd06bc9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5c995f8bbbab4368b67a253e0df3971a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T10:07:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'guest_format': None, 'size': 0, 'encryption_format': None, 'device_type': 'disk', 'image_id': '299da0c9-e1c4-48f0-be55-fbe20dd06bc9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73572) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 10:15:17 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-1dd0676a-6f86-4221-9e76-643ff0c83a03 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:15:17 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-1dd0676a-6f86-4221-9e76-643ff0c83a03 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:15:17 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-1dd0676a-6f86-4221-9e76-643ff0c83a03 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73572) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 10:15:17 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-1dd0676a-6f86-4221-9e76-643ff0c83a03 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] CPU controller missing on host. {{(pid=73572) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 10:15:17 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-1dd0676a-6f86-4221-9e76-643ff0c83a03 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73572) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 10:15:17 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-1dd0676a-6f86-4221-9e76-643ff0c83a03 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] CPU controller found on host. {{(pid=73572) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 10:15:17 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-1dd0676a-6f86-4221-9e76-643ff0c83a03 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73572) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 10:15:17 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-1dd0676a-6f86-4221-9e76-643ff0c83a03 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T10:07:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T10:07:33Z,direct_url=<?>,disk_format='qcow2',id=299da0c9-e1c4-48f0-be55-fbe20dd06bc9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5c995f8bbbab4368b67a253e0df3971a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T10:07:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 10:15:17 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-1dd0676a-6f86-4221-9e76-643ff0c83a03 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Flavor limits 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 10:15:17 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-1dd0676a-6f86-4221-9e76-643ff0c83a03 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Image limits 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 10:15:17 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-1dd0676a-6f86-4221-9e76-643ff0c83a03 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Flavor pref 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 10:15:17 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-1dd0676a-6f86-4221-9e76-643ff0c83a03 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Image pref 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 10:15:17 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-1dd0676a-6f86-4221-9e76-643ff0c83a03 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 10:15:17 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-1dd0676a-6f86-4221-9e76-643ff0c83a03 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 10:15:17 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-1dd0676a-6f86-4221-9e76-643ff0c83a03 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73572) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 10:15:17 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-1dd0676a-6f86-4221-9e76-643ff0c83a03 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Got 1 possible topologies {{(pid=73572) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 10:15:17 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-1dd0676a-6f86-4221-9e76-643ff0c83a03 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 10:15:17 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-1dd0676a-6f86-4221-9e76-643ff0c83a03 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 10:15:17 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-1dd0676a-6f86-4221-9e76-643ff0c83a03 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T10:15:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-767184678',display_name='tempest-AttachVolumeTestJSON-server-767184678',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-767184678',id=15,image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDUM4e46LSrHmno1gp4T3RRXiXfjHx917gcUppmI/sxQPEY8hKY/vqoEhT+Bxby7kAu1Ei3af6xY5p/QME/Z3JthPiVJQ1F4Ur+7V+CECg8DAf4Z/fI85QJzneAszEfomQ==',key_name='tempest-keypair-643189050',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='084df935eab842e58bad79afad7090f3',ramdisk_id='',reservation_id='r-d4j1rgky',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-716261196',owner_user_name='tempest-AttachVolumeTestJSON-716261196-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T10:15:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2a2ef00486924f318ff1e7e502e835a6',uuid=00c47a06-2bf8-427d-bcb1-304688584511,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d18bfeb9-ad63-41d9-8d66-56df3d3306d8", "address": "fa:16:3e:a2:f2:f4", "network": {"id": "81543fb3-a8fe-4e9c-8180-c65fa4dcc9e1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-469390371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "084df935eab842e58bad79afad7090f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd18bfeb9-ad", "ovs_interfaceid": "d18bfeb9-ad63-41d9-8d66-56df3d3306d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73572) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 10:15:17 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-1dd0676a-6f86-4221-9e76-643ff0c83a03 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Converting VIF {"id": "d18bfeb9-ad63-41d9-8d66-56df3d3306d8", "address": "fa:16:3e:a2:f2:f4", "network": {"id": "81543fb3-a8fe-4e9c-8180-c65fa4dcc9e1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-469390371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "084df935eab842e58bad79afad7090f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd18bfeb9-ad", "ovs_interfaceid": "d18bfeb9-ad63-41d9-8d66-56df3d3306d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:15:17 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-1dd0676a-6f86-4221-9e76-643ff0c83a03 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:f2:f4,bridge_name='br-int',has_traffic_filtering=True,id=d18bfeb9-ad63-41d9-8d66-56df3d3306d8,network=Network(81543fb3-a8fe-4e9c-8180-c65fa4dcc9e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd18bfeb9-ad') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:15:17 user nova-compute[73572]: DEBUG nova.objects.instance [None req-1dd0676a-6f86-4221-9e76-643ff0c83a03 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Lazy-loading 'pci_devices' on Instance uuid 00c47a06-2bf8-427d-bcb1-304688584511 {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:15:17 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-acc52716-aea6-4d4a-9149-c6110a3c274f tempest-VolumesAssistedSnapshotsTest-660608201 tempest-VolumesAssistedSnapshotsTest-660608201-project-member] Lock "bc56542d-af1f-4313-8555-1b2014ff35e7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.143s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:15:17 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-1dd0676a-6f86-4221-9e76-643ff0c83a03 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] [instance: 00c47a06-2bf8-427d-bcb1-304688584511] End _get_guest_xml xml=<domain type="kvm">
Aug 26 10:15:17 user nova-compute[73572]:   <uuid>00c47a06-2bf8-427d-bcb1-304688584511</uuid>
Aug 26 10:15:17 user nova-compute[73572]:   <name>instance-0000000f</name>
Aug 26 10:15:17 user nova-compute[73572]:   <memory>524288</memory>
Aug 26 10:15:17 user nova-compute[73572]:   <vcpu>1</vcpu>
Aug 26 10:15:17 user nova-compute[73572]:   <metadata>
Aug 26 10:15:17 user nova-compute[73572]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 10:15:17 user nova-compute[73572]:       <nova:package version="0.0.0"/>
Aug 26 10:15:17 user nova-compute[73572]:       <nova:name>tempest-AttachVolumeTestJSON-server-767184678</nova:name>
Aug 26 10:15:17 user nova-compute[73572]:       <nova:creationTime>2023-08-26 10:15:17</nova:creationTime>
Aug 26 10:15:17 user nova-compute[73572]:       <nova:flavor name="m1.tiny">
Aug 26 10:15:17 user nova-compute[73572]:         <nova:memory>512</nova:memory>
Aug 26 10:15:17 user nova-compute[73572]:         <nova:disk>1</nova:disk>
Aug 26 10:15:17 user nova-compute[73572]:         <nova:swap>0</nova:swap>
Aug 26 10:15:17 user nova-compute[73572]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 10:15:17 user nova-compute[73572]:         <nova:vcpus>1</nova:vcpus>
Aug 26 10:15:17 user nova-compute[73572]:       </nova:flavor>
Aug 26 10:15:17 user nova-compute[73572]:       <nova:owner>
Aug 26 10:15:17 user nova-compute[73572]:         <nova:user uuid="2a2ef00486924f318ff1e7e502e835a6">tempest-AttachVolumeTestJSON-716261196-project-member</nova:user>
Aug 26 10:15:17 user nova-compute[73572]:         <nova:project uuid="084df935eab842e58bad79afad7090f3">tempest-AttachVolumeTestJSON-716261196</nova:project>
Aug 26 10:15:17 user nova-compute[73572]:       </nova:owner>
Aug 26 10:15:17 user nova-compute[73572]:       <nova:root type="image" uuid="299da0c9-e1c4-48f0-be55-fbe20dd06bc9"/>
Aug 26 10:15:17 user nova-compute[73572]:       <nova:ports>
Aug 26 10:15:17 user nova-compute[73572]:         <nova:port uuid="d18bfeb9-ad63-41d9-8d66-56df3d3306d8">
Aug 26 10:15:17 user nova-compute[73572]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 26 10:15:17 user nova-compute[73572]:         </nova:port>
Aug 26 10:15:17 user nova-compute[73572]:       </nova:ports>
Aug 26 10:15:17 user nova-compute[73572]:     </nova:instance>
Aug 26 10:15:17 user nova-compute[73572]:   </metadata>
Aug 26 10:15:17 user nova-compute[73572]:   <sysinfo type="smbios">
Aug 26 10:15:17 user nova-compute[73572]:     <system>
Aug 26 10:15:17 user nova-compute[73572]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 10:15:17 user nova-compute[73572]:       <entry name="product">OpenStack Nova</entry>
Aug 26 10:15:17 user nova-compute[73572]:       <entry name="version">0.0.0</entry>
Aug 26 10:15:17 user nova-compute[73572]:       <entry name="serial">00c47a06-2bf8-427d-bcb1-304688584511</entry>
Aug 26 10:15:17 user nova-compute[73572]:       <entry name="uuid">00c47a06-2bf8-427d-bcb1-304688584511</entry>
Aug 26 10:15:17 user nova-compute[73572]:       <entry name="family">Virtual Machine</entry>
Aug 26 10:15:17 user nova-compute[73572]:     </system>
Aug 26 10:15:17 user nova-compute[73572]:   </sysinfo>
Aug 26 10:15:17 user nova-compute[73572]:   <os>
Aug 26 10:15:17 user nova-compute[73572]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 10:15:17 user nova-compute[73572]:     <boot dev="hd"/>
Aug 26 10:15:17 user nova-compute[73572]:     <smbios mode="sysinfo"/>
Aug 26 10:15:17 user nova-compute[73572]:   </os>
Aug 26 10:15:17 user nova-compute[73572]:   <features>
Aug 26 10:15:17 user nova-compute[73572]:     <acpi/>
Aug 26 10:15:17 user nova-compute[73572]:     <apic/>
Aug 26 10:15:17 user nova-compute[73572]:     <vmcoreinfo/>
Aug 26 10:15:17 user nova-compute[73572]:   </features>
Aug 26 10:15:17 user nova-compute[73572]:   <clock offset="utc">
Aug 26 10:15:17 user nova-compute[73572]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 10:15:17 user nova-compute[73572]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 10:15:17 user nova-compute[73572]:     <timer name="hpet" present="no"/>
Aug 26 10:15:17 user nova-compute[73572]:   </clock>
Aug 26 10:15:17 user nova-compute[73572]:   <cpu mode="custom" match="exact">
Aug 26 10:15:17 user nova-compute[73572]:     <model>Nehalem</model>
Aug 26 10:15:17 user nova-compute[73572]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 10:15:17 user nova-compute[73572]:   </cpu>
Aug 26 10:15:17 user nova-compute[73572]:   <devices>
Aug 26 10:15:17 user nova-compute[73572]:     <disk type="file" device="disk">
Aug 26 10:15:17 user nova-compute[73572]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 10:15:17 user nova-compute[73572]:       <source file="/opt/stack/data/nova/instances/00c47a06-2bf8-427d-bcb1-304688584511/disk"/>
Aug 26 10:15:17 user nova-compute[73572]:       <target dev="vda" bus="virtio"/>
Aug 26 10:15:17 user nova-compute[73572]:     </disk>
Aug 26 10:15:17 user nova-compute[73572]:     <interface type="ethernet">
Aug 26 10:15:17 user nova-compute[73572]:       <mac address="fa:16:3e:a2:f2:f4"/>
Aug 26 10:15:17 user nova-compute[73572]:       <model type="virtio"/>
Aug 26 10:15:17 user nova-compute[73572]:       <mtu size="1442"/>
Aug 26 10:15:17 user nova-compute[73572]:       <target dev="tapd18bfeb9-ad"/>
Aug 26 10:15:17 user nova-compute[73572]:     </interface>
Aug 26 10:15:17 user nova-compute[73572]:     <serial type="pty">
Aug 26 10:15:17 user nova-compute[73572]:       <log file="/opt/stack/data/nova/instances/00c47a06-2bf8-427d-bcb1-304688584511/console.log" append="off"/>
Aug 26 10:15:17 user nova-compute[73572]:     </serial>
Aug 26 10:15:17 user nova-compute[73572]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 10:15:17 user nova-compute[73572]:     <video>
Aug 26 10:15:17 user nova-compute[73572]:       <model type="virtio"/>
Aug 26 10:15:17 user nova-compute[73572]:     </video>
Aug 26 10:15:17 user nova-compute[73572]:     <rng model="virtio">
Aug 26 10:15:17 user nova-compute[73572]:       <backend model="random">/dev/urandom</backend>
Aug 26 10:15:17 user nova-compute[73572]:     </rng>
Aug 26 10:15:17 user nova-compute[73572]:     <controller type="usb" index="0" model="none"/>
Aug 26 10:15:17 user nova-compute[73572]:     <memballoon model="virtio">
Aug 26 10:15:17 user nova-compute[73572]:       <stats period="10"/>
Aug 26 10:15:17 user nova-compute[73572]:     </memballoon>
Aug 26 10:15:17 user nova-compute[73572]:   </devices>
Aug 26 10:15:17 user nova-compute[73572]: </domain>
Aug 26 10:15:17 user nova-compute[73572]:  {{(pid=73572) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 10:15:17 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-1dd0676a-6f86-4221-9e76-643ff0c83a03 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T10:15:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-767184678',display_name='tempest-AttachVolumeTestJSON-server-767184678',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-767184678',id=15,image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDUM4e46LSrHmno1gp4T3RRXiXfjHx917gcUppmI/sxQPEY8hKY/vqoEhT+Bxby7kAu1Ei3af6xY5p/QME/Z3JthPiVJQ1F4Ur+7V+CECg8DAf4Z/fI85QJzneAszEfomQ==',key_name='tempest-keypair-643189050',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='084df935eab842e58bad79afad7090f3',ramdisk_id='',reservation_id='r-d4j1rgky',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-716261196',owner_user_name='tempest-AttachVolumeTestJSON-716261196-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T10:15:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2a2ef00486924f318ff1e7e502e835a6',uuid=00c47a06-2bf8-427d-bcb1-304688584511,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d18bfeb9-ad63-41d9-8d66-56df3d3306d8", "address": "fa:16:3e:a2:f2:f4", "network": {"id": "81543fb3-a8fe-4e9c-8180-c65fa4dcc9e1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-469390371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "084df935eab842e58bad79afad7090f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd18bfeb9-ad", "ovs_interfaceid": "d18bfeb9-ad63-41d9-8d66-56df3d3306d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 10:15:17 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-1dd0676a-6f86-4221-9e76-643ff0c83a03 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Converting VIF {"id": "d18bfeb9-ad63-41d9-8d66-56df3d3306d8", "address": "fa:16:3e:a2:f2:f4", "network": {"id": "81543fb3-a8fe-4e9c-8180-c65fa4dcc9e1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-469390371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "084df935eab842e58bad79afad7090f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd18bfeb9-ad", "ovs_interfaceid": "d18bfeb9-ad63-41d9-8d66-56df3d3306d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:15:17 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-1dd0676a-6f86-4221-9e76-643ff0c83a03 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:f2:f4,bridge_name='br-int',has_traffic_filtering=True,id=d18bfeb9-ad63-41d9-8d66-56df3d3306d8,network=Network(81543fb3-a8fe-4e9c-8180-c65fa4dcc9e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd18bfeb9-ad') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:15:17 user nova-compute[73572]: DEBUG os_vif [None req-1dd0676a-6f86-4221-9e76-643ff0c83a03 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:f2:f4,bridge_name='br-int',has_traffic_filtering=True,id=d18bfeb9-ad63-41d9-8d66-56df3d3306d8,network=Network(81543fb3-a8fe-4e9c-8180-c65fa4dcc9e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd18bfeb9-ad') {{(pid=73572) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 10:15:17 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:15:17 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:15:17 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 10:15:17 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c555f971-b177-4c26-a38e-09e0e78bf7b9/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:15:17 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:15:17 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd18bfeb9-ad, may_exist=True, interface_attrs={}) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:15:17 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd18bfeb9-ad, col_values=(('external_ids', {'iface-id': 'd18bfeb9-ad63-41d9-8d66-56df3d3306d8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a2:f2:f4', 'vm-uuid': '00c47a06-2bf8-427d-bcb1-304688584511'}),), if_exists=True) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:15:17 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:15:17 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:15:17 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73572) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 10:15:17 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73572) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 10:15:17 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=73572) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 10:15:17 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:15:17 user nova-compute[73572]: INFO os_vif [None req-1dd0676a-6f86-4221-9e76-643ff0c83a03 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:f2:f4,bridge_name='br-int',has_traffic_filtering=True,id=d18bfeb9-ad63-41d9-8d66-56df3d3306d8,network=Network(81543fb3-a8fe-4e9c-8180-c65fa4dcc9e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd18bfeb9-ad')
Aug 26 10:15:18 user nova-compute[73572]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693044902.9517002, b3c0b9c1-4218-4d6e-acac-d5d1dcf4f1b8 => Stopped> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:15:18 user nova-compute[73572]: INFO nova.compute.manager [-] [instance: b3c0b9c1-4218-4d6e-acac-d5d1dcf4f1b8] VM Stopped (Lifecycle Event)
Aug 26 10:15:18 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:15:18 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:15:18 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Hypervisor/Node resource view: name=user free_ram=7672MB free_disk=25.60680389404297GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=73572) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 10:15:18 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:15:18 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:15:18 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-1dd0676a-6f86-4221-9e76-643ff0c83a03 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] No BDM found with device name vda, not building metadata. {{(pid=73572) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 10:15:18 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-1dd0676a-6f86-4221-9e76-643ff0c83a03 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] No VIF found with MAC fa:16:3e:a2:f2:f4, not building metadata {{(pid=73572) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 10:15:18 user nova-compute[73572]: DEBUG nova.compute.manager [None req-7f5da9b0-8dc8-4cb3-be88-b1493aa83bef None None] [instance: b3c0b9c1-4218-4d6e-acac-d5d1dcf4f1b8] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:15:18 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance c785b609-0068-442f-91f5-d26e888a993f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:15:18 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance 8302d6e7-aaf3-461c-a55e-f2e685d1800d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:15:18 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance c555f971-b177-4c26-a38e-09e0e78bf7b9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:15:18 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance ee9bcbaa-25a6-4588-b757-2a2ae15b6cf8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:15:18 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance d2a731d2-13ff-49e5-ab17-80686b622df7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:15:18 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance 83670c16-3566-4679-8e74-c6451c840315 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:15:18 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance 32a28361-567b-4bd4-9f4f-d9cfac2c9388 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:15:18 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance 14fab12e-52be-4fe6-8777-bc7ebf3c25f1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:15:18 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance 00c47a06-2bf8-427d-bcb1-304688584511 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:15:18 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=73572) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 10:15:18 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=73572) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 10:15:18 user nova-compute[73572]: DEBUG os_brick.utils [None req-1e258a7f-6e52-41d1-bc86-d49c3d8692c9 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 10:15:18 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:15:18 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:15:18 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[077290d7-b1e5-4860-8952-c567234b8cd6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:de8a79ed912\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:15:18 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:15:18 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:15:18 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0872fe3-c221-4ca3-a48f-6bd9bd7985c6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:15:18 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:15:18 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:15:18 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[c56b263c-8520-44b9-931c-020f4287b8bf]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:15:18 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[3becbb62-ca2e-48b4-a445-242a1a6d791b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:15:18 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-1e258a7f-6e52-41d1-bc86-d49c3d8692c9 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Running cmd (subprocess): nvme version {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:15:18 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-1e258a7f-6e52-41d1-bc86-d49c3d8692c9 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] 'nvme version' failed. Not Retrying. {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 10:15:18 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1e258a7f-6e52-41d1-bc86-d49c3d8692c9 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] nvme not present on system {{(pid=73572) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 10:15:18 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:15:18 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 10:15:18 user nova-compute[73572]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 10:15:18 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[affd4133-e78f-40bb-8ddf-3c17633602b4]: (4, '') {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:15:18 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.lightos [None req-1e258a7f-6e52-41d1-bc86-d49c3d8692c9 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73572) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 10:15:18 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.lightos [None req-1e258a7f-6e52-41d1-bc86-d49c3d8692c9 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73572) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 10:15:18 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.lightos [None req-1e258a7f-6e52-41d1-bc86-d49c3d8692c9 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] LIGHTOS: no hostnqn found. {{(pid=73572) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 10:15:18 user nova-compute[73572]: DEBUG os_brick.utils [None req-1e258a7f-6e52-41d1-bc86-d49c3d8692c9 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] <== get_connector_properties: return (160ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:de8a79ed912', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 10:15:18 user nova-compute[73572]: DEBUG nova.virt.block_device [None req-1e258a7f-6e52-41d1-bc86-d49c3d8692c9 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: 14fab12e-52be-4fe6-8777-bc7ebf3c25f1] Updating existing volume attachment record: e784ff83-27ae-4861-be4b-16a6bf769b3a {{(pid=73572) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 10:15:18 user nova-compute[73572]: DEBUG nova.compute.provider_tree [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Inventory has not changed in ProviderTree for provider: e2cec974-59b2-4c77-a53d-a7f4e5a30d75 {{(pid=73572) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 10:15:18 user nova-compute[73572]: DEBUG nova.compute.manager [req-b36e898b-b3f6-4d06-b7b7-40af023f5df5 req-9901b92a-b688-42e0-8fe4-ebe6e5d1b518 service nova] [instance: 00c47a06-2bf8-427d-bcb1-304688584511] Received event network-changed-d18bfeb9-ad63-41d9-8d66-56df3d3306d8 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:15:18 user nova-compute[73572]: DEBUG nova.compute.manager [req-b36e898b-b3f6-4d06-b7b7-40af023f5df5 req-9901b92a-b688-42e0-8fe4-ebe6e5d1b518 service nova] [instance: 00c47a06-2bf8-427d-bcb1-304688584511] Refreshing instance network info cache due to event network-changed-d18bfeb9-ad63-41d9-8d66-56df3d3306d8. {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 10:15:18 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-b36e898b-b3f6-4d06-b7b7-40af023f5df5 req-9901b92a-b688-42e0-8fe4-ebe6e5d1b518 service nova] Acquiring lock "refresh_cache-00c47a06-2bf8-427d-bcb1-304688584511" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:15:18 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-b36e898b-b3f6-4d06-b7b7-40af023f5df5 req-9901b92a-b688-42e0-8fe4-ebe6e5d1b518 service nova] Acquired lock "refresh_cache-00c47a06-2bf8-427d-bcb1-304688584511" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:15:18 user nova-compute[73572]: DEBUG nova.network.neutron [req-b36e898b-b3f6-4d06-b7b7-40af023f5df5 req-9901b92a-b688-42e0-8fe4-ebe6e5d1b518 service nova] [instance: 00c47a06-2bf8-427d-bcb1-304688584511] Refreshing network info cache for port d18bfeb9-ad63-41d9-8d66-56df3d3306d8 {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 10:15:18 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Inventory has not changed for provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73572) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 10:15:18 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Compute_service record updated for user:user {{(pid=73572) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 10:15:18 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.722s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:15:19 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:15:19 user nova-compute[73572]: DEBUG nova.network.neutron [req-b36e898b-b3f6-4d06-b7b7-40af023f5df5 req-9901b92a-b688-42e0-8fe4-ebe6e5d1b518 service nova] [instance: 00c47a06-2bf8-427d-bcb1-304688584511] Updated VIF entry in instance network info cache for port d18bfeb9-ad63-41d9-8d66-56df3d3306d8. {{(pid=73572) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 10:15:19 user nova-compute[73572]: DEBUG nova.network.neutron [req-b36e898b-b3f6-4d06-b7b7-40af023f5df5 req-9901b92a-b688-42e0-8fe4-ebe6e5d1b518 service nova] [instance: 00c47a06-2bf8-427d-bcb1-304688584511] Updating instance_info_cache with network_info: [{"id": "d18bfeb9-ad63-41d9-8d66-56df3d3306d8", "address": "fa:16:3e:a2:f2:f4", "network": {"id": "81543fb3-a8fe-4e9c-8180-c65fa4dcc9e1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-469390371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "084df935eab842e58bad79afad7090f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd18bfeb9-ad", "ovs_interfaceid": "d18bfeb9-ad63-41d9-8d66-56df3d3306d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:15:19 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:15:19 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-b36e898b-b3f6-4d06-b7b7-40af023f5df5 req-9901b92a-b688-42e0-8fe4-ebe6e5d1b518 service nova] Releasing lock "refresh_cache-00c47a06-2bf8-427d-bcb1-304688584511" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:15:19 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:15:19 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:15:19 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:15:19 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:15:20 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:15:20 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:15:20 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:15:22 user nova-compute[73572]: DEBUG nova.virt.driver [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Emitting event <LifecycleEvent: 1693044922.0160978, 00c47a06-2bf8-427d-bcb1-304688584511 => Resumed> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:15:22 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 00c47a06-2bf8-427d-bcb1-304688584511] VM Resumed (Lifecycle Event)
Aug 26 10:15:22 user nova-compute[73572]: DEBUG nova.compute.manager [None req-1dd0676a-6f86-4221-9e76-643ff0c83a03 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] [instance: 00c47a06-2bf8-427d-bcb1-304688584511] Instance event wait completed in 0 seconds for  {{(pid=73572) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 10:15:22 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-1dd0676a-6f86-4221-9e76-643ff0c83a03 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] [instance: 00c47a06-2bf8-427d-bcb1-304688584511] Guest created on hypervisor {{(pid=73572) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 10:15:22 user nova-compute[73572]: INFO nova.virt.libvirt.driver [-] [instance: 00c47a06-2bf8-427d-bcb1-304688584511] Instance spawned successfully.
Aug 26 10:15:22 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-1dd0676a-6f86-4221-9e76-643ff0c83a03 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] [instance: 00c47a06-2bf8-427d-bcb1-304688584511] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 10:15:22 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 00c47a06-2bf8-427d-bcb1-304688584511] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:15:22 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 00c47a06-2bf8-427d-bcb1-304688584511] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73572) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 10:15:22 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-1dd0676a-6f86-4221-9e76-643ff0c83a03 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] [instance: 00c47a06-2bf8-427d-bcb1-304688584511] Found default for hw_cdrom_bus of ide {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:15:22 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-1dd0676a-6f86-4221-9e76-643ff0c83a03 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] [instance: 00c47a06-2bf8-427d-bcb1-304688584511] Found default for hw_disk_bus of virtio {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:15:22 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-1dd0676a-6f86-4221-9e76-643ff0c83a03 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] [instance: 00c47a06-2bf8-427d-bcb1-304688584511] Found default for hw_input_bus of None {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:15:22 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-1dd0676a-6f86-4221-9e76-643ff0c83a03 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] [instance: 00c47a06-2bf8-427d-bcb1-304688584511] Found default for hw_pointer_model of None {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:15:22 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-1dd0676a-6f86-4221-9e76-643ff0c83a03 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] [instance: 00c47a06-2bf8-427d-bcb1-304688584511] Found default for hw_video_model of virtio {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:15:22 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-1dd0676a-6f86-4221-9e76-643ff0c83a03 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] [instance: 00c47a06-2bf8-427d-bcb1-304688584511] Found default for hw_vif_model of virtio {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:15:22 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 00c47a06-2bf8-427d-bcb1-304688584511] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 10:15:22 user nova-compute[73572]: DEBUG nova.virt.driver [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Emitting event <LifecycleEvent: 1693044922.0216036, 00c47a06-2bf8-427d-bcb1-304688584511 => Started> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:15:22 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 00c47a06-2bf8-427d-bcb1-304688584511] VM Started (Lifecycle Event)
Aug 26 10:15:22 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 00c47a06-2bf8-427d-bcb1-304688584511] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:15:22 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 00c47a06-2bf8-427d-bcb1-304688584511] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73572) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 10:15:22 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 00c47a06-2bf8-427d-bcb1-304688584511] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 10:15:22 user nova-compute[73572]: INFO nova.compute.manager [None req-1dd0676a-6f86-4221-9e76-643ff0c83a03 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] [instance: 00c47a06-2bf8-427d-bcb1-304688584511] Took 9.39 seconds to spawn the instance on the hypervisor.
Aug 26 10:15:22 user nova-compute[73572]: DEBUG nova.compute.manager [None req-1dd0676a-6f86-4221-9e76-643ff0c83a03 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] [instance: 00c47a06-2bf8-427d-bcb1-304688584511] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:15:22 user nova-compute[73572]: INFO nova.compute.manager [None req-1dd0676a-6f86-4221-9e76-643ff0c83a03 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] [instance: 00c47a06-2bf8-427d-bcb1-304688584511] Took 11.05 seconds to build instance.
Aug 26 10:15:22 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-1dd0676a-6f86-4221-9e76-643ff0c83a03 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Lock "00c47a06-2bf8-427d-bcb1-304688584511" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.152s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:15:22 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:15:23 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-55ab0eb2-9bf3-48be-8900-44bbfc4ca36f tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Acquiring lock "d2970584-8c2a-4f99-922c-d66d59489504" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:15:23 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-55ab0eb2-9bf3-48be-8900-44bbfc4ca36f tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Lock "d2970584-8c2a-4f99-922c-d66d59489504" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:15:23 user nova-compute[73572]: DEBUG nova.compute.manager [None req-55ab0eb2-9bf3-48be-8900-44bbfc4ca36f tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] [instance: d2970584-8c2a-4f99-922c-d66d59489504] Starting instance... {{(pid=73572) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 10:15:23 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-55ab0eb2-9bf3-48be-8900-44bbfc4ca36f tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:15:23 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-55ab0eb2-9bf3-48be-8900-44bbfc4ca36f tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:15:23 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-55ab0eb2-9bf3-48be-8900-44bbfc4ca36f tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73572) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 10:15:23 user nova-compute[73572]: INFO nova.compute.claims [None req-55ab0eb2-9bf3-48be-8900-44bbfc4ca36f tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] [instance: d2970584-8c2a-4f99-922c-d66d59489504] Claim successful on node user
Aug 26 10:15:23 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-93cf4380-2392-4ace-97a9-0b80c4bf1870 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] [instance: c555f971-b177-4c26-a38e-09e0e78bf7b9] Calling os-brick to attach iSCSI Volume {{(pid=73572) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 10:15:23 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-93cf4380-2392-4ace-97a9-0b80c4bf1870 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc89c3d6a10>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:ac5c1ee2-3656-49b3-942f-5fc992dc001b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TqBgdYHa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 10:15:23 user nova-compute[73572]: WARNING os_brick.initiator.connectors.base [None req-93cf4380-2392-4ace-97a9-0b80c4bf1870 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 10:15:23 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-93cf4380-2392-4ace-97a9-0b80c4bf1870 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 10:15:23 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-93cf4380-2392-4ace-97a9-0b80c4bf1870 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 10:15:23 user nova-compute[73572]: WARNING os_brick.initiator.connectors.base [None req-93cf4380-2392-4ace-97a9-0b80c4bf1870 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 10:15:23 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-93cf4380-2392-4ace-97a9-0b80c4bf1870 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ac5c1ee2-3656-49b3-942f-5fc992dc001b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 10:15:23 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-93cf4380-2392-4ace-97a9-0b80c4bf1870 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ac5c1ee2-3656-49b3-942f-5fc992dc001b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 10:15:23 user nova-compute[73572]: INFO os_brick.initiator.connectors.iscsi [None req-93cf4380-2392-4ace-97a9-0b80c4bf1870 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 10:15:23 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac5c1ee2-3656-49b3-942f-5fc992dc001b -p 172.16.0.220:3260 {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:15:23 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac5c1ee2-3656-49b3-942f-5fc992dc001b -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:15:23 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc04dbf6-43c0-4366-adf6-bcad8eb69093]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:15:23 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-93cf4380-2392-4ace-97a9-0b80c4bf1870 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 10:15:23 user nova-compute[73572]:  {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:15:23 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac5c1ee2-3656-49b3-942f-5fc992dc001b -p 172.16.0.220:3260 --interface default --op new {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:15:23 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac5c1ee2-3656-49b3-942f-5fc992dc001b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:15:23 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[2415cde0-7fa1-4ad0-98a5-bdd887e5900e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ac5c1ee2-3656-49b3-942f-5fc992dc001b] added\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:15:23 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-93cf4380-2392-4ace-97a9-0b80c4bf1870 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ac5c1ee2-3656-49b3-942f-5fc992dc001b] added
Aug 26 10:15:23 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:15:23 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac5c1ee2-3656-49b3-942f-5fc992dc001b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:15:23 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac5c1ee2-3656-49b3-942f-5fc992dc001b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:15:23 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b0da12a-658d-4151-beba-c62fe923b790]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:15:23 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-93cf4380-2392-4ace-97a9-0b80c4bf1870 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:15:23 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac5c1ee2-3656-49b3-942f-5fc992dc001b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:15:23 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac5c1ee2-3656-49b3-942f-5fc992dc001b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:15:23 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[717de135-74db-4382-95e1-4f089857423d]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:15:23 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-93cf4380-2392-4ace-97a9-0b80c4bf1870 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:15:23 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac5c1ee2-3656-49b3-942f-5fc992dc001b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TqBgdYHa {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:15:23 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac5c1ee2-3656-49b3-942f-5fc992dc001b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TqBgdYHa" returned: 0 in 0.019s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:15:23 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[38c22e8b-eeae-4765-ac74-1c6f2c8a4d48]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:15:23 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-93cf4380-2392-4ace-97a9-0b80c4bf1870 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TqBgdYHa'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:15:23 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac5c1ee2-3656-49b3-942f-5fc992dc001b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:15:23 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac5c1ee2-3656-49b3-942f-5fc992dc001b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:15:23 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[54bdcea6-bff4-4a80-8b50-37d9ca8e8a52]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:15:23 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-93cf4380-2392-4ace-97a9-0b80c4bf1870 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:15:23 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:15:23 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:15:23 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1b7f417-5c96-44ae-945d-cdb042cf847c]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09ba694f-cb2a-4600-abe9-924b41292479 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85988ff4-7fac-4a96-a502-74d6ca8189fe (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75ebe4c4-f791-4f09-a9bd-747ade3d70a3 (non-flash)\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:15:23 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-93cf4380-2392-4ace-97a9-0b80c4bf1870 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09ba694f-cb2a-4600-abe9-924b41292479 (non-flash)
Aug 26 10:15:23 user nova-compute[73572]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85988ff4-7fac-4a96-a502-74d6ca8189fe (non-flash)
Aug 26 10:15:23 user nova-compute[73572]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75ebe4c4-f791-4f09-a9bd-747ade3d70a3 (non-flash)
Aug 26 10:15:23 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 10:15:23 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-93cf4380-2392-4ace-97a9-0b80c4bf1870 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09ba694f-cb2a-4600-abe9-924b41292479 (non-flash)
Aug 26 10:15:23 user nova-compute[73572]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85988ff4-7fac-4a96-a502-74d6ca8189fe (non-flash)
Aug 26 10:15:23 user nova-compute[73572]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75ebe4c4-f791-4f09-a9bd-747ade3d70a3 (non-flash)
Aug 26 10:15:23 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 10:15:23 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac5c1ee2-3656-49b3-942f-5fc992dc001b -p 172.16.0.220:3260 --login {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:15:23 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac5c1ee2-3656-49b3-942f-5fc992dc001b -p 172.16.0.220:3260 --login" returned: 0 in 0.080s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:15:23 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2718e77-5b2e-4de0-88dd-a0764b8d54c0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ac5c1ee2-3656-49b3-942f-5fc992dc001b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ac5c1ee2-3656-49b3-942f-5fc992dc001b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:15:23 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-93cf4380-2392-4ace-97a9-0b80c4bf1870 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ac5c1ee2-3656-49b3-942f-5fc992dc001b, portal: 172.16.0.220,3260]
Aug 26 10:15:23 user nova-compute[73572]: Login to [iface: default, target: iqn.2010-10.org.openstack:ac5c1ee2-3656-49b3-942f-5fc992dc001b, portal: 172.16.0.220,3260] successful.
Aug 26 10:15:23 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:15:23 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac5c1ee2-3656-49b3-942f-5fc992dc001b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:15:23 user nova-compute[73572]: DEBUG nova.compute.provider_tree [None req-55ab0eb2-9bf3-48be-8900-44bbfc4ca36f tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Inventory has not changed in ProviderTree for provider: e2cec974-59b2-4c77-a53d-a7f4e5a30d75 {{(pid=73572) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 10:15:23 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-55ab0eb2-9bf3-48be-8900-44bbfc4ca36f tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Inventory has not changed for provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73572) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 10:15:23 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac5c1ee2-3656-49b3-942f-5fc992dc001b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.032s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:15:23 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[37e95d52-c836-409d-b45f-24b57d040eca]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:15:23 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-93cf4380-2392-4ace-97a9-0b80c4bf1870 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:15:23 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:15:24 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:15:24 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ac8e74e-a8ef-4670-b04b-2b972f01cb90]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac5c1ee2-3656-49b3-942f-5fc992dc001b (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09ba694f-cb2a-4600-abe9-924b41292479 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85988ff4-7fac-4a96-a502-74d6ca8189fe (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75ebe4c4-f791-4f09-a9bd-747ade3d70a3 (non-flash)\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:15:24 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-93cf4380-2392-4ace-97a9-0b80c4bf1870 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac5c1ee2-3656-49b3-942f-5fc992dc001b (non-flash)
Aug 26 10:15:24 user nova-compute[73572]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09ba694f-cb2a-4600-abe9-924b41292479 (non-flash)
Aug 26 10:15:24 user nova-compute[73572]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85988ff4-7fac-4a96-a502-74d6ca8189fe (non-flash)
Aug 26 10:15:24 user nova-compute[73572]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75ebe4c4-f791-4f09-a9bd-747ade3d70a3 (non-flash)
Aug 26 10:15:24 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 10:15:24 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-93cf4380-2392-4ace-97a9-0b80c4bf1870 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac5c1ee2-3656-49b3-942f-5fc992dc001b (non-flash)
Aug 26 10:15:24 user nova-compute[73572]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09ba694f-cb2a-4600-abe9-924b41292479 (non-flash)
Aug 26 10:15:24 user nova-compute[73572]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85988ff4-7fac-4a96-a502-74d6ca8189fe (non-flash)
Aug 26 10:15:24 user nova-compute[73572]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75ebe4c4-f791-4f09-a9bd-747ade3d70a3 (non-flash)
Aug 26 10:15:24 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 10:15:24 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-93cf4380-2392-4ace-97a9-0b80c4bf1870 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ac5c1ee2-3656-49b3-942f-5fc992dc001b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.403s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 10:15:24 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-93cf4380-2392-4ace-97a9-0b80c4bf1870 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] Connected to 172.16.0.220:3260 {{(pid=73572) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 10:15:24 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-93cf4380-2392-4ace-97a9-0b80c4bf1870 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] HCTL ('36', '-', '-', 0) found on session 12 with lun 0 {{(pid=73572) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 10:15:24 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-93cf4380-2392-4ace-97a9-0b80c4bf1870 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73572) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 10:15:24 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-55ab0eb2-9bf3-48be-8900-44bbfc4ca36f tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.746s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:15:24 user nova-compute[73572]: DEBUG nova.compute.manager [None req-55ab0eb2-9bf3-48be-8900-44bbfc4ca36f tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] [instance: d2970584-8c2a-4f99-922c-d66d59489504] Start building networks asynchronously for instance. {{(pid=73572) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 10:15:24 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:15:24 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.019s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:15:24 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc6d095d-e803-4d24-ad5f-706347434db7]: (4, ('- - 0', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:15:24 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-93cf4380-2392-4ace-97a9-0b80c4bf1870 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] Searching for a device in session 12 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73572) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 10:15:24 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-93cf4380-2392-4ace-97a9-0b80c4bf1870 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TqBgdYHa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73572) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 10:15:24 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:15:24 user nova-compute[73572]: DEBUG nova.compute.manager [None req-55ab0eb2-9bf3-48be-8900-44bbfc4ca36f tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] [instance: d2970584-8c2a-4f99-922c-d66d59489504] Allocating IP information in the background. {{(pid=73572) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 10:15:24 user nova-compute[73572]: DEBUG nova.network.neutron [None req-55ab0eb2-9bf3-48be-8900-44bbfc4ca36f tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] [instance: d2970584-8c2a-4f99-922c-d66d59489504] allocate_for_instance() {{(pid=73572) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 10:15:24 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-55ab0eb2-9bf3-48be-8900-44bbfc4ca36f tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] [instance: d2970584-8c2a-4f99-922c-d66d59489504] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 10:15:24 user nova-compute[73572]: DEBUG nova.compute.manager [None req-55ab0eb2-9bf3-48be-8900-44bbfc4ca36f tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] [instance: d2970584-8c2a-4f99-922c-d66d59489504] Start building block device mappings for instance. {{(pid=73572) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 10:15:24 user nova-compute[73572]: DEBUG nova.compute.manager [None req-55ab0eb2-9bf3-48be-8900-44bbfc4ca36f tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] [instance: d2970584-8c2a-4f99-922c-d66d59489504] Start spawning the instance on the hypervisor. {{(pid=73572) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 10:15:24 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-55ab0eb2-9bf3-48be-8900-44bbfc4ca36f tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] [instance: d2970584-8c2a-4f99-922c-d66d59489504] Creating instance directory {{(pid=73572) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 10:15:24 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-55ab0eb2-9bf3-48be-8900-44bbfc4ca36f tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] [instance: d2970584-8c2a-4f99-922c-d66d59489504] Creating image(s)
Aug 26 10:15:24 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-55ab0eb2-9bf3-48be-8900-44bbfc4ca36f tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Acquiring lock "/opt/stack/data/nova/instances/d2970584-8c2a-4f99-922c-d66d59489504/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:15:24 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-55ab0eb2-9bf3-48be-8900-44bbfc4ca36f tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Lock "/opt/stack/data/nova/instances/d2970584-8c2a-4f99-922c-d66d59489504/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:15:24 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-55ab0eb2-9bf3-48be-8900-44bbfc4ca36f tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Lock "/opt/stack/data/nova/instances/d2970584-8c2a-4f99-922c-d66d59489504/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:15:24 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-55ab0eb2-9bf3-48be-8900-44bbfc4ca36f tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:15:24 user nova-compute[73572]: DEBUG nova.policy [None req-55ab0eb2-9bf3-48be-8900-44bbfc4ca36f tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b990faa34b924d29bf7c0490aaf07644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2be8d4c6c147e98a1b5b7443b3828d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73572) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 10:15:24 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-55ab0eb2-9bf3-48be-8900-44bbfc4ca36f tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json" returned: 0 in 0.209s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:15:24 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-55ab0eb2-9bf3-48be-8900-44bbfc4ca36f tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Acquiring lock "2099350d6f3bcd0de9471c73862d4fe75b049801" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:15:24 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-55ab0eb2-9bf3-48be-8900-44bbfc4ca36f tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Lock "2099350d6f3bcd0de9471c73862d4fe75b049801" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:15:24 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-55ab0eb2-9bf3-48be-8900-44bbfc4ca36f tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:15:24 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-55ab0eb2-9bf3-48be-8900-44bbfc4ca36f tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json" returned: 0 in 0.225s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:15:24 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-55ab0eb2-9bf3-48be-8900-44bbfc4ca36f tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801,backing_fmt=raw /opt/stack/data/nova/instances/d2970584-8c2a-4f99-922c-d66d59489504/disk 1073741824 {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:15:24 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-55ab0eb2-9bf3-48be-8900-44bbfc4ca36f tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801,backing_fmt=raw /opt/stack/data/nova/instances/d2970584-8c2a-4f99-922c-d66d59489504/disk 1073741824" returned: 0 in 0.062s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:15:24 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-55ab0eb2-9bf3-48be-8900-44bbfc4ca36f tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Lock "2099350d6f3bcd0de9471c73862d4fe75b049801" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.295s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:15:24 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-55ab0eb2-9bf3-48be-8900-44bbfc4ca36f tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:15:24 user nova-compute[73572]: DEBUG nova.compute.manager [req-4c79b96b-2f7c-4363-a679-5f23209621f6 req-92879af5-2ac1-46ce-afc1-9888c9e39c9c service nova] [instance: 00c47a06-2bf8-427d-bcb1-304688584511] Received event network-vif-plugged-d18bfeb9-ad63-41d9-8d66-56df3d3306d8 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:15:24 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-4c79b96b-2f7c-4363-a679-5f23209621f6 req-92879af5-2ac1-46ce-afc1-9888c9e39c9c service nova] Acquiring lock "00c47a06-2bf8-427d-bcb1-304688584511-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:15:24 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-4c79b96b-2f7c-4363-a679-5f23209621f6 req-92879af5-2ac1-46ce-afc1-9888c9e39c9c service nova] Lock "00c47a06-2bf8-427d-bcb1-304688584511-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:15:24 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-4c79b96b-2f7c-4363-a679-5f23209621f6 req-92879af5-2ac1-46ce-afc1-9888c9e39c9c service nova] Lock "00c47a06-2bf8-427d-bcb1-304688584511-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:15:24 user nova-compute[73572]: DEBUG nova.compute.manager [req-4c79b96b-2f7c-4363-a679-5f23209621f6 req-92879af5-2ac1-46ce-afc1-9888c9e39c9c service nova] [instance: 00c47a06-2bf8-427d-bcb1-304688584511] No waiting events found dispatching network-vif-plugged-d18bfeb9-ad63-41d9-8d66-56df3d3306d8 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:15:24 user nova-compute[73572]: WARNING nova.compute.manager [req-4c79b96b-2f7c-4363-a679-5f23209621f6 req-92879af5-2ac1-46ce-afc1-9888c9e39c9c service nova] [instance: 00c47a06-2bf8-427d-bcb1-304688584511] Received unexpected event network-vif-plugged-d18bfeb9-ad63-41d9-8d66-56df3d3306d8 for instance with vm_state active and task_state None.
Aug 26 10:15:25 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-55ab0eb2-9bf3-48be-8900-44bbfc4ca36f tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json" returned: 0 in 0.187s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:15:25 user nova-compute[73572]: DEBUG nova.virt.disk.api [None req-55ab0eb2-9bf3-48be-8900-44bbfc4ca36f tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d2970584-8c2a-4f99-922c-d66d59489504/disk. size=1073741824 {{(pid=73572) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 10:15:25 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-55ab0eb2-9bf3-48be-8900-44bbfc4ca36f tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2970584-8c2a-4f99-922c-d66d59489504/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:15:25 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-93cf4380-2392-4ace-97a9-0b80c4bf1870 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.476s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 10:15:25 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-93cf4380-2392-4ace-97a9-0b80c4bf1870 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] <== connect_volume: return (1479ms) {'type': 'block', 'scsi_wwn': '23034313335346462', 'path': '/dev/sde'} {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 10:15:25 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-93cf4380-2392-4ace-97a9-0b80c4bf1870 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] [instance: c555f971-b177-4c26-a38e-09e0e78bf7b9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23034313335346462', 'path': '/dev/sde'} {{(pid=73572) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 10:15:25 user nova-compute[73572]: DEBUG nova.objects.instance [None req-93cf4380-2392-4ace-97a9-0b80c4bf1870 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] Lazy-loading 'flavor' on Instance uuid c555f971-b177-4c26-a38e-09e0e78bf7b9 {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:15:25 user nova-compute[73572]: DEBUG nova.virt.libvirt.guest [None req-93cf4380-2392-4ace-97a9-0b80c4bf1870 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 10:15:25 user nova-compute[73572]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 10:15:25 user nova-compute[73572]:   <source dev="/dev/sde"/>
Aug 26 10:15:25 user nova-compute[73572]:   <target dev="vdb" bus="virtio"/>
Aug 26 10:15:25 user nova-compute[73572]:   <serial>ac5c1ee2-3656-49b3-942f-5fc992dc001b</serial>
Aug 26 10:15:25 user nova-compute[73572]: </disk>
Aug 26 10:15:25 user nova-compute[73572]:  {{(pid=73572) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 10:15:25 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-55ab0eb2-9bf3-48be-8900-44bbfc4ca36f tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2970584-8c2a-4f99-922c-d66d59489504/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:15:25 user nova-compute[73572]: DEBUG nova.virt.disk.api [None req-55ab0eb2-9bf3-48be-8900-44bbfc4ca36f tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Cannot resize image /opt/stack/data/nova/instances/d2970584-8c2a-4f99-922c-d66d59489504/disk to a smaller size. {{(pid=73572) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 10:15:25 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-55ab0eb2-9bf3-48be-8900-44bbfc4ca36f tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] [instance: d2970584-8c2a-4f99-922c-d66d59489504] Created local disks {{(pid=73572) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 10:15:25 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-55ab0eb2-9bf3-48be-8900-44bbfc4ca36f tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] [instance: d2970584-8c2a-4f99-922c-d66d59489504] Ensure instance console log exists: /opt/stack/data/nova/instances/d2970584-8c2a-4f99-922c-d66d59489504/console.log {{(pid=73572) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 10:15:25 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-55ab0eb2-9bf3-48be-8900-44bbfc4ca36f tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:15:25 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-55ab0eb2-9bf3-48be-8900-44bbfc4ca36f tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:15:25 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-55ab0eb2-9bf3-48be-8900-44bbfc4ca36f tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:15:25 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-93cf4380-2392-4ace-97a9-0b80c4bf1870 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] No BDM found with device name vda, not building metadata. {{(pid=73572) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 10:15:25 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-93cf4380-2392-4ace-97a9-0b80c4bf1870 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73572) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 10:15:25 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-93cf4380-2392-4ace-97a9-0b80c4bf1870 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] No VIF found with MAC fa:16:3e:26:32:ef, not building metadata {{(pid=73572) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 10:15:25 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-93cf4380-2392-4ace-97a9-0b80c4bf1870 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] Lock "c555f971-b177-4c26-a38e-09e0e78bf7b9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 16.210s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:15:26 user nova-compute[73572]: DEBUG nova.network.neutron [None req-55ab0eb2-9bf3-48be-8900-44bbfc4ca36f tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] [instance: d2970584-8c2a-4f99-922c-d66d59489504] Successfully created port: 754f85e2-09b3-418b-9c3f-452c88756d3a {{(pid=73572) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 10:15:26 user nova-compute[73572]: INFO nova.compute.manager [None req-4fe848ab-8dca-44c9-9fc4-07ef3901e2b0 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] [instance: c555f971-b177-4c26-a38e-09e0e78bf7b9] Rescuing
Aug 26 10:15:26 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-4fe848ab-8dca-44c9-9fc4-07ef3901e2b0 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] Acquiring lock "refresh_cache-c555f971-b177-4c26-a38e-09e0e78bf7b9" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:15:26 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-4fe848ab-8dca-44c9-9fc4-07ef3901e2b0 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] Acquired lock "refresh_cache-c555f971-b177-4c26-a38e-09e0e78bf7b9" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:15:26 user nova-compute[73572]: DEBUG nova.network.neutron [None req-4fe848ab-8dca-44c9-9fc4-07ef3901e2b0 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] [instance: c555f971-b177-4c26-a38e-09e0e78bf7b9] Building network info cache for instance {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 10:15:27 user nova-compute[73572]: DEBUG nova.compute.manager [req-dbda5b61-16b8-464b-89e5-92753dc1c672 req-271b109b-7a77-413a-b875-72ffba20136d service nova] [instance: 00c47a06-2bf8-427d-bcb1-304688584511] Received event network-vif-plugged-d18bfeb9-ad63-41d9-8d66-56df3d3306d8 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:15:27 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-dbda5b61-16b8-464b-89e5-92753dc1c672 req-271b109b-7a77-413a-b875-72ffba20136d service nova] Acquiring lock "00c47a06-2bf8-427d-bcb1-304688584511-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:15:27 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-dbda5b61-16b8-464b-89e5-92753dc1c672 req-271b109b-7a77-413a-b875-72ffba20136d service nova] Lock "00c47a06-2bf8-427d-bcb1-304688584511-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:15:27 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-dbda5b61-16b8-464b-89e5-92753dc1c672 req-271b109b-7a77-413a-b875-72ffba20136d service nova] Lock "00c47a06-2bf8-427d-bcb1-304688584511-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:15:27 user nova-compute[73572]: DEBUG nova.compute.manager [req-dbda5b61-16b8-464b-89e5-92753dc1c672 req-271b109b-7a77-413a-b875-72ffba20136d service nova] [instance: 00c47a06-2bf8-427d-bcb1-304688584511] No waiting events found dispatching network-vif-plugged-d18bfeb9-ad63-41d9-8d66-56df3d3306d8 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:15:27 user nova-compute[73572]: WARNING nova.compute.manager [req-dbda5b61-16b8-464b-89e5-92753dc1c672 req-271b109b-7a77-413a-b875-72ffba20136d service nova] [instance: 00c47a06-2bf8-427d-bcb1-304688584511] Received unexpected event network-vif-plugged-d18bfeb9-ad63-41d9-8d66-56df3d3306d8 for instance with vm_state active and task_state None.
Aug 26 10:15:27 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:15:27 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:15:27 user nova-compute[73572]: DEBUG nova.network.neutron [None req-4fe848ab-8dca-44c9-9fc4-07ef3901e2b0 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] [instance: c555f971-b177-4c26-a38e-09e0e78bf7b9] Updating instance_info_cache with network_info: [{"id": "4ffb7229-16fb-441b-a954-d91308071fb8", "address": "fa:16:3e:26:32:ef", "network": {"id": "e052e34f-ce84-4612-b48b-2ed8474e7177", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-332746918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4556d14c0dd416fbe13ab2274947dec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ffb7229-16", "ovs_interfaceid": "4ffb7229-16fb-441b-a954-d91308071fb8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:15:27 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-4fe848ab-8dca-44c9-9fc4-07ef3901e2b0 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] Releasing lock "refresh_cache-c555f971-b177-4c26-a38e-09e0e78bf7b9" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:15:28 user nova-compute[73572]: DEBUG nova.network.neutron [None req-55ab0eb2-9bf3-48be-8900-44bbfc4ca36f tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] [instance: d2970584-8c2a-4f99-922c-d66d59489504] Successfully updated port: 754f85e2-09b3-418b-9c3f-452c88756d3a {{(pid=73572) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 10:15:28 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-55ab0eb2-9bf3-48be-8900-44bbfc4ca36f tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Acquiring lock "refresh_cache-d2970584-8c2a-4f99-922c-d66d59489504" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:15:28 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-55ab0eb2-9bf3-48be-8900-44bbfc4ca36f tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Acquired lock "refresh_cache-d2970584-8c2a-4f99-922c-d66d59489504" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:15:28 user nova-compute[73572]: DEBUG nova.network.neutron [None req-55ab0eb2-9bf3-48be-8900-44bbfc4ca36f tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] [instance: d2970584-8c2a-4f99-922c-d66d59489504] Building network info cache for instance {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 10:15:28 user nova-compute[73572]: DEBUG nova.compute.manager [req-ba2dba16-b3e2-4631-94da-88d4a6d0333e req-953f630b-c25f-4937-af83-af51203adebf service nova] [instance: d2970584-8c2a-4f99-922c-d66d59489504] Received event network-changed-754f85e2-09b3-418b-9c3f-452c88756d3a {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:15:28 user nova-compute[73572]: DEBUG nova.compute.manager [req-ba2dba16-b3e2-4631-94da-88d4a6d0333e req-953f630b-c25f-4937-af83-af51203adebf service nova] [instance: d2970584-8c2a-4f99-922c-d66d59489504] Refreshing instance network info cache due to event network-changed-754f85e2-09b3-418b-9c3f-452c88756d3a. {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 10:15:28 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-ba2dba16-b3e2-4631-94da-88d4a6d0333e req-953f630b-c25f-4937-af83-af51203adebf service nova] Acquiring lock "refresh_cache-d2970584-8c2a-4f99-922c-d66d59489504" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:15:28 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:15:28 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:15:28 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:15:28 user nova-compute[73572]: DEBUG nova.network.neutron [None req-55ab0eb2-9bf3-48be-8900-44bbfc4ca36f tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] [instance: d2970584-8c2a-4f99-922c-d66d59489504] Instance cache missing network info. {{(pid=73572) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 10:15:28 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:15:28 user nova-compute[73572]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693044913.3525636, bc56542d-af1f-4313-8555-1b2014ff35e7 => Stopped> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:15:28 user nova-compute[73572]: INFO nova.compute.manager [-] [instance: bc56542d-af1f-4313-8555-1b2014ff35e7] VM Stopped (Lifecycle Event)
Aug 26 10:15:28 user nova-compute[73572]: DEBUG nova.compute.manager [None req-ecf52d2c-9fdd-414b-9c38-c00f77356e9a None None] [instance: bc56542d-af1f-4313-8555-1b2014ff35e7] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:15:28 user nova-compute[73572]: INFO nova.virt.libvirt.driver [-] [instance: c555f971-b177-4c26-a38e-09e0e78bf7b9] Instance destroyed successfully.
Aug 26 10:15:28 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-4fe848ab-8dca-44c9-9fc4-07ef3901e2b0 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] [instance: c555f971-b177-4c26-a38e-09e0e78bf7b9] Attempting a stable device rescue
Aug 26 10:15:28 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-4fe848ab-8dca-44c9-9fc4-07ef3901e2b0 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=73572) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 26 10:15:28 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-4fe848ab-8dca-44c9-9fc4-07ef3901e2b0 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] [instance: c555f971-b177-4c26-a38e-09e0e78bf7b9] Instance directory exists: not creating {{(pid=73572) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 26 10:15:28 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-4fe848ab-8dca-44c9-9fc4-07ef3901e2b0 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] [instance: c555f971-b177-4c26-a38e-09e0e78bf7b9] Creating image(s)
Aug 26 10:15:28 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-4fe848ab-8dca-44c9-9fc4-07ef3901e2b0 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] Acquiring lock "/opt/stack/data/nova/instances/c555f971-b177-4c26-a38e-09e0e78bf7b9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:15:28 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-4fe848ab-8dca-44c9-9fc4-07ef3901e2b0 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] Lock "/opt/stack/data/nova/instances/c555f971-b177-4c26-a38e-09e0e78bf7b9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:15:28 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-4fe848ab-8dca-44c9-9fc4-07ef3901e2b0 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] Lock "/opt/stack/data/nova/instances/c555f971-b177-4c26-a38e-09e0e78bf7b9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:15:28 user nova-compute[73572]: DEBUG nova.objects.instance [None req-4fe848ab-8dca-44c9-9fc4-07ef3901e2b0 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] Lazy-loading 'trusted_certs' on Instance uuid c555f971-b177-4c26-a38e-09e0e78bf7b9 {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:15:28 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-4fe848ab-8dca-44c9-9fc4-07ef3901e2b0 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] Acquiring lock "185e949b7072af41e5f0cfe823069a60b504cffb" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:15:28 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-4fe848ab-8dca-44c9-9fc4-07ef3901e2b0 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] Lock "185e949b7072af41e5f0cfe823069a60b504cffb" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:15:29 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-4fe848ab-8dca-44c9-9fc4-07ef3901e2b0 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/185e949b7072af41e5f0cfe823069a60b504cffb.part --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:15:29 user nova-compute[73572]: DEBUG nova.network.neutron [None req-55ab0eb2-9bf3-48be-8900-44bbfc4ca36f tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] [instance: d2970584-8c2a-4f99-922c-d66d59489504] Updating instance_info_cache with network_info: [{"id": "754f85e2-09b3-418b-9c3f-452c88756d3a", "address": "fa:16:3e:d6:92:13", "network": {"id": "e565abb6-25f8-4f92-9cca-69db36e4216a", "bridge": "br-int", "label": "tempest-TestStampPattern-1866566708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f2be8d4c6c147e98a1b5b7443b3828d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap754f85e2-09", "ovs_interfaceid": "754f85e2-09b3-418b-9c3f-452c88756d3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:15:29 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:15:29 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-55ab0eb2-9bf3-48be-8900-44bbfc4ca36f tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Releasing lock "refresh_cache-d2970584-8c2a-4f99-922c-d66d59489504" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:15:29 user nova-compute[73572]: DEBUG nova.compute.manager [None req-55ab0eb2-9bf3-48be-8900-44bbfc4ca36f tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] [instance: d2970584-8c2a-4f99-922c-d66d59489504] Instance network_info: |[{"id": "754f85e2-09b3-418b-9c3f-452c88756d3a", "address": "fa:16:3e:d6:92:13", "network": {"id": "e565abb6-25f8-4f92-9cca-69db36e4216a", "bridge": "br-int", "label": "tempest-TestStampPattern-1866566708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f2be8d4c6c147e98a1b5b7443b3828d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap754f85e2-09", "ovs_interfaceid": "754f85e2-09b3-418b-9c3f-452c88756d3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73572) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 10:15:29 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-ba2dba16-b3e2-4631-94da-88d4a6d0333e req-953f630b-c25f-4937-af83-af51203adebf service nova] Acquired lock "refresh_cache-d2970584-8c2a-4f99-922c-d66d59489504" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:15:29 user nova-compute[73572]: DEBUG nova.network.neutron [req-ba2dba16-b3e2-4631-94da-88d4a6d0333e req-953f630b-c25f-4937-af83-af51203adebf service nova] [instance: d2970584-8c2a-4f99-922c-d66d59489504] Refreshing network info cache for port 754f85e2-09b3-418b-9c3f-452c88756d3a {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 10:15:29 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-55ab0eb2-9bf3-48be-8900-44bbfc4ca36f tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] [instance: d2970584-8c2a-4f99-922c-d66d59489504] Start _get_guest_xml network_info=[{"id": "754f85e2-09b3-418b-9c3f-452c88756d3a", "address": "fa:16:3e:d6:92:13", "network": {"id": "e565abb6-25f8-4f92-9cca-69db36e4216a", "bridge": "br-int", "label": "tempest-TestStampPattern-1866566708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f2be8d4c6c147e98a1b5b7443b3828d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap754f85e2-09", "ovs_interfaceid": "754f85e2-09b3-418b-9c3f-452c88756d3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T10:07:33Z,direct_url=<?>,disk_format='qcow2',id=299da0c9-e1c4-48f0-be55-fbe20dd06bc9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5c995f8bbbab4368b67a253e0df3971a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T10:07:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'guest_format': None, 'size': 0, 'encryption_format': None, 'device_type': 'disk', 'image_id': '299da0c9-e1c4-48f0-be55-fbe20dd06bc9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73572) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 10:15:29 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-55ab0eb2-9bf3-48be-8900-44bbfc4ca36f tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:15:29 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-55ab0eb2-9bf3-48be-8900-44bbfc4ca36f tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:15:29 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-55ab0eb2-9bf3-48be-8900-44bbfc4ca36f tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73572) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 10:15:29 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-55ab0eb2-9bf3-48be-8900-44bbfc4ca36f tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] CPU controller missing on host. {{(pid=73572) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 10:15:29 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-55ab0eb2-9bf3-48be-8900-44bbfc4ca36f tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73572) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 10:15:29 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-55ab0eb2-9bf3-48be-8900-44bbfc4ca36f tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] CPU controller found on host. {{(pid=73572) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 10:15:29 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-55ab0eb2-9bf3-48be-8900-44bbfc4ca36f tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73572) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 10:15:29 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-55ab0eb2-9bf3-48be-8900-44bbfc4ca36f tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T10:07:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T10:07:33Z,direct_url=<?>,disk_format='qcow2',id=299da0c9-e1c4-48f0-be55-fbe20dd06bc9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5c995f8bbbab4368b67a253e0df3971a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T10:07:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 10:15:29 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-55ab0eb2-9bf3-48be-8900-44bbfc4ca36f tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Flavor limits 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 10:15:29 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-55ab0eb2-9bf3-48be-8900-44bbfc4ca36f tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Image limits 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 10:15:29 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-55ab0eb2-9bf3-48be-8900-44bbfc4ca36f tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Flavor pref 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 10:15:29 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-55ab0eb2-9bf3-48be-8900-44bbfc4ca36f tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Image pref 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 10:15:29 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-55ab0eb2-9bf3-48be-8900-44bbfc4ca36f tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 10:15:29 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-55ab0eb2-9bf3-48be-8900-44bbfc4ca36f tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 10:15:29 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-55ab0eb2-9bf3-48be-8900-44bbfc4ca36f tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73572) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 10:15:29 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-55ab0eb2-9bf3-48be-8900-44bbfc4ca36f tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Got 1 possible topologies {{(pid=73572) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 10:15:29 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-55ab0eb2-9bf3-48be-8900-44bbfc4ca36f tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 10:15:29 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-55ab0eb2-9bf3-48be-8900-44bbfc4ca36f tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 10:15:29 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-55ab0eb2-9bf3-48be-8900-44bbfc4ca36f tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T10:15:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1555345289',display_name='tempest-TestStampPattern-server-1555345289',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1555345289',id=16,image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP9vHc9cYvgcHQg/aK0omfrRC7E/+64q6slnxR+kteK1TJpzyHka+ebCIfWJOJFiXL5L634G/nkiqr1k6bVjV80fgSFGxhy9wnZsw6PuJmiL2f9/rm8j19mT+daCzhQYQw==',key_name='tempest-TestStampPattern-1944573374',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6f2be8d4c6c147e98a1b5b7443b3828d',ramdisk_id='',reservation_id='r-ns4ykzlm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-478976113',owner_user_name='tempest-TestStampPattern-478976113-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T10:15:24Z,user_data=None,user_id='b990faa34b924d29bf7c0490aaf07644',uuid=d2970584-8c2a-4f99-922c-d66d59489504,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "754f85e2-09b3-418b-9c3f-452c88756d3a", "address": "fa:16:3e:d6:92:13", "network": {"id": "e565abb6-25f8-4f92-9cca-69db36e4216a", "bridge": "br-int", "label": "tempest-TestStampPattern-1866566708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f2be8d4c6c147e98a1b5b7443b3828d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap754f85e2-09", "ovs_interfaceid": "754f85e2-09b3-418b-9c3f-452c88756d3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73572) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 10:15:29 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-55ab0eb2-9bf3-48be-8900-44bbfc4ca36f tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Converting VIF {"id": "754f85e2-09b3-418b-9c3f-452c88756d3a", "address": "fa:16:3e:d6:92:13", "network": {"id": "e565abb6-25f8-4f92-9cca-69db36e4216a", "bridge": "br-int", "label": "tempest-TestStampPattern-1866566708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f2be8d4c6c147e98a1b5b7443b3828d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap754f85e2-09", "ovs_interfaceid": "754f85e2-09b3-418b-9c3f-452c88756d3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:15:29 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-55ab0eb2-9bf3-48be-8900-44bbfc4ca36f tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:92:13,bridge_name='br-int',has_traffic_filtering=True,id=754f85e2-09b3-418b-9c3f-452c88756d3a,network=Network(e565abb6-25f8-4f92-9cca-69db36e4216a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap754f85e2-09') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:15:29 user nova-compute[73572]: DEBUG nova.objects.instance [None req-55ab0eb2-9bf3-48be-8900-44bbfc4ca36f tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Lazy-loading 'pci_devices' on Instance uuid d2970584-8c2a-4f99-922c-d66d59489504 {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:15:29 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-55ab0eb2-9bf3-48be-8900-44bbfc4ca36f tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] [instance: d2970584-8c2a-4f99-922c-d66d59489504] End _get_guest_xml xml=<domain type="kvm">
Aug 26 10:15:29 user nova-compute[73572]:   <uuid>d2970584-8c2a-4f99-922c-d66d59489504</uuid>
Aug 26 10:15:29 user nova-compute[73572]:   <name>instance-00000010</name>
Aug 26 10:15:29 user nova-compute[73572]:   <memory>524288</memory>
Aug 26 10:15:29 user nova-compute[73572]:   <vcpu>1</vcpu>
Aug 26 10:15:29 user nova-compute[73572]:   <metadata>
Aug 26 10:15:29 user nova-compute[73572]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 10:15:29 user nova-compute[73572]:       <nova:package version="0.0.0"/>
Aug 26 10:15:29 user nova-compute[73572]:       <nova:name>tempest-TestStampPattern-server-1555345289</nova:name>
Aug 26 10:15:29 user nova-compute[73572]:       <nova:creationTime>2023-08-26 10:15:29</nova:creationTime>
Aug 26 10:15:29 user nova-compute[73572]:       <nova:flavor name="m1.tiny">
Aug 26 10:15:29 user nova-compute[73572]:         <nova:memory>512</nova:memory>
Aug 26 10:15:29 user nova-compute[73572]:         <nova:disk>1</nova:disk>
Aug 26 10:15:29 user nova-compute[73572]:         <nova:swap>0</nova:swap>
Aug 26 10:15:29 user nova-compute[73572]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 10:15:29 user nova-compute[73572]:         <nova:vcpus>1</nova:vcpus>
Aug 26 10:15:29 user nova-compute[73572]:       </nova:flavor>
Aug 26 10:15:29 user nova-compute[73572]:       <nova:owner>
Aug 26 10:15:29 user nova-compute[73572]:         <nova:user uuid="b990faa34b924d29bf7c0490aaf07644">tempest-TestStampPattern-478976113-project-member</nova:user>
Aug 26 10:15:29 user nova-compute[73572]:         <nova:project uuid="6f2be8d4c6c147e98a1b5b7443b3828d">tempest-TestStampPattern-478976113</nova:project>
Aug 26 10:15:29 user nova-compute[73572]:       </nova:owner>
Aug 26 10:15:29 user nova-compute[73572]:       <nova:root type="image" uuid="299da0c9-e1c4-48f0-be55-fbe20dd06bc9"/>
Aug 26 10:15:29 user nova-compute[73572]:       <nova:ports>
Aug 26 10:15:29 user nova-compute[73572]:         <nova:port uuid="754f85e2-09b3-418b-9c3f-452c88756d3a">
Aug 26 10:15:29 user nova-compute[73572]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 26 10:15:29 user nova-compute[73572]:         </nova:port>
Aug 26 10:15:29 user nova-compute[73572]:       </nova:ports>
Aug 26 10:15:29 user nova-compute[73572]:     </nova:instance>
Aug 26 10:15:29 user nova-compute[73572]:   </metadata>
Aug 26 10:15:29 user nova-compute[73572]:   <sysinfo type="smbios">
Aug 26 10:15:29 user nova-compute[73572]:     <system>
Aug 26 10:15:29 user nova-compute[73572]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 10:15:29 user nova-compute[73572]:       <entry name="product">OpenStack Nova</entry>
Aug 26 10:15:29 user nova-compute[73572]:       <entry name="version">0.0.0</entry>
Aug 26 10:15:29 user nova-compute[73572]:       <entry name="serial">d2970584-8c2a-4f99-922c-d66d59489504</entry>
Aug 26 10:15:29 user nova-compute[73572]:       <entry name="uuid">d2970584-8c2a-4f99-922c-d66d59489504</entry>
Aug 26 10:15:29 user nova-compute[73572]:       <entry name="family">Virtual Machine</entry>
Aug 26 10:15:29 user nova-compute[73572]:     </system>
Aug 26 10:15:29 user nova-compute[73572]:   </sysinfo>
Aug 26 10:15:29 user nova-compute[73572]:   <os>
Aug 26 10:15:29 user nova-compute[73572]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 10:15:29 user nova-compute[73572]:     <boot dev="hd"/>
Aug 26 10:15:29 user nova-compute[73572]:     <smbios mode="sysinfo"/>
Aug 26 10:15:29 user nova-compute[73572]:   </os>
Aug 26 10:15:29 user nova-compute[73572]:   <features>
Aug 26 10:15:29 user nova-compute[73572]:     <acpi/>
Aug 26 10:15:29 user nova-compute[73572]:     <apic/>
Aug 26 10:15:29 user nova-compute[73572]:     <vmcoreinfo/>
Aug 26 10:15:29 user nova-compute[73572]:   </features>
Aug 26 10:15:29 user nova-compute[73572]:   <clock offset="utc">
Aug 26 10:15:29 user nova-compute[73572]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 10:15:29 user nova-compute[73572]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 10:15:29 user nova-compute[73572]:     <timer name="hpet" present="no"/>
Aug 26 10:15:29 user nova-compute[73572]:   </clock>
Aug 26 10:15:29 user nova-compute[73572]:   <cpu mode="custom" match="exact">
Aug 26 10:15:29 user nova-compute[73572]:     <model>Nehalem</model>
Aug 26 10:15:29 user nova-compute[73572]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 10:15:29 user nova-compute[73572]:   </cpu>
Aug 26 10:15:29 user nova-compute[73572]:   <devices>
Aug 26 10:15:29 user nova-compute[73572]:     <disk type="file" device="disk">
Aug 26 10:15:29 user nova-compute[73572]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 10:15:29 user nova-compute[73572]:       <source file="/opt/stack/data/nova/instances/d2970584-8c2a-4f99-922c-d66d59489504/disk"/>
Aug 26 10:15:29 user nova-compute[73572]:       <target dev="vda" bus="virtio"/>
Aug 26 10:15:29 user nova-compute[73572]:     </disk>
Aug 26 10:15:29 user nova-compute[73572]:     <interface type="ethernet">
Aug 26 10:15:29 user nova-compute[73572]:       <mac address="fa:16:3e:d6:92:13"/>
Aug 26 10:15:29 user nova-compute[73572]:       <model type="virtio"/>
Aug 26 10:15:29 user nova-compute[73572]:       <mtu size="1442"/>
Aug 26 10:15:29 user nova-compute[73572]:       <target dev="tap754f85e2-09"/>
Aug 26 10:15:29 user nova-compute[73572]:     </interface>
Aug 26 10:15:29 user nova-compute[73572]:     <serial type="pty">
Aug 26 10:15:29 user nova-compute[73572]:       <log file="/opt/stack/data/nova/instances/d2970584-8c2a-4f99-922c-d66d59489504/console.log" append="off"/>
Aug 26 10:15:29 user nova-compute[73572]:     </serial>
Aug 26 10:15:29 user nova-compute[73572]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 10:15:29 user nova-compute[73572]:     <video>
Aug 26 10:15:29 user nova-compute[73572]:       <model type="virtio"/>
Aug 26 10:15:29 user nova-compute[73572]:     </video>
Aug 26 10:15:29 user nova-compute[73572]:     <rng model="virtio">
Aug 26 10:15:29 user nova-compute[73572]:       <backend model="random">/dev/urandom</backend>
Aug 26 10:15:29 user nova-compute[73572]:     </rng>
Aug 26 10:15:29 user nova-compute[73572]:     <controller type="usb" index="0" model="none"/>
Aug 26 10:15:29 user nova-compute[73572]:     <memballoon model="virtio">
Aug 26 10:15:29 user nova-compute[73572]:       <stats period="10"/>
Aug 26 10:15:29 user nova-compute[73572]:     </memballoon>
Aug 26 10:15:29 user nova-compute[73572]:   </devices>
Aug 26 10:15:29 user nova-compute[73572]: </domain>
Aug 26 10:15:29 user nova-compute[73572]:  {{(pid=73572) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 10:15:29 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-55ab0eb2-9bf3-48be-8900-44bbfc4ca36f tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T10:15:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1555345289',display_name='tempest-TestStampPattern-server-1555345289',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1555345289',id=16,image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP9vHc9cYvgcHQg/aK0omfrRC7E/+64q6slnxR+kteK1TJpzyHka+ebCIfWJOJFiXL5L634G/nkiqr1k6bVjV80fgSFGxhy9wnZsw6PuJmiL2f9/rm8j19mT+daCzhQYQw==',key_name='tempest-TestStampPattern-1944573374',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6f2be8d4c6c147e98a1b5b7443b3828d',ramdisk_id='',reservation_id='r-ns4ykzlm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-478976113',owner_user_name='tempest-TestStampPattern-478976113-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T10:15:24Z,user_data=None,user_id='b990faa34b924d29bf7c0490aaf07644',uuid=d2970584-8c2a-4f99-922c-d66d59489504,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "754f85e2-09b3-418b-9c3f-452c88756d3a", "address": "fa:16:3e:d6:92:13", "network": {"id": "e565abb6-25f8-4f92-9cca-69db36e4216a", "bridge": "br-int", "label": "tempest-TestStampPattern-1866566708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f2be8d4c6c147e98a1b5b7443b3828d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap754f85e2-09", "ovs_interfaceid": "754f85e2-09b3-418b-9c3f-452c88756d3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 10:15:29 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-55ab0eb2-9bf3-48be-8900-44bbfc4ca36f tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Converting VIF {"id": "754f85e2-09b3-418b-9c3f-452c88756d3a", "address": "fa:16:3e:d6:92:13", "network": {"id": "e565abb6-25f8-4f92-9cca-69db36e4216a", "bridge": "br-int", "label": "tempest-TestStampPattern-1866566708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f2be8d4c6c147e98a1b5b7443b3828d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap754f85e2-09", "ovs_interfaceid": "754f85e2-09b3-418b-9c3f-452c88756d3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:15:29 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-55ab0eb2-9bf3-48be-8900-44bbfc4ca36f tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:92:13,bridge_name='br-int',has_traffic_filtering=True,id=754f85e2-09b3-418b-9c3f-452c88756d3a,network=Network(e565abb6-25f8-4f92-9cca-69db36e4216a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap754f85e2-09') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:15:29 user nova-compute[73572]: DEBUG os_vif [None req-55ab0eb2-9bf3-48be-8900-44bbfc4ca36f tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:92:13,bridge_name='br-int',has_traffic_filtering=True,id=754f85e2-09b3-418b-9c3f-452c88756d3a,network=Network(e565abb6-25f8-4f92-9cca-69db36e4216a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap754f85e2-09') {{(pid=73572) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 10:15:29 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:15:29 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:15:29 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 10:15:29 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:15:29 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap754f85e2-09, may_exist=True, interface_attrs={}) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:15:29 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap754f85e2-09, col_values=(('external_ids', {'iface-id': '754f85e2-09b3-418b-9c3f-452c88756d3a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d6:92:13', 'vm-uuid': 'd2970584-8c2a-4f99-922c-d66d59489504'}),), if_exists=True) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:15:29 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:15:29 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:15:29 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:15:29 user nova-compute[73572]: INFO os_vif [None req-55ab0eb2-9bf3-48be-8900-44bbfc4ca36f tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:92:13,bridge_name='br-int',has_traffic_filtering=True,id=754f85e2-09b3-418b-9c3f-452c88756d3a,network=Network(e565abb6-25f8-4f92-9cca-69db36e4216a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap754f85e2-09')
Aug 26 10:15:29 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-4fe848ab-8dca-44c9-9fc4-07ef3901e2b0 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/185e949b7072af41e5f0cfe823069a60b504cffb.part --force-share --output=json" returned: 0 in 0.222s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:15:29 user nova-compute[73572]: DEBUG nova.virt.images [None req-4fe848ab-8dca-44c9-9fc4-07ef3901e2b0 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] d598bc4d-4a83-4c51-9e58-a9fb38ba654f was qcow2, converting to raw {{(pid=73572) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 26 10:15:29 user nova-compute[73572]: DEBUG nova.privsep.utils [None req-4fe848ab-8dca-44c9-9fc4-07ef3901e2b0 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73572) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 26 10:15:29 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-4fe848ab-8dca-44c9-9fc4-07ef3901e2b0 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/185e949b7072af41e5f0cfe823069a60b504cffb.part /opt/stack/data/nova/instances/_base/185e949b7072af41e5f0cfe823069a60b504cffb.converted {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:15:30 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-55ab0eb2-9bf3-48be-8900-44bbfc4ca36f tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] No BDM found with device name vda, not building metadata. {{(pid=73572) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 10:15:30 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-55ab0eb2-9bf3-48be-8900-44bbfc4ca36f tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] No VIF found with MAC fa:16:3e:d6:92:13, not building metadata {{(pid=73572) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 10:15:30 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:15:30 user nova-compute[73572]: DEBUG nova.compute.manager [req-cf014c66-7106-4b1a-a1ad-3b8b9ffca57e req-33ed401b-7790-463b-9a99-c77e5cae5f25 service nova] [instance: c555f971-b177-4c26-a38e-09e0e78bf7b9] Received event network-vif-unplugged-4ffb7229-16fb-441b-a954-d91308071fb8 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:15:30 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-cf014c66-7106-4b1a-a1ad-3b8b9ffca57e req-33ed401b-7790-463b-9a99-c77e5cae5f25 service nova] Acquiring lock "c555f971-b177-4c26-a38e-09e0e78bf7b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:15:30 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-cf014c66-7106-4b1a-a1ad-3b8b9ffca57e req-33ed401b-7790-463b-9a99-c77e5cae5f25 service nova] Lock "c555f971-b177-4c26-a38e-09e0e78bf7b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:15:30 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-cf014c66-7106-4b1a-a1ad-3b8b9ffca57e req-33ed401b-7790-463b-9a99-c77e5cae5f25 service nova] Lock "c555f971-b177-4c26-a38e-09e0e78bf7b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:15:30 user nova-compute[73572]: DEBUG nova.compute.manager [req-cf014c66-7106-4b1a-a1ad-3b8b9ffca57e req-33ed401b-7790-463b-9a99-c77e5cae5f25 service nova] [instance: c555f971-b177-4c26-a38e-09e0e78bf7b9] No waiting events found dispatching network-vif-unplugged-4ffb7229-16fb-441b-a954-d91308071fb8 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:15:30 user nova-compute[73572]: WARNING nova.compute.manager [req-cf014c66-7106-4b1a-a1ad-3b8b9ffca57e req-33ed401b-7790-463b-9a99-c77e5cae5f25 service nova] [instance: c555f971-b177-4c26-a38e-09e0e78bf7b9] Received unexpected event network-vif-unplugged-4ffb7229-16fb-441b-a954-d91308071fb8 for instance with vm_state active and task_state rescuing.
Aug 26 10:15:30 user nova-compute[73572]: DEBUG nova.compute.manager [req-cf014c66-7106-4b1a-a1ad-3b8b9ffca57e req-33ed401b-7790-463b-9a99-c77e5cae5f25 service nova] [instance: c555f971-b177-4c26-a38e-09e0e78bf7b9] Received event network-vif-plugged-4ffb7229-16fb-441b-a954-d91308071fb8 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:15:30 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-cf014c66-7106-4b1a-a1ad-3b8b9ffca57e req-33ed401b-7790-463b-9a99-c77e5cae5f25 service nova] Acquiring lock "c555f971-b177-4c26-a38e-09e0e78bf7b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:15:30 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-cf014c66-7106-4b1a-a1ad-3b8b9ffca57e req-33ed401b-7790-463b-9a99-c77e5cae5f25 service nova] Lock "c555f971-b177-4c26-a38e-09e0e78bf7b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:15:30 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-cf014c66-7106-4b1a-a1ad-3b8b9ffca57e req-33ed401b-7790-463b-9a99-c77e5cae5f25 service nova] Lock "c555f971-b177-4c26-a38e-09e0e78bf7b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:15:30 user nova-compute[73572]: DEBUG nova.compute.manager [req-cf014c66-7106-4b1a-a1ad-3b8b9ffca57e req-33ed401b-7790-463b-9a99-c77e5cae5f25 service nova] [instance: c555f971-b177-4c26-a38e-09e0e78bf7b9] No waiting events found dispatching network-vif-plugged-4ffb7229-16fb-441b-a954-d91308071fb8 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:15:30 user nova-compute[73572]: WARNING nova.compute.manager [req-cf014c66-7106-4b1a-a1ad-3b8b9ffca57e req-33ed401b-7790-463b-9a99-c77e5cae5f25 service nova] [instance: c555f971-b177-4c26-a38e-09e0e78bf7b9] Received unexpected event network-vif-plugged-4ffb7229-16fb-441b-a954-d91308071fb8 for instance with vm_state active and task_state rescuing.
Aug 26 10:15:30 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-4fe848ab-8dca-44c9-9fc4-07ef3901e2b0 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/185e949b7072af41e5f0cfe823069a60b504cffb.part /opt/stack/data/nova/instances/_base/185e949b7072af41e5f0cfe823069a60b504cffb.converted" returned: 0 in 0.469s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:15:30 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-4fe848ab-8dca-44c9-9fc4-07ef3901e2b0 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/185e949b7072af41e5f0cfe823069a60b504cffb.converted --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:15:30 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-4fe848ab-8dca-44c9-9fc4-07ef3901e2b0 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/185e949b7072af41e5f0cfe823069a60b504cffb.converted --force-share --output=json" returned: 0 in 0.194s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:15:30 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-4fe848ab-8dca-44c9-9fc4-07ef3901e2b0 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] Lock "185e949b7072af41e5f0cfe823069a60b504cffb" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.787s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:15:30 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-4fe848ab-8dca-44c9-9fc4-07ef3901e2b0 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] Acquiring lock "185e949b7072af41e5f0cfe823069a60b504cffb" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:15:30 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-4fe848ab-8dca-44c9-9fc4-07ef3901e2b0 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] Lock "185e949b7072af41e5f0cfe823069a60b504cffb" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:15:30 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-4fe848ab-8dca-44c9-9fc4-07ef3901e2b0 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/185e949b7072af41e5f0cfe823069a60b504cffb --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:15:30 user nova-compute[73572]: DEBUG nova.network.neutron [req-ba2dba16-b3e2-4631-94da-88d4a6d0333e req-953f630b-c25f-4937-af83-af51203adebf service nova] [instance: d2970584-8c2a-4f99-922c-d66d59489504] Updated VIF entry in instance network info cache for port 754f85e2-09b3-418b-9c3f-452c88756d3a. {{(pid=73572) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 10:15:30 user nova-compute[73572]: DEBUG nova.network.neutron [req-ba2dba16-b3e2-4631-94da-88d4a6d0333e req-953f630b-c25f-4937-af83-af51203adebf service nova] [instance: d2970584-8c2a-4f99-922c-d66d59489504] Updating instance_info_cache with network_info: [{"id": "754f85e2-09b3-418b-9c3f-452c88756d3a", "address": "fa:16:3e:d6:92:13", "network": {"id": "e565abb6-25f8-4f92-9cca-69db36e4216a", "bridge": "br-int", "label": "tempest-TestStampPattern-1866566708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f2be8d4c6c147e98a1b5b7443b3828d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap754f85e2-09", "ovs_interfaceid": "754f85e2-09b3-418b-9c3f-452c88756d3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:15:30 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-ba2dba16-b3e2-4631-94da-88d4a6d0333e req-953f630b-c25f-4937-af83-af51203adebf service nova] Releasing lock "refresh_cache-d2970584-8c2a-4f99-922c-d66d59489504" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:15:30 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-4fe848ab-8dca-44c9-9fc4-07ef3901e2b0 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/185e949b7072af41e5f0cfe823069a60b504cffb --force-share --output=json" returned: 0 in 0.196s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:15:30 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-4fe848ab-8dca-44c9-9fc4-07ef3901e2b0 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/185e949b7072af41e5f0cfe823069a60b504cffb,backing_fmt=raw /opt/stack/data/nova/instances/c555f971-b177-4c26-a38e-09e0e78bf7b9/disk.rescue {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:15:30 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-4fe848ab-8dca-44c9-9fc4-07ef3901e2b0 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/185e949b7072af41e5f0cfe823069a60b504cffb,backing_fmt=raw /opt/stack/data/nova/instances/c555f971-b177-4c26-a38e-09e0e78bf7b9/disk.rescue" returned: 0 in 0.049s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:15:30 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-4fe848ab-8dca-44c9-9fc4-07ef3901e2b0 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] Lock "185e949b7072af41e5f0cfe823069a60b504cffb" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.251s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:15:30 user nova-compute[73572]: DEBUG nova.objects.instance [None req-4fe848ab-8dca-44c9-9fc4-07ef3901e2b0 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] Lazy-loading 'migration_context' on Instance uuid c555f971-b177-4c26-a38e-09e0e78bf7b9 {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:15:30 user nova-compute[73572]: DEBUG nova.objects.base [None req-4fe848ab-8dca-44c9-9fc4-07ef3901e2b0 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] Object Instance<c555f971-b177-4c26-a38e-09e0e78bf7b9> lazy-loaded attributes: trusted_certs,migration_context {{(pid=73572) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 10:15:30 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-4fe848ab-8dca-44c9-9fc4-07ef3901e2b0 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] [instance: c555f971-b177-4c26-a38e-09e0e78bf7b9] Created local disks {{(pid=73572) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 10:15:30 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-4fe848ab-8dca-44c9-9fc4-07ef3901e2b0 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] [instance: c555f971-b177-4c26-a38e-09e0e78bf7b9] Start _get_guest_xml network_info=[{"id": "4ffb7229-16fb-441b-a954-d91308071fb8", "address": "fa:16:3e:26:32:ef", "network": {"id": "e052e34f-ce84-4612-b48b-2ed8474e7177", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-332746918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-332746918-network", "vif_mac": "fa:16:3e:26:32:ef"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4556d14c0dd416fbe13ab2274947dec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ffb7229-16", "ovs_interfaceid": "4ffb7229-16fb-441b-a954-d91308071fb8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T10:07:33Z,direct_url=<?>,disk_format='qcow2',id=299da0c9-e1c4-48f0-be55-fbe20dd06bc9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5c995f8bbbab4368b67a253e0df3971a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T10:07:34Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'd598bc4d-4a83-4c51-9e58-a9fb38ba654f', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'guest_format': None, 'size': 0, 'encryption_format': None, 'device_type': 'disk', 'image_id': '299da0c9-e1c4-48f0-be55-fbe20dd06bc9'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'disk_bus': 'virtio', 'boot_index': None, 'mount_device': '/dev/vdb', 'attachment_id': '5ee88ad3-c295-4423-b9ee-f2939264ed0b', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:ac5c1ee2-3656-49b3-942f-5fc992dc001b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TqBgdYHa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': 'c555f971-b177-4c26-a38e-09e0e78bf7b9', 'attached_at': '', 'detached_at': '', 'volume_id': 'ac5c1ee2-3656-49b3-942f-5fc992dc001b', 'serial': 'ac5c1ee2-3656-49b3-942f-5fc992dc001b'}, 'guest_format': None, 'device_type': 'disk', 'volume_type': None} {{(pid=73572) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 10:15:30 user nova-compute[73572]: DEBUG nova.objects.instance [None req-4fe848ab-8dca-44c9-9fc4-07ef3901e2b0 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] Lazy-loading 'resources' on Instance uuid c555f971-b177-4c26-a38e-09e0e78bf7b9 {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:15:30 user nova-compute[73572]: DEBUG nova.objects.base [None req-4fe848ab-8dca-44c9-9fc4-07ef3901e2b0 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] Object Instance<c555f971-b177-4c26-a38e-09e0e78bf7b9> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=73572) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 10:15:31 user nova-compute[73572]: DEBUG nova.objects.instance [None req-4fe848ab-8dca-44c9-9fc4-07ef3901e2b0 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] Lazy-loading 'numa_topology' on Instance uuid c555f971-b177-4c26-a38e-09e0e78bf7b9 {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:15:31 user nova-compute[73572]: DEBUG nova.objects.base [None req-4fe848ab-8dca-44c9-9fc4-07ef3901e2b0 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] Object Instance<c555f971-b177-4c26-a38e-09e0e78bf7b9> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=73572) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 10:15:31 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-4fe848ab-8dca-44c9-9fc4-07ef3901e2b0 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:15:31 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-4fe848ab-8dca-44c9-9fc4-07ef3901e2b0 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:15:31 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-4fe848ab-8dca-44c9-9fc4-07ef3901e2b0 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73572) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 10:15:31 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-4fe848ab-8dca-44c9-9fc4-07ef3901e2b0 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] CPU controller missing on host. {{(pid=73572) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 10:15:31 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-4fe848ab-8dca-44c9-9fc4-07ef3901e2b0 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73572) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 10:15:31 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-4fe848ab-8dca-44c9-9fc4-07ef3901e2b0 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] CPU controller found on host. {{(pid=73572) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 10:15:31 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-4fe848ab-8dca-44c9-9fc4-07ef3901e2b0 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73572) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 10:15:31 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-4fe848ab-8dca-44c9-9fc4-07ef3901e2b0 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T10:07:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T10:07:33Z,direct_url=<?>,disk_format='qcow2',id=299da0c9-e1c4-48f0-be55-fbe20dd06bc9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5c995f8bbbab4368b67a253e0df3971a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T10:07:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 10:15:31 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-4fe848ab-8dca-44c9-9fc4-07ef3901e2b0 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] Flavor limits 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 10:15:31 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-4fe848ab-8dca-44c9-9fc4-07ef3901e2b0 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] Image limits 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 10:15:31 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-4fe848ab-8dca-44c9-9fc4-07ef3901e2b0 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] Flavor pref 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 10:15:31 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-4fe848ab-8dca-44c9-9fc4-07ef3901e2b0 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] Image pref 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 10:15:31 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-4fe848ab-8dca-44c9-9fc4-07ef3901e2b0 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 10:15:31 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-4fe848ab-8dca-44c9-9fc4-07ef3901e2b0 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 10:15:31 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-4fe848ab-8dca-44c9-9fc4-07ef3901e2b0 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73572) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 10:15:31 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-4fe848ab-8dca-44c9-9fc4-07ef3901e2b0 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] Got 1 possible topologies {{(pid=73572) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 10:15:31 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-4fe848ab-8dca-44c9-9fc4-07ef3901e2b0 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 10:15:31 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-4fe848ab-8dca-44c9-9fc4-07ef3901e2b0 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 10:15:31 user nova-compute[73572]: DEBUG nova.objects.instance [None req-4fe848ab-8dca-44c9-9fc4-07ef3901e2b0 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] Lazy-loading 'vcpu_model' on Instance uuid c555f971-b177-4c26-a38e-09e0e78bf7b9 {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:15:31 user nova-compute[73572]: DEBUG nova.objects.base [None req-4fe848ab-8dca-44c9-9fc4-07ef3901e2b0 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] Object Instance<c555f971-b177-4c26-a38e-09e0e78bf7b9> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=73572) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 10:15:31 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4fe848ab-8dca-44c9-9fc4-07ef3901e2b0 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] [instance: c555f971-b177-4c26-a38e-09e0e78bf7b9] Calling os-brick to attach iSCSI Volume {{(pid=73572) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 10:15:31 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fe848ab-8dca-44c9-9fc4-07ef3901e2b0 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc89c3d6a10>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:ac5c1ee2-3656-49b3-942f-5fc992dc001b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TqBgdYHa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 10:15:31 user nova-compute[73572]: WARNING os_brick.initiator.connectors.base [None req-4fe848ab-8dca-44c9-9fc4-07ef3901e2b0 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 10:15:31 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-4fe848ab-8dca-44c9-9fc4-07ef3901e2b0 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 10:15:31 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-4fe848ab-8dca-44c9-9fc4-07ef3901e2b0 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 10:15:31 user nova-compute[73572]: WARNING os_brick.initiator.connectors.base [None req-4fe848ab-8dca-44c9-9fc4-07ef3901e2b0 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 10:15:31 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-4fe848ab-8dca-44c9-9fc4-07ef3901e2b0 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ac5c1ee2-3656-49b3-942f-5fc992dc001b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 10:15:31 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-4fe848ab-8dca-44c9-9fc4-07ef3901e2b0 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ac5c1ee2-3656-49b3-942f-5fc992dc001b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 10:15:31 user nova-compute[73572]: INFO os_brick.initiator.connectors.iscsi [None req-4fe848ab-8dca-44c9-9fc4-07ef3901e2b0 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 10:15:31 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac5c1ee2-3656-49b3-942f-5fc992dc001b -p 172.16.0.220:3260 {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:15:31 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac5c1ee2-3656-49b3-942f-5fc992dc001b -p 172.16.0.220:3260" returned: 0 in 0.021s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:15:31 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bfc0f9f-6723-4254-8c1a-fa4f9bb7f6bf]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:ac5c1ee2-3656-49b3-942f-5fc992dc001b\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = TqBgdYHa\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:15:31 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fe848ab-8dca-44c9-9fc4-07ef3901e2b0 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 26 10:15:31 user nova-compute[73572]: node.name = iqn.2010-10.org.openstack:ac5c1ee2-3656-49b3-942f-5fc992dc001b
Aug 26 10:15:31 user nova-compute[73572]: node.tpgt = -1
Aug 26 10:15:31 user nova-compute[73572]: node.startup = automatic
Aug 26 10:15:31 user nova-compute[73572]: node.leading_login = No
Aug 26 10:15:31 user nova-compute[73572]: iface.iscsi_ifacename = default
Aug 26 10:15:31 user nova-compute[73572]: iface.net_ifacename = <empty>
Aug 26 10:15:31 user nova-compute[73572]: iface.ipaddress = <empty>
Aug 26 10:15:31 user nova-compute[73572]: iface.prefix_len = 0
Aug 26 10:15:31 user nova-compute[73572]: iface.hwaddress = <empty>
Aug 26 10:15:31 user nova-compute[73572]: iface.transport_name = tcp
Aug 26 10:15:31 user nova-compute[73572]: iface.initiatorname = <empty>
Aug 26 10:15:31 user nova-compute[73572]: iface.state = <empty>
Aug 26 10:15:31 user nova-compute[73572]: iface.vlan_id = 0
Aug 26 10:15:31 user nova-compute[73572]: iface.vlan_priority = 0
Aug 26 10:15:31 user nova-compute[73572]: iface.vlan_state = <empty>
Aug 26 10:15:31 user nova-compute[73572]: iface.iface_num = 0
Aug 26 10:15:31 user nova-compute[73572]: iface.mtu = 0
Aug 26 10:15:31 user nova-compute[73572]: iface.port = 0
Aug 26 10:15:31 user nova-compute[73572]: iface.bootproto = <empty>
Aug 26 10:15:31 user nova-compute[73572]: iface.subnet_mask = <empty>
Aug 26 10:15:31 user nova-compute[73572]: iface.gateway = <empty>
Aug 26 10:15:31 user nova-compute[73572]: iface.dhcp_alt_client_id_state = <empty>
Aug 26 10:15:31 user nova-compute[73572]: iface.dhcp_alt_client_id = <empty>
Aug 26 10:15:31 user nova-compute[73572]: iface.dhcp_dns = <empty>
Aug 26 10:15:31 user nova-compute[73572]: iface.dhcp_learn_iqn = <empty>
Aug 26 10:15:31 user nova-compute[73572]: iface.dhcp_req_vendor_id_state = <empty>
Aug 26 10:15:31 user nova-compute[73572]: iface.dhcp_vendor_id_state = <empty>
Aug 26 10:15:31 user nova-compute[73572]: iface.dhcp_vendor_id = <empty>
Aug 26 10:15:31 user nova-compute[73572]: iface.dhcp_slp_da = <empty>
Aug 26 10:15:31 user nova-compute[73572]: iface.fragmentation = <empty>
Aug 26 10:15:31 user nova-compute[73572]: iface.gratuitous_arp = <empty>
Aug 26 10:15:31 user nova-compute[73572]: iface.incoming_forwarding = <empty>
Aug 26 10:15:31 user nova-compute[73572]: iface.tos_state = <empty>
Aug 26 10:15:31 user nova-compute[73572]: iface.tos = 0
Aug 26 10:15:31 user nova-compute[73572]: iface.ttl = 0
Aug 26 10:15:31 user nova-compute[73572]: iface.delayed_ack = <empty>
Aug 26 10:15:31 user nova-compute[73572]: iface.tcp_nagle = <empty>
Aug 26 10:15:31 user nova-compute[73572]: iface.tcp_wsf_state = <empty>
Aug 26 10:15:31 user nova-compute[73572]: iface.tcp_wsf = 0
Aug 26 10:15:31 user nova-compute[73572]: iface.tcp_timer_scale = 0
Aug 26 10:15:31 user nova-compute[73572]: iface.tcp_timestamp = <empty>
Aug 26 10:15:31 user nova-compute[73572]: iface.redirect = <empty>
Aug 26 10:15:31 user nova-compute[73572]: iface.def_task_mgmt_timeout = 0
Aug 26 10:15:31 user nova-compute[73572]: iface.header_digest = <empty>
Aug 26 10:15:31 user nova-compute[73572]: iface.data_digest = <empty>
Aug 26 10:15:31 user nova-compute[73572]: iface.immediate_data = <empty>
Aug 26 10:15:31 user nova-compute[73572]: iface.initial_r2t = <empty>
Aug 26 10:15:31 user nova-compute[73572]: iface.data_seq_inorder = <empty>
Aug 26 10:15:31 user nova-compute[73572]: iface.data_pdu_inorder = <empty>
Aug 26 10:15:31 user nova-compute[73572]: iface.erl = 0
Aug 26 10:15:31 user nova-compute[73572]: iface.max_receive_data_len = 0
Aug 26 10:15:31 user nova-compute[73572]: iface.first_burst_len = 0
Aug 26 10:15:31 user nova-compute[73572]: iface.max_outstanding_r2t = 0
Aug 26 10:15:31 user nova-compute[73572]: iface.max_burst_len = 0
Aug 26 10:15:31 user nova-compute[73572]: iface.chap_auth = <empty>
Aug 26 10:15:31 user nova-compute[73572]: iface.bidi_chap = <empty>
Aug 26 10:15:31 user nova-compute[73572]: iface.strict_login_compliance = <empty>
Aug 26 10:15:31 user nova-compute[73572]: iface.discovery_auth = <empty>
Aug 26 10:15:31 user nova-compute[73572]: iface.discovery_logout = <empty>
Aug 26 10:15:31 user nova-compute[73572]: node.discovery_address = <empty>
Aug 26 10:15:31 user nova-compute[73572]: node.discovery_port = 0
Aug 26 10:15:31 user nova-compute[73572]: node.discovery_type = static
Aug 26 10:15:31 user nova-compute[73572]: node.session.initial_cmdsn = 0
Aug 26 10:15:31 user nova-compute[73572]: node.session.initial_login_retry_max = 8
Aug 26 10:15:31 user nova-compute[73572]: node.session.xmit_thread_priority = -20
Aug 26 10:15:31 user nova-compute[73572]: node.session.cmds_max = 128
Aug 26 10:15:31 user nova-compute[73572]: node.session.queue_depth = 32
Aug 26 10:15:31 user nova-compute[73572]: node.session.nr_sessions = 1
Aug 26 10:15:31 user nova-compute[73572]: node.session.auth.authmethod = CHAP
Aug 26 10:15:31 user nova-compute[73572]: node.session.auth.username = TqBgdYHa
Aug 26 10:15:31 user nova-compute[73572]: node.session.auth.password = ***
Aug 26 10:15:31 user nova-compute[73572]: node.session.auth.username_in = <empty>
Aug 26 10:15:31 user nova-compute[73572]: node.session.auth.password_in = <empty>
Aug 26 10:15:31 user nova-compute[73572]: node.session.auth.chap_algs = MD5
Aug 26 10:15:31 user nova-compute[73572]: node.session.timeo.replacement_timeout = 120
Aug 26 10:15:31 user nova-compute[73572]: node.session.err_timeo.abort_timeout = 15
Aug 26 10:15:31 user nova-compute[73572]: node.session.err_timeo.lu_reset_timeout = 30
Aug 26 10:15:31 user nova-compute[73572]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 26 10:15:31 user nova-compute[73572]: node.session.err_timeo.host_reset_timeout = 60
Aug 26 10:15:31 user nova-compute[73572]: node.session.iscsi.FastAbort = Yes
Aug 26 10:15:31 user nova-compute[73572]: node.session.iscsi.InitialR2T = No
Aug 26 10:15:31 user nova-compute[73572]: node.session.iscsi.ImmediateData = Yes
Aug 26 10:15:31 user nova-compute[73572]: node.session.iscsi.FirstBurstLength = 262144
Aug 26 10:15:31 user nova-compute[73572]: node.session.iscsi.MaxBurstLength = 16776192
Aug 26 10:15:31 user nova-compute[73572]: node.session.iscsi.DefaultTime2Retain = 0
Aug 26 10:15:31 user nova-compute[73572]: node.session.iscsi.DefaultTime2Wait = 2
Aug 26 10:15:31 user nova-compute[73572]: node.session.iscsi.MaxConnections = 1
Aug 26 10:15:31 user nova-compute[73572]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 26 10:15:31 user nova-compute[73572]: node.session.iscsi.ERL = 0
Aug 26 10:15:31 user nova-compute[73572]: node.session.scan = manual
Aug 26 10:15:31 user nova-compute[73572]: node.session.reopen_max = 0
Aug 26 10:15:31 user nova-compute[73572]: node.conn[0].address = 172.16.0.220
Aug 26 10:15:31 user nova-compute[73572]: node.conn[0].port = 3260
Aug 26 10:15:31 user nova-compute[73572]: node.conn[0].startup = manual
Aug 26 10:15:31 user nova-compute[73572]: node.conn[0].tcp.window_size = 524288
Aug 26 10:15:31 user nova-compute[73572]: node.conn[0].tcp.type_of_service = 0
Aug 26 10:15:31 user nova-compute[73572]: node.conn[0].timeo.logout_timeout = 15
Aug 26 10:15:31 user nova-compute[73572]: node.conn[0].timeo.login_timeout = 15
Aug 26 10:15:31 user nova-compute[73572]: node.conn[0].timeo.auth_timeout = 45
Aug 26 10:15:31 user nova-compute[73572]: node.conn[0].timeo.noop_out_interval = 5
Aug 26 10:15:31 user nova-compute[73572]: node.conn[0].timeo.noop_out_timeout = 5
Aug 26 10:15:31 user nova-compute[73572]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 26 10:15:31 user nova-compute[73572]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 26 10:15:31 user nova-compute[73572]: node.conn[0].iscsi.HeaderDigest = None
Aug 26 10:15:31 user nova-compute[73572]: node.conn[0].iscsi.DataDigest = None
Aug 26 10:15:31 user nova-compute[73572]: node.conn[0].iscsi.IFMarker = No
Aug 26 10:15:31 user nova-compute[73572]: node.conn[0].iscsi.OFMarker = No
Aug 26 10:15:31 user nova-compute[73572]: # END RECORD
Aug 26 10:15:31 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:15:31 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac5c1ee2-3656-49b3-942f-5fc992dc001b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:15:31 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac5c1ee2-3656-49b3-942f-5fc992dc001b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:15:31 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[49046fcc-6ff0-476b-9d19-b5dcdd20910b]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:15:31 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fe848ab-8dca-44c9-9fc4-07ef3901e2b0 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:15:31 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac5c1ee2-3656-49b3-942f-5fc992dc001b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:15:31 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac5c1ee2-3656-49b3-942f-5fc992dc001b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:15:31 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdbc4821-3d65-4042-b47a-bd994461ae1c]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:15:31 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fe848ab-8dca-44c9-9fc4-07ef3901e2b0 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:15:31 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac5c1ee2-3656-49b3-942f-5fc992dc001b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TqBgdYHa {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:15:31 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac5c1ee2-3656-49b3-942f-5fc992dc001b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TqBgdYHa" returned: 0 in 0.020s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:15:31 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b125b9f-4535-4549-8e9c-d21b55bcaf09]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:15:31 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fe848ab-8dca-44c9-9fc4-07ef3901e2b0 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TqBgdYHa'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:15:31 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac5c1ee2-3656-49b3-942f-5fc992dc001b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:15:31 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac5c1ee2-3656-49b3-942f-5fc992dc001b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:15:31 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[b05d132c-6ff9-4cca-b426-5538334a4b7a]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:15:31 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fe848ab-8dca-44c9-9fc4-07ef3901e2b0 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:15:31 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:15:31 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:15:31 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c006927-a054-49f4-8307-8305cae67076]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac5c1ee2-3656-49b3-942f-5fc992dc001b (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09ba694f-cb2a-4600-abe9-924b41292479 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85988ff4-7fac-4a96-a502-74d6ca8189fe (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75ebe4c4-f791-4f09-a9bd-747ade3d70a3 (non-flash)\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:15:31 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fe848ab-8dca-44c9-9fc4-07ef3901e2b0 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac5c1ee2-3656-49b3-942f-5fc992dc001b (non-flash)
Aug 26 10:15:31 user nova-compute[73572]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09ba694f-cb2a-4600-abe9-924b41292479 (non-flash)
Aug 26 10:15:31 user nova-compute[73572]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85988ff4-7fac-4a96-a502-74d6ca8189fe (non-flash)
Aug 26 10:15:31 user nova-compute[73572]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75ebe4c4-f791-4f09-a9bd-747ade3d70a3 (non-flash)
Aug 26 10:15:31 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 10:15:31 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fe848ab-8dca-44c9-9fc4-07ef3901e2b0 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac5c1ee2-3656-49b3-942f-5fc992dc001b (non-flash)
Aug 26 10:15:31 user nova-compute[73572]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09ba694f-cb2a-4600-abe9-924b41292479 (non-flash)
Aug 26 10:15:31 user nova-compute[73572]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85988ff4-7fac-4a96-a502-74d6ca8189fe (non-flash)
Aug 26 10:15:31 user nova-compute[73572]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75ebe4c4-f791-4f09-a9bd-747ade3d70a3 (non-flash)
Aug 26 10:15:31 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 10:15:31 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-4fe848ab-8dca-44c9-9fc4-07ef3901e2b0 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ac5c1ee2-3656-49b3-942f-5fc992dc001b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.156s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 10:15:31 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fe848ab-8dca-44c9-9fc4-07ef3901e2b0 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] Connected to 172.16.0.220:3260 {{(pid=73572) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 10:15:31 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-4fe848ab-8dca-44c9-9fc4-07ef3901e2b0 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] HCTL ('36', '0', '0', 0) found on session 12 with lun 0 {{(pid=73572) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 10:15:31 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-4fe848ab-8dca-44c9-9fc4-07ef3901e2b0 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] Scanning host 36 c: 0, t: 0, l: 0) {{(pid=73572) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 10:15:31 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:15:31 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.015s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:15:31 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4f14569-e70e-4caf-878d-5ca1a62dab91]: (4, ('0 0 0', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:15:31 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-4fe848ab-8dca-44c9-9fc4-07ef3901e2b0 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] Searching for a device in session 12 and hctl ('36', '0', '0', 0) yield: sde {{(pid=73572) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 10:15:31 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fe848ab-8dca-44c9-9fc4-07ef3901e2b0 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TqBgdYHa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73572) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 10:15:31 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-4fe848ab-8dca-44c9-9fc4-07ef3901e2b0 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.181s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 10:15:31 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fe848ab-8dca-44c9-9fc4-07ef3901e2b0 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] <== connect_volume: return (181ms) {'type': 'block', 'scsi_wwn': '23034313335346462', 'path': '/dev/sde'} {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 10:15:31 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4fe848ab-8dca-44c9-9fc4-07ef3901e2b0 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] [instance: c555f971-b177-4c26-a38e-09e0e78bf7b9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23034313335346462', 'path': '/dev/sde'} {{(pid=73572) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 10:15:31 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-4fe848ab-8dca-44c9-9fc4-07ef3901e2b0 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T10:11:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1454082664',display_name='tempest-ServerStableDeviceRescueTest-server-1454082664',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1454082664',id=4,image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK8A2oE4l13QSyERYwh4Ahnk9uJU+nAPDuhZ37O71VJwdAai0fKJUmgw/2IvPbix5amEMjoghtaXSFXa7D9qX8lOxviBOZZHzhpX2yXB6onP6197FUVAXT21Pc+RZuhqOw==',key_name='tempest-keypair-1487694876',keypairs=<?>,launch_index=0,launched_at=2023-08-26T10:11:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c4556d14c0dd416fbe13ab2274947dec',ramdisk_id='',reservation_id='r-cj50rz21',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1992646584',owner_user_name='tempest-ServerStableDeviceRescueTest-1992646584-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T10:13:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a56cbd5c1fe94cf9b2a0adc3e82f600b',uuid=c555f971-b177-4c26-a38e-09e0e78bf7b9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4ffb7229-16fb-441b-a954-d91308071fb8", "address": "fa:16:3e:26:32:ef", "network": {"id": "e052e34f-ce84-4612-b48b-2ed8474e7177", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-332746918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-332746918-network", "vif_mac": "fa:16:3e:26:32:ef"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4556d14c0dd416fbe13ab2274947dec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ffb7229-16", "ovs_interfaceid": "4ffb7229-16fb-441b-a954-d91308071fb8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73572) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 10:15:31 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-4fe848ab-8dca-44c9-9fc4-07ef3901e2b0 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] Converting VIF {"id": "4ffb7229-16fb-441b-a954-d91308071fb8", "address": "fa:16:3e:26:32:ef", "network": {"id": "e052e34f-ce84-4612-b48b-2ed8474e7177", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-332746918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-332746918-network", "vif_mac": "fa:16:3e:26:32:ef"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4556d14c0dd416fbe13ab2274947dec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ffb7229-16", "ovs_interfaceid": "4ffb7229-16fb-441b-a954-d91308071fb8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:15:31 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-4fe848ab-8dca-44c9-9fc4-07ef3901e2b0 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:26:32:ef,bridge_name='br-int',has_traffic_filtering=True,id=4ffb7229-16fb-441b-a954-d91308071fb8,network=Network(e052e34f-ce84-4612-b48b-2ed8474e7177),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ffb7229-16') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:15:31 user nova-compute[73572]: DEBUG nova.objects.instance [None req-4fe848ab-8dca-44c9-9fc4-07ef3901e2b0 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] Lazy-loading 'pci_devices' on Instance uuid c555f971-b177-4c26-a38e-09e0e78bf7b9 {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:15:31 user nova-compute[73572]: DEBUG nova.objects.base [None req-4fe848ab-8dca-44c9-9fc4-07ef3901e2b0 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] Object Instance<c555f971-b177-4c26-a38e-09e0e78bf7b9> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=73572) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 10:15:31 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-4fe848ab-8dca-44c9-9fc4-07ef3901e2b0 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] [instance: c555f971-b177-4c26-a38e-09e0e78bf7b9] End _get_guest_xml xml=<domain type="kvm">
Aug 26 10:15:31 user nova-compute[73572]:   <uuid>c555f971-b177-4c26-a38e-09e0e78bf7b9</uuid>
Aug 26 10:15:31 user nova-compute[73572]:   <name>instance-00000004</name>
Aug 26 10:15:31 user nova-compute[73572]:   <memory>524288</memory>
Aug 26 10:15:31 user nova-compute[73572]:   <vcpu>1</vcpu>
Aug 26 10:15:31 user nova-compute[73572]:   <metadata>
Aug 26 10:15:31 user nova-compute[73572]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 10:15:31 user nova-compute[73572]:       <nova:package version="0.0.0"/>
Aug 26 10:15:31 user nova-compute[73572]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1454082664</nova:name>
Aug 26 10:15:31 user nova-compute[73572]:       <nova:creationTime>2023-08-26 10:15:31</nova:creationTime>
Aug 26 10:15:31 user nova-compute[73572]:       <nova:flavor name="m1.tiny">
Aug 26 10:15:31 user nova-compute[73572]:         <nova:memory>512</nova:memory>
Aug 26 10:15:31 user nova-compute[73572]:         <nova:disk>1</nova:disk>
Aug 26 10:15:31 user nova-compute[73572]:         <nova:swap>0</nova:swap>
Aug 26 10:15:31 user nova-compute[73572]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 10:15:31 user nova-compute[73572]:         <nova:vcpus>1</nova:vcpus>
Aug 26 10:15:31 user nova-compute[73572]:       </nova:flavor>
Aug 26 10:15:31 user nova-compute[73572]:       <nova:owner>
Aug 26 10:15:31 user nova-compute[73572]:         <nova:user uuid="a56cbd5c1fe94cf9b2a0adc3e82f600b">tempest-ServerStableDeviceRescueTest-1992646584-project-member</nova:user>
Aug 26 10:15:31 user nova-compute[73572]:         <nova:project uuid="c4556d14c0dd416fbe13ab2274947dec">tempest-ServerStableDeviceRescueTest-1992646584</nova:project>
Aug 26 10:15:31 user nova-compute[73572]:       </nova:owner>
Aug 26 10:15:31 user nova-compute[73572]:       <nova:root type="image" uuid="299da0c9-e1c4-48f0-be55-fbe20dd06bc9"/>
Aug 26 10:15:31 user nova-compute[73572]:       <nova:ports>
Aug 26 10:15:31 user nova-compute[73572]:         <nova:port uuid="4ffb7229-16fb-441b-a954-d91308071fb8">
Aug 26 10:15:31 user nova-compute[73572]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 26 10:15:31 user nova-compute[73572]:         </nova:port>
Aug 26 10:15:31 user nova-compute[73572]:       </nova:ports>
Aug 26 10:15:31 user nova-compute[73572]:     </nova:instance>
Aug 26 10:15:31 user nova-compute[73572]:   </metadata>
Aug 26 10:15:31 user nova-compute[73572]:   <sysinfo type="smbios">
Aug 26 10:15:31 user nova-compute[73572]:     <system>
Aug 26 10:15:31 user nova-compute[73572]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 10:15:31 user nova-compute[73572]:       <entry name="product">OpenStack Nova</entry>
Aug 26 10:15:31 user nova-compute[73572]:       <entry name="version">0.0.0</entry>
Aug 26 10:15:31 user nova-compute[73572]:       <entry name="serial">c555f971-b177-4c26-a38e-09e0e78bf7b9</entry>
Aug 26 10:15:31 user nova-compute[73572]:       <entry name="uuid">c555f971-b177-4c26-a38e-09e0e78bf7b9</entry>
Aug 26 10:15:31 user nova-compute[73572]:       <entry name="family">Virtual Machine</entry>
Aug 26 10:15:31 user nova-compute[73572]:     </system>
Aug 26 10:15:31 user nova-compute[73572]:   </sysinfo>
Aug 26 10:15:31 user nova-compute[73572]:   <os>
Aug 26 10:15:31 user nova-compute[73572]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 10:15:31 user nova-compute[73572]:     <smbios mode="sysinfo"/>
Aug 26 10:15:31 user nova-compute[73572]:   </os>
Aug 26 10:15:31 user nova-compute[73572]:   <features>
Aug 26 10:15:31 user nova-compute[73572]:     <acpi/>
Aug 26 10:15:31 user nova-compute[73572]:     <apic/>
Aug 26 10:15:31 user nova-compute[73572]:     <vmcoreinfo/>
Aug 26 10:15:31 user nova-compute[73572]:   </features>
Aug 26 10:15:31 user nova-compute[73572]:   <clock offset="utc">
Aug 26 10:15:31 user nova-compute[73572]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 10:15:31 user nova-compute[73572]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 10:15:31 user nova-compute[73572]:     <timer name="hpet" present="no"/>
Aug 26 10:15:31 user nova-compute[73572]:   </clock>
Aug 26 10:15:31 user nova-compute[73572]:   <cpu mode="custom" match="exact">
Aug 26 10:15:31 user nova-compute[73572]:     <model>Nehalem</model>
Aug 26 10:15:31 user nova-compute[73572]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 10:15:31 user nova-compute[73572]:   </cpu>
Aug 26 10:15:31 user nova-compute[73572]:   <devices>
Aug 26 10:15:31 user nova-compute[73572]:     <disk type="file" device="disk">
Aug 26 10:15:31 user nova-compute[73572]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 10:15:31 user nova-compute[73572]:       <source file="/opt/stack/data/nova/instances/c555f971-b177-4c26-a38e-09e0e78bf7b9/disk"/>
Aug 26 10:15:31 user nova-compute[73572]:       <target dev="vda" bus="virtio"/>
Aug 26 10:15:31 user nova-compute[73572]:     </disk>
Aug 26 10:15:31 user nova-compute[73572]:     <disk type="block" device="disk">
Aug 26 10:15:31 user nova-compute[73572]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 10:15:31 user nova-compute[73572]:       <source dev="/dev/sde"/>
Aug 26 10:15:31 user nova-compute[73572]:       <target dev="vdb" bus="virtio"/>
Aug 26 10:15:31 user nova-compute[73572]:       <serial>ac5c1ee2-3656-49b3-942f-5fc992dc001b</serial>
Aug 26 10:15:31 user nova-compute[73572]:     </disk>
Aug 26 10:15:31 user nova-compute[73572]:     <disk type="file" device="disk">
Aug 26 10:15:31 user nova-compute[73572]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 10:15:31 user nova-compute[73572]:       <source file="/opt/stack/data/nova/instances/c555f971-b177-4c26-a38e-09e0e78bf7b9/disk.rescue"/>
Aug 26 10:15:31 user nova-compute[73572]:       <target dev="vdc" bus="virtio"/>
Aug 26 10:15:31 user nova-compute[73572]:       <boot order="1"/>
Aug 26 10:15:31 user nova-compute[73572]:     </disk>
Aug 26 10:15:31 user nova-compute[73572]:     <interface type="ethernet">
Aug 26 10:15:31 user nova-compute[73572]:       <mac address="fa:16:3e:26:32:ef"/>
Aug 26 10:15:31 user nova-compute[73572]:       <model type="virtio"/>
Aug 26 10:15:31 user nova-compute[73572]:       <mtu size="1442"/>
Aug 26 10:15:31 user nova-compute[73572]:       <target dev="tap4ffb7229-16"/>
Aug 26 10:15:31 user nova-compute[73572]:     </interface>
Aug 26 10:15:31 user nova-compute[73572]:     <serial type="pty">
Aug 26 10:15:31 user nova-compute[73572]:       <log file="/opt/stack/data/nova/instances/c555f971-b177-4c26-a38e-09e0e78bf7b9/console.log" append="off"/>
Aug 26 10:15:31 user nova-compute[73572]:     </serial>
Aug 26 10:15:31 user nova-compute[73572]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 10:15:31 user nova-compute[73572]:     <video>
Aug 26 10:15:31 user nova-compute[73572]:       <model type="virtio"/>
Aug 26 10:15:31 user nova-compute[73572]:     </video>
Aug 26 10:15:31 user nova-compute[73572]:     <rng model="virtio">
Aug 26 10:15:31 user nova-compute[73572]:       <backend model="random">/dev/urandom</backend>
Aug 26 10:15:31 user nova-compute[73572]:     </rng>
Aug 26 10:15:31 user nova-compute[73572]:     <controller type="usb" index="0" model="none"/>
Aug 26 10:15:31 user nova-compute[73572]:     <memballoon model="virtio">
Aug 26 10:15:31 user nova-compute[73572]:       <stats period="10"/>
Aug 26 10:15:31 user nova-compute[73572]:     </memballoon>
Aug 26 10:15:31 user nova-compute[73572]:   </devices>
Aug 26 10:15:31 user nova-compute[73572]: </domain>
Aug 26 10:15:31 user nova-compute[73572]:  {{(pid=73572) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 10:15:31 user nova-compute[73572]: INFO nova.virt.libvirt.driver [-] [instance: c555f971-b177-4c26-a38e-09e0e78bf7b9] Instance destroyed successfully.
Aug 26 10:15:31 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-4fe848ab-8dca-44c9-9fc4-07ef3901e2b0 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] No BDM found with device name vda, not building metadata. {{(pid=73572) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 10:15:31 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-4fe848ab-8dca-44c9-9fc4-07ef3901e2b0 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73572) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 10:15:31 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-4fe848ab-8dca-44c9-9fc4-07ef3901e2b0 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] No BDM found with device name vdc, not building metadata. {{(pid=73572) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 10:15:31 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-4fe848ab-8dca-44c9-9fc4-07ef3901e2b0 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] No VIF found with MAC fa:16:3e:26:32:ef, not building metadata {{(pid=73572) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 10:15:31 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:15:31 user nova-compute[73572]: DEBUG nova.compute.manager [None req-1e258a7f-6e52-41d1-bc86-d49c3d8692c9 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: 14fab12e-52be-4fe6-8777-bc7ebf3c25f1] Start spawning the instance on the hypervisor. {{(pid=73572) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 10:15:31 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-1e258a7f-6e52-41d1-bc86-d49c3d8692c9 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: 14fab12e-52be-4fe6-8777-bc7ebf3c25f1] Creating instance directory {{(pid=73572) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 10:15:31 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-1e258a7f-6e52-41d1-bc86-d49c3d8692c9 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: 14fab12e-52be-4fe6-8777-bc7ebf3c25f1] Creating image(s)
Aug 26 10:15:31 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-1e258a7f-6e52-41d1-bc86-d49c3d8692c9 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: 14fab12e-52be-4fe6-8777-bc7ebf3c25f1] Did not create local disks {{(pid=73572) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 26 10:15:31 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-1e258a7f-6e52-41d1-bc86-d49c3d8692c9 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: 14fab12e-52be-4fe6-8777-bc7ebf3c25f1] Ensure instance console log exists: /opt/stack/data/nova/instances/14fab12e-52be-4fe6-8777-bc7ebf3c25f1/console.log {{(pid=73572) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 10:15:31 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-1e258a7f-6e52-41d1-bc86-d49c3d8692c9 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:15:31 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-1e258a7f-6e52-41d1-bc86-d49c3d8692c9 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:15:31 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-1e258a7f-6e52-41d1-bc86-d49c3d8692c9 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:15:31 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-1e258a7f-6e52-41d1-bc86-d49c3d8692c9 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: 14fab12e-52be-4fe6-8777-bc7ebf3c25f1] Start _get_guest_xml network_info=[{"id": "1b2121f4-88b1-4815-9329-3c9e3172a2f6", "address": "fa:16:3e:b0:35:f5", "network": {"id": "991b9dff-5173-4456-a530-b1f7eb5cfa4a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1845930297-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4636f93c5bfc4653804de097aed2882c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b2121f4-88", "ovs_interfaceid": "1b2121f4-88b1-4815-9329-3c9e3172a2f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T10:07:33Z,direct_url=<?>,disk_format='qcow2',id=299da0c9-e1c4-48f0-be55-fbe20dd06bc9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5c995f8bbbab4368b67a253e0df3971a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T10:07:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'disk_bus': 'virtio', 'boot_index': 0, 'mount_device': '/dev/vda', 'attachment_id': 'e784ff83-27ae-4861-be4b-16a6bf769b3a', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'isVEPGco', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '14fab12e-52be-4fe6-8777-bc7ebf3c25f1', 'attached_at': '', 'detached_at': '', 'volume_id': '36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81', 'serial': '36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81'}, 'guest_format': None, 'device_type': 'disk', 'volume_type': None} {{(pid=73572) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 10:15:31 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-1e258a7f-6e52-41d1-bc86-d49c3d8692c9 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:15:31 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-1e258a7f-6e52-41d1-bc86-d49c3d8692c9 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:15:31 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-1e258a7f-6e52-41d1-bc86-d49c3d8692c9 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73572) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 10:15:31 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-1e258a7f-6e52-41d1-bc86-d49c3d8692c9 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] CPU controller missing on host. {{(pid=73572) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 10:15:31 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-1e258a7f-6e52-41d1-bc86-d49c3d8692c9 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73572) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 10:15:31 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-1e258a7f-6e52-41d1-bc86-d49c3d8692c9 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] CPU controller found on host. {{(pid=73572) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 10:15:31 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-1e258a7f-6e52-41d1-bc86-d49c3d8692c9 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73572) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 10:15:31 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-1e258a7f-6e52-41d1-bc86-d49c3d8692c9 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T10:07:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T10:07:33Z,direct_url=<?>,disk_format='qcow2',id=299da0c9-e1c4-48f0-be55-fbe20dd06bc9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5c995f8bbbab4368b67a253e0df3971a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T10:07:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 10:15:31 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-1e258a7f-6e52-41d1-bc86-d49c3d8692c9 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Flavor limits 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 10:15:31 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-1e258a7f-6e52-41d1-bc86-d49c3d8692c9 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Image limits 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 10:15:31 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-1e258a7f-6e52-41d1-bc86-d49c3d8692c9 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Flavor pref 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 10:15:31 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-1e258a7f-6e52-41d1-bc86-d49c3d8692c9 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Image pref 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 10:15:31 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-1e258a7f-6e52-41d1-bc86-d49c3d8692c9 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 10:15:31 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-1e258a7f-6e52-41d1-bc86-d49c3d8692c9 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 10:15:31 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-1e258a7f-6e52-41d1-bc86-d49c3d8692c9 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73572) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 10:15:31 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-1e258a7f-6e52-41d1-bc86-d49c3d8692c9 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Got 1 possible topologies {{(pid=73572) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 10:15:31 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-1e258a7f-6e52-41d1-bc86-d49c3d8692c9 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 10:15:31 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-1e258a7f-6e52-41d1-bc86-d49c3d8692c9 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 10:15:31 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1e258a7f-6e52-41d1-bc86-d49c3d8692c9 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: 14fab12e-52be-4fe6-8777-bc7ebf3c25f1] Calling os-brick to attach iSCSI Volume {{(pid=73572) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 10:15:31 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e258a7f-6e52-41d1-bc86-d49c3d8692c9 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc89c3d6a10>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'isVEPGco', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 10:15:31 user nova-compute[73572]: WARNING os_brick.initiator.connectors.base [None req-1e258a7f-6e52-41d1-bc86-d49c3d8692c9 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 10:15:31 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-1e258a7f-6e52-41d1-bc86-d49c3d8692c9 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 10:15:31 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-1e258a7f-6e52-41d1-bc86-d49c3d8692c9 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 10:15:31 user nova-compute[73572]: WARNING os_brick.initiator.connectors.base [None req-1e258a7f-6e52-41d1-bc86-d49c3d8692c9 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 10:15:31 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-1e258a7f-6e52-41d1-bc86-d49c3d8692c9 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 10:15:31 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-1e258a7f-6e52-41d1-bc86-d49c3d8692c9 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 10:15:31 user nova-compute[73572]: INFO os_brick.initiator.connectors.iscsi [None req-1e258a7f-6e52-41d1-bc86-d49c3d8692c9 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 10:15:31 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:15:31 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 -p 172.16.0.220:3260 {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:15:31 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:15:31 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9ab8318-1c79-423b-a1f1-379c25ad8f1b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:15:31 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e258a7f-6e52-41d1-bc86-d49c3d8692c9 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 10:15:31 user nova-compute[73572]:  {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:15:31 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 -p 172.16.0.220:3260 --interface default --op new {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:15:31 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:15:31 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea743bc6-c223-4b96-bee5-a4158f8a42b2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81] added\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:15:31 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e258a7f-6e52-41d1-bc86-d49c3d8692c9 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81] added
Aug 26 10:15:31 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:15:31 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:15:31 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:15:31 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee8ebd98-94ca-4edb-a66c-a51375489fd8]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:15:31 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e258a7f-6e52-41d1-bc86-d49c3d8692c9 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:15:31 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:15:31 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:15:31 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd7f524e-0844-4207-999b-e5192fd47cc6]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:15:31 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e258a7f-6e52-41d1-bc86-d49c3d8692c9 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:15:31 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v isVEPGco {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:15:31 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v isVEPGco" returned: 0 in 0.030s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:15:31 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ec74834-34aa-4cea-bcfb-3fb6b141caee]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:15:31 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e258a7f-6e52-41d1-bc86-d49c3d8692c9 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'isVEPGco'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:15:31 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:15:31 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:15:31 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6c7ffe3-6719-49f9-9ce6-558a69b0d7d3]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:15:31 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e258a7f-6e52-41d1-bc86-d49c3d8692c9 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:15:31 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:15:31 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:15:31 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf42b856-19a1-4028-9b7c-f1eaa199f1ad]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac5c1ee2-3656-49b3-942f-5fc992dc001b (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09ba694f-cb2a-4600-abe9-924b41292479 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85988ff4-7fac-4a96-a502-74d6ca8189fe (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75ebe4c4-f791-4f09-a9bd-747ade3d70a3 (non-flash)\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:15:31 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e258a7f-6e52-41d1-bc86-d49c3d8692c9 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac5c1ee2-3656-49b3-942f-5fc992dc001b (non-flash)
Aug 26 10:15:31 user nova-compute[73572]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09ba694f-cb2a-4600-abe9-924b41292479 (non-flash)
Aug 26 10:15:31 user nova-compute[73572]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85988ff4-7fac-4a96-a502-74d6ca8189fe (non-flash)
Aug 26 10:15:31 user nova-compute[73572]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75ebe4c4-f791-4f09-a9bd-747ade3d70a3 (non-flash)
Aug 26 10:15:31 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 10:15:31 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e258a7f-6e52-41d1-bc86-d49c3d8692c9 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac5c1ee2-3656-49b3-942f-5fc992dc001b (non-flash)
Aug 26 10:15:31 user nova-compute[73572]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09ba694f-cb2a-4600-abe9-924b41292479 (non-flash)
Aug 26 10:15:31 user nova-compute[73572]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85988ff4-7fac-4a96-a502-74d6ca8189fe (non-flash)
Aug 26 10:15:31 user nova-compute[73572]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75ebe4c4-f791-4f09-a9bd-747ade3d70a3 (non-flash)
Aug 26 10:15:31 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 10:15:31 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 -p 172.16.0.220:3260 --login {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:15:31 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:15:31 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a202368-383e-46fb-a8b4-41a15031f9cc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:15:31 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e258a7f-6e52-41d1-bc86-d49c3d8692c9 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81, portal: 172.16.0.220,3260]
Aug 26 10:15:31 user nova-compute[73572]: Login to [iface: default, target: iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81, portal: 172.16.0.220,3260] successful.
Aug 26 10:15:31 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:15:31 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:15:31 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:15:31 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[6933375f-bee4-46ba-b53c-1d377283d020]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:15:31 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e258a7f-6e52-41d1-bc86-d49c3d8692c9 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:15:31 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:15:31 user nova-compute[73572]: DEBUG nova.compute.manager [req-25816d2f-29d7-4c49-a3a5-3a085ee648af req-2f6120c9-6274-48ed-a5e9-75c69bf8447a service nova] [instance: d2970584-8c2a-4f99-922c-d66d59489504] Received event network-vif-plugged-754f85e2-09b3-418b-9c3f-452c88756d3a {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:15:31 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-25816d2f-29d7-4c49-a3a5-3a085ee648af req-2f6120c9-6274-48ed-a5e9-75c69bf8447a service nova] Acquiring lock "d2970584-8c2a-4f99-922c-d66d59489504-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:15:31 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-25816d2f-29d7-4c49-a3a5-3a085ee648af req-2f6120c9-6274-48ed-a5e9-75c69bf8447a service nova] Lock "d2970584-8c2a-4f99-922c-d66d59489504-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:15:31 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-25816d2f-29d7-4c49-a3a5-3a085ee648af req-2f6120c9-6274-48ed-a5e9-75c69bf8447a service nova] Lock "d2970584-8c2a-4f99-922c-d66d59489504-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:15:31 user nova-compute[73572]: DEBUG nova.compute.manager [req-25816d2f-29d7-4c49-a3a5-3a085ee648af req-2f6120c9-6274-48ed-a5e9-75c69bf8447a service nova] [instance: d2970584-8c2a-4f99-922c-d66d59489504] No waiting events found dispatching network-vif-plugged-754f85e2-09b3-418b-9c3f-452c88756d3a {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:15:31 user nova-compute[73572]: WARNING nova.compute.manager [req-25816d2f-29d7-4c49-a3a5-3a085ee648af req-2f6120c9-6274-48ed-a5e9-75c69bf8447a service nova] [instance: d2970584-8c2a-4f99-922c-d66d59489504] Received unexpected event network-vif-plugged-754f85e2-09b3-418b-9c3f-452c88756d3a for instance with vm_state building and task_state spawning.
Aug 26 10:15:31 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:15:31 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[b05eb678-0d24-44cb-a63f-30809fff4540]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac5c1ee2-3656-49b3-942f-5fc992dc001b (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09ba694f-cb2a-4600-abe9-924b41292479 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85988ff4-7fac-4a96-a502-74d6ca8189fe (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75ebe4c4-f791-4f09-a9bd-747ade3d70a3 (non-flash)\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:15:31 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e258a7f-6e52-41d1-bc86-d49c3d8692c9 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac5c1ee2-3656-49b3-942f-5fc992dc001b (non-flash)
Aug 26 10:15:31 user nova-compute[73572]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)
Aug 26 10:15:31 user nova-compute[73572]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09ba694f-cb2a-4600-abe9-924b41292479 (non-flash)
Aug 26 10:15:31 user nova-compute[73572]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85988ff4-7fac-4a96-a502-74d6ca8189fe (non-flash)
Aug 26 10:15:31 user nova-compute[73572]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75ebe4c4-f791-4f09-a9bd-747ade3d70a3 (non-flash)
Aug 26 10:15:31 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 10:15:31 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e258a7f-6e52-41d1-bc86-d49c3d8692c9 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac5c1ee2-3656-49b3-942f-5fc992dc001b (non-flash)
Aug 26 10:15:31 user nova-compute[73572]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)
Aug 26 10:15:31 user nova-compute[73572]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09ba694f-cb2a-4600-abe9-924b41292479 (non-flash)
Aug 26 10:15:31 user nova-compute[73572]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85988ff4-7fac-4a96-a502-74d6ca8189fe (non-flash)
Aug 26 10:15:31 user nova-compute[73572]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75ebe4c4-f791-4f09-a9bd-747ade3d70a3 (non-flash)
Aug 26 10:15:31 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 10:15:31 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-1e258a7f-6e52-41d1-bc86-d49c3d8692c9 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.338s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 10:15:31 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e258a7f-6e52-41d1-bc86-d49c3d8692c9 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Connected to 172.16.0.220:3260 {{(pid=73572) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 10:15:31 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-1e258a7f-6e52-41d1-bc86-d49c3d8692c9 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] HCTL ('37', '-', '-', 0) found on session 13 with lun 0 {{(pid=73572) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 10:15:31 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-1e258a7f-6e52-41d1-bc86-d49c3d8692c9 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=73572) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 10:15:31 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:15:31 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.016s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:15:31 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[95da595e-dcac-49d5-ad10-2c71d1cc09b8]: (4, ('- - 0', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:15:31 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-1e258a7f-6e52-41d1-bc86-d49c3d8692c9 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Searching for a device in session 13 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=73572) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 10:15:31 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e258a7f-6e52-41d1-bc86-d49c3d8692c9 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'isVEPGco', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73572) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 10:15:32 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:15:32 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:15:32 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:15:32 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:15:32 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-f68ac4b9-b880-4ea9-80bb-5ae1072aa2e7 tempest-TestVolumeSwap-1919204229 tempest-TestVolumeSwap-1919204229-project-member] Acquiring lock "d2a731d2-13ff-49e5-ab17-80686b622df7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:15:32 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-f68ac4b9-b880-4ea9-80bb-5ae1072aa2e7 tempest-TestVolumeSwap-1919204229 tempest-TestVolumeSwap-1919204229-project-member] Lock "d2a731d2-13ff-49e5-ab17-80686b622df7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:15:32 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-f68ac4b9-b880-4ea9-80bb-5ae1072aa2e7 tempest-TestVolumeSwap-1919204229 tempest-TestVolumeSwap-1919204229-project-member] Acquiring lock "d2a731d2-13ff-49e5-ab17-80686b622df7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:15:32 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-f68ac4b9-b880-4ea9-80bb-5ae1072aa2e7 tempest-TestVolumeSwap-1919204229 tempest-TestVolumeSwap-1919204229-project-member] Lock "d2a731d2-13ff-49e5-ab17-80686b622df7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:15:32 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-f68ac4b9-b880-4ea9-80bb-5ae1072aa2e7 tempest-TestVolumeSwap-1919204229 tempest-TestVolumeSwap-1919204229-project-member] Lock "d2a731d2-13ff-49e5-ab17-80686b622df7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:15:32 user nova-compute[73572]: INFO nova.compute.manager [None req-f68ac4b9-b880-4ea9-80bb-5ae1072aa2e7 tempest-TestVolumeSwap-1919204229 tempest-TestVolumeSwap-1919204229-project-member] [instance: d2a731d2-13ff-49e5-ab17-80686b622df7] Terminating instance
Aug 26 10:15:32 user nova-compute[73572]: DEBUG nova.compute.manager [None req-f68ac4b9-b880-4ea9-80bb-5ae1072aa2e7 tempest-TestVolumeSwap-1919204229 tempest-TestVolumeSwap-1919204229-project-member] [instance: d2a731d2-13ff-49e5-ab17-80686b622df7] Start destroying the instance on the hypervisor. {{(pid=73572) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 10:15:32 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:15:32 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:15:32 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:15:32 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:15:32 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:15:33 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-1e258a7f-6e52-41d1-bc86-d49c3d8692c9 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.381s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 10:15:33 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e258a7f-6e52-41d1-bc86-d49c3d8692c9 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] <== connect_volume: return (1383ms) {'type': 'block', 'scsi_wwn': '26661383361383639', 'path': '/dev/sdf'} {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 10:15:33 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1e258a7f-6e52-41d1-bc86-d49c3d8692c9 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: 14fab12e-52be-4fe6-8777-bc7ebf3c25f1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26661383361383639', 'path': '/dev/sdf'} {{(pid=73572) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 10:15:33 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-1e258a7f-6e52-41d1-bc86-d49c3d8692c9 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T10:15:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1685663078',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1685663078',id=14,image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4636f93c5bfc4653804de097aed2882c',ramdisk_id='',reservation_id='r-5s63bck6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-665602868',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T10:15:12Z,user_data=None,user_id='07f3538038a14713af3bbe420f1fb03a',uuid=14fab12e-52be-4fe6-8777-bc7ebf3c25f1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1b2121f4-88b1-4815-9329-3c9e3172a2f6", "address": "fa:16:3e:b0:35:f5", "network": {"id": "991b9dff-5173-4456-a530-b1f7eb5cfa4a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1845930297-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4636f93c5bfc4653804de097aed2882c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b2121f4-88", "ovs_interfaceid": "1b2121f4-88b1-4815-9329-3c9e3172a2f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73572) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 10:15:33 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-1e258a7f-6e52-41d1-bc86-d49c3d8692c9 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Converting VIF {"id": "1b2121f4-88b1-4815-9329-3c9e3172a2f6", "address": "fa:16:3e:b0:35:f5", "network": {"id": "991b9dff-5173-4456-a530-b1f7eb5cfa4a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1845930297-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4636f93c5bfc4653804de097aed2882c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b2121f4-88", "ovs_interfaceid": "1b2121f4-88b1-4815-9329-3c9e3172a2f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:15:33 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-1e258a7f-6e52-41d1-bc86-d49c3d8692c9 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:35:f5,bridge_name='br-int',has_traffic_filtering=True,id=1b2121f4-88b1-4815-9329-3c9e3172a2f6,network=Network(991b9dff-5173-4456-a530-b1f7eb5cfa4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b2121f4-88') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:15:33 user nova-compute[73572]: DEBUG nova.objects.instance [None req-1e258a7f-6e52-41d1-bc86-d49c3d8692c9 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Lazy-loading 'pci_devices' on Instance uuid 14fab12e-52be-4fe6-8777-bc7ebf3c25f1 {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:15:33 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-1e258a7f-6e52-41d1-bc86-d49c3d8692c9 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: 14fab12e-52be-4fe6-8777-bc7ebf3c25f1] End _get_guest_xml xml=<domain type="kvm">
Aug 26 10:15:33 user nova-compute[73572]:   <uuid>14fab12e-52be-4fe6-8777-bc7ebf3c25f1</uuid>
Aug 26 10:15:33 user nova-compute[73572]:   <name>instance-0000000e</name>
Aug 26 10:15:33 user nova-compute[73572]:   <memory>524288</memory>
Aug 26 10:15:33 user nova-compute[73572]:   <vcpu>1</vcpu>
Aug 26 10:15:33 user nova-compute[73572]:   <metadata>
Aug 26 10:15:33 user nova-compute[73572]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 10:15:33 user nova-compute[73572]:       <nova:package version="0.0.0"/>
Aug 26 10:15:33 user nova-compute[73572]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1685663078</nova:name>
Aug 26 10:15:33 user nova-compute[73572]:       <nova:creationTime>2023-08-26 10:15:31</nova:creationTime>
Aug 26 10:15:33 user nova-compute[73572]:       <nova:flavor name="m1.tiny">
Aug 26 10:15:33 user nova-compute[73572]:         <nova:memory>512</nova:memory>
Aug 26 10:15:33 user nova-compute[73572]:         <nova:disk>1</nova:disk>
Aug 26 10:15:33 user nova-compute[73572]:         <nova:swap>0</nova:swap>
Aug 26 10:15:33 user nova-compute[73572]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 10:15:33 user nova-compute[73572]:         <nova:vcpus>1</nova:vcpus>
Aug 26 10:15:33 user nova-compute[73572]:       </nova:flavor>
Aug 26 10:15:33 user nova-compute[73572]:       <nova:owner>
Aug 26 10:15:33 user nova-compute[73572]:         <nova:user uuid="07f3538038a14713af3bbe420f1fb03a">tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member</nova:user>
Aug 26 10:15:33 user nova-compute[73572]:         <nova:project uuid="4636f93c5bfc4653804de097aed2882c">tempest-ServerBootFromVolumeStableRescueTest-665602868</nova:project>
Aug 26 10:15:33 user nova-compute[73572]:       </nova:owner>
Aug 26 10:15:33 user nova-compute[73572]:       <nova:root type="image" uuid="299da0c9-e1c4-48f0-be55-fbe20dd06bc9"/>
Aug 26 10:15:33 user nova-compute[73572]:       <nova:ports>
Aug 26 10:15:33 user nova-compute[73572]:         <nova:port uuid="1b2121f4-88b1-4815-9329-3c9e3172a2f6">
Aug 26 10:15:33 user nova-compute[73572]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 26 10:15:33 user nova-compute[73572]:         </nova:port>
Aug 26 10:15:33 user nova-compute[73572]:       </nova:ports>
Aug 26 10:15:33 user nova-compute[73572]:     </nova:instance>
Aug 26 10:15:33 user nova-compute[73572]:   </metadata>
Aug 26 10:15:33 user nova-compute[73572]:   <sysinfo type="smbios">
Aug 26 10:15:33 user nova-compute[73572]:     <system>
Aug 26 10:15:33 user nova-compute[73572]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 10:15:33 user nova-compute[73572]:       <entry name="product">OpenStack Nova</entry>
Aug 26 10:15:33 user nova-compute[73572]:       <entry name="version">0.0.0</entry>
Aug 26 10:15:33 user nova-compute[73572]:       <entry name="serial">14fab12e-52be-4fe6-8777-bc7ebf3c25f1</entry>
Aug 26 10:15:33 user nova-compute[73572]:       <entry name="uuid">14fab12e-52be-4fe6-8777-bc7ebf3c25f1</entry>
Aug 26 10:15:33 user nova-compute[73572]:       <entry name="family">Virtual Machine</entry>
Aug 26 10:15:33 user nova-compute[73572]:     </system>
Aug 26 10:15:33 user nova-compute[73572]:   </sysinfo>
Aug 26 10:15:33 user nova-compute[73572]:   <os>
Aug 26 10:15:33 user nova-compute[73572]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 10:15:33 user nova-compute[73572]:     <boot dev="hd"/>
Aug 26 10:15:33 user nova-compute[73572]:     <smbios mode="sysinfo"/>
Aug 26 10:15:33 user nova-compute[73572]:   </os>
Aug 26 10:15:33 user nova-compute[73572]:   <features>
Aug 26 10:15:33 user nova-compute[73572]:     <acpi/>
Aug 26 10:15:33 user nova-compute[73572]:     <apic/>
Aug 26 10:15:33 user nova-compute[73572]:     <vmcoreinfo/>
Aug 26 10:15:33 user nova-compute[73572]:   </features>
Aug 26 10:15:33 user nova-compute[73572]:   <clock offset="utc">
Aug 26 10:15:33 user nova-compute[73572]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 10:15:33 user nova-compute[73572]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 10:15:33 user nova-compute[73572]:     <timer name="hpet" present="no"/>
Aug 26 10:15:33 user nova-compute[73572]:   </clock>
Aug 26 10:15:33 user nova-compute[73572]:   <cpu mode="custom" match="exact">
Aug 26 10:15:33 user nova-compute[73572]:     <model>Nehalem</model>
Aug 26 10:15:33 user nova-compute[73572]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 10:15:33 user nova-compute[73572]:   </cpu>
Aug 26 10:15:33 user nova-compute[73572]:   <devices>
Aug 26 10:15:33 user nova-compute[73572]:     <disk type="block" device="disk">
Aug 26 10:15:33 user nova-compute[73572]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 10:15:33 user nova-compute[73572]:       <source dev="/dev/sdf"/>
Aug 26 10:15:33 user nova-compute[73572]:       <target dev="vda" bus="virtio"/>
Aug 26 10:15:33 user nova-compute[73572]:       <serial>36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81</serial>
Aug 26 10:15:33 user nova-compute[73572]:     </disk>
Aug 26 10:15:33 user nova-compute[73572]:     <interface type="ethernet">
Aug 26 10:15:33 user nova-compute[73572]:       <mac address="fa:16:3e:b0:35:f5"/>
Aug 26 10:15:33 user nova-compute[73572]:       <model type="virtio"/>
Aug 26 10:15:33 user nova-compute[73572]:       <mtu size="1442"/>
Aug 26 10:15:33 user nova-compute[73572]:       <target dev="tap1b2121f4-88"/>
Aug 26 10:15:33 user nova-compute[73572]:     </interface>
Aug 26 10:15:33 user nova-compute[73572]:     <serial type="pty">
Aug 26 10:15:33 user nova-compute[73572]:       <log file="/opt/stack/data/nova/instances/14fab12e-52be-4fe6-8777-bc7ebf3c25f1/console.log" append="off"/>
Aug 26 10:15:33 user nova-compute[73572]:     </serial>
Aug 26 10:15:33 user nova-compute[73572]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 10:15:33 user nova-compute[73572]:     <video>
Aug 26 10:15:33 user nova-compute[73572]:       <model type="virtio"/>
Aug 26 10:15:33 user nova-compute[73572]:     </video>
Aug 26 10:15:33 user nova-compute[73572]:     <rng model="virtio">
Aug 26 10:15:33 user nova-compute[73572]:       <backend model="random">/dev/urandom</backend>
Aug 26 10:15:33 user nova-compute[73572]:     </rng>
Aug 26 10:15:33 user nova-compute[73572]:     <controller type="usb" index="0" model="none"/>
Aug 26 10:15:33 user nova-compute[73572]:     <memballoon model="virtio">
Aug 26 10:15:33 user nova-compute[73572]:       <stats period="10"/>
Aug 26 10:15:33 user nova-compute[73572]:     </memballoon>
Aug 26 10:15:33 user nova-compute[73572]:   </devices>
Aug 26 10:15:33 user nova-compute[73572]: </domain>
Aug 26 10:15:33 user nova-compute[73572]:  {{(pid=73572) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 10:15:33 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-1e258a7f-6e52-41d1-bc86-d49c3d8692c9 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T10:15:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1685663078',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1685663078',id=14,image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4636f93c5bfc4653804de097aed2882c',ramdisk_id='',reservation_id='r-5s63bck6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-665602868',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T10:15:12Z,user_data=None,user_id='07f3538038a14713af3bbe420f1fb03a',uuid=14fab12e-52be-4fe6-8777-bc7ebf3c25f1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1b2121f4-88b1-4815-9329-3c9e3172a2f6", "address": "fa:16:3e:b0:35:f5", "network": {"id": "991b9dff-5173-4456-a530-b1f7eb5cfa4a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1845930297-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4636f93c5bfc4653804de097aed2882c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b2121f4-88", "ovs_interfaceid": "1b2121f4-88b1-4815-9329-3c9e3172a2f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 10:15:33 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-1e258a7f-6e52-41d1-bc86-d49c3d8692c9 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Converting VIF {"id": "1b2121f4-88b1-4815-9329-3c9e3172a2f6", "address": "fa:16:3e:b0:35:f5", "network": {"id": "991b9dff-5173-4456-a530-b1f7eb5cfa4a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1845930297-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4636f93c5bfc4653804de097aed2882c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b2121f4-88", "ovs_interfaceid": "1b2121f4-88b1-4815-9329-3c9e3172a2f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:15:33 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-1e258a7f-6e52-41d1-bc86-d49c3d8692c9 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:35:f5,bridge_name='br-int',has_traffic_filtering=True,id=1b2121f4-88b1-4815-9329-3c9e3172a2f6,network=Network(991b9dff-5173-4456-a530-b1f7eb5cfa4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b2121f4-88') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:15:33 user nova-compute[73572]: DEBUG os_vif [None req-1e258a7f-6e52-41d1-bc86-d49c3d8692c9 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:35:f5,bridge_name='br-int',has_traffic_filtering=True,id=1b2121f4-88b1-4815-9329-3c9e3172a2f6,network=Network(991b9dff-5173-4456-a530-b1f7eb5cfa4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b2121f4-88') {{(pid=73572) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 10:15:33 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:15:33 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:15:33 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 10:15:33 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:15:33 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1b2121f4-88, may_exist=True, interface_attrs={}) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:15:33 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1b2121f4-88, col_values=(('external_ids', {'iface-id': '1b2121f4-88b1-4815-9329-3c9e3172a2f6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b0:35:f5', 'vm-uuid': '14fab12e-52be-4fe6-8777-bc7ebf3c25f1'}),), if_exists=True) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:15:33 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:15:33 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:15:33 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:15:33 user nova-compute[73572]: INFO os_vif [None req-1e258a7f-6e52-41d1-bc86-d49c3d8692c9 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:35:f5,bridge_name='br-int',has_traffic_filtering=True,id=1b2121f4-88b1-4815-9329-3c9e3172a2f6,network=Network(991b9dff-5173-4456-a530-b1f7eb5cfa4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b2121f4-88')
Aug 26 10:15:33 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:15:33 user nova-compute[73572]: DEBUG nova.compute.manager [req-dd3dfeea-7f16-4b3e-8c9e-add85d91ecc0 req-e7f7ffd7-b33f-40f2-bf29-e345682af90f service nova] [instance: d2a731d2-13ff-49e5-ab17-80686b622df7] Received event network-vif-unplugged-a07bf467-f02f-4889-b735-17df0d48853a {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:15:33 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-dd3dfeea-7f16-4b3e-8c9e-add85d91ecc0 req-e7f7ffd7-b33f-40f2-bf29-e345682af90f service nova] Acquiring lock "d2a731d2-13ff-49e5-ab17-80686b622df7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:15:33 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-dd3dfeea-7f16-4b3e-8c9e-add85d91ecc0 req-e7f7ffd7-b33f-40f2-bf29-e345682af90f service nova] Lock "d2a731d2-13ff-49e5-ab17-80686b622df7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:15:33 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-dd3dfeea-7f16-4b3e-8c9e-add85d91ecc0 req-e7f7ffd7-b33f-40f2-bf29-e345682af90f service nova] Lock "d2a731d2-13ff-49e5-ab17-80686b622df7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:15:33 user nova-compute[73572]: DEBUG nova.compute.manager [req-dd3dfeea-7f16-4b3e-8c9e-add85d91ecc0 req-e7f7ffd7-b33f-40f2-bf29-e345682af90f service nova] [instance: d2a731d2-13ff-49e5-ab17-80686b622df7] No waiting events found dispatching network-vif-unplugged-a07bf467-f02f-4889-b735-17df0d48853a {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:15:33 user nova-compute[73572]: DEBUG nova.compute.manager [req-dd3dfeea-7f16-4b3e-8c9e-add85d91ecc0 req-e7f7ffd7-b33f-40f2-bf29-e345682af90f service nova] [instance: d2a731d2-13ff-49e5-ab17-80686b622df7] Received event network-vif-unplugged-a07bf467-f02f-4889-b735-17df0d48853a for instance with task_state deleting. {{(pid=73572) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 10:15:33 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:15:33 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:15:33 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-1e258a7f-6e52-41d1-bc86-d49c3d8692c9 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] No BDM found with device name vda, not building metadata. {{(pid=73572) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 10:15:33 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-1e258a7f-6e52-41d1-bc86-d49c3d8692c9 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] No VIF found with MAC fa:16:3e:b0:35:f5, not building metadata {{(pid=73572) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 10:15:33 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:15:33 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:15:33 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:15:33 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:15:33 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:15:33 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:15:33 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:15:33 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:15:33 user nova-compute[73572]: DEBUG nova.compute.manager [req-28360daf-8c14-4694-9bf4-25ef0d873967 req-5b0fabfc-ea22-4f97-97fa-fd541d0ef224 service nova] [instance: d2970584-8c2a-4f99-922c-d66d59489504] Received event network-vif-plugged-754f85e2-09b3-418b-9c3f-452c88756d3a {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:15:33 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-28360daf-8c14-4694-9bf4-25ef0d873967 req-5b0fabfc-ea22-4f97-97fa-fd541d0ef224 service nova] Acquiring lock "d2970584-8c2a-4f99-922c-d66d59489504-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:15:33 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-28360daf-8c14-4694-9bf4-25ef0d873967 req-5b0fabfc-ea22-4f97-97fa-fd541d0ef224 service nova] Lock "d2970584-8c2a-4f99-922c-d66d59489504-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:15:33 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-28360daf-8c14-4694-9bf4-25ef0d873967 req-5b0fabfc-ea22-4f97-97fa-fd541d0ef224 service nova] Lock "d2970584-8c2a-4f99-922c-d66d59489504-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:15:33 user nova-compute[73572]: DEBUG nova.compute.manager [req-28360daf-8c14-4694-9bf4-25ef0d873967 req-5b0fabfc-ea22-4f97-97fa-fd541d0ef224 service nova] [instance: d2970584-8c2a-4f99-922c-d66d59489504] No waiting events found dispatching network-vif-plugged-754f85e2-09b3-418b-9c3f-452c88756d3a {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:15:33 user nova-compute[73572]: WARNING nova.compute.manager [req-28360daf-8c14-4694-9bf4-25ef0d873967 req-5b0fabfc-ea22-4f97-97fa-fd541d0ef224 service nova] [instance: d2970584-8c2a-4f99-922c-d66d59489504] Received unexpected event network-vif-plugged-754f85e2-09b3-418b-9c3f-452c88756d3a for instance with vm_state building and task_state spawning.
Aug 26 10:15:34 user nova-compute[73572]: INFO nova.virt.libvirt.driver [-] [instance: d2a731d2-13ff-49e5-ab17-80686b622df7] Instance destroyed successfully.
Aug 26 10:15:34 user nova-compute[73572]: DEBUG nova.objects.instance [None req-f68ac4b9-b880-4ea9-80bb-5ae1072aa2e7 tempest-TestVolumeSwap-1919204229 tempest-TestVolumeSwap-1919204229-project-member] Lazy-loading 'resources' on Instance uuid d2a731d2-13ff-49e5-ab17-80686b622df7 {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:15:34 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-f68ac4b9-b880-4ea9-80bb-5ae1072aa2e7 tempest-TestVolumeSwap-1919204229 tempest-TestVolumeSwap-1919204229-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T10:11:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-585233066',display_name='tempest-TestVolumeSwap-server-585233066',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-585233066',id=7,image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE7lvVaX0yiXG8PU0mRk4tmslldd3pRCdHchcM8Dy1MMJT5OS7HQv09GGP6cHMbFsi7N7JpTFlII+BoiRglGxoR4O7mSR45WN111rHDSK/AfMIZcgfLhqTcecD+Z6jgexg==',key_name='tempest-keypair-1635714976',keypairs=<?>,launch_index=0,launched_at=2023-08-26T10:12:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='093a28613113447b87f3785c80906ba2',ramdisk_id='',reservation_id='r-a78ndj6e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-1919204229',owner_user_name='tempest-TestVolumeSwap-1919204229-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T10:12:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e023f93a60c044f59c07bae3620f5811',uuid=d2a731d2-13ff-49e5-ab17-80686b622df7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a07bf467-f02f-4889-b735-17df0d48853a", "address": "fa:16:3e:2d:a2:9f", "network": {"id": "6881a14a-a8c8-47da-a205-a4958693640c", "bridge": "br-int", "label": "tempest-TestVolumeSwap-627208954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "093a28613113447b87f3785c80906ba2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa07bf467-f0", "ovs_interfaceid": "a07bf467-f02f-4889-b735-17df0d48853a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 10:15:34 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-f68ac4b9-b880-4ea9-80bb-5ae1072aa2e7 tempest-TestVolumeSwap-1919204229 tempest-TestVolumeSwap-1919204229-project-member] Converting VIF {"id": "a07bf467-f02f-4889-b735-17df0d48853a", "address": "fa:16:3e:2d:a2:9f", "network": {"id": "6881a14a-a8c8-47da-a205-a4958693640c", "bridge": "br-int", "label": "tempest-TestVolumeSwap-627208954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "093a28613113447b87f3785c80906ba2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa07bf467-f0", "ovs_interfaceid": "a07bf467-f02f-4889-b735-17df0d48853a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:15:34 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-f68ac4b9-b880-4ea9-80bb-5ae1072aa2e7 tempest-TestVolumeSwap-1919204229 tempest-TestVolumeSwap-1919204229-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2d:a2:9f,bridge_name='br-int',has_traffic_filtering=True,id=a07bf467-f02f-4889-b735-17df0d48853a,network=Network(6881a14a-a8c8-47da-a205-a4958693640c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa07bf467-f0') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:15:34 user nova-compute[73572]: DEBUG os_vif [None req-f68ac4b9-b880-4ea9-80bb-5ae1072aa2e7 tempest-TestVolumeSwap-1919204229 tempest-TestVolumeSwap-1919204229-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2d:a2:9f,bridge_name='br-int',has_traffic_filtering=True,id=a07bf467-f02f-4889-b735-17df0d48853a,network=Network(6881a14a-a8c8-47da-a205-a4958693640c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa07bf467-f0') {{(pid=73572) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 10:15:34 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:15:34 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa07bf467-f0, bridge=br-int, if_exists=True) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:15:34 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:15:34 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:15:34 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:15:34 user nova-compute[73572]: INFO os_vif [None req-f68ac4b9-b880-4ea9-80bb-5ae1072aa2e7 tempest-TestVolumeSwap-1919204229 tempest-TestVolumeSwap-1919204229-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2d:a2:9f,bridge_name='br-int',has_traffic_filtering=True,id=a07bf467-f02f-4889-b735-17df0d48853a,network=Network(6881a14a-a8c8-47da-a205-a4958693640c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa07bf467-f0')
Aug 26 10:15:34 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-f68ac4b9-b880-4ea9-80bb-5ae1072aa2e7 tempest-TestVolumeSwap-1919204229 tempest-TestVolumeSwap-1919204229-project-member] [instance: d2a731d2-13ff-49e5-ab17-80686b622df7] Deleting instance files /opt/stack/data/nova/instances/d2a731d2-13ff-49e5-ab17-80686b622df7_del
Aug 26 10:15:34 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-f68ac4b9-b880-4ea9-80bb-5ae1072aa2e7 tempest-TestVolumeSwap-1919204229 tempest-TestVolumeSwap-1919204229-project-member] [instance: d2a731d2-13ff-49e5-ab17-80686b622df7] Deletion of /opt/stack/data/nova/instances/d2a731d2-13ff-49e5-ab17-80686b622df7_del complete
Aug 26 10:15:34 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:15:34 user nova-compute[73572]: INFO nova.compute.manager [None req-f68ac4b9-b880-4ea9-80bb-5ae1072aa2e7 tempest-TestVolumeSwap-1919204229 tempest-TestVolumeSwap-1919204229-project-member] [instance: d2a731d2-13ff-49e5-ab17-80686b622df7] Took 1.70 seconds to destroy the instance on the hypervisor.
Aug 26 10:15:34 user nova-compute[73572]: DEBUG oslo.service.loopingcall [None req-f68ac4b9-b880-4ea9-80bb-5ae1072aa2e7 tempest-TestVolumeSwap-1919204229 tempest-TestVolumeSwap-1919204229-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73572) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 10:15:34 user nova-compute[73572]: DEBUG nova.compute.manager [-] [instance: d2a731d2-13ff-49e5-ab17-80686b622df7] Deallocating network for instance {{(pid=73572) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 10:15:34 user nova-compute[73572]: DEBUG nova.network.neutron [-] [instance: d2a731d2-13ff-49e5-ab17-80686b622df7] deallocate_for_instance() {{(pid=73572) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 10:15:34 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-6cda5169-8360-44bf-b3c1-3c4e62b0831c tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Acquiring lock "0fe47a17-4ffb-48ce-b0f6-a9b43002bd55" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:15:34 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-6cda5169-8360-44bf-b3c1-3c4e62b0831c tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Lock "0fe47a17-4ffb-48ce-b0f6-a9b43002bd55" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:15:34 user nova-compute[73572]: DEBUG nova.compute.manager [None req-6cda5169-8360-44bf-b3c1-3c4e62b0831c tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] [instance: 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55] Starting instance... {{(pid=73572) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 10:15:34 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-6cda5169-8360-44bf-b3c1-3c4e62b0831c tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:15:34 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-6cda5169-8360-44bf-b3c1-3c4e62b0831c tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:15:34 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-6cda5169-8360-44bf-b3c1-3c4e62b0831c tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73572) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 10:15:34 user nova-compute[73572]: INFO nova.compute.claims [None req-6cda5169-8360-44bf-b3c1-3c4e62b0831c tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] [instance: 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55] Claim successful on node user
Aug 26 10:15:35 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:15:35 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:15:35 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:15:35 user nova-compute[73572]: DEBUG nova.network.neutron [-] [instance: d2a731d2-13ff-49e5-ab17-80686b622df7] Updating instance_info_cache with network_info: [] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:15:35 user nova-compute[73572]: DEBUG nova.compute.manager [req-48e8457f-9cd9-4e3d-aaa7-ddd492c09999 req-a2a35f94-92fa-4d70-ad83-4d90dd03e058 service nova] [instance: d2a731d2-13ff-49e5-ab17-80686b622df7] Received event network-vif-deleted-a07bf467-f02f-4889-b735-17df0d48853a {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:15:35 user nova-compute[73572]: INFO nova.compute.manager [req-48e8457f-9cd9-4e3d-aaa7-ddd492c09999 req-a2a35f94-92fa-4d70-ad83-4d90dd03e058 service nova] [instance: d2a731d2-13ff-49e5-ab17-80686b622df7] Neutron deleted interface a07bf467-f02f-4889-b735-17df0d48853a; detaching it from the instance and deleting it from the info cache
Aug 26 10:15:35 user nova-compute[73572]: DEBUG nova.network.neutron [req-48e8457f-9cd9-4e3d-aaa7-ddd492c09999 req-a2a35f94-92fa-4d70-ad83-4d90dd03e058 service nova] [instance: d2a731d2-13ff-49e5-ab17-80686b622df7] Updating instance_info_cache with network_info: [] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:15:35 user nova-compute[73572]: INFO nova.compute.manager [-] [instance: d2a731d2-13ff-49e5-ab17-80686b622df7] Took 0.93 seconds to deallocate network for instance.
Aug 26 10:15:35 user nova-compute[73572]: DEBUG nova.compute.manager [req-229574a9-62a7-410d-98f3-cb5ddd6d56e5 req-85fb84a7-b204-4f9b-ad20-b3d1e0b2240e service nova] [instance: d2a731d2-13ff-49e5-ab17-80686b622df7] Received event network-vif-plugged-a07bf467-f02f-4889-b735-17df0d48853a {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:15:35 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-229574a9-62a7-410d-98f3-cb5ddd6d56e5 req-85fb84a7-b204-4f9b-ad20-b3d1e0b2240e service nova] Acquiring lock "d2a731d2-13ff-49e5-ab17-80686b622df7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:15:35 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-229574a9-62a7-410d-98f3-cb5ddd6d56e5 req-85fb84a7-b204-4f9b-ad20-b3d1e0b2240e service nova] Lock "d2a731d2-13ff-49e5-ab17-80686b622df7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:15:35 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-229574a9-62a7-410d-98f3-cb5ddd6d56e5 req-85fb84a7-b204-4f9b-ad20-b3d1e0b2240e service nova] Lock "d2a731d2-13ff-49e5-ab17-80686b622df7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:15:35 user nova-compute[73572]: DEBUG nova.compute.manager [req-229574a9-62a7-410d-98f3-cb5ddd6d56e5 req-85fb84a7-b204-4f9b-ad20-b3d1e0b2240e service nova] [instance: d2a731d2-13ff-49e5-ab17-80686b622df7] No waiting events found dispatching network-vif-plugged-a07bf467-f02f-4889-b735-17df0d48853a {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:15:35 user nova-compute[73572]: WARNING nova.compute.manager [req-229574a9-62a7-410d-98f3-cb5ddd6d56e5 req-85fb84a7-b204-4f9b-ad20-b3d1e0b2240e service nova] [instance: d2a731d2-13ff-49e5-ab17-80686b622df7] Received unexpected event network-vif-plugged-a07bf467-f02f-4889-b735-17df0d48853a for instance with vm_state active and task_state deleting.
Aug 26 10:15:35 user nova-compute[73572]: DEBUG nova.compute.manager [req-48e8457f-9cd9-4e3d-aaa7-ddd492c09999 req-a2a35f94-92fa-4d70-ad83-4d90dd03e058 service nova] [instance: d2a731d2-13ff-49e5-ab17-80686b622df7] Detach interface failed, port_id=a07bf467-f02f-4889-b735-17df0d48853a, reason: Instance d2a731d2-13ff-49e5-ab17-80686b622df7 could not be found. {{(pid=73572) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 10:15:35 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-f68ac4b9-b880-4ea9-80bb-5ae1072aa2e7 tempest-TestVolumeSwap-1919204229 tempest-TestVolumeSwap-1919204229-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:15:35 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:15:35 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:15:35 user nova-compute[73572]: DEBUG nova.compute.provider_tree [None req-6cda5169-8360-44bf-b3c1-3c4e62b0831c tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Inventory has not changed in ProviderTree for provider: e2cec974-59b2-4c77-a53d-a7f4e5a30d75 {{(pid=73572) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 10:15:35 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-6cda5169-8360-44bf-b3c1-3c4e62b0831c tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Inventory has not changed for provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73572) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 10:15:35 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-6cda5169-8360-44bf-b3c1-3c4e62b0831c tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.691s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:15:35 user nova-compute[73572]: DEBUG nova.compute.manager [None req-6cda5169-8360-44bf-b3c1-3c4e62b0831c tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] [instance: 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55] Start building networks asynchronously for instance. {{(pid=73572) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 10:15:35 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-f68ac4b9-b880-4ea9-80bb-5ae1072aa2e7 tempest-TestVolumeSwap-1919204229 tempest-TestVolumeSwap-1919204229-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.248s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:15:35 user nova-compute[73572]: DEBUG nova.compute.manager [None req-6cda5169-8360-44bf-b3c1-3c4e62b0831c tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] [instance: 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55] Allocating IP information in the background. {{(pid=73572) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 10:15:35 user nova-compute[73572]: DEBUG nova.network.neutron [None req-6cda5169-8360-44bf-b3c1-3c4e62b0831c tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] [instance: 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55] allocate_for_instance() {{(pid=73572) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 10:15:35 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-6cda5169-8360-44bf-b3c1-3c4e62b0831c tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] [instance: 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 10:15:35 user nova-compute[73572]: DEBUG nova.compute.manager [None req-6cda5169-8360-44bf-b3c1-3c4e62b0831c tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] [instance: 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55] Start building block device mappings for instance. {{(pid=73572) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 10:15:35 user nova-compute[73572]: DEBUG nova.policy [None req-6cda5169-8360-44bf-b3c1-3c4e62b0831c tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0ee7e4a9f7db476eb9f16440c6b8e37e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d2c922711fb445aa99ae4f30b802c12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73572) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 10:15:35 user nova-compute[73572]: DEBUG nova.compute.manager [None req-6cda5169-8360-44bf-b3c1-3c4e62b0831c tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] [instance: 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55] Start spawning the instance on the hypervisor. {{(pid=73572) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 10:15:35 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-6cda5169-8360-44bf-b3c1-3c4e62b0831c tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] [instance: 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55] Creating instance directory {{(pid=73572) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 10:15:35 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-6cda5169-8360-44bf-b3c1-3c4e62b0831c tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] [instance: 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55] Creating image(s)
Aug 26 10:15:35 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-6cda5169-8360-44bf-b3c1-3c4e62b0831c tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Acquiring lock "/opt/stack/data/nova/instances/0fe47a17-4ffb-48ce-b0f6-a9b43002bd55/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:15:35 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-6cda5169-8360-44bf-b3c1-3c4e62b0831c tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Lock "/opt/stack/data/nova/instances/0fe47a17-4ffb-48ce-b0f6-a9b43002bd55/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:15:35 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-6cda5169-8360-44bf-b3c1-3c4e62b0831c tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Lock "/opt/stack/data/nova/instances/0fe47a17-4ffb-48ce-b0f6-a9b43002bd55/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:15:35 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-6cda5169-8360-44bf-b3c1-3c4e62b0831c tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:15:36 user nova-compute[73572]: DEBUG nova.compute.manager [req-b36b1e65-8628-4ebb-8f71-a05450af562b req-b2524bb7-07e7-4d75-b2c4-93ef94ea5bb8 service nova] [instance: 83670c16-3566-4679-8e74-c6451c840315] Received event network-changed-71be4c62-7219-45ca-8047-ab6716b37f6a {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:15:36 user nova-compute[73572]: DEBUG nova.compute.manager [req-b36b1e65-8628-4ebb-8f71-a05450af562b req-b2524bb7-07e7-4d75-b2c4-93ef94ea5bb8 service nova] [instance: 83670c16-3566-4679-8e74-c6451c840315] Refreshing instance network info cache due to event network-changed-71be4c62-7219-45ca-8047-ab6716b37f6a. {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 10:15:36 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-b36b1e65-8628-4ebb-8f71-a05450af562b req-b2524bb7-07e7-4d75-b2c4-93ef94ea5bb8 service nova] Acquiring lock "refresh_cache-83670c16-3566-4679-8e74-c6451c840315" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:15:36 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-b36b1e65-8628-4ebb-8f71-a05450af562b req-b2524bb7-07e7-4d75-b2c4-93ef94ea5bb8 service nova] Acquired lock "refresh_cache-83670c16-3566-4679-8e74-c6451c840315" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:15:36 user nova-compute[73572]: DEBUG nova.network.neutron [req-b36b1e65-8628-4ebb-8f71-a05450af562b req-b2524bb7-07e7-4d75-b2c4-93ef94ea5bb8 service nova] [instance: 83670c16-3566-4679-8e74-c6451c840315] Refreshing network info cache for port 71be4c62-7219-45ca-8047-ab6716b37f6a {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 10:15:36 user nova-compute[73572]: DEBUG nova.compute.provider_tree [None req-f68ac4b9-b880-4ea9-80bb-5ae1072aa2e7 tempest-TestVolumeSwap-1919204229 tempest-TestVolumeSwap-1919204229-project-member] Inventory has not changed in ProviderTree for provider: e2cec974-59b2-4c77-a53d-a7f4e5a30d75 {{(pid=73572) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 10:15:36 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-f68ac4b9-b880-4ea9-80bb-5ae1072aa2e7 tempest-TestVolumeSwap-1919204229 tempest-TestVolumeSwap-1919204229-project-member] Inventory has not changed for provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73572) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 10:15:36 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-6cda5169-8360-44bf-b3c1-3c4e62b0831c tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json" returned: 0 in 0.237s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:15:36 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-6cda5169-8360-44bf-b3c1-3c4e62b0831c tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Acquiring lock "2099350d6f3bcd0de9471c73862d4fe75b049801" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:15:36 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-6cda5169-8360-44bf-b3c1-3c4e62b0831c tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Lock "2099350d6f3bcd0de9471c73862d4fe75b049801" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:15:36 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-6cda5169-8360-44bf-b3c1-3c4e62b0831c tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:15:36 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-f68ac4b9-b880-4ea9-80bb-5ae1072aa2e7 tempest-TestVolumeSwap-1919204229 tempest-TestVolumeSwap-1919204229-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.685s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:15:36 user nova-compute[73572]: INFO nova.scheduler.client.report [None req-f68ac4b9-b880-4ea9-80bb-5ae1072aa2e7 tempest-TestVolumeSwap-1919204229 tempest-TestVolumeSwap-1919204229-project-member] Deleted allocations for instance d2a731d2-13ff-49e5-ab17-80686b622df7
Aug 26 10:15:36 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-6cda5169-8360-44bf-b3c1-3c4e62b0831c tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json" returned: 0 in 0.225s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:15:36 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-6cda5169-8360-44bf-b3c1-3c4e62b0831c tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801,backing_fmt=raw /opt/stack/data/nova/instances/0fe47a17-4ffb-48ce-b0f6-a9b43002bd55/disk 1073741824 {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:15:36 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-f68ac4b9-b880-4ea9-80bb-5ae1072aa2e7 tempest-TestVolumeSwap-1919204229 tempest-TestVolumeSwap-1919204229-project-member] Lock "d2a731d2-13ff-49e5-ab17-80686b622df7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.903s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:15:36 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-6cda5169-8360-44bf-b3c1-3c4e62b0831c tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801,backing_fmt=raw /opt/stack/data/nova/instances/0fe47a17-4ffb-48ce-b0f6-a9b43002bd55/disk 1073741824" returned: 0 in 0.073s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:15:36 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-6cda5169-8360-44bf-b3c1-3c4e62b0831c tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Lock "2099350d6f3bcd0de9471c73862d4fe75b049801" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.301s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:15:36 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-6cda5169-8360-44bf-b3c1-3c4e62b0831c tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:15:36 user nova-compute[73572]: DEBUG nova.virt.driver [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Emitting event <LifecycleEvent: 1693044936.6704876, d2970584-8c2a-4f99-922c-d66d59489504 => Resumed> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:15:36 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: d2970584-8c2a-4f99-922c-d66d59489504] VM Resumed (Lifecycle Event)
Aug 26 10:15:36 user nova-compute[73572]: DEBUG nova.compute.manager [None req-55ab0eb2-9bf3-48be-8900-44bbfc4ca36f tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] [instance: d2970584-8c2a-4f99-922c-d66d59489504] Instance event wait completed in 0 seconds for  {{(pid=73572) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 10:15:36 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-55ab0eb2-9bf3-48be-8900-44bbfc4ca36f tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] [instance: d2970584-8c2a-4f99-922c-d66d59489504] Guest created on hypervisor {{(pid=73572) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 10:15:36 user nova-compute[73572]: INFO nova.virt.libvirt.driver [-] [instance: d2970584-8c2a-4f99-922c-d66d59489504] Instance spawned successfully.
Aug 26 10:15:36 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-55ab0eb2-9bf3-48be-8900-44bbfc4ca36f tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] [instance: d2970584-8c2a-4f99-922c-d66d59489504] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 10:15:36 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-6cda5169-8360-44bf-b3c1-3c4e62b0831c tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json" returned: 0 in 0.192s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:15:36 user nova-compute[73572]: DEBUG nova.virt.disk.api [None req-6cda5169-8360-44bf-b3c1-3c4e62b0831c tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0fe47a17-4ffb-48ce-b0f6-a9b43002bd55/disk. size=1073741824 {{(pid=73572) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 10:15:36 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-6cda5169-8360-44bf-b3c1-3c4e62b0831c tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fe47a17-4ffb-48ce-b0f6-a9b43002bd55/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:15:36 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: d2970584-8c2a-4f99-922c-d66d59489504] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:15:36 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-55ab0eb2-9bf3-48be-8900-44bbfc4ca36f tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] [instance: d2970584-8c2a-4f99-922c-d66d59489504] Found default for hw_cdrom_bus of ide {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:15:36 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-55ab0eb2-9bf3-48be-8900-44bbfc4ca36f tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] [instance: d2970584-8c2a-4f99-922c-d66d59489504] Found default for hw_disk_bus of virtio {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:15:36 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-55ab0eb2-9bf3-48be-8900-44bbfc4ca36f tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] [instance: d2970584-8c2a-4f99-922c-d66d59489504] Found default for hw_input_bus of None {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:15:36 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-55ab0eb2-9bf3-48be-8900-44bbfc4ca36f tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] [instance: d2970584-8c2a-4f99-922c-d66d59489504] Found default for hw_pointer_model of None {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:15:36 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-55ab0eb2-9bf3-48be-8900-44bbfc4ca36f tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] [instance: d2970584-8c2a-4f99-922c-d66d59489504] Found default for hw_video_model of virtio {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:15:36 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-55ab0eb2-9bf3-48be-8900-44bbfc4ca36f tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] [instance: d2970584-8c2a-4f99-922c-d66d59489504] Found default for hw_vif_model of virtio {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:15:36 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: d2970584-8c2a-4f99-922c-d66d59489504] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73572) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 10:15:36 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: d2970584-8c2a-4f99-922c-d66d59489504] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 10:15:36 user nova-compute[73572]: DEBUG nova.virt.driver [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Emitting event <LifecycleEvent: 1693044936.6744697, d2970584-8c2a-4f99-922c-d66d59489504 => Started> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:15:36 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: d2970584-8c2a-4f99-922c-d66d59489504] VM Started (Lifecycle Event)
Aug 26 10:15:36 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-6cda5169-8360-44bf-b3c1-3c4e62b0831c tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fe47a17-4ffb-48ce-b0f6-a9b43002bd55/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:15:36 user nova-compute[73572]: DEBUG nova.virt.disk.api [None req-6cda5169-8360-44bf-b3c1-3c4e62b0831c tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Cannot resize image /opt/stack/data/nova/instances/0fe47a17-4ffb-48ce-b0f6-a9b43002bd55/disk to a smaller size. {{(pid=73572) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 10:15:36 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-6cda5169-8360-44bf-b3c1-3c4e62b0831c tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] [instance: 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55] Created local disks {{(pid=73572) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 10:15:36 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-6cda5169-8360-44bf-b3c1-3c4e62b0831c tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] [instance: 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55] Ensure instance console log exists: /opt/stack/data/nova/instances/0fe47a17-4ffb-48ce-b0f6-a9b43002bd55/console.log {{(pid=73572) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 10:15:36 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-6cda5169-8360-44bf-b3c1-3c4e62b0831c tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:15:36 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-6cda5169-8360-44bf-b3c1-3c4e62b0831c tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:15:36 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-6cda5169-8360-44bf-b3c1-3c4e62b0831c tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:15:36 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: d2970584-8c2a-4f99-922c-d66d59489504] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:15:36 user nova-compute[73572]: INFO nova.compute.manager [None req-55ab0eb2-9bf3-48be-8900-44bbfc4ca36f tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] [instance: d2970584-8c2a-4f99-922c-d66d59489504] Took 12.59 seconds to spawn the instance on the hypervisor.
Aug 26 10:15:36 user nova-compute[73572]: DEBUG nova.compute.manager [None req-55ab0eb2-9bf3-48be-8900-44bbfc4ca36f tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] [instance: d2970584-8c2a-4f99-922c-d66d59489504] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:15:36 user nova-compute[73572]: DEBUG nova.network.neutron [req-b36b1e65-8628-4ebb-8f71-a05450af562b req-b2524bb7-07e7-4d75-b2c4-93ef94ea5bb8 service nova] [instance: 83670c16-3566-4679-8e74-c6451c840315] Updated VIF entry in instance network info cache for port 71be4c62-7219-45ca-8047-ab6716b37f6a. {{(pid=73572) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 10:15:36 user nova-compute[73572]: DEBUG nova.network.neutron [req-b36b1e65-8628-4ebb-8f71-a05450af562b req-b2524bb7-07e7-4d75-b2c4-93ef94ea5bb8 service nova] [instance: 83670c16-3566-4679-8e74-c6451c840315] Updating instance_info_cache with network_info: [{"id": "71be4c62-7219-45ca-8047-ab6716b37f6a", "address": "fa:16:3e:5b:5d:84", "network": {"id": "0a1bb03e-917c-4df5-84cc-bd7729b69ab6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-258329362-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9de7931c97d448eaa26d295386b3a999", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71be4c62-72", "ovs_interfaceid": "71be4c62-7219-45ca-8047-ab6716b37f6a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "84bf04a4-b563-48c5-aa73-5b54cbb4887f", "address": "fa:16:3e:e2:c6:ae", "network": {"id": "e194b396-7c3f-41f3-99b2-f82b55c779f2", "bridge": "br-int", "label": "tempest-device-tagging-net1-1768943373", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.226", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9de7931c97d448eaa26d295386b3a999", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84bf04a4-b5", "ovs_interfaceid": "84bf04a4-b563-48c5-aa73-5b54cbb4887f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f4d684f0-2fe0-46e6-8f84-e2c0918a5a82", "address": "fa:16:3e:a6:7f:bd", "network": {"id": "e194b396-7c3f-41f3-99b2-f82b55c779f2", "bridge": "br-int", "label": "tempest-device-tagging-net1-1768943373", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.191", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9de7931c97d448eaa26d295386b3a999", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4d684f0-2f", "ovs_interfaceid": "f4d684f0-2fe0-46e6-8f84-e2c0918a5a82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "41a7ee04-5b67-4da6-a543-0d15187e5813", "address": "fa:16:3e:32:50:ef", "network": {"id": "e194b396-7c3f-41f3-99b2-f82b55c779f2", "bridge": "br-int", "label": "tempest-device-tagging-net1-1768943373", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.158", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9de7931c97d448eaa26d295386b3a999", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41a7ee04-5b", "ovs_interfaceid": "41a7ee04-5b67-4da6-a543-0d15187e5813", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "422eb7ef-4540-462b-a485-afdc38ebccd0", "address": "fa:16:3e:79:44:99", "network": {"id": "e194b396-7c3f-41f3-99b2-f82b55c779f2", "bridge": "br-int", "label": "tempest-device-tagging-net1-1768943373", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9de7931c97d448eaa26d295386b3a999", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap422eb7ef-45", "ovs_interfaceid": "422eb7ef-4540-462b-a485-afdc38ebccd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5e85b3cc-9fe4-46aa-a43f-d4acc5ca3c73", "address": "fa:16:3e:fd:33:d1", "network": {"id": "2cfbe057-f10f-4b28-b3bf-98b2ef5103d7", "bridge": "br-int", "label": "tempest-device-tagging-net2-598168548", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9de7931c97d448eaa26d295386b3a999", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e85b3cc-9f", "ovs_interfaceid": "5e85b3cc-9fe4-46aa-a43f-d4acc5ca3c73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7b7b7362-9dcc-48da-ad4e-9141c676839e", "address": "fa:16:3e:0b:b5:3a", "network": {"id": "2cfbe057-f10f-4b28-b3bf-98b2ef5103d7", "bridge": "br-int", "label": "tempest-device-tagging-net2-598168548", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9de7931c97d448eaa26d295386b3a999", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b7b7362-9d", "ovs_interfaceid": "7b7b7362-9dcc-48da-ad4e-9141c676839e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:15:36 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: d2970584-8c2a-4f99-922c-d66d59489504] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73572) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 10:15:36 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-b36b1e65-8628-4ebb-8f71-a05450af562b req-b2524bb7-07e7-4d75-b2c4-93ef94ea5bb8 service nova] Releasing lock "refresh_cache-83670c16-3566-4679-8e74-c6451c840315" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:15:36 user nova-compute[73572]: DEBUG nova.network.neutron [None req-6cda5169-8360-44bf-b3c1-3c4e62b0831c tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] [instance: 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55] Successfully created port: ebf9f385-e59b-4060-9bf9-a8d2006327b4 {{(pid=73572) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 10:15:36 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: d2970584-8c2a-4f99-922c-d66d59489504] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 10:15:37 user nova-compute[73572]: INFO nova.compute.manager [None req-55ab0eb2-9bf3-48be-8900-44bbfc4ca36f tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] [instance: d2970584-8c2a-4f99-922c-d66d59489504] Took 13.80 seconds to build instance.
Aug 26 10:15:37 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-55ab0eb2-9bf3-48be-8900-44bbfc4ca36f tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Lock "d2970584-8c2a-4f99-922c-d66d59489504" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.909s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:15:37 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Removed pending event for c555f971-b177-4c26-a38e-09e0e78bf7b9 due to event {{(pid=73572) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 26 10:15:37 user nova-compute[73572]: DEBUG nova.virt.driver [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Emitting event <LifecycleEvent: 1693044937.1358724, c555f971-b177-4c26-a38e-09e0e78bf7b9 => Resumed> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:15:37 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: c555f971-b177-4c26-a38e-09e0e78bf7b9] VM Resumed (Lifecycle Event)
Aug 26 10:15:37 user nova-compute[73572]: DEBUG nova.compute.manager [None req-4fe848ab-8dca-44c9-9fc4-07ef3901e2b0 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] [instance: c555f971-b177-4c26-a38e-09e0e78bf7b9] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:15:37 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: c555f971-b177-4c26-a38e-09e0e78bf7b9] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:15:37 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: c555f971-b177-4c26-a38e-09e0e78bf7b9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73572) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 10:15:37 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: c555f971-b177-4c26-a38e-09e0e78bf7b9] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 26 10:15:37 user nova-compute[73572]: DEBUG nova.virt.driver [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Emitting event <LifecycleEvent: 1693044937.1366942, c555f971-b177-4c26-a38e-09e0e78bf7b9 => Started> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:15:37 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: c555f971-b177-4c26-a38e-09e0e78bf7b9] VM Started (Lifecycle Event)
Aug 26 10:15:37 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: c555f971-b177-4c26-a38e-09e0e78bf7b9] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:15:37 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: c555f971-b177-4c26-a38e-09e0e78bf7b9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73572) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 10:15:37 user nova-compute[73572]: DEBUG nova.compute.manager [req-1a0bd4e2-0510-4292-82b2-40ec57a19ba8 req-807087e3-8e9c-4b4e-8dff-61dca4535474 service nova] [instance: 14fab12e-52be-4fe6-8777-bc7ebf3c25f1] Received event network-vif-plugged-1b2121f4-88b1-4815-9329-3c9e3172a2f6 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:15:37 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-1a0bd4e2-0510-4292-82b2-40ec57a19ba8 req-807087e3-8e9c-4b4e-8dff-61dca4535474 service nova] Acquiring lock "14fab12e-52be-4fe6-8777-bc7ebf3c25f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:15:37 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-1a0bd4e2-0510-4292-82b2-40ec57a19ba8 req-807087e3-8e9c-4b4e-8dff-61dca4535474 service nova] Lock "14fab12e-52be-4fe6-8777-bc7ebf3c25f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:15:37 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-1a0bd4e2-0510-4292-82b2-40ec57a19ba8 req-807087e3-8e9c-4b4e-8dff-61dca4535474 service nova] Lock "14fab12e-52be-4fe6-8777-bc7ebf3c25f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:15:37 user nova-compute[73572]: DEBUG nova.compute.manager [req-1a0bd4e2-0510-4292-82b2-40ec57a19ba8 req-807087e3-8e9c-4b4e-8dff-61dca4535474 service nova] [instance: 14fab12e-52be-4fe6-8777-bc7ebf3c25f1] No waiting events found dispatching network-vif-plugged-1b2121f4-88b1-4815-9329-3c9e3172a2f6 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:15:37 user nova-compute[73572]: WARNING nova.compute.manager [req-1a0bd4e2-0510-4292-82b2-40ec57a19ba8 req-807087e3-8e9c-4b4e-8dff-61dca4535474 service nova] [instance: 14fab12e-52be-4fe6-8777-bc7ebf3c25f1] Received unexpected event network-vif-plugged-1b2121f4-88b1-4815-9329-3c9e3172a2f6 for instance with vm_state building and task_state spawning.
Aug 26 10:15:37 user nova-compute[73572]: DEBUG nova.compute.manager [req-1a0bd4e2-0510-4292-82b2-40ec57a19ba8 req-807087e3-8e9c-4b4e-8dff-61dca4535474 service nova] [instance: 14fab12e-52be-4fe6-8777-bc7ebf3c25f1] Received event network-vif-plugged-1b2121f4-88b1-4815-9329-3c9e3172a2f6 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:15:37 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-1a0bd4e2-0510-4292-82b2-40ec57a19ba8 req-807087e3-8e9c-4b4e-8dff-61dca4535474 service nova] Acquiring lock "14fab12e-52be-4fe6-8777-bc7ebf3c25f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:15:37 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-1a0bd4e2-0510-4292-82b2-40ec57a19ba8 req-807087e3-8e9c-4b4e-8dff-61dca4535474 service nova] Lock "14fab12e-52be-4fe6-8777-bc7ebf3c25f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:15:37 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-1a0bd4e2-0510-4292-82b2-40ec57a19ba8 req-807087e3-8e9c-4b4e-8dff-61dca4535474 service nova] Lock "14fab12e-52be-4fe6-8777-bc7ebf3c25f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:15:37 user nova-compute[73572]: DEBUG nova.compute.manager [req-1a0bd4e2-0510-4292-82b2-40ec57a19ba8 req-807087e3-8e9c-4b4e-8dff-61dca4535474 service nova] [instance: 14fab12e-52be-4fe6-8777-bc7ebf3c25f1] No waiting events found dispatching network-vif-plugged-1b2121f4-88b1-4815-9329-3c9e3172a2f6 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:15:37 user nova-compute[73572]: WARNING nova.compute.manager [req-1a0bd4e2-0510-4292-82b2-40ec57a19ba8 req-807087e3-8e9c-4b4e-8dff-61dca4535474 service nova] [instance: 14fab12e-52be-4fe6-8777-bc7ebf3c25f1] Received unexpected event network-vif-plugged-1b2121f4-88b1-4815-9329-3c9e3172a2f6 for instance with vm_state building and task_state spawning.
Aug 26 10:15:37 user nova-compute[73572]: DEBUG nova.compute.manager [req-ad70e5c3-a3be-45d3-8e66-1d80103bf113 req-52100c4f-0e7c-4a87-87bb-df07e826c644 service nova] [instance: c555f971-b177-4c26-a38e-09e0e78bf7b9] Received event network-vif-plugged-4ffb7229-16fb-441b-a954-d91308071fb8 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:15:37 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-ad70e5c3-a3be-45d3-8e66-1d80103bf113 req-52100c4f-0e7c-4a87-87bb-df07e826c644 service nova] Acquiring lock "c555f971-b177-4c26-a38e-09e0e78bf7b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:15:37 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-ad70e5c3-a3be-45d3-8e66-1d80103bf113 req-52100c4f-0e7c-4a87-87bb-df07e826c644 service nova] Lock "c555f971-b177-4c26-a38e-09e0e78bf7b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:15:37 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-ad70e5c3-a3be-45d3-8e66-1d80103bf113 req-52100c4f-0e7c-4a87-87bb-df07e826c644 service nova] Lock "c555f971-b177-4c26-a38e-09e0e78bf7b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:15:37 user nova-compute[73572]: DEBUG nova.compute.manager [req-ad70e5c3-a3be-45d3-8e66-1d80103bf113 req-52100c4f-0e7c-4a87-87bb-df07e826c644 service nova] [instance: c555f971-b177-4c26-a38e-09e0e78bf7b9] No waiting events found dispatching network-vif-plugged-4ffb7229-16fb-441b-a954-d91308071fb8 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:15:37 user nova-compute[73572]: WARNING nova.compute.manager [req-ad70e5c3-a3be-45d3-8e66-1d80103bf113 req-52100c4f-0e7c-4a87-87bb-df07e826c644 service nova] [instance: c555f971-b177-4c26-a38e-09e0e78bf7b9] Received unexpected event network-vif-plugged-4ffb7229-16fb-441b-a954-d91308071fb8 for instance with vm_state rescued and task_state None.
Aug 26 10:15:37 user nova-compute[73572]: DEBUG nova.compute.manager [req-ad70e5c3-a3be-45d3-8e66-1d80103bf113 req-52100c4f-0e7c-4a87-87bb-df07e826c644 service nova] [instance: c555f971-b177-4c26-a38e-09e0e78bf7b9] Received event network-vif-plugged-4ffb7229-16fb-441b-a954-d91308071fb8 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:15:37 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-ad70e5c3-a3be-45d3-8e66-1d80103bf113 req-52100c4f-0e7c-4a87-87bb-df07e826c644 service nova] Acquiring lock "c555f971-b177-4c26-a38e-09e0e78bf7b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:15:37 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-ad70e5c3-a3be-45d3-8e66-1d80103bf113 req-52100c4f-0e7c-4a87-87bb-df07e826c644 service nova] Lock "c555f971-b177-4c26-a38e-09e0e78bf7b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:15:37 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-ad70e5c3-a3be-45d3-8e66-1d80103bf113 req-52100c4f-0e7c-4a87-87bb-df07e826c644 service nova] Lock "c555f971-b177-4c26-a38e-09e0e78bf7b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:15:37 user nova-compute[73572]: DEBUG nova.compute.manager [req-ad70e5c3-a3be-45d3-8e66-1d80103bf113 req-52100c4f-0e7c-4a87-87bb-df07e826c644 service nova] [instance: c555f971-b177-4c26-a38e-09e0e78bf7b9] No waiting events found dispatching network-vif-plugged-4ffb7229-16fb-441b-a954-d91308071fb8 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:15:37 user nova-compute[73572]: WARNING nova.compute.manager [req-ad70e5c3-a3be-45d3-8e66-1d80103bf113 req-52100c4f-0e7c-4a87-87bb-df07e826c644 service nova] [instance: c555f971-b177-4c26-a38e-09e0e78bf7b9] Received unexpected event network-vif-plugged-4ffb7229-16fb-441b-a954-d91308071fb8 for instance with vm_state rescued and task_state None.
Aug 26 10:15:37 user nova-compute[73572]: DEBUG nova.virt.driver [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Emitting event <LifecycleEvent: 1693044937.531074, 14fab12e-52be-4fe6-8777-bc7ebf3c25f1 => Resumed> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:15:37 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 14fab12e-52be-4fe6-8777-bc7ebf3c25f1] VM Resumed (Lifecycle Event)
Aug 26 10:15:37 user nova-compute[73572]: DEBUG nova.compute.manager [None req-1e258a7f-6e52-41d1-bc86-d49c3d8692c9 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: 14fab12e-52be-4fe6-8777-bc7ebf3c25f1] Instance event wait completed in 0 seconds for  {{(pid=73572) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 10:15:37 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-1e258a7f-6e52-41d1-bc86-d49c3d8692c9 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: 14fab12e-52be-4fe6-8777-bc7ebf3c25f1] Guest created on hypervisor {{(pid=73572) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 10:15:37 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 14fab12e-52be-4fe6-8777-bc7ebf3c25f1] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:15:37 user nova-compute[73572]: INFO nova.virt.libvirt.driver [-] [instance: 14fab12e-52be-4fe6-8777-bc7ebf3c25f1] Instance spawned successfully.
Aug 26 10:15:37 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-1e258a7f-6e52-41d1-bc86-d49c3d8692c9 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: 14fab12e-52be-4fe6-8777-bc7ebf3c25f1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 10:15:37 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 14fab12e-52be-4fe6-8777-bc7ebf3c25f1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73572) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 10:15:37 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-1e258a7f-6e52-41d1-bc86-d49c3d8692c9 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: 14fab12e-52be-4fe6-8777-bc7ebf3c25f1] Found default for hw_cdrom_bus of ide {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:15:37 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-1e258a7f-6e52-41d1-bc86-d49c3d8692c9 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: 14fab12e-52be-4fe6-8777-bc7ebf3c25f1] Found default for hw_disk_bus of virtio {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:15:37 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-1e258a7f-6e52-41d1-bc86-d49c3d8692c9 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: 14fab12e-52be-4fe6-8777-bc7ebf3c25f1] Found default for hw_input_bus of None {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:15:37 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-1e258a7f-6e52-41d1-bc86-d49c3d8692c9 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: 14fab12e-52be-4fe6-8777-bc7ebf3c25f1] Found default for hw_pointer_model of None {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:15:37 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-1e258a7f-6e52-41d1-bc86-d49c3d8692c9 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: 14fab12e-52be-4fe6-8777-bc7ebf3c25f1] Found default for hw_video_model of virtio {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:15:37 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-1e258a7f-6e52-41d1-bc86-d49c3d8692c9 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: 14fab12e-52be-4fe6-8777-bc7ebf3c25f1] Found default for hw_vif_model of virtio {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:15:37 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 14fab12e-52be-4fe6-8777-bc7ebf3c25f1] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 10:15:37 user nova-compute[73572]: DEBUG nova.virt.driver [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Emitting event <LifecycleEvent: 1693044937.5322292, 14fab12e-52be-4fe6-8777-bc7ebf3c25f1 => Started> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:15:37 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 14fab12e-52be-4fe6-8777-bc7ebf3c25f1] VM Started (Lifecycle Event)
Aug 26 10:15:37 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 14fab12e-52be-4fe6-8777-bc7ebf3c25f1] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:15:37 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 14fab12e-52be-4fe6-8777-bc7ebf3c25f1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73572) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 10:15:37 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 14fab12e-52be-4fe6-8777-bc7ebf3c25f1] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 10:15:37 user nova-compute[73572]: INFO nova.compute.manager [None req-1e258a7f-6e52-41d1-bc86-d49c3d8692c9 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: 14fab12e-52be-4fe6-8777-bc7ebf3c25f1] Took 6.15 seconds to spawn the instance on the hypervisor.
Aug 26 10:15:37 user nova-compute[73572]: DEBUG nova.compute.manager [None req-1e258a7f-6e52-41d1-bc86-d49c3d8692c9 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: 14fab12e-52be-4fe6-8777-bc7ebf3c25f1] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:15:37 user nova-compute[73572]: INFO nova.compute.manager [None req-1e258a7f-6e52-41d1-bc86-d49c3d8692c9 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: 14fab12e-52be-4fe6-8777-bc7ebf3c25f1] Took 26.56 seconds to build instance.
Aug 26 10:15:37 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-1e258a7f-6e52-41d1-bc86-d49c3d8692c9 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Lock "14fab12e-52be-4fe6-8777-bc7ebf3c25f1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 26.696s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:15:37 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-6176f596-4265-4ead-b93e-207ce53a4e2e tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] Acquiring lock "83670c16-3566-4679-8e74-c6451c840315" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:15:37 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-6176f596-4265-4ead-b93e-207ce53a4e2e tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] Lock "83670c16-3566-4679-8e74-c6451c840315" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:15:37 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-6176f596-4265-4ead-b93e-207ce53a4e2e tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] Acquiring lock "83670c16-3566-4679-8e74-c6451c840315-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:15:37 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-6176f596-4265-4ead-b93e-207ce53a4e2e tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] Lock "83670c16-3566-4679-8e74-c6451c840315-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:15:37 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-6176f596-4265-4ead-b93e-207ce53a4e2e tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] Lock "83670c16-3566-4679-8e74-c6451c840315-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:15:37 user nova-compute[73572]: INFO nova.compute.manager [None req-6176f596-4265-4ead-b93e-207ce53a4e2e tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] [instance: 83670c16-3566-4679-8e74-c6451c840315] Terminating instance
Aug 26 10:15:37 user nova-compute[73572]: DEBUG nova.compute.manager [None req-6176f596-4265-4ead-b93e-207ce53a4e2e tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] [instance: 83670c16-3566-4679-8e74-c6451c840315] Start destroying the instance on the hypervisor. {{(pid=73572) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 10:15:38 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:15:38 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:15:38 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:15:38 user nova-compute[73572]: DEBUG nova.network.neutron [None req-6cda5169-8360-44bf-b3c1-3c4e62b0831c tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] [instance: 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55] Successfully updated port: ebf9f385-e59b-4060-9bf9-a8d2006327b4 {{(pid=73572) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 10:15:38 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-6cda5169-8360-44bf-b3c1-3c4e62b0831c tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Acquiring lock "refresh_cache-0fe47a17-4ffb-48ce-b0f6-a9b43002bd55" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:15:38 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-6cda5169-8360-44bf-b3c1-3c4e62b0831c tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Acquired lock "refresh_cache-0fe47a17-4ffb-48ce-b0f6-a9b43002bd55" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:15:38 user nova-compute[73572]: DEBUG nova.network.neutron [None req-6cda5169-8360-44bf-b3c1-3c4e62b0831c tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] [instance: 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55] Building network info cache for instance {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 10:15:38 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:15:38 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:15:38 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:15:38 user nova-compute[73572]: DEBUG nova.network.neutron [None req-6cda5169-8360-44bf-b3c1-3c4e62b0831c tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] [instance: 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55] Instance cache missing network info. {{(pid=73572) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 10:15:38 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:15:38 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:15:38 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:15:38 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:15:38 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:15:38 user nova-compute[73572]: DEBUG nova.compute.manager [req-7d467428-9f22-4ba8-9d4c-7bf7aaaff3fa req-03ee86e7-53a1-4e34-8982-0dfb2b359821 service nova] [instance: 83670c16-3566-4679-8e74-c6451c840315] Received event network-vif-unplugged-71be4c62-7219-45ca-8047-ab6716b37f6a {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:15:38 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-7d467428-9f22-4ba8-9d4c-7bf7aaaff3fa req-03ee86e7-53a1-4e34-8982-0dfb2b359821 service nova] Acquiring lock "83670c16-3566-4679-8e74-c6451c840315-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:15:38 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-7d467428-9f22-4ba8-9d4c-7bf7aaaff3fa req-03ee86e7-53a1-4e34-8982-0dfb2b359821 service nova] Lock "83670c16-3566-4679-8e74-c6451c840315-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:15:38 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-7d467428-9f22-4ba8-9d4c-7bf7aaaff3fa req-03ee86e7-53a1-4e34-8982-0dfb2b359821 service nova] Lock "83670c16-3566-4679-8e74-c6451c840315-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:15:38 user nova-compute[73572]: DEBUG nova.compute.manager [req-7d467428-9f22-4ba8-9d4c-7bf7aaaff3fa req-03ee86e7-53a1-4e34-8982-0dfb2b359821 service nova] [instance: 83670c16-3566-4679-8e74-c6451c840315] No waiting events found dispatching network-vif-unplugged-71be4c62-7219-45ca-8047-ab6716b37f6a {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:15:38 user nova-compute[73572]: DEBUG nova.compute.manager [req-7d467428-9f22-4ba8-9d4c-7bf7aaaff3fa req-03ee86e7-53a1-4e34-8982-0dfb2b359821 service nova] [instance: 83670c16-3566-4679-8e74-c6451c840315] Received event network-vif-unplugged-71be4c62-7219-45ca-8047-ab6716b37f6a for instance with task_state deleting. {{(pid=73572) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 10:15:38 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:15:38 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:15:38 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:15:38 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:15:38 user nova-compute[73572]: DEBUG nova.network.neutron [None req-6cda5169-8360-44bf-b3c1-3c4e62b0831c tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] [instance: 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55] Updating instance_info_cache with network_info: [{"id": "ebf9f385-e59b-4060-9bf9-a8d2006327b4", "address": "fa:16:3e:49:23:6a", "network": {"id": "7c89c22a-96d4-4e60-9c4c-b5a82a7eca55", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1976182948-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d2c922711fb445aa99ae4f30b802c12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebf9f385-e5", "ovs_interfaceid": "ebf9f385-e59b-4060-9bf9-a8d2006327b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:15:38 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:15:38 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-6cda5169-8360-44bf-b3c1-3c4e62b0831c tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Releasing lock "refresh_cache-0fe47a17-4ffb-48ce-b0f6-a9b43002bd55" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:15:38 user nova-compute[73572]: DEBUG nova.compute.manager [None req-6cda5169-8360-44bf-b3c1-3c4e62b0831c tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] [instance: 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55] Instance network_info: |[{"id": "ebf9f385-e59b-4060-9bf9-a8d2006327b4", "address": "fa:16:3e:49:23:6a", "network": {"id": "7c89c22a-96d4-4e60-9c4c-b5a82a7eca55", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1976182948-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d2c922711fb445aa99ae4f30b802c12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebf9f385-e5", "ovs_interfaceid": "ebf9f385-e59b-4060-9bf9-a8d2006327b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73572) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 10:15:38 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-6cda5169-8360-44bf-b3c1-3c4e62b0831c tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] [instance: 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55] Start _get_guest_xml network_info=[{"id": "ebf9f385-e59b-4060-9bf9-a8d2006327b4", "address": "fa:16:3e:49:23:6a", "network": {"id": "7c89c22a-96d4-4e60-9c4c-b5a82a7eca55", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1976182948-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d2c922711fb445aa99ae4f30b802c12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebf9f385-e5", "ovs_interfaceid": "ebf9f385-e59b-4060-9bf9-a8d2006327b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T10:07:33Z,direct_url=<?>,disk_format='qcow2',id=299da0c9-e1c4-48f0-be55-fbe20dd06bc9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5c995f8bbbab4368b67a253e0df3971a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T10:07:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'guest_format': None, 'size': 0, 'encryption_format': None, 'device_type': 'disk', 'image_id': '299da0c9-e1c4-48f0-be55-fbe20dd06bc9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73572) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 10:15:38 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-6cda5169-8360-44bf-b3c1-3c4e62b0831c tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:15:38 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-6cda5169-8360-44bf-b3c1-3c4e62b0831c tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:15:38 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:15:38 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-6cda5169-8360-44bf-b3c1-3c4e62b0831c tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73572) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 10:15:38 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-6cda5169-8360-44bf-b3c1-3c4e62b0831c tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] CPU controller missing on host. {{(pid=73572) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 10:15:38 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-6cda5169-8360-44bf-b3c1-3c4e62b0831c tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73572) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 10:15:38 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-6cda5169-8360-44bf-b3c1-3c4e62b0831c tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] CPU controller found on host. {{(pid=73572) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 10:15:38 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-6cda5169-8360-44bf-b3c1-3c4e62b0831c tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73572) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 10:15:38 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-6cda5169-8360-44bf-b3c1-3c4e62b0831c tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T10:07:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T10:07:33Z,direct_url=<?>,disk_format='qcow2',id=299da0c9-e1c4-48f0-be55-fbe20dd06bc9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5c995f8bbbab4368b67a253e0df3971a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T10:07:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 10:15:38 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-6cda5169-8360-44bf-b3c1-3c4e62b0831c tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Flavor limits 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 10:15:38 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-6cda5169-8360-44bf-b3c1-3c4e62b0831c tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Image limits 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 10:15:38 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-6cda5169-8360-44bf-b3c1-3c4e62b0831c tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Flavor pref 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 10:15:38 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-6cda5169-8360-44bf-b3c1-3c4e62b0831c tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Image pref 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 10:15:38 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-6cda5169-8360-44bf-b3c1-3c4e62b0831c tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 10:15:38 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-6cda5169-8360-44bf-b3c1-3c4e62b0831c tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 10:15:38 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-6cda5169-8360-44bf-b3c1-3c4e62b0831c tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73572) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 10:15:38 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-6cda5169-8360-44bf-b3c1-3c4e62b0831c tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Got 1 possible topologies {{(pid=73572) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 10:15:38 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-6cda5169-8360-44bf-b3c1-3c4e62b0831c tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 10:15:38 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-6cda5169-8360-44bf-b3c1-3c4e62b0831c tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 10:15:38 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-6cda5169-8360-44bf-b3c1-3c4e62b0831c tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T10:15:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-220365578',display_name='tempest-ServerActionsTestOtherB-server-220365578',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-220365578',id=17,image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNpUMyiGXRzsPFYrzC1k+DPeAQeFXKXREu1ci6G2S65T1Gci+/hLSOFjcdBoLqgENyI+7/uwXL8y2F/F10thQC08ST7hXeII35W/K66MHhxc0L254FUOJIzPARZXOsUESA==',key_name='tempest-keypair-2095276623',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0d2c922711fb445aa99ae4f30b802c12',ramdisk_id='',reservation_id='r-ktz04i2y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1806914349',owner_user_name='tempest-ServerActionsTestOtherB-1806914349-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T10:15:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0ee7e4a9f7db476eb9f16440c6b8e37e',uuid=0fe47a17-4ffb-48ce-b0f6-a9b43002bd55,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ebf9f385-e59b-4060-9bf9-a8d2006327b4", "address": "fa:16:3e:49:23:6a", "network": {"id": "7c89c22a-96d4-4e60-9c4c-b5a82a7eca55", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1976182948-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d2c922711fb445aa99ae4f30b802c12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebf9f385-e5", "ovs_interfaceid": "ebf9f385-e59b-4060-9bf9-a8d2006327b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73572) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 10:15:38 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-6cda5169-8360-44bf-b3c1-3c4e62b0831c tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Converting VIF {"id": "ebf9f385-e59b-4060-9bf9-a8d2006327b4", "address": "fa:16:3e:49:23:6a", "network": {"id": "7c89c22a-96d4-4e60-9c4c-b5a82a7eca55", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1976182948-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d2c922711fb445aa99ae4f30b802c12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebf9f385-e5", "ovs_interfaceid": "ebf9f385-e59b-4060-9bf9-a8d2006327b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:15:38 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-6cda5169-8360-44bf-b3c1-3c4e62b0831c tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:49:23:6a,bridge_name='br-int',has_traffic_filtering=True,id=ebf9f385-e59b-4060-9bf9-a8d2006327b4,network=Network(7c89c22a-96d4-4e60-9c4c-b5a82a7eca55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebf9f385-e5') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:15:38 user nova-compute[73572]: DEBUG nova.objects.instance [None req-6cda5169-8360-44bf-b3c1-3c4e62b0831c tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Lazy-loading 'pci_devices' on Instance uuid 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55 {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:15:38 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:15:38 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-6cda5169-8360-44bf-b3c1-3c4e62b0831c tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] [instance: 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55] End _get_guest_xml xml=<domain type="kvm">
Aug 26 10:15:38 user nova-compute[73572]:   <uuid>0fe47a17-4ffb-48ce-b0f6-a9b43002bd55</uuid>
Aug 26 10:15:38 user nova-compute[73572]:   <name>instance-00000011</name>
Aug 26 10:15:38 user nova-compute[73572]:   <memory>524288</memory>
Aug 26 10:15:38 user nova-compute[73572]:   <vcpu>1</vcpu>
Aug 26 10:15:38 user nova-compute[73572]:   <metadata>
Aug 26 10:15:38 user nova-compute[73572]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 10:15:38 user nova-compute[73572]:       <nova:package version="0.0.0"/>
Aug 26 10:15:38 user nova-compute[73572]:       <nova:name>tempest-ServerActionsTestOtherB-server-220365578</nova:name>
Aug 26 10:15:38 user nova-compute[73572]:       <nova:creationTime>2023-08-26 10:15:38</nova:creationTime>
Aug 26 10:15:38 user nova-compute[73572]:       <nova:flavor name="m1.tiny">
Aug 26 10:15:38 user nova-compute[73572]:         <nova:memory>512</nova:memory>
Aug 26 10:15:38 user nova-compute[73572]:         <nova:disk>1</nova:disk>
Aug 26 10:15:38 user nova-compute[73572]:         <nova:swap>0</nova:swap>
Aug 26 10:15:38 user nova-compute[73572]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 10:15:38 user nova-compute[73572]:         <nova:vcpus>1</nova:vcpus>
Aug 26 10:15:38 user nova-compute[73572]:       </nova:flavor>
Aug 26 10:15:38 user nova-compute[73572]:       <nova:owner>
Aug 26 10:15:38 user nova-compute[73572]:         <nova:user uuid="0ee7e4a9f7db476eb9f16440c6b8e37e">tempest-ServerActionsTestOtherB-1806914349-project-member</nova:user>
Aug 26 10:15:38 user nova-compute[73572]:         <nova:project uuid="0d2c922711fb445aa99ae4f30b802c12">tempest-ServerActionsTestOtherB-1806914349</nova:project>
Aug 26 10:15:38 user nova-compute[73572]:       </nova:owner>
Aug 26 10:15:38 user nova-compute[73572]:       <nova:root type="image" uuid="299da0c9-e1c4-48f0-be55-fbe20dd06bc9"/>
Aug 26 10:15:38 user nova-compute[73572]:       <nova:ports>
Aug 26 10:15:38 user nova-compute[73572]:         <nova:port uuid="ebf9f385-e59b-4060-9bf9-a8d2006327b4">
Aug 26 10:15:38 user nova-compute[73572]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 26 10:15:38 user nova-compute[73572]:         </nova:port>
Aug 26 10:15:38 user nova-compute[73572]:       </nova:ports>
Aug 26 10:15:38 user nova-compute[73572]:     </nova:instance>
Aug 26 10:15:38 user nova-compute[73572]:   </metadata>
Aug 26 10:15:38 user nova-compute[73572]:   <sysinfo type="smbios">
Aug 26 10:15:38 user nova-compute[73572]:     <system>
Aug 26 10:15:38 user nova-compute[73572]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 10:15:38 user nova-compute[73572]:       <entry name="product">OpenStack Nova</entry>
Aug 26 10:15:38 user nova-compute[73572]:       <entry name="version">0.0.0</entry>
Aug 26 10:15:38 user nova-compute[73572]:       <entry name="serial">0fe47a17-4ffb-48ce-b0f6-a9b43002bd55</entry>
Aug 26 10:15:38 user nova-compute[73572]:       <entry name="uuid">0fe47a17-4ffb-48ce-b0f6-a9b43002bd55</entry>
Aug 26 10:15:38 user nova-compute[73572]:       <entry name="family">Virtual Machine</entry>
Aug 26 10:15:38 user nova-compute[73572]:     </system>
Aug 26 10:15:38 user nova-compute[73572]:   </sysinfo>
Aug 26 10:15:38 user nova-compute[73572]:   <os>
Aug 26 10:15:38 user nova-compute[73572]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 10:15:38 user nova-compute[73572]:     <boot dev="hd"/>
Aug 26 10:15:38 user nova-compute[73572]:     <smbios mode="sysinfo"/>
Aug 26 10:15:38 user nova-compute[73572]:   </os>
Aug 26 10:15:38 user nova-compute[73572]:   <features>
Aug 26 10:15:38 user nova-compute[73572]:     <acpi/>
Aug 26 10:15:38 user nova-compute[73572]:     <apic/>
Aug 26 10:15:38 user nova-compute[73572]:     <vmcoreinfo/>
Aug 26 10:15:38 user nova-compute[73572]:   </features>
Aug 26 10:15:38 user nova-compute[73572]:   <clock offset="utc">
Aug 26 10:15:38 user nova-compute[73572]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 10:15:38 user nova-compute[73572]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 10:15:38 user nova-compute[73572]:     <timer name="hpet" present="no"/>
Aug 26 10:15:38 user nova-compute[73572]:   </clock>
Aug 26 10:15:38 user nova-compute[73572]:   <cpu mode="custom" match="exact">
Aug 26 10:15:38 user nova-compute[73572]:     <model>Nehalem</model>
Aug 26 10:15:38 user nova-compute[73572]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 10:15:38 user nova-compute[73572]:   </cpu>
Aug 26 10:15:38 user nova-compute[73572]:   <devices>
Aug 26 10:15:38 user nova-compute[73572]:     <disk type="file" device="disk">
Aug 26 10:15:38 user nova-compute[73572]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 10:15:38 user nova-compute[73572]:       <source file="/opt/stack/data/nova/instances/0fe47a17-4ffb-48ce-b0f6-a9b43002bd55/disk"/>
Aug 26 10:15:38 user nova-compute[73572]:       <target dev="vda" bus="virtio"/>
Aug 26 10:15:38 user nova-compute[73572]:     </disk>
Aug 26 10:15:38 user nova-compute[73572]:     <interface type="ethernet">
Aug 26 10:15:38 user nova-compute[73572]:       <mac address="fa:16:3e:49:23:6a"/>
Aug 26 10:15:38 user nova-compute[73572]:       <model type="virtio"/>
Aug 26 10:15:38 user nova-compute[73572]:       <mtu size="1442"/>
Aug 26 10:15:38 user nova-compute[73572]:       <target dev="tapebf9f385-e5"/>
Aug 26 10:15:38 user nova-compute[73572]:     </interface>
Aug 26 10:15:38 user nova-compute[73572]:     <serial type="pty">
Aug 26 10:15:38 user nova-compute[73572]:       <log file="/opt/stack/data/nova/instances/0fe47a17-4ffb-48ce-b0f6-a9b43002bd55/console.log" append="off"/>
Aug 26 10:15:38 user nova-compute[73572]:     </serial>
Aug 26 10:15:38 user nova-compute[73572]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 10:15:38 user nova-compute[73572]:     <video>
Aug 26 10:15:38 user nova-compute[73572]:       <model type="virtio"/>
Aug 26 10:15:38 user nova-compute[73572]:     </video>
Aug 26 10:15:38 user nova-compute[73572]:     <rng model="virtio">
Aug 26 10:15:38 user nova-compute[73572]:       <backend model="random">/dev/urandom</backend>
Aug 26 10:15:38 user nova-compute[73572]:     </rng>
Aug 26 10:15:38 user nova-compute[73572]:     <controller type="usb" index="0" model="none"/>
Aug 26 10:15:38 user nova-compute[73572]:     <memballoon model="virtio">
Aug 26 10:15:38 user nova-compute[73572]:       <stats period="10"/>
Aug 26 10:15:38 user nova-compute[73572]:     </memballoon>
Aug 26 10:15:38 user nova-compute[73572]:   </devices>
Aug 26 10:15:38 user nova-compute[73572]: </domain>
Aug 26 10:15:38 user nova-compute[73572]:  {{(pid=73572) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 10:15:38 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-6cda5169-8360-44bf-b3c1-3c4e62b0831c tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T10:15:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-220365578',display_name='tempest-ServerActionsTestOtherB-server-220365578',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-220365578',id=17,image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNpUMyiGXRzsPFYrzC1k+DPeAQeFXKXREu1ci6G2S65T1Gci+/hLSOFjcdBoLqgENyI+7/uwXL8y2F/F10thQC08ST7hXeII35W/K66MHhxc0L254FUOJIzPARZXOsUESA==',key_name='tempest-keypair-2095276623',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0d2c922711fb445aa99ae4f30b802c12',ramdisk_id='',reservation_id='r-ktz04i2y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1806914349',owner_user_name='tempest-ServerActionsTestOtherB-1806914349-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T10:15:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0ee7e4a9f7db476eb9f16440c6b8e37e',uuid=0fe47a17-4ffb-48ce-b0f6-a9b43002bd55,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ebf9f385-e59b-4060-9bf9-a8d2006327b4", "address": "fa:16:3e:49:23:6a", "network": {"id": "7c89c22a-96d4-4e60-9c4c-b5a82a7eca55", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1976182948-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d2c922711fb445aa99ae4f30b802c12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebf9f385-e5", "ovs_interfaceid": "ebf9f385-e59b-4060-9bf9-a8d2006327b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 10:15:38 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-6cda5169-8360-44bf-b3c1-3c4e62b0831c tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Converting VIF {"id": "ebf9f385-e59b-4060-9bf9-a8d2006327b4", "address": "fa:16:3e:49:23:6a", "network": {"id": "7c89c22a-96d4-4e60-9c4c-b5a82a7eca55", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1976182948-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d2c922711fb445aa99ae4f30b802c12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebf9f385-e5", "ovs_interfaceid": "ebf9f385-e59b-4060-9bf9-a8d2006327b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:15:38 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-6cda5169-8360-44bf-b3c1-3c4e62b0831c tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:49:23:6a,bridge_name='br-int',has_traffic_filtering=True,id=ebf9f385-e59b-4060-9bf9-a8d2006327b4,network=Network(7c89c22a-96d4-4e60-9c4c-b5a82a7eca55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebf9f385-e5') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:15:38 user nova-compute[73572]: DEBUG os_vif [None req-6cda5169-8360-44bf-b3c1-3c4e62b0831c tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:23:6a,bridge_name='br-int',has_traffic_filtering=True,id=ebf9f385-e59b-4060-9bf9-a8d2006327b4,network=Network(7c89c22a-96d4-4e60-9c4c-b5a82a7eca55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebf9f385-e5') {{(pid=73572) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 10:15:38 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:15:38 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:15:38 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 10:15:38 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:15:38 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapebf9f385-e5, may_exist=True, interface_attrs={}) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:15:38 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapebf9f385-e5, col_values=(('external_ids', {'iface-id': 'ebf9f385-e59b-4060-9bf9-a8d2006327b4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:49:23:6a', 'vm-uuid': '0fe47a17-4ffb-48ce-b0f6-a9b43002bd55'}),), if_exists=True) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:15:38 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:15:38 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:15:38 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:15:38 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:15:39 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:15:39 user nova-compute[73572]: INFO os_vif [None req-6cda5169-8360-44bf-b3c1-3c4e62b0831c tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:23:6a,bridge_name='br-int',has_traffic_filtering=True,id=ebf9f385-e59b-4060-9bf9-a8d2006327b4,network=Network(7c89c22a-96d4-4e60-9c4c-b5a82a7eca55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebf9f385-e5')
Aug 26 10:15:39 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-6cda5169-8360-44bf-b3c1-3c4e62b0831c tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] No BDM found with device name vda, not building metadata. {{(pid=73572) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 10:15:39 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-6cda5169-8360-44bf-b3c1-3c4e62b0831c tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] No VIF found with MAC fa:16:3e:49:23:6a, not building metadata {{(pid=73572) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 10:15:39 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:15:39 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:15:39 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:15:39 user nova-compute[73572]: DEBUG nova.compute.manager [req-8878164c-d221-4070-8bf2-6ea1af193e07 req-f47e5bda-e771-4f24-9134-d2fc69026e10 service nova] [instance: 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55] Received event network-changed-ebf9f385-e59b-4060-9bf9-a8d2006327b4 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:15:39 user nova-compute[73572]: DEBUG nova.compute.manager [req-8878164c-d221-4070-8bf2-6ea1af193e07 req-f47e5bda-e771-4f24-9134-d2fc69026e10 service nova] [instance: 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55] Refreshing instance network info cache due to event network-changed-ebf9f385-e59b-4060-9bf9-a8d2006327b4. {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 10:15:39 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-8878164c-d221-4070-8bf2-6ea1af193e07 req-f47e5bda-e771-4f24-9134-d2fc69026e10 service nova] Acquiring lock "refresh_cache-0fe47a17-4ffb-48ce-b0f6-a9b43002bd55" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:15:39 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-8878164c-d221-4070-8bf2-6ea1af193e07 req-f47e5bda-e771-4f24-9134-d2fc69026e10 service nova] Acquired lock "refresh_cache-0fe47a17-4ffb-48ce-b0f6-a9b43002bd55" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:15:39 user nova-compute[73572]: DEBUG nova.network.neutron [req-8878164c-d221-4070-8bf2-6ea1af193e07 req-f47e5bda-e771-4f24-9134-d2fc69026e10 service nova] [instance: 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55] Refreshing network info cache for port ebf9f385-e59b-4060-9bf9-a8d2006327b4 {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 10:15:40 user nova-compute[73572]: INFO nova.virt.libvirt.driver [-] [instance: 83670c16-3566-4679-8e74-c6451c840315] Instance destroyed successfully.
Aug 26 10:15:40 user nova-compute[73572]: DEBUG nova.objects.instance [None req-6176f596-4265-4ead-b93e-207ce53a4e2e tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] Lazy-loading 'resources' on Instance uuid 83670c16-3566-4679-8e74-c6451c840315 {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:15:40 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-6176f596-4265-4ead-b93e-207ce53a4e2e tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T10:12:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1879326179',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1879326179',id=9,image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM3oCFCh6aSyMKnKXD2N01fKLoLdTwSLEkitnN27bC0tybJXZUg58irUKFfKhM+F56mUQ6TT+wCANqJX5C6Y4Kdsag44eqLZjU/ENlptljpGrrUDZwWsVYQykcGl3CUZJQ==',key_name='tempest-keypair-123856006',keypairs=<?>,launch_index=0,launched_at=2023-08-26T10:13:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9de7931c97d448eaa26d295386b3a999',ramdisk_id='',reservation_id='r-9p350v4l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1188843039',owner_user_name='tempest-TaggedBootDevicesTest-1188843039-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T10:13:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d2269ea682c5489892c05da7db781952',uuid=83670c16-3566-4679-8e74-c6451c840315,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "71be4c62-7219-45ca-8047-ab6716b37f6a", "address": "fa:16:3e:5b:5d:84", "network": {"id": "0a1bb03e-917c-4df5-84cc-bd7729b69ab6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-258329362-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9de7931c97d448eaa26d295386b3a999", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71be4c62-72", "ovs_interfaceid": "71be4c62-7219-45ca-8047-ab6716b37f6a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 10:15:40 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-6176f596-4265-4ead-b93e-207ce53a4e2e tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] Converting VIF {"id": "71be4c62-7219-45ca-8047-ab6716b37f6a", "address": "fa:16:3e:5b:5d:84", "network": {"id": "0a1bb03e-917c-4df5-84cc-bd7729b69ab6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-258329362-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9de7931c97d448eaa26d295386b3a999", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71be4c62-72", "ovs_interfaceid": "71be4c62-7219-45ca-8047-ab6716b37f6a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:15:40 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-6176f596-4265-4ead-b93e-207ce53a4e2e tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5b:5d:84,bridge_name='br-int',has_traffic_filtering=True,id=71be4c62-7219-45ca-8047-ab6716b37f6a,network=Network(0a1bb03e-917c-4df5-84cc-bd7729b69ab6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71be4c62-72') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:15:40 user nova-compute[73572]: DEBUG os_vif [None req-6176f596-4265-4ead-b93e-207ce53a4e2e tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5b:5d:84,bridge_name='br-int',has_traffic_filtering=True,id=71be4c62-7219-45ca-8047-ab6716b37f6a,network=Network(0a1bb03e-917c-4df5-84cc-bd7729b69ab6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71be4c62-72') {{(pid=73572) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 10:15:40 user nova-compute[73572]: DEBUG nova.network.neutron [req-8878164c-d221-4070-8bf2-6ea1af193e07 req-f47e5bda-e771-4f24-9134-d2fc69026e10 service nova] [instance: 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55] Updated VIF entry in instance network info cache for port ebf9f385-e59b-4060-9bf9-a8d2006327b4. {{(pid=73572) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 10:15:40 user nova-compute[73572]: DEBUG nova.network.neutron [req-8878164c-d221-4070-8bf2-6ea1af193e07 req-f47e5bda-e771-4f24-9134-d2fc69026e10 service nova] [instance: 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55] Updating instance_info_cache with network_info: [{"id": "ebf9f385-e59b-4060-9bf9-a8d2006327b4", "address": "fa:16:3e:49:23:6a", "network": {"id": "7c89c22a-96d4-4e60-9c4c-b5a82a7eca55", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1976182948-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d2c922711fb445aa99ae4f30b802c12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebf9f385-e5", "ovs_interfaceid": "ebf9f385-e59b-4060-9bf9-a8d2006327b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:15:40 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:15:40 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap71be4c62-72, bridge=br-int, if_exists=True) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:15:40 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:15:40 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:15:40 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-8878164c-d221-4070-8bf2-6ea1af193e07 req-f47e5bda-e771-4f24-9134-d2fc69026e10 service nova] Releasing lock "refresh_cache-0fe47a17-4ffb-48ce-b0f6-a9b43002bd55" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:15:40 user nova-compute[73572]: DEBUG nova.compute.manager [req-8878164c-d221-4070-8bf2-6ea1af193e07 req-f47e5bda-e771-4f24-9134-d2fc69026e10 service nova] [instance: 83670c16-3566-4679-8e74-c6451c840315] Received event network-vif-unplugged-f4d684f0-2fe0-46e6-8f84-e2c0918a5a82 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:15:40 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-8878164c-d221-4070-8bf2-6ea1af193e07 req-f47e5bda-e771-4f24-9134-d2fc69026e10 service nova] Acquiring lock "83670c16-3566-4679-8e74-c6451c840315-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:15:40 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-8878164c-d221-4070-8bf2-6ea1af193e07 req-f47e5bda-e771-4f24-9134-d2fc69026e10 service nova] Lock "83670c16-3566-4679-8e74-c6451c840315-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:15:40 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-8878164c-d221-4070-8bf2-6ea1af193e07 req-f47e5bda-e771-4f24-9134-d2fc69026e10 service nova] Lock "83670c16-3566-4679-8e74-c6451c840315-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:15:40 user nova-compute[73572]: DEBUG nova.compute.manager [req-8878164c-d221-4070-8bf2-6ea1af193e07 req-f47e5bda-e771-4f24-9134-d2fc69026e10 service nova] [instance: 83670c16-3566-4679-8e74-c6451c840315] No waiting events found dispatching network-vif-unplugged-f4d684f0-2fe0-46e6-8f84-e2c0918a5a82 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:15:40 user nova-compute[73572]: DEBUG nova.compute.manager [req-8878164c-d221-4070-8bf2-6ea1af193e07 req-f47e5bda-e771-4f24-9134-d2fc69026e10 service nova] [instance: 83670c16-3566-4679-8e74-c6451c840315] Received event network-vif-unplugged-f4d684f0-2fe0-46e6-8f84-e2c0918a5a82 for instance with task_state deleting. {{(pid=73572) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 10:15:40 user nova-compute[73572]: DEBUG nova.compute.manager [req-8878164c-d221-4070-8bf2-6ea1af193e07 req-f47e5bda-e771-4f24-9134-d2fc69026e10 service nova] [instance: 83670c16-3566-4679-8e74-c6451c840315] Received event network-vif-plugged-f4d684f0-2fe0-46e6-8f84-e2c0918a5a82 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:15:40 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-8878164c-d221-4070-8bf2-6ea1af193e07 req-f47e5bda-e771-4f24-9134-d2fc69026e10 service nova] Acquiring lock "83670c16-3566-4679-8e74-c6451c840315-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:15:40 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-8878164c-d221-4070-8bf2-6ea1af193e07 req-f47e5bda-e771-4f24-9134-d2fc69026e10 service nova] Lock "83670c16-3566-4679-8e74-c6451c840315-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:15:40 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-8878164c-d221-4070-8bf2-6ea1af193e07 req-f47e5bda-e771-4f24-9134-d2fc69026e10 service nova] Lock "83670c16-3566-4679-8e74-c6451c840315-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:15:40 user nova-compute[73572]: DEBUG nova.compute.manager [req-8878164c-d221-4070-8bf2-6ea1af193e07 req-f47e5bda-e771-4f24-9134-d2fc69026e10 service nova] [instance: 83670c16-3566-4679-8e74-c6451c840315] No waiting events found dispatching network-vif-plugged-f4d684f0-2fe0-46e6-8f84-e2c0918a5a82 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:15:40 user nova-compute[73572]: WARNING nova.compute.manager [req-8878164c-d221-4070-8bf2-6ea1af193e07 req-f47e5bda-e771-4f24-9134-d2fc69026e10 service nova] [instance: 83670c16-3566-4679-8e74-c6451c840315] Received unexpected event network-vif-plugged-f4d684f0-2fe0-46e6-8f84-e2c0918a5a82 for instance with vm_state active and task_state deleting.
Aug 26 10:15:40 user nova-compute[73572]: DEBUG nova.compute.manager [req-8878164c-d221-4070-8bf2-6ea1af193e07 req-f47e5bda-e771-4f24-9134-d2fc69026e10 service nova] [instance: 83670c16-3566-4679-8e74-c6451c840315] Received event network-vif-unplugged-5e85b3cc-9fe4-46aa-a43f-d4acc5ca3c73 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:15:40 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-8878164c-d221-4070-8bf2-6ea1af193e07 req-f47e5bda-e771-4f24-9134-d2fc69026e10 service nova] Acquiring lock "83670c16-3566-4679-8e74-c6451c840315-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:15:40 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-8878164c-d221-4070-8bf2-6ea1af193e07 req-f47e5bda-e771-4f24-9134-d2fc69026e10 service nova] Lock "83670c16-3566-4679-8e74-c6451c840315-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:15:40 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-8878164c-d221-4070-8bf2-6ea1af193e07 req-f47e5bda-e771-4f24-9134-d2fc69026e10 service nova] Lock "83670c16-3566-4679-8e74-c6451c840315-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:15:40 user nova-compute[73572]: DEBUG nova.compute.manager [req-8878164c-d221-4070-8bf2-6ea1af193e07 req-f47e5bda-e771-4f24-9134-d2fc69026e10 service nova] [instance: 83670c16-3566-4679-8e74-c6451c840315] No waiting events found dispatching network-vif-unplugged-5e85b3cc-9fe4-46aa-a43f-d4acc5ca3c73 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:15:40 user nova-compute[73572]: DEBUG nova.compute.manager [req-8878164c-d221-4070-8bf2-6ea1af193e07 req-f47e5bda-e771-4f24-9134-d2fc69026e10 service nova] [instance: 83670c16-3566-4679-8e74-c6451c840315] Received event network-vif-unplugged-5e85b3cc-9fe4-46aa-a43f-d4acc5ca3c73 for instance with task_state deleting. {{(pid=73572) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 10:15:40 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:15:40 user nova-compute[73572]: INFO os_vif [None req-6176f596-4265-4ead-b93e-207ce53a4e2e tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5b:5d:84,bridge_name='br-int',has_traffic_filtering=True,id=71be4c62-7219-45ca-8047-ab6716b37f6a,network=Network(0a1bb03e-917c-4df5-84cc-bd7729b69ab6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71be4c62-72')
Aug 26 10:15:40 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-6176f596-4265-4ead-b93e-207ce53a4e2e tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T10:12:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1879326179',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1879326179',id=9,image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM3oCFCh6aSyMKnKXD2N01fKLoLdTwSLEkitnN27bC0tybJXZUg58irUKFfKhM+F56mUQ6TT+wCANqJX5C6Y4Kdsag44eqLZjU/ENlptljpGrrUDZwWsVYQykcGl3CUZJQ==',key_name='tempest-keypair-123856006',keypairs=<?>,launch_index=0,launched_at=2023-08-26T10:13:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9de7931c97d448eaa26d295386b3a999',ramdisk_id='',reservation_id='r-9p350v4l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1188843039',owner_user_name='tempest-TaggedBootDevicesTest-1188843039-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T10:13:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d2269ea682c5489892c05da7db781952',uuid=83670c16-3566-4679-8e74-c6451c840315,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "84bf04a4-b563-48c5-aa73-5b54cbb4887f", "address": "fa:16:3e:e2:c6:ae", "network": {"id": "e194b396-7c3f-41f3-99b2-f82b55c779f2", "bridge": "br-int", "label": "tempest-device-tagging-net1-1768943373", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.226", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9de7931c97d448eaa26d295386b3a999", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84bf04a4-b5", "ovs_interfaceid": "84bf04a4-b563-48c5-aa73-5b54cbb4887f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73572) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 10:15:40 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-6176f596-4265-4ead-b93e-207ce53a4e2e tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] Converting VIF {"id": "84bf04a4-b563-48c5-aa73-5b54cbb4887f", "address": "fa:16:3e:e2:c6:ae", "network": {"id": "e194b396-7c3f-41f3-99b2-f82b55c779f2", "bridge": "br-int", "label": "tempest-device-tagging-net1-1768943373", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.226", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9de7931c97d448eaa26d295386b3a999", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84bf04a4-b5", "ovs_interfaceid": "84bf04a4-b563-48c5-aa73-5b54cbb4887f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:15:40 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-6176f596-4265-4ead-b93e-207ce53a4e2e tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:c6:ae,bridge_name='br-int',has_traffic_filtering=True,id=84bf04a4-b563-48c5-aa73-5b54cbb4887f,network=Network(e194b396-7c3f-41f3-99b2-f82b55c779f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap84bf04a4-b5') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:15:40 user nova-compute[73572]: DEBUG os_vif [None req-6176f596-4265-4ead-b93e-207ce53a4e2e tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:c6:ae,bridge_name='br-int',has_traffic_filtering=True,id=84bf04a4-b563-48c5-aa73-5b54cbb4887f,network=Network(e194b396-7c3f-41f3-99b2-f82b55c779f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap84bf04a4-b5') {{(pid=73572) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 10:15:40 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:15:40 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap84bf04a4-b5, bridge=br-int, if_exists=True) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:15:40 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:15:40 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:15:40 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:15:40 user nova-compute[73572]: INFO os_vif [None req-6176f596-4265-4ead-b93e-207ce53a4e2e tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:c6:ae,bridge_name='br-int',has_traffic_filtering=True,id=84bf04a4-b563-48c5-aa73-5b54cbb4887f,network=Network(e194b396-7c3f-41f3-99b2-f82b55c779f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap84bf04a4-b5')
Aug 26 10:15:40 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-6176f596-4265-4ead-b93e-207ce53a4e2e tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T10:12:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1879326179',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1879326179',id=9,image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM3oCFCh6aSyMKnKXD2N01fKLoLdTwSLEkitnN27bC0tybJXZUg58irUKFfKhM+F56mUQ6TT+wCANqJX5C6Y4Kdsag44eqLZjU/ENlptljpGrrUDZwWsVYQykcGl3CUZJQ==',key_name='tempest-keypair-123856006',keypairs=<?>,launch_index=0,launched_at=2023-08-26T10:13:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9de7931c97d448eaa26d295386b3a999',ramdisk_id='',reservation_id='r-9p350v4l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1188843039',owner_user_name='tempest-TaggedBootDevicesTest-1188843039-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T10:13:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d2269ea682c5489892c05da7db781952',uuid=83670c16-3566-4679-8e74-c6451c840315,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f4d684f0-2fe0-46e6-8f84-e2c0918a5a82", "address": "fa:16:3e:a6:7f:bd", "network": {"id": "e194b396-7c3f-41f3-99b2-f82b55c779f2", "bridge": "br-int", "label": "tempest-device-tagging-net1-1768943373", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.191", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9de7931c97d448eaa26d295386b3a999", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4d684f0-2f", "ovs_interfaceid": "f4d684f0-2fe0-46e6-8f84-e2c0918a5a82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73572) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 10:15:40 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-6176f596-4265-4ead-b93e-207ce53a4e2e tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] Converting VIF {"id": "f4d684f0-2fe0-46e6-8f84-e2c0918a5a82", "address": "fa:16:3e:a6:7f:bd", "network": {"id": "e194b396-7c3f-41f3-99b2-f82b55c779f2", "bridge": "br-int", "label": "tempest-device-tagging-net1-1768943373", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.191", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9de7931c97d448eaa26d295386b3a999", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4d684f0-2f", "ovs_interfaceid": "f4d684f0-2fe0-46e6-8f84-e2c0918a5a82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:15:40 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-6176f596-4265-4ead-b93e-207ce53a4e2e tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:7f:bd,bridge_name='br-int',has_traffic_filtering=True,id=f4d684f0-2fe0-46e6-8f84-e2c0918a5a82,network=Network(e194b396-7c3f-41f3-99b2-f82b55c779f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf4d684f0-2f') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:15:40 user nova-compute[73572]: DEBUG os_vif [None req-6176f596-4265-4ead-b93e-207ce53a4e2e tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:7f:bd,bridge_name='br-int',has_traffic_filtering=True,id=f4d684f0-2fe0-46e6-8f84-e2c0918a5a82,network=Network(e194b396-7c3f-41f3-99b2-f82b55c779f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf4d684f0-2f') {{(pid=73572) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 10:15:40 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:15:40 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf4d684f0-2f, bridge=br-int, if_exists=True) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:15:40 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:15:40 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:15:40 user nova-compute[73572]: INFO os_vif [None req-6176f596-4265-4ead-b93e-207ce53a4e2e tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:7f:bd,bridge_name='br-int',has_traffic_filtering=True,id=f4d684f0-2fe0-46e6-8f84-e2c0918a5a82,network=Network(e194b396-7c3f-41f3-99b2-f82b55c779f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf4d684f0-2f')
Aug 26 10:15:40 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-6176f596-4265-4ead-b93e-207ce53a4e2e tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T10:12:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1879326179',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1879326179',id=9,image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM3oCFCh6aSyMKnKXD2N01fKLoLdTwSLEkitnN27bC0tybJXZUg58irUKFfKhM+F56mUQ6TT+wCANqJX5C6Y4Kdsag44eqLZjU/ENlptljpGrrUDZwWsVYQykcGl3CUZJQ==',key_name='tempest-keypair-123856006',keypairs=<?>,launch_index=0,launched_at=2023-08-26T10:13:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9de7931c97d448eaa26d295386b3a999',ramdisk_id='',reservation_id='r-9p350v4l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1188843039',owner_user_name='tempest-TaggedBootDevicesTest-1188843039-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T10:13:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d2269ea682c5489892c05da7db781952',uuid=83670c16-3566-4679-8e74-c6451c840315,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "41a7ee04-5b67-4da6-a543-0d15187e5813", "address": "fa:16:3e:32:50:ef", "network": {"id": "e194b396-7c3f-41f3-99b2-f82b55c779f2", "bridge": "br-int", "label": "tempest-device-tagging-net1-1768943373", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.158", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9de7931c97d448eaa26d295386b3a999", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41a7ee04-5b", "ovs_interfaceid": "41a7ee04-5b67-4da6-a543-0d15187e5813", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 10:15:40 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-6176f596-4265-4ead-b93e-207ce53a4e2e tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] Converting VIF {"id": "41a7ee04-5b67-4da6-a543-0d15187e5813", "address": "fa:16:3e:32:50:ef", "network": {"id": "e194b396-7c3f-41f3-99b2-f82b55c779f2", "bridge": "br-int", "label": "tempest-device-tagging-net1-1768943373", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.158", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9de7931c97d448eaa26d295386b3a999", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41a7ee04-5b", "ovs_interfaceid": "41a7ee04-5b67-4da6-a543-0d15187e5813", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:15:40 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-6176f596-4265-4ead-b93e-207ce53a4e2e tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:50:ef,bridge_name='br-int',has_traffic_filtering=True,id=41a7ee04-5b67-4da6-a543-0d15187e5813,network=Network(e194b396-7c3f-41f3-99b2-f82b55c779f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41a7ee04-5b') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:15:40 user nova-compute[73572]: DEBUG os_vif [None req-6176f596-4265-4ead-b93e-207ce53a4e2e tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:50:ef,bridge_name='br-int',has_traffic_filtering=True,id=41a7ee04-5b67-4da6-a543-0d15187e5813,network=Network(e194b396-7c3f-41f3-99b2-f82b55c779f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41a7ee04-5b') {{(pid=73572) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 10:15:40 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:15:40 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap41a7ee04-5b, bridge=br-int, if_exists=True) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:15:40 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:15:40 user nova-compute[73572]: DEBUG nova.compute.manager [req-f109eff9-92b6-449a-9d74-5d29781ef5ec req-c35fdbb1-7a4b-4638-8ca3-88ad644fa96b service nova] [instance: 83670c16-3566-4679-8e74-c6451c840315] Received event network-vif-plugged-71be4c62-7219-45ca-8047-ab6716b37f6a {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:15:40 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-f109eff9-92b6-449a-9d74-5d29781ef5ec req-c35fdbb1-7a4b-4638-8ca3-88ad644fa96b service nova] Acquiring lock "83670c16-3566-4679-8e74-c6451c840315-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:15:40 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-f109eff9-92b6-449a-9d74-5d29781ef5ec req-c35fdbb1-7a4b-4638-8ca3-88ad644fa96b service nova] Lock "83670c16-3566-4679-8e74-c6451c840315-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:15:40 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-f109eff9-92b6-449a-9d74-5d29781ef5ec req-c35fdbb1-7a4b-4638-8ca3-88ad644fa96b service nova] Lock "83670c16-3566-4679-8e74-c6451c840315-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:15:40 user nova-compute[73572]: DEBUG nova.compute.manager [req-f109eff9-92b6-449a-9d74-5d29781ef5ec req-c35fdbb1-7a4b-4638-8ca3-88ad644fa96b service nova] [instance: 83670c16-3566-4679-8e74-c6451c840315] No waiting events found dispatching network-vif-plugged-71be4c62-7219-45ca-8047-ab6716b37f6a {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:15:40 user nova-compute[73572]: WARNING nova.compute.manager [req-f109eff9-92b6-449a-9d74-5d29781ef5ec req-c35fdbb1-7a4b-4638-8ca3-88ad644fa96b service nova] [instance: 83670c16-3566-4679-8e74-c6451c840315] Received unexpected event network-vif-plugged-71be4c62-7219-45ca-8047-ab6716b37f6a for instance with vm_state active and task_state deleting.
Aug 26 10:15:40 user nova-compute[73572]: DEBUG nova.compute.manager [req-f109eff9-92b6-449a-9d74-5d29781ef5ec req-c35fdbb1-7a4b-4638-8ca3-88ad644fa96b service nova] [instance: 83670c16-3566-4679-8e74-c6451c840315] Received event network-vif-unplugged-84bf04a4-b563-48c5-aa73-5b54cbb4887f {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:15:40 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-f109eff9-92b6-449a-9d74-5d29781ef5ec req-c35fdbb1-7a4b-4638-8ca3-88ad644fa96b service nova] Acquiring lock "83670c16-3566-4679-8e74-c6451c840315-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:15:40 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-f109eff9-92b6-449a-9d74-5d29781ef5ec req-c35fdbb1-7a4b-4638-8ca3-88ad644fa96b service nova] Lock "83670c16-3566-4679-8e74-c6451c840315-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:15:40 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-f109eff9-92b6-449a-9d74-5d29781ef5ec req-c35fdbb1-7a4b-4638-8ca3-88ad644fa96b service nova] Lock "83670c16-3566-4679-8e74-c6451c840315-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:15:40 user nova-compute[73572]: DEBUG nova.compute.manager [req-f109eff9-92b6-449a-9d74-5d29781ef5ec req-c35fdbb1-7a4b-4638-8ca3-88ad644fa96b service nova] [instance: 83670c16-3566-4679-8e74-c6451c840315] No waiting events found dispatching network-vif-unplugged-84bf04a4-b563-48c5-aa73-5b54cbb4887f {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:15:40 user nova-compute[73572]: DEBUG nova.compute.manager [req-f109eff9-92b6-449a-9d74-5d29781ef5ec req-c35fdbb1-7a4b-4638-8ca3-88ad644fa96b service nova] [instance: 83670c16-3566-4679-8e74-c6451c840315] Received event network-vif-unplugged-84bf04a4-b563-48c5-aa73-5b54cbb4887f for instance with task_state deleting. {{(pid=73572) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 10:15:40 user nova-compute[73572]: DEBUG nova.compute.manager [req-f109eff9-92b6-449a-9d74-5d29781ef5ec req-c35fdbb1-7a4b-4638-8ca3-88ad644fa96b service nova] [instance: 83670c16-3566-4679-8e74-c6451c840315] Received event network-vif-plugged-84bf04a4-b563-48c5-aa73-5b54cbb4887f {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:15:40 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-f109eff9-92b6-449a-9d74-5d29781ef5ec req-c35fdbb1-7a4b-4638-8ca3-88ad644fa96b service nova] Acquiring lock "83670c16-3566-4679-8e74-c6451c840315-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:15:40 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-f109eff9-92b6-449a-9d74-5d29781ef5ec req-c35fdbb1-7a4b-4638-8ca3-88ad644fa96b service nova] Lock "83670c16-3566-4679-8e74-c6451c840315-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:15:40 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-f109eff9-92b6-449a-9d74-5d29781ef5ec req-c35fdbb1-7a4b-4638-8ca3-88ad644fa96b service nova] Lock "83670c16-3566-4679-8e74-c6451c840315-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:15:40 user nova-compute[73572]: DEBUG nova.compute.manager [req-f109eff9-92b6-449a-9d74-5d29781ef5ec req-c35fdbb1-7a4b-4638-8ca3-88ad644fa96b service nova] [instance: 83670c16-3566-4679-8e74-c6451c840315] No waiting events found dispatching network-vif-plugged-84bf04a4-b563-48c5-aa73-5b54cbb4887f {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:15:40 user nova-compute[73572]: WARNING nova.compute.manager [req-f109eff9-92b6-449a-9d74-5d29781ef5ec req-c35fdbb1-7a4b-4638-8ca3-88ad644fa96b service nova] [instance: 83670c16-3566-4679-8e74-c6451c840315] Received unexpected event network-vif-plugged-84bf04a4-b563-48c5-aa73-5b54cbb4887f for instance with vm_state active and task_state deleting.
Aug 26 10:15:40 user nova-compute[73572]: DEBUG nova.compute.manager [req-f109eff9-92b6-449a-9d74-5d29781ef5ec req-c35fdbb1-7a4b-4638-8ca3-88ad644fa96b service nova] [instance: 83670c16-3566-4679-8e74-c6451c840315] Received event network-vif-unplugged-41a7ee04-5b67-4da6-a543-0d15187e5813 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:15:40 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-f109eff9-92b6-449a-9d74-5d29781ef5ec req-c35fdbb1-7a4b-4638-8ca3-88ad644fa96b service nova] Acquiring lock "83670c16-3566-4679-8e74-c6451c840315-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:15:40 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-f109eff9-92b6-449a-9d74-5d29781ef5ec req-c35fdbb1-7a4b-4638-8ca3-88ad644fa96b service nova] Lock "83670c16-3566-4679-8e74-c6451c840315-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:15:40 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-f109eff9-92b6-449a-9d74-5d29781ef5ec req-c35fdbb1-7a4b-4638-8ca3-88ad644fa96b service nova] Lock "83670c16-3566-4679-8e74-c6451c840315-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:15:40 user nova-compute[73572]: DEBUG nova.compute.manager [req-f109eff9-92b6-449a-9d74-5d29781ef5ec req-c35fdbb1-7a4b-4638-8ca3-88ad644fa96b service nova] [instance: 83670c16-3566-4679-8e74-c6451c840315] No waiting events found dispatching network-vif-unplugged-41a7ee04-5b67-4da6-a543-0d15187e5813 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:15:40 user nova-compute[73572]: DEBUG nova.compute.manager [req-f109eff9-92b6-449a-9d74-5d29781ef5ec req-c35fdbb1-7a4b-4638-8ca3-88ad644fa96b service nova] [instance: 83670c16-3566-4679-8e74-c6451c840315] Received event network-vif-unplugged-41a7ee04-5b67-4da6-a543-0d15187e5813 for instance with task_state deleting. {{(pid=73572) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 10:15:40 user nova-compute[73572]: DEBUG nova.compute.manager [req-f109eff9-92b6-449a-9d74-5d29781ef5ec req-c35fdbb1-7a4b-4638-8ca3-88ad644fa96b service nova] [instance: 83670c16-3566-4679-8e74-c6451c840315] Received event network-vif-plugged-41a7ee04-5b67-4da6-a543-0d15187e5813 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:15:40 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-f109eff9-92b6-449a-9d74-5d29781ef5ec req-c35fdbb1-7a4b-4638-8ca3-88ad644fa96b service nova] Acquiring lock "83670c16-3566-4679-8e74-c6451c840315-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:15:40 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-f109eff9-92b6-449a-9d74-5d29781ef5ec req-c35fdbb1-7a4b-4638-8ca3-88ad644fa96b service nova] Lock "83670c16-3566-4679-8e74-c6451c840315-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:15:40 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-f109eff9-92b6-449a-9d74-5d29781ef5ec req-c35fdbb1-7a4b-4638-8ca3-88ad644fa96b service nova] Lock "83670c16-3566-4679-8e74-c6451c840315-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:15:40 user nova-compute[73572]: DEBUG nova.compute.manager [req-f109eff9-92b6-449a-9d74-5d29781ef5ec req-c35fdbb1-7a4b-4638-8ca3-88ad644fa96b service nova] [instance: 83670c16-3566-4679-8e74-c6451c840315] No waiting events found dispatching network-vif-plugged-41a7ee04-5b67-4da6-a543-0d15187e5813 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:15:40 user nova-compute[73572]: WARNING nova.compute.manager [req-f109eff9-92b6-449a-9d74-5d29781ef5ec req-c35fdbb1-7a4b-4638-8ca3-88ad644fa96b service nova] [instance: 83670c16-3566-4679-8e74-c6451c840315] Received unexpected event network-vif-plugged-41a7ee04-5b67-4da6-a543-0d15187e5813 for instance with vm_state active and task_state deleting.
Aug 26 10:15:40 user nova-compute[73572]: DEBUG nova.compute.manager [req-f109eff9-92b6-449a-9d74-5d29781ef5ec req-c35fdbb1-7a4b-4638-8ca3-88ad644fa96b service nova] [instance: 83670c16-3566-4679-8e74-c6451c840315] Received event network-vif-unplugged-422eb7ef-4540-462b-a485-afdc38ebccd0 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:15:40 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-f109eff9-92b6-449a-9d74-5d29781ef5ec req-c35fdbb1-7a4b-4638-8ca3-88ad644fa96b service nova] Acquiring lock "83670c16-3566-4679-8e74-c6451c840315-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:15:40 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-f109eff9-92b6-449a-9d74-5d29781ef5ec req-c35fdbb1-7a4b-4638-8ca3-88ad644fa96b service nova] Lock "83670c16-3566-4679-8e74-c6451c840315-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:15:40 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-f109eff9-92b6-449a-9d74-5d29781ef5ec req-c35fdbb1-7a4b-4638-8ca3-88ad644fa96b service nova] Lock "83670c16-3566-4679-8e74-c6451c840315-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:15:40 user nova-compute[73572]: DEBUG nova.compute.manager [req-f109eff9-92b6-449a-9d74-5d29781ef5ec req-c35fdbb1-7a4b-4638-8ca3-88ad644fa96b service nova] [instance: 83670c16-3566-4679-8e74-c6451c840315] No waiting events found dispatching network-vif-unplugged-422eb7ef-4540-462b-a485-afdc38ebccd0 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:15:40 user nova-compute[73572]: DEBUG nova.compute.manager [req-f109eff9-92b6-449a-9d74-5d29781ef5ec req-c35fdbb1-7a4b-4638-8ca3-88ad644fa96b service nova] [instance: 83670c16-3566-4679-8e74-c6451c840315] Received event network-vif-unplugged-422eb7ef-4540-462b-a485-afdc38ebccd0 for instance with task_state deleting. {{(pid=73572) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 10:15:40 user nova-compute[73572]: DEBUG nova.compute.manager [req-f109eff9-92b6-449a-9d74-5d29781ef5ec req-c35fdbb1-7a4b-4638-8ca3-88ad644fa96b service nova] [instance: 83670c16-3566-4679-8e74-c6451c840315] Received event network-vif-plugged-422eb7ef-4540-462b-a485-afdc38ebccd0 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:15:40 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-f109eff9-92b6-449a-9d74-5d29781ef5ec req-c35fdbb1-7a4b-4638-8ca3-88ad644fa96b service nova] Acquiring lock "83670c16-3566-4679-8e74-c6451c840315-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:15:40 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-f109eff9-92b6-449a-9d74-5d29781ef5ec req-c35fdbb1-7a4b-4638-8ca3-88ad644fa96b service nova] Lock "83670c16-3566-4679-8e74-c6451c840315-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:15:40 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-f109eff9-92b6-449a-9d74-5d29781ef5ec req-c35fdbb1-7a4b-4638-8ca3-88ad644fa96b service nova] Lock "83670c16-3566-4679-8e74-c6451c840315-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:15:40 user nova-compute[73572]: DEBUG nova.compute.manager [req-f109eff9-92b6-449a-9d74-5d29781ef5ec req-c35fdbb1-7a4b-4638-8ca3-88ad644fa96b service nova] [instance: 83670c16-3566-4679-8e74-c6451c840315] No waiting events found dispatching network-vif-plugged-422eb7ef-4540-462b-a485-afdc38ebccd0 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:15:40 user nova-compute[73572]: WARNING nova.compute.manager [req-f109eff9-92b6-449a-9d74-5d29781ef5ec req-c35fdbb1-7a4b-4638-8ca3-88ad644fa96b service nova] [instance: 83670c16-3566-4679-8e74-c6451c840315] Received unexpected event network-vif-plugged-422eb7ef-4540-462b-a485-afdc38ebccd0 for instance with vm_state active and task_state deleting.
Aug 26 10:15:40 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:15:40 user nova-compute[73572]: INFO os_vif [None req-6176f596-4265-4ead-b93e-207ce53a4e2e tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:50:ef,bridge_name='br-int',has_traffic_filtering=True,id=41a7ee04-5b67-4da6-a543-0d15187e5813,network=Network(e194b396-7c3f-41f3-99b2-f82b55c779f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41a7ee04-5b')
Aug 26 10:15:40 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-6176f596-4265-4ead-b93e-207ce53a4e2e tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T10:12:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1879326179',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1879326179',id=9,image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM3oCFCh6aSyMKnKXD2N01fKLoLdTwSLEkitnN27bC0tybJXZUg58irUKFfKhM+F56mUQ6TT+wCANqJX5C6Y4Kdsag44eqLZjU/ENlptljpGrrUDZwWsVYQykcGl3CUZJQ==',key_name='tempest-keypair-123856006',keypairs=<?>,launch_index=0,launched_at=2023-08-26T10:13:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9de7931c97d448eaa26d295386b3a999',ramdisk_id='',reservation_id='r-9p350v4l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1188843039',owner_user_name='tempest-TaggedBootDevicesTest-1188843039-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T10:13:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d2269ea682c5489892c05da7db781952',uuid=83670c16-3566-4679-8e74-c6451c840315,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "422eb7ef-4540-462b-a485-afdc38ebccd0", "address": "fa:16:3e:79:44:99", "network": {"id": "e194b396-7c3f-41f3-99b2-f82b55c779f2", "bridge": "br-int", "label": "tempest-device-tagging-net1-1768943373", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9de7931c97d448eaa26d295386b3a999", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap422eb7ef-45", "ovs_interfaceid": "422eb7ef-4540-462b-a485-afdc38ebccd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 10:15:40 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-6176f596-4265-4ead-b93e-207ce53a4e2e tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] Converting VIF {"id": "422eb7ef-4540-462b-a485-afdc38ebccd0", "address": "fa:16:3e:79:44:99", "network": {"id": "e194b396-7c3f-41f3-99b2-f82b55c779f2", "bridge": "br-int", "label": "tempest-device-tagging-net1-1768943373", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9de7931c97d448eaa26d295386b3a999", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap422eb7ef-45", "ovs_interfaceid": "422eb7ef-4540-462b-a485-afdc38ebccd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:15:40 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-6176f596-4265-4ead-b93e-207ce53a4e2e tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:44:99,bridge_name='br-int',has_traffic_filtering=True,id=422eb7ef-4540-462b-a485-afdc38ebccd0,network=Network(e194b396-7c3f-41f3-99b2-f82b55c779f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap422eb7ef-45') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:15:40 user nova-compute[73572]: DEBUG os_vif [None req-6176f596-4265-4ead-b93e-207ce53a4e2e tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:44:99,bridge_name='br-int',has_traffic_filtering=True,id=422eb7ef-4540-462b-a485-afdc38ebccd0,network=Network(e194b396-7c3f-41f3-99b2-f82b55c779f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap422eb7ef-45') {{(pid=73572) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 10:15:40 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:15:40 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap422eb7ef-45, bridge=br-int, if_exists=True) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:15:40 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:15:40 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:15:40 user nova-compute[73572]: INFO os_vif [None req-6176f596-4265-4ead-b93e-207ce53a4e2e tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:44:99,bridge_name='br-int',has_traffic_filtering=True,id=422eb7ef-4540-462b-a485-afdc38ebccd0,network=Network(e194b396-7c3f-41f3-99b2-f82b55c779f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap422eb7ef-45')
Aug 26 10:15:40 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-6176f596-4265-4ead-b93e-207ce53a4e2e tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T10:12:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1879326179',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1879326179',id=9,image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM3oCFCh6aSyMKnKXD2N01fKLoLdTwSLEkitnN27bC0tybJXZUg58irUKFfKhM+F56mUQ6TT+wCANqJX5C6Y4Kdsag44eqLZjU/ENlptljpGrrUDZwWsVYQykcGl3CUZJQ==',key_name='tempest-keypair-123856006',keypairs=<?>,launch_index=0,launched_at=2023-08-26T10:13:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9de7931c97d448eaa26d295386b3a999',ramdisk_id='',reservation_id='r-9p350v4l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1188843039',owner_user_name='tempest-TaggedBootDevicesTest-1188843039-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T10:13:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d2269ea682c5489892c05da7db781952',uuid=83670c16-3566-4679-8e74-c6451c840315,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5e85b3cc-9fe4-46aa-a43f-d4acc5ca3c73", "address": "fa:16:3e:fd:33:d1", "network": {"id": "2cfbe057-f10f-4b28-b3bf-98b2ef5103d7", "bridge": "br-int", "label": "tempest-device-tagging-net2-598168548", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9de7931c97d448eaa26d295386b3a999", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e85b3cc-9f", "ovs_interfaceid": "5e85b3cc-9fe4-46aa-a43f-d4acc5ca3c73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 10:15:40 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-6176f596-4265-4ead-b93e-207ce53a4e2e tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] Converting VIF {"id": "5e85b3cc-9fe4-46aa-a43f-d4acc5ca3c73", "address": "fa:16:3e:fd:33:d1", "network": {"id": "2cfbe057-f10f-4b28-b3bf-98b2ef5103d7", "bridge": "br-int", "label": "tempest-device-tagging-net2-598168548", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9de7931c97d448eaa26d295386b3a999", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e85b3cc-9f", "ovs_interfaceid": "5e85b3cc-9fe4-46aa-a43f-d4acc5ca3c73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:15:40 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-6176f596-4265-4ead-b93e-207ce53a4e2e tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:33:d1,bridge_name='br-int',has_traffic_filtering=True,id=5e85b3cc-9fe4-46aa-a43f-d4acc5ca3c73,network=Network(2cfbe057-f10f-4b28-b3bf-98b2ef5103d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e85b3cc-9f') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:15:40 user nova-compute[73572]: DEBUG os_vif [None req-6176f596-4265-4ead-b93e-207ce53a4e2e tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:33:d1,bridge_name='br-int',has_traffic_filtering=True,id=5e85b3cc-9fe4-46aa-a43f-d4acc5ca3c73,network=Network(2cfbe057-f10f-4b28-b3bf-98b2ef5103d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e85b3cc-9f') {{(pid=73572) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 10:15:40 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:15:40 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5e85b3cc-9f, bridge=br-int, if_exists=True) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:15:40 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:15:40 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:15:40 user nova-compute[73572]: INFO os_vif [None req-6176f596-4265-4ead-b93e-207ce53a4e2e tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:33:d1,bridge_name='br-int',has_traffic_filtering=True,id=5e85b3cc-9fe4-46aa-a43f-d4acc5ca3c73,network=Network(2cfbe057-f10f-4b28-b3bf-98b2ef5103d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e85b3cc-9f')
Aug 26 10:15:40 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-6176f596-4265-4ead-b93e-207ce53a4e2e tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T10:12:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1879326179',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1879326179',id=9,image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM3oCFCh6aSyMKnKXD2N01fKLoLdTwSLEkitnN27bC0tybJXZUg58irUKFfKhM+F56mUQ6TT+wCANqJX5C6Y4Kdsag44eqLZjU/ENlptljpGrrUDZwWsVYQykcGl3CUZJQ==',key_name='tempest-keypair-123856006',keypairs=<?>,launch_index=0,launched_at=2023-08-26T10:13:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9de7931c97d448eaa26d295386b3a999',ramdisk_id='',reservation_id='r-9p350v4l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1188843039',owner_user_name='tempest-TaggedBootDevicesTest-1188843039-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T10:13:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d2269ea682c5489892c05da7db781952',uuid=83670c16-3566-4679-8e74-c6451c840315,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7b7b7362-9dcc-48da-ad4e-9141c676839e", "address": "fa:16:3e:0b:b5:3a", "network": {"id": "2cfbe057-f10f-4b28-b3bf-98b2ef5103d7", "bridge": "br-int", "label": "tempest-device-tagging-net2-598168548", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9de7931c97d448eaa26d295386b3a999", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b7b7362-9d", "ovs_interfaceid": "7b7b7362-9dcc-48da-ad4e-9141c676839e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 10:15:40 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-6176f596-4265-4ead-b93e-207ce53a4e2e tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] Converting VIF {"id": "7b7b7362-9dcc-48da-ad4e-9141c676839e", "address": "fa:16:3e:0b:b5:3a", "network": {"id": "2cfbe057-f10f-4b28-b3bf-98b2ef5103d7", "bridge": "br-int", "label": "tempest-device-tagging-net2-598168548", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9de7931c97d448eaa26d295386b3a999", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b7b7362-9d", "ovs_interfaceid": "7b7b7362-9dcc-48da-ad4e-9141c676839e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:15:40 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-6176f596-4265-4ead-b93e-207ce53a4e2e tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0b:b5:3a,bridge_name='br-int',has_traffic_filtering=True,id=7b7b7362-9dcc-48da-ad4e-9141c676839e,network=Network(2cfbe057-f10f-4b28-b3bf-98b2ef5103d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b7b7362-9d') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:15:40 user nova-compute[73572]: DEBUG os_vif [None req-6176f596-4265-4ead-b93e-207ce53a4e2e tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:b5:3a,bridge_name='br-int',has_traffic_filtering=True,id=7b7b7362-9dcc-48da-ad4e-9141c676839e,network=Network(2cfbe057-f10f-4b28-b3bf-98b2ef5103d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b7b7362-9d') {{(pid=73572) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 10:15:40 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:15:40 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7b7b7362-9d, bridge=br-int, if_exists=True) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:15:40 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:15:40 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:15:40 user nova-compute[73572]: INFO os_vif [None req-6176f596-4265-4ead-b93e-207ce53a4e2e tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:b5:3a,bridge_name='br-int',has_traffic_filtering=True,id=7b7b7362-9dcc-48da-ad4e-9141c676839e,network=Network(2cfbe057-f10f-4b28-b3bf-98b2ef5103d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b7b7362-9d')
Aug 26 10:15:40 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6176f596-4265-4ead-b93e-207ce53a4e2e tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] [instance: 83670c16-3566-4679-8e74-c6451c840315] calling os-brick to detach iSCSI Volume {{(pid=73572) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 10:15:40 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-6176f596-4265-4ead-b93e-207ce53a4e2e tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc89c3d6a10>, {'target_iqns': ['iqn.2010-10.org.openstack:09ba694f-cb2a-4600-abe9-924b41292479'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SDlthyJr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 10:15:40 user nova-compute[73572]: WARNING os_brick.initiator.connectors.base [None req-6176f596-4265-4ead-b93e-207ce53a4e2e tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 10:15:40 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-6176f596-4265-4ead-b93e-207ce53a4e2e tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 10:15:40 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-6176f596-4265-4ead-b93e-207ce53a4e2e tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 10:15:40 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-6176f596-4265-4ead-b93e-207ce53a4e2e tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:09ba694f-cb2a-4600-abe9-924b41292479', 0)] {{(pid=73572) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 10:15:40 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:15:40 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:15:40 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea3f3c7e-e1c1-4bf7-b68b-4d4bdada2b0f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:09ba694f-cb2a-4600-abe9-924b41292479\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:75ebe4c4-f791-4f09-a9bd-747ade3d70a3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:85988ff4-7fac-4a96-a502-74d6ca8189fe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ac5c1ee2-3656-49b3-942f-5fc992dc001b\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:15:40 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:15:40 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:15:40 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[21079018-87a8-4bce-a453-c8ce3a0554cd]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac5c1ee2-3656-49b3-942f-5fc992dc001b (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09ba694f-cb2a-4600-abe9-924b41292479 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85988ff4-7fac-4a96-a502-74d6ca8189fe (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75ebe4c4-f791-4f09-a9bd-747ade3d70a3 (non-flash)\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:15:40 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-6176f596-4265-4ead-b93e-207ce53a4e2e tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac5c1ee2-3656-49b3-942f-5fc992dc001b (non-flash)
Aug 26 10:15:40 user nova-compute[73572]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)
Aug 26 10:15:40 user nova-compute[73572]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09ba694f-cb2a-4600-abe9-924b41292479 (non-flash)
Aug 26 10:15:40 user nova-compute[73572]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85988ff4-7fac-4a96-a502-74d6ca8189fe (non-flash)
Aug 26 10:15:40 user nova-compute[73572]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75ebe4c4-f791-4f09-a9bd-747ade3d70a3 (non-flash)
Aug 26 10:15:40 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 10:15:40 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-6176f596-4265-4ead-b93e-207ce53a4e2e tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac5c1ee2-3656-49b3-942f-5fc992dc001b (non-flash)
Aug 26 10:15:40 user nova-compute[73572]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)
Aug 26 10:15:40 user nova-compute[73572]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09ba694f-cb2a-4600-abe9-924b41292479 (non-flash)
Aug 26 10:15:40 user nova-compute[73572]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85988ff4-7fac-4a96-a502-74d6ca8189fe (non-flash)
Aug 26 10:15:40 user nova-compute[73572]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75ebe4c4-f791-4f09-a9bd-747ade3d70a3 (non-flash)
Aug 26 10:15:40 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 10:15:40 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-6176f596-4265-4ead-b93e-207ce53a4e2e tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc89c3ca290>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:09ba694f-cb2a-4600-abe9-924b41292479'): ({'sdb'}, set())}) {{(pid=73572) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 10:15:40 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-6176f596-4265-4ead-b93e-207ce53a4e2e tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] Removing single pathed devices sdb {{(pid=73572) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 10:15:40 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:15:40 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:15:40 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad6e25eb-b7f1-40d4-94af-d0514edc611e]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:15:40 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:15:40 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:15:40 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[57d4c63b-e8de-430a-aa47-6ccb4481ea94]: (4, ('ok\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:15:40 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-6176f596-4265-4ead-b93e-207ce53a4e2e tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] Flushing IO for device /dev/sdb {{(pid=73572) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 10:15:40 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:15:40 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:15:40 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbbd3a5f-ca49-4445-8b9a-aad553a39557]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:15:40 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-6176f596-4265-4ead-b93e-207ce53a4e2e tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73572) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 10:15:40 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:15:40 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:15:40 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:15:40 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b023dc8-fd65-4cb9-9c81-77ad8064cd06]: (4, ('1', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:15:41 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-6176f596-4265-4ead-b93e-207ce53a4e2e tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73572) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 10:15:41 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-6176f596-4265-4ead-b93e-207ce53a4e2e tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] SCSI volumes sdb have been removed. {{(pid=73572) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 10:15:41 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-6176f596-4265-4ead-b93e-207ce53a4e2e tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:09ba694f-cb2a-4600-abe9-924b41292479')] {{(pid=73572) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 10:15:41 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09ba694f-cb2a-4600-abe9-924b41292479 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:15:41 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:15:41 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09ba694f-cb2a-4600-abe9-924b41292479 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:15:41 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[87848d4c-aa67-4dd9-88f2-66282fae37bb]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:15:41 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-6176f596-4265-4ead-b93e-207ce53a4e2e tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:15:41 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:15:41 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:15:41 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09ba694f-cb2a-4600-abe9-924b41292479 -p 172.16.0.220:3260 --logout {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:15:41 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09ba694f-cb2a-4600-abe9-924b41292479 -p 172.16.0.220:3260 --logout" returned: 0 in 0.094s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:15:41 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[37953d96-c018-45ec-8b4a-ffe7a2e6bc5b]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:09ba694f-cb2a-4600-abe9-924b41292479, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:09ba694f-cb2a-4600-abe9-924b41292479, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:15:41 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-6176f596-4265-4ead-b93e-207ce53a4e2e tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:09ba694f-cb2a-4600-abe9-924b41292479, portal: 172.16.0.220,3260]
Aug 26 10:15:41 user nova-compute[73572]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:09ba694f-cb2a-4600-abe9-924b41292479, portal: 172.16.0.220,3260] successful.
Aug 26 10:15:41 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:15:41 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09ba694f-cb2a-4600-abe9-924b41292479 -p 172.16.0.220:3260 --op delete {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:15:41 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09ba694f-cb2a-4600-abe9-924b41292479 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:15:41 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[1858f130-8478-4124-bd56-addc366802fc]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:15:41 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-6176f596-4265-4ead-b93e-207ce53a4e2e tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:15:41 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-6176f596-4265-4ead-b93e-207ce53a4e2e tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.390s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 10:15:41 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-6176f596-4265-4ead-b93e-207ce53a4e2e tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] <== disconnect_volume: return (392ms) None {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 10:15:41 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6176f596-4265-4ead-b93e-207ce53a4e2e tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] [instance: 83670c16-3566-4679-8e74-c6451c840315] Disconnected iSCSI Volume {{(pid=73572) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 10:15:41 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6176f596-4265-4ead-b93e-207ce53a4e2e tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] [instance: 83670c16-3566-4679-8e74-c6451c840315] calling os-brick to detach iSCSI Volume {{(pid=73572) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 10:15:41 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-6176f596-4265-4ead-b93e-207ce53a4e2e tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc89c3d6a10>, {'target_iqns': ['iqn.2010-10.org.openstack:85988ff4-7fac-4a96-a502-74d6ca8189fe'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MeDnamRS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 10:15:41 user nova-compute[73572]: WARNING os_brick.initiator.connectors.base [None req-6176f596-4265-4ead-b93e-207ce53a4e2e tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 10:15:41 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-6176f596-4265-4ead-b93e-207ce53a4e2e tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 10:15:41 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-6176f596-4265-4ead-b93e-207ce53a4e2e tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 10:15:41 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-6176f596-4265-4ead-b93e-207ce53a4e2e tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:85988ff4-7fac-4a96-a502-74d6ca8189fe', 0)] {{(pid=73572) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 10:15:41 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:15:41 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:15:41 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[25082418-f383-43e5-a81f-e132b0638fce]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:75ebe4c4-f791-4f09-a9bd-747ade3d70a3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:85988ff4-7fac-4a96-a502-74d6ca8189fe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ac5c1ee2-3656-49b3-942f-5fc992dc001b\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:15:41 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:15:41 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.041s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:15:41 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[87154749-a170-4da4-bc4c-890311cf85a3]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac5c1ee2-3656-49b3-942f-5fc992dc001b (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85988ff4-7fac-4a96-a502-74d6ca8189fe (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75ebe4c4-f791-4f09-a9bd-747ade3d70a3 (non-flash)\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:15:41 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-6176f596-4265-4ead-b93e-207ce53a4e2e tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac5c1ee2-3656-49b3-942f-5fc992dc001b (non-flash)
Aug 26 10:15:41 user nova-compute[73572]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)
Aug 26 10:15:41 user nova-compute[73572]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85988ff4-7fac-4a96-a502-74d6ca8189fe (non-flash)
Aug 26 10:15:41 user nova-compute[73572]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75ebe4c4-f791-4f09-a9bd-747ade3d70a3 (non-flash)
Aug 26 10:15:41 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 10:15:41 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-6176f596-4265-4ead-b93e-207ce53a4e2e tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac5c1ee2-3656-49b3-942f-5fc992dc001b (non-flash)
Aug 26 10:15:41 user nova-compute[73572]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)
Aug 26 10:15:41 user nova-compute[73572]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85988ff4-7fac-4a96-a502-74d6ca8189fe (non-flash)
Aug 26 10:15:41 user nova-compute[73572]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75ebe4c4-f791-4f09-a9bd-747ade3d70a3 (non-flash)
Aug 26 10:15:41 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 10:15:41 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-6176f596-4265-4ead-b93e-207ce53a4e2e tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc878de43a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:85988ff4-7fac-4a96-a502-74d6ca8189fe'): ({'sdc'}, set())}) {{(pid=73572) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 10:15:41 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-6176f596-4265-4ead-b93e-207ce53a4e2e tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] Removing single pathed devices sdc {{(pid=73572) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 10:15:41 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:15:41 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.029s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:15:41 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[17e90811-5203-4c42-a9b1-afe75ab5f3bb]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:15:41 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:15:41 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:15:41 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc34fb49-5c94-43b2-949e-3ce7e0cfbb3e]: (4, ('ok\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:15:41 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-6176f596-4265-4ead-b93e-207ce53a4e2e tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] Flushing IO for device /dev/sdc {{(pid=73572) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 10:15:41 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:15:41 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:15:41 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c91dfcf-8d42-4fad-990a-ae4193fd52b5]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:15:41 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-6176f596-4265-4ead-b93e-207ce53a4e2e tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73572) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 10:15:41 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:15:41 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.035s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:15:41 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e0125be-53a8-41c1-901e-08ff4b0e9983]: (4, ('1', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:15:41 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-6176f596-4265-4ead-b93e-207ce53a4e2e tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73572) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 10:15:41 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-6176f596-4265-4ead-b93e-207ce53a4e2e tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] SCSI volumes sdc have been removed. {{(pid=73572) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 10:15:41 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-6176f596-4265-4ead-b93e-207ce53a4e2e tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:85988ff4-7fac-4a96-a502-74d6ca8189fe')] {{(pid=73572) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 10:15:41 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85988ff4-7fac-4a96-a502-74d6ca8189fe -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:15:41 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85988ff4-7fac-4a96-a502-74d6ca8189fe -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:15:41 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[74f857af-f66e-49cd-98df-f4424241ebb0]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:15:41 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-6176f596-4265-4ead-b93e-207ce53a4e2e tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:15:41 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85988ff4-7fac-4a96-a502-74d6ca8189fe -p 172.16.0.220:3260 --logout {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:15:41 user nova-compute[73572]: DEBUG nova.compute.manager [req-52682c99-5fae-46bb-a343-1988aaef6aa1 req-35e0a77b-dfe0-48f2-92e4-cd7dedb1ed77 service nova] [instance: 83670c16-3566-4679-8e74-c6451c840315] Received event network-vif-plugged-5e85b3cc-9fe4-46aa-a43f-d4acc5ca3c73 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:15:41 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-52682c99-5fae-46bb-a343-1988aaef6aa1 req-35e0a77b-dfe0-48f2-92e4-cd7dedb1ed77 service nova] Acquiring lock "83670c16-3566-4679-8e74-c6451c840315-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:15:41 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-52682c99-5fae-46bb-a343-1988aaef6aa1 req-35e0a77b-dfe0-48f2-92e4-cd7dedb1ed77 service nova] Lock "83670c16-3566-4679-8e74-c6451c840315-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:15:41 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-52682c99-5fae-46bb-a343-1988aaef6aa1 req-35e0a77b-dfe0-48f2-92e4-cd7dedb1ed77 service nova] Lock "83670c16-3566-4679-8e74-c6451c840315-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:15:41 user nova-compute[73572]: DEBUG nova.compute.manager [req-52682c99-5fae-46bb-a343-1988aaef6aa1 req-35e0a77b-dfe0-48f2-92e4-cd7dedb1ed77 service nova] [instance: 83670c16-3566-4679-8e74-c6451c840315] No waiting events found dispatching network-vif-plugged-5e85b3cc-9fe4-46aa-a43f-d4acc5ca3c73 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:15:41 user nova-compute[73572]: WARNING nova.compute.manager [req-52682c99-5fae-46bb-a343-1988aaef6aa1 req-35e0a77b-dfe0-48f2-92e4-cd7dedb1ed77 service nova] [instance: 83670c16-3566-4679-8e74-c6451c840315] Received unexpected event network-vif-plugged-5e85b3cc-9fe4-46aa-a43f-d4acc5ca3c73 for instance with vm_state active and task_state deleting.
Aug 26 10:15:41 user nova-compute[73572]: DEBUG nova.compute.manager [req-52682c99-5fae-46bb-a343-1988aaef6aa1 req-35e0a77b-dfe0-48f2-92e4-cd7dedb1ed77 service nova] [instance: 83670c16-3566-4679-8e74-c6451c840315] Received event network-vif-unplugged-7b7b7362-9dcc-48da-ad4e-9141c676839e {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:15:41 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-52682c99-5fae-46bb-a343-1988aaef6aa1 req-35e0a77b-dfe0-48f2-92e4-cd7dedb1ed77 service nova] Acquiring lock "83670c16-3566-4679-8e74-c6451c840315-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:15:41 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-52682c99-5fae-46bb-a343-1988aaef6aa1 req-35e0a77b-dfe0-48f2-92e4-cd7dedb1ed77 service nova] Lock "83670c16-3566-4679-8e74-c6451c840315-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:15:41 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-52682c99-5fae-46bb-a343-1988aaef6aa1 req-35e0a77b-dfe0-48f2-92e4-cd7dedb1ed77 service nova] Lock "83670c16-3566-4679-8e74-c6451c840315-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:15:41 user nova-compute[73572]: DEBUG nova.compute.manager [req-52682c99-5fae-46bb-a343-1988aaef6aa1 req-35e0a77b-dfe0-48f2-92e4-cd7dedb1ed77 service nova] [instance: 83670c16-3566-4679-8e74-c6451c840315] No waiting events found dispatching network-vif-unplugged-7b7b7362-9dcc-48da-ad4e-9141c676839e {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:15:41 user nova-compute[73572]: DEBUG nova.compute.manager [req-52682c99-5fae-46bb-a343-1988aaef6aa1 req-35e0a77b-dfe0-48f2-92e4-cd7dedb1ed77 service nova] [instance: 83670c16-3566-4679-8e74-c6451c840315] Received event network-vif-unplugged-7b7b7362-9dcc-48da-ad4e-9141c676839e for instance with task_state deleting. {{(pid=73572) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 10:15:41 user nova-compute[73572]: DEBUG nova.compute.manager [req-52682c99-5fae-46bb-a343-1988aaef6aa1 req-35e0a77b-dfe0-48f2-92e4-cd7dedb1ed77 service nova] [instance: 83670c16-3566-4679-8e74-c6451c840315] Received event network-vif-plugged-7b7b7362-9dcc-48da-ad4e-9141c676839e {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:15:41 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-52682c99-5fae-46bb-a343-1988aaef6aa1 req-35e0a77b-dfe0-48f2-92e4-cd7dedb1ed77 service nova] Acquiring lock "83670c16-3566-4679-8e74-c6451c840315-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:15:41 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-52682c99-5fae-46bb-a343-1988aaef6aa1 req-35e0a77b-dfe0-48f2-92e4-cd7dedb1ed77 service nova] Lock "83670c16-3566-4679-8e74-c6451c840315-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:15:41 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-52682c99-5fae-46bb-a343-1988aaef6aa1 req-35e0a77b-dfe0-48f2-92e4-cd7dedb1ed77 service nova] Lock "83670c16-3566-4679-8e74-c6451c840315-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:15:41 user nova-compute[73572]: DEBUG nova.compute.manager [req-52682c99-5fae-46bb-a343-1988aaef6aa1 req-35e0a77b-dfe0-48f2-92e4-cd7dedb1ed77 service nova] [instance: 83670c16-3566-4679-8e74-c6451c840315] No waiting events found dispatching network-vif-plugged-7b7b7362-9dcc-48da-ad4e-9141c676839e {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:15:41 user nova-compute[73572]: WARNING nova.compute.manager [req-52682c99-5fae-46bb-a343-1988aaef6aa1 req-35e0a77b-dfe0-48f2-92e4-cd7dedb1ed77 service nova] [instance: 83670c16-3566-4679-8e74-c6451c840315] Received unexpected event network-vif-plugged-7b7b7362-9dcc-48da-ad4e-9141c676839e for instance with vm_state active and task_state deleting.
Aug 26 10:15:41 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85988ff4-7fac-4a96-a502-74d6ca8189fe -p 172.16.0.220:3260 --logout" returned: 0 in 0.078s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:15:41 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef9ff70d-938d-432a-8126-8e0f3238e304]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:85988ff4-7fac-4a96-a502-74d6ca8189fe, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:85988ff4-7fac-4a96-a502-74d6ca8189fe, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:15:41 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-6176f596-4265-4ead-b93e-207ce53a4e2e tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:85988ff4-7fac-4a96-a502-74d6ca8189fe, portal: 172.16.0.220,3260]
Aug 26 10:15:41 user nova-compute[73572]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:85988ff4-7fac-4a96-a502-74d6ca8189fe, portal: 172.16.0.220,3260] successful.
Aug 26 10:15:41 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:15:41 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85988ff4-7fac-4a96-a502-74d6ca8189fe -p 172.16.0.220:3260 --op delete {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:15:41 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85988ff4-7fac-4a96-a502-74d6ca8189fe -p 172.16.0.220:3260 --op delete" returned: 0 in 0.160s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:15:41 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e36427f-72aa-4b32-b39f-b2c70451e1b8]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:15:41 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-6176f596-4265-4ead-b93e-207ce53a4e2e tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:15:41 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-6176f596-4265-4ead-b93e-207ce53a4e2e tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.489s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 10:15:41 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-6176f596-4265-4ead-b93e-207ce53a4e2e tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] <== disconnect_volume: return (490ms) None {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 10:15:41 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6176f596-4265-4ead-b93e-207ce53a4e2e tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] [instance: 83670c16-3566-4679-8e74-c6451c840315] Disconnected iSCSI Volume {{(pid=73572) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 10:15:41 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6176f596-4265-4ead-b93e-207ce53a4e2e tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] [instance: 83670c16-3566-4679-8e74-c6451c840315] calling os-brick to detach iSCSI Volume {{(pid=73572) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 10:15:41 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-6176f596-4265-4ead-b93e-207ce53a4e2e tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc89c3d6a10>, {'target_iqns': ['iqn.2010-10.org.openstack:75ebe4c4-f791-4f09-a9bd-747ade3d70a3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ghQFCVAp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 10:15:41 user nova-compute[73572]: WARNING os_brick.initiator.connectors.base [None req-6176f596-4265-4ead-b93e-207ce53a4e2e tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 10:15:41 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-6176f596-4265-4ead-b93e-207ce53a4e2e tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 10:15:41 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-6176f596-4265-4ead-b93e-207ce53a4e2e tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 10:15:41 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-6176f596-4265-4ead-b93e-207ce53a4e2e tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:75ebe4c4-f791-4f09-a9bd-747ade3d70a3', 0)] {{(pid=73572) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 10:15:41 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:15:41 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:15:41 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb62954e-e0cb-478b-808d-d3f3acdf0eb0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:75ebe4c4-f791-4f09-a9bd-747ade3d70a3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ac5c1ee2-3656-49b3-942f-5fc992dc001b\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:15:41 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:15:41 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:15:41 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[32ae9be6-06d2-4d82-aa11-026646bcd0f3]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac5c1ee2-3656-49b3-942f-5fc992dc001b (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75ebe4c4-f791-4f09-a9bd-747ade3d70a3 (non-flash)\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:15:41 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-6176f596-4265-4ead-b93e-207ce53a4e2e tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac5c1ee2-3656-49b3-942f-5fc992dc001b (non-flash)
Aug 26 10:15:41 user nova-compute[73572]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)
Aug 26 10:15:41 user nova-compute[73572]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75ebe4c4-f791-4f09-a9bd-747ade3d70a3 (non-flash)
Aug 26 10:15:41 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 10:15:41 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-6176f596-4265-4ead-b93e-207ce53a4e2e tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac5c1ee2-3656-49b3-942f-5fc992dc001b (non-flash)
Aug 26 10:15:41 user nova-compute[73572]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)
Aug 26 10:15:41 user nova-compute[73572]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75ebe4c4-f791-4f09-a9bd-747ade3d70a3 (non-flash)
Aug 26 10:15:41 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 10:15:41 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-6176f596-4265-4ead-b93e-207ce53a4e2e tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc878de43a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:75ebe4c4-f791-4f09-a9bd-747ade3d70a3'): ({'sdd'}, set())}) {{(pid=73572) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 10:15:41 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-6176f596-4265-4ead-b93e-207ce53a4e2e tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] Removing single pathed devices sdd {{(pid=73572) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 10:15:41 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:15:41 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:15:41 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1048015-223e-4aa4-b15c-b4379b44a7e5]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:15:41 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:15:41 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:15:41 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[f85f4723-a09c-4b35-b963-030b33a6259b]: (4, ('ok\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:15:41 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-6176f596-4265-4ead-b93e-207ce53a4e2e tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] Flushing IO for device /dev/sdd {{(pid=73572) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 10:15:41 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:15:41 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:15:41 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:15:41 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a576651-5e6f-4387-bc05-265541354824]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:15:41 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-6176f596-4265-4ead-b93e-207ce53a4e2e tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73572) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 10:15:41 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:15:41 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:15:41 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.055s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:15:41 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[965779c6-4368-467b-ac7f-309be098b718]: (4, ('1', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:15:41 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-6176f596-4265-4ead-b93e-207ce53a4e2e tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73572) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 10:15:41 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-6176f596-4265-4ead-b93e-207ce53a4e2e tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] SCSI volumes sdd have been removed. {{(pid=73572) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 10:15:41 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-6176f596-4265-4ead-b93e-207ce53a4e2e tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:75ebe4c4-f791-4f09-a9bd-747ade3d70a3')] {{(pid=73572) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 10:15:41 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75ebe4c4-f791-4f09-a9bd-747ade3d70a3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:15:41 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75ebe4c4-f791-4f09-a9bd-747ade3d70a3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:15:41 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa4b193c-8943-43b9-b9c5-3d3c25f71073]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:15:41 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-6176f596-4265-4ead-b93e-207ce53a4e2e tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:15:41 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75ebe4c4-f791-4f09-a9bd-747ade3d70a3 -p 172.16.0.220:3260 --logout {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:15:42 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75ebe4c4-f791-4f09-a9bd-747ade3d70a3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:15:42 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[252d54c6-7fcf-437a-a7ad-d6b899ff459d]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:75ebe4c4-f791-4f09-a9bd-747ade3d70a3, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:75ebe4c4-f791-4f09-a9bd-747ade3d70a3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:15:42 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-6176f596-4265-4ead-b93e-207ce53a4e2e tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:75ebe4c4-f791-4f09-a9bd-747ade3d70a3, portal: 172.16.0.220,3260]
Aug 26 10:15:42 user nova-compute[73572]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:75ebe4c4-f791-4f09-a9bd-747ade3d70a3, portal: 172.16.0.220,3260] successful.
Aug 26 10:15:42 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:15:42 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75ebe4c4-f791-4f09-a9bd-747ade3d70a3 -p 172.16.0.220:3260 --op delete {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:15:42 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75ebe4c4-f791-4f09-a9bd-747ade3d70a3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:15:42 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[715b1677-6eac-4301-aaa2-864413eaa1d4]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:15:42 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-6176f596-4265-4ead-b93e-207ce53a4e2e tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:15:42 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-6176f596-4265-4ead-b93e-207ce53a4e2e tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.348s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 10:15:42 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-6176f596-4265-4ead-b93e-207ce53a4e2e tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] <== disconnect_volume: return (349ms) None {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 10:15:42 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6176f596-4265-4ead-b93e-207ce53a4e2e tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] [instance: 83670c16-3566-4679-8e74-c6451c840315] Disconnected iSCSI Volume {{(pid=73572) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 10:15:42 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-6176f596-4265-4ead-b93e-207ce53a4e2e tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] [instance: 83670c16-3566-4679-8e74-c6451c840315] Deleting instance files /opt/stack/data/nova/instances/83670c16-3566-4679-8e74-c6451c840315_del
Aug 26 10:15:42 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-6176f596-4265-4ead-b93e-207ce53a4e2e tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] [instance: 83670c16-3566-4679-8e74-c6451c840315] Deletion of /opt/stack/data/nova/instances/83670c16-3566-4679-8e74-c6451c840315_del complete
Aug 26 10:15:42 user nova-compute[73572]: INFO nova.compute.manager [None req-6176f596-4265-4ead-b93e-207ce53a4e2e tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] [instance: 83670c16-3566-4679-8e74-c6451c840315] Took 4.15 seconds to destroy the instance on the hypervisor.
Aug 26 10:15:42 user nova-compute[73572]: DEBUG oslo.service.loopingcall [None req-6176f596-4265-4ead-b93e-207ce53a4e2e tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73572) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 10:15:42 user nova-compute[73572]: DEBUG nova.compute.manager [-] [instance: 83670c16-3566-4679-8e74-c6451c840315] Deallocating network for instance {{(pid=73572) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 10:15:42 user nova-compute[73572]: DEBUG nova.network.neutron [-] [instance: 83670c16-3566-4679-8e74-c6451c840315] deallocate_for_instance() {{(pid=73572) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 10:15:42 user nova-compute[73572]: DEBUG nova.compute.manager [req-987cdc79-a3ae-45e6-aca6-d86fa058ae00 req-da361152-476c-4984-9ea3-33a9edcc1381 service nova] [instance: 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55] Received event network-vif-plugged-ebf9f385-e59b-4060-9bf9-a8d2006327b4 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:15:42 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-987cdc79-a3ae-45e6-aca6-d86fa058ae00 req-da361152-476c-4984-9ea3-33a9edcc1381 service nova] Acquiring lock "0fe47a17-4ffb-48ce-b0f6-a9b43002bd55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:15:42 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-987cdc79-a3ae-45e6-aca6-d86fa058ae00 req-da361152-476c-4984-9ea3-33a9edcc1381 service nova] Lock "0fe47a17-4ffb-48ce-b0f6-a9b43002bd55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:15:42 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-987cdc79-a3ae-45e6-aca6-d86fa058ae00 req-da361152-476c-4984-9ea3-33a9edcc1381 service nova] Lock "0fe47a17-4ffb-48ce-b0f6-a9b43002bd55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:15:42 user nova-compute[73572]: DEBUG nova.compute.manager [req-987cdc79-a3ae-45e6-aca6-d86fa058ae00 req-da361152-476c-4984-9ea3-33a9edcc1381 service nova] [instance: 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55] No waiting events found dispatching network-vif-plugged-ebf9f385-e59b-4060-9bf9-a8d2006327b4 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:15:42 user nova-compute[73572]: WARNING nova.compute.manager [req-987cdc79-a3ae-45e6-aca6-d86fa058ae00 req-da361152-476c-4984-9ea3-33a9edcc1381 service nova] [instance: 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55] Received unexpected event network-vif-plugged-ebf9f385-e59b-4060-9bf9-a8d2006327b4 for instance with vm_state building and task_state spawning.
Aug 26 10:15:42 user nova-compute[73572]: DEBUG nova.compute.manager [req-987cdc79-a3ae-45e6-aca6-d86fa058ae00 req-da361152-476c-4984-9ea3-33a9edcc1381 service nova] [instance: 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55] Received event network-vif-plugged-ebf9f385-e59b-4060-9bf9-a8d2006327b4 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:15:42 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-987cdc79-a3ae-45e6-aca6-d86fa058ae00 req-da361152-476c-4984-9ea3-33a9edcc1381 service nova] Acquiring lock "0fe47a17-4ffb-48ce-b0f6-a9b43002bd55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:15:42 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-987cdc79-a3ae-45e6-aca6-d86fa058ae00 req-da361152-476c-4984-9ea3-33a9edcc1381 service nova] Lock "0fe47a17-4ffb-48ce-b0f6-a9b43002bd55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:15:42 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-987cdc79-a3ae-45e6-aca6-d86fa058ae00 req-da361152-476c-4984-9ea3-33a9edcc1381 service nova] Lock "0fe47a17-4ffb-48ce-b0f6-a9b43002bd55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:15:42 user nova-compute[73572]: DEBUG nova.compute.manager [req-987cdc79-a3ae-45e6-aca6-d86fa058ae00 req-da361152-476c-4984-9ea3-33a9edcc1381 service nova] [instance: 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55] No waiting events found dispatching network-vif-plugged-ebf9f385-e59b-4060-9bf9-a8d2006327b4 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:15:42 user nova-compute[73572]: WARNING nova.compute.manager [req-987cdc79-a3ae-45e6-aca6-d86fa058ae00 req-da361152-476c-4984-9ea3-33a9edcc1381 service nova] [instance: 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55] Received unexpected event network-vif-plugged-ebf9f385-e59b-4060-9bf9-a8d2006327b4 for instance with vm_state building and task_state spawning.
Aug 26 10:15:43 user nova-compute[73572]: DEBUG nova.virt.driver [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Emitting event <LifecycleEvent: 1693044943.8826742, 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55 => Resumed> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:15:43 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55] VM Resumed (Lifecycle Event)
Aug 26 10:15:43 user nova-compute[73572]: DEBUG nova.compute.manager [None req-6cda5169-8360-44bf-b3c1-3c4e62b0831c tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] [instance: 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55] Instance event wait completed in 0 seconds for  {{(pid=73572) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 10:15:43 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-6cda5169-8360-44bf-b3c1-3c4e62b0831c tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] [instance: 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55] Guest created on hypervisor {{(pid=73572) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 10:15:43 user nova-compute[73572]: INFO nova.virt.libvirt.driver [-] [instance: 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55] Instance spawned successfully.
Aug 26 10:15:43 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-6cda5169-8360-44bf-b3c1-3c4e62b0831c tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] [instance: 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 10:15:43 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:15:43 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73572) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 10:15:43 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-6cda5169-8360-44bf-b3c1-3c4e62b0831c tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] [instance: 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55] Found default for hw_cdrom_bus of ide {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:15:43 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-6cda5169-8360-44bf-b3c1-3c4e62b0831c tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] [instance: 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55] Found default for hw_disk_bus of virtio {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:15:43 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-6cda5169-8360-44bf-b3c1-3c4e62b0831c tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] [instance: 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55] Found default for hw_input_bus of None {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:15:43 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-6cda5169-8360-44bf-b3c1-3c4e62b0831c tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] [instance: 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55] Found default for hw_pointer_model of None {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:15:43 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-6cda5169-8360-44bf-b3c1-3c4e62b0831c tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] [instance: 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55] Found default for hw_video_model of virtio {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:15:43 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-6cda5169-8360-44bf-b3c1-3c4e62b0831c tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] [instance: 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55] Found default for hw_vif_model of virtio {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:15:43 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 10:15:43 user nova-compute[73572]: DEBUG nova.virt.driver [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Emitting event <LifecycleEvent: 1693044943.883769, 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55 => Started> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:15:43 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55] VM Started (Lifecycle Event)
Aug 26 10:15:43 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:15:43 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73572) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 10:15:43 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 10:15:44 user nova-compute[73572]: INFO nova.compute.manager [None req-6cda5169-8360-44bf-b3c1-3c4e62b0831c tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] [instance: 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55] Took 8.07 seconds to spawn the instance on the hypervisor.
Aug 26 10:15:44 user nova-compute[73572]: DEBUG nova.compute.manager [None req-6cda5169-8360-44bf-b3c1-3c4e62b0831c tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] [instance: 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:15:44 user nova-compute[73572]: INFO nova.compute.manager [None req-6cda5169-8360-44bf-b3c1-3c4e62b0831c tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] [instance: 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55] Took 9.27 seconds to build instance.
Aug 26 10:15:44 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-6cda5169-8360-44bf-b3c1-3c4e62b0831c tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Lock "0fe47a17-4ffb-48ce-b0f6-a9b43002bd55" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.373s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:15:44 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:15:44 user nova-compute[73572]: DEBUG nova.compute.manager [req-1eb58eae-71bb-4282-8e00-b3a60d8d2891 req-e91b7240-1342-451c-af75-5617f9118ff6 service nova] [instance: 83670c16-3566-4679-8e74-c6451c840315] Received event network-vif-deleted-5e85b3cc-9fe4-46aa-a43f-d4acc5ca3c73 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:15:44 user nova-compute[73572]: INFO nova.compute.manager [req-1eb58eae-71bb-4282-8e00-b3a60d8d2891 req-e91b7240-1342-451c-af75-5617f9118ff6 service nova] [instance: 83670c16-3566-4679-8e74-c6451c840315] Neutron deleted interface 5e85b3cc-9fe4-46aa-a43f-d4acc5ca3c73; detaching it from the instance and deleting it from the info cache
Aug 26 10:15:44 user nova-compute[73572]: DEBUG nova.network.neutron [req-1eb58eae-71bb-4282-8e00-b3a60d8d2891 req-e91b7240-1342-451c-af75-5617f9118ff6 service nova] [instance: 83670c16-3566-4679-8e74-c6451c840315] Updating instance_info_cache with network_info: [{"id": "71be4c62-7219-45ca-8047-ab6716b37f6a", "address": "fa:16:3e:5b:5d:84", "network": {"id": "0a1bb03e-917c-4df5-84cc-bd7729b69ab6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-258329362-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9de7931c97d448eaa26d295386b3a999", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71be4c62-72", "ovs_interfaceid": "71be4c62-7219-45ca-8047-ab6716b37f6a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "84bf04a4-b563-48c5-aa73-5b54cbb4887f", "address": "fa:16:3e:e2:c6:ae", "network": {"id": "e194b396-7c3f-41f3-99b2-f82b55c779f2", "bridge": "br-int", "label": "tempest-device-tagging-net1-1768943373", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.226", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9de7931c97d448eaa26d295386b3a999", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84bf04a4-b5", "ovs_interfaceid": "84bf04a4-b563-48c5-aa73-5b54cbb4887f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f4d684f0-2fe0-46e6-8f84-e2c0918a5a82", "address": "fa:16:3e:a6:7f:bd", "network": {"id": "e194b396-7c3f-41f3-99b2-f82b55c779f2", "bridge": "br-int", "label": "tempest-device-tagging-net1-1768943373", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.191", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9de7931c97d448eaa26d295386b3a999", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4d684f0-2f", "ovs_interfaceid": "f4d684f0-2fe0-46e6-8f84-e2c0918a5a82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "41a7ee04-5b67-4da6-a543-0d15187e5813", "address": "fa:16:3e:32:50:ef", "network": {"id": "e194b396-7c3f-41f3-99b2-f82b55c779f2", "bridge": "br-int", "label": "tempest-device-tagging-net1-1768943373", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.158", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9de7931c97d448eaa26d295386b3a999", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41a7ee04-5b", "ovs_interfaceid": "41a7ee04-5b67-4da6-a543-0d15187e5813", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "422eb7ef-4540-462b-a485-afdc38ebccd0", "address": "fa:16:3e:79:44:99", "network": {"id": "e194b396-7c3f-41f3-99b2-f82b55c779f2", "bridge": "br-int", "label": "tempest-device-tagging-net1-1768943373", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9de7931c97d448eaa26d295386b3a999", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap422eb7ef-45", "ovs_interfaceid": "422eb7ef-4540-462b-a485-afdc38ebccd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7b7b7362-9dcc-48da-ad4e-9141c676839e", "address": "fa:16:3e:0b:b5:3a", "network": {"id": "2cfbe057-f10f-4b28-b3bf-98b2ef5103d7", "bridge": "br-int", "label": "tempest-device-tagging-net2-598168548", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9de7931c97d448eaa26d295386b3a999", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b7b7362-9d", "ovs_interfaceid": "7b7b7362-9dcc-48da-ad4e-9141c676839e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:15:44 user nova-compute[73572]: DEBUG nova.compute.manager [req-1eb58eae-71bb-4282-8e00-b3a60d8d2891 req-e91b7240-1342-451c-af75-5617f9118ff6 service nova] [instance: 83670c16-3566-4679-8e74-c6451c840315] Detach interface failed, port_id=5e85b3cc-9fe4-46aa-a43f-d4acc5ca3c73, reason: Instance 83670c16-3566-4679-8e74-c6451c840315 could not be found. {{(pid=73572) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 10:15:45 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:15:46 user nova-compute[73572]: DEBUG nova.compute.manager [req-3e3ff996-1f96-48bb-a3b7-99fa1c069a65 req-beacefd5-f89c-4f77-a2df-ef4cd828c858 service nova] [instance: 83670c16-3566-4679-8e74-c6451c840315] Received event network-vif-deleted-7b7b7362-9dcc-48da-ad4e-9141c676839e {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:15:46 user nova-compute[73572]: INFO nova.compute.manager [req-3e3ff996-1f96-48bb-a3b7-99fa1c069a65 req-beacefd5-f89c-4f77-a2df-ef4cd828c858 service nova] [instance: 83670c16-3566-4679-8e74-c6451c840315] Neutron deleted interface 7b7b7362-9dcc-48da-ad4e-9141c676839e; detaching it from the instance and deleting it from the info cache
Aug 26 10:15:46 user nova-compute[73572]: DEBUG nova.network.neutron [req-3e3ff996-1f96-48bb-a3b7-99fa1c069a65 req-beacefd5-f89c-4f77-a2df-ef4cd828c858 service nova] [instance: 83670c16-3566-4679-8e74-c6451c840315] Updating instance_info_cache with network_info: [{"id": "71be4c62-7219-45ca-8047-ab6716b37f6a", "address": "fa:16:3e:5b:5d:84", "network": {"id": "0a1bb03e-917c-4df5-84cc-bd7729b69ab6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-258329362-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9de7931c97d448eaa26d295386b3a999", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71be4c62-72", "ovs_interfaceid": "71be4c62-7219-45ca-8047-ab6716b37f6a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "84bf04a4-b563-48c5-aa73-5b54cbb4887f", "address": "fa:16:3e:e2:c6:ae", "network": {"id": "e194b396-7c3f-41f3-99b2-f82b55c779f2", "bridge": "br-int", "label": "tempest-device-tagging-net1-1768943373", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.226", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9de7931c97d448eaa26d295386b3a999", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84bf04a4-b5", "ovs_interfaceid": "84bf04a4-b563-48c5-aa73-5b54cbb4887f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f4d684f0-2fe0-46e6-8f84-e2c0918a5a82", "address": "fa:16:3e:a6:7f:bd", "network": {"id": "e194b396-7c3f-41f3-99b2-f82b55c779f2", "bridge": "br-int", "label": "tempest-device-tagging-net1-1768943373", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.191", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9de7931c97d448eaa26d295386b3a999", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4d684f0-2f", "ovs_interfaceid": "f4d684f0-2fe0-46e6-8f84-e2c0918a5a82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "41a7ee04-5b67-4da6-a543-0d15187e5813", "address": "fa:16:3e:32:50:ef", "network": {"id": "e194b396-7c3f-41f3-99b2-f82b55c779f2", "bridge": "br-int", "label": "tempest-device-tagging-net1-1768943373", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.158", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9de7931c97d448eaa26d295386b3a999", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41a7ee04-5b", "ovs_interfaceid": "41a7ee04-5b67-4da6-a543-0d15187e5813", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "422eb7ef-4540-462b-a485-afdc38ebccd0", "address": "fa:16:3e:79:44:99", "network": {"id": "e194b396-7c3f-41f3-99b2-f82b55c779f2", "bridge": "br-int", "label": "tempest-device-tagging-net1-1768943373", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9de7931c97d448eaa26d295386b3a999", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap422eb7ef-45", "ovs_interfaceid": "422eb7ef-4540-462b-a485-afdc38ebccd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:15:46 user nova-compute[73572]: DEBUG nova.compute.manager [req-3e3ff996-1f96-48bb-a3b7-99fa1c069a65 req-beacefd5-f89c-4f77-a2df-ef4cd828c858 service nova] [instance: 83670c16-3566-4679-8e74-c6451c840315] Detach interface failed, port_id=7b7b7362-9dcc-48da-ad4e-9141c676839e, reason: Instance 83670c16-3566-4679-8e74-c6451c840315 could not be found. {{(pid=73572) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 10:15:46 user nova-compute[73572]: DEBUG nova.compute.manager [req-3e3ff996-1f96-48bb-a3b7-99fa1c069a65 req-beacefd5-f89c-4f77-a2df-ef4cd828c858 service nova] [instance: 83670c16-3566-4679-8e74-c6451c840315] Received event network-vif-deleted-422eb7ef-4540-462b-a485-afdc38ebccd0 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:15:46 user nova-compute[73572]: INFO nova.compute.manager [req-3e3ff996-1f96-48bb-a3b7-99fa1c069a65 req-beacefd5-f89c-4f77-a2df-ef4cd828c858 service nova] [instance: 83670c16-3566-4679-8e74-c6451c840315] Neutron deleted interface 422eb7ef-4540-462b-a485-afdc38ebccd0; detaching it from the instance and deleting it from the info cache
Aug 26 10:15:46 user nova-compute[73572]: DEBUG nova.network.neutron [req-3e3ff996-1f96-48bb-a3b7-99fa1c069a65 req-beacefd5-f89c-4f77-a2df-ef4cd828c858 service nova] [instance: 83670c16-3566-4679-8e74-c6451c840315] Updating instance_info_cache with network_info: [{"id": "71be4c62-7219-45ca-8047-ab6716b37f6a", "address": "fa:16:3e:5b:5d:84", "network": {"id": "0a1bb03e-917c-4df5-84cc-bd7729b69ab6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-258329362-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9de7931c97d448eaa26d295386b3a999", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71be4c62-72", "ovs_interfaceid": "71be4c62-7219-45ca-8047-ab6716b37f6a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "84bf04a4-b563-48c5-aa73-5b54cbb4887f", "address": "fa:16:3e:e2:c6:ae", "network": {"id": "e194b396-7c3f-41f3-99b2-f82b55c779f2", "bridge": "br-int", "label": "tempest-device-tagging-net1-1768943373", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.226", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9de7931c97d448eaa26d295386b3a999", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84bf04a4-b5", "ovs_interfaceid": "84bf04a4-b563-48c5-aa73-5b54cbb4887f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f4d684f0-2fe0-46e6-8f84-e2c0918a5a82", "address": "fa:16:3e:a6:7f:bd", "network": {"id": "e194b396-7c3f-41f3-99b2-f82b55c779f2", "bridge": "br-int", "label": "tempest-device-tagging-net1-1768943373", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.191", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9de7931c97d448eaa26d295386b3a999", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4d684f0-2f", "ovs_interfaceid": "f4d684f0-2fe0-46e6-8f84-e2c0918a5a82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "41a7ee04-5b67-4da6-a543-0d15187e5813", "address": "fa:16:3e:32:50:ef", "network": {"id": "e194b396-7c3f-41f3-99b2-f82b55c779f2", "bridge": "br-int", "label": "tempest-device-tagging-net1-1768943373", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.158", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9de7931c97d448eaa26d295386b3a999", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41a7ee04-5b", "ovs_interfaceid": "41a7ee04-5b67-4da6-a543-0d15187e5813", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:15:46 user nova-compute[73572]: DEBUG nova.network.neutron [-] [instance: 83670c16-3566-4679-8e74-c6451c840315] Updating instance_info_cache with network_info: [] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:15:46 user nova-compute[73572]: DEBUG nova.compute.manager [req-3e3ff996-1f96-48bb-a3b7-99fa1c069a65 req-beacefd5-f89c-4f77-a2df-ef4cd828c858 service nova] [instance: 83670c16-3566-4679-8e74-c6451c840315] Detach interface failed, port_id=422eb7ef-4540-462b-a485-afdc38ebccd0, reason: Instance 83670c16-3566-4679-8e74-c6451c840315 could not be found. {{(pid=73572) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 10:15:46 user nova-compute[73572]: DEBUG nova.compute.manager [req-3e3ff996-1f96-48bb-a3b7-99fa1c069a65 req-beacefd5-f89c-4f77-a2df-ef4cd828c858 service nova] [instance: 83670c16-3566-4679-8e74-c6451c840315] Received event network-vif-deleted-71be4c62-7219-45ca-8047-ab6716b37f6a {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:15:46 user nova-compute[73572]: INFO nova.compute.manager [req-3e3ff996-1f96-48bb-a3b7-99fa1c069a65 req-beacefd5-f89c-4f77-a2df-ef4cd828c858 service nova] [instance: 83670c16-3566-4679-8e74-c6451c840315] Neutron deleted interface 71be4c62-7219-45ca-8047-ab6716b37f6a; detaching it from the instance and deleting it from the info cache
Aug 26 10:15:46 user nova-compute[73572]: DEBUG nova.network.neutron [req-3e3ff996-1f96-48bb-a3b7-99fa1c069a65 req-beacefd5-f89c-4f77-a2df-ef4cd828c858 service nova] [instance: 83670c16-3566-4679-8e74-c6451c840315] Updating instance_info_cache with network_info: [{"id": "84bf04a4-b563-48c5-aa73-5b54cbb4887f", "address": "fa:16:3e:e2:c6:ae", "network": {"id": "e194b396-7c3f-41f3-99b2-f82b55c779f2", "bridge": "br-int", "label": "tempest-device-tagging-net1-1768943373", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.226", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9de7931c97d448eaa26d295386b3a999", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84bf04a4-b5", "ovs_interfaceid": "84bf04a4-b563-48c5-aa73-5b54cbb4887f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f4d684f0-2fe0-46e6-8f84-e2c0918a5a82", "address": "fa:16:3e:a6:7f:bd", "network": {"id": "e194b396-7c3f-41f3-99b2-f82b55c779f2", "bridge": "br-int", "label": "tempest-device-tagging-net1-1768943373", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.191", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9de7931c97d448eaa26d295386b3a999", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4d684f0-2f", "ovs_interfaceid": "f4d684f0-2fe0-46e6-8f84-e2c0918a5a82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "41a7ee04-5b67-4da6-a543-0d15187e5813", "address": "fa:16:3e:32:50:ef", "network": {"id": "e194b396-7c3f-41f3-99b2-f82b55c779f2", "bridge": "br-int", "label": "tempest-device-tagging-net1-1768943373", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.158", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9de7931c97d448eaa26d295386b3a999", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41a7ee04-5b", "ovs_interfaceid": "41a7ee04-5b67-4da6-a543-0d15187e5813", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:15:46 user nova-compute[73572]: INFO nova.compute.manager [-] [instance: 83670c16-3566-4679-8e74-c6451c840315] Took 4.32 seconds to deallocate network for instance.
Aug 26 10:15:46 user nova-compute[73572]: DEBUG nova.compute.manager [req-3e3ff996-1f96-48bb-a3b7-99fa1c069a65 req-beacefd5-f89c-4f77-a2df-ef4cd828c858 service nova] [instance: 83670c16-3566-4679-8e74-c6451c840315] Detach interface failed, port_id=71be4c62-7219-45ca-8047-ab6716b37f6a, reason: Instance 83670c16-3566-4679-8e74-c6451c840315 could not be found. {{(pid=73572) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 10:15:48 user nova-compute[73572]: DEBUG nova.compute.manager [req-be2b7524-90c2-4780-b404-75b903191e8e req-6652572d-705a-4c47-9727-26b0c149549b service nova] [instance: 83670c16-3566-4679-8e74-c6451c840315] Received event network-vif-deleted-41a7ee04-5b67-4da6-a543-0d15187e5813 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:15:48 user nova-compute[73572]: INFO nova.compute.manager [req-be2b7524-90c2-4780-b404-75b903191e8e req-6652572d-705a-4c47-9727-26b0c149549b service nova] [instance: 83670c16-3566-4679-8e74-c6451c840315] Neutron deleted interface 41a7ee04-5b67-4da6-a543-0d15187e5813; detaching it from the instance and deleting it from the info cache
Aug 26 10:15:48 user nova-compute[73572]: DEBUG nova.network.neutron [req-be2b7524-90c2-4780-b404-75b903191e8e req-6652572d-705a-4c47-9727-26b0c149549b service nova] [instance: 83670c16-3566-4679-8e74-c6451c840315] Updating instance_info_cache with network_info: [{"id": "84bf04a4-b563-48c5-aa73-5b54cbb4887f", "address": "fa:16:3e:e2:c6:ae", "network": {"id": "e194b396-7c3f-41f3-99b2-f82b55c779f2", "bridge": "br-int", "label": "tempest-device-tagging-net1-1768943373", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.226", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9de7931c97d448eaa26d295386b3a999", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84bf04a4-b5", "ovs_interfaceid": "84bf04a4-b563-48c5-aa73-5b54cbb4887f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f4d684f0-2fe0-46e6-8f84-e2c0918a5a82", "address": "fa:16:3e:a6:7f:bd", "network": {"id": "e194b396-7c3f-41f3-99b2-f82b55c779f2", "bridge": "br-int", "label": "tempest-device-tagging-net1-1768943373", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.191", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9de7931c97d448eaa26d295386b3a999", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4d684f0-2f", "ovs_interfaceid": "f4d684f0-2fe0-46e6-8f84-e2c0918a5a82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:15:48 user nova-compute[73572]: DEBUG nova.compute.manager [req-be2b7524-90c2-4780-b404-75b903191e8e req-6652572d-705a-4c47-9727-26b0c149549b service nova] [instance: 83670c16-3566-4679-8e74-c6451c840315] Detach interface failed, port_id=41a7ee04-5b67-4da6-a543-0d15187e5813, reason: Instance 83670c16-3566-4679-8e74-c6451c840315 could not be found. {{(pid=73572) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 10:15:49 user nova-compute[73572]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693044934.0353935, d2a731d2-13ff-49e5-ab17-80686b622df7 => Stopped> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:15:49 user nova-compute[73572]: INFO nova.compute.manager [-] [instance: d2a731d2-13ff-49e5-ab17-80686b622df7] VM Stopped (Lifecycle Event)
Aug 26 10:15:49 user nova-compute[73572]: DEBUG nova.compute.manager [None req-0758d36c-4ac8-4e6c-b7f4-61afbf1eb440 None None] [instance: d2a731d2-13ff-49e5-ab17-80686b622df7] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:15:49 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:15:49 user nova-compute[73572]: INFO nova.compute.manager [None req-6176f596-4265-4ead-b93e-207ce53a4e2e tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] [instance: 83670c16-3566-4679-8e74-c6451c840315] Took 2.86 seconds to detach 3 volumes for instance.
Aug 26 10:15:49 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-6176f596-4265-4ead-b93e-207ce53a4e2e tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:15:49 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-6176f596-4265-4ead-b93e-207ce53a4e2e tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:15:49 user nova-compute[73572]: DEBUG nova.compute.provider_tree [None req-6176f596-4265-4ead-b93e-207ce53a4e2e tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] Inventory has not changed in ProviderTree for provider: e2cec974-59b2-4c77-a53d-a7f4e5a30d75 {{(pid=73572) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 10:15:49 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-6176f596-4265-4ead-b93e-207ce53a4e2e tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] Inventory has not changed for provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73572) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 10:15:49 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-6176f596-4265-4ead-b93e-207ce53a4e2e tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.333s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:15:49 user nova-compute[73572]: INFO nova.scheduler.client.report [None req-6176f596-4265-4ead-b93e-207ce53a4e2e tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] Deleted allocations for instance 83670c16-3566-4679-8e74-c6451c840315
Aug 26 10:15:49 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-6176f596-4265-4ead-b93e-207ce53a4e2e tempest-TaggedBootDevicesTest-1188843039 tempest-TaggedBootDevicesTest-1188843039-project-member] Lock "83670c16-3566-4679-8e74-c6451c840315" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 11.857s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:15:50 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:15:53 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-6028a536-d54b-4d9f-b85e-65b63a3b1b47 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] Acquiring lock "b837eafb-db4e-4696-9b9f-bcfa1a30192a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:15:53 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-6028a536-d54b-4d9f-b85e-65b63a3b1b47 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] Lock "b837eafb-db4e-4696-9b9f-bcfa1a30192a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:15:53 user nova-compute[73572]: DEBUG nova.compute.manager [None req-6028a536-d54b-4d9f-b85e-65b63a3b1b47 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] [instance: b837eafb-db4e-4696-9b9f-bcfa1a30192a] Starting instance... {{(pid=73572) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 10:15:53 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-6028a536-d54b-4d9f-b85e-65b63a3b1b47 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:15:53 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-6028a536-d54b-4d9f-b85e-65b63a3b1b47 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:15:53 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-6028a536-d54b-4d9f-b85e-65b63a3b1b47 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73572) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 10:15:53 user nova-compute[73572]: INFO nova.compute.claims [None req-6028a536-d54b-4d9f-b85e-65b63a3b1b47 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] [instance: b837eafb-db4e-4696-9b9f-bcfa1a30192a] Claim successful on node user
Aug 26 10:15:54 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:15:54 user nova-compute[73572]: DEBUG nova.compute.provider_tree [None req-6028a536-d54b-4d9f-b85e-65b63a3b1b47 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] Inventory has not changed in ProviderTree for provider: e2cec974-59b2-4c77-a53d-a7f4e5a30d75 {{(pid=73572) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 10:15:54 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-6028a536-d54b-4d9f-b85e-65b63a3b1b47 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] Inventory has not changed for provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73572) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 10:15:54 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-6028a536-d54b-4d9f-b85e-65b63a3b1b47 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.413s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:15:54 user nova-compute[73572]: DEBUG nova.compute.manager [None req-6028a536-d54b-4d9f-b85e-65b63a3b1b47 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] [instance: b837eafb-db4e-4696-9b9f-bcfa1a30192a] Start building networks asynchronously for instance. {{(pid=73572) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 10:15:54 user nova-compute[73572]: DEBUG nova.compute.manager [None req-6028a536-d54b-4d9f-b85e-65b63a3b1b47 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] [instance: b837eafb-db4e-4696-9b9f-bcfa1a30192a] Allocating IP information in the background. {{(pid=73572) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 10:15:54 user nova-compute[73572]: DEBUG nova.network.neutron [None req-6028a536-d54b-4d9f-b85e-65b63a3b1b47 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] [instance: b837eafb-db4e-4696-9b9f-bcfa1a30192a] allocate_for_instance() {{(pid=73572) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 10:15:54 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-6028a536-d54b-4d9f-b85e-65b63a3b1b47 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] [instance: b837eafb-db4e-4696-9b9f-bcfa1a30192a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 10:15:54 user nova-compute[73572]: DEBUG nova.compute.manager [None req-6028a536-d54b-4d9f-b85e-65b63a3b1b47 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] [instance: b837eafb-db4e-4696-9b9f-bcfa1a30192a] Start building block device mappings for instance. {{(pid=73572) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 10:15:54 user nova-compute[73572]: DEBUG nova.policy [None req-6028a536-d54b-4d9f-b85e-65b63a3b1b47 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '257dcb60edca4eebabab0b4db96ba6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71aa440d71d44cd8a51d40bfbcae7f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73572) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 10:15:54 user nova-compute[73572]: DEBUG nova.compute.manager [None req-6028a536-d54b-4d9f-b85e-65b63a3b1b47 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] [instance: b837eafb-db4e-4696-9b9f-bcfa1a30192a] Start spawning the instance on the hypervisor. {{(pid=73572) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 10:15:54 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-6028a536-d54b-4d9f-b85e-65b63a3b1b47 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] [instance: b837eafb-db4e-4696-9b9f-bcfa1a30192a] Creating instance directory {{(pid=73572) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 10:15:54 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-6028a536-d54b-4d9f-b85e-65b63a3b1b47 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] [instance: b837eafb-db4e-4696-9b9f-bcfa1a30192a] Creating image(s)
Aug 26 10:15:54 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-6028a536-d54b-4d9f-b85e-65b63a3b1b47 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] Acquiring lock "/opt/stack/data/nova/instances/b837eafb-db4e-4696-9b9f-bcfa1a30192a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:15:54 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-6028a536-d54b-4d9f-b85e-65b63a3b1b47 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] Lock "/opt/stack/data/nova/instances/b837eafb-db4e-4696-9b9f-bcfa1a30192a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:15:54 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-6028a536-d54b-4d9f-b85e-65b63a3b1b47 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] Lock "/opt/stack/data/nova/instances/b837eafb-db4e-4696-9b9f-bcfa1a30192a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:15:54 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-6028a536-d54b-4d9f-b85e-65b63a3b1b47 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:15:54 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-6028a536-d54b-4d9f-b85e-65b63a3b1b47 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json" returned: 0 in 0.185s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:15:54 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-6028a536-d54b-4d9f-b85e-65b63a3b1b47 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] Acquiring lock "2099350d6f3bcd0de9471c73862d4fe75b049801" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:15:54 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-6028a536-d54b-4d9f-b85e-65b63a3b1b47 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] Lock "2099350d6f3bcd0de9471c73862d4fe75b049801" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:15:54 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-6028a536-d54b-4d9f-b85e-65b63a3b1b47 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:15:54 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-6028a536-d54b-4d9f-b85e-65b63a3b1b47 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json" returned: 0 in 0.190s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:15:54 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-6028a536-d54b-4d9f-b85e-65b63a3b1b47 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801,backing_fmt=raw /opt/stack/data/nova/instances/b837eafb-db4e-4696-9b9f-bcfa1a30192a/disk 1073741824 {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:15:55 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-6028a536-d54b-4d9f-b85e-65b63a3b1b47 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801,backing_fmt=raw /opt/stack/data/nova/instances/b837eafb-db4e-4696-9b9f-bcfa1a30192a/disk 1073741824" returned: 0 in 0.049s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:15:55 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-6028a536-d54b-4d9f-b85e-65b63a3b1b47 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] Lock "2099350d6f3bcd0de9471c73862d4fe75b049801" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.246s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:15:55 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-6028a536-d54b-4d9f-b85e-65b63a3b1b47 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:15:55 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:15:55 user nova-compute[73572]: DEBUG nova.network.neutron [None req-6028a536-d54b-4d9f-b85e-65b63a3b1b47 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] [instance: b837eafb-db4e-4696-9b9f-bcfa1a30192a] Successfully created port: 7e24882c-25ba-47d9-bc1f-9f45dac8291a {{(pid=73572) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 10:15:55 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-6028a536-d54b-4d9f-b85e-65b63a3b1b47 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json" returned: 0 in 0.195s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:15:55 user nova-compute[73572]: DEBUG nova.virt.disk.api [None req-6028a536-d54b-4d9f-b85e-65b63a3b1b47 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b837eafb-db4e-4696-9b9f-bcfa1a30192a/disk. size=1073741824 {{(pid=73572) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 10:15:55 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-6028a536-d54b-4d9f-b85e-65b63a3b1b47 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b837eafb-db4e-4696-9b9f-bcfa1a30192a/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:15:55 user nova-compute[73572]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693044940.267854, 83670c16-3566-4679-8e74-c6451c840315 => Stopped> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:15:55 user nova-compute[73572]: INFO nova.compute.manager [-] [instance: 83670c16-3566-4679-8e74-c6451c840315] VM Stopped (Lifecycle Event)
Aug 26 10:15:55 user nova-compute[73572]: DEBUG nova.compute.manager [None req-5945932a-3521-4ece-b46c-afc9cfffc55f None None] [instance: 83670c16-3566-4679-8e74-c6451c840315] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:15:55 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-6028a536-d54b-4d9f-b85e-65b63a3b1b47 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b837eafb-db4e-4696-9b9f-bcfa1a30192a/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:15:55 user nova-compute[73572]: DEBUG nova.virt.disk.api [None req-6028a536-d54b-4d9f-b85e-65b63a3b1b47 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] Cannot resize image /opt/stack/data/nova/instances/b837eafb-db4e-4696-9b9f-bcfa1a30192a/disk to a smaller size. {{(pid=73572) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 10:15:55 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-6028a536-d54b-4d9f-b85e-65b63a3b1b47 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] [instance: b837eafb-db4e-4696-9b9f-bcfa1a30192a] Created local disks {{(pid=73572) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 10:15:55 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-6028a536-d54b-4d9f-b85e-65b63a3b1b47 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] [instance: b837eafb-db4e-4696-9b9f-bcfa1a30192a] Ensure instance console log exists: /opt/stack/data/nova/instances/b837eafb-db4e-4696-9b9f-bcfa1a30192a/console.log {{(pid=73572) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 10:15:55 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-6028a536-d54b-4d9f-b85e-65b63a3b1b47 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:15:55 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-6028a536-d54b-4d9f-b85e-65b63a3b1b47 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:15:55 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-6028a536-d54b-4d9f-b85e-65b63a3b1b47 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:15:55 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:15:56 user nova-compute[73572]: DEBUG nova.network.neutron [None req-6028a536-d54b-4d9f-b85e-65b63a3b1b47 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] [instance: b837eafb-db4e-4696-9b9f-bcfa1a30192a] Successfully updated port: 7e24882c-25ba-47d9-bc1f-9f45dac8291a {{(pid=73572) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 10:15:56 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-6028a536-d54b-4d9f-b85e-65b63a3b1b47 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] Acquiring lock "refresh_cache-b837eafb-db4e-4696-9b9f-bcfa1a30192a" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:15:56 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-6028a536-d54b-4d9f-b85e-65b63a3b1b47 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] Acquired lock "refresh_cache-b837eafb-db4e-4696-9b9f-bcfa1a30192a" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:15:56 user nova-compute[73572]: DEBUG nova.network.neutron [None req-6028a536-d54b-4d9f-b85e-65b63a3b1b47 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] [instance: b837eafb-db4e-4696-9b9f-bcfa1a30192a] Building network info cache for instance {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 10:15:56 user nova-compute[73572]: DEBUG nova.compute.manager [req-3c33408a-965a-4316-8c7c-d5c636c65b7c req-870050ce-f537-479c-9c9a-7bc4e384fdbd service nova] [instance: b837eafb-db4e-4696-9b9f-bcfa1a30192a] Received event network-changed-7e24882c-25ba-47d9-bc1f-9f45dac8291a {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:15:56 user nova-compute[73572]: DEBUG nova.compute.manager [req-3c33408a-965a-4316-8c7c-d5c636c65b7c req-870050ce-f537-479c-9c9a-7bc4e384fdbd service nova] [instance: b837eafb-db4e-4696-9b9f-bcfa1a30192a] Refreshing instance network info cache due to event network-changed-7e24882c-25ba-47d9-bc1f-9f45dac8291a. {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 10:15:56 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-3c33408a-965a-4316-8c7c-d5c636c65b7c req-870050ce-f537-479c-9c9a-7bc4e384fdbd service nova] Acquiring lock "refresh_cache-b837eafb-db4e-4696-9b9f-bcfa1a30192a" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:15:56 user nova-compute[73572]: DEBUG nova.network.neutron [None req-6028a536-d54b-4d9f-b85e-65b63a3b1b47 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] [instance: b837eafb-db4e-4696-9b9f-bcfa1a30192a] Instance cache missing network info. {{(pid=73572) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 10:15:56 user nova-compute[73572]: DEBUG nova.network.neutron [None req-6028a536-d54b-4d9f-b85e-65b63a3b1b47 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] [instance: b837eafb-db4e-4696-9b9f-bcfa1a30192a] Updating instance_info_cache with network_info: [{"id": "7e24882c-25ba-47d9-bc1f-9f45dac8291a", "address": "fa:16:3e:92:98:cd", "network": {"id": "c0189896-22a3-47d8-adad-dff6c1e16a8f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2033963461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71aa440d71d44cd8a51d40bfbcae7f5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e24882c-25", "ovs_interfaceid": "7e24882c-25ba-47d9-bc1f-9f45dac8291a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:15:56 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-6028a536-d54b-4d9f-b85e-65b63a3b1b47 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] Releasing lock "refresh_cache-b837eafb-db4e-4696-9b9f-bcfa1a30192a" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:15:56 user nova-compute[73572]: DEBUG nova.compute.manager [None req-6028a536-d54b-4d9f-b85e-65b63a3b1b47 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] [instance: b837eafb-db4e-4696-9b9f-bcfa1a30192a] Instance network_info: |[{"id": "7e24882c-25ba-47d9-bc1f-9f45dac8291a", "address": "fa:16:3e:92:98:cd", "network": {"id": "c0189896-22a3-47d8-adad-dff6c1e16a8f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2033963461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71aa440d71d44cd8a51d40bfbcae7f5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e24882c-25", "ovs_interfaceid": "7e24882c-25ba-47d9-bc1f-9f45dac8291a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73572) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 10:15:56 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-3c33408a-965a-4316-8c7c-d5c636c65b7c req-870050ce-f537-479c-9c9a-7bc4e384fdbd service nova] Acquired lock "refresh_cache-b837eafb-db4e-4696-9b9f-bcfa1a30192a" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:15:56 user nova-compute[73572]: DEBUG nova.network.neutron [req-3c33408a-965a-4316-8c7c-d5c636c65b7c req-870050ce-f537-479c-9c9a-7bc4e384fdbd service nova] [instance: b837eafb-db4e-4696-9b9f-bcfa1a30192a] Refreshing network info cache for port 7e24882c-25ba-47d9-bc1f-9f45dac8291a {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 10:15:56 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-6028a536-d54b-4d9f-b85e-65b63a3b1b47 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] [instance: b837eafb-db4e-4696-9b9f-bcfa1a30192a] Start _get_guest_xml network_info=[{"id": "7e24882c-25ba-47d9-bc1f-9f45dac8291a", "address": "fa:16:3e:92:98:cd", "network": {"id": "c0189896-22a3-47d8-adad-dff6c1e16a8f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2033963461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71aa440d71d44cd8a51d40bfbcae7f5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e24882c-25", "ovs_interfaceid": "7e24882c-25ba-47d9-bc1f-9f45dac8291a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T10:07:33Z,direct_url=<?>,disk_format='qcow2',id=299da0c9-e1c4-48f0-be55-fbe20dd06bc9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5c995f8bbbab4368b67a253e0df3971a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T10:07:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'guest_format': None, 'size': 0, 'encryption_format': None, 'device_type': 'disk', 'image_id': '299da0c9-e1c4-48f0-be55-fbe20dd06bc9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73572) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 10:15:56 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-6028a536-d54b-4d9f-b85e-65b63a3b1b47 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:15:56 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-6028a536-d54b-4d9f-b85e-65b63a3b1b47 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:15:56 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-6028a536-d54b-4d9f-b85e-65b63a3b1b47 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73572) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 10:15:56 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-6028a536-d54b-4d9f-b85e-65b63a3b1b47 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] CPU controller missing on host. {{(pid=73572) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 10:15:56 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-6028a536-d54b-4d9f-b85e-65b63a3b1b47 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73572) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 10:15:56 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-6028a536-d54b-4d9f-b85e-65b63a3b1b47 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] CPU controller found on host. {{(pid=73572) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 10:15:56 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-6028a536-d54b-4d9f-b85e-65b63a3b1b47 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73572) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 10:15:56 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-6028a536-d54b-4d9f-b85e-65b63a3b1b47 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T10:07:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T10:07:33Z,direct_url=<?>,disk_format='qcow2',id=299da0c9-e1c4-48f0-be55-fbe20dd06bc9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5c995f8bbbab4368b67a253e0df3971a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T10:07:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 10:15:56 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-6028a536-d54b-4d9f-b85e-65b63a3b1b47 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] Flavor limits 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 10:15:56 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-6028a536-d54b-4d9f-b85e-65b63a3b1b47 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] Image limits 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 10:15:56 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-6028a536-d54b-4d9f-b85e-65b63a3b1b47 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] Flavor pref 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 10:15:56 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-6028a536-d54b-4d9f-b85e-65b63a3b1b47 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] Image pref 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 10:15:56 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-6028a536-d54b-4d9f-b85e-65b63a3b1b47 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 10:15:56 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-6028a536-d54b-4d9f-b85e-65b63a3b1b47 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 10:15:56 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-6028a536-d54b-4d9f-b85e-65b63a3b1b47 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73572) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 10:15:56 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-6028a536-d54b-4d9f-b85e-65b63a3b1b47 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] Got 1 possible topologies {{(pid=73572) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 10:15:56 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-6028a536-d54b-4d9f-b85e-65b63a3b1b47 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 10:15:56 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-6028a536-d54b-4d9f-b85e-65b63a3b1b47 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 10:15:56 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-6028a536-d54b-4d9f-b85e-65b63a3b1b47 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T10:15:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1739478325',display_name='tempest-VolumesActionsTest-instance-1739478325',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1739478325',id=18,image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='71aa440d71d44cd8a51d40bfbcae7f5f',ramdisk_id='',reservation_id='r-mob060o5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1871113041',owner_user_name='tempest-VolumesActionsTest-1871113041-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T10:15:54Z,user_data=None,user_id='257dcb60edca4eebabab0b4db96ba6d6',uuid=b837eafb-db4e-4696-9b9f-bcfa1a30192a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7e24882c-25ba-47d9-bc1f-9f45dac8291a", "address": "fa:16:3e:92:98:cd", "network": {"id": "c0189896-22a3-47d8-adad-dff6c1e16a8f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2033963461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71aa440d71d44cd8a51d40bfbcae7f5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e24882c-25", "ovs_interfaceid": "7e24882c-25ba-47d9-bc1f-9f45dac8291a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73572) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 10:15:56 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-6028a536-d54b-4d9f-b85e-65b63a3b1b47 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] Converting VIF {"id": "7e24882c-25ba-47d9-bc1f-9f45dac8291a", "address": "fa:16:3e:92:98:cd", "network": {"id": "c0189896-22a3-47d8-adad-dff6c1e16a8f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2033963461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71aa440d71d44cd8a51d40bfbcae7f5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e24882c-25", "ovs_interfaceid": "7e24882c-25ba-47d9-bc1f-9f45dac8291a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:15:56 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-6028a536-d54b-4d9f-b85e-65b63a3b1b47 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:98:cd,bridge_name='br-int',has_traffic_filtering=True,id=7e24882c-25ba-47d9-bc1f-9f45dac8291a,network=Network(c0189896-22a3-47d8-adad-dff6c1e16a8f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e24882c-25') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:15:56 user nova-compute[73572]: DEBUG nova.objects.instance [None req-6028a536-d54b-4d9f-b85e-65b63a3b1b47 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] Lazy-loading 'pci_devices' on Instance uuid b837eafb-db4e-4696-9b9f-bcfa1a30192a {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:15:56 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-6028a536-d54b-4d9f-b85e-65b63a3b1b47 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] [instance: b837eafb-db4e-4696-9b9f-bcfa1a30192a] End _get_guest_xml xml=<domain type="kvm">
Aug 26 10:15:56 user nova-compute[73572]:   <uuid>b837eafb-db4e-4696-9b9f-bcfa1a30192a</uuid>
Aug 26 10:15:56 user nova-compute[73572]:   <name>instance-00000012</name>
Aug 26 10:15:56 user nova-compute[73572]:   <memory>524288</memory>
Aug 26 10:15:56 user nova-compute[73572]:   <vcpu>1</vcpu>
Aug 26 10:15:56 user nova-compute[73572]:   <metadata>
Aug 26 10:15:56 user nova-compute[73572]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 10:15:56 user nova-compute[73572]:       <nova:package version="0.0.0"/>
Aug 26 10:15:56 user nova-compute[73572]:       <nova:name>tempest-VolumesActionsTest-instance-1739478325</nova:name>
Aug 26 10:15:56 user nova-compute[73572]:       <nova:creationTime>2023-08-26 10:15:56</nova:creationTime>
Aug 26 10:15:56 user nova-compute[73572]:       <nova:flavor name="m1.tiny">
Aug 26 10:15:56 user nova-compute[73572]:         <nova:memory>512</nova:memory>
Aug 26 10:15:56 user nova-compute[73572]:         <nova:disk>1</nova:disk>
Aug 26 10:15:56 user nova-compute[73572]:         <nova:swap>0</nova:swap>
Aug 26 10:15:56 user nova-compute[73572]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 10:15:56 user nova-compute[73572]:         <nova:vcpus>1</nova:vcpus>
Aug 26 10:15:56 user nova-compute[73572]:       </nova:flavor>
Aug 26 10:15:56 user nova-compute[73572]:       <nova:owner>
Aug 26 10:15:56 user nova-compute[73572]:         <nova:user uuid="257dcb60edca4eebabab0b4db96ba6d6">tempest-VolumesActionsTest-1871113041-project-member</nova:user>
Aug 26 10:15:56 user nova-compute[73572]:         <nova:project uuid="71aa440d71d44cd8a51d40bfbcae7f5f">tempest-VolumesActionsTest-1871113041</nova:project>
Aug 26 10:15:56 user nova-compute[73572]:       </nova:owner>
Aug 26 10:15:56 user nova-compute[73572]:       <nova:root type="image" uuid="299da0c9-e1c4-48f0-be55-fbe20dd06bc9"/>
Aug 26 10:15:56 user nova-compute[73572]:       <nova:ports>
Aug 26 10:15:56 user nova-compute[73572]:         <nova:port uuid="7e24882c-25ba-47d9-bc1f-9f45dac8291a">
Aug 26 10:15:56 user nova-compute[73572]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 26 10:15:56 user nova-compute[73572]:         </nova:port>
Aug 26 10:15:56 user nova-compute[73572]:       </nova:ports>
Aug 26 10:15:56 user nova-compute[73572]:     </nova:instance>
Aug 26 10:15:56 user nova-compute[73572]:   </metadata>
Aug 26 10:15:56 user nova-compute[73572]:   <sysinfo type="smbios">
Aug 26 10:15:56 user nova-compute[73572]:     <system>
Aug 26 10:15:56 user nova-compute[73572]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 10:15:56 user nova-compute[73572]:       <entry name="product">OpenStack Nova</entry>
Aug 26 10:15:56 user nova-compute[73572]:       <entry name="version">0.0.0</entry>
Aug 26 10:15:56 user nova-compute[73572]:       <entry name="serial">b837eafb-db4e-4696-9b9f-bcfa1a30192a</entry>
Aug 26 10:15:56 user nova-compute[73572]:       <entry name="uuid">b837eafb-db4e-4696-9b9f-bcfa1a30192a</entry>
Aug 26 10:15:56 user nova-compute[73572]:       <entry name="family">Virtual Machine</entry>
Aug 26 10:15:56 user nova-compute[73572]:     </system>
Aug 26 10:15:56 user nova-compute[73572]:   </sysinfo>
Aug 26 10:15:56 user nova-compute[73572]:   <os>
Aug 26 10:15:56 user nova-compute[73572]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 10:15:56 user nova-compute[73572]:     <boot dev="hd"/>
Aug 26 10:15:56 user nova-compute[73572]:     <smbios mode="sysinfo"/>
Aug 26 10:15:56 user nova-compute[73572]:   </os>
Aug 26 10:15:56 user nova-compute[73572]:   <features>
Aug 26 10:15:56 user nova-compute[73572]:     <acpi/>
Aug 26 10:15:56 user nova-compute[73572]:     <apic/>
Aug 26 10:15:56 user nova-compute[73572]:     <vmcoreinfo/>
Aug 26 10:15:56 user nova-compute[73572]:   </features>
Aug 26 10:15:56 user nova-compute[73572]:   <clock offset="utc">
Aug 26 10:15:56 user nova-compute[73572]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 10:15:56 user nova-compute[73572]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 10:15:56 user nova-compute[73572]:     <timer name="hpet" present="no"/>
Aug 26 10:15:56 user nova-compute[73572]:   </clock>
Aug 26 10:15:56 user nova-compute[73572]:   <cpu mode="custom" match="exact">
Aug 26 10:15:56 user nova-compute[73572]:     <model>Nehalem</model>
Aug 26 10:15:56 user nova-compute[73572]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 10:15:56 user nova-compute[73572]:   </cpu>
Aug 26 10:15:56 user nova-compute[73572]:   <devices>
Aug 26 10:15:56 user nova-compute[73572]:     <disk type="file" device="disk">
Aug 26 10:15:56 user nova-compute[73572]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 10:15:56 user nova-compute[73572]:       <source file="/opt/stack/data/nova/instances/b837eafb-db4e-4696-9b9f-bcfa1a30192a/disk"/>
Aug 26 10:15:56 user nova-compute[73572]:       <target dev="vda" bus="virtio"/>
Aug 26 10:15:56 user nova-compute[73572]:     </disk>
Aug 26 10:15:56 user nova-compute[73572]:     <interface type="ethernet">
Aug 26 10:15:56 user nova-compute[73572]:       <mac address="fa:16:3e:92:98:cd"/>
Aug 26 10:15:56 user nova-compute[73572]:       <model type="virtio"/>
Aug 26 10:15:56 user nova-compute[73572]:       <mtu size="1442"/>
Aug 26 10:15:56 user nova-compute[73572]:       <target dev="tap7e24882c-25"/>
Aug 26 10:15:56 user nova-compute[73572]:     </interface>
Aug 26 10:15:56 user nova-compute[73572]:     <serial type="pty">
Aug 26 10:15:56 user nova-compute[73572]:       <log file="/opt/stack/data/nova/instances/b837eafb-db4e-4696-9b9f-bcfa1a30192a/console.log" append="off"/>
Aug 26 10:15:56 user nova-compute[73572]:     </serial>
Aug 26 10:15:56 user nova-compute[73572]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 10:15:56 user nova-compute[73572]:     <video>
Aug 26 10:15:56 user nova-compute[73572]:       <model type="virtio"/>
Aug 26 10:15:56 user nova-compute[73572]:     </video>
Aug 26 10:15:56 user nova-compute[73572]:     <rng model="virtio">
Aug 26 10:15:56 user nova-compute[73572]:       <backend model="random">/dev/urandom</backend>
Aug 26 10:15:56 user nova-compute[73572]:     </rng>
Aug 26 10:15:56 user nova-compute[73572]:     <controller type="usb" index="0" model="none"/>
Aug 26 10:15:56 user nova-compute[73572]:     <memballoon model="virtio">
Aug 26 10:15:56 user nova-compute[73572]:       <stats period="10"/>
Aug 26 10:15:56 user nova-compute[73572]:     </memballoon>
Aug 26 10:15:56 user nova-compute[73572]:   </devices>
Aug 26 10:15:56 user nova-compute[73572]: </domain>
Aug 26 10:15:56 user nova-compute[73572]:  {{(pid=73572) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 10:15:56 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-6028a536-d54b-4d9f-b85e-65b63a3b1b47 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T10:15:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1739478325',display_name='tempest-VolumesActionsTest-instance-1739478325',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1739478325',id=18,image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='71aa440d71d44cd8a51d40bfbcae7f5f',ramdisk_id='',reservation_id='r-mob060o5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1871113041',owner_user_name='tempest-VolumesActionsTest-1871113041-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T10:15:54Z,user_data=None,user_id='257dcb60edca4eebabab0b4db96ba6d6',uuid=b837eafb-db4e-4696-9b9f-bcfa1a30192a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7e24882c-25ba-47d9-bc1f-9f45dac8291a", "address": "fa:16:3e:92:98:cd", "network": {"id": "c0189896-22a3-47d8-adad-dff6c1e16a8f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2033963461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71aa440d71d44cd8a51d40bfbcae7f5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e24882c-25", "ovs_interfaceid": "7e24882c-25ba-47d9-bc1f-9f45dac8291a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 10:15:56 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-6028a536-d54b-4d9f-b85e-65b63a3b1b47 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] Converting VIF {"id": "7e24882c-25ba-47d9-bc1f-9f45dac8291a", "address": "fa:16:3e:92:98:cd", "network": {"id": "c0189896-22a3-47d8-adad-dff6c1e16a8f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2033963461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71aa440d71d44cd8a51d40bfbcae7f5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e24882c-25", "ovs_interfaceid": "7e24882c-25ba-47d9-bc1f-9f45dac8291a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:15:56 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-6028a536-d54b-4d9f-b85e-65b63a3b1b47 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:98:cd,bridge_name='br-int',has_traffic_filtering=True,id=7e24882c-25ba-47d9-bc1f-9f45dac8291a,network=Network(c0189896-22a3-47d8-adad-dff6c1e16a8f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e24882c-25') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:15:56 user nova-compute[73572]: DEBUG os_vif [None req-6028a536-d54b-4d9f-b85e-65b63a3b1b47 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:98:cd,bridge_name='br-int',has_traffic_filtering=True,id=7e24882c-25ba-47d9-bc1f-9f45dac8291a,network=Network(c0189896-22a3-47d8-adad-dff6c1e16a8f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e24882c-25') {{(pid=73572) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 10:15:56 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:15:56 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:15:56 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 10:15:56 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:15:56 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7e24882c-25, may_exist=True, interface_attrs={}) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:15:56 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7e24882c-25, col_values=(('external_ids', {'iface-id': '7e24882c-25ba-47d9-bc1f-9f45dac8291a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:92:98:cd', 'vm-uuid': 'b837eafb-db4e-4696-9b9f-bcfa1a30192a'}),), if_exists=True) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:15:56 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:15:56 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:15:56 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:15:56 user nova-compute[73572]: INFO os_vif [None req-6028a536-d54b-4d9f-b85e-65b63a3b1b47 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:98:cd,bridge_name='br-int',has_traffic_filtering=True,id=7e24882c-25ba-47d9-bc1f-9f45dac8291a,network=Network(c0189896-22a3-47d8-adad-dff6c1e16a8f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e24882c-25')
Aug 26 10:15:56 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-6028a536-d54b-4d9f-b85e-65b63a3b1b47 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] No BDM found with device name vda, not building metadata. {{(pid=73572) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 10:15:56 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-6028a536-d54b-4d9f-b85e-65b63a3b1b47 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] No VIF found with MAC fa:16:3e:92:98:cd, not building metadata {{(pid=73572) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 10:15:56 user nova-compute[73572]: DEBUG nova.network.neutron [req-3c33408a-965a-4316-8c7c-d5c636c65b7c req-870050ce-f537-479c-9c9a-7bc4e384fdbd service nova] [instance: b837eafb-db4e-4696-9b9f-bcfa1a30192a] Updated VIF entry in instance network info cache for port 7e24882c-25ba-47d9-bc1f-9f45dac8291a. {{(pid=73572) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 10:15:56 user nova-compute[73572]: DEBUG nova.network.neutron [req-3c33408a-965a-4316-8c7c-d5c636c65b7c req-870050ce-f537-479c-9c9a-7bc4e384fdbd service nova] [instance: b837eafb-db4e-4696-9b9f-bcfa1a30192a] Updating instance_info_cache with network_info: [{"id": "7e24882c-25ba-47d9-bc1f-9f45dac8291a", "address": "fa:16:3e:92:98:cd", "network": {"id": "c0189896-22a3-47d8-adad-dff6c1e16a8f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2033963461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71aa440d71d44cd8a51d40bfbcae7f5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e24882c-25", "ovs_interfaceid": "7e24882c-25ba-47d9-bc1f-9f45dac8291a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:15:56 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-3c33408a-965a-4316-8c7c-d5c636c65b7c req-870050ce-f537-479c-9c9a-7bc4e384fdbd service nova] Releasing lock "refresh_cache-b837eafb-db4e-4696-9b9f-bcfa1a30192a" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:15:58 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:15:58 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:15:58 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:15:58 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:15:58 user nova-compute[73572]: DEBUG nova.compute.manager [req-de705e75-67a0-489e-8729-32dd0bfd989c req-8bd1e232-9226-4d87-99b2-2f84830e05c5 service nova] [instance: b837eafb-db4e-4696-9b9f-bcfa1a30192a] Received event network-vif-plugged-7e24882c-25ba-47d9-bc1f-9f45dac8291a {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:15:58 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-de705e75-67a0-489e-8729-32dd0bfd989c req-8bd1e232-9226-4d87-99b2-2f84830e05c5 service nova] Acquiring lock "b837eafb-db4e-4696-9b9f-bcfa1a30192a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:15:58 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-de705e75-67a0-489e-8729-32dd0bfd989c req-8bd1e232-9226-4d87-99b2-2f84830e05c5 service nova] Lock "b837eafb-db4e-4696-9b9f-bcfa1a30192a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:15:58 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-de705e75-67a0-489e-8729-32dd0bfd989c req-8bd1e232-9226-4d87-99b2-2f84830e05c5 service nova] Lock "b837eafb-db4e-4696-9b9f-bcfa1a30192a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:15:58 user nova-compute[73572]: DEBUG nova.compute.manager [req-de705e75-67a0-489e-8729-32dd0bfd989c req-8bd1e232-9226-4d87-99b2-2f84830e05c5 service nova] [instance: b837eafb-db4e-4696-9b9f-bcfa1a30192a] No waiting events found dispatching network-vif-plugged-7e24882c-25ba-47d9-bc1f-9f45dac8291a {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:15:58 user nova-compute[73572]: WARNING nova.compute.manager [req-de705e75-67a0-489e-8729-32dd0bfd989c req-8bd1e232-9226-4d87-99b2-2f84830e05c5 service nova] [instance: b837eafb-db4e-4696-9b9f-bcfa1a30192a] Received unexpected event network-vif-plugged-7e24882c-25ba-47d9-bc1f-9f45dac8291a for instance with vm_state building and task_state spawning.
Aug 26 10:15:58 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:15:58 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:15:58 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:15:59 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:16:00 user nova-compute[73572]: DEBUG nova.virt.driver [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Emitting event <LifecycleEvent: 1693044960.2575188, b837eafb-db4e-4696-9b9f-bcfa1a30192a => Resumed> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:16:00 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: b837eafb-db4e-4696-9b9f-bcfa1a30192a] VM Resumed (Lifecycle Event)
Aug 26 10:16:00 user nova-compute[73572]: DEBUG nova.compute.manager [None req-6028a536-d54b-4d9f-b85e-65b63a3b1b47 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] [instance: b837eafb-db4e-4696-9b9f-bcfa1a30192a] Instance event wait completed in 0 seconds for  {{(pid=73572) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 10:16:00 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-6028a536-d54b-4d9f-b85e-65b63a3b1b47 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] [instance: b837eafb-db4e-4696-9b9f-bcfa1a30192a] Guest created on hypervisor {{(pid=73572) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 10:16:00 user nova-compute[73572]: INFO nova.virt.libvirt.driver [-] [instance: b837eafb-db4e-4696-9b9f-bcfa1a30192a] Instance spawned successfully.
Aug 26 10:16:00 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-6028a536-d54b-4d9f-b85e-65b63a3b1b47 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] [instance: b837eafb-db4e-4696-9b9f-bcfa1a30192a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 10:16:00 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: b837eafb-db4e-4696-9b9f-bcfa1a30192a] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:16:00 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: b837eafb-db4e-4696-9b9f-bcfa1a30192a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73572) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 10:16:00 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-6028a536-d54b-4d9f-b85e-65b63a3b1b47 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] [instance: b837eafb-db4e-4696-9b9f-bcfa1a30192a] Found default for hw_cdrom_bus of ide {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:16:00 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-6028a536-d54b-4d9f-b85e-65b63a3b1b47 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] [instance: b837eafb-db4e-4696-9b9f-bcfa1a30192a] Found default for hw_disk_bus of virtio {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:16:00 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-6028a536-d54b-4d9f-b85e-65b63a3b1b47 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] [instance: b837eafb-db4e-4696-9b9f-bcfa1a30192a] Found default for hw_input_bus of None {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:16:00 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-6028a536-d54b-4d9f-b85e-65b63a3b1b47 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] [instance: b837eafb-db4e-4696-9b9f-bcfa1a30192a] Found default for hw_pointer_model of None {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:16:00 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-6028a536-d54b-4d9f-b85e-65b63a3b1b47 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] [instance: b837eafb-db4e-4696-9b9f-bcfa1a30192a] Found default for hw_video_model of virtio {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:16:00 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-6028a536-d54b-4d9f-b85e-65b63a3b1b47 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] [instance: b837eafb-db4e-4696-9b9f-bcfa1a30192a] Found default for hw_vif_model of virtio {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:16:00 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: b837eafb-db4e-4696-9b9f-bcfa1a30192a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 10:16:00 user nova-compute[73572]: DEBUG nova.virt.driver [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Emitting event <LifecycleEvent: 1693044960.2589633, b837eafb-db4e-4696-9b9f-bcfa1a30192a => Started> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:16:00 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: b837eafb-db4e-4696-9b9f-bcfa1a30192a] VM Started (Lifecycle Event)
Aug 26 10:16:00 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: b837eafb-db4e-4696-9b9f-bcfa1a30192a] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:16:00 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: b837eafb-db4e-4696-9b9f-bcfa1a30192a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73572) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 10:16:00 user nova-compute[73572]: DEBUG nova.compute.manager [req-e624b215-3607-422c-b7c4-53c27e0ffc3d req-e274a55c-4b43-4afa-aa24-43edf4ea0862 service nova] [instance: b837eafb-db4e-4696-9b9f-bcfa1a30192a] Received event network-vif-plugged-7e24882c-25ba-47d9-bc1f-9f45dac8291a {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:16:00 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-e624b215-3607-422c-b7c4-53c27e0ffc3d req-e274a55c-4b43-4afa-aa24-43edf4ea0862 service nova] Acquiring lock "b837eafb-db4e-4696-9b9f-bcfa1a30192a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:16:00 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-e624b215-3607-422c-b7c4-53c27e0ffc3d req-e274a55c-4b43-4afa-aa24-43edf4ea0862 service nova] Lock "b837eafb-db4e-4696-9b9f-bcfa1a30192a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:16:00 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-e624b215-3607-422c-b7c4-53c27e0ffc3d req-e274a55c-4b43-4afa-aa24-43edf4ea0862 service nova] Lock "b837eafb-db4e-4696-9b9f-bcfa1a30192a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:16:00 user nova-compute[73572]: DEBUG nova.compute.manager [req-e624b215-3607-422c-b7c4-53c27e0ffc3d req-e274a55c-4b43-4afa-aa24-43edf4ea0862 service nova] [instance: b837eafb-db4e-4696-9b9f-bcfa1a30192a] No waiting events found dispatching network-vif-plugged-7e24882c-25ba-47d9-bc1f-9f45dac8291a {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:16:00 user nova-compute[73572]: WARNING nova.compute.manager [req-e624b215-3607-422c-b7c4-53c27e0ffc3d req-e274a55c-4b43-4afa-aa24-43edf4ea0862 service nova] [instance: b837eafb-db4e-4696-9b9f-bcfa1a30192a] Received unexpected event network-vif-plugged-7e24882c-25ba-47d9-bc1f-9f45dac8291a for instance with vm_state building and task_state spawning.
Aug 26 10:16:00 user nova-compute[73572]: INFO nova.compute.manager [None req-6028a536-d54b-4d9f-b85e-65b63a3b1b47 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] [instance: b837eafb-db4e-4696-9b9f-bcfa1a30192a] Took 5.81 seconds to spawn the instance on the hypervisor.
Aug 26 10:16:00 user nova-compute[73572]: DEBUG nova.compute.manager [None req-6028a536-d54b-4d9f-b85e-65b63a3b1b47 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] [instance: b837eafb-db4e-4696-9b9f-bcfa1a30192a] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:16:00 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: b837eafb-db4e-4696-9b9f-bcfa1a30192a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 10:16:00 user nova-compute[73572]: INFO nova.compute.manager [None req-6028a536-d54b-4d9f-b85e-65b63a3b1b47 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] [instance: b837eafb-db4e-4696-9b9f-bcfa1a30192a] Took 6.56 seconds to build instance.
Aug 26 10:16:00 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-6028a536-d54b-4d9f-b85e-65b63a3b1b47 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] Lock "b837eafb-db4e-4696-9b9f-bcfa1a30192a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.692s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:16:01 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:16:04 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:16:04 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:16:06 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:16:07 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:16:08 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:16:08 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:16:08 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Starting heal instance info cache {{(pid=73572) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 10:16:09 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:16:09 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquiring lock "refresh_cache-ee9bcbaa-25a6-4588-b757-2a2ae15b6cf8" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:16:09 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquired lock "refresh_cache-ee9bcbaa-25a6-4588-b757-2a2ae15b6cf8" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:16:09 user nova-compute[73572]: DEBUG nova.network.neutron [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] [instance: ee9bcbaa-25a6-4588-b757-2a2ae15b6cf8] Forcefully refreshing network info cache for instance {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 10:16:09 user nova-compute[73572]: DEBUG nova.network.neutron [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] [instance: ee9bcbaa-25a6-4588-b757-2a2ae15b6cf8] Updating instance_info_cache with network_info: [{"id": "f47d01ad-ade6-4b38-8b96-ea183c06134c", "address": "fa:16:3e:f9:ca:45", "network": {"id": "529bb981-16ba-47c5-afb0-55f4aa577ecc", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-265382654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9898b65714845e7aea403cc39182df7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf47d01ad-ad", "ovs_interfaceid": "f47d01ad-ade6-4b38-8b96-ea183c06134c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:16:09 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Releasing lock "refresh_cache-ee9bcbaa-25a6-4588-b757-2a2ae15b6cf8" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:16:09 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] [instance: ee9bcbaa-25a6-4588-b757-2a2ae15b6cf8] Updated the network info_cache for instance {{(pid=73572) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 10:16:09 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:16:09 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73572) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 10:16:10 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:16:10 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:16:11 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:16:11 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:16:11 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:16:11 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:16:12 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:16:12 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:16:13 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:16:13 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:16:14 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:16:16 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:16:16 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:16:16 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:16:16 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:16:16 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:16:16 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:16:16 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Auditing locally available compute resources for user (node: user) {{(pid=73572) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 10:16:17 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b837eafb-db4e-4696-9b9f-bcfa1a30192a/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:16:17 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b837eafb-db4e-4696-9b9f-bcfa1a30192a/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:16:17 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b837eafb-db4e-4696-9b9f-bcfa1a30192a/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:16:17 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-bea4e44a-dc56-416e-b44f-4ae65f1e0274 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Acquiring lock "682138af-ba6a-47f1-a9a5-03ae2661f54d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:16:17 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-bea4e44a-dc56-416e-b44f-4ae65f1e0274 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Lock "682138af-ba6a-47f1-a9a5-03ae2661f54d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:16:17 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b837eafb-db4e-4696-9b9f-bcfa1a30192a/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:16:17 user nova-compute[73572]: DEBUG nova.compute.manager [None req-bea4e44a-dc56-416e-b44f-4ae65f1e0274 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] [instance: 682138af-ba6a-47f1-a9a5-03ae2661f54d] Starting instance... {{(pid=73572) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 10:16:17 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8302d6e7-aaf3-461c-a55e-f2e685d1800d/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:16:17 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8302d6e7-aaf3-461c-a55e-f2e685d1800d/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:16:17 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8302d6e7-aaf3-461c-a55e-f2e685d1800d/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:16:17 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-bea4e44a-dc56-416e-b44f-4ae65f1e0274 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:16:17 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-bea4e44a-dc56-416e-b44f-4ae65f1e0274 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:16:17 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8302d6e7-aaf3-461c-a55e-f2e685d1800d/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:16:17 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-bea4e44a-dc56-416e-b44f-4ae65f1e0274 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73572) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 10:16:17 user nova-compute[73572]: INFO nova.compute.claims [None req-bea4e44a-dc56-416e-b44f-4ae65f1e0274 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] [instance: 682138af-ba6a-47f1-a9a5-03ae2661f54d] Claim successful on node user
Aug 26 10:16:17 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c785b609-0068-442f-91f5-d26e888a993f/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:16:17 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c785b609-0068-442f-91f5-d26e888a993f/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:16:17 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c785b609-0068-442f-91f5-d26e888a993f/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:16:18 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c785b609-0068-442f-91f5-d26e888a993f/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:16:18 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32a28361-567b-4bd4-9f4f-d9cfac2c9388/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:16:18 user nova-compute[73572]: DEBUG nova.compute.provider_tree [None req-bea4e44a-dc56-416e-b44f-4ae65f1e0274 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Inventory has not changed in ProviderTree for provider: e2cec974-59b2-4c77-a53d-a7f4e5a30d75 {{(pid=73572) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 10:16:18 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-bea4e44a-dc56-416e-b44f-4ae65f1e0274 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Inventory has not changed for provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73572) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 10:16:18 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32a28361-567b-4bd4-9f4f-d9cfac2c9388/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:16:18 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32a28361-567b-4bd4-9f4f-d9cfac2c9388/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:16:18 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-bea4e44a-dc56-416e-b44f-4ae65f1e0274 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.673s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:16:18 user nova-compute[73572]: DEBUG nova.compute.manager [None req-bea4e44a-dc56-416e-b44f-4ae65f1e0274 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] [instance: 682138af-ba6a-47f1-a9a5-03ae2661f54d] Start building networks asynchronously for instance. {{(pid=73572) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 10:16:18 user nova-compute[73572]: DEBUG nova.compute.manager [None req-bea4e44a-dc56-416e-b44f-4ae65f1e0274 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] [instance: 682138af-ba6a-47f1-a9a5-03ae2661f54d] Allocating IP information in the background. {{(pid=73572) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 10:16:18 user nova-compute[73572]: DEBUG nova.network.neutron [None req-bea4e44a-dc56-416e-b44f-4ae65f1e0274 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] [instance: 682138af-ba6a-47f1-a9a5-03ae2661f54d] allocate_for_instance() {{(pid=73572) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 10:16:18 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-bea4e44a-dc56-416e-b44f-4ae65f1e0274 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] [instance: 682138af-ba6a-47f1-a9a5-03ae2661f54d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 10:16:18 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32a28361-567b-4bd4-9f4f-d9cfac2c9388/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:16:18 user nova-compute[73572]: DEBUG nova.compute.manager [None req-bea4e44a-dc56-416e-b44f-4ae65f1e0274 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] [instance: 682138af-ba6a-47f1-a9a5-03ae2661f54d] Start building block device mappings for instance. {{(pid=73572) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 10:16:18 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00c47a06-2bf8-427d-bcb1-304688584511/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:16:18 user nova-compute[73572]: DEBUG nova.policy [None req-bea4e44a-dc56-416e-b44f-4ae65f1e0274 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a354eb6764fd4c95a53b8962544bc49b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb6ef2597eac461f959a568abd3031ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73572) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 10:16:18 user nova-compute[73572]: DEBUG nova.compute.manager [None req-bea4e44a-dc56-416e-b44f-4ae65f1e0274 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] [instance: 682138af-ba6a-47f1-a9a5-03ae2661f54d] Start spawning the instance on the hypervisor. {{(pid=73572) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 10:16:18 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-bea4e44a-dc56-416e-b44f-4ae65f1e0274 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] [instance: 682138af-ba6a-47f1-a9a5-03ae2661f54d] Creating instance directory {{(pid=73572) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 10:16:18 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-bea4e44a-dc56-416e-b44f-4ae65f1e0274 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] [instance: 682138af-ba6a-47f1-a9a5-03ae2661f54d] Creating image(s)
Aug 26 10:16:18 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-bea4e44a-dc56-416e-b44f-4ae65f1e0274 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Acquiring lock "/opt/stack/data/nova/instances/682138af-ba6a-47f1-a9a5-03ae2661f54d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:16:18 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-bea4e44a-dc56-416e-b44f-4ae65f1e0274 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Lock "/opt/stack/data/nova/instances/682138af-ba6a-47f1-a9a5-03ae2661f54d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:16:18 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-bea4e44a-dc56-416e-b44f-4ae65f1e0274 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Lock "/opt/stack/data/nova/instances/682138af-ba6a-47f1-a9a5-03ae2661f54d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:16:18 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-bea4e44a-dc56-416e-b44f-4ae65f1e0274 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Acquiring lock "07206003e8abff675a157299cdd9d53c100accd6" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:16:18 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-bea4e44a-dc56-416e-b44f-4ae65f1e0274 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Lock "07206003e8abff675a157299cdd9d53c100accd6" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:16:18 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00c47a06-2bf8-427d-bcb1-304688584511/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:16:18 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00c47a06-2bf8-427d-bcb1-304688584511/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:16:19 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-bea4e44a-dc56-416e-b44f-4ae65f1e0274 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07206003e8abff675a157299cdd9d53c100accd6.part --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:16:19 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:16:19 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00c47a06-2bf8-427d-bcb1-304688584511/disk --force-share --output=json" returned: 0 in 0.526s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:16:19 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee9bcbaa-25a6-4588-b757-2a2ae15b6cf8/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:16:19 user nova-compute[73572]: DEBUG nova.network.neutron [None req-bea4e44a-dc56-416e-b44f-4ae65f1e0274 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] [instance: 682138af-ba6a-47f1-a9a5-03ae2661f54d] Successfully created port: 72fe24f4-00e3-40f1-a44a-014c7669e862 {{(pid=73572) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 10:16:19 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-bea4e44a-dc56-416e-b44f-4ae65f1e0274 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07206003e8abff675a157299cdd9d53c100accd6.part --force-share --output=json" returned: 0 in 0.209s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:16:19 user nova-compute[73572]: DEBUG nova.virt.images [None req-bea4e44a-dc56-416e-b44f-4ae65f1e0274 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] bd4d7dcc-4b94-4755-8f4d-82a35910708b was qcow2, converting to raw {{(pid=73572) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 26 10:16:19 user nova-compute[73572]: DEBUG nova.privsep.utils [None req-bea4e44a-dc56-416e-b44f-4ae65f1e0274 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73572) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 26 10:16:19 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-bea4e44a-dc56-416e-b44f-4ae65f1e0274 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/07206003e8abff675a157299cdd9d53c100accd6.part /opt/stack/data/nova/instances/_base/07206003e8abff675a157299cdd9d53c100accd6.converted {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:16:19 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee9bcbaa-25a6-4588-b757-2a2ae15b6cf8/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:16:19 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee9bcbaa-25a6-4588-b757-2a2ae15b6cf8/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:16:19 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee9bcbaa-25a6-4588-b757-2a2ae15b6cf8/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:16:19 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=73572) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 10:16:19 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c555f971-b177-4c26-a38e-09e0e78bf7b9/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:16:19 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-bea4e44a-dc56-416e-b44f-4ae65f1e0274 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/07206003e8abff675a157299cdd9d53c100accd6.part /opt/stack/data/nova/instances/_base/07206003e8abff675a157299cdd9d53c100accd6.converted" returned: 0 in 0.522s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:16:20 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-bea4e44a-dc56-416e-b44f-4ae65f1e0274 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07206003e8abff675a157299cdd9d53c100accd6.converted --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:16:20 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c555f971-b177-4c26-a38e-09e0e78bf7b9/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:16:20 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c555f971-b177-4c26-a38e-09e0e78bf7b9/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:16:20 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-bea4e44a-dc56-416e-b44f-4ae65f1e0274 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07206003e8abff675a157299cdd9d53c100accd6.converted --force-share --output=json" returned: 0 in 0.180s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:16:20 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-bea4e44a-dc56-416e-b44f-4ae65f1e0274 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Lock "07206003e8abff675a157299cdd9d53c100accd6" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.455s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:16:20 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-bea4e44a-dc56-416e-b44f-4ae65f1e0274 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07206003e8abff675a157299cdd9d53c100accd6 --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:16:20 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c555f971-b177-4c26-a38e-09e0e78bf7b9/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:16:20 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=73572) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 10:16:20 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c555f971-b177-4c26-a38e-09e0e78bf7b9/disk.rescue --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:16:20 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-bea4e44a-dc56-416e-b44f-4ae65f1e0274 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07206003e8abff675a157299cdd9d53c100accd6 --force-share --output=json" returned: 0 in 0.175s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:16:20 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-bea4e44a-dc56-416e-b44f-4ae65f1e0274 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Acquiring lock "07206003e8abff675a157299cdd9d53c100accd6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:16:20 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-bea4e44a-dc56-416e-b44f-4ae65f1e0274 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Lock "07206003e8abff675a157299cdd9d53c100accd6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:16:20 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-bea4e44a-dc56-416e-b44f-4ae65f1e0274 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07206003e8abff675a157299cdd9d53c100accd6 --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:16:20 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c555f971-b177-4c26-a38e-09e0e78bf7b9/disk.rescue --force-share --output=json" returned: 0 in 0.193s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:16:20 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c555f971-b177-4c26-a38e-09e0e78bf7b9/disk.rescue --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:16:20 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-bea4e44a-dc56-416e-b44f-4ae65f1e0274 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07206003e8abff675a157299cdd9d53c100accd6 --force-share --output=json" returned: 0 in 0.182s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:16:20 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-bea4e44a-dc56-416e-b44f-4ae65f1e0274 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/07206003e8abff675a157299cdd9d53c100accd6,backing_fmt=raw /opt/stack/data/nova/instances/682138af-ba6a-47f1-a9a5-03ae2661f54d/disk 1073741824 {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:16:20 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-bea4e44a-dc56-416e-b44f-4ae65f1e0274 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/07206003e8abff675a157299cdd9d53c100accd6,backing_fmt=raw /opt/stack/data/nova/instances/682138af-ba6a-47f1-a9a5-03ae2661f54d/disk 1073741824" returned: 0 in 0.047s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:16:20 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-bea4e44a-dc56-416e-b44f-4ae65f1e0274 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Lock "07206003e8abff675a157299cdd9d53c100accd6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.238s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:16:20 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-bea4e44a-dc56-416e-b44f-4ae65f1e0274 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07206003e8abff675a157299cdd9d53c100accd6 --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:16:20 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c555f971-b177-4c26-a38e-09e0e78bf7b9/disk.rescue --force-share --output=json" returned: 0 in 0.192s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:16:20 user nova-compute[73572]: DEBUG nova.network.neutron [None req-bea4e44a-dc56-416e-b44f-4ae65f1e0274 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] [instance: 682138af-ba6a-47f1-a9a5-03ae2661f54d] Successfully updated port: 72fe24f4-00e3-40f1-a44a-014c7669e862 {{(pid=73572) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 10:16:20 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2970584-8c2a-4f99-922c-d66d59489504/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:16:20 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-bea4e44a-dc56-416e-b44f-4ae65f1e0274 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Acquiring lock "refresh_cache-682138af-ba6a-47f1-a9a5-03ae2661f54d" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:16:20 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-bea4e44a-dc56-416e-b44f-4ae65f1e0274 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Acquired lock "refresh_cache-682138af-ba6a-47f1-a9a5-03ae2661f54d" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:16:20 user nova-compute[73572]: DEBUG nova.network.neutron [None req-bea4e44a-dc56-416e-b44f-4ae65f1e0274 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] [instance: 682138af-ba6a-47f1-a9a5-03ae2661f54d] Building network info cache for instance {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 10:16:20 user nova-compute[73572]: DEBUG nova.compute.manager [req-5bcb320b-6295-4ef8-89e1-2740e46d45ee req-4b46d057-6962-49ec-9c97-6a4788f48282 service nova] [instance: 682138af-ba6a-47f1-a9a5-03ae2661f54d] Received event network-changed-72fe24f4-00e3-40f1-a44a-014c7669e862 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:16:20 user nova-compute[73572]: DEBUG nova.compute.manager [req-5bcb320b-6295-4ef8-89e1-2740e46d45ee req-4b46d057-6962-49ec-9c97-6a4788f48282 service nova] [instance: 682138af-ba6a-47f1-a9a5-03ae2661f54d] Refreshing instance network info cache due to event network-changed-72fe24f4-00e3-40f1-a44a-014c7669e862. {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 10:16:20 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-5bcb320b-6295-4ef8-89e1-2740e46d45ee req-4b46d057-6962-49ec-9c97-6a4788f48282 service nova] Acquiring lock "refresh_cache-682138af-ba6a-47f1-a9a5-03ae2661f54d" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:16:20 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-bea4e44a-dc56-416e-b44f-4ae65f1e0274 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07206003e8abff675a157299cdd9d53c100accd6 --force-share --output=json" returned: 0 in 0.184s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:16:20 user nova-compute[73572]: DEBUG nova.virt.disk.api [None req-bea4e44a-dc56-416e-b44f-4ae65f1e0274 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Checking if we can resize image /opt/stack/data/nova/instances/682138af-ba6a-47f1-a9a5-03ae2661f54d/disk. size=1073741824 {{(pid=73572) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 10:16:20 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-bea4e44a-dc56-416e-b44f-4ae65f1e0274 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/682138af-ba6a-47f1-a9a5-03ae2661f54d/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:16:20 user nova-compute[73572]: DEBUG nova.network.neutron [None req-bea4e44a-dc56-416e-b44f-4ae65f1e0274 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] [instance: 682138af-ba6a-47f1-a9a5-03ae2661f54d] Instance cache missing network info. {{(pid=73572) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 10:16:20 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2970584-8c2a-4f99-922c-d66d59489504/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:16:20 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2970584-8c2a-4f99-922c-d66d59489504/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:16:21 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-bea4e44a-dc56-416e-b44f-4ae65f1e0274 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/682138af-ba6a-47f1-a9a5-03ae2661f54d/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:16:21 user nova-compute[73572]: DEBUG nova.virt.disk.api [None req-bea4e44a-dc56-416e-b44f-4ae65f1e0274 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Cannot resize image /opt/stack/data/nova/instances/682138af-ba6a-47f1-a9a5-03ae2661f54d/disk to a smaller size. {{(pid=73572) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 10:16:21 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-bea4e44a-dc56-416e-b44f-4ae65f1e0274 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] [instance: 682138af-ba6a-47f1-a9a5-03ae2661f54d] Created local disks {{(pid=73572) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 10:16:21 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-bea4e44a-dc56-416e-b44f-4ae65f1e0274 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] [instance: 682138af-ba6a-47f1-a9a5-03ae2661f54d] Ensure instance console log exists: /opt/stack/data/nova/instances/682138af-ba6a-47f1-a9a5-03ae2661f54d/console.log {{(pid=73572) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 10:16:21 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-bea4e44a-dc56-416e-b44f-4ae65f1e0274 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:16:21 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-bea4e44a-dc56-416e-b44f-4ae65f1e0274 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:16:21 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-bea4e44a-dc56-416e-b44f-4ae65f1e0274 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:16:21 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2970584-8c2a-4f99-922c-d66d59489504/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:16:21 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fe47a17-4ffb-48ce-b0f6-a9b43002bd55/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:16:21 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fe47a17-4ffb-48ce-b0f6-a9b43002bd55/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:16:21 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fe47a17-4ffb-48ce-b0f6-a9b43002bd55/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:16:21 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fe47a17-4ffb-48ce-b0f6-a9b43002bd55/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:16:21 user nova-compute[73572]: DEBUG nova.network.neutron [None req-bea4e44a-dc56-416e-b44f-4ae65f1e0274 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] [instance: 682138af-ba6a-47f1-a9a5-03ae2661f54d] Updating instance_info_cache with network_info: [{"id": "72fe24f4-00e3-40f1-a44a-014c7669e862", "address": "fa:16:3e:d2:52:c7", "network": {"id": "2a6e27c9-9bd2-4ccb-abf6-82d85524da90", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1822065121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb6ef2597eac461f959a568abd3031ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72fe24f4-00", "ovs_interfaceid": "72fe24f4-00e3-40f1-a44a-014c7669e862", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:16:21 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-bea4e44a-dc56-416e-b44f-4ae65f1e0274 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Releasing lock "refresh_cache-682138af-ba6a-47f1-a9a5-03ae2661f54d" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:16:21 user nova-compute[73572]: DEBUG nova.compute.manager [None req-bea4e44a-dc56-416e-b44f-4ae65f1e0274 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] [instance: 682138af-ba6a-47f1-a9a5-03ae2661f54d] Instance network_info: |[{"id": "72fe24f4-00e3-40f1-a44a-014c7669e862", "address": "fa:16:3e:d2:52:c7", "network": {"id": "2a6e27c9-9bd2-4ccb-abf6-82d85524da90", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1822065121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb6ef2597eac461f959a568abd3031ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72fe24f4-00", "ovs_interfaceid": "72fe24f4-00e3-40f1-a44a-014c7669e862", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73572) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 10:16:21 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-5bcb320b-6295-4ef8-89e1-2740e46d45ee req-4b46d057-6962-49ec-9c97-6a4788f48282 service nova] Acquired lock "refresh_cache-682138af-ba6a-47f1-a9a5-03ae2661f54d" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:16:21 user nova-compute[73572]: DEBUG nova.network.neutron [req-5bcb320b-6295-4ef8-89e1-2740e46d45ee req-4b46d057-6962-49ec-9c97-6a4788f48282 service nova] [instance: 682138af-ba6a-47f1-a9a5-03ae2661f54d] Refreshing network info cache for port 72fe24f4-00e3-40f1-a44a-014c7669e862 {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 10:16:21 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-bea4e44a-dc56-416e-b44f-4ae65f1e0274 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] [instance: 682138af-ba6a-47f1-a9a5-03ae2661f54d] Start _get_guest_xml network_info=[{"id": "72fe24f4-00e3-40f1-a44a-014c7669e862", "address": "fa:16:3e:d2:52:c7", "network": {"id": "2a6e27c9-9bd2-4ccb-abf6-82d85524da90", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1822065121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb6ef2597eac461f959a568abd3031ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72fe24f4-00", "ovs_interfaceid": "72fe24f4-00e3-40f1-a44a-014c7669e862", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T10:16:14Z,direct_url=<?>,disk_format='qcow2',id=bd4d7dcc-4b94-4755-8f4d-82a35910708b,min_disk=0,min_ram=0,name='tempest-scenario-img--1719745748',owner='eb6ef2597eac461f959a568abd3031ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T10:16:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'guest_format': None, 'size': 0, 'encryption_format': None, 'device_type': 'disk', 'image_id': 'bd4d7dcc-4b94-4755-8f4d-82a35910708b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73572) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 10:16:21 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-bea4e44a-dc56-416e-b44f-4ae65f1e0274 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:16:21 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-bea4e44a-dc56-416e-b44f-4ae65f1e0274 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:16:21 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-bea4e44a-dc56-416e-b44f-4ae65f1e0274 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73572) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 10:16:21 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-bea4e44a-dc56-416e-b44f-4ae65f1e0274 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] CPU controller missing on host. {{(pid=73572) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 10:16:22 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:16:22 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-bea4e44a-dc56-416e-b44f-4ae65f1e0274 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73572) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 10:16:22 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-bea4e44a-dc56-416e-b44f-4ae65f1e0274 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] CPU controller found on host. {{(pid=73572) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 10:16:22 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-bea4e44a-dc56-416e-b44f-4ae65f1e0274 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73572) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 10:16:22 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-bea4e44a-dc56-416e-b44f-4ae65f1e0274 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T10:07:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T10:16:14Z,direct_url=<?>,disk_format='qcow2',id=bd4d7dcc-4b94-4755-8f4d-82a35910708b,min_disk=0,min_ram=0,name='tempest-scenario-img--1719745748',owner='eb6ef2597eac461f959a568abd3031ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T10:16:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 10:16:22 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-bea4e44a-dc56-416e-b44f-4ae65f1e0274 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Flavor limits 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 10:16:22 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-bea4e44a-dc56-416e-b44f-4ae65f1e0274 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Image limits 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 10:16:22 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-bea4e44a-dc56-416e-b44f-4ae65f1e0274 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Flavor pref 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 10:16:22 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-bea4e44a-dc56-416e-b44f-4ae65f1e0274 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Image pref 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 10:16:22 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-bea4e44a-dc56-416e-b44f-4ae65f1e0274 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 10:16:22 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-bea4e44a-dc56-416e-b44f-4ae65f1e0274 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 10:16:22 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-bea4e44a-dc56-416e-b44f-4ae65f1e0274 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73572) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 10:16:22 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-bea4e44a-dc56-416e-b44f-4ae65f1e0274 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Got 1 possible topologies {{(pid=73572) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 10:16:22 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-bea4e44a-dc56-416e-b44f-4ae65f1e0274 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 10:16:22 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-bea4e44a-dc56-416e-b44f-4ae65f1e0274 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 10:16:22 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-bea4e44a-dc56-416e-b44f-4ae65f1e0274 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T10:16:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-599563112',display_name='tempest-TestMinimumBasicScenario-server-599563112',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-599563112',id=19,image_ref='bd4d7dcc-4b94-4755-8f4d-82a35910708b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAPaLciMuuXDmK5UDnc9dDAL0q42nrYLkWq/GzkjjE2uLKRfJ9mMrCN1hVlbNdhdzgF+EEXM/a0Wtl8GXTyBJxG1WbLNcxpzQzC0r1tfMhaC51ige81Z2TsBef7Q/w6+Iw==',key_name='tempest-TestMinimumBasicScenario-908269596',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eb6ef2597eac461f959a568abd3031ca',ramdisk_id='',reservation_id='r-gemevwm3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bd4d7dcc-4b94-4755-8f4d-82a35910708b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1705958769',owner_user_name='tempest-TestMinimumBasicScenario-1705958769-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T10:16:19Z,user_data=None,user_id='a354eb6764fd4c95a53b8962544bc49b',uuid=682138af-ba6a-47f1-a9a5-03ae2661f54d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "72fe24f4-00e3-40f1-a44a-014c7669e862", "address": "fa:16:3e:d2:52:c7", "network": {"id": "2a6e27c9-9bd2-4ccb-abf6-82d85524da90", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1822065121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb6ef2597eac461f959a568abd3031ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72fe24f4-00", "ovs_interfaceid": "72fe24f4-00e3-40f1-a44a-014c7669e862", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73572) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 10:16:22 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-bea4e44a-dc56-416e-b44f-4ae65f1e0274 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Converting VIF {"id": "72fe24f4-00e3-40f1-a44a-014c7669e862", "address": "fa:16:3e:d2:52:c7", "network": {"id": "2a6e27c9-9bd2-4ccb-abf6-82d85524da90", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1822065121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb6ef2597eac461f959a568abd3031ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72fe24f4-00", "ovs_interfaceid": "72fe24f4-00e3-40f1-a44a-014c7669e862", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:16:22 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-bea4e44a-dc56-416e-b44f-4ae65f1e0274 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:52:c7,bridge_name='br-int',has_traffic_filtering=True,id=72fe24f4-00e3-40f1-a44a-014c7669e862,network=Network(2a6e27c9-9bd2-4ccb-abf6-82d85524da90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72fe24f4-00') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:16:22 user nova-compute[73572]: DEBUG nova.objects.instance [None req-bea4e44a-dc56-416e-b44f-4ae65f1e0274 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Lazy-loading 'pci_devices' on Instance uuid 682138af-ba6a-47f1-a9a5-03ae2661f54d {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:16:22 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:16:22 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:16:22 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Hypervisor/Node resource view: name=user free_ram=7146MB free_disk=25.38184356689453GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=73572) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 10:16:22 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:16:22 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:16:22 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-bea4e44a-dc56-416e-b44f-4ae65f1e0274 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] [instance: 682138af-ba6a-47f1-a9a5-03ae2661f54d] End _get_guest_xml xml=<domain type="kvm">
Aug 26 10:16:22 user nova-compute[73572]:   <uuid>682138af-ba6a-47f1-a9a5-03ae2661f54d</uuid>
Aug 26 10:16:22 user nova-compute[73572]:   <name>instance-00000013</name>
Aug 26 10:16:22 user nova-compute[73572]:   <memory>524288</memory>
Aug 26 10:16:22 user nova-compute[73572]:   <vcpu>1</vcpu>
Aug 26 10:16:22 user nova-compute[73572]:   <metadata>
Aug 26 10:16:22 user nova-compute[73572]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 10:16:22 user nova-compute[73572]:       <nova:package version="0.0.0"/>
Aug 26 10:16:22 user nova-compute[73572]:       <nova:name>tempest-TestMinimumBasicScenario-server-599563112</nova:name>
Aug 26 10:16:22 user nova-compute[73572]:       <nova:creationTime>2023-08-26 10:16:21</nova:creationTime>
Aug 26 10:16:22 user nova-compute[73572]:       <nova:flavor name="m1.tiny">
Aug 26 10:16:22 user nova-compute[73572]:         <nova:memory>512</nova:memory>
Aug 26 10:16:22 user nova-compute[73572]:         <nova:disk>1</nova:disk>
Aug 26 10:16:22 user nova-compute[73572]:         <nova:swap>0</nova:swap>
Aug 26 10:16:22 user nova-compute[73572]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 10:16:22 user nova-compute[73572]:         <nova:vcpus>1</nova:vcpus>
Aug 26 10:16:22 user nova-compute[73572]:       </nova:flavor>
Aug 26 10:16:22 user nova-compute[73572]:       <nova:owner>
Aug 26 10:16:22 user nova-compute[73572]:         <nova:user uuid="a354eb6764fd4c95a53b8962544bc49b">tempest-TestMinimumBasicScenario-1705958769-project-member</nova:user>
Aug 26 10:16:22 user nova-compute[73572]:         <nova:project uuid="eb6ef2597eac461f959a568abd3031ca">tempest-TestMinimumBasicScenario-1705958769</nova:project>
Aug 26 10:16:22 user nova-compute[73572]:       </nova:owner>
Aug 26 10:16:22 user nova-compute[73572]:       <nova:root type="image" uuid="bd4d7dcc-4b94-4755-8f4d-82a35910708b"/>
Aug 26 10:16:22 user nova-compute[73572]:       <nova:ports>
Aug 26 10:16:22 user nova-compute[73572]:         <nova:port uuid="72fe24f4-00e3-40f1-a44a-014c7669e862">
Aug 26 10:16:22 user nova-compute[73572]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 26 10:16:22 user nova-compute[73572]:         </nova:port>
Aug 26 10:16:22 user nova-compute[73572]:       </nova:ports>
Aug 26 10:16:22 user nova-compute[73572]:     </nova:instance>
Aug 26 10:16:22 user nova-compute[73572]:   </metadata>
Aug 26 10:16:22 user nova-compute[73572]:   <sysinfo type="smbios">
Aug 26 10:16:22 user nova-compute[73572]:     <system>
Aug 26 10:16:22 user nova-compute[73572]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 10:16:22 user nova-compute[73572]:       <entry name="product">OpenStack Nova</entry>
Aug 26 10:16:22 user nova-compute[73572]:       <entry name="version">0.0.0</entry>
Aug 26 10:16:22 user nova-compute[73572]:       <entry name="serial">682138af-ba6a-47f1-a9a5-03ae2661f54d</entry>
Aug 26 10:16:22 user nova-compute[73572]:       <entry name="uuid">682138af-ba6a-47f1-a9a5-03ae2661f54d</entry>
Aug 26 10:16:22 user nova-compute[73572]:       <entry name="family">Virtual Machine</entry>
Aug 26 10:16:22 user nova-compute[73572]:     </system>
Aug 26 10:16:22 user nova-compute[73572]:   </sysinfo>
Aug 26 10:16:22 user nova-compute[73572]:   <os>
Aug 26 10:16:22 user nova-compute[73572]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 10:16:22 user nova-compute[73572]:     <boot dev="hd"/>
Aug 26 10:16:22 user nova-compute[73572]:     <smbios mode="sysinfo"/>
Aug 26 10:16:22 user nova-compute[73572]:   </os>
Aug 26 10:16:22 user nova-compute[73572]:   <features>
Aug 26 10:16:22 user nova-compute[73572]:     <acpi/>
Aug 26 10:16:22 user nova-compute[73572]:     <apic/>
Aug 26 10:16:22 user nova-compute[73572]:     <vmcoreinfo/>
Aug 26 10:16:22 user nova-compute[73572]:   </features>
Aug 26 10:16:22 user nova-compute[73572]:   <clock offset="utc">
Aug 26 10:16:22 user nova-compute[73572]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 10:16:22 user nova-compute[73572]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 10:16:22 user nova-compute[73572]:     <timer name="hpet" present="no"/>
Aug 26 10:16:22 user nova-compute[73572]:   </clock>
Aug 26 10:16:22 user nova-compute[73572]:   <cpu mode="custom" match="exact">
Aug 26 10:16:22 user nova-compute[73572]:     <model>Nehalem</model>
Aug 26 10:16:22 user nova-compute[73572]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 10:16:22 user nova-compute[73572]:   </cpu>
Aug 26 10:16:22 user nova-compute[73572]:   <devices>
Aug 26 10:16:22 user nova-compute[73572]:     <disk type="file" device="disk">
Aug 26 10:16:22 user nova-compute[73572]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 10:16:22 user nova-compute[73572]:       <source file="/opt/stack/data/nova/instances/682138af-ba6a-47f1-a9a5-03ae2661f54d/disk"/>
Aug 26 10:16:22 user nova-compute[73572]:       <target dev="vda" bus="virtio"/>
Aug 26 10:16:22 user nova-compute[73572]:     </disk>
Aug 26 10:16:22 user nova-compute[73572]:     <interface type="ethernet">
Aug 26 10:16:22 user nova-compute[73572]:       <mac address="fa:16:3e:d2:52:c7"/>
Aug 26 10:16:22 user nova-compute[73572]:       <model type="virtio"/>
Aug 26 10:16:22 user nova-compute[73572]:       <mtu size="1442"/>
Aug 26 10:16:22 user nova-compute[73572]:       <target dev="tap72fe24f4-00"/>
Aug 26 10:16:22 user nova-compute[73572]:     </interface>
Aug 26 10:16:22 user nova-compute[73572]:     <serial type="pty">
Aug 26 10:16:22 user nova-compute[73572]:       <log file="/opt/stack/data/nova/instances/682138af-ba6a-47f1-a9a5-03ae2661f54d/console.log" append="off"/>
Aug 26 10:16:22 user nova-compute[73572]:     </serial>
Aug 26 10:16:22 user nova-compute[73572]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 10:16:22 user nova-compute[73572]:     <video>
Aug 26 10:16:22 user nova-compute[73572]:       <model type="virtio"/>
Aug 26 10:16:22 user nova-compute[73572]:     </video>
Aug 26 10:16:22 user nova-compute[73572]:     <rng model="virtio">
Aug 26 10:16:22 user nova-compute[73572]:       <backend model="random">/dev/urandom</backend>
Aug 26 10:16:22 user nova-compute[73572]:     </rng>
Aug 26 10:16:22 user nova-compute[73572]:     <controller type="usb" index="0" model="none"/>
Aug 26 10:16:22 user nova-compute[73572]:     <memballoon model="virtio">
Aug 26 10:16:22 user nova-compute[73572]:       <stats period="10"/>
Aug 26 10:16:22 user nova-compute[73572]:     </memballoon>
Aug 26 10:16:22 user nova-compute[73572]:   </devices>
Aug 26 10:16:22 user nova-compute[73572]: </domain>
Aug 26 10:16:22 user nova-compute[73572]:  {{(pid=73572) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 10:16:22 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-bea4e44a-dc56-416e-b44f-4ae65f1e0274 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T10:16:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-599563112',display_name='tempest-TestMinimumBasicScenario-server-599563112',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-599563112',id=19,image_ref='bd4d7dcc-4b94-4755-8f4d-82a35910708b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAPaLciMuuXDmK5UDnc9dDAL0q42nrYLkWq/GzkjjE2uLKRfJ9mMrCN1hVlbNdhdzgF+EEXM/a0Wtl8GXTyBJxG1WbLNcxpzQzC0r1tfMhaC51ige81Z2TsBef7Q/w6+Iw==',key_name='tempest-TestMinimumBasicScenario-908269596',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eb6ef2597eac461f959a568abd3031ca',ramdisk_id='',reservation_id='r-gemevwm3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bd4d7dcc-4b94-4755-8f4d-82a35910708b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1705958769',owner_user_name='tempest-TestMinimumBasicScenario-1705958769-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T10:16:19Z,user_data=None,user_id='a354eb6764fd4c95a53b8962544bc49b',uuid=682138af-ba6a-47f1-a9a5-03ae2661f54d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "72fe24f4-00e3-40f1-a44a-014c7669e862", "address": "fa:16:3e:d2:52:c7", "network": {"id": "2a6e27c9-9bd2-4ccb-abf6-82d85524da90", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1822065121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb6ef2597eac461f959a568abd3031ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72fe24f4-00", "ovs_interfaceid": "72fe24f4-00e3-40f1-a44a-014c7669e862", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 10:16:22 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-bea4e44a-dc56-416e-b44f-4ae65f1e0274 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Converting VIF {"id": "72fe24f4-00e3-40f1-a44a-014c7669e862", "address": "fa:16:3e:d2:52:c7", "network": {"id": "2a6e27c9-9bd2-4ccb-abf6-82d85524da90", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1822065121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb6ef2597eac461f959a568abd3031ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72fe24f4-00", "ovs_interfaceid": "72fe24f4-00e3-40f1-a44a-014c7669e862", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:16:22 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-bea4e44a-dc56-416e-b44f-4ae65f1e0274 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:52:c7,bridge_name='br-int',has_traffic_filtering=True,id=72fe24f4-00e3-40f1-a44a-014c7669e862,network=Network(2a6e27c9-9bd2-4ccb-abf6-82d85524da90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72fe24f4-00') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:16:22 user nova-compute[73572]: DEBUG os_vif [None req-bea4e44a-dc56-416e-b44f-4ae65f1e0274 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:52:c7,bridge_name='br-int',has_traffic_filtering=True,id=72fe24f4-00e3-40f1-a44a-014c7669e862,network=Network(2a6e27c9-9bd2-4ccb-abf6-82d85524da90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72fe24f4-00') {{(pid=73572) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 10:16:22 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:16:22 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:16:22 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 10:16:22 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:16:22 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap72fe24f4-00, may_exist=True, interface_attrs={}) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:16:22 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap72fe24f4-00, col_values=(('external_ids', {'iface-id': '72fe24f4-00e3-40f1-a44a-014c7669e862', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d2:52:c7', 'vm-uuid': '682138af-ba6a-47f1-a9a5-03ae2661f54d'}),), if_exists=True) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:16:22 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:16:22 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:16:22 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:16:22 user nova-compute[73572]: INFO os_vif [None req-bea4e44a-dc56-416e-b44f-4ae65f1e0274 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:52:c7,bridge_name='br-int',has_traffic_filtering=True,id=72fe24f4-00e3-40f1-a44a-014c7669e862,network=Network(2a6e27c9-9bd2-4ccb-abf6-82d85524da90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72fe24f4-00')
Aug 26 10:16:22 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-bea4e44a-dc56-416e-b44f-4ae65f1e0274 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] No BDM found with device name vda, not building metadata. {{(pid=73572) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 10:16:22 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-bea4e44a-dc56-416e-b44f-4ae65f1e0274 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] No VIF found with MAC fa:16:3e:d2:52:c7, not building metadata {{(pid=73572) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 10:16:22 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance c785b609-0068-442f-91f5-d26e888a993f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:16:22 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance 8302d6e7-aaf3-461c-a55e-f2e685d1800d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:16:22 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance c555f971-b177-4c26-a38e-09e0e78bf7b9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:16:22 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance ee9bcbaa-25a6-4588-b757-2a2ae15b6cf8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:16:22 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance 32a28361-567b-4bd4-9f4f-d9cfac2c9388 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:16:22 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance 14fab12e-52be-4fe6-8777-bc7ebf3c25f1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:16:22 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance 00c47a06-2bf8-427d-bcb1-304688584511 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:16:22 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance d2970584-8c2a-4f99-922c-d66d59489504 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:16:22 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:16:22 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance b837eafb-db4e-4696-9b9f-bcfa1a30192a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:16:22 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance 682138af-ba6a-47f1-a9a5-03ae2661f54d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:16:22 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=73572) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 10:16:22 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=73572) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 10:16:22 user nova-compute[73572]: DEBUG nova.compute.provider_tree [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Inventory has not changed in ProviderTree for provider: e2cec974-59b2-4c77-a53d-a7f4e5a30d75 {{(pid=73572) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 10:16:22 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Inventory has not changed for provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73572) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 10:16:22 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Compute_service record updated for user:user {{(pid=73572) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 10:16:22 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.489s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:16:23 user nova-compute[73572]: DEBUG nova.network.neutron [req-5bcb320b-6295-4ef8-89e1-2740e46d45ee req-4b46d057-6962-49ec-9c97-6a4788f48282 service nova] [instance: 682138af-ba6a-47f1-a9a5-03ae2661f54d] Updated VIF entry in instance network info cache for port 72fe24f4-00e3-40f1-a44a-014c7669e862. {{(pid=73572) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 10:16:23 user nova-compute[73572]: DEBUG nova.network.neutron [req-5bcb320b-6295-4ef8-89e1-2740e46d45ee req-4b46d057-6962-49ec-9c97-6a4788f48282 service nova] [instance: 682138af-ba6a-47f1-a9a5-03ae2661f54d] Updating instance_info_cache with network_info: [{"id": "72fe24f4-00e3-40f1-a44a-014c7669e862", "address": "fa:16:3e:d2:52:c7", "network": {"id": "2a6e27c9-9bd2-4ccb-abf6-82d85524da90", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1822065121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb6ef2597eac461f959a568abd3031ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72fe24f4-00", "ovs_interfaceid": "72fe24f4-00e3-40f1-a44a-014c7669e862", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:16:23 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-5bcb320b-6295-4ef8-89e1-2740e46d45ee req-4b46d057-6962-49ec-9c97-6a4788f48282 service nova] Releasing lock "refresh_cache-682138af-ba6a-47f1-a9a5-03ae2661f54d" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:16:23 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:16:23 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:16:23 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:16:24 user nova-compute[73572]: DEBUG nova.compute.manager [req-22aee682-9740-4d5e-8311-3ef876a1ed96 req-baeda9b3-b9fc-453d-b670-5bc7eda8bc6c service nova] [instance: 682138af-ba6a-47f1-a9a5-03ae2661f54d] Received event network-vif-plugged-72fe24f4-00e3-40f1-a44a-014c7669e862 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:16:24 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-22aee682-9740-4d5e-8311-3ef876a1ed96 req-baeda9b3-b9fc-453d-b670-5bc7eda8bc6c service nova] Acquiring lock "682138af-ba6a-47f1-a9a5-03ae2661f54d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:16:24 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-22aee682-9740-4d5e-8311-3ef876a1ed96 req-baeda9b3-b9fc-453d-b670-5bc7eda8bc6c service nova] Lock "682138af-ba6a-47f1-a9a5-03ae2661f54d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:16:24 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-22aee682-9740-4d5e-8311-3ef876a1ed96 req-baeda9b3-b9fc-453d-b670-5bc7eda8bc6c service nova] Lock "682138af-ba6a-47f1-a9a5-03ae2661f54d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:16:24 user nova-compute[73572]: DEBUG nova.compute.manager [req-22aee682-9740-4d5e-8311-3ef876a1ed96 req-baeda9b3-b9fc-453d-b670-5bc7eda8bc6c service nova] [instance: 682138af-ba6a-47f1-a9a5-03ae2661f54d] No waiting events found dispatching network-vif-plugged-72fe24f4-00e3-40f1-a44a-014c7669e862 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:16:24 user nova-compute[73572]: WARNING nova.compute.manager [req-22aee682-9740-4d5e-8311-3ef876a1ed96 req-baeda9b3-b9fc-453d-b670-5bc7eda8bc6c service nova] [instance: 682138af-ba6a-47f1-a9a5-03ae2661f54d] Received unexpected event network-vif-plugged-72fe24f4-00e3-40f1-a44a-014c7669e862 for instance with vm_state building and task_state spawning.
Aug 26 10:16:24 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:16:24 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:16:24 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:16:24 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:16:24 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:16:24 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:16:25 user nova-compute[73572]: DEBUG nova.virt.driver [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Emitting event <LifecycleEvent: 1693044985.743048, 682138af-ba6a-47f1-a9a5-03ae2661f54d => Resumed> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:16:25 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 682138af-ba6a-47f1-a9a5-03ae2661f54d] VM Resumed (Lifecycle Event)
Aug 26 10:16:25 user nova-compute[73572]: DEBUG nova.compute.manager [None req-bea4e44a-dc56-416e-b44f-4ae65f1e0274 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] [instance: 682138af-ba6a-47f1-a9a5-03ae2661f54d] Instance event wait completed in 0 seconds for  {{(pid=73572) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 10:16:25 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-bea4e44a-dc56-416e-b44f-4ae65f1e0274 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] [instance: 682138af-ba6a-47f1-a9a5-03ae2661f54d] Guest created on hypervisor {{(pid=73572) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 10:16:25 user nova-compute[73572]: INFO nova.virt.libvirt.driver [-] [instance: 682138af-ba6a-47f1-a9a5-03ae2661f54d] Instance spawned successfully.
Aug 26 10:16:25 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-bea4e44a-dc56-416e-b44f-4ae65f1e0274 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] [instance: 682138af-ba6a-47f1-a9a5-03ae2661f54d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 10:16:25 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 682138af-ba6a-47f1-a9a5-03ae2661f54d] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:16:25 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-bea4e44a-dc56-416e-b44f-4ae65f1e0274 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] [instance: 682138af-ba6a-47f1-a9a5-03ae2661f54d] Found default for hw_cdrom_bus of ide {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:16:25 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-bea4e44a-dc56-416e-b44f-4ae65f1e0274 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] [instance: 682138af-ba6a-47f1-a9a5-03ae2661f54d] Found default for hw_disk_bus of virtio {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:16:25 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-bea4e44a-dc56-416e-b44f-4ae65f1e0274 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] [instance: 682138af-ba6a-47f1-a9a5-03ae2661f54d] Found default for hw_input_bus of None {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:16:25 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-bea4e44a-dc56-416e-b44f-4ae65f1e0274 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] [instance: 682138af-ba6a-47f1-a9a5-03ae2661f54d] Found default for hw_pointer_model of None {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:16:25 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-bea4e44a-dc56-416e-b44f-4ae65f1e0274 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] [instance: 682138af-ba6a-47f1-a9a5-03ae2661f54d] Found default for hw_video_model of virtio {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:16:25 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-bea4e44a-dc56-416e-b44f-4ae65f1e0274 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] [instance: 682138af-ba6a-47f1-a9a5-03ae2661f54d] Found default for hw_vif_model of virtio {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:16:25 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 682138af-ba6a-47f1-a9a5-03ae2661f54d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73572) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 10:16:25 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 682138af-ba6a-47f1-a9a5-03ae2661f54d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 10:16:25 user nova-compute[73572]: DEBUG nova.virt.driver [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Emitting event <LifecycleEvent: 1693044985.7441003, 682138af-ba6a-47f1-a9a5-03ae2661f54d => Started> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:16:25 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 682138af-ba6a-47f1-a9a5-03ae2661f54d] VM Started (Lifecycle Event)
Aug 26 10:16:25 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 682138af-ba6a-47f1-a9a5-03ae2661f54d] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:16:25 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 682138af-ba6a-47f1-a9a5-03ae2661f54d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73572) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 10:16:25 user nova-compute[73572]: INFO nova.compute.manager [None req-bea4e44a-dc56-416e-b44f-4ae65f1e0274 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] [instance: 682138af-ba6a-47f1-a9a5-03ae2661f54d] Took 7.15 seconds to spawn the instance on the hypervisor.
Aug 26 10:16:25 user nova-compute[73572]: DEBUG nova.compute.manager [None req-bea4e44a-dc56-416e-b44f-4ae65f1e0274 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] [instance: 682138af-ba6a-47f1-a9a5-03ae2661f54d] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:16:25 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 682138af-ba6a-47f1-a9a5-03ae2661f54d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 10:16:26 user nova-compute[73572]: INFO nova.compute.manager [None req-bea4e44a-dc56-416e-b44f-4ae65f1e0274 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] [instance: 682138af-ba6a-47f1-a9a5-03ae2661f54d] Took 8.26 seconds to build instance.
Aug 26 10:16:26 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-bea4e44a-dc56-416e-b44f-4ae65f1e0274 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Lock "682138af-ba6a-47f1-a9a5-03ae2661f54d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.632s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:16:26 user nova-compute[73572]: DEBUG nova.compute.manager [req-f8ae7dd6-25ff-42f8-9e20-83b44a2cb62a req-3b559c37-90d8-42ca-a189-008a947115fa service nova] [instance: 682138af-ba6a-47f1-a9a5-03ae2661f54d] Received event network-vif-plugged-72fe24f4-00e3-40f1-a44a-014c7669e862 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:16:26 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-f8ae7dd6-25ff-42f8-9e20-83b44a2cb62a req-3b559c37-90d8-42ca-a189-008a947115fa service nova] Acquiring lock "682138af-ba6a-47f1-a9a5-03ae2661f54d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:16:26 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-f8ae7dd6-25ff-42f8-9e20-83b44a2cb62a req-3b559c37-90d8-42ca-a189-008a947115fa service nova] Lock "682138af-ba6a-47f1-a9a5-03ae2661f54d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:16:26 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-f8ae7dd6-25ff-42f8-9e20-83b44a2cb62a req-3b559c37-90d8-42ca-a189-008a947115fa service nova] Lock "682138af-ba6a-47f1-a9a5-03ae2661f54d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:16:26 user nova-compute[73572]: DEBUG nova.compute.manager [req-f8ae7dd6-25ff-42f8-9e20-83b44a2cb62a req-3b559c37-90d8-42ca-a189-008a947115fa service nova] [instance: 682138af-ba6a-47f1-a9a5-03ae2661f54d] No waiting events found dispatching network-vif-plugged-72fe24f4-00e3-40f1-a44a-014c7669e862 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:16:26 user nova-compute[73572]: WARNING nova.compute.manager [req-f8ae7dd6-25ff-42f8-9e20-83b44a2cb62a req-3b559c37-90d8-42ca-a189-008a947115fa service nova] [instance: 682138af-ba6a-47f1-a9a5-03ae2661f54d] Received unexpected event network-vif-plugged-72fe24f4-00e3-40f1-a44a-014c7669e862 for instance with vm_state active and task_state None.
Aug 26 10:16:26 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:16:27 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:16:29 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:16:31 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:16:32 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:16:34 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:16:34 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:16:37 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:16:39 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:16:42 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:16:42 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:16:43 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-928d03d5-13c3-46d7-aa42-111721574403 tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] Acquiring lock "0dceaa35-4a13-453b-961f-831f66c35af0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:16:43 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-928d03d5-13c3-46d7-aa42-111721574403 tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] Lock "0dceaa35-4a13-453b-961f-831f66c35af0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:16:43 user nova-compute[73572]: DEBUG nova.compute.manager [None req-928d03d5-13c3-46d7-aa42-111721574403 tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] [instance: 0dceaa35-4a13-453b-961f-831f66c35af0] Starting instance... {{(pid=73572) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 10:16:43 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-928d03d5-13c3-46d7-aa42-111721574403 tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:16:43 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-928d03d5-13c3-46d7-aa42-111721574403 tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:16:43 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-928d03d5-13c3-46d7-aa42-111721574403 tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73572) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 10:16:43 user nova-compute[73572]: INFO nova.compute.claims [None req-928d03d5-13c3-46d7-aa42-111721574403 tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] [instance: 0dceaa35-4a13-453b-961f-831f66c35af0] Claim successful on node user
Aug 26 10:16:44 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:16:44 user nova-compute[73572]: DEBUG nova.compute.provider_tree [None req-928d03d5-13c3-46d7-aa42-111721574403 tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] Inventory has not changed in ProviderTree for provider: e2cec974-59b2-4c77-a53d-a7f4e5a30d75 {{(pid=73572) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 10:16:44 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-928d03d5-13c3-46d7-aa42-111721574403 tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] Inventory has not changed for provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73572) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 10:16:44 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-928d03d5-13c3-46d7-aa42-111721574403 tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.503s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:16:44 user nova-compute[73572]: DEBUG nova.compute.manager [None req-928d03d5-13c3-46d7-aa42-111721574403 tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] [instance: 0dceaa35-4a13-453b-961f-831f66c35af0] Start building networks asynchronously for instance. {{(pid=73572) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 10:16:44 user nova-compute[73572]: DEBUG nova.compute.manager [None req-928d03d5-13c3-46d7-aa42-111721574403 tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] [instance: 0dceaa35-4a13-453b-961f-831f66c35af0] Allocating IP information in the background. {{(pid=73572) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 10:16:44 user nova-compute[73572]: DEBUG nova.network.neutron [None req-928d03d5-13c3-46d7-aa42-111721574403 tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] [instance: 0dceaa35-4a13-453b-961f-831f66c35af0] allocate_for_instance() {{(pid=73572) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 10:16:44 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-928d03d5-13c3-46d7-aa42-111721574403 tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] [instance: 0dceaa35-4a13-453b-961f-831f66c35af0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 10:16:44 user nova-compute[73572]: DEBUG nova.compute.manager [None req-928d03d5-13c3-46d7-aa42-111721574403 tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] [instance: 0dceaa35-4a13-453b-961f-831f66c35af0] Start building block device mappings for instance. {{(pid=73572) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 10:16:44 user nova-compute[73572]: DEBUG nova.policy [None req-928d03d5-13c3-46d7-aa42-111721574403 tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5ff395781b5f403fa56cada31e168817', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d2915087eb04830831062675024f835', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73572) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 10:16:44 user nova-compute[73572]: DEBUG nova.compute.manager [None req-928d03d5-13c3-46d7-aa42-111721574403 tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] [instance: 0dceaa35-4a13-453b-961f-831f66c35af0] Start spawning the instance on the hypervisor. {{(pid=73572) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 10:16:44 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-928d03d5-13c3-46d7-aa42-111721574403 tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] [instance: 0dceaa35-4a13-453b-961f-831f66c35af0] Creating instance directory {{(pid=73572) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 10:16:44 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-928d03d5-13c3-46d7-aa42-111721574403 tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] [instance: 0dceaa35-4a13-453b-961f-831f66c35af0] Creating image(s)
Aug 26 10:16:44 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-928d03d5-13c3-46d7-aa42-111721574403 tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] Acquiring lock "/opt/stack/data/nova/instances/0dceaa35-4a13-453b-961f-831f66c35af0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:16:44 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-928d03d5-13c3-46d7-aa42-111721574403 tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] Lock "/opt/stack/data/nova/instances/0dceaa35-4a13-453b-961f-831f66c35af0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:16:44 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-928d03d5-13c3-46d7-aa42-111721574403 tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] Lock "/opt/stack/data/nova/instances/0dceaa35-4a13-453b-961f-831f66c35af0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:16:44 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-928d03d5-13c3-46d7-aa42-111721574403 tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:16:44 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-928d03d5-13c3-46d7-aa42-111721574403 tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json" returned: 0 in 0.194s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:16:44 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-928d03d5-13c3-46d7-aa42-111721574403 tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] Acquiring lock "2099350d6f3bcd0de9471c73862d4fe75b049801" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:16:44 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-928d03d5-13c3-46d7-aa42-111721574403 tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] Lock "2099350d6f3bcd0de9471c73862d4fe75b049801" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:16:44 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-928d03d5-13c3-46d7-aa42-111721574403 tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:16:45 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-928d03d5-13c3-46d7-aa42-111721574403 tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json" returned: 0 in 0.185s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:16:45 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-928d03d5-13c3-46d7-aa42-111721574403 tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801,backing_fmt=raw /opt/stack/data/nova/instances/0dceaa35-4a13-453b-961f-831f66c35af0/disk 1073741824 {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:16:45 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-928d03d5-13c3-46d7-aa42-111721574403 tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801,backing_fmt=raw /opt/stack/data/nova/instances/0dceaa35-4a13-453b-961f-831f66c35af0/disk 1073741824" returned: 0 in 0.054s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:16:45 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-928d03d5-13c3-46d7-aa42-111721574403 tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] Lock "2099350d6f3bcd0de9471c73862d4fe75b049801" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.247s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:16:45 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-928d03d5-13c3-46d7-aa42-111721574403 tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:16:45 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-928d03d5-13c3-46d7-aa42-111721574403 tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json" returned: 0 in 0.238s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:16:45 user nova-compute[73572]: DEBUG nova.virt.disk.api [None req-928d03d5-13c3-46d7-aa42-111721574403 tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0dceaa35-4a13-453b-961f-831f66c35af0/disk. size=1073741824 {{(pid=73572) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 10:16:45 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-928d03d5-13c3-46d7-aa42-111721574403 tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dceaa35-4a13-453b-961f-831f66c35af0/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:16:45 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-928d03d5-13c3-46d7-aa42-111721574403 tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dceaa35-4a13-453b-961f-831f66c35af0/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:16:45 user nova-compute[73572]: DEBUG nova.virt.disk.api [None req-928d03d5-13c3-46d7-aa42-111721574403 tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] Cannot resize image /opt/stack/data/nova/instances/0dceaa35-4a13-453b-961f-831f66c35af0/disk to a smaller size. {{(pid=73572) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 10:16:45 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-928d03d5-13c3-46d7-aa42-111721574403 tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] [instance: 0dceaa35-4a13-453b-961f-831f66c35af0] Created local disks {{(pid=73572) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 10:16:45 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-928d03d5-13c3-46d7-aa42-111721574403 tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] [instance: 0dceaa35-4a13-453b-961f-831f66c35af0] Ensure instance console log exists: /opt/stack/data/nova/instances/0dceaa35-4a13-453b-961f-831f66c35af0/console.log {{(pid=73572) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 10:16:45 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-928d03d5-13c3-46d7-aa42-111721574403 tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:16:45 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-928d03d5-13c3-46d7-aa42-111721574403 tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:16:45 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-928d03d5-13c3-46d7-aa42-111721574403 tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:16:45 user nova-compute[73572]: DEBUG nova.network.neutron [None req-928d03d5-13c3-46d7-aa42-111721574403 tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] [instance: 0dceaa35-4a13-453b-961f-831f66c35af0] Successfully created port: 3c5d5d20-da80-4401-b027-3c4b0df169c6 {{(pid=73572) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 10:16:46 user nova-compute[73572]: DEBUG nova.network.neutron [None req-928d03d5-13c3-46d7-aa42-111721574403 tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] [instance: 0dceaa35-4a13-453b-961f-831f66c35af0] Successfully updated port: 3c5d5d20-da80-4401-b027-3c4b0df169c6 {{(pid=73572) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 10:16:46 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-928d03d5-13c3-46d7-aa42-111721574403 tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] Acquiring lock "refresh_cache-0dceaa35-4a13-453b-961f-831f66c35af0" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:16:46 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-928d03d5-13c3-46d7-aa42-111721574403 tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] Acquired lock "refresh_cache-0dceaa35-4a13-453b-961f-831f66c35af0" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:16:46 user nova-compute[73572]: DEBUG nova.network.neutron [None req-928d03d5-13c3-46d7-aa42-111721574403 tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] [instance: 0dceaa35-4a13-453b-961f-831f66c35af0] Building network info cache for instance {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 10:16:46 user nova-compute[73572]: DEBUG nova.network.neutron [None req-928d03d5-13c3-46d7-aa42-111721574403 tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] [instance: 0dceaa35-4a13-453b-961f-831f66c35af0] Instance cache missing network info. {{(pid=73572) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 10:16:47 user nova-compute[73572]: DEBUG nova.compute.manager [req-dbbdaa27-a4f8-415a-b195-a75e09dab656 req-7dc10905-3f10-4553-9bdd-9a9b17f1982c service nova] [instance: 0dceaa35-4a13-453b-961f-831f66c35af0] Received event network-changed-3c5d5d20-da80-4401-b027-3c4b0df169c6 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:16:47 user nova-compute[73572]: DEBUG nova.compute.manager [req-dbbdaa27-a4f8-415a-b195-a75e09dab656 req-7dc10905-3f10-4553-9bdd-9a9b17f1982c service nova] [instance: 0dceaa35-4a13-453b-961f-831f66c35af0] Refreshing instance network info cache due to event network-changed-3c5d5d20-da80-4401-b027-3c4b0df169c6. {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 10:16:47 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-dbbdaa27-a4f8-415a-b195-a75e09dab656 req-7dc10905-3f10-4553-9bdd-9a9b17f1982c service nova] Acquiring lock "refresh_cache-0dceaa35-4a13-453b-961f-831f66c35af0" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:16:47 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:16:47 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:16:47 user nova-compute[73572]: DEBUG nova.network.neutron [None req-928d03d5-13c3-46d7-aa42-111721574403 tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] [instance: 0dceaa35-4a13-453b-961f-831f66c35af0] Updating instance_info_cache with network_info: [{"id": "3c5d5d20-da80-4401-b027-3c4b0df169c6", "address": "fa:16:3e:ad:63:c3", "network": {"id": "92949b0a-01f9-413c-9f96-a25b9b648f84", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-167588816-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d2915087eb04830831062675024f835", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c5d5d20-da", "ovs_interfaceid": "3c5d5d20-da80-4401-b027-3c4b0df169c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:16:47 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-928d03d5-13c3-46d7-aa42-111721574403 tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] Releasing lock "refresh_cache-0dceaa35-4a13-453b-961f-831f66c35af0" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:16:47 user nova-compute[73572]: DEBUG nova.compute.manager [None req-928d03d5-13c3-46d7-aa42-111721574403 tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] [instance: 0dceaa35-4a13-453b-961f-831f66c35af0] Instance network_info: |[{"id": "3c5d5d20-da80-4401-b027-3c4b0df169c6", "address": "fa:16:3e:ad:63:c3", "network": {"id": "92949b0a-01f9-413c-9f96-a25b9b648f84", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-167588816-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d2915087eb04830831062675024f835", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c5d5d20-da", "ovs_interfaceid": "3c5d5d20-da80-4401-b027-3c4b0df169c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73572) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 10:16:47 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-dbbdaa27-a4f8-415a-b195-a75e09dab656 req-7dc10905-3f10-4553-9bdd-9a9b17f1982c service nova] Acquired lock "refresh_cache-0dceaa35-4a13-453b-961f-831f66c35af0" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:16:47 user nova-compute[73572]: DEBUG nova.network.neutron [req-dbbdaa27-a4f8-415a-b195-a75e09dab656 req-7dc10905-3f10-4553-9bdd-9a9b17f1982c service nova] [instance: 0dceaa35-4a13-453b-961f-831f66c35af0] Refreshing network info cache for port 3c5d5d20-da80-4401-b027-3c4b0df169c6 {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 10:16:47 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-928d03d5-13c3-46d7-aa42-111721574403 tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] [instance: 0dceaa35-4a13-453b-961f-831f66c35af0] Start _get_guest_xml network_info=[{"id": "3c5d5d20-da80-4401-b027-3c4b0df169c6", "address": "fa:16:3e:ad:63:c3", "network": {"id": "92949b0a-01f9-413c-9f96-a25b9b648f84", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-167588816-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d2915087eb04830831062675024f835", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c5d5d20-da", "ovs_interfaceid": "3c5d5d20-da80-4401-b027-3c4b0df169c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T10:07:33Z,direct_url=<?>,disk_format='qcow2',id=299da0c9-e1c4-48f0-be55-fbe20dd06bc9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5c995f8bbbab4368b67a253e0df3971a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T10:07:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'guest_format': None, 'size': 0, 'encryption_format': None, 'device_type': 'disk', 'image_id': '299da0c9-e1c4-48f0-be55-fbe20dd06bc9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73572) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 10:16:47 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-928d03d5-13c3-46d7-aa42-111721574403 tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:16:47 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-928d03d5-13c3-46d7-aa42-111721574403 tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:16:47 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-928d03d5-13c3-46d7-aa42-111721574403 tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73572) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 10:16:47 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-928d03d5-13c3-46d7-aa42-111721574403 tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] CPU controller missing on host. {{(pid=73572) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 10:16:47 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-928d03d5-13c3-46d7-aa42-111721574403 tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73572) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 10:16:47 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-928d03d5-13c3-46d7-aa42-111721574403 tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] CPU controller found on host. {{(pid=73572) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 10:16:47 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-928d03d5-13c3-46d7-aa42-111721574403 tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73572) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 10:16:47 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-928d03d5-13c3-46d7-aa42-111721574403 tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T10:07:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T10:07:33Z,direct_url=<?>,disk_format='qcow2',id=299da0c9-e1c4-48f0-be55-fbe20dd06bc9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5c995f8bbbab4368b67a253e0df3971a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T10:07:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 10:16:47 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-928d03d5-13c3-46d7-aa42-111721574403 tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] Flavor limits 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 10:16:47 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-928d03d5-13c3-46d7-aa42-111721574403 tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] Image limits 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 10:16:47 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-928d03d5-13c3-46d7-aa42-111721574403 tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] Flavor pref 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 10:16:47 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-928d03d5-13c3-46d7-aa42-111721574403 tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] Image pref 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 10:16:47 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-928d03d5-13c3-46d7-aa42-111721574403 tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 10:16:47 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-928d03d5-13c3-46d7-aa42-111721574403 tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 10:16:47 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-928d03d5-13c3-46d7-aa42-111721574403 tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73572) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 10:16:47 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-928d03d5-13c3-46d7-aa42-111721574403 tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] Got 1 possible topologies {{(pid=73572) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 10:16:47 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-928d03d5-13c3-46d7-aa42-111721574403 tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 10:16:47 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-928d03d5-13c3-46d7-aa42-111721574403 tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 10:16:47 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-928d03d5-13c3-46d7-aa42-111721574403 tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T10:16:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1180989107',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1180989107',id=20,image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCoQLfbNOsScPlPdH7TTAWBoUTtprP7Wt9D2iobB5TEO7soZAUDBZvsnw8EfneOw36+/lna9tLwlSS51wnghWJumalBKBT2droQjZV+qAgp3BnIGzzIB2rwkhacN2zLmGg==',key_name='tempest-keypair-1046141656',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6d2915087eb04830831062675024f835',ramdisk_id='',reservation_id='r-untu6l5l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1639980618',owner_user_name='tempest-TaggedAttachmentsTest-1639980618-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T10:16:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5ff395781b5f403fa56cada31e168817',uuid=0dceaa35-4a13-453b-961f-831f66c35af0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3c5d5d20-da80-4401-b027-3c4b0df169c6", "address": "fa:16:3e:ad:63:c3", "network": {"id": "92949b0a-01f9-413c-9f96-a25b9b648f84", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-167588816-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d2915087eb04830831062675024f835", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c5d5d20-da", "ovs_interfaceid": "3c5d5d20-da80-4401-b027-3c4b0df169c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73572) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 10:16:47 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-928d03d5-13c3-46d7-aa42-111721574403 tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] Converting VIF {"id": "3c5d5d20-da80-4401-b027-3c4b0df169c6", "address": "fa:16:3e:ad:63:c3", "network": {"id": "92949b0a-01f9-413c-9f96-a25b9b648f84", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-167588816-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d2915087eb04830831062675024f835", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c5d5d20-da", "ovs_interfaceid": "3c5d5d20-da80-4401-b027-3c4b0df169c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:16:47 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-928d03d5-13c3-46d7-aa42-111721574403 tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:63:c3,bridge_name='br-int',has_traffic_filtering=True,id=3c5d5d20-da80-4401-b027-3c4b0df169c6,network=Network(92949b0a-01f9-413c-9f96-a25b9b648f84),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c5d5d20-da') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:16:47 user nova-compute[73572]: DEBUG nova.objects.instance [None req-928d03d5-13c3-46d7-aa42-111721574403 tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] Lazy-loading 'pci_devices' on Instance uuid 0dceaa35-4a13-453b-961f-831f66c35af0 {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:16:47 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-928d03d5-13c3-46d7-aa42-111721574403 tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] [instance: 0dceaa35-4a13-453b-961f-831f66c35af0] End _get_guest_xml xml=<domain type="kvm">
Aug 26 10:16:47 user nova-compute[73572]:   <uuid>0dceaa35-4a13-453b-961f-831f66c35af0</uuid>
Aug 26 10:16:47 user nova-compute[73572]:   <name>instance-00000014</name>
Aug 26 10:16:47 user nova-compute[73572]:   <memory>524288</memory>
Aug 26 10:16:47 user nova-compute[73572]:   <vcpu>1</vcpu>
Aug 26 10:16:47 user nova-compute[73572]:   <metadata>
Aug 26 10:16:47 user nova-compute[73572]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 10:16:47 user nova-compute[73572]:       <nova:package version="0.0.0"/>
Aug 26 10:16:47 user nova-compute[73572]:       <nova:name>tempest-device-tagging-server-1180989107</nova:name>
Aug 26 10:16:47 user nova-compute[73572]:       <nova:creationTime>2023-08-26 10:16:47</nova:creationTime>
Aug 26 10:16:47 user nova-compute[73572]:       <nova:flavor name="m1.tiny">
Aug 26 10:16:47 user nova-compute[73572]:         <nova:memory>512</nova:memory>
Aug 26 10:16:47 user nova-compute[73572]:         <nova:disk>1</nova:disk>
Aug 26 10:16:47 user nova-compute[73572]:         <nova:swap>0</nova:swap>
Aug 26 10:16:47 user nova-compute[73572]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 10:16:47 user nova-compute[73572]:         <nova:vcpus>1</nova:vcpus>
Aug 26 10:16:47 user nova-compute[73572]:       </nova:flavor>
Aug 26 10:16:47 user nova-compute[73572]:       <nova:owner>
Aug 26 10:16:47 user nova-compute[73572]:         <nova:user uuid="5ff395781b5f403fa56cada31e168817">tempest-TaggedAttachmentsTest-1639980618-project-member</nova:user>
Aug 26 10:16:47 user nova-compute[73572]:         <nova:project uuid="6d2915087eb04830831062675024f835">tempest-TaggedAttachmentsTest-1639980618</nova:project>
Aug 26 10:16:47 user nova-compute[73572]:       </nova:owner>
Aug 26 10:16:47 user nova-compute[73572]:       <nova:root type="image" uuid="299da0c9-e1c4-48f0-be55-fbe20dd06bc9"/>
Aug 26 10:16:47 user nova-compute[73572]:       <nova:ports>
Aug 26 10:16:47 user nova-compute[73572]:         <nova:port uuid="3c5d5d20-da80-4401-b027-3c4b0df169c6">
Aug 26 10:16:47 user nova-compute[73572]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 26 10:16:47 user nova-compute[73572]:         </nova:port>
Aug 26 10:16:47 user nova-compute[73572]:       </nova:ports>
Aug 26 10:16:47 user nova-compute[73572]:     </nova:instance>
Aug 26 10:16:47 user nova-compute[73572]:   </metadata>
Aug 26 10:16:47 user nova-compute[73572]:   <sysinfo type="smbios">
Aug 26 10:16:47 user nova-compute[73572]:     <system>
Aug 26 10:16:47 user nova-compute[73572]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 10:16:47 user nova-compute[73572]:       <entry name="product">OpenStack Nova</entry>
Aug 26 10:16:47 user nova-compute[73572]:       <entry name="version">0.0.0</entry>
Aug 26 10:16:47 user nova-compute[73572]:       <entry name="serial">0dceaa35-4a13-453b-961f-831f66c35af0</entry>
Aug 26 10:16:47 user nova-compute[73572]:       <entry name="uuid">0dceaa35-4a13-453b-961f-831f66c35af0</entry>
Aug 26 10:16:47 user nova-compute[73572]:       <entry name="family">Virtual Machine</entry>
Aug 26 10:16:47 user nova-compute[73572]:     </system>
Aug 26 10:16:47 user nova-compute[73572]:   </sysinfo>
Aug 26 10:16:47 user nova-compute[73572]:   <os>
Aug 26 10:16:47 user nova-compute[73572]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 10:16:47 user nova-compute[73572]:     <boot dev="hd"/>
Aug 26 10:16:47 user nova-compute[73572]:     <smbios mode="sysinfo"/>
Aug 26 10:16:47 user nova-compute[73572]:   </os>
Aug 26 10:16:47 user nova-compute[73572]:   <features>
Aug 26 10:16:47 user nova-compute[73572]:     <acpi/>
Aug 26 10:16:47 user nova-compute[73572]:     <apic/>
Aug 26 10:16:47 user nova-compute[73572]:     <vmcoreinfo/>
Aug 26 10:16:47 user nova-compute[73572]:   </features>
Aug 26 10:16:47 user nova-compute[73572]:   <clock offset="utc">
Aug 26 10:16:47 user nova-compute[73572]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 10:16:47 user nova-compute[73572]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 10:16:47 user nova-compute[73572]:     <timer name="hpet" present="no"/>
Aug 26 10:16:47 user nova-compute[73572]:   </clock>
Aug 26 10:16:47 user nova-compute[73572]:   <cpu mode="custom" match="exact">
Aug 26 10:16:47 user nova-compute[73572]:     <model>Nehalem</model>
Aug 26 10:16:47 user nova-compute[73572]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 10:16:47 user nova-compute[73572]:   </cpu>
Aug 26 10:16:47 user nova-compute[73572]:   <devices>
Aug 26 10:16:47 user nova-compute[73572]:     <disk type="file" device="disk">
Aug 26 10:16:47 user nova-compute[73572]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 10:16:47 user nova-compute[73572]:       <source file="/opt/stack/data/nova/instances/0dceaa35-4a13-453b-961f-831f66c35af0/disk"/>
Aug 26 10:16:47 user nova-compute[73572]:       <target dev="vda" bus="virtio"/>
Aug 26 10:16:47 user nova-compute[73572]:     </disk>
Aug 26 10:16:47 user nova-compute[73572]:     <disk type="file" device="cdrom">
Aug 26 10:16:47 user nova-compute[73572]:       <driver name="qemu" type="raw" cache="none"/>
Aug 26 10:16:47 user nova-compute[73572]:       <source file="/opt/stack/data/nova/instances/0dceaa35-4a13-453b-961f-831f66c35af0/disk.config"/>
Aug 26 10:16:47 user nova-compute[73572]:       <target dev="hda" bus="ide"/>
Aug 26 10:16:47 user nova-compute[73572]:     </disk>
Aug 26 10:16:47 user nova-compute[73572]:     <interface type="ethernet">
Aug 26 10:16:47 user nova-compute[73572]:       <mac address="fa:16:3e:ad:63:c3"/>
Aug 26 10:16:47 user nova-compute[73572]:       <model type="virtio"/>
Aug 26 10:16:47 user nova-compute[73572]:       <mtu size="1442"/>
Aug 26 10:16:47 user nova-compute[73572]:       <target dev="tap3c5d5d20-da"/>
Aug 26 10:16:47 user nova-compute[73572]:     </interface>
Aug 26 10:16:47 user nova-compute[73572]:     <serial type="pty">
Aug 26 10:16:47 user nova-compute[73572]:       <log file="/opt/stack/data/nova/instances/0dceaa35-4a13-453b-961f-831f66c35af0/console.log" append="off"/>
Aug 26 10:16:47 user nova-compute[73572]:     </serial>
Aug 26 10:16:47 user nova-compute[73572]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 10:16:47 user nova-compute[73572]:     <video>
Aug 26 10:16:47 user nova-compute[73572]:       <model type="virtio"/>
Aug 26 10:16:47 user nova-compute[73572]:     </video>
Aug 26 10:16:47 user nova-compute[73572]:     <rng model="virtio">
Aug 26 10:16:47 user nova-compute[73572]:       <backend model="random">/dev/urandom</backend>
Aug 26 10:16:47 user nova-compute[73572]:     </rng>
Aug 26 10:16:47 user nova-compute[73572]:     <controller type="usb" index="0" model="none"/>
Aug 26 10:16:47 user nova-compute[73572]:     <memballoon model="virtio">
Aug 26 10:16:47 user nova-compute[73572]:       <stats period="10"/>
Aug 26 10:16:47 user nova-compute[73572]:     </memballoon>
Aug 26 10:16:47 user nova-compute[73572]:   </devices>
Aug 26 10:16:47 user nova-compute[73572]: </domain>
Aug 26 10:16:47 user nova-compute[73572]:  {{(pid=73572) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 10:16:47 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-928d03d5-13c3-46d7-aa42-111721574403 tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T10:16:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1180989107',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1180989107',id=20,image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCoQLfbNOsScPlPdH7TTAWBoUTtprP7Wt9D2iobB5TEO7soZAUDBZvsnw8EfneOw36+/lna9tLwlSS51wnghWJumalBKBT2droQjZV+qAgp3BnIGzzIB2rwkhacN2zLmGg==',key_name='tempest-keypair-1046141656',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6d2915087eb04830831062675024f835',ramdisk_id='',reservation_id='r-untu6l5l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1639980618',owner_user_name='tempest-TaggedAttachmentsTest-1639980618-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T10:16:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5ff395781b5f403fa56cada31e168817',uuid=0dceaa35-4a13-453b-961f-831f66c35af0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3c5d5d20-da80-4401-b027-3c4b0df169c6", "address": "fa:16:3e:ad:63:c3", "network": {"id": "92949b0a-01f9-413c-9f96-a25b9b648f84", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-167588816-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d2915087eb04830831062675024f835", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c5d5d20-da", "ovs_interfaceid": "3c5d5d20-da80-4401-b027-3c4b0df169c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 10:16:47 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-928d03d5-13c3-46d7-aa42-111721574403 tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] Converting VIF {"id": "3c5d5d20-da80-4401-b027-3c4b0df169c6", "address": "fa:16:3e:ad:63:c3", "network": {"id": "92949b0a-01f9-413c-9f96-a25b9b648f84", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-167588816-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d2915087eb04830831062675024f835", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c5d5d20-da", "ovs_interfaceid": "3c5d5d20-da80-4401-b027-3c4b0df169c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:16:47 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-928d03d5-13c3-46d7-aa42-111721574403 tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:63:c3,bridge_name='br-int',has_traffic_filtering=True,id=3c5d5d20-da80-4401-b027-3c4b0df169c6,network=Network(92949b0a-01f9-413c-9f96-a25b9b648f84),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c5d5d20-da') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:16:47 user nova-compute[73572]: DEBUG os_vif [None req-928d03d5-13c3-46d7-aa42-111721574403 tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:63:c3,bridge_name='br-int',has_traffic_filtering=True,id=3c5d5d20-da80-4401-b027-3c4b0df169c6,network=Network(92949b0a-01f9-413c-9f96-a25b9b648f84),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c5d5d20-da') {{(pid=73572) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 10:16:47 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:16:47 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:16:47 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 10:16:47 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:16:47 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3c5d5d20-da, may_exist=True, interface_attrs={}) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:16:47 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3c5d5d20-da, col_values=(('external_ids', {'iface-id': '3c5d5d20-da80-4401-b027-3c4b0df169c6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ad:63:c3', 'vm-uuid': '0dceaa35-4a13-453b-961f-831f66c35af0'}),), if_exists=True) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:16:47 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:16:47 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:16:47 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:16:47 user nova-compute[73572]: INFO os_vif [None req-928d03d5-13c3-46d7-aa42-111721574403 tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:63:c3,bridge_name='br-int',has_traffic_filtering=True,id=3c5d5d20-da80-4401-b027-3c4b0df169c6,network=Network(92949b0a-01f9-413c-9f96-a25b9b648f84),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c5d5d20-da')
Aug 26 10:16:47 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-928d03d5-13c3-46d7-aa42-111721574403 tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] No BDM found with device name vda, not building metadata. {{(pid=73572) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 10:16:47 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-928d03d5-13c3-46d7-aa42-111721574403 tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] No BDM found with device name hda, not building metadata. {{(pid=73572) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 10:16:47 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-928d03d5-13c3-46d7-aa42-111721574403 tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] No VIF found with MAC fa:16:3e:ad:63:c3, not building metadata {{(pid=73572) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 10:16:47 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-928d03d5-13c3-46d7-aa42-111721574403 tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] [instance: 0dceaa35-4a13-453b-961f-831f66c35af0] Using config drive
Aug 26 10:16:47 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-928d03d5-13c3-46d7-aa42-111721574403 tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] [instance: 0dceaa35-4a13-453b-961f-831f66c35af0] Creating config drive at /opt/stack/data/nova/instances/0dceaa35-4a13-453b-961f-831f66c35af0/disk.config
Aug 26 10:16:47 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-928d03d5-13c3-46d7-aa42-111721574403 tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/0dceaa35-4a13-453b-961f-831f66c35af0/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpgr6yw19b {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:16:47 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-928d03d5-13c3-46d7-aa42-111721574403 tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/0dceaa35-4a13-453b-961f-831f66c35af0/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpgr6yw19b" returned: 0 in 0.062s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:16:48 user nova-compute[73572]: DEBUG nova.network.neutron [req-dbbdaa27-a4f8-415a-b195-a75e09dab656 req-7dc10905-3f10-4553-9bdd-9a9b17f1982c service nova] [instance: 0dceaa35-4a13-453b-961f-831f66c35af0] Updated VIF entry in instance network info cache for port 3c5d5d20-da80-4401-b027-3c4b0df169c6. {{(pid=73572) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 10:16:48 user nova-compute[73572]: DEBUG nova.network.neutron [req-dbbdaa27-a4f8-415a-b195-a75e09dab656 req-7dc10905-3f10-4553-9bdd-9a9b17f1982c service nova] [instance: 0dceaa35-4a13-453b-961f-831f66c35af0] Updating instance_info_cache with network_info: [{"id": "3c5d5d20-da80-4401-b027-3c4b0df169c6", "address": "fa:16:3e:ad:63:c3", "network": {"id": "92949b0a-01f9-413c-9f96-a25b9b648f84", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-167588816-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d2915087eb04830831062675024f835", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c5d5d20-da", "ovs_interfaceid": "3c5d5d20-da80-4401-b027-3c4b0df169c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:16:48 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-dbbdaa27-a4f8-415a-b195-a75e09dab656 req-7dc10905-3f10-4553-9bdd-9a9b17f1982c service nova] Releasing lock "refresh_cache-0dceaa35-4a13-453b-961f-831f66c35af0" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:16:49 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:16:49 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:16:49 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:16:49 user nova-compute[73572]: DEBUG nova.compute.manager [req-94974033-2bd8-4795-aeb1-52aaa3b8110c req-28bf9c5f-f4ef-406b-aa4e-56ff8d7b4305 service nova] [instance: 0dceaa35-4a13-453b-961f-831f66c35af0] Received event network-vif-plugged-3c5d5d20-da80-4401-b027-3c4b0df169c6 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:16:49 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-94974033-2bd8-4795-aeb1-52aaa3b8110c req-28bf9c5f-f4ef-406b-aa4e-56ff8d7b4305 service nova] Acquiring lock "0dceaa35-4a13-453b-961f-831f66c35af0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:16:49 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-94974033-2bd8-4795-aeb1-52aaa3b8110c req-28bf9c5f-f4ef-406b-aa4e-56ff8d7b4305 service nova] Lock "0dceaa35-4a13-453b-961f-831f66c35af0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:16:49 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-94974033-2bd8-4795-aeb1-52aaa3b8110c req-28bf9c5f-f4ef-406b-aa4e-56ff8d7b4305 service nova] Lock "0dceaa35-4a13-453b-961f-831f66c35af0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:16:49 user nova-compute[73572]: DEBUG nova.compute.manager [req-94974033-2bd8-4795-aeb1-52aaa3b8110c req-28bf9c5f-f4ef-406b-aa4e-56ff8d7b4305 service nova] [instance: 0dceaa35-4a13-453b-961f-831f66c35af0] No waiting events found dispatching network-vif-plugged-3c5d5d20-da80-4401-b027-3c4b0df169c6 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:16:49 user nova-compute[73572]: WARNING nova.compute.manager [req-94974033-2bd8-4795-aeb1-52aaa3b8110c req-28bf9c5f-f4ef-406b-aa4e-56ff8d7b4305 service nova] [instance: 0dceaa35-4a13-453b-961f-831f66c35af0] Received unexpected event network-vif-plugged-3c5d5d20-da80-4401-b027-3c4b0df169c6 for instance with vm_state building and task_state spawning.
Aug 26 10:16:50 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:16:50 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:16:50 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:16:51 user nova-compute[73572]: DEBUG nova.virt.driver [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Emitting event <LifecycleEvent: 1693045011.5956433, 0dceaa35-4a13-453b-961f-831f66c35af0 => Resumed> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:16:51 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 0dceaa35-4a13-453b-961f-831f66c35af0] VM Resumed (Lifecycle Event)
Aug 26 10:16:51 user nova-compute[73572]: DEBUG nova.compute.manager [None req-928d03d5-13c3-46d7-aa42-111721574403 tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] [instance: 0dceaa35-4a13-453b-961f-831f66c35af0] Instance event wait completed in 0 seconds for  {{(pid=73572) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 10:16:51 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-928d03d5-13c3-46d7-aa42-111721574403 tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] [instance: 0dceaa35-4a13-453b-961f-831f66c35af0] Guest created on hypervisor {{(pid=73572) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 10:16:51 user nova-compute[73572]: INFO nova.virt.libvirt.driver [-] [instance: 0dceaa35-4a13-453b-961f-831f66c35af0] Instance spawned successfully.
Aug 26 10:16:51 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-928d03d5-13c3-46d7-aa42-111721574403 tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] [instance: 0dceaa35-4a13-453b-961f-831f66c35af0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 10:16:51 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 0dceaa35-4a13-453b-961f-831f66c35af0] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:16:51 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-928d03d5-13c3-46d7-aa42-111721574403 tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] [instance: 0dceaa35-4a13-453b-961f-831f66c35af0] Found default for hw_cdrom_bus of ide {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:16:51 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-928d03d5-13c3-46d7-aa42-111721574403 tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] [instance: 0dceaa35-4a13-453b-961f-831f66c35af0] Found default for hw_disk_bus of virtio {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:16:51 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-928d03d5-13c3-46d7-aa42-111721574403 tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] [instance: 0dceaa35-4a13-453b-961f-831f66c35af0] Found default for hw_input_bus of None {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:16:51 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-928d03d5-13c3-46d7-aa42-111721574403 tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] [instance: 0dceaa35-4a13-453b-961f-831f66c35af0] Found default for hw_pointer_model of None {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:16:51 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-928d03d5-13c3-46d7-aa42-111721574403 tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] [instance: 0dceaa35-4a13-453b-961f-831f66c35af0] Found default for hw_video_model of virtio {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:16:51 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-928d03d5-13c3-46d7-aa42-111721574403 tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] [instance: 0dceaa35-4a13-453b-961f-831f66c35af0] Found default for hw_vif_model of virtio {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:16:51 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 0dceaa35-4a13-453b-961f-831f66c35af0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73572) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 10:16:51 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 0dceaa35-4a13-453b-961f-831f66c35af0] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 10:16:51 user nova-compute[73572]: DEBUG nova.virt.driver [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Emitting event <LifecycleEvent: 1693045011.602212, 0dceaa35-4a13-453b-961f-831f66c35af0 => Started> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:16:51 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 0dceaa35-4a13-453b-961f-831f66c35af0] VM Started (Lifecycle Event)
Aug 26 10:16:51 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 0dceaa35-4a13-453b-961f-831f66c35af0] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:16:51 user nova-compute[73572]: DEBUG nova.compute.manager [req-13af625c-38a3-4ef8-bb57-e4269f698539 req-7bcd6399-4502-4d96-88d4-f84025b45ac4 service nova] [instance: 0dceaa35-4a13-453b-961f-831f66c35af0] Received event network-vif-plugged-3c5d5d20-da80-4401-b027-3c4b0df169c6 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:16:51 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-13af625c-38a3-4ef8-bb57-e4269f698539 req-7bcd6399-4502-4d96-88d4-f84025b45ac4 service nova] Acquiring lock "0dceaa35-4a13-453b-961f-831f66c35af0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:16:51 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-13af625c-38a3-4ef8-bb57-e4269f698539 req-7bcd6399-4502-4d96-88d4-f84025b45ac4 service nova] Lock "0dceaa35-4a13-453b-961f-831f66c35af0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:16:51 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-13af625c-38a3-4ef8-bb57-e4269f698539 req-7bcd6399-4502-4d96-88d4-f84025b45ac4 service nova] Lock "0dceaa35-4a13-453b-961f-831f66c35af0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:16:51 user nova-compute[73572]: DEBUG nova.compute.manager [req-13af625c-38a3-4ef8-bb57-e4269f698539 req-7bcd6399-4502-4d96-88d4-f84025b45ac4 service nova] [instance: 0dceaa35-4a13-453b-961f-831f66c35af0] No waiting events found dispatching network-vif-plugged-3c5d5d20-da80-4401-b027-3c4b0df169c6 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:16:51 user nova-compute[73572]: WARNING nova.compute.manager [req-13af625c-38a3-4ef8-bb57-e4269f698539 req-7bcd6399-4502-4d96-88d4-f84025b45ac4 service nova] [instance: 0dceaa35-4a13-453b-961f-831f66c35af0] Received unexpected event network-vif-plugged-3c5d5d20-da80-4401-b027-3c4b0df169c6 for instance with vm_state building and task_state spawning.
Aug 26 10:16:51 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 0dceaa35-4a13-453b-961f-831f66c35af0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73572) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 10:16:51 user nova-compute[73572]: INFO nova.compute.manager [None req-928d03d5-13c3-46d7-aa42-111721574403 tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] [instance: 0dceaa35-4a13-453b-961f-831f66c35af0] Took 6.98 seconds to spawn the instance on the hypervisor.
Aug 26 10:16:51 user nova-compute[73572]: DEBUG nova.compute.manager [None req-928d03d5-13c3-46d7-aa42-111721574403 tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] [instance: 0dceaa35-4a13-453b-961f-831f66c35af0] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:16:51 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 0dceaa35-4a13-453b-961f-831f66c35af0] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 10:16:51 user nova-compute[73572]: INFO nova.compute.manager [None req-928d03d5-13c3-46d7-aa42-111721574403 tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] [instance: 0dceaa35-4a13-453b-961f-831f66c35af0] Took 7.93 seconds to build instance.
Aug 26 10:16:51 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-928d03d5-13c3-46d7-aa42-111721574403 tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] Lock "0dceaa35-4a13-453b-961f-831f66c35af0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.234s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:16:52 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:16:54 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:16:54 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:16:54 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-4bbf945f-dc45-4935-b58c-a04505bd254a tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] Acquiring lock "32a28361-567b-4bd4-9f4f-d9cfac2c9388" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:16:54 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-4bbf945f-dc45-4935-b58c-a04505bd254a tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] Lock "32a28361-567b-4bd4-9f4f-d9cfac2c9388" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:16:54 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-4bbf945f-dc45-4935-b58c-a04505bd254a tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] Acquiring lock "32a28361-567b-4bd4-9f4f-d9cfac2c9388-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:16:54 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-4bbf945f-dc45-4935-b58c-a04505bd254a tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] Lock "32a28361-567b-4bd4-9f4f-d9cfac2c9388-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:16:54 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-4bbf945f-dc45-4935-b58c-a04505bd254a tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] Lock "32a28361-567b-4bd4-9f4f-d9cfac2c9388-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:16:54 user nova-compute[73572]: INFO nova.compute.manager [None req-4bbf945f-dc45-4935-b58c-a04505bd254a tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] [instance: 32a28361-567b-4bd4-9f4f-d9cfac2c9388] Terminating instance
Aug 26 10:16:54 user nova-compute[73572]: DEBUG nova.compute.manager [None req-4bbf945f-dc45-4935-b58c-a04505bd254a tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] [instance: 32a28361-567b-4bd4-9f4f-d9cfac2c9388] Start destroying the instance on the hypervisor. {{(pid=73572) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 10:16:54 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:16:54 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:16:54 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:16:54 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:16:55 user nova-compute[73572]: INFO nova.virt.libvirt.driver [-] [instance: 32a28361-567b-4bd4-9f4f-d9cfac2c9388] Instance destroyed successfully.
Aug 26 10:16:55 user nova-compute[73572]: DEBUG nova.objects.instance [None req-4bbf945f-dc45-4935-b58c-a04505bd254a tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] Lazy-loading 'resources' on Instance uuid 32a28361-567b-4bd4-9f4f-d9cfac2c9388 {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:16:55 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-4bbf945f-dc45-4935-b58c-a04505bd254a tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T10:14:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-135214525',display_name='tempest-VolumesAdminNegativeTest-server-135214525',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-135214525',id=13,image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T10:14:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a9898b65714845e7aea403cc39182df7',ramdisk_id='',reservation_id='r-mf7osq3t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-119088495',owner_user_name='tempest-VolumesAdminNegativeTest-119088495-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T10:14:59Z,user_data=None,user_id='fe58afb632fe4189a29df22dc61fb0ae',uuid=32a28361-567b-4bd4-9f4f-d9cfac2c9388,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "47632d74-7b97-49f3-946c-0568247c7f7b", "address": "fa:16:3e:a5:f4:74", "network": {"id": "529bb981-16ba-47c5-afb0-55f4aa577ecc", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-265382654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9898b65714845e7aea403cc39182df7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47632d74-7b", "ovs_interfaceid": "47632d74-7b97-49f3-946c-0568247c7f7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 10:16:55 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-4bbf945f-dc45-4935-b58c-a04505bd254a tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] Converting VIF {"id": "47632d74-7b97-49f3-946c-0568247c7f7b", "address": "fa:16:3e:a5:f4:74", "network": {"id": "529bb981-16ba-47c5-afb0-55f4aa577ecc", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-265382654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9898b65714845e7aea403cc39182df7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47632d74-7b", "ovs_interfaceid": "47632d74-7b97-49f3-946c-0568247c7f7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:16:55 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-4bbf945f-dc45-4935-b58c-a04505bd254a tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a5:f4:74,bridge_name='br-int',has_traffic_filtering=True,id=47632d74-7b97-49f3-946c-0568247c7f7b,network=Network(529bb981-16ba-47c5-afb0-55f4aa577ecc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47632d74-7b') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:16:55 user nova-compute[73572]: DEBUG os_vif [None req-4bbf945f-dc45-4935-b58c-a04505bd254a tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:f4:74,bridge_name='br-int',has_traffic_filtering=True,id=47632d74-7b97-49f3-946c-0568247c7f7b,network=Network(529bb981-16ba-47c5-afb0-55f4aa577ecc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47632d74-7b') {{(pid=73572) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 10:16:55 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:16:55 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap47632d74-7b, bridge=br-int, if_exists=True) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:16:55 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:16:55 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:16:55 user nova-compute[73572]: INFO os_vif [None req-4bbf945f-dc45-4935-b58c-a04505bd254a tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:f4:74,bridge_name='br-int',has_traffic_filtering=True,id=47632d74-7b97-49f3-946c-0568247c7f7b,network=Network(529bb981-16ba-47c5-afb0-55f4aa577ecc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47632d74-7b')
Aug 26 10:16:55 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-4bbf945f-dc45-4935-b58c-a04505bd254a tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] [instance: 32a28361-567b-4bd4-9f4f-d9cfac2c9388] Deleting instance files /opt/stack/data/nova/instances/32a28361-567b-4bd4-9f4f-d9cfac2c9388_del
Aug 26 10:16:55 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-4bbf945f-dc45-4935-b58c-a04505bd254a tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] [instance: 32a28361-567b-4bd4-9f4f-d9cfac2c9388] Deletion of /opt/stack/data/nova/instances/32a28361-567b-4bd4-9f4f-d9cfac2c9388_del complete
Aug 26 10:16:55 user nova-compute[73572]: INFO nova.compute.manager [None req-4bbf945f-dc45-4935-b58c-a04505bd254a tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] [instance: 32a28361-567b-4bd4-9f4f-d9cfac2c9388] Took 1.04 seconds to destroy the instance on the hypervisor.
Aug 26 10:16:55 user nova-compute[73572]: DEBUG oslo.service.loopingcall [None req-4bbf945f-dc45-4935-b58c-a04505bd254a tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73572) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 10:16:55 user nova-compute[73572]: DEBUG nova.compute.manager [-] [instance: 32a28361-567b-4bd4-9f4f-d9cfac2c9388] Deallocating network for instance {{(pid=73572) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 10:16:55 user nova-compute[73572]: DEBUG nova.network.neutron [-] [instance: 32a28361-567b-4bd4-9f4f-d9cfac2c9388] deallocate_for_instance() {{(pid=73572) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 10:16:55 user nova-compute[73572]: DEBUG nova.compute.manager [req-d054befc-9682-4ef8-a5bf-7cea944d8c0f req-05827ce9-515c-4dca-b4c5-2212fb8bd1d1 service nova] [instance: 32a28361-567b-4bd4-9f4f-d9cfac2c9388] Received event network-vif-unplugged-47632d74-7b97-49f3-946c-0568247c7f7b {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:16:55 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-d054befc-9682-4ef8-a5bf-7cea944d8c0f req-05827ce9-515c-4dca-b4c5-2212fb8bd1d1 service nova] Acquiring lock "32a28361-567b-4bd4-9f4f-d9cfac2c9388-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:16:55 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-d054befc-9682-4ef8-a5bf-7cea944d8c0f req-05827ce9-515c-4dca-b4c5-2212fb8bd1d1 service nova] Lock "32a28361-567b-4bd4-9f4f-d9cfac2c9388-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:16:55 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-d054befc-9682-4ef8-a5bf-7cea944d8c0f req-05827ce9-515c-4dca-b4c5-2212fb8bd1d1 service nova] Lock "32a28361-567b-4bd4-9f4f-d9cfac2c9388-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:16:55 user nova-compute[73572]: DEBUG nova.compute.manager [req-d054befc-9682-4ef8-a5bf-7cea944d8c0f req-05827ce9-515c-4dca-b4c5-2212fb8bd1d1 service nova] [instance: 32a28361-567b-4bd4-9f4f-d9cfac2c9388] No waiting events found dispatching network-vif-unplugged-47632d74-7b97-49f3-946c-0568247c7f7b {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:16:55 user nova-compute[73572]: DEBUG nova.compute.manager [req-d054befc-9682-4ef8-a5bf-7cea944d8c0f req-05827ce9-515c-4dca-b4c5-2212fb8bd1d1 service nova] [instance: 32a28361-567b-4bd4-9f4f-d9cfac2c9388] Received event network-vif-unplugged-47632d74-7b97-49f3-946c-0568247c7f7b for instance with task_state deleting. {{(pid=73572) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 10:16:56 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:16:56 user nova-compute[73572]: DEBUG nova.network.neutron [-] [instance: 32a28361-567b-4bd4-9f4f-d9cfac2c9388] Updating instance_info_cache with network_info: [] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:16:56 user nova-compute[73572]: INFO nova.compute.manager [-] [instance: 32a28361-567b-4bd4-9f4f-d9cfac2c9388] Took 1.25 seconds to deallocate network for instance.
Aug 26 10:16:56 user nova-compute[73572]: DEBUG nova.compute.manager [req-29dd4937-411d-4d43-a3c5-cd258938b5a4 req-60da4fab-53ab-4bef-a7d4-36a00c17624c service nova] [instance: 32a28361-567b-4bd4-9f4f-d9cfac2c9388] Received event network-vif-deleted-47632d74-7b97-49f3-946c-0568247c7f7b {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:16:56 user nova-compute[73572]: INFO nova.compute.manager [req-29dd4937-411d-4d43-a3c5-cd258938b5a4 req-60da4fab-53ab-4bef-a7d4-36a00c17624c service nova] [instance: 32a28361-567b-4bd4-9f4f-d9cfac2c9388] Neutron deleted interface 47632d74-7b97-49f3-946c-0568247c7f7b; detaching it from the instance and deleting it from the info cache
Aug 26 10:16:56 user nova-compute[73572]: DEBUG nova.network.neutron [req-29dd4937-411d-4d43-a3c5-cd258938b5a4 req-60da4fab-53ab-4bef-a7d4-36a00c17624c service nova] [instance: 32a28361-567b-4bd4-9f4f-d9cfac2c9388] Updating instance_info_cache with network_info: [] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:16:56 user nova-compute[73572]: DEBUG nova.compute.manager [req-29dd4937-411d-4d43-a3c5-cd258938b5a4 req-60da4fab-53ab-4bef-a7d4-36a00c17624c service nova] [instance: 32a28361-567b-4bd4-9f4f-d9cfac2c9388] Detach interface failed, port_id=47632d74-7b97-49f3-946c-0568247c7f7b, reason: Instance 32a28361-567b-4bd4-9f4f-d9cfac2c9388 could not be found. {{(pid=73572) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 10:16:56 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-4bbf945f-dc45-4935-b58c-a04505bd254a tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:16:56 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-4bbf945f-dc45-4935-b58c-a04505bd254a tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:16:57 user nova-compute[73572]: DEBUG nova.compute.provider_tree [None req-4bbf945f-dc45-4935-b58c-a04505bd254a tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] Inventory has not changed in ProviderTree for provider: e2cec974-59b2-4c77-a53d-a7f4e5a30d75 {{(pid=73572) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 10:16:57 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-4bbf945f-dc45-4935-b58c-a04505bd254a tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] Inventory has not changed for provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73572) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 10:16:57 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-4bbf945f-dc45-4935-b58c-a04505bd254a tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.492s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:16:57 user nova-compute[73572]: INFO nova.scheduler.client.report [None req-4bbf945f-dc45-4935-b58c-a04505bd254a tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] Deleted allocations for instance 32a28361-567b-4bd4-9f4f-d9cfac2c9388
Aug 26 10:16:57 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-4bbf945f-dc45-4935-b58c-a04505bd254a tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] Lock "32a28361-567b-4bd4-9f4f-d9cfac2c9388" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.025s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:16:57 user nova-compute[73572]: DEBUG nova.compute.manager [req-685be57b-4fb5-48fb-b0bf-1ed0dbb11068 req-cca5d9f9-ad73-4a9a-9e0e-c0651a08743e service nova] [instance: 32a28361-567b-4bd4-9f4f-d9cfac2c9388] Received event network-vif-plugged-47632d74-7b97-49f3-946c-0568247c7f7b {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:16:57 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-685be57b-4fb5-48fb-b0bf-1ed0dbb11068 req-cca5d9f9-ad73-4a9a-9e0e-c0651a08743e service nova] Acquiring lock "32a28361-567b-4bd4-9f4f-d9cfac2c9388-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:16:57 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-685be57b-4fb5-48fb-b0bf-1ed0dbb11068 req-cca5d9f9-ad73-4a9a-9e0e-c0651a08743e service nova] Lock "32a28361-567b-4bd4-9f4f-d9cfac2c9388-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:16:57 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-685be57b-4fb5-48fb-b0bf-1ed0dbb11068 req-cca5d9f9-ad73-4a9a-9e0e-c0651a08743e service nova] Lock "32a28361-567b-4bd4-9f4f-d9cfac2c9388-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:16:57 user nova-compute[73572]: DEBUG nova.compute.manager [req-685be57b-4fb5-48fb-b0bf-1ed0dbb11068 req-cca5d9f9-ad73-4a9a-9e0e-c0651a08743e service nova] [instance: 32a28361-567b-4bd4-9f4f-d9cfac2c9388] No waiting events found dispatching network-vif-plugged-47632d74-7b97-49f3-946c-0568247c7f7b {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:16:57 user nova-compute[73572]: WARNING nova.compute.manager [req-685be57b-4fb5-48fb-b0bf-1ed0dbb11068 req-cca5d9f9-ad73-4a9a-9e0e-c0651a08743e service nova] [instance: 32a28361-567b-4bd4-9f4f-d9cfac2c9388] Received unexpected event network-vif-plugged-47632d74-7b97-49f3-946c-0568247c7f7b for instance with vm_state deleted and task_state None.
Aug 26 10:16:57 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:16:59 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:17:00 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:17:01 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:17:02 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:17:02 user nova-compute[73572]: INFO nova.compute.manager [None req-64cf350e-c50e-47d2-9a6a-5b0e9f11ca11 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: 14fab12e-52be-4fe6-8777-bc7ebf3c25f1] Rescuing
Aug 26 10:17:02 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-64cf350e-c50e-47d2-9a6a-5b0e9f11ca11 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Acquiring lock "refresh_cache-14fab12e-52be-4fe6-8777-bc7ebf3c25f1" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:17:02 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-64cf350e-c50e-47d2-9a6a-5b0e9f11ca11 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Acquired lock "refresh_cache-14fab12e-52be-4fe6-8777-bc7ebf3c25f1" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:17:02 user nova-compute[73572]: DEBUG nova.network.neutron [None req-64cf350e-c50e-47d2-9a6a-5b0e9f11ca11 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: 14fab12e-52be-4fe6-8777-bc7ebf3c25f1] Building network info cache for instance {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 10:17:04 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:17:04 user nova-compute[73572]: DEBUG nova.compute.manager [req-6c03e450-a407-49d8-b68e-063400f7d7e8 req-76d52f51-39c7-46d3-a8ec-8352bebd7005 service nova] [instance: 00c47a06-2bf8-427d-bcb1-304688584511] Received event network-changed-d18bfeb9-ad63-41d9-8d66-56df3d3306d8 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:17:04 user nova-compute[73572]: DEBUG nova.compute.manager [req-6c03e450-a407-49d8-b68e-063400f7d7e8 req-76d52f51-39c7-46d3-a8ec-8352bebd7005 service nova] [instance: 00c47a06-2bf8-427d-bcb1-304688584511] Refreshing instance network info cache due to event network-changed-d18bfeb9-ad63-41d9-8d66-56df3d3306d8. {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 10:17:04 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-6c03e450-a407-49d8-b68e-063400f7d7e8 req-76d52f51-39c7-46d3-a8ec-8352bebd7005 service nova] Acquiring lock "refresh_cache-00c47a06-2bf8-427d-bcb1-304688584511" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:17:04 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-6c03e450-a407-49d8-b68e-063400f7d7e8 req-76d52f51-39c7-46d3-a8ec-8352bebd7005 service nova] Acquired lock "refresh_cache-00c47a06-2bf8-427d-bcb1-304688584511" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:17:04 user nova-compute[73572]: DEBUG nova.network.neutron [req-6c03e450-a407-49d8-b68e-063400f7d7e8 req-76d52f51-39c7-46d3-a8ec-8352bebd7005 service nova] [instance: 00c47a06-2bf8-427d-bcb1-304688584511] Refreshing network info cache for port d18bfeb9-ad63-41d9-8d66-56df3d3306d8 {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 10:17:04 user nova-compute[73572]: DEBUG nova.network.neutron [None req-64cf350e-c50e-47d2-9a6a-5b0e9f11ca11 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: 14fab12e-52be-4fe6-8777-bc7ebf3c25f1] Updating instance_info_cache with network_info: [{"id": "1b2121f4-88b1-4815-9329-3c9e3172a2f6", "address": "fa:16:3e:b0:35:f5", "network": {"id": "991b9dff-5173-4456-a530-b1f7eb5cfa4a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1845930297-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4636f93c5bfc4653804de097aed2882c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b2121f4-88", "ovs_interfaceid": "1b2121f4-88b1-4815-9329-3c9e3172a2f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:17:04 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-64cf350e-c50e-47d2-9a6a-5b0e9f11ca11 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Releasing lock "refresh_cache-14fab12e-52be-4fe6-8777-bc7ebf3c25f1" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:17:04 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:17:04 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:17:04 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:17:04 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73572) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 26 10:17:04 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:17:05 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:17:05 user nova-compute[73572]: DEBUG nova.compute.manager [req-656409ac-cc9d-40a4-903d-4f94881cc73a req-f33ebffc-1d9e-498a-bd56-e6db96f4276e service nova] [instance: 14fab12e-52be-4fe6-8777-bc7ebf3c25f1] Received event network-vif-unplugged-1b2121f4-88b1-4815-9329-3c9e3172a2f6 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:17:05 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-656409ac-cc9d-40a4-903d-4f94881cc73a req-f33ebffc-1d9e-498a-bd56-e6db96f4276e service nova] Acquiring lock "14fab12e-52be-4fe6-8777-bc7ebf3c25f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:17:05 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-656409ac-cc9d-40a4-903d-4f94881cc73a req-f33ebffc-1d9e-498a-bd56-e6db96f4276e service nova] Lock "14fab12e-52be-4fe6-8777-bc7ebf3c25f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:17:05 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-656409ac-cc9d-40a4-903d-4f94881cc73a req-f33ebffc-1d9e-498a-bd56-e6db96f4276e service nova] Lock "14fab12e-52be-4fe6-8777-bc7ebf3c25f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:17:05 user nova-compute[73572]: DEBUG nova.compute.manager [req-656409ac-cc9d-40a4-903d-4f94881cc73a req-f33ebffc-1d9e-498a-bd56-e6db96f4276e service nova] [instance: 14fab12e-52be-4fe6-8777-bc7ebf3c25f1] No waiting events found dispatching network-vif-unplugged-1b2121f4-88b1-4815-9329-3c9e3172a2f6 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:17:05 user nova-compute[73572]: WARNING nova.compute.manager [req-656409ac-cc9d-40a4-903d-4f94881cc73a req-f33ebffc-1d9e-498a-bd56-e6db96f4276e service nova] [instance: 14fab12e-52be-4fe6-8777-bc7ebf3c25f1] Received unexpected event network-vif-unplugged-1b2121f4-88b1-4815-9329-3c9e3172a2f6 for instance with vm_state active and task_state rescuing.
Aug 26 10:17:05 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:17:05 user nova-compute[73572]: INFO nova.virt.libvirt.driver [-] [instance: 14fab12e-52be-4fe6-8777-bc7ebf3c25f1] Instance destroyed successfully.
Aug 26 10:17:05 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-64cf350e-c50e-47d2-9a6a-5b0e9f11ca11 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: 14fab12e-52be-4fe6-8777-bc7ebf3c25f1] Attempting a stable device rescue
Aug 26 10:17:05 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-64cf350e-c50e-47d2-9a6a-5b0e9f11ca11 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=73572) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 26 10:17:05 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-64cf350e-c50e-47d2-9a6a-5b0e9f11ca11 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: 14fab12e-52be-4fe6-8777-bc7ebf3c25f1] Instance directory exists: not creating {{(pid=73572) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 26 10:17:05 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-64cf350e-c50e-47d2-9a6a-5b0e9f11ca11 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: 14fab12e-52be-4fe6-8777-bc7ebf3c25f1] Creating image(s)
Aug 26 10:17:05 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-64cf350e-c50e-47d2-9a6a-5b0e9f11ca11 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Acquiring lock "/opt/stack/data/nova/instances/14fab12e-52be-4fe6-8777-bc7ebf3c25f1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:17:05 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-64cf350e-c50e-47d2-9a6a-5b0e9f11ca11 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Lock "/opt/stack/data/nova/instances/14fab12e-52be-4fe6-8777-bc7ebf3c25f1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:17:05 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-64cf350e-c50e-47d2-9a6a-5b0e9f11ca11 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Lock "/opt/stack/data/nova/instances/14fab12e-52be-4fe6-8777-bc7ebf3c25f1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:17:05 user nova-compute[73572]: DEBUG nova.objects.instance [None req-64cf350e-c50e-47d2-9a6a-5b0e9f11ca11 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Lazy-loading 'trusted_certs' on Instance uuid 14fab12e-52be-4fe6-8777-bc7ebf3c25f1 {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:17:05 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-64cf350e-c50e-47d2-9a6a-5b0e9f11ca11 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Acquiring lock "681e5c5fd0998c6bda4aea7aa659ea4dda7e3951" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:17:05 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-64cf350e-c50e-47d2-9a6a-5b0e9f11ca11 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Lock "681e5c5fd0998c6bda4aea7aa659ea4dda7e3951" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:17:05 user nova-compute[73572]: DEBUG nova.network.neutron [req-6c03e450-a407-49d8-b68e-063400f7d7e8 req-76d52f51-39c7-46d3-a8ec-8352bebd7005 service nova] [instance: 00c47a06-2bf8-427d-bcb1-304688584511] Updated VIF entry in instance network info cache for port d18bfeb9-ad63-41d9-8d66-56df3d3306d8. {{(pid=73572) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 10:17:05 user nova-compute[73572]: DEBUG nova.network.neutron [req-6c03e450-a407-49d8-b68e-063400f7d7e8 req-76d52f51-39c7-46d3-a8ec-8352bebd7005 service nova] [instance: 00c47a06-2bf8-427d-bcb1-304688584511] Updating instance_info_cache with network_info: [{"id": "d18bfeb9-ad63-41d9-8d66-56df3d3306d8", "address": "fa:16:3e:a2:f2:f4", "network": {"id": "81543fb3-a8fe-4e9c-8180-c65fa4dcc9e1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-469390371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "084df935eab842e58bad79afad7090f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd18bfeb9-ad", "ovs_interfaceid": "d18bfeb9-ad63-41d9-8d66-56df3d3306d8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:17:05 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-6c03e450-a407-49d8-b68e-063400f7d7e8 req-76d52f51-39c7-46d3-a8ec-8352bebd7005 service nova] Releasing lock "refresh_cache-00c47a06-2bf8-427d-bcb1-304688584511" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:17:06 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-64cf350e-c50e-47d2-9a6a-5b0e9f11ca11 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/681e5c5fd0998c6bda4aea7aa659ea4dda7e3951.part --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:17:06 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:17:06 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:17:06 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Starting heal instance info cache {{(pid=73572) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 10:17:06 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Didn't find any instances for network info cache update. {{(pid=73572) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 26 10:17:06 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-64cf350e-c50e-47d2-9a6a-5b0e9f11ca11 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/681e5c5fd0998c6bda4aea7aa659ea4dda7e3951.part --force-share --output=json" returned: 0 in 0.596s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:17:06 user nova-compute[73572]: DEBUG nova.virt.images [None req-64cf350e-c50e-47d2-9a6a-5b0e9f11ca11 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] ac85e303-fd69-4047-ae6b-4afa2c0d12cb was qcow2, converting to raw {{(pid=73572) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 26 10:17:06 user nova-compute[73572]: DEBUG nova.privsep.utils [None req-64cf350e-c50e-47d2-9a6a-5b0e9f11ca11 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73572) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 26 10:17:06 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-64cf350e-c50e-47d2-9a6a-5b0e9f11ca11 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/681e5c5fd0998c6bda4aea7aa659ea4dda7e3951.part /opt/stack/data/nova/instances/_base/681e5c5fd0998c6bda4aea7aa659ea4dda7e3951.converted {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:17:07 user nova-compute[73572]: DEBUG nova.compute.manager [req-7ee5bcce-8c83-4912-a951-2e164fe29c0b req-a9eb9e2e-1a63-46d3-9469-0bd6f8d65321 service nova] [instance: 14fab12e-52be-4fe6-8777-bc7ebf3c25f1] Received event network-vif-plugged-1b2121f4-88b1-4815-9329-3c9e3172a2f6 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:17:07 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-7ee5bcce-8c83-4912-a951-2e164fe29c0b req-a9eb9e2e-1a63-46d3-9469-0bd6f8d65321 service nova] Acquiring lock "14fab12e-52be-4fe6-8777-bc7ebf3c25f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:17:07 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-7ee5bcce-8c83-4912-a951-2e164fe29c0b req-a9eb9e2e-1a63-46d3-9469-0bd6f8d65321 service nova] Lock "14fab12e-52be-4fe6-8777-bc7ebf3c25f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:17:07 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-7ee5bcce-8c83-4912-a951-2e164fe29c0b req-a9eb9e2e-1a63-46d3-9469-0bd6f8d65321 service nova] Lock "14fab12e-52be-4fe6-8777-bc7ebf3c25f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:17:07 user nova-compute[73572]: DEBUG nova.compute.manager [req-7ee5bcce-8c83-4912-a951-2e164fe29c0b req-a9eb9e2e-1a63-46d3-9469-0bd6f8d65321 service nova] [instance: 14fab12e-52be-4fe6-8777-bc7ebf3c25f1] No waiting events found dispatching network-vif-plugged-1b2121f4-88b1-4815-9329-3c9e3172a2f6 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:17:07 user nova-compute[73572]: WARNING nova.compute.manager [req-7ee5bcce-8c83-4912-a951-2e164fe29c0b req-a9eb9e2e-1a63-46d3-9469-0bd6f8d65321 service nova] [instance: 14fab12e-52be-4fe6-8777-bc7ebf3c25f1] Received unexpected event network-vif-plugged-1b2121f4-88b1-4815-9329-3c9e3172a2f6 for instance with vm_state active and task_state rescuing.
Aug 26 10:17:07 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-64cf350e-c50e-47d2-9a6a-5b0e9f11ca11 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/681e5c5fd0998c6bda4aea7aa659ea4dda7e3951.part /opt/stack/data/nova/instances/_base/681e5c5fd0998c6bda4aea7aa659ea4dda7e3951.converted" returned: 0 in 0.339s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:17:07 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-64cf350e-c50e-47d2-9a6a-5b0e9f11ca11 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/681e5c5fd0998c6bda4aea7aa659ea4dda7e3951.converted --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:17:07 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-64cf350e-c50e-47d2-9a6a-5b0e9f11ca11 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/681e5c5fd0998c6bda4aea7aa659ea4dda7e3951.converted --force-share --output=json" returned: 0 in 0.205s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:17:07 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-64cf350e-c50e-47d2-9a6a-5b0e9f11ca11 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Lock "681e5c5fd0998c6bda4aea7aa659ea4dda7e3951" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.007s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:17:07 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-64cf350e-c50e-47d2-9a6a-5b0e9f11ca11 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Acquiring lock "681e5c5fd0998c6bda4aea7aa659ea4dda7e3951" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:17:07 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-64cf350e-c50e-47d2-9a6a-5b0e9f11ca11 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Lock "681e5c5fd0998c6bda4aea7aa659ea4dda7e3951" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:17:07 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-64cf350e-c50e-47d2-9a6a-5b0e9f11ca11 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/681e5c5fd0998c6bda4aea7aa659ea4dda7e3951 --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:17:07 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-64cf350e-c50e-47d2-9a6a-5b0e9f11ca11 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/681e5c5fd0998c6bda4aea7aa659ea4dda7e3951 --force-share --output=json" returned: 0 in 0.209s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:17:07 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-64cf350e-c50e-47d2-9a6a-5b0e9f11ca11 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/681e5c5fd0998c6bda4aea7aa659ea4dda7e3951,backing_fmt=raw /opt/stack/data/nova/instances/14fab12e-52be-4fe6-8777-bc7ebf3c25f1/disk.rescue {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:17:07 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-64cf350e-c50e-47d2-9a6a-5b0e9f11ca11 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/681e5c5fd0998c6bda4aea7aa659ea4dda7e3951,backing_fmt=raw /opt/stack/data/nova/instances/14fab12e-52be-4fe6-8777-bc7ebf3c25f1/disk.rescue" returned: 0 in 0.049s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:17:07 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-64cf350e-c50e-47d2-9a6a-5b0e9f11ca11 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Lock "681e5c5fd0998c6bda4aea7aa659ea4dda7e3951" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.265s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:17:07 user nova-compute[73572]: DEBUG nova.objects.instance [None req-64cf350e-c50e-47d2-9a6a-5b0e9f11ca11 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Lazy-loading 'migration_context' on Instance uuid 14fab12e-52be-4fe6-8777-bc7ebf3c25f1 {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:17:07 user nova-compute[73572]: DEBUG nova.objects.base [None req-64cf350e-c50e-47d2-9a6a-5b0e9f11ca11 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Object Instance<14fab12e-52be-4fe6-8777-bc7ebf3c25f1> lazy-loaded attributes: trusted_certs,migration_context {{(pid=73572) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 10:17:07 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-64cf350e-c50e-47d2-9a6a-5b0e9f11ca11 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: 14fab12e-52be-4fe6-8777-bc7ebf3c25f1] Created local disks {{(pid=73572) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 10:17:07 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-64cf350e-c50e-47d2-9a6a-5b0e9f11ca11 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: 14fab12e-52be-4fe6-8777-bc7ebf3c25f1] Start _get_guest_xml network_info=[{"id": "1b2121f4-88b1-4815-9329-3c9e3172a2f6", "address": "fa:16:3e:b0:35:f5", "network": {"id": "991b9dff-5173-4456-a530-b1f7eb5cfa4a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1845930297-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1845930297-network", "vif_mac": "fa:16:3e:b0:35:f5"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4636f93c5bfc4653804de097aed2882c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b2121f4-88", "ovs_interfaceid": "1b2121f4-88b1-4815-9329-3c9e3172a2f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T10:07:33Z,direct_url=<?>,disk_format='qcow2',id=299da0c9-e1c4-48f0-be55-fbe20dd06bc9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5c995f8bbbab4368b67a253e0df3971a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T10:07:34Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'ac85e303-fd69-4047-ae6b-4afa2c0d12cb', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'disk_bus': 'virtio', 'boot_index': 0, 'mount_device': '/dev/vda', 'attachment_id': 'e784ff83-27ae-4861-be4b-16a6bf769b3a', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'isVEPGco', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': '14fab12e-52be-4fe6-8777-bc7ebf3c25f1', 'attached_at': '', 'detached_at': '', 'volume_id': '36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81', 'serial': '36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81'}, 'guest_format': None, 'device_type': 'disk', 'volume_type': None} {{(pid=73572) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 10:17:07 user nova-compute[73572]: DEBUG nova.objects.instance [None req-64cf350e-c50e-47d2-9a6a-5b0e9f11ca11 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Lazy-loading 'resources' on Instance uuid 14fab12e-52be-4fe6-8777-bc7ebf3c25f1 {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:17:07 user nova-compute[73572]: DEBUG nova.objects.base [None req-64cf350e-c50e-47d2-9a6a-5b0e9f11ca11 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Object Instance<14fab12e-52be-4fe6-8777-bc7ebf3c25f1> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=73572) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 10:17:07 user nova-compute[73572]: DEBUG nova.objects.instance [None req-64cf350e-c50e-47d2-9a6a-5b0e9f11ca11 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Lazy-loading 'numa_topology' on Instance uuid 14fab12e-52be-4fe6-8777-bc7ebf3c25f1 {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:17:07 user nova-compute[73572]: DEBUG nova.objects.base [None req-64cf350e-c50e-47d2-9a6a-5b0e9f11ca11 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Object Instance<14fab12e-52be-4fe6-8777-bc7ebf3c25f1> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=73572) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 10:17:07 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-64cf350e-c50e-47d2-9a6a-5b0e9f11ca11 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:17:07 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-64cf350e-c50e-47d2-9a6a-5b0e9f11ca11 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:17:07 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-64cf350e-c50e-47d2-9a6a-5b0e9f11ca11 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73572) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 10:17:07 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-64cf350e-c50e-47d2-9a6a-5b0e9f11ca11 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] CPU controller missing on host. {{(pid=73572) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 10:17:07 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-64cf350e-c50e-47d2-9a6a-5b0e9f11ca11 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73572) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 10:17:07 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-64cf350e-c50e-47d2-9a6a-5b0e9f11ca11 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] CPU controller found on host. {{(pid=73572) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 10:17:07 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-64cf350e-c50e-47d2-9a6a-5b0e9f11ca11 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73572) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 10:17:07 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-64cf350e-c50e-47d2-9a6a-5b0e9f11ca11 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T10:07:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T10:07:33Z,direct_url=<?>,disk_format='qcow2',id=299da0c9-e1c4-48f0-be55-fbe20dd06bc9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5c995f8bbbab4368b67a253e0df3971a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T10:07:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 10:17:07 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-64cf350e-c50e-47d2-9a6a-5b0e9f11ca11 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Flavor limits 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 10:17:07 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-64cf350e-c50e-47d2-9a6a-5b0e9f11ca11 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Image limits 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 10:17:07 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-64cf350e-c50e-47d2-9a6a-5b0e9f11ca11 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Flavor pref 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 10:17:07 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-64cf350e-c50e-47d2-9a6a-5b0e9f11ca11 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Image pref 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 10:17:07 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-64cf350e-c50e-47d2-9a6a-5b0e9f11ca11 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 10:17:07 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-64cf350e-c50e-47d2-9a6a-5b0e9f11ca11 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 10:17:07 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-64cf350e-c50e-47d2-9a6a-5b0e9f11ca11 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73572) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 10:17:07 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-64cf350e-c50e-47d2-9a6a-5b0e9f11ca11 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Got 1 possible topologies {{(pid=73572) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 10:17:07 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-64cf350e-c50e-47d2-9a6a-5b0e9f11ca11 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 10:17:07 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-64cf350e-c50e-47d2-9a6a-5b0e9f11ca11 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 10:17:07 user nova-compute[73572]: DEBUG nova.objects.instance [None req-64cf350e-c50e-47d2-9a6a-5b0e9f11ca11 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Lazy-loading 'vcpu_model' on Instance uuid 14fab12e-52be-4fe6-8777-bc7ebf3c25f1 {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:17:07 user nova-compute[73572]: DEBUG nova.objects.base [None req-64cf350e-c50e-47d2-9a6a-5b0e9f11ca11 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Object Instance<14fab12e-52be-4fe6-8777-bc7ebf3c25f1> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=73572) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 10:17:07 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-64cf350e-c50e-47d2-9a6a-5b0e9f11ca11 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: 14fab12e-52be-4fe6-8777-bc7ebf3c25f1] Calling os-brick to attach iSCSI Volume {{(pid=73572) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 10:17:07 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-64cf350e-c50e-47d2-9a6a-5b0e9f11ca11 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc89c3d6a10>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'isVEPGco', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 10:17:07 user nova-compute[73572]: WARNING os_brick.initiator.connectors.base [None req-64cf350e-c50e-47d2-9a6a-5b0e9f11ca11 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 10:17:07 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-64cf350e-c50e-47d2-9a6a-5b0e9f11ca11 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 10:17:07 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-64cf350e-c50e-47d2-9a6a-5b0e9f11ca11 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 10:17:07 user nova-compute[73572]: WARNING os_brick.initiator.connectors.base [None req-64cf350e-c50e-47d2-9a6a-5b0e9f11ca11 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 10:17:07 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-64cf350e-c50e-47d2-9a6a-5b0e9f11ca11 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 10:17:07 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-64cf350e-c50e-47d2-9a6a-5b0e9f11ca11 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 10:17:07 user nova-compute[73572]: INFO os_brick.initiator.connectors.iscsi [None req-64cf350e-c50e-47d2-9a6a-5b0e9f11ca11 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 10:17:07 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 -p 172.16.0.220:3260 {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:17:07 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 -p 172.16.0.220:3260" returned: 0 in 0.018s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:17:07 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbac9fec-bc5d-497c-95eb-6d573ea6bbb8]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = isVEPGco\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:17:07 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-64cf350e-c50e-47d2-9a6a-5b0e9f11ca11 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 26 10:17:07 user nova-compute[73572]: node.name = iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81
Aug 26 10:17:07 user nova-compute[73572]: node.tpgt = -1
Aug 26 10:17:07 user nova-compute[73572]: node.startup = automatic
Aug 26 10:17:07 user nova-compute[73572]: node.leading_login = No
Aug 26 10:17:07 user nova-compute[73572]: iface.iscsi_ifacename = default
Aug 26 10:17:07 user nova-compute[73572]: iface.net_ifacename = <empty>
Aug 26 10:17:07 user nova-compute[73572]: iface.ipaddress = <empty>
Aug 26 10:17:07 user nova-compute[73572]: iface.prefix_len = 0
Aug 26 10:17:07 user nova-compute[73572]: iface.hwaddress = <empty>
Aug 26 10:17:07 user nova-compute[73572]: iface.transport_name = tcp
Aug 26 10:17:07 user nova-compute[73572]: iface.initiatorname = <empty>
Aug 26 10:17:07 user nova-compute[73572]: iface.state = <empty>
Aug 26 10:17:07 user nova-compute[73572]: iface.vlan_id = 0
Aug 26 10:17:07 user nova-compute[73572]: iface.vlan_priority = 0
Aug 26 10:17:07 user nova-compute[73572]: iface.vlan_state = <empty>
Aug 26 10:17:07 user nova-compute[73572]: iface.iface_num = 0
Aug 26 10:17:07 user nova-compute[73572]: iface.mtu = 0
Aug 26 10:17:07 user nova-compute[73572]: iface.port = 0
Aug 26 10:17:07 user nova-compute[73572]: iface.bootproto = <empty>
Aug 26 10:17:07 user nova-compute[73572]: iface.subnet_mask = <empty>
Aug 26 10:17:07 user nova-compute[73572]: iface.gateway = <empty>
Aug 26 10:17:07 user nova-compute[73572]: iface.dhcp_alt_client_id_state = <empty>
Aug 26 10:17:07 user nova-compute[73572]: iface.dhcp_alt_client_id = <empty>
Aug 26 10:17:07 user nova-compute[73572]: iface.dhcp_dns = <empty>
Aug 26 10:17:07 user nova-compute[73572]: iface.dhcp_learn_iqn = <empty>
Aug 26 10:17:07 user nova-compute[73572]: iface.dhcp_req_vendor_id_state = <empty>
Aug 26 10:17:07 user nova-compute[73572]: iface.dhcp_vendor_id_state = <empty>
Aug 26 10:17:07 user nova-compute[73572]: iface.dhcp_vendor_id = <empty>
Aug 26 10:17:07 user nova-compute[73572]: iface.dhcp_slp_da = <empty>
Aug 26 10:17:07 user nova-compute[73572]: iface.fragmentation = <empty>
Aug 26 10:17:07 user nova-compute[73572]: iface.gratuitous_arp = <empty>
Aug 26 10:17:07 user nova-compute[73572]: iface.incoming_forwarding = <empty>
Aug 26 10:17:07 user nova-compute[73572]: iface.tos_state = <empty>
Aug 26 10:17:07 user nova-compute[73572]: iface.tos = 0
Aug 26 10:17:07 user nova-compute[73572]: iface.ttl = 0
Aug 26 10:17:07 user nova-compute[73572]: iface.delayed_ack = <empty>
Aug 26 10:17:07 user nova-compute[73572]: iface.tcp_nagle = <empty>
Aug 26 10:17:07 user nova-compute[73572]: iface.tcp_wsf_state = <empty>
Aug 26 10:17:07 user nova-compute[73572]: iface.tcp_wsf = 0
Aug 26 10:17:07 user nova-compute[73572]: iface.tcp_timer_scale = 0
Aug 26 10:17:07 user nova-compute[73572]: iface.tcp_timestamp = <empty>
Aug 26 10:17:07 user nova-compute[73572]: iface.redirect = <empty>
Aug 26 10:17:07 user nova-compute[73572]: iface.def_task_mgmt_timeout = 0
Aug 26 10:17:07 user nova-compute[73572]: iface.header_digest = <empty>
Aug 26 10:17:07 user nova-compute[73572]: iface.data_digest = <empty>
Aug 26 10:17:07 user nova-compute[73572]: iface.immediate_data = <empty>
Aug 26 10:17:07 user nova-compute[73572]: iface.initial_r2t = <empty>
Aug 26 10:17:07 user nova-compute[73572]: iface.data_seq_inorder = <empty>
Aug 26 10:17:07 user nova-compute[73572]: iface.data_pdu_inorder = <empty>
Aug 26 10:17:07 user nova-compute[73572]: iface.erl = 0
Aug 26 10:17:07 user nova-compute[73572]: iface.max_receive_data_len = 0
Aug 26 10:17:07 user nova-compute[73572]: iface.first_burst_len = 0
Aug 26 10:17:07 user nova-compute[73572]: iface.max_outstanding_r2t = 0
Aug 26 10:17:07 user nova-compute[73572]: iface.max_burst_len = 0
Aug 26 10:17:07 user nova-compute[73572]: iface.chap_auth = <empty>
Aug 26 10:17:07 user nova-compute[73572]: iface.bidi_chap = <empty>
Aug 26 10:17:07 user nova-compute[73572]: iface.strict_login_compliance = <empty>
Aug 26 10:17:07 user nova-compute[73572]: iface.discovery_auth = <empty>
Aug 26 10:17:07 user nova-compute[73572]: iface.discovery_logout = <empty>
Aug 26 10:17:07 user nova-compute[73572]: node.discovery_address = <empty>
Aug 26 10:17:07 user nova-compute[73572]: node.discovery_port = 0
Aug 26 10:17:07 user nova-compute[73572]: node.discovery_type = static
Aug 26 10:17:07 user nova-compute[73572]: node.session.initial_cmdsn = 0
Aug 26 10:17:07 user nova-compute[73572]: node.session.initial_login_retry_max = 8
Aug 26 10:17:07 user nova-compute[73572]: node.session.xmit_thread_priority = -20
Aug 26 10:17:07 user nova-compute[73572]: node.session.cmds_max = 128
Aug 26 10:17:07 user nova-compute[73572]: node.session.queue_depth = 32
Aug 26 10:17:07 user nova-compute[73572]: node.session.nr_sessions = 1
Aug 26 10:17:07 user nova-compute[73572]: node.session.auth.authmethod = CHAP
Aug 26 10:17:07 user nova-compute[73572]: node.session.auth.username = isVEPGco
Aug 26 10:17:07 user nova-compute[73572]: node.session.auth.password = ***
Aug 26 10:17:07 user nova-compute[73572]: node.session.auth.username_in = <empty>
Aug 26 10:17:07 user nova-compute[73572]: node.session.auth.password_in = <empty>
Aug 26 10:17:07 user nova-compute[73572]: node.session.auth.chap_algs = MD5
Aug 26 10:17:07 user nova-compute[73572]: node.session.timeo.replacement_timeout = 120
Aug 26 10:17:07 user nova-compute[73572]: node.session.err_timeo.abort_timeout = 15
Aug 26 10:17:07 user nova-compute[73572]: node.session.err_timeo.lu_reset_timeout = 30
Aug 26 10:17:07 user nova-compute[73572]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 26 10:17:07 user nova-compute[73572]: node.session.err_timeo.host_reset_timeout = 60
Aug 26 10:17:07 user nova-compute[73572]: node.session.iscsi.FastAbort = Yes
Aug 26 10:17:07 user nova-compute[73572]: node.session.iscsi.InitialR2T = No
Aug 26 10:17:07 user nova-compute[73572]: node.session.iscsi.ImmediateData = Yes
Aug 26 10:17:07 user nova-compute[73572]: node.session.iscsi.FirstBurstLength = 262144
Aug 26 10:17:07 user nova-compute[73572]: node.session.iscsi.MaxBurstLength = 16776192
Aug 26 10:17:07 user nova-compute[73572]: node.session.iscsi.DefaultTime2Retain = 0
Aug 26 10:17:07 user nova-compute[73572]: node.session.iscsi.DefaultTime2Wait = 2
Aug 26 10:17:07 user nova-compute[73572]: node.session.iscsi.MaxConnections = 1
Aug 26 10:17:07 user nova-compute[73572]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 26 10:17:07 user nova-compute[73572]: node.session.iscsi.ERL = 0
Aug 26 10:17:07 user nova-compute[73572]: node.session.scan = manual
Aug 26 10:17:07 user nova-compute[73572]: node.session.reopen_max = 0
Aug 26 10:17:07 user nova-compute[73572]: node.conn[0].address = 172.16.0.220
Aug 26 10:17:07 user nova-compute[73572]: node.conn[0].port = 3260
Aug 26 10:17:07 user nova-compute[73572]: node.conn[0].startup = manual
Aug 26 10:17:07 user nova-compute[73572]: node.conn[0].tcp.window_size = 524288
Aug 26 10:17:07 user nova-compute[73572]: node.conn[0].tcp.type_of_service = 0
Aug 26 10:17:07 user nova-compute[73572]: node.conn[0].timeo.logout_timeout = 15
Aug 26 10:17:07 user nova-compute[73572]: node.conn[0].timeo.login_timeout = 15
Aug 26 10:17:07 user nova-compute[73572]: node.conn[0].timeo.auth_timeout = 45
Aug 26 10:17:07 user nova-compute[73572]: node.conn[0].timeo.noop_out_interval = 5
Aug 26 10:17:07 user nova-compute[73572]: node.conn[0].timeo.noop_out_timeout = 5
Aug 26 10:17:07 user nova-compute[73572]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 26 10:17:07 user nova-compute[73572]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 26 10:17:07 user nova-compute[73572]: node.conn[0].iscsi.HeaderDigest = None
Aug 26 10:17:07 user nova-compute[73572]: node.conn[0].iscsi.DataDigest = None
Aug 26 10:17:07 user nova-compute[73572]: node.conn[0].iscsi.IFMarker = No
Aug 26 10:17:07 user nova-compute[73572]: node.conn[0].iscsi.OFMarker = No
Aug 26 10:17:07 user nova-compute[73572]: # END RECORD
Aug 26 10:17:07 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:17:07 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:17:07 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:17:07 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[9316c4d7-2d25-4dfd-8bbe-3decedb1ba48]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:17:07 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-64cf350e-c50e-47d2-9a6a-5b0e9f11ca11 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:17:07 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:17:07 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:17:07 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[877dd4db-d31e-4f6f-92e1-f1ca72101cc7]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:17:08 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-64cf350e-c50e-47d2-9a6a-5b0e9f11ca11 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:17:08 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v isVEPGco {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:17:08 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v isVEPGco" returned: 0 in 0.021s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:17:08 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[3deca634-9e28-493f-84f4-fba47c4b089f]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:17:08 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-64cf350e-c50e-47d2-9a6a-5b0e9f11ca11 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'isVEPGco'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:17:08 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:17:08 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:17:08 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f5614a8-0afd-4b9e-bcd6-e8f32cbfb4f8]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:17:08 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-64cf350e-c50e-47d2-9a6a-5b0e9f11ca11 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:17:08 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:17:08 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:17:08 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d3b038d-7a8b-411c-aac2-66903b345a5d]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac5c1ee2-3656-49b3-942f-5fc992dc001b (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:17:08 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-64cf350e-c50e-47d2-9a6a-5b0e9f11ca11 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac5c1ee2-3656-49b3-942f-5fc992dc001b (non-flash)
Aug 26 10:17:08 user nova-compute[73572]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)
Aug 26 10:17:08 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 10:17:08 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-64cf350e-c50e-47d2-9a6a-5b0e9f11ca11 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac5c1ee2-3656-49b3-942f-5fc992dc001b (non-flash)
Aug 26 10:17:08 user nova-compute[73572]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)
Aug 26 10:17:08 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 10:17:08 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-64cf350e-c50e-47d2-9a6a-5b0e9f11ca11 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.150s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 10:17:08 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-64cf350e-c50e-47d2-9a6a-5b0e9f11ca11 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Connected to 172.16.0.220:3260 {{(pid=73572) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 10:17:08 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-64cf350e-c50e-47d2-9a6a-5b0e9f11ca11 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] HCTL ('37', '0', '0', 0) found on session 13 with lun 0 {{(pid=73572) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 10:17:08 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-64cf350e-c50e-47d2-9a6a-5b0e9f11ca11 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Scanning host 37 c: 0, t: 0, l: 0) {{(pid=73572) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 10:17:08 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:17:08 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:17:08 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.018s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:17:08 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[938612ea-67ea-47ae-906b-8e199bd8e186]: (4, ('0 0 0', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:17:08 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-64cf350e-c50e-47d2-9a6a-5b0e9f11ca11 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Searching for a device in session 13 and hctl ('37', '0', '0', 0) yield: sdf {{(pid=73572) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 10:17:08 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-64cf350e-c50e-47d2-9a6a-5b0e9f11ca11 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'isVEPGco', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73572) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 10:17:08 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-64cf350e-c50e-47d2-9a6a-5b0e9f11ca11 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.185s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 10:17:08 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-64cf350e-c50e-47d2-9a6a-5b0e9f11ca11 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] <== connect_volume: return (186ms) {'type': 'block', 'scsi_wwn': '26661383361383639', 'path': '/dev/sdf'} {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 10:17:08 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-64cf350e-c50e-47d2-9a6a-5b0e9f11ca11 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: 14fab12e-52be-4fe6-8777-bc7ebf3c25f1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26661383361383639', 'path': '/dev/sdf'} {{(pid=73572) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 10:17:08 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-64cf350e-c50e-47d2-9a6a-5b0e9f11ca11 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T10:15:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1685663078',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1685663078',id=14,image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T10:15:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4636f93c5bfc4653804de097aed2882c',ramdisk_id='',reservation_id='r-5s63bck6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-665602868',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T10:15:38Z,user_data=None,user_id='07f3538038a14713af3bbe420f1fb03a',uuid=14fab12e-52be-4fe6-8777-bc7ebf3c25f1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1b2121f4-88b1-4815-9329-3c9e3172a2f6", "address": "fa:16:3e:b0:35:f5", "network": {"id": "991b9dff-5173-4456-a530-b1f7eb5cfa4a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1845930297-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1845930297-network", "vif_mac": "fa:16:3e:b0:35:f5"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4636f93c5bfc4653804de097aed2882c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b2121f4-88", "ovs_interfaceid": "1b2121f4-88b1-4815-9329-3c9e3172a2f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73572) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 10:17:08 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-64cf350e-c50e-47d2-9a6a-5b0e9f11ca11 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Converting VIF {"id": "1b2121f4-88b1-4815-9329-3c9e3172a2f6", "address": "fa:16:3e:b0:35:f5", "network": {"id": "991b9dff-5173-4456-a530-b1f7eb5cfa4a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1845930297-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1845930297-network", "vif_mac": "fa:16:3e:b0:35:f5"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4636f93c5bfc4653804de097aed2882c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b2121f4-88", "ovs_interfaceid": "1b2121f4-88b1-4815-9329-3c9e3172a2f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:17:08 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-64cf350e-c50e-47d2-9a6a-5b0e9f11ca11 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b0:35:f5,bridge_name='br-int',has_traffic_filtering=True,id=1b2121f4-88b1-4815-9329-3c9e3172a2f6,network=Network(991b9dff-5173-4456-a530-b1f7eb5cfa4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b2121f4-88') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:17:08 user nova-compute[73572]: DEBUG nova.objects.instance [None req-64cf350e-c50e-47d2-9a6a-5b0e9f11ca11 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Lazy-loading 'pci_devices' on Instance uuid 14fab12e-52be-4fe6-8777-bc7ebf3c25f1 {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:17:08 user nova-compute[73572]: DEBUG nova.objects.base [None req-64cf350e-c50e-47d2-9a6a-5b0e9f11ca11 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Object Instance<14fab12e-52be-4fe6-8777-bc7ebf3c25f1> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=73572) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 10:17:08 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-64cf350e-c50e-47d2-9a6a-5b0e9f11ca11 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: 14fab12e-52be-4fe6-8777-bc7ebf3c25f1] End _get_guest_xml xml=<domain type="kvm">
Aug 26 10:17:08 user nova-compute[73572]:   <uuid>14fab12e-52be-4fe6-8777-bc7ebf3c25f1</uuid>
Aug 26 10:17:08 user nova-compute[73572]:   <name>instance-0000000e</name>
Aug 26 10:17:08 user nova-compute[73572]:   <memory>524288</memory>
Aug 26 10:17:08 user nova-compute[73572]:   <vcpu>1</vcpu>
Aug 26 10:17:08 user nova-compute[73572]:   <metadata>
Aug 26 10:17:08 user nova-compute[73572]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 10:17:08 user nova-compute[73572]:       <nova:package version="0.0.0"/>
Aug 26 10:17:08 user nova-compute[73572]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1685663078</nova:name>
Aug 26 10:17:08 user nova-compute[73572]:       <nova:creationTime>2023-08-26 10:17:07</nova:creationTime>
Aug 26 10:17:08 user nova-compute[73572]:       <nova:flavor name="m1.tiny">
Aug 26 10:17:08 user nova-compute[73572]:         <nova:memory>512</nova:memory>
Aug 26 10:17:08 user nova-compute[73572]:         <nova:disk>1</nova:disk>
Aug 26 10:17:08 user nova-compute[73572]:         <nova:swap>0</nova:swap>
Aug 26 10:17:08 user nova-compute[73572]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 10:17:08 user nova-compute[73572]:         <nova:vcpus>1</nova:vcpus>
Aug 26 10:17:08 user nova-compute[73572]:       </nova:flavor>
Aug 26 10:17:08 user nova-compute[73572]:       <nova:owner>
Aug 26 10:17:08 user nova-compute[73572]:         <nova:user uuid="07f3538038a14713af3bbe420f1fb03a">tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member</nova:user>
Aug 26 10:17:08 user nova-compute[73572]:         <nova:project uuid="4636f93c5bfc4653804de097aed2882c">tempest-ServerBootFromVolumeStableRescueTest-665602868</nova:project>
Aug 26 10:17:08 user nova-compute[73572]:       </nova:owner>
Aug 26 10:17:08 user nova-compute[73572]:       <nova:root type="image" uuid="299da0c9-e1c4-48f0-be55-fbe20dd06bc9"/>
Aug 26 10:17:08 user nova-compute[73572]:       <nova:ports>
Aug 26 10:17:08 user nova-compute[73572]:         <nova:port uuid="1b2121f4-88b1-4815-9329-3c9e3172a2f6">
Aug 26 10:17:08 user nova-compute[73572]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 26 10:17:08 user nova-compute[73572]:         </nova:port>
Aug 26 10:17:08 user nova-compute[73572]:       </nova:ports>
Aug 26 10:17:08 user nova-compute[73572]:     </nova:instance>
Aug 26 10:17:08 user nova-compute[73572]:   </metadata>
Aug 26 10:17:08 user nova-compute[73572]:   <sysinfo type="smbios">
Aug 26 10:17:08 user nova-compute[73572]:     <system>
Aug 26 10:17:08 user nova-compute[73572]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 10:17:08 user nova-compute[73572]:       <entry name="product">OpenStack Nova</entry>
Aug 26 10:17:08 user nova-compute[73572]:       <entry name="version">0.0.0</entry>
Aug 26 10:17:08 user nova-compute[73572]:       <entry name="serial">14fab12e-52be-4fe6-8777-bc7ebf3c25f1</entry>
Aug 26 10:17:08 user nova-compute[73572]:       <entry name="uuid">14fab12e-52be-4fe6-8777-bc7ebf3c25f1</entry>
Aug 26 10:17:08 user nova-compute[73572]:       <entry name="family">Virtual Machine</entry>
Aug 26 10:17:08 user nova-compute[73572]:     </system>
Aug 26 10:17:08 user nova-compute[73572]:   </sysinfo>
Aug 26 10:17:08 user nova-compute[73572]:   <os>
Aug 26 10:17:08 user nova-compute[73572]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 10:17:08 user nova-compute[73572]:     <smbios mode="sysinfo"/>
Aug 26 10:17:08 user nova-compute[73572]:   </os>
Aug 26 10:17:08 user nova-compute[73572]:   <features>
Aug 26 10:17:08 user nova-compute[73572]:     <acpi/>
Aug 26 10:17:08 user nova-compute[73572]:     <apic/>
Aug 26 10:17:08 user nova-compute[73572]:     <vmcoreinfo/>
Aug 26 10:17:08 user nova-compute[73572]:   </features>
Aug 26 10:17:08 user nova-compute[73572]:   <clock offset="utc">
Aug 26 10:17:08 user nova-compute[73572]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 10:17:08 user nova-compute[73572]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 10:17:08 user nova-compute[73572]:     <timer name="hpet" present="no"/>
Aug 26 10:17:08 user nova-compute[73572]:   </clock>
Aug 26 10:17:08 user nova-compute[73572]:   <cpu mode="custom" match="exact">
Aug 26 10:17:08 user nova-compute[73572]:     <model>Nehalem</model>
Aug 26 10:17:08 user nova-compute[73572]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 10:17:08 user nova-compute[73572]:   </cpu>
Aug 26 10:17:08 user nova-compute[73572]:   <devices>
Aug 26 10:17:08 user nova-compute[73572]:     <disk type="block" device="disk">
Aug 26 10:17:08 user nova-compute[73572]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 10:17:08 user nova-compute[73572]:       <source dev="/dev/sdf"/>
Aug 26 10:17:08 user nova-compute[73572]:       <target dev="vda" bus="virtio"/>
Aug 26 10:17:08 user nova-compute[73572]:       <serial>36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81</serial>
Aug 26 10:17:08 user nova-compute[73572]:     </disk>
Aug 26 10:17:08 user nova-compute[73572]:     <disk type="file" device="disk">
Aug 26 10:17:08 user nova-compute[73572]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 10:17:08 user nova-compute[73572]:       <source file="/opt/stack/data/nova/instances/14fab12e-52be-4fe6-8777-bc7ebf3c25f1/disk.rescue"/>
Aug 26 10:17:08 user nova-compute[73572]:       <target dev="vdb" bus="virtio"/>
Aug 26 10:17:08 user nova-compute[73572]:       <boot order="1"/>
Aug 26 10:17:08 user nova-compute[73572]:     </disk>
Aug 26 10:17:08 user nova-compute[73572]:     <interface type="ethernet">
Aug 26 10:17:08 user nova-compute[73572]:       <mac address="fa:16:3e:b0:35:f5"/>
Aug 26 10:17:08 user nova-compute[73572]:       <model type="virtio"/>
Aug 26 10:17:08 user nova-compute[73572]:       <mtu size="1442"/>
Aug 26 10:17:08 user nova-compute[73572]:       <target dev="tap1b2121f4-88"/>
Aug 26 10:17:08 user nova-compute[73572]:     </interface>
Aug 26 10:17:08 user nova-compute[73572]:     <serial type="pty">
Aug 26 10:17:08 user nova-compute[73572]:       <log file="/opt/stack/data/nova/instances/14fab12e-52be-4fe6-8777-bc7ebf3c25f1/console.log" append="off"/>
Aug 26 10:17:08 user nova-compute[73572]:     </serial>
Aug 26 10:17:08 user nova-compute[73572]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 10:17:08 user nova-compute[73572]:     <video>
Aug 26 10:17:08 user nova-compute[73572]:       <model type="virtio"/>
Aug 26 10:17:08 user nova-compute[73572]:     </video>
Aug 26 10:17:08 user nova-compute[73572]:     <rng model="virtio">
Aug 26 10:17:08 user nova-compute[73572]:       <backend model="random">/dev/urandom</backend>
Aug 26 10:17:08 user nova-compute[73572]:     </rng>
Aug 26 10:17:08 user nova-compute[73572]:     <controller type="usb" index="0" model="none"/>
Aug 26 10:17:08 user nova-compute[73572]:     <memballoon model="virtio">
Aug 26 10:17:08 user nova-compute[73572]:       <stats period="10"/>
Aug 26 10:17:08 user nova-compute[73572]:     </memballoon>
Aug 26 10:17:08 user nova-compute[73572]:   </devices>
Aug 26 10:17:08 user nova-compute[73572]: </domain>
Aug 26 10:17:08 user nova-compute[73572]:  {{(pid=73572) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 10:17:08 user nova-compute[73572]: INFO nova.virt.libvirt.driver [-] [instance: 14fab12e-52be-4fe6-8777-bc7ebf3c25f1] Instance destroyed successfully.
Aug 26 10:17:08 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-64cf350e-c50e-47d2-9a6a-5b0e9f11ca11 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] No BDM found with device name vda, not building metadata. {{(pid=73572) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 10:17:08 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-64cf350e-c50e-47d2-9a6a-5b0e9f11ca11 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73572) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 10:17:08 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-64cf350e-c50e-47d2-9a6a-5b0e9f11ca11 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] No VIF found with MAC fa:16:3e:b0:35:f5, not building metadata {{(pid=73572) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 10:17:09 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:17:09 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:17:09 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:17:09 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:17:09 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-cfa6d5b7-e49f-4fe6-bcb9-49ef9346245c tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Acquiring lock "00c47a06-2bf8-427d-bcb1-304688584511" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:17:09 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-cfa6d5b7-e49f-4fe6-bcb9-49ef9346245c tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Lock "00c47a06-2bf8-427d-bcb1-304688584511" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:17:09 user nova-compute[73572]: DEBUG nova.objects.instance [None req-cfa6d5b7-e49f-4fe6-bcb9-49ef9346245c tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Lazy-loading 'flavor' on Instance uuid 00c47a06-2bf8-427d-bcb1-304688584511 {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:17:09 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-cfa6d5b7-e49f-4fe6-bcb9-49ef9346245c tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Lock "00c47a06-2bf8-427d-bcb1-304688584511" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:17:09 user nova-compute[73572]: DEBUG nova.compute.manager [req-2096b589-46e3-46bf-8048-7695212e490f req-2d03fea4-2a93-45cd-bd8b-bd78c74ff7a4 service nova] [instance: 14fab12e-52be-4fe6-8777-bc7ebf3c25f1] Received event network-vif-plugged-1b2121f4-88b1-4815-9329-3c9e3172a2f6 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:17:09 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-2096b589-46e3-46bf-8048-7695212e490f req-2d03fea4-2a93-45cd-bd8b-bd78c74ff7a4 service nova] Acquiring lock "14fab12e-52be-4fe6-8777-bc7ebf3c25f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:17:09 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-2096b589-46e3-46bf-8048-7695212e490f req-2d03fea4-2a93-45cd-bd8b-bd78c74ff7a4 service nova] Lock "14fab12e-52be-4fe6-8777-bc7ebf3c25f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.005s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:17:09 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-2096b589-46e3-46bf-8048-7695212e490f req-2d03fea4-2a93-45cd-bd8b-bd78c74ff7a4 service nova] Lock "14fab12e-52be-4fe6-8777-bc7ebf3c25f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:17:09 user nova-compute[73572]: DEBUG nova.compute.manager [req-2096b589-46e3-46bf-8048-7695212e490f req-2d03fea4-2a93-45cd-bd8b-bd78c74ff7a4 service nova] [instance: 14fab12e-52be-4fe6-8777-bc7ebf3c25f1] No waiting events found dispatching network-vif-plugged-1b2121f4-88b1-4815-9329-3c9e3172a2f6 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:17:09 user nova-compute[73572]: WARNING nova.compute.manager [req-2096b589-46e3-46bf-8048-7695212e490f req-2d03fea4-2a93-45cd-bd8b-bd78c74ff7a4 service nova] [instance: 14fab12e-52be-4fe6-8777-bc7ebf3c25f1] Received unexpected event network-vif-plugged-1b2121f4-88b1-4815-9329-3c9e3172a2f6 for instance with vm_state active and task_state rescuing.
Aug 26 10:17:09 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-cfa6d5b7-e49f-4fe6-bcb9-49ef9346245c tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Acquiring lock "00c47a06-2bf8-427d-bcb1-304688584511" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:17:09 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-cfa6d5b7-e49f-4fe6-bcb9-49ef9346245c tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Lock "00c47a06-2bf8-427d-bcb1-304688584511" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:17:09 user nova-compute[73572]: INFO nova.compute.manager [None req-cfa6d5b7-e49f-4fe6-bcb9-49ef9346245c tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] [instance: 00c47a06-2bf8-427d-bcb1-304688584511] Attaching volume fceee937-cad2-4ce8-8a00-49b3ffab9478 to /dev/vdb
Aug 26 10:17:10 user nova-compute[73572]: DEBUG os_brick.utils [None req-cfa6d5b7-e49f-4fe6-bcb9-49ef9346245c tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 10:17:10 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:17:10 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:17:10 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[866c7ccf-a180-434f-8ce4-47a2e543778d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:de8a79ed912\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:17:10 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:17:10 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:17:10 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[e76f9ac0-e275-40d9-95ce-3b0affdb7157]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:17:10 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:17:10 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:17:10 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[624ae887-cd48-4ad8-840c-df79741b02bc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:17:10 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[7397e068-ccf8-4f0c-b971-4639d92e601b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:17:10 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-cfa6d5b7-e49f-4fe6-bcb9-49ef9346245c tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Running cmd (subprocess): nvme version {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:17:10 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-cfa6d5b7-e49f-4fe6-bcb9-49ef9346245c tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] 'nvme version' failed. Not Retrying. {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 10:17:10 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cfa6d5b7-e49f-4fe6-bcb9-49ef9346245c tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] nvme not present on system {{(pid=73572) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 10:17:10 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:17:10 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 10:17:10 user nova-compute[73572]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 10:17:10 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[690b13aa-5c82-42f6-8859-5bde59d4344c]: (4, '') {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:17:10 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.lightos [None req-cfa6d5b7-e49f-4fe6-bcb9-49ef9346245c tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73572) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 10:17:10 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.lightos [None req-cfa6d5b7-e49f-4fe6-bcb9-49ef9346245c tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73572) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 10:17:10 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.lightos [None req-cfa6d5b7-e49f-4fe6-bcb9-49ef9346245c tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] LIGHTOS: no hostnqn found. {{(pid=73572) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 10:17:10 user nova-compute[73572]: DEBUG os_brick.utils [None req-cfa6d5b7-e49f-4fe6-bcb9-49ef9346245c tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:de8a79ed912', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 10:17:10 user nova-compute[73572]: DEBUG nova.virt.block_device [None req-cfa6d5b7-e49f-4fe6-bcb9-49ef9346245c tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] [instance: 00c47a06-2bf8-427d-bcb1-304688584511] Updating existing volume attachment record: 72c3ccf1-c005-4caf-a75a-edf67652de29 {{(pid=73572) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 10:17:10 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:17:10 user nova-compute[73572]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693045015.2702458, 32a28361-567b-4bd4-9f4f-d9cfac2c9388 => Stopped> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:17:10 user nova-compute[73572]: INFO nova.compute.manager [-] [instance: 32a28361-567b-4bd4-9f4f-d9cfac2c9388] VM Stopped (Lifecycle Event)
Aug 26 10:17:10 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9f5dc4fe-2a12-4238-b685-087a604eb6f9 None None] [instance: 32a28361-567b-4bd4-9f4f-d9cfac2c9388] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:17:10 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:17:10 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:17:10 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:17:11 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Removed pending event for 14fab12e-52be-4fe6-8777-bc7ebf3c25f1 due to event {{(pid=73572) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 26 10:17:11 user nova-compute[73572]: DEBUG nova.virt.driver [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Emitting event <LifecycleEvent: 1693045031.7927244, 14fab12e-52be-4fe6-8777-bc7ebf3c25f1 => Resumed> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:17:11 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 14fab12e-52be-4fe6-8777-bc7ebf3c25f1] VM Resumed (Lifecycle Event)
Aug 26 10:17:11 user nova-compute[73572]: DEBUG nova.compute.manager [None req-64cf350e-c50e-47d2-9a6a-5b0e9f11ca11 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: 14fab12e-52be-4fe6-8777-bc7ebf3c25f1] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:17:11 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:17:11 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:17:11 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73572) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 10:17:11 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 14fab12e-52be-4fe6-8777-bc7ebf3c25f1] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:17:11 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 14fab12e-52be-4fe6-8777-bc7ebf3c25f1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73572) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 10:17:11 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 14fab12e-52be-4fe6-8777-bc7ebf3c25f1] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 26 10:17:11 user nova-compute[73572]: DEBUG nova.virt.driver [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Emitting event <LifecycleEvent: 1693045031.7989182, 14fab12e-52be-4fe6-8777-bc7ebf3c25f1 => Started> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:17:11 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 14fab12e-52be-4fe6-8777-bc7ebf3c25f1] VM Started (Lifecycle Event)
Aug 26 10:17:11 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 14fab12e-52be-4fe6-8777-bc7ebf3c25f1] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:17:11 user nova-compute[73572]: DEBUG nova.compute.manager [req-a027aea6-b0af-4fc9-a798-567ea65d7dd7 req-b85e00c4-8d15-43cc-9a79-a1bf212d76eb service nova] [instance: 14fab12e-52be-4fe6-8777-bc7ebf3c25f1] Received event network-vif-plugged-1b2121f4-88b1-4815-9329-3c9e3172a2f6 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:17:11 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-a027aea6-b0af-4fc9-a798-567ea65d7dd7 req-b85e00c4-8d15-43cc-9a79-a1bf212d76eb service nova] Acquiring lock "14fab12e-52be-4fe6-8777-bc7ebf3c25f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:17:11 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-a027aea6-b0af-4fc9-a798-567ea65d7dd7 req-b85e00c4-8d15-43cc-9a79-a1bf212d76eb service nova] Lock "14fab12e-52be-4fe6-8777-bc7ebf3c25f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:17:11 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-a027aea6-b0af-4fc9-a798-567ea65d7dd7 req-b85e00c4-8d15-43cc-9a79-a1bf212d76eb service nova] Lock "14fab12e-52be-4fe6-8777-bc7ebf3c25f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:17:11 user nova-compute[73572]: DEBUG nova.compute.manager [req-a027aea6-b0af-4fc9-a798-567ea65d7dd7 req-b85e00c4-8d15-43cc-9a79-a1bf212d76eb service nova] [instance: 14fab12e-52be-4fe6-8777-bc7ebf3c25f1] No waiting events found dispatching network-vif-plugged-1b2121f4-88b1-4815-9329-3c9e3172a2f6 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:17:11 user nova-compute[73572]: WARNING nova.compute.manager [req-a027aea6-b0af-4fc9-a798-567ea65d7dd7 req-b85e00c4-8d15-43cc-9a79-a1bf212d76eb service nova] [instance: 14fab12e-52be-4fe6-8777-bc7ebf3c25f1] Received unexpected event network-vif-plugged-1b2121f4-88b1-4815-9329-3c9e3172a2f6 for instance with vm_state rescued and task_state None.
Aug 26 10:17:11 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 14fab12e-52be-4fe6-8777-bc7ebf3c25f1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73572) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 10:17:12 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:17:12 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:17:13 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:17:13 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:17:13 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:17:14 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:17:14 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:17:15 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:17:15 user nova-compute[73572]: DEBUG nova.compute.manager [req-6f4e84b7-ad98-47f1-9079-54095a6a6ae6 req-e5d9de3a-600a-4cbd-b5eb-9517e4b64b49 service nova] [instance: d2970584-8c2a-4f99-922c-d66d59489504] Received event network-changed-754f85e2-09b3-418b-9c3f-452c88756d3a {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:17:15 user nova-compute[73572]: DEBUG nova.compute.manager [req-6f4e84b7-ad98-47f1-9079-54095a6a6ae6 req-e5d9de3a-600a-4cbd-b5eb-9517e4b64b49 service nova] [instance: d2970584-8c2a-4f99-922c-d66d59489504] Refreshing instance network info cache due to event network-changed-754f85e2-09b3-418b-9c3f-452c88756d3a. {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 10:17:15 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-6f4e84b7-ad98-47f1-9079-54095a6a6ae6 req-e5d9de3a-600a-4cbd-b5eb-9517e4b64b49 service nova] Acquiring lock "refresh_cache-d2970584-8c2a-4f99-922c-d66d59489504" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:17:15 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-6f4e84b7-ad98-47f1-9079-54095a6a6ae6 req-e5d9de3a-600a-4cbd-b5eb-9517e4b64b49 service nova] Acquired lock "refresh_cache-d2970584-8c2a-4f99-922c-d66d59489504" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:17:15 user nova-compute[73572]: DEBUG nova.network.neutron [req-6f4e84b7-ad98-47f1-9079-54095a6a6ae6 req-e5d9de3a-600a-4cbd-b5eb-9517e4b64b49 service nova] [instance: d2970584-8c2a-4f99-922c-d66d59489504] Refreshing network info cache for port 754f85e2-09b3-418b-9c3f-452c88756d3a {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 10:17:16 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-f4fec9ca-dc2e-40dc-9ea2-9f7de17fe8d6 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Acquiring lock "d2970584-8c2a-4f99-922c-d66d59489504" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:17:16 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-f4fec9ca-dc2e-40dc-9ea2-9f7de17fe8d6 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Lock "d2970584-8c2a-4f99-922c-d66d59489504" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:17:16 user nova-compute[73572]: DEBUG nova.objects.instance [None req-f4fec9ca-dc2e-40dc-9ea2-9f7de17fe8d6 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Lazy-loading 'flavor' on Instance uuid d2970584-8c2a-4f99-922c-d66d59489504 {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:17:16 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-f4fec9ca-dc2e-40dc-9ea2-9f7de17fe8d6 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Lock "d2970584-8c2a-4f99-922c-d66d59489504" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.082s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:17:16 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-f4fec9ca-dc2e-40dc-9ea2-9f7de17fe8d6 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Acquiring lock "d2970584-8c2a-4f99-922c-d66d59489504" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:17:16 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-f4fec9ca-dc2e-40dc-9ea2-9f7de17fe8d6 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Lock "d2970584-8c2a-4f99-922c-d66d59489504" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.003s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:17:16 user nova-compute[73572]: INFO nova.compute.manager [None req-f4fec9ca-dc2e-40dc-9ea2-9f7de17fe8d6 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] [instance: d2970584-8c2a-4f99-922c-d66d59489504] Attaching volume 0f30de3c-8988-4fc4-84f0-04e8109ece16 to /dev/vdb
Aug 26 10:17:16 user nova-compute[73572]: DEBUG os_brick.utils [None req-f4fec9ca-dc2e-40dc-9ea2-9f7de17fe8d6 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 10:17:16 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:17:16 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:17:16 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[d258e2df-0155-41c0-885b-0856dfb038c6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:de8a79ed912\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:17:16 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:17:16 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:17:16 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Cleaning up deleted instances {{(pid=73572) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 26 10:17:16 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:17:16 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[be3be030-8b13-4dd0-911e-660db0b97a60]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:17:16 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:17:16 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] There are 0 instances to clean {{(pid=73572) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 26 10:17:16 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:17:16 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[83fee5a5-2ead-42fa-bac2-cb5565875749]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:17:16 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[97923a75-ba4c-4302-aed5-c5d647ee1347]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:17:16 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-f4fec9ca-dc2e-40dc-9ea2-9f7de17fe8d6 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Running cmd (subprocess): nvme version {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:17:16 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-f4fec9ca-dc2e-40dc-9ea2-9f7de17fe8d6 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] 'nvme version' failed. Not Retrying. {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 10:17:16 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f4fec9ca-dc2e-40dc-9ea2-9f7de17fe8d6 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] nvme not present on system {{(pid=73572) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 10:17:16 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:17:16 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 10:17:16 user nova-compute[73572]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 10:17:16 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe0609a6-1e88-422f-8fb3-98da4d694f43]: (4, '') {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:17:16 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.lightos [None req-f4fec9ca-dc2e-40dc-9ea2-9f7de17fe8d6 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73572) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 10:17:16 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.lightos [None req-f4fec9ca-dc2e-40dc-9ea2-9f7de17fe8d6 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73572) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 10:17:16 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.lightos [None req-f4fec9ca-dc2e-40dc-9ea2-9f7de17fe8d6 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] LIGHTOS: no hostnqn found. {{(pid=73572) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 10:17:16 user nova-compute[73572]: DEBUG os_brick.utils [None req-f4fec9ca-dc2e-40dc-9ea2-9f7de17fe8d6 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] <== get_connector_properties: return (152ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:de8a79ed912', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 10:17:16 user nova-compute[73572]: DEBUG nova.virt.block_device [None req-f4fec9ca-dc2e-40dc-9ea2-9f7de17fe8d6 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] [instance: d2970584-8c2a-4f99-922c-d66d59489504] Updating existing volume attachment record: 5a8f9f5d-8b5c-4a56-9c9b-4647e7ca1d75 {{(pid=73572) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 10:17:16 user nova-compute[73572]: DEBUG nova.network.neutron [req-6f4e84b7-ad98-47f1-9079-54095a6a6ae6 req-e5d9de3a-600a-4cbd-b5eb-9517e4b64b49 service nova] [instance: d2970584-8c2a-4f99-922c-d66d59489504] Updated VIF entry in instance network info cache for port 754f85e2-09b3-418b-9c3f-452c88756d3a. {{(pid=73572) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 10:17:16 user nova-compute[73572]: DEBUG nova.network.neutron [req-6f4e84b7-ad98-47f1-9079-54095a6a6ae6 req-e5d9de3a-600a-4cbd-b5eb-9517e4b64b49 service nova] [instance: d2970584-8c2a-4f99-922c-d66d59489504] Updating instance_info_cache with network_info: [{"id": "754f85e2-09b3-418b-9c3f-452c88756d3a", "address": "fa:16:3e:d6:92:13", "network": {"id": "e565abb6-25f8-4f92-9cca-69db36e4216a", "bridge": "br-int", "label": "tempest-TestStampPattern-1866566708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f2be8d4c6c147e98a1b5b7443b3828d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap754f85e2-09", "ovs_interfaceid": "754f85e2-09b3-418b-9c3f-452c88756d3a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:17:17 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-6f4e84b7-ad98-47f1-9079-54095a6a6ae6 req-e5d9de3a-600a-4cbd-b5eb-9517e4b64b49 service nova] Releasing lock "refresh_cache-d2970584-8c2a-4f99-922c-d66d59489504" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:17:17 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:17:18 user nova-compute[73572]: INFO nova.compute.manager [None req-9a894069-128e-4593-9121-7b1524044e32 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] [instance: c555f971-b177-4c26-a38e-09e0e78bf7b9] Unrescuing
Aug 26 10:17:18 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9a894069-128e-4593-9121-7b1524044e32 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] Acquiring lock "refresh_cache-c555f971-b177-4c26-a38e-09e0e78bf7b9" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:17:18 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9a894069-128e-4593-9121-7b1524044e32 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] Acquired lock "refresh_cache-c555f971-b177-4c26-a38e-09e0e78bf7b9" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:17:18 user nova-compute[73572]: DEBUG nova.network.neutron [None req-9a894069-128e-4593-9121-7b1524044e32 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] [instance: c555f971-b177-4c26-a38e-09e0e78bf7b9] Building network info cache for instance {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 10:17:18 user nova-compute[73572]: DEBUG nova.network.neutron [None req-9a894069-128e-4593-9121-7b1524044e32 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] [instance: c555f971-b177-4c26-a38e-09e0e78bf7b9] Updating instance_info_cache with network_info: [{"id": "4ffb7229-16fb-441b-a954-d91308071fb8", "address": "fa:16:3e:26:32:ef", "network": {"id": "e052e34f-ce84-4612-b48b-2ed8474e7177", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-332746918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4556d14c0dd416fbe13ab2274947dec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ffb7229-16", "ovs_interfaceid": "4ffb7229-16fb-441b-a954-d91308071fb8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:17:18 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9a894069-128e-4593-9121-7b1524044e32 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] Releasing lock "refresh_cache-c555f971-b177-4c26-a38e-09e0e78bf7b9" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:17:18 user nova-compute[73572]: DEBUG nova.objects.instance [None req-9a894069-128e-4593-9121-7b1524044e32 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] Lazy-loading 'flavor' on Instance uuid c555f971-b177-4c26-a38e-09e0e78bf7b9 {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:17:18 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:17:18 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:17:18 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:17:18 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:17:18 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Auditing locally available compute resources for user (node: user) {{(pid=73572) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 10:17:18 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:17:18 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:17:19 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:17:19 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:17:19 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:17:19 user nova-compute[73572]: DEBUG nova.compute.manager [req-c9b90e0f-66db-416f-b180-f2ed6970bccd req-7f35339a-9d91-4db2-a952-b69202a045e2 service nova] [instance: c555f971-b177-4c26-a38e-09e0e78bf7b9] Received event network-vif-unplugged-4ffb7229-16fb-441b-a954-d91308071fb8 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:17:19 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-c9b90e0f-66db-416f-b180-f2ed6970bccd req-7f35339a-9d91-4db2-a952-b69202a045e2 service nova] Acquiring lock "c555f971-b177-4c26-a38e-09e0e78bf7b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:17:19 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-c9b90e0f-66db-416f-b180-f2ed6970bccd req-7f35339a-9d91-4db2-a952-b69202a045e2 service nova] Lock "c555f971-b177-4c26-a38e-09e0e78bf7b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:17:19 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-c9b90e0f-66db-416f-b180-f2ed6970bccd req-7f35339a-9d91-4db2-a952-b69202a045e2 service nova] Lock "c555f971-b177-4c26-a38e-09e0e78bf7b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:17:19 user nova-compute[73572]: DEBUG nova.compute.manager [req-c9b90e0f-66db-416f-b180-f2ed6970bccd req-7f35339a-9d91-4db2-a952-b69202a045e2 service nova] [instance: c555f971-b177-4c26-a38e-09e0e78bf7b9] No waiting events found dispatching network-vif-unplugged-4ffb7229-16fb-441b-a954-d91308071fb8 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:17:19 user nova-compute[73572]: WARNING nova.compute.manager [req-c9b90e0f-66db-416f-b180-f2ed6970bccd req-7f35339a-9d91-4db2-a952-b69202a045e2 service nova] [instance: c555f971-b177-4c26-a38e-09e0e78bf7b9] Received unexpected event network-vif-unplugged-4ffb7229-16fb-441b-a954-d91308071fb8 for instance with vm_state rescued and task_state unrescuing.
Aug 26 10:17:19 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:17:19 user nova-compute[73572]: DEBUG nova.compute.manager [req-250f5e9d-4ce5-4900-b7fc-3fd8dffa281f req-600b40c9-e25a-4d93-95ca-dd5a1a1fb9cb service nova] [instance: c555f971-b177-4c26-a38e-09e0e78bf7b9] Received event network-changed-4ffb7229-16fb-441b-a954-d91308071fb8 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:17:19 user nova-compute[73572]: DEBUG nova.compute.manager [req-250f5e9d-4ce5-4900-b7fc-3fd8dffa281f req-600b40c9-e25a-4d93-95ca-dd5a1a1fb9cb service nova] [instance: c555f971-b177-4c26-a38e-09e0e78bf7b9] Refreshing instance network info cache due to event network-changed-4ffb7229-16fb-441b-a954-d91308071fb8. {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 10:17:19 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-250f5e9d-4ce5-4900-b7fc-3fd8dffa281f req-600b40c9-e25a-4d93-95ca-dd5a1a1fb9cb service nova] Acquiring lock "refresh_cache-c555f971-b177-4c26-a38e-09e0e78bf7b9" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:17:19 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-250f5e9d-4ce5-4900-b7fc-3fd8dffa281f req-600b40c9-e25a-4d93-95ca-dd5a1a1fb9cb service nova] Acquired lock "refresh_cache-c555f971-b177-4c26-a38e-09e0e78bf7b9" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:17:19 user nova-compute[73572]: DEBUG nova.network.neutron [req-250f5e9d-4ce5-4900-b7fc-3fd8dffa281f req-600b40c9-e25a-4d93-95ca-dd5a1a1fb9cb service nova] [instance: c555f971-b177-4c26-a38e-09e0e78bf7b9] Refreshing network info cache for port 4ffb7229-16fb-441b-a954-d91308071fb8 {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 10:17:19 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:17:19 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:17:19 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:17:19 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:17:19 user nova-compute[73572]: INFO nova.virt.libvirt.driver [-] [instance: c555f971-b177-4c26-a38e-09e0e78bf7b9] Instance destroyed successfully.
Aug 26 10:17:19 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:17:20 user nova-compute[73572]: DEBUG nova.network.neutron [req-250f5e9d-4ce5-4900-b7fc-3fd8dffa281f req-600b40c9-e25a-4d93-95ca-dd5a1a1fb9cb service nova] [instance: c555f971-b177-4c26-a38e-09e0e78bf7b9] Updated VIF entry in instance network info cache for port 4ffb7229-16fb-441b-a954-d91308071fb8. {{(pid=73572) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 10:17:20 user nova-compute[73572]: DEBUG nova.network.neutron [req-250f5e9d-4ce5-4900-b7fc-3fd8dffa281f req-600b40c9-e25a-4d93-95ca-dd5a1a1fb9cb service nova] [instance: c555f971-b177-4c26-a38e-09e0e78bf7b9] Updating instance_info_cache with network_info: [{"id": "4ffb7229-16fb-441b-a954-d91308071fb8", "address": "fa:16:3e:26:32:ef", "network": {"id": "e052e34f-ce84-4612-b48b-2ed8474e7177", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-332746918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4556d14c0dd416fbe13ab2274947dec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ffb7229-16", "ovs_interfaceid": "4ffb7229-16fb-441b-a954-d91308071fb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:17:20 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-250f5e9d-4ce5-4900-b7fc-3fd8dffa281f req-600b40c9-e25a-4d93-95ca-dd5a1a1fb9cb service nova] Releasing lock "refresh_cache-c555f971-b177-4c26-a38e-09e0e78bf7b9" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:17:20 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:17:20 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:17:20 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:17:20 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:17:20 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:17:20 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:17:20 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:17:20 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:17:21 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:17:21 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:17:21 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:17:21 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:17:21 user nova-compute[73572]: DEBUG nova.compute.manager [req-954f5339-71e3-4663-8c3d-5b0bca07ea2e req-c24822c5-d9a0-4fc0-8a42-e879609d2db4 service nova] [instance: c555f971-b177-4c26-a38e-09e0e78bf7b9] Received event network-vif-plugged-4ffb7229-16fb-441b-a954-d91308071fb8 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:17:21 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-954f5339-71e3-4663-8c3d-5b0bca07ea2e req-c24822c5-d9a0-4fc0-8a42-e879609d2db4 service nova] Acquiring lock "c555f971-b177-4c26-a38e-09e0e78bf7b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:17:21 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-954f5339-71e3-4663-8c3d-5b0bca07ea2e req-c24822c5-d9a0-4fc0-8a42-e879609d2db4 service nova] Lock "c555f971-b177-4c26-a38e-09e0e78bf7b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:17:21 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-954f5339-71e3-4663-8c3d-5b0bca07ea2e req-c24822c5-d9a0-4fc0-8a42-e879609d2db4 service nova] Lock "c555f971-b177-4c26-a38e-09e0e78bf7b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:17:21 user nova-compute[73572]: DEBUG nova.compute.manager [req-954f5339-71e3-4663-8c3d-5b0bca07ea2e req-c24822c5-d9a0-4fc0-8a42-e879609d2db4 service nova] [instance: c555f971-b177-4c26-a38e-09e0e78bf7b9] No waiting events found dispatching network-vif-plugged-4ffb7229-16fb-441b-a954-d91308071fb8 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:17:21 user nova-compute[73572]: WARNING nova.compute.manager [req-954f5339-71e3-4663-8c3d-5b0bca07ea2e req-c24822c5-d9a0-4fc0-8a42-e879609d2db4 service nova] [instance: c555f971-b177-4c26-a38e-09e0e78bf7b9] Received unexpected event network-vif-plugged-4ffb7229-16fb-441b-a954-d91308071fb8 for instance with vm_state rescued and task_state unrescuing.
Aug 26 10:17:21 user nova-compute[73572]: DEBUG nova.compute.manager [req-954f5339-71e3-4663-8c3d-5b0bca07ea2e req-c24822c5-d9a0-4fc0-8a42-e879609d2db4 service nova] [instance: c555f971-b177-4c26-a38e-09e0e78bf7b9] Received event network-vif-plugged-4ffb7229-16fb-441b-a954-d91308071fb8 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:17:21 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-954f5339-71e3-4663-8c3d-5b0bca07ea2e req-c24822c5-d9a0-4fc0-8a42-e879609d2db4 service nova] Acquiring lock "c555f971-b177-4c26-a38e-09e0e78bf7b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:17:21 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-954f5339-71e3-4663-8c3d-5b0bca07ea2e req-c24822c5-d9a0-4fc0-8a42-e879609d2db4 service nova] Lock "c555f971-b177-4c26-a38e-09e0e78bf7b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:17:21 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-954f5339-71e3-4663-8c3d-5b0bca07ea2e req-c24822c5-d9a0-4fc0-8a42-e879609d2db4 service nova] Lock "c555f971-b177-4c26-a38e-09e0e78bf7b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:17:21 user nova-compute[73572]: DEBUG nova.compute.manager [req-954f5339-71e3-4663-8c3d-5b0bca07ea2e req-c24822c5-d9a0-4fc0-8a42-e879609d2db4 service nova] [instance: c555f971-b177-4c26-a38e-09e0e78bf7b9] No waiting events found dispatching network-vif-plugged-4ffb7229-16fb-441b-a954-d91308071fb8 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:17:21 user nova-compute[73572]: WARNING nova.compute.manager [req-954f5339-71e3-4663-8c3d-5b0bca07ea2e req-c24822c5-d9a0-4fc0-8a42-e879609d2db4 service nova] [instance: c555f971-b177-4c26-a38e-09e0e78bf7b9] Received unexpected event network-vif-plugged-4ffb7229-16fb-441b-a954-d91308071fb8 for instance with vm_state rescued and task_state unrescuing.
Aug 26 10:17:21 user nova-compute[73572]: DEBUG nova.compute.manager [req-954f5339-71e3-4663-8c3d-5b0bca07ea2e req-c24822c5-d9a0-4fc0-8a42-e879609d2db4 service nova] [instance: c555f971-b177-4c26-a38e-09e0e78bf7b9] Received event network-vif-plugged-4ffb7229-16fb-441b-a954-d91308071fb8 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:17:21 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-954f5339-71e3-4663-8c3d-5b0bca07ea2e req-c24822c5-d9a0-4fc0-8a42-e879609d2db4 service nova] Acquiring lock "c555f971-b177-4c26-a38e-09e0e78bf7b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:17:21 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-954f5339-71e3-4663-8c3d-5b0bca07ea2e req-c24822c5-d9a0-4fc0-8a42-e879609d2db4 service nova] Lock "c555f971-b177-4c26-a38e-09e0e78bf7b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:17:21 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-954f5339-71e3-4663-8c3d-5b0bca07ea2e req-c24822c5-d9a0-4fc0-8a42-e879609d2db4 service nova] Lock "c555f971-b177-4c26-a38e-09e0e78bf7b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:17:21 user nova-compute[73572]: DEBUG nova.compute.manager [req-954f5339-71e3-4663-8c3d-5b0bca07ea2e req-c24822c5-d9a0-4fc0-8a42-e879609d2db4 service nova] [instance: c555f971-b177-4c26-a38e-09e0e78bf7b9] No waiting events found dispatching network-vif-plugged-4ffb7229-16fb-441b-a954-d91308071fb8 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:17:21 user nova-compute[73572]: WARNING nova.compute.manager [req-954f5339-71e3-4663-8c3d-5b0bca07ea2e req-c24822c5-d9a0-4fc0-8a42-e879609d2db4 service nova] [instance: c555f971-b177-4c26-a38e-09e0e78bf7b9] Received unexpected event network-vif-plugged-4ffb7229-16fb-441b-a954-d91308071fb8 for instance with vm_state rescued and task_state unrescuing.
Aug 26 10:17:21 user nova-compute[73572]: DEBUG nova.compute.manager [req-954f5339-71e3-4663-8c3d-5b0bca07ea2e req-c24822c5-d9a0-4fc0-8a42-e879609d2db4 service nova] [instance: c555f971-b177-4c26-a38e-09e0e78bf7b9] Received event network-vif-unplugged-4ffb7229-16fb-441b-a954-d91308071fb8 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:17:21 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-954f5339-71e3-4663-8c3d-5b0bca07ea2e req-c24822c5-d9a0-4fc0-8a42-e879609d2db4 service nova] Acquiring lock "c555f971-b177-4c26-a38e-09e0e78bf7b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:17:21 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-954f5339-71e3-4663-8c3d-5b0bca07ea2e req-c24822c5-d9a0-4fc0-8a42-e879609d2db4 service nova] Lock "c555f971-b177-4c26-a38e-09e0e78bf7b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:17:21 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-954f5339-71e3-4663-8c3d-5b0bca07ea2e req-c24822c5-d9a0-4fc0-8a42-e879609d2db4 service nova] Lock "c555f971-b177-4c26-a38e-09e0e78bf7b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:17:21 user nova-compute[73572]: DEBUG nova.compute.manager [req-954f5339-71e3-4663-8c3d-5b0bca07ea2e req-c24822c5-d9a0-4fc0-8a42-e879609d2db4 service nova] [instance: c555f971-b177-4c26-a38e-09e0e78bf7b9] No waiting events found dispatching network-vif-unplugged-4ffb7229-16fb-441b-a954-d91308071fb8 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:17:21 user nova-compute[73572]: WARNING nova.compute.manager [req-954f5339-71e3-4663-8c3d-5b0bca07ea2e req-c24822c5-d9a0-4fc0-8a42-e879609d2db4 service nova] [instance: c555f971-b177-4c26-a38e-09e0e78bf7b9] Received unexpected event network-vif-unplugged-4ffb7229-16fb-441b-a954-d91308071fb8 for instance with vm_state rescued and task_state unrescuing.
Aug 26 10:17:21 user nova-compute[73572]: DEBUG nova.compute.manager [req-954f5339-71e3-4663-8c3d-5b0bca07ea2e req-c24822c5-d9a0-4fc0-8a42-e879609d2db4 service nova] [instance: c555f971-b177-4c26-a38e-09e0e78bf7b9] Received event network-vif-plugged-4ffb7229-16fb-441b-a954-d91308071fb8 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:17:21 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-954f5339-71e3-4663-8c3d-5b0bca07ea2e req-c24822c5-d9a0-4fc0-8a42-e879609d2db4 service nova] Acquiring lock "c555f971-b177-4c26-a38e-09e0e78bf7b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:17:21 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-954f5339-71e3-4663-8c3d-5b0bca07ea2e req-c24822c5-d9a0-4fc0-8a42-e879609d2db4 service nova] Lock "c555f971-b177-4c26-a38e-09e0e78bf7b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:17:21 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-954f5339-71e3-4663-8c3d-5b0bca07ea2e req-c24822c5-d9a0-4fc0-8a42-e879609d2db4 service nova] Lock "c555f971-b177-4c26-a38e-09e0e78bf7b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:17:21 user nova-compute[73572]: DEBUG nova.compute.manager [req-954f5339-71e3-4663-8c3d-5b0bca07ea2e req-c24822c5-d9a0-4fc0-8a42-e879609d2db4 service nova] [instance: c555f971-b177-4c26-a38e-09e0e78bf7b9] No waiting events found dispatching network-vif-plugged-4ffb7229-16fb-441b-a954-d91308071fb8 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:17:21 user nova-compute[73572]: WARNING nova.compute.manager [req-954f5339-71e3-4663-8c3d-5b0bca07ea2e req-c24822c5-d9a0-4fc0-8a42-e879609d2db4 service nova] [instance: c555f971-b177-4c26-a38e-09e0e78bf7b9] Received unexpected event network-vif-plugged-4ffb7229-16fb-441b-a954-d91308071fb8 for instance with vm_state rescued and task_state unrescuing.
Aug 26 10:17:21 user nova-compute[73572]: DEBUG nova.compute.manager [req-8ac0e162-76f3-4e69-898c-4803c4f2ac03 req-a62a686e-12b1-483b-8e1a-c4dadaa8ca95 service nova] [instance: c555f971-b177-4c26-a38e-09e0e78bf7b9] Received event network-changed-4ffb7229-16fb-441b-a954-d91308071fb8 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:17:21 user nova-compute[73572]: DEBUG nova.compute.manager [req-8ac0e162-76f3-4e69-898c-4803c4f2ac03 req-a62a686e-12b1-483b-8e1a-c4dadaa8ca95 service nova] [instance: c555f971-b177-4c26-a38e-09e0e78bf7b9] Refreshing instance network info cache due to event network-changed-4ffb7229-16fb-441b-a954-d91308071fb8. {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 10:17:21 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-8ac0e162-76f3-4e69-898c-4803c4f2ac03 req-a62a686e-12b1-483b-8e1a-c4dadaa8ca95 service nova] Acquiring lock "refresh_cache-c555f971-b177-4c26-a38e-09e0e78bf7b9" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:17:21 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-8ac0e162-76f3-4e69-898c-4803c4f2ac03 req-a62a686e-12b1-483b-8e1a-c4dadaa8ca95 service nova] Acquired lock "refresh_cache-c555f971-b177-4c26-a38e-09e0e78bf7b9" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:17:21 user nova-compute[73572]: DEBUG nova.network.neutron [req-8ac0e162-76f3-4e69-898c-4803c4f2ac03 req-a62a686e-12b1-483b-8e1a-c4dadaa8ca95 service nova] [instance: c555f971-b177-4c26-a38e-09e0e78bf7b9] Refreshing network info cache for port 4ffb7229-16fb-441b-a954-d91308071fb8 {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 10:17:21 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b837eafb-db4e-4696-9b9f-bcfa1a30192a/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:17:21 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:17:21 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:17:22 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b837eafb-db4e-4696-9b9f-bcfa1a30192a/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:17:22 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b837eafb-db4e-4696-9b9f-bcfa1a30192a/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:17:22 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b837eafb-db4e-4696-9b9f-bcfa1a30192a/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:17:22 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8302d6e7-aaf3-461c-a55e-f2e685d1800d/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:17:22 user nova-compute[73572]: DEBUG nova.network.neutron [req-8ac0e162-76f3-4e69-898c-4803c4f2ac03 req-a62a686e-12b1-483b-8e1a-c4dadaa8ca95 service nova] [instance: c555f971-b177-4c26-a38e-09e0e78bf7b9] Updated VIF entry in instance network info cache for port 4ffb7229-16fb-441b-a954-d91308071fb8. {{(pid=73572) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 10:17:22 user nova-compute[73572]: DEBUG nova.network.neutron [req-8ac0e162-76f3-4e69-898c-4803c4f2ac03 req-a62a686e-12b1-483b-8e1a-c4dadaa8ca95 service nova] [instance: c555f971-b177-4c26-a38e-09e0e78bf7b9] Updating instance_info_cache with network_info: [{"id": "4ffb7229-16fb-441b-a954-d91308071fb8", "address": "fa:16:3e:26:32:ef", "network": {"id": "e052e34f-ce84-4612-b48b-2ed8474e7177", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-332746918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4556d14c0dd416fbe13ab2274947dec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ffb7229-16", "ovs_interfaceid": "4ffb7229-16fb-441b-a954-d91308071fb8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:17:22 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8302d6e7-aaf3-461c-a55e-f2e685d1800d/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:17:22 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8302d6e7-aaf3-461c-a55e-f2e685d1800d/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:17:22 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-8ac0e162-76f3-4e69-898c-4803c4f2ac03 req-a62a686e-12b1-483b-8e1a-c4dadaa8ca95 service nova] Releasing lock "refresh_cache-c555f971-b177-4c26-a38e-09e0e78bf7b9" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:17:22 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8302d6e7-aaf3-461c-a55e-f2e685d1800d/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:17:22 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c785b609-0068-442f-91f5-d26e888a993f/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:17:22 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cfa6d5b7-e49f-4fe6-bcb9-49ef9346245c tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] [instance: 00c47a06-2bf8-427d-bcb1-304688584511] Calling os-brick to attach iSCSI Volume {{(pid=73572) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 10:17:22 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfa6d5b7-e49f-4fe6-bcb9-49ef9346245c tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc89c3d6a10>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bpfqgBQW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 10:17:22 user nova-compute[73572]: WARNING os_brick.initiator.connectors.base [None req-cfa6d5b7-e49f-4fe6-bcb9-49ef9346245c tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 10:17:22 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-cfa6d5b7-e49f-4fe6-bcb9-49ef9346245c tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 10:17:22 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-cfa6d5b7-e49f-4fe6-bcb9-49ef9346245c tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 10:17:22 user nova-compute[73572]: WARNING os_brick.initiator.connectors.base [None req-cfa6d5b7-e49f-4fe6-bcb9-49ef9346245c tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 10:17:22 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-cfa6d5b7-e49f-4fe6-bcb9-49ef9346245c tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 10:17:22 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-cfa6d5b7-e49f-4fe6-bcb9-49ef9346245c tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 10:17:22 user nova-compute[73572]: INFO os_brick.initiator.connectors.iscsi [None req-cfa6d5b7-e49f-4fe6-bcb9-49ef9346245c tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 10:17:22 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478 -p 172.16.0.220:3260 {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:17:22 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:17:22 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[42990fdd-7824-485e-8843-f01a23a4fc0c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:17:22 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfa6d5b7-e49f-4fe6-bcb9-49ef9346245c tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 10:17:22 user nova-compute[73572]:  {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:17:22 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478 -p 172.16.0.220:3260 --interface default --op new {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:17:22 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:17:22 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e57ac2e-8bb8-4077-a5ed-52b9ac53b76e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478] added\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:17:22 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfa6d5b7-e49f-4fe6-bcb9-49ef9346245c tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478] added
Aug 26 10:17:22 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:17:22 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:17:22 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:17:22 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[872aab59-f2c1-40c6-946b-5212a628ff85]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:17:22 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfa6d5b7-e49f-4fe6-bcb9-49ef9346245c tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:17:22 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:17:22 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c785b609-0068-442f-91f5-d26e888a993f/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:17:22 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c785b609-0068-442f-91f5-d26e888a993f/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:17:23 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:17:23 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[08ac11b7-18e3-4304-8ccf-9ffa8c4f42fc]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:17:23 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfa6d5b7-e49f-4fe6-bcb9-49ef9346245c tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:17:23 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bpfqgBQW {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:17:23 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bpfqgBQW" returned: 0 in 0.025s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:17:23 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[3968b666-0427-49ed-a830-e92cd907b95a]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:17:23 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfa6d5b7-e49f-4fe6-bcb9-49ef9346245c tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bpfqgBQW'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:17:23 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:17:23 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:17:23 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9aa9a0f-91cc-4935-8828-0512ca8f8bef]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:17:23 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfa6d5b7-e49f-4fe6-bcb9-49ef9346245c tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:17:23 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:17:23 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:17:23 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bbdff6b-dc64-45bf-87f0-584f4a8fe370]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac5c1ee2-3656-49b3-942f-5fc992dc001b (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:17:23 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfa6d5b7-e49f-4fe6-bcb9-49ef9346245c tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac5c1ee2-3656-49b3-942f-5fc992dc001b (non-flash)
Aug 26 10:17:23 user nova-compute[73572]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)
Aug 26 10:17:23 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 10:17:23 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfa6d5b7-e49f-4fe6-bcb9-49ef9346245c tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac5c1ee2-3656-49b3-942f-5fc992dc001b (non-flash)
Aug 26 10:17:23 user nova-compute[73572]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)
Aug 26 10:17:23 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 10:17:23 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478 -p 172.16.0.220:3260 --login {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:17:23 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:17:23 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[e056d4ab-3e38-465e-b466-1b44ec95851d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:17:23 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfa6d5b7-e49f-4fe6-bcb9-49ef9346245c tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478, portal: 172.16.0.220,3260]
Aug 26 10:17:23 user nova-compute[73572]: Login to [iface: default, target: iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478, portal: 172.16.0.220,3260] successful.
Aug 26 10:17:23 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:17:23 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:17:23 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c785b609-0068-442f-91f5-d26e888a993f/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:17:23 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dceaa35-4a13-453b-961f-831f66c35af0/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:17:23 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:17:23 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdc589b4-d52c-40f6-9511-4ef7624c0025]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:17:23 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfa6d5b7-e49f-4fe6-bcb9-49ef9346245c tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:17:23 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:17:23 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:17:23 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[044d8b92-010b-4cb8-acb2-e506a8c1b7ab]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac5c1ee2-3656-49b3-942f-5fc992dc001b (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478 (non-flash)\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:17:23 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfa6d5b7-e49f-4fe6-bcb9-49ef9346245c tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac5c1ee2-3656-49b3-942f-5fc992dc001b (non-flash)
Aug 26 10:17:23 user nova-compute[73572]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)
Aug 26 10:17:23 user nova-compute[73572]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478 (non-flash)
Aug 26 10:17:23 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 10:17:23 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfa6d5b7-e49f-4fe6-bcb9-49ef9346245c tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac5c1ee2-3656-49b3-942f-5fc992dc001b (non-flash)
Aug 26 10:17:23 user nova-compute[73572]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)
Aug 26 10:17:23 user nova-compute[73572]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478 (non-flash)
Aug 26 10:17:23 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 10:17:23 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-cfa6d5b7-e49f-4fe6-bcb9-49ef9346245c tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.405s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 10:17:23 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfa6d5b7-e49f-4fe6-bcb9-49ef9346245c tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Connected to 172.16.0.220:3260 {{(pid=73572) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 10:17:23 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-cfa6d5b7-e49f-4fe6-bcb9-49ef9346245c tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] HCTL ('33', '-', '-', 0) found on session 14 with lun 0 {{(pid=73572) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 10:17:23 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-cfa6d5b7-e49f-4fe6-bcb9-49ef9346245c tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73572) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 10:17:23 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:17:23 user nova-compute[73572]: DEBUG nova.compute.manager [req-80c27969-1f47-4d12-9c62-2fdf6aa95e49 req-e3626e8c-e9d6-41f1-8b42-f8d1b727954e service nova] [instance: c555f971-b177-4c26-a38e-09e0e78bf7b9] Received event network-vif-plugged-4ffb7229-16fb-441b-a954-d91308071fb8 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:17:23 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-80c27969-1f47-4d12-9c62-2fdf6aa95e49 req-e3626e8c-e9d6-41f1-8b42-f8d1b727954e service nova] Acquiring lock "c555f971-b177-4c26-a38e-09e0e78bf7b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:17:23 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-80c27969-1f47-4d12-9c62-2fdf6aa95e49 req-e3626e8c-e9d6-41f1-8b42-f8d1b727954e service nova] Lock "c555f971-b177-4c26-a38e-09e0e78bf7b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:17:23 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-80c27969-1f47-4d12-9c62-2fdf6aa95e49 req-e3626e8c-e9d6-41f1-8b42-f8d1b727954e service nova] Lock "c555f971-b177-4c26-a38e-09e0e78bf7b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:17:23 user nova-compute[73572]: DEBUG nova.compute.manager [req-80c27969-1f47-4d12-9c62-2fdf6aa95e49 req-e3626e8c-e9d6-41f1-8b42-f8d1b727954e service nova] [instance: c555f971-b177-4c26-a38e-09e0e78bf7b9] No waiting events found dispatching network-vif-plugged-4ffb7229-16fb-441b-a954-d91308071fb8 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:17:23 user nova-compute[73572]: WARNING nova.compute.manager [req-80c27969-1f47-4d12-9c62-2fdf6aa95e49 req-e3626e8c-e9d6-41f1-8b42-f8d1b727954e service nova] [instance: c555f971-b177-4c26-a38e-09e0e78bf7b9] Received unexpected event network-vif-plugged-4ffb7229-16fb-441b-a954-d91308071fb8 for instance with vm_state rescued and task_state unrescuing.
Aug 26 10:17:23 user nova-compute[73572]: DEBUG nova.compute.manager [req-80c27969-1f47-4d12-9c62-2fdf6aa95e49 req-e3626e8c-e9d6-41f1-8b42-f8d1b727954e service nova] [instance: c555f971-b177-4c26-a38e-09e0e78bf7b9] Received event network-vif-plugged-4ffb7229-16fb-441b-a954-d91308071fb8 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:17:23 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-80c27969-1f47-4d12-9c62-2fdf6aa95e49 req-e3626e8c-e9d6-41f1-8b42-f8d1b727954e service nova] Acquiring lock "c555f971-b177-4c26-a38e-09e0e78bf7b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:17:23 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-80c27969-1f47-4d12-9c62-2fdf6aa95e49 req-e3626e8c-e9d6-41f1-8b42-f8d1b727954e service nova] Lock "c555f971-b177-4c26-a38e-09e0e78bf7b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:17:23 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-80c27969-1f47-4d12-9c62-2fdf6aa95e49 req-e3626e8c-e9d6-41f1-8b42-f8d1b727954e service nova] Lock "c555f971-b177-4c26-a38e-09e0e78bf7b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:17:23 user nova-compute[73572]: DEBUG nova.compute.manager [req-80c27969-1f47-4d12-9c62-2fdf6aa95e49 req-e3626e8c-e9d6-41f1-8b42-f8d1b727954e service nova] [instance: c555f971-b177-4c26-a38e-09e0e78bf7b9] No waiting events found dispatching network-vif-plugged-4ffb7229-16fb-441b-a954-d91308071fb8 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:17:23 user nova-compute[73572]: WARNING nova.compute.manager [req-80c27969-1f47-4d12-9c62-2fdf6aa95e49 req-e3626e8c-e9d6-41f1-8b42-f8d1b727954e service nova] [instance: c555f971-b177-4c26-a38e-09e0e78bf7b9] Received unexpected event network-vif-plugged-4ffb7229-16fb-441b-a954-d91308071fb8 for instance with vm_state rescued and task_state unrescuing.
Aug 26 10:17:23 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.030s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:17:23 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[61cd22a1-40d5-4ac3-8cdc-a2c5a587d29a]: (4, ('- - 0', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:17:23 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-cfa6d5b7-e49f-4fe6-bcb9-49ef9346245c tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Searching for a device in session 14 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73572) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 10:17:23 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfa6d5b7-e49f-4fe6-bcb9-49ef9346245c tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bpfqgBQW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73572) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 10:17:23 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dceaa35-4a13-453b-961f-831f66c35af0/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:17:23 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dceaa35-4a13-453b-961f-831f66c35af0/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:17:23 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dceaa35-4a13-453b-961f-831f66c35af0/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:17:23 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00c47a06-2bf8-427d-bcb1-304688584511/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:17:23 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Removed pending event for c555f971-b177-4c26-a38e-09e0e78bf7b9 due to event {{(pid=73572) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 26 10:17:23 user nova-compute[73572]: DEBUG nova.virt.driver [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Emitting event <LifecycleEvent: 1693045043.7055721, c555f971-b177-4c26-a38e-09e0e78bf7b9 => Resumed> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:17:23 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: c555f971-b177-4c26-a38e-09e0e78bf7b9] VM Resumed (Lifecycle Event)
Aug 26 10:17:23 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a894069-128e-4593-9121-7b1524044e32 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] [instance: c555f971-b177-4c26-a38e-09e0e78bf7b9] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:17:23 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: c555f971-b177-4c26-a38e-09e0e78bf7b9] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:17:23 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: c555f971-b177-4c26-a38e-09e0e78bf7b9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73572) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 10:17:23 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: c555f971-b177-4c26-a38e-09e0e78bf7b9] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 26 10:17:23 user nova-compute[73572]: DEBUG nova.virt.driver [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Emitting event <LifecycleEvent: 1693045043.7189105, c555f971-b177-4c26-a38e-09e0e78bf7b9 => Started> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:17:23 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: c555f971-b177-4c26-a38e-09e0e78bf7b9] VM Started (Lifecycle Event)
Aug 26 10:17:23 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: c555f971-b177-4c26-a38e-09e0e78bf7b9] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:17:23 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00c47a06-2bf8-427d-bcb1-304688584511/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:17:23 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00c47a06-2bf8-427d-bcb1-304688584511/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:17:23 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: c555f971-b177-4c26-a38e-09e0e78bf7b9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73572) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 10:17:24 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00c47a06-2bf8-427d-bcb1-304688584511/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:17:24 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee9bcbaa-25a6-4588-b757-2a2ae15b6cf8/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:17:24 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee9bcbaa-25a6-4588-b757-2a2ae15b6cf8/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:17:24 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee9bcbaa-25a6-4588-b757-2a2ae15b6cf8/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:17:24 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-cfa6d5b7-e49f-4fe6-bcb9-49ef9346245c tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.454s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 10:17:24 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfa6d5b7-e49f-4fe6-bcb9-49ef9346245c tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] <== connect_volume: return (1458ms) {'type': 'block', 'scsi_wwn': '23365316561383430', 'path': '/dev/sdb'} {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 10:17:24 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cfa6d5b7-e49f-4fe6-bcb9-49ef9346245c tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] [instance: 00c47a06-2bf8-427d-bcb1-304688584511] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23365316561383430', 'path': '/dev/sdb'} {{(pid=73572) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 10:17:24 user nova-compute[73572]: DEBUG nova.objects.instance [None req-cfa6d5b7-e49f-4fe6-bcb9-49ef9346245c tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Lazy-loading 'flavor' on Instance uuid 00c47a06-2bf8-427d-bcb1-304688584511 {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:17:24 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:17:24 user nova-compute[73572]: DEBUG nova.virt.libvirt.guest [None req-cfa6d5b7-e49f-4fe6-bcb9-49ef9346245c tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 10:17:24 user nova-compute[73572]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 10:17:24 user nova-compute[73572]:   <source dev="/dev/sdb"/>
Aug 26 10:17:24 user nova-compute[73572]:   <target dev="vdb" bus="virtio"/>
Aug 26 10:17:24 user nova-compute[73572]:   <serial>fceee937-cad2-4ce8-8a00-49b3ffab9478</serial>
Aug 26 10:17:24 user nova-compute[73572]: </disk>
Aug 26 10:17:24 user nova-compute[73572]:  {{(pid=73572) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 10:17:24 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee9bcbaa-25a6-4588-b757-2a2ae15b6cf8/disk --force-share --output=json" returned: 0 in 0.254s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:17:24 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=73572) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 10:17:24 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14fab12e-52be-4fe6-8777-bc7ebf3c25f1/disk.rescue --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:17:24 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14fab12e-52be-4fe6-8777-bc7ebf3c25f1/disk.rescue --force-share --output=json" returned: 0 in 0.201s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:17:24 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14fab12e-52be-4fe6-8777-bc7ebf3c25f1/disk.rescue --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:17:24 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-cfa6d5b7-e49f-4fe6-bcb9-49ef9346245c tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] No BDM found with device name vda, not building metadata. {{(pid=73572) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 10:17:24 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-cfa6d5b7-e49f-4fe6-bcb9-49ef9346245c tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73572) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 10:17:24 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-cfa6d5b7-e49f-4fe6-bcb9-49ef9346245c tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] No VIF found with MAC fa:16:3e:a2:f2:f4, not building metadata {{(pid=73572) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 10:17:24 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14fab12e-52be-4fe6-8777-bc7ebf3c25f1/disk.rescue --force-share --output=json" returned: 0 in 0.208s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:17:24 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c555f971-b177-4c26-a38e-09e0e78bf7b9/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:17:25 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-cfa6d5b7-e49f-4fe6-bcb9-49ef9346245c tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Lock "00c47a06-2bf8-427d-bcb1-304688584511" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 15.163s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:17:25 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c555f971-b177-4c26-a38e-09e0e78bf7b9/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:17:25 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c555f971-b177-4c26-a38e-09e0e78bf7b9/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:17:25 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:17:25 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c555f971-b177-4c26-a38e-09e0e78bf7b9/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:17:25 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=73572) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 10:17:25 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/682138af-ba6a-47f1-a9a5-03ae2661f54d/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:17:25 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-93b5a1e4-6023-4697-b4ec-aa7d7bba1611 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Acquiring lock "00c47a06-2bf8-427d-bcb1-304688584511" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:17:25 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-93b5a1e4-6023-4697-b4ec-aa7d7bba1611 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Lock "00c47a06-2bf8-427d-bcb1-304688584511" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.003s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:17:25 user nova-compute[73572]: DEBUG nova.compute.manager [None req-93b5a1e4-6023-4697-b4ec-aa7d7bba1611 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] [instance: 00c47a06-2bf8-427d-bcb1-304688584511] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:17:25 user nova-compute[73572]: DEBUG nova.compute.manager [None req-93b5a1e4-6023-4697-b4ec-aa7d7bba1611 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] [instance: 00c47a06-2bf8-427d-bcb1-304688584511] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=73572) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3342}}
Aug 26 10:17:25 user nova-compute[73572]: DEBUG nova.objects.instance [None req-93b5a1e4-6023-4697-b4ec-aa7d7bba1611 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Lazy-loading 'flavor' on Instance uuid 00c47a06-2bf8-427d-bcb1-304688584511 {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:17:25 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:17:25 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/682138af-ba6a-47f1-a9a5-03ae2661f54d/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:17:25 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/682138af-ba6a-47f1-a9a5-03ae2661f54d/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:17:25 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:17:25 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:17:25 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:17:25 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/682138af-ba6a-47f1-a9a5-03ae2661f54d/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:17:25 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2970584-8c2a-4f99-922c-d66d59489504/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:17:25 user nova-compute[73572]: DEBUG nova.compute.manager [req-a7380d81-e311-4108-990a-4983b16a93bd req-cebf179f-8cb2-4c4a-a586-b3138a088275 service nova] [instance: 00c47a06-2bf8-427d-bcb1-304688584511] Received event network-vif-unplugged-d18bfeb9-ad63-41d9-8d66-56df3d3306d8 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:17:25 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-a7380d81-e311-4108-990a-4983b16a93bd req-cebf179f-8cb2-4c4a-a586-b3138a088275 service nova] Acquiring lock "00c47a06-2bf8-427d-bcb1-304688584511-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:17:25 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-a7380d81-e311-4108-990a-4983b16a93bd req-cebf179f-8cb2-4c4a-a586-b3138a088275 service nova] Lock "00c47a06-2bf8-427d-bcb1-304688584511-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:17:25 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-a7380d81-e311-4108-990a-4983b16a93bd req-cebf179f-8cb2-4c4a-a586-b3138a088275 service nova] Lock "00c47a06-2bf8-427d-bcb1-304688584511-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:17:25 user nova-compute[73572]: DEBUG nova.compute.manager [req-a7380d81-e311-4108-990a-4983b16a93bd req-cebf179f-8cb2-4c4a-a586-b3138a088275 service nova] [instance: 00c47a06-2bf8-427d-bcb1-304688584511] No waiting events found dispatching network-vif-unplugged-d18bfeb9-ad63-41d9-8d66-56df3d3306d8 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:17:25 user nova-compute[73572]: WARNING nova.compute.manager [req-a7380d81-e311-4108-990a-4983b16a93bd req-cebf179f-8cb2-4c4a-a586-b3138a088275 service nova] [instance: 00c47a06-2bf8-427d-bcb1-304688584511] Received unexpected event network-vif-unplugged-d18bfeb9-ad63-41d9-8d66-56df3d3306d8 for instance with vm_state active and task_state powering-off.
Aug 26 10:17:26 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2970584-8c2a-4f99-922c-d66d59489504/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:17:26 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2970584-8c2a-4f99-922c-d66d59489504/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:17:26 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2970584-8c2a-4f99-922c-d66d59489504/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:17:26 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fe47a17-4ffb-48ce-b0f6-a9b43002bd55/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:17:26 user nova-compute[73572]: INFO nova.virt.libvirt.driver [-] [instance: 00c47a06-2bf8-427d-bcb1-304688584511] Instance destroyed successfully.
Aug 26 10:17:26 user nova-compute[73572]: DEBUG nova.compute.manager [None req-93b5a1e4-6023-4697-b4ec-aa7d7bba1611 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] [instance: 00c47a06-2bf8-427d-bcb1-304688584511] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:17:26 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-93b5a1e4-6023-4697-b4ec-aa7d7bba1611 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Lock "00c47a06-2bf8-427d-bcb1-304688584511" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 1.134s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:17:26 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fe47a17-4ffb-48ce-b0f6-a9b43002bd55/disk --force-share --output=json" returned: 0 in 0.256s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:17:26 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fe47a17-4ffb-48ce-b0f6-a9b43002bd55/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:17:26 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fe47a17-4ffb-48ce-b0f6-a9b43002bd55/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:17:27 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:17:27 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:17:27 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Hypervisor/Node resource view: name=user free_ram=7139MB free_disk=25.200042724609375GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=73572) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 10:17:27 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:17:27 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:17:27 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance c785b609-0068-442f-91f5-d26e888a993f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:17:27 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance 8302d6e7-aaf3-461c-a55e-f2e685d1800d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:17:27 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance c555f971-b177-4c26-a38e-09e0e78bf7b9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:17:27 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance ee9bcbaa-25a6-4588-b757-2a2ae15b6cf8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:17:27 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance 14fab12e-52be-4fe6-8777-bc7ebf3c25f1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:17:27 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance 00c47a06-2bf8-427d-bcb1-304688584511 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:17:27 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance d2970584-8c2a-4f99-922c-d66d59489504 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:17:27 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:17:27 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance b837eafb-db4e-4696-9b9f-bcfa1a30192a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:17:27 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance 682138af-ba6a-47f1-a9a5-03ae2661f54d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:17:27 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance 0dceaa35-4a13-453b-961f-831f66c35af0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:17:27 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=73572) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 10:17:27 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=73572) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 10:17:27 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Refreshing inventories for resource provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 {{(pid=73572) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 26 10:17:27 user nova-compute[73572]: DEBUG nova.compute.manager [req-53cf040d-2e8c-4282-809a-84b3bc931a42 req-2a7cedad-acfc-4495-a991-0bb429f4495d service nova] [instance: 00c47a06-2bf8-427d-bcb1-304688584511] Received event network-vif-plugged-d18bfeb9-ad63-41d9-8d66-56df3d3306d8 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:17:27 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-53cf040d-2e8c-4282-809a-84b3bc931a42 req-2a7cedad-acfc-4495-a991-0bb429f4495d service nova] Acquiring lock "00c47a06-2bf8-427d-bcb1-304688584511-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:17:27 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-53cf040d-2e8c-4282-809a-84b3bc931a42 req-2a7cedad-acfc-4495-a991-0bb429f4495d service nova] Lock "00c47a06-2bf8-427d-bcb1-304688584511-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:17:27 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-53cf040d-2e8c-4282-809a-84b3bc931a42 req-2a7cedad-acfc-4495-a991-0bb429f4495d service nova] Lock "00c47a06-2bf8-427d-bcb1-304688584511-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:17:27 user nova-compute[73572]: DEBUG nova.compute.manager [req-53cf040d-2e8c-4282-809a-84b3bc931a42 req-2a7cedad-acfc-4495-a991-0bb429f4495d service nova] [instance: 00c47a06-2bf8-427d-bcb1-304688584511] No waiting events found dispatching network-vif-plugged-d18bfeb9-ad63-41d9-8d66-56df3d3306d8 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:17:27 user nova-compute[73572]: WARNING nova.compute.manager [req-53cf040d-2e8c-4282-809a-84b3bc931a42 req-2a7cedad-acfc-4495-a991-0bb429f4495d service nova] [instance: 00c47a06-2bf8-427d-bcb1-304688584511] Received unexpected event network-vif-plugged-d18bfeb9-ad63-41d9-8d66-56df3d3306d8 for instance with vm_state stopped and task_state None.
Aug 26 10:17:27 user nova-compute[73572]: DEBUG nova.compute.manager [req-53cf040d-2e8c-4282-809a-84b3bc931a42 req-2a7cedad-acfc-4495-a991-0bb429f4495d service nova] [instance: 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55] Received event network-changed-ebf9f385-e59b-4060-9bf9-a8d2006327b4 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:17:27 user nova-compute[73572]: DEBUG nova.compute.manager [req-53cf040d-2e8c-4282-809a-84b3bc931a42 req-2a7cedad-acfc-4495-a991-0bb429f4495d service nova] [instance: 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55] Refreshing instance network info cache due to event network-changed-ebf9f385-e59b-4060-9bf9-a8d2006327b4. {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 10:17:27 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-53cf040d-2e8c-4282-809a-84b3bc931a42 req-2a7cedad-acfc-4495-a991-0bb429f4495d service nova] Acquiring lock "refresh_cache-0fe47a17-4ffb-48ce-b0f6-a9b43002bd55" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:17:27 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-53cf040d-2e8c-4282-809a-84b3bc931a42 req-2a7cedad-acfc-4495-a991-0bb429f4495d service nova] Acquired lock "refresh_cache-0fe47a17-4ffb-48ce-b0f6-a9b43002bd55" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:17:27 user nova-compute[73572]: DEBUG nova.network.neutron [req-53cf040d-2e8c-4282-809a-84b3bc931a42 req-2a7cedad-acfc-4495-a991-0bb429f4495d service nova] [instance: 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55] Refreshing network info cache for port ebf9f385-e59b-4060-9bf9-a8d2006327b4 {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 10:17:27 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Updating ProviderTree inventory for provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73572) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 26 10:17:27 user nova-compute[73572]: DEBUG nova.compute.provider_tree [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Updating inventory in ProviderTree for provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73572) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 26 10:17:28 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Refreshing aggregate associations for resource provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75, aggregates: None {{(pid=73572) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 26 10:17:28 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Refreshing trait associations for resource provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75, traits: COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSSE3,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE2,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NODE,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_NE2K_PCI {{(pid=73572) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 26 10:17:28 user nova-compute[73572]: DEBUG nova.compute.provider_tree [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Inventory has not changed in ProviderTree for provider: e2cec974-59b2-4c77-a53d-a7f4e5a30d75 {{(pid=73572) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 10:17:28 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Inventory has not changed for provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73572) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 10:17:28 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Compute_service record updated for user:user {{(pid=73572) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 10:17:28 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.046s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:17:28 user nova-compute[73572]: DEBUG nova.network.neutron [req-53cf040d-2e8c-4282-809a-84b3bc931a42 req-2a7cedad-acfc-4495-a991-0bb429f4495d service nova] [instance: 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55] Updated VIF entry in instance network info cache for port ebf9f385-e59b-4060-9bf9-a8d2006327b4. {{(pid=73572) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 10:17:28 user nova-compute[73572]: DEBUG nova.network.neutron [req-53cf040d-2e8c-4282-809a-84b3bc931a42 req-2a7cedad-acfc-4495-a991-0bb429f4495d service nova] [instance: 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55] Updating instance_info_cache with network_info: [{"id": "ebf9f385-e59b-4060-9bf9-a8d2006327b4", "address": "fa:16:3e:49:23:6a", "network": {"id": "7c89c22a-96d4-4e60-9c4c-b5a82a7eca55", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1976182948-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d2c922711fb445aa99ae4f30b802c12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebf9f385-e5", "ovs_interfaceid": "ebf9f385-e59b-4060-9bf9-a8d2006327b4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:17:28 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-53cf040d-2e8c-4282-809a-84b3bc931a42 req-2a7cedad-acfc-4495-a991-0bb429f4495d service nova] Releasing lock "refresh_cache-0fe47a17-4ffb-48ce-b0f6-a9b43002bd55" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:17:29 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:17:30 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:17:33 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-a43fc977-4f45-4f43-a35a-0b4564e891c4 tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] Acquiring lock "339517ef-c023-4f13-a8cc-d84f7176dfcd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:17:33 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-a43fc977-4f45-4f43-a35a-0b4564e891c4 tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] Lock "339517ef-c023-4f13-a8cc-d84f7176dfcd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:17:33 user nova-compute[73572]: DEBUG nova.compute.manager [None req-a43fc977-4f45-4f43-a35a-0b4564e891c4 tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] [instance: 339517ef-c023-4f13-a8cc-d84f7176dfcd] Starting instance... {{(pid=73572) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 10:17:33 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-a43fc977-4f45-4f43-a35a-0b4564e891c4 tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:17:33 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-a43fc977-4f45-4f43-a35a-0b4564e891c4 tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:17:33 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-a43fc977-4f45-4f43-a35a-0b4564e891c4 tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73572) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 10:17:33 user nova-compute[73572]: INFO nova.compute.claims [None req-a43fc977-4f45-4f43-a35a-0b4564e891c4 tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] [instance: 339517ef-c023-4f13-a8cc-d84f7176dfcd] Claim successful on node user
Aug 26 10:17:33 user nova-compute[73572]: DEBUG nova.compute.provider_tree [None req-a43fc977-4f45-4f43-a35a-0b4564e891c4 tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] Inventory has not changed in ProviderTree for provider: e2cec974-59b2-4c77-a53d-a7f4e5a30d75 {{(pid=73572) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 10:17:33 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-a43fc977-4f45-4f43-a35a-0b4564e891c4 tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] Inventory has not changed for provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73572) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 10:17:33 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-a43fc977-4f45-4f43-a35a-0b4564e891c4 tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.639s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:17:33 user nova-compute[73572]: DEBUG nova.compute.manager [None req-a43fc977-4f45-4f43-a35a-0b4564e891c4 tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] [instance: 339517ef-c023-4f13-a8cc-d84f7176dfcd] Start building networks asynchronously for instance. {{(pid=73572) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 10:17:33 user nova-compute[73572]: DEBUG nova.compute.manager [None req-a43fc977-4f45-4f43-a35a-0b4564e891c4 tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] [instance: 339517ef-c023-4f13-a8cc-d84f7176dfcd] Allocating IP information in the background. {{(pid=73572) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 10:17:33 user nova-compute[73572]: DEBUG nova.network.neutron [None req-a43fc977-4f45-4f43-a35a-0b4564e891c4 tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] [instance: 339517ef-c023-4f13-a8cc-d84f7176dfcd] allocate_for_instance() {{(pid=73572) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 10:17:33 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-a43fc977-4f45-4f43-a35a-0b4564e891c4 tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] [instance: 339517ef-c023-4f13-a8cc-d84f7176dfcd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 10:17:33 user nova-compute[73572]: DEBUG nova.compute.manager [None req-a43fc977-4f45-4f43-a35a-0b4564e891c4 tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] [instance: 339517ef-c023-4f13-a8cc-d84f7176dfcd] Start building block device mappings for instance. {{(pid=73572) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 10:17:33 user nova-compute[73572]: DEBUG nova.policy [None req-a43fc977-4f45-4f43-a35a-0b4564e891c4 tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4ab4c737924c4e8da6b35cdb4051c3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b5f7c995974418c972eb33e591fab75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73572) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 10:17:34 user nova-compute[73572]: INFO nova.virt.block_device [None req-a43fc977-4f45-4f43-a35a-0b4564e891c4 tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] [instance: 339517ef-c023-4f13-a8cc-d84f7176dfcd] Booting with volume d94556c8-9096-4e9a-9cfc-f9d17846ed06 at /dev/vda
Aug 26 10:17:34 user nova-compute[73572]: DEBUG os_brick.utils [None req-a43fc977-4f45-4f43-a35a-0b4564e891c4 tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 10:17:34 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:17:34 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:17:34 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[eae96199-904e-4678-884e-7170d98776bc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:de8a79ed912\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:17:34 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:17:34 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.025s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:17:34 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[e373eeb7-9c31-4b66-8c32-592e02e6c0a3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:17:34 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:17:34 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:17:34 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[7422095b-a4e8-44f5-a153-298073a28cc4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:17:34 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[cae841fb-1d41-4ad0-9a60-7daaea14bfee]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:17:34 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-a43fc977-4f45-4f43-a35a-0b4564e891c4 tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] Running cmd (subprocess): nvme version {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:17:34 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-a43fc977-4f45-4f43-a35a-0b4564e891c4 tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] 'nvme version' failed. Not Retrying. {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 10:17:34 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a43fc977-4f45-4f43-a35a-0b4564e891c4 tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] nvme not present on system {{(pid=73572) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 10:17:34 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:17:34 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 10:17:34 user nova-compute[73572]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 10:17:34 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f0c2604-6cbd-4516-ac09-18c61e39146b]: (4, '') {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:17:34 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.lightos [None req-a43fc977-4f45-4f43-a35a-0b4564e891c4 tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73572) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 10:17:34 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.lightos [None req-a43fc977-4f45-4f43-a35a-0b4564e891c4 tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73572) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 10:17:34 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.lightos [None req-a43fc977-4f45-4f43-a35a-0b4564e891c4 tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] LIGHTOS: no hostnqn found. {{(pid=73572) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 10:17:34 user nova-compute[73572]: DEBUG os_brick.utils [None req-a43fc977-4f45-4f43-a35a-0b4564e891c4 tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:de8a79ed912', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 10:17:34 user nova-compute[73572]: DEBUG nova.virt.block_device [None req-a43fc977-4f45-4f43-a35a-0b4564e891c4 tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] [instance: 339517ef-c023-4f13-a8cc-d84f7176dfcd] Updating existing volume attachment record: 888e4985-ee83-4b83-bfe4-aa9b0c7257b7 {{(pid=73572) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 10:17:34 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:17:34 user nova-compute[73572]: DEBUG nova.network.neutron [None req-a43fc977-4f45-4f43-a35a-0b4564e891c4 tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] [instance: 339517ef-c023-4f13-a8cc-d84f7176dfcd] Successfully created port: 0545369e-80c9-45cc-a9a2-330705df9241 {{(pid=73572) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 10:17:35 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:17:35 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f4fec9ca-dc2e-40dc-9ea2-9f7de17fe8d6 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] [instance: d2970584-8c2a-4f99-922c-d66d59489504] Calling os-brick to attach iSCSI Volume {{(pid=73572) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 10:17:35 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4fec9ca-dc2e-40dc-9ea2-9f7de17fe8d6 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc89c3d6a10>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:0f30de3c-8988-4fc4-84f0-04e8109ece16'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LxVqJHvj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 10:17:35 user nova-compute[73572]: WARNING os_brick.initiator.connectors.base [None req-f4fec9ca-dc2e-40dc-9ea2-9f7de17fe8d6 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 10:17:35 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-f4fec9ca-dc2e-40dc-9ea2-9f7de17fe8d6 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 10:17:35 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-f4fec9ca-dc2e-40dc-9ea2-9f7de17fe8d6 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 10:17:35 user nova-compute[73572]: WARNING os_brick.initiator.connectors.base [None req-f4fec9ca-dc2e-40dc-9ea2-9f7de17fe8d6 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 10:17:35 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-f4fec9ca-dc2e-40dc-9ea2-9f7de17fe8d6 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0f30de3c-8988-4fc4-84f0-04e8109ece16" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 10:17:35 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-f4fec9ca-dc2e-40dc-9ea2-9f7de17fe8d6 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0f30de3c-8988-4fc4-84f0-04e8109ece16" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 10:17:35 user nova-compute[73572]: INFO os_brick.initiator.connectors.iscsi [None req-f4fec9ca-dc2e-40dc-9ea2-9f7de17fe8d6 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 10:17:35 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f30de3c-8988-4fc4-84f0-04e8109ece16 -p 172.16.0.220:3260 {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:17:35 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f30de3c-8988-4fc4-84f0-04e8109ece16 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:17:35 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad4cd5cd-f92d-4a64-b0bc-ad6d2633307d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:17:35 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4fec9ca-dc2e-40dc-9ea2-9f7de17fe8d6 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 10:17:35 user nova-compute[73572]:  {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:17:35 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f30de3c-8988-4fc4-84f0-04e8109ece16 -p 172.16.0.220:3260 --interface default --op new {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:17:35 user nova-compute[73572]: DEBUG nova.network.neutron [None req-a43fc977-4f45-4f43-a35a-0b4564e891c4 tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] [instance: 339517ef-c023-4f13-a8cc-d84f7176dfcd] Successfully updated port: 0545369e-80c9-45cc-a9a2-330705df9241 {{(pid=73572) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 10:17:35 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-a43fc977-4f45-4f43-a35a-0b4564e891c4 tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] Acquiring lock "refresh_cache-339517ef-c023-4f13-a8cc-d84f7176dfcd" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:17:35 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-a43fc977-4f45-4f43-a35a-0b4564e891c4 tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] Acquired lock "refresh_cache-339517ef-c023-4f13-a8cc-d84f7176dfcd" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:17:35 user nova-compute[73572]: DEBUG nova.network.neutron [None req-a43fc977-4f45-4f43-a35a-0b4564e891c4 tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] [instance: 339517ef-c023-4f13-a8cc-d84f7176dfcd] Building network info cache for instance {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 10:17:35 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f30de3c-8988-4fc4-84f0-04e8109ece16 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:17:35 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a59cb85-4128-4b06-a747-364b2f47e918]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0f30de3c-8988-4fc4-84f0-04e8109ece16] added\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:17:35 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4fec9ca-dc2e-40dc-9ea2-9f7de17fe8d6 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0f30de3c-8988-4fc4-84f0-04e8109ece16] added
Aug 26 10:17:35 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:17:35 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f30de3c-8988-4fc4-84f0-04e8109ece16 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:17:35 user nova-compute[73572]: DEBUG nova.compute.manager [req-79b2e0fe-5d86-411b-b48e-4aeab91e7b3f req-3ef03750-261e-4312-948d-6aaf42a814b2 service nova] [instance: 339517ef-c023-4f13-a8cc-d84f7176dfcd] Received event network-changed-0545369e-80c9-45cc-a9a2-330705df9241 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:17:35 user nova-compute[73572]: DEBUG nova.compute.manager [req-79b2e0fe-5d86-411b-b48e-4aeab91e7b3f req-3ef03750-261e-4312-948d-6aaf42a814b2 service nova] [instance: 339517ef-c023-4f13-a8cc-d84f7176dfcd] Refreshing instance network info cache due to event network-changed-0545369e-80c9-45cc-a9a2-330705df9241. {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 10:17:35 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-79b2e0fe-5d86-411b-b48e-4aeab91e7b3f req-3ef03750-261e-4312-948d-6aaf42a814b2 service nova] Acquiring lock "refresh_cache-339517ef-c023-4f13-a8cc-d84f7176dfcd" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:17:35 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f30de3c-8988-4fc4-84f0-04e8109ece16 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:17:35 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e7c921b-25f1-4bb5-a7fe-4b2650d28767]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:17:35 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4fec9ca-dc2e-40dc-9ea2-9f7de17fe8d6 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:17:35 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f30de3c-8988-4fc4-84f0-04e8109ece16 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:17:35 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f30de3c-8988-4fc4-84f0-04e8109ece16 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:17:35 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[87e0381f-ab97-4cef-94d8-87ca479b511e]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:17:35 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4fec9ca-dc2e-40dc-9ea2-9f7de17fe8d6 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:17:35 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f30de3c-8988-4fc4-84f0-04e8109ece16 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LxVqJHvj {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:17:35 user nova-compute[73572]: DEBUG nova.network.neutron [None req-a43fc977-4f45-4f43-a35a-0b4564e891c4 tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] [instance: 339517ef-c023-4f13-a8cc-d84f7176dfcd] Instance cache missing network info. {{(pid=73572) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 10:17:35 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f30de3c-8988-4fc4-84f0-04e8109ece16 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LxVqJHvj" returned: 0 in 0.023s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:17:35 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[d871c803-c244-465c-8720-d2ef7874edee]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:17:35 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4fec9ca-dc2e-40dc-9ea2-9f7de17fe8d6 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LxVqJHvj'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:17:35 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f30de3c-8988-4fc4-84f0-04e8109ece16 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:17:35 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f30de3c-8988-4fc4-84f0-04e8109ece16 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:17:35 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffd764fb-a33e-42eb-b899-8a8970f9c3b4]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:17:35 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4fec9ca-dc2e-40dc-9ea2-9f7de17fe8d6 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:17:35 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:17:35 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:17:35 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[28dd800d-d55d-4baf-ae16-a6f5242f0349]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac5c1ee2-3656-49b3-942f-5fc992dc001b (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478 (non-flash)\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:17:35 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4fec9ca-dc2e-40dc-9ea2-9f7de17fe8d6 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac5c1ee2-3656-49b3-942f-5fc992dc001b (non-flash)
Aug 26 10:17:35 user nova-compute[73572]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)
Aug 26 10:17:35 user nova-compute[73572]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478 (non-flash)
Aug 26 10:17:35 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 10:17:35 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4fec9ca-dc2e-40dc-9ea2-9f7de17fe8d6 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac5c1ee2-3656-49b3-942f-5fc992dc001b (non-flash)
Aug 26 10:17:35 user nova-compute[73572]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)
Aug 26 10:17:35 user nova-compute[73572]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478 (non-flash)
Aug 26 10:17:35 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 10:17:35 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f30de3c-8988-4fc4-84f0-04e8109ece16 -p 172.16.0.220:3260 --login {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:17:35 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f30de3c-8988-4fc4-84f0-04e8109ece16 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:17:35 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d5bb234-902c-46a7-b2ca-dbf945a8f898]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0f30de3c-8988-4fc4-84f0-04e8109ece16, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0f30de3c-8988-4fc4-84f0-04e8109ece16, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:17:35 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4fec9ca-dc2e-40dc-9ea2-9f7de17fe8d6 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0f30de3c-8988-4fc4-84f0-04e8109ece16, portal: 172.16.0.220,3260]
Aug 26 10:17:35 user nova-compute[73572]: Login to [iface: default, target: iqn.2010-10.org.openstack:0f30de3c-8988-4fc4-84f0-04e8109ece16, portal: 172.16.0.220,3260] successful.
Aug 26 10:17:35 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:17:35 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f30de3c-8988-4fc4-84f0-04e8109ece16 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:17:35 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f30de3c-8988-4fc4-84f0-04e8109ece16 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:17:35 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2145620-404d-4919-9356-858aba54dd75]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:17:35 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4fec9ca-dc2e-40dc-9ea2-9f7de17fe8d6 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:17:35 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:17:35 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:17:35 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea0037e9-cd05-46ce-b61e-26773daa54cf]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac5c1ee2-3656-49b3-942f-5fc992dc001b (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f30de3c-8988-4fc4-84f0-04e8109ece16 (non-flash)\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:17:35 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4fec9ca-dc2e-40dc-9ea2-9f7de17fe8d6 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac5c1ee2-3656-49b3-942f-5fc992dc001b (non-flash)
Aug 26 10:17:35 user nova-compute[73572]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)
Aug 26 10:17:35 user nova-compute[73572]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478 (non-flash)
Aug 26 10:17:35 user nova-compute[73572]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f30de3c-8988-4fc4-84f0-04e8109ece16 (non-flash)
Aug 26 10:17:35 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 10:17:35 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4fec9ca-dc2e-40dc-9ea2-9f7de17fe8d6 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac5c1ee2-3656-49b3-942f-5fc992dc001b (non-flash)
Aug 26 10:17:35 user nova-compute[73572]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)
Aug 26 10:17:35 user nova-compute[73572]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478 (non-flash)
Aug 26 10:17:35 user nova-compute[73572]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f30de3c-8988-4fc4-84f0-04e8109ece16 (non-flash)
Aug 26 10:17:35 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 10:17:35 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-f4fec9ca-dc2e-40dc-9ea2-9f7de17fe8d6 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0f30de3c-8988-4fc4-84f0-04e8109ece16" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.316s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 10:17:35 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4fec9ca-dc2e-40dc-9ea2-9f7de17fe8d6 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Connected to 172.16.0.220:3260 {{(pid=73572) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 10:17:35 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-f4fec9ca-dc2e-40dc-9ea2-9f7de17fe8d6 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] HCTL ('34', '-', '-', 0) found on session 15 with lun 0 {{(pid=73572) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 10:17:35 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-f4fec9ca-dc2e-40dc-9ea2-9f7de17fe8d6 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73572) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 10:17:35 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:17:35 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:17:35 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c0579ba-4b6b-4f47-9d66-b5ce236c94b3]: (4, ('- - 0', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:17:35 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-f4fec9ca-dc2e-40dc-9ea2-9f7de17fe8d6 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Searching for a device in session 15 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73572) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 10:17:35 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4fec9ca-dc2e-40dc-9ea2-9f7de17fe8d6 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LxVqJHvj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73572) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 10:17:35 user nova-compute[73572]: DEBUG nova.network.neutron [None req-a43fc977-4f45-4f43-a35a-0b4564e891c4 tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] [instance: 339517ef-c023-4f13-a8cc-d84f7176dfcd] Updating instance_info_cache with network_info: [{"id": "0545369e-80c9-45cc-a9a2-330705df9241", "address": "fa:16:3e:ae:3c:b5", "network": {"id": "a9900fc6-80c0-41e3-ac1a-4fa11bda2d38", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1804146753-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b5f7c995974418c972eb33e591fab75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0545369e-80", "ovs_interfaceid": "0545369e-80c9-45cc-a9a2-330705df9241", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:17:35 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-a43fc977-4f45-4f43-a35a-0b4564e891c4 tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] Releasing lock "refresh_cache-339517ef-c023-4f13-a8cc-d84f7176dfcd" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:17:35 user nova-compute[73572]: DEBUG nova.compute.manager [None req-a43fc977-4f45-4f43-a35a-0b4564e891c4 tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] [instance: 339517ef-c023-4f13-a8cc-d84f7176dfcd] Instance network_info: |[{"id": "0545369e-80c9-45cc-a9a2-330705df9241", "address": "fa:16:3e:ae:3c:b5", "network": {"id": "a9900fc6-80c0-41e3-ac1a-4fa11bda2d38", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1804146753-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b5f7c995974418c972eb33e591fab75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0545369e-80", "ovs_interfaceid": "0545369e-80c9-45cc-a9a2-330705df9241", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73572) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 10:17:35 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-79b2e0fe-5d86-411b-b48e-4aeab91e7b3f req-3ef03750-261e-4312-948d-6aaf42a814b2 service nova] Acquired lock "refresh_cache-339517ef-c023-4f13-a8cc-d84f7176dfcd" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:17:35 user nova-compute[73572]: DEBUG nova.network.neutron [req-79b2e0fe-5d86-411b-b48e-4aeab91e7b3f req-3ef03750-261e-4312-948d-6aaf42a814b2 service nova] [instance: 339517ef-c023-4f13-a8cc-d84f7176dfcd] Refreshing network info cache for port 0545369e-80c9-45cc-a9a2-330705df9241 {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 10:17:36 user nova-compute[73572]: DEBUG nova.network.neutron [req-79b2e0fe-5d86-411b-b48e-4aeab91e7b3f req-3ef03750-261e-4312-948d-6aaf42a814b2 service nova] [instance: 339517ef-c023-4f13-a8cc-d84f7176dfcd] Updated VIF entry in instance network info cache for port 0545369e-80c9-45cc-a9a2-330705df9241. {{(pid=73572) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 10:17:36 user nova-compute[73572]: DEBUG nova.network.neutron [req-79b2e0fe-5d86-411b-b48e-4aeab91e7b3f req-3ef03750-261e-4312-948d-6aaf42a814b2 service nova] [instance: 339517ef-c023-4f13-a8cc-d84f7176dfcd] Updating instance_info_cache with network_info: [{"id": "0545369e-80c9-45cc-a9a2-330705df9241", "address": "fa:16:3e:ae:3c:b5", "network": {"id": "a9900fc6-80c0-41e3-ac1a-4fa11bda2d38", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1804146753-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b5f7c995974418c972eb33e591fab75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0545369e-80", "ovs_interfaceid": "0545369e-80c9-45cc-a9a2-330705df9241", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:17:36 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-79b2e0fe-5d86-411b-b48e-4aeab91e7b3f req-3ef03750-261e-4312-948d-6aaf42a814b2 service nova] Releasing lock "refresh_cache-339517ef-c023-4f13-a8cc-d84f7176dfcd" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:17:36 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-f4fec9ca-dc2e-40dc-9ea2-9f7de17fe8d6 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.357s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 10:17:36 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4fec9ca-dc2e-40dc-9ea2-9f7de17fe8d6 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] <== connect_volume: return (1360ms) {'type': 'block', 'scsi_wwn': '26532343231656664', 'path': '/dev/sdc'} {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 10:17:36 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f4fec9ca-dc2e-40dc-9ea2-9f7de17fe8d6 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] [instance: d2970584-8c2a-4f99-922c-d66d59489504] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26532343231656664', 'path': '/dev/sdc'} {{(pid=73572) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 10:17:36 user nova-compute[73572]: DEBUG nova.objects.instance [None req-f4fec9ca-dc2e-40dc-9ea2-9f7de17fe8d6 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Lazy-loading 'flavor' on Instance uuid d2970584-8c2a-4f99-922c-d66d59489504 {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:17:36 user nova-compute[73572]: DEBUG nova.virt.libvirt.guest [None req-f4fec9ca-dc2e-40dc-9ea2-9f7de17fe8d6 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 10:17:36 user nova-compute[73572]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 10:17:36 user nova-compute[73572]:   <source dev="/dev/sdc"/>
Aug 26 10:17:36 user nova-compute[73572]:   <target dev="vdb" bus="virtio"/>
Aug 26 10:17:36 user nova-compute[73572]:   <serial>0f30de3c-8988-4fc4-84f0-04e8109ece16</serial>
Aug 26 10:17:36 user nova-compute[73572]: </disk>
Aug 26 10:17:36 user nova-compute[73572]:  {{(pid=73572) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 10:17:36 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] Acquiring lock "41c1ef7a-4f98-4cbb-9948-acb96bd9d557" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:17:36 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] Lock "41c1ef7a-4f98-4cbb-9948-acb96bd9d557" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:17:36 user nova-compute[73572]: DEBUG nova.compute.manager [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] Starting instance... {{(pid=73572) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 10:17:37 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:17:37 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:17:37 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73572) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 10:17:37 user nova-compute[73572]: INFO nova.compute.claims [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] Claim successful on node user
Aug 26 10:17:37 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-f4fec9ca-dc2e-40dc-9ea2-9f7de17fe8d6 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] No BDM found with device name vda, not building metadata. {{(pid=73572) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 10:17:37 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-f4fec9ca-dc2e-40dc-9ea2-9f7de17fe8d6 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73572) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 10:17:37 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-f4fec9ca-dc2e-40dc-9ea2-9f7de17fe8d6 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] No VIF found with MAC fa:16:3e:d6:92:13, not building metadata {{(pid=73572) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 10:17:37 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-f4fec9ca-dc2e-40dc-9ea2-9f7de17fe8d6 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Lock "d2970584-8c2a-4f99-922c-d66d59489504" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 20.813s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:17:37 user nova-compute[73572]: DEBUG nova.compute.provider_tree [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] Inventory has not changed in ProviderTree for provider: e2cec974-59b2-4c77-a53d-a7f4e5a30d75 {{(pid=73572) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 10:17:37 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] Inventory has not changed for provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73572) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 10:17:37 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.591s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:17:37 user nova-compute[73572]: DEBUG nova.compute.manager [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] Start building networks asynchronously for instance. {{(pid=73572) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 10:17:37 user nova-compute[73572]: DEBUG nova.compute.manager [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] Allocating IP information in the background. {{(pid=73572) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 10:17:37 user nova-compute[73572]: DEBUG nova.network.neutron [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] allocate_for_instance() {{(pid=73572) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 10:17:37 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 10:17:37 user nova-compute[73572]: DEBUG nova.compute.manager [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] Start building block device mappings for instance. {{(pid=73572) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 10:17:37 user nova-compute[73572]: INFO nova.virt.block_device [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] Booting with volume c22666f6-bb12-41a8-b565-837f4617df4e at /dev/vda
Aug 26 10:17:37 user nova-compute[73572]: DEBUG os_brick.utils [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 10:17:37 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:17:37 user nova-compute[73572]: DEBUG nova.policy [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '25fdd7b9201b4f6eaf5eb6d55bb09ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf2ae4dd7d3474394090e3276c957ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73572) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 10:17:37 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:17:37 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[3374cc33-d910-449a-8ad4-99f05092dd2b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:de8a79ed912\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:17:37 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:17:37 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:17:37 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[37e0144f-3139-45c4-8de9-43f06be97c6b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:17:37 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:17:37 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:17:37 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[ded27d63-2c77-47cf-a81f-0c527ffeffa3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:17:37 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e0882d8-a3ee-4b58-b4d7-d8279a948202]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:17:37 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] Running cmd (subprocess): nvme version {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:17:38 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] 'nvme version' failed. Not Retrying. {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 10:17:38 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] nvme not present on system {{(pid=73572) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 10:17:38 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:17:38 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 10:17:38 user nova-compute[73572]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 10:17:38 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ddc0921-083b-453d-9154-eab7aed04202]: (4, '') {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:17:38 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.lightos [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73572) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 10:17:38 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.lightos [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73572) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 10:17:38 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.lightos [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] LIGHTOS: no hostnqn found. {{(pid=73572) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 10:17:38 user nova-compute[73572]: DEBUG os_brick.utils [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:de8a79ed912', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 10:17:38 user nova-compute[73572]: DEBUG nova.virt.block_device [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] Updating existing volume attachment record: 49029723-0912-4186-a0fd-b0839b9fa74f {{(pid=73572) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 10:17:38 user nova-compute[73572]: DEBUG nova.network.neutron [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] Successfully created port: 123d944e-47d4-4f95-94bc-73e1920ecbc1 {{(pid=73572) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 10:17:39 user nova-compute[73572]: DEBUG nova.network.neutron [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] Successfully created port: f264d951-8920-4151-8276-33baa6a9def9 {{(pid=73572) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 10:17:39 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:17:39 user nova-compute[73572]: DEBUG nova.network.neutron [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] Successfully created port: c0c6f2bc-3209-461a-bcc3-edf740139ca2 {{(pid=73572) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 10:17:39 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-6f51f362-91c7-49bc-94ae-7c9caec0ce7a tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Acquiring lock "d2970584-8c2a-4f99-922c-d66d59489504" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:17:39 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-6f51f362-91c7-49bc-94ae-7c9caec0ce7a tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Lock "d2970584-8c2a-4f99-922c-d66d59489504" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:17:39 user nova-compute[73572]: INFO nova.compute.manager [None req-6f51f362-91c7-49bc-94ae-7c9caec0ce7a tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] [instance: d2970584-8c2a-4f99-922c-d66d59489504] Detaching volume 0f30de3c-8988-4fc4-84f0-04e8109ece16
Aug 26 10:17:39 user nova-compute[73572]: INFO nova.virt.block_device [None req-6f51f362-91c7-49bc-94ae-7c9caec0ce7a tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] [instance: d2970584-8c2a-4f99-922c-d66d59489504] Attempting to driver detach volume 0f30de3c-8988-4fc4-84f0-04e8109ece16 from mountpoint /dev/vdb
Aug 26 10:17:39 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-6f51f362-91c7-49bc-94ae-7c9caec0ce7a tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Attempting to detach device vdb from instance d2970584-8c2a-4f99-922c-d66d59489504 from the persistent domain config. {{(pid=73572) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 10:17:39 user nova-compute[73572]: DEBUG nova.virt.libvirt.guest [None req-6f51f362-91c7-49bc-94ae-7c9caec0ce7a tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 10:17:39 user nova-compute[73572]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 10:17:39 user nova-compute[73572]:   <source dev="/dev/sdc"/>
Aug 26 10:17:39 user nova-compute[73572]:   <target dev="vdb" bus="virtio"/>
Aug 26 10:17:39 user nova-compute[73572]:   <serial>0f30de3c-8988-4fc4-84f0-04e8109ece16</serial>
Aug 26 10:17:39 user nova-compute[73572]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 10:17:39 user nova-compute[73572]: </disk>
Aug 26 10:17:39 user nova-compute[73572]:  {{(pid=73572) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 10:17:39 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-6f51f362-91c7-49bc-94ae-7c9caec0ce7a tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Successfully detached device vdb from instance d2970584-8c2a-4f99-922c-d66d59489504 from the persistent domain config.
Aug 26 10:17:39 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-6f51f362-91c7-49bc-94ae-7c9caec0ce7a tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d2970584-8c2a-4f99-922c-d66d59489504 from the live domain config. {{(pid=73572) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 10:17:39 user nova-compute[73572]: DEBUG nova.virt.libvirt.guest [None req-6f51f362-91c7-49bc-94ae-7c9caec0ce7a tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 10:17:39 user nova-compute[73572]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 10:17:39 user nova-compute[73572]:   <source dev="/dev/sdc"/>
Aug 26 10:17:39 user nova-compute[73572]:   <target dev="vdb" bus="virtio"/>
Aug 26 10:17:39 user nova-compute[73572]:   <serial>0f30de3c-8988-4fc4-84f0-04e8109ece16</serial>
Aug 26 10:17:39 user nova-compute[73572]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 10:17:39 user nova-compute[73572]: </disk>
Aug 26 10:17:39 user nova-compute[73572]:  {{(pid=73572) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 10:17:40 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:17:40 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Received event <DeviceRemovedEvent: 1693045060.475013, d2970584-8c2a-4f99-922c-d66d59489504 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73572) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 10:17:40 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-6f51f362-91c7-49bc-94ae-7c9caec0ce7a tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d2970584-8c2a-4f99-922c-d66d59489504 {{(pid=73572) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 10:17:40 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-6f51f362-91c7-49bc-94ae-7c9caec0ce7a tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Successfully detached device vdb from instance d2970584-8c2a-4f99-922c-d66d59489504 from the live domain config.
Aug 26 10:17:40 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6f51f362-91c7-49bc-94ae-7c9caec0ce7a tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] [instance: d2970584-8c2a-4f99-922c-d66d59489504] calling os-brick to detach iSCSI Volume {{(pid=73572) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 10:17:40 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f51f362-91c7-49bc-94ae-7c9caec0ce7a tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc89c3d6a10>, {'target_iqns': ['iqn.2010-10.org.openstack:0f30de3c-8988-4fc4-84f0-04e8109ece16'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LxVqJHvj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 10:17:40 user nova-compute[73572]: WARNING os_brick.initiator.connectors.base [None req-6f51f362-91c7-49bc-94ae-7c9caec0ce7a tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 10:17:40 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-6f51f362-91c7-49bc-94ae-7c9caec0ce7a tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 10:17:40 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-6f51f362-91c7-49bc-94ae-7c9caec0ce7a tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 10:17:40 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f51f362-91c7-49bc-94ae-7c9caec0ce7a tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0f30de3c-8988-4fc4-84f0-04e8109ece16', 0)] {{(pid=73572) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 10:17:40 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:17:40 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:17:40 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[5815b5b3-c297-45ea-b4e1-3c09ff43e16b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0f30de3c-8988-4fc4-84f0-04e8109ece16\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ac5c1ee2-3656-49b3-942f-5fc992dc001b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:17:40 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:17:40 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:17:40 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[34344e2e-ff1e-4202-a8fe-6561bbe777d9]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac5c1ee2-3656-49b3-942f-5fc992dc001b (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f30de3c-8988-4fc4-84f0-04e8109ece16 (non-flash)\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:17:40 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f51f362-91c7-49bc-94ae-7c9caec0ce7a tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac5c1ee2-3656-49b3-942f-5fc992dc001b (non-flash)
Aug 26 10:17:40 user nova-compute[73572]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)
Aug 26 10:17:40 user nova-compute[73572]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478 (non-flash)
Aug 26 10:17:40 user nova-compute[73572]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f30de3c-8988-4fc4-84f0-04e8109ece16 (non-flash)
Aug 26 10:17:40 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 10:17:40 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f51f362-91c7-49bc-94ae-7c9caec0ce7a tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac5c1ee2-3656-49b3-942f-5fc992dc001b (non-flash)
Aug 26 10:17:40 user nova-compute[73572]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)
Aug 26 10:17:40 user nova-compute[73572]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478 (non-flash)
Aug 26 10:17:40 user nova-compute[73572]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f30de3c-8988-4fc4-84f0-04e8109ece16 (non-flash)
Aug 26 10:17:40 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 10:17:40 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f51f362-91c7-49bc-94ae-7c9caec0ce7a tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc878c26680>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0f30de3c-8988-4fc4-84f0-04e8109ece16'): ({'sdc'}, set())}) {{(pid=73572) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 10:17:40 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-6f51f362-91c7-49bc-94ae-7c9caec0ce7a tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Removing single pathed devices sdc {{(pid=73572) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 10:17:40 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:17:40 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:17:40 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa7ded4e-760d-411b-813a-31d1501d41c0]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:17:40 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:17:40 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.024s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:17:40 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[d366ff07-d785-41fd-9a6b-acee61049d15]: (4, ('ok\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:17:40 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-6f51f362-91c7-49bc-94ae-7c9caec0ce7a tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Flushing IO for device /dev/sdc {{(pid=73572) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 10:17:40 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:17:40 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:17:40 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbdb6ce7-52ce-49c2-91f1-ca8e2b7ff60b]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:17:40 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-6f51f362-91c7-49bc-94ae-7c9caec0ce7a tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73572) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 10:17:40 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:17:40 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.037s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:17:40 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[49b7b715-aa31-471c-92a0-fc972a076240]: (4, ('1', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:17:40 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-6f51f362-91c7-49bc-94ae-7c9caec0ce7a tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73572) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 10:17:40 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-6f51f362-91c7-49bc-94ae-7c9caec0ce7a tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] SCSI volumes sdc have been removed. {{(pid=73572) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 10:17:40 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f51f362-91c7-49bc-94ae-7c9caec0ce7a tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0f30de3c-8988-4fc4-84f0-04e8109ece16')] {{(pid=73572) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 10:17:40 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f30de3c-8988-4fc4-84f0-04e8109ece16 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:17:40 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f30de3c-8988-4fc4-84f0-04e8109ece16 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:17:40 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[db2ac6d9-d8fd-4960-a8e8-0534a5175530]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:17:40 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f51f362-91c7-49bc-94ae-7c9caec0ce7a tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:17:40 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f30de3c-8988-4fc4-84f0-04e8109ece16 -p 172.16.0.220:3260 --logout {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:17:40 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f30de3c-8988-4fc4-84f0-04e8109ece16 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:17:40 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[adce0b85-753d-4133-816f-1ad6d809e9d9]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:0f30de3c-8988-4fc4-84f0-04e8109ece16, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:0f30de3c-8988-4fc4-84f0-04e8109ece16, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:17:40 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f51f362-91c7-49bc-94ae-7c9caec0ce7a tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:0f30de3c-8988-4fc4-84f0-04e8109ece16, portal: 172.16.0.220,3260]
Aug 26 10:17:40 user nova-compute[73572]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:0f30de3c-8988-4fc4-84f0-04e8109ece16, portal: 172.16.0.220,3260] successful.
Aug 26 10:17:40 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:17:40 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f30de3c-8988-4fc4-84f0-04e8109ece16 -p 172.16.0.220:3260 --op delete {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:17:40 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f30de3c-8988-4fc4-84f0-04e8109ece16 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:17:40 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[708c31c6-e727-4f8e-bb2b-1f8f454dfb0f]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:17:40 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f51f362-91c7-49bc-94ae-7c9caec0ce7a tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:17:40 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-6f51f362-91c7-49bc-94ae-7c9caec0ce7a tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.291s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 10:17:40 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f51f362-91c7-49bc-94ae-7c9caec0ce7a tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] <== disconnect_volume: return (292ms) None {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 10:17:40 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6f51f362-91c7-49bc-94ae-7c9caec0ce7a tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] [instance: d2970584-8c2a-4f99-922c-d66d59489504] Disconnected iSCSI Volume {{(pid=73572) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 10:17:41 user nova-compute[73572]: DEBUG nova.network.neutron [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] Successfully created port: 2fe25c93-5639-47a6-80de-8cc83615e3c4 {{(pid=73572) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 10:17:41 user nova-compute[73572]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693045046.398682, 00c47a06-2bf8-427d-bcb1-304688584511 => Stopped> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:17:41 user nova-compute[73572]: INFO nova.compute.manager [-] [instance: 00c47a06-2bf8-427d-bcb1-304688584511] VM Stopped (Lifecycle Event)
Aug 26 10:17:41 user nova-compute[73572]: DEBUG nova.compute.manager [None req-2122f318-6d60-4fa8-84ac-89d624a8d602 None None] [instance: 00c47a06-2bf8-427d-bcb1-304688584511] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:17:41 user nova-compute[73572]: DEBUG nova.compute.manager [None req-2122f318-6d60-4fa8-84ac-89d624a8d602 None None] [instance: 00c47a06-2bf8-427d-bcb1-304688584511] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=73572) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 10:17:41 user nova-compute[73572]: DEBUG nova.objects.instance [None req-6f51f362-91c7-49bc-94ae-7c9caec0ce7a tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Lazy-loading 'flavor' on Instance uuid d2970584-8c2a-4f99-922c-d66d59489504 {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:17:41 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-6f51f362-91c7-49bc-94ae-7c9caec0ce7a tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Lock "d2970584-8c2a-4f99-922c-d66d59489504" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.689s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:17:41 user nova-compute[73572]: DEBUG nova.network.neutron [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] Successfully created port: 8bc3e6f9-0fb7-4283-973c-cbb09e440e68 {{(pid=73572) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 10:17:42 user nova-compute[73572]: DEBUG nova.network.neutron [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] Successfully updated port: 123d944e-47d4-4f95-94bc-73e1920ecbc1 {{(pid=73572) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 10:17:42 user nova-compute[73572]: DEBUG nova.compute.manager [req-7d8eed67-f7ca-4fd4-bc2a-8a740cb38581 req-a501554d-78b6-4627-a0b4-fa66b4cd953f service nova] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] Received event network-changed-123d944e-47d4-4f95-94bc-73e1920ecbc1 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:17:42 user nova-compute[73572]: DEBUG nova.compute.manager [req-7d8eed67-f7ca-4fd4-bc2a-8a740cb38581 req-a501554d-78b6-4627-a0b4-fa66b4cd953f service nova] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] Refreshing instance network info cache due to event network-changed-123d944e-47d4-4f95-94bc-73e1920ecbc1. {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 10:17:42 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-7d8eed67-f7ca-4fd4-bc2a-8a740cb38581 req-a501554d-78b6-4627-a0b4-fa66b4cd953f service nova] Acquiring lock "refresh_cache-41c1ef7a-4f98-4cbb-9948-acb96bd9d557" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:17:42 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-7d8eed67-f7ca-4fd4-bc2a-8a740cb38581 req-a501554d-78b6-4627-a0b4-fa66b4cd953f service nova] Acquired lock "refresh_cache-41c1ef7a-4f98-4cbb-9948-acb96bd9d557" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:17:42 user nova-compute[73572]: DEBUG nova.network.neutron [req-7d8eed67-f7ca-4fd4-bc2a-8a740cb38581 req-a501554d-78b6-4627-a0b4-fa66b4cd953f service nova] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] Refreshing network info cache for port 123d944e-47d4-4f95-94bc-73e1920ecbc1 {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 10:17:42 user nova-compute[73572]: DEBUG nova.network.neutron [req-7d8eed67-f7ca-4fd4-bc2a-8a740cb38581 req-a501554d-78b6-4627-a0b4-fa66b4cd953f service nova] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] Instance cache missing network info. {{(pid=73572) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 10:17:43 user nova-compute[73572]: DEBUG nova.network.neutron [req-7d8eed67-f7ca-4fd4-bc2a-8a740cb38581 req-a501554d-78b6-4627-a0b4-fa66b4cd953f service nova] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] Updating instance_info_cache with network_info: [] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:17:43 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-7d8eed67-f7ca-4fd4-bc2a-8a740cb38581 req-a501554d-78b6-4627-a0b4-fa66b4cd953f service nova] Releasing lock "refresh_cache-41c1ef7a-4f98-4cbb-9948-acb96bd9d557" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:17:43 user nova-compute[73572]: DEBUG nova.network.neutron [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] Successfully updated port: 696cd753-312c-437d-b140-c40b4158554e {{(pid=73572) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 10:17:44 user nova-compute[73572]: DEBUG nova.network.neutron [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] Successfully updated port: 3e7d3f56-193b-43ba-9cc5-c5373755e06f {{(pid=73572) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 10:17:44 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:17:44 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-697cd893-2279-44a9-ae0e-12ce1ebe45c1 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] Acquiring lock "b837eafb-db4e-4696-9b9f-bcfa1a30192a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:17:44 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-697cd893-2279-44a9-ae0e-12ce1ebe45c1 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] Lock "b837eafb-db4e-4696-9b9f-bcfa1a30192a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:17:44 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-697cd893-2279-44a9-ae0e-12ce1ebe45c1 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] Acquiring lock "b837eafb-db4e-4696-9b9f-bcfa1a30192a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:17:44 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-697cd893-2279-44a9-ae0e-12ce1ebe45c1 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] Lock "b837eafb-db4e-4696-9b9f-bcfa1a30192a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:17:44 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-697cd893-2279-44a9-ae0e-12ce1ebe45c1 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] Lock "b837eafb-db4e-4696-9b9f-bcfa1a30192a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:17:44 user nova-compute[73572]: INFO nova.compute.manager [None req-697cd893-2279-44a9-ae0e-12ce1ebe45c1 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] [instance: b837eafb-db4e-4696-9b9f-bcfa1a30192a] Terminating instance
Aug 26 10:17:44 user nova-compute[73572]: DEBUG nova.compute.manager [None req-697cd893-2279-44a9-ae0e-12ce1ebe45c1 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] [instance: b837eafb-db4e-4696-9b9f-bcfa1a30192a] Start destroying the instance on the hypervisor. {{(pid=73572) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 10:17:44 user nova-compute[73572]: DEBUG nova.compute.manager [req-dcce6b46-d58f-40a0-b75e-ce1a9de634c0 req-1c3335e0-8f59-48d3-b0d1-f538885fe30d service nova] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] Received event network-changed-696cd753-312c-437d-b140-c40b4158554e {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:17:44 user nova-compute[73572]: DEBUG nova.compute.manager [req-dcce6b46-d58f-40a0-b75e-ce1a9de634c0 req-1c3335e0-8f59-48d3-b0d1-f538885fe30d service nova] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] Refreshing instance network info cache due to event network-changed-696cd753-312c-437d-b140-c40b4158554e. {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 10:17:44 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-dcce6b46-d58f-40a0-b75e-ce1a9de634c0 req-1c3335e0-8f59-48d3-b0d1-f538885fe30d service nova] Acquiring lock "refresh_cache-41c1ef7a-4f98-4cbb-9948-acb96bd9d557" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:17:44 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-dcce6b46-d58f-40a0-b75e-ce1a9de634c0 req-1c3335e0-8f59-48d3-b0d1-f538885fe30d service nova] Acquired lock "refresh_cache-41c1ef7a-4f98-4cbb-9948-acb96bd9d557" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:17:44 user nova-compute[73572]: DEBUG nova.network.neutron [req-dcce6b46-d58f-40a0-b75e-ce1a9de634c0 req-1c3335e0-8f59-48d3-b0d1-f538885fe30d service nova] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] Refreshing network info cache for port 696cd753-312c-437d-b140-c40b4158554e {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 10:17:44 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:17:44 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:17:44 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:17:44 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:17:44 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:17:44 user nova-compute[73572]: DEBUG nova.network.neutron [req-dcce6b46-d58f-40a0-b75e-ce1a9de634c0 req-1c3335e0-8f59-48d3-b0d1-f538885fe30d service nova] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] Instance cache missing network info. {{(pid=73572) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 10:17:44 user nova-compute[73572]: DEBUG nova.compute.manager [req-2fdbf00f-2e9e-44d5-bad3-a1551ab80399 req-1304c26a-95f2-48e7-b905-7f373f8d077b service nova] [instance: b837eafb-db4e-4696-9b9f-bcfa1a30192a] Received event network-vif-unplugged-7e24882c-25ba-47d9-bc1f-9f45dac8291a {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:17:44 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-2fdbf00f-2e9e-44d5-bad3-a1551ab80399 req-1304c26a-95f2-48e7-b905-7f373f8d077b service nova] Acquiring lock "b837eafb-db4e-4696-9b9f-bcfa1a30192a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:17:45 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-2fdbf00f-2e9e-44d5-bad3-a1551ab80399 req-1304c26a-95f2-48e7-b905-7f373f8d077b service nova] Lock "b837eafb-db4e-4696-9b9f-bcfa1a30192a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:17:45 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-2fdbf00f-2e9e-44d5-bad3-a1551ab80399 req-1304c26a-95f2-48e7-b905-7f373f8d077b service nova] Lock "b837eafb-db4e-4696-9b9f-bcfa1a30192a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:17:45 user nova-compute[73572]: DEBUG nova.compute.manager [req-2fdbf00f-2e9e-44d5-bad3-a1551ab80399 req-1304c26a-95f2-48e7-b905-7f373f8d077b service nova] [instance: b837eafb-db4e-4696-9b9f-bcfa1a30192a] No waiting events found dispatching network-vif-unplugged-7e24882c-25ba-47d9-bc1f-9f45dac8291a {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:17:45 user nova-compute[73572]: DEBUG nova.compute.manager [req-2fdbf00f-2e9e-44d5-bad3-a1551ab80399 req-1304c26a-95f2-48e7-b905-7f373f8d077b service nova] [instance: b837eafb-db4e-4696-9b9f-bcfa1a30192a] Received event network-vif-unplugged-7e24882c-25ba-47d9-bc1f-9f45dac8291a for instance with task_state deleting. {{(pid=73572) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 10:17:45 user nova-compute[73572]: DEBUG nova.network.neutron [req-dcce6b46-d58f-40a0-b75e-ce1a9de634c0 req-1c3335e0-8f59-48d3-b0d1-f538885fe30d service nova] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] Updating instance_info_cache with network_info: [] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:17:45 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-dcce6b46-d58f-40a0-b75e-ce1a9de634c0 req-1c3335e0-8f59-48d3-b0d1-f538885fe30d service nova] Releasing lock "refresh_cache-41c1ef7a-4f98-4cbb-9948-acb96bd9d557" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:17:45 user nova-compute[73572]: DEBUG nova.compute.manager [req-dcce6b46-d58f-40a0-b75e-ce1a9de634c0 req-1c3335e0-8f59-48d3-b0d1-f538885fe30d service nova] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] Received event network-changed-3e7d3f56-193b-43ba-9cc5-c5373755e06f {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:17:45 user nova-compute[73572]: DEBUG nova.compute.manager [req-dcce6b46-d58f-40a0-b75e-ce1a9de634c0 req-1c3335e0-8f59-48d3-b0d1-f538885fe30d service nova] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] Refreshing instance network info cache due to event network-changed-3e7d3f56-193b-43ba-9cc5-c5373755e06f. {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 10:17:45 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-dcce6b46-d58f-40a0-b75e-ce1a9de634c0 req-1c3335e0-8f59-48d3-b0d1-f538885fe30d service nova] Acquiring lock "refresh_cache-41c1ef7a-4f98-4cbb-9948-acb96bd9d557" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:17:45 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-dcce6b46-d58f-40a0-b75e-ce1a9de634c0 req-1c3335e0-8f59-48d3-b0d1-f538885fe30d service nova] Acquired lock "refresh_cache-41c1ef7a-4f98-4cbb-9948-acb96bd9d557" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:17:45 user nova-compute[73572]: DEBUG nova.network.neutron [req-dcce6b46-d58f-40a0-b75e-ce1a9de634c0 req-1c3335e0-8f59-48d3-b0d1-f538885fe30d service nova] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] Refreshing network info cache for port 3e7d3f56-193b-43ba-9cc5-c5373755e06f {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 10:17:45 user nova-compute[73572]: INFO nova.virt.libvirt.driver [-] [instance: b837eafb-db4e-4696-9b9f-bcfa1a30192a] Instance destroyed successfully.
Aug 26 10:17:45 user nova-compute[73572]: DEBUG nova.objects.instance [None req-697cd893-2279-44a9-ae0e-12ce1ebe45c1 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] Lazy-loading 'resources' on Instance uuid b837eafb-db4e-4696-9b9f-bcfa1a30192a {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:17:45 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-697cd893-2279-44a9-ae0e-12ce1ebe45c1 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T10:15:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1739478325',display_name='tempest-VolumesActionsTest-instance-1739478325',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1739478325',id=18,image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T10:16:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='71aa440d71d44cd8a51d40bfbcae7f5f',ramdisk_id='',reservation_id='r-mob060o5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1871113041',owner_user_name='tempest-VolumesActionsTest-1871113041-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T10:16:00Z,user_data=None,user_id='257dcb60edca4eebabab0b4db96ba6d6',uuid=b837eafb-db4e-4696-9b9f-bcfa1a30192a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7e24882c-25ba-47d9-bc1f-9f45dac8291a", "address": "fa:16:3e:92:98:cd", "network": {"id": "c0189896-22a3-47d8-adad-dff6c1e16a8f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2033963461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71aa440d71d44cd8a51d40bfbcae7f5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e24882c-25", "ovs_interfaceid": "7e24882c-25ba-47d9-bc1f-9f45dac8291a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 10:17:45 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-697cd893-2279-44a9-ae0e-12ce1ebe45c1 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] Converting VIF {"id": "7e24882c-25ba-47d9-bc1f-9f45dac8291a", "address": "fa:16:3e:92:98:cd", "network": {"id": "c0189896-22a3-47d8-adad-dff6c1e16a8f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2033963461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71aa440d71d44cd8a51d40bfbcae7f5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e24882c-25", "ovs_interfaceid": "7e24882c-25ba-47d9-bc1f-9f45dac8291a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:17:45 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-697cd893-2279-44a9-ae0e-12ce1ebe45c1 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:98:cd,bridge_name='br-int',has_traffic_filtering=True,id=7e24882c-25ba-47d9-bc1f-9f45dac8291a,network=Network(c0189896-22a3-47d8-adad-dff6c1e16a8f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e24882c-25') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:17:45 user nova-compute[73572]: DEBUG os_vif [None req-697cd893-2279-44a9-ae0e-12ce1ebe45c1 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:98:cd,bridge_name='br-int',has_traffic_filtering=True,id=7e24882c-25ba-47d9-bc1f-9f45dac8291a,network=Network(c0189896-22a3-47d8-adad-dff6c1e16a8f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e24882c-25') {{(pid=73572) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 10:17:45 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:17:45 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7e24882c-25, bridge=br-int, if_exists=True) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:17:45 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:17:45 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:17:45 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:17:45 user nova-compute[73572]: INFO os_vif [None req-697cd893-2279-44a9-ae0e-12ce1ebe45c1 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:98:cd,bridge_name='br-int',has_traffic_filtering=True,id=7e24882c-25ba-47d9-bc1f-9f45dac8291a,network=Network(c0189896-22a3-47d8-adad-dff6c1e16a8f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e24882c-25')
Aug 26 10:17:45 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-697cd893-2279-44a9-ae0e-12ce1ebe45c1 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] [instance: b837eafb-db4e-4696-9b9f-bcfa1a30192a] Deleting instance files /opt/stack/data/nova/instances/b837eafb-db4e-4696-9b9f-bcfa1a30192a_del
Aug 26 10:17:45 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-697cd893-2279-44a9-ae0e-12ce1ebe45c1 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] [instance: b837eafb-db4e-4696-9b9f-bcfa1a30192a] Deletion of /opt/stack/data/nova/instances/b837eafb-db4e-4696-9b9f-bcfa1a30192a_del complete
Aug 26 10:17:45 user nova-compute[73572]: DEBUG nova.network.neutron [req-dcce6b46-d58f-40a0-b75e-ce1a9de634c0 req-1c3335e0-8f59-48d3-b0d1-f538885fe30d service nova] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] Instance cache missing network info. {{(pid=73572) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 10:17:45 user nova-compute[73572]: INFO nova.compute.manager [None req-697cd893-2279-44a9-ae0e-12ce1ebe45c1 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] [instance: b837eafb-db4e-4696-9b9f-bcfa1a30192a] Took 0.92 seconds to destroy the instance on the hypervisor.
Aug 26 10:17:45 user nova-compute[73572]: DEBUG oslo.service.loopingcall [None req-697cd893-2279-44a9-ae0e-12ce1ebe45c1 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73572) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 10:17:45 user nova-compute[73572]: DEBUG nova.compute.manager [-] [instance: b837eafb-db4e-4696-9b9f-bcfa1a30192a] Deallocating network for instance {{(pid=73572) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 10:17:45 user nova-compute[73572]: DEBUG nova.network.neutron [-] [instance: b837eafb-db4e-4696-9b9f-bcfa1a30192a] deallocate_for_instance() {{(pid=73572) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 10:17:45 user nova-compute[73572]: DEBUG nova.network.neutron [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] Successfully updated port: f264d951-8920-4151-8276-33baa6a9def9 {{(pid=73572) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 10:17:45 user nova-compute[73572]: DEBUG nova.network.neutron [req-dcce6b46-d58f-40a0-b75e-ce1a9de634c0 req-1c3335e0-8f59-48d3-b0d1-f538885fe30d service nova] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] Updating instance_info_cache with network_info: [] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:17:45 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-dcce6b46-d58f-40a0-b75e-ce1a9de634c0 req-1c3335e0-8f59-48d3-b0d1-f538885fe30d service nova] Releasing lock "refresh_cache-41c1ef7a-4f98-4cbb-9948-acb96bd9d557" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:17:45 user nova-compute[73572]: DEBUG nova.network.neutron [-] [instance: b837eafb-db4e-4696-9b9f-bcfa1a30192a] Updating instance_info_cache with network_info: [] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:17:45 user nova-compute[73572]: INFO nova.compute.manager [-] [instance: b837eafb-db4e-4696-9b9f-bcfa1a30192a] Took 0.53 seconds to deallocate network for instance.
Aug 26 10:17:45 user nova-compute[73572]: DEBUG nova.compute.manager [req-a61070cf-6587-4f5a-9439-37aacde26c23 req-d28af0c3-2ef9-4320-b70f-5f953e9d686d service nova] [instance: b837eafb-db4e-4696-9b9f-bcfa1a30192a] Received event network-vif-deleted-7e24882c-25ba-47d9-bc1f-9f45dac8291a {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:17:45 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-697cd893-2279-44a9-ae0e-12ce1ebe45c1 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:17:45 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-697cd893-2279-44a9-ae0e-12ce1ebe45c1 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:17:46 user nova-compute[73572]: DEBUG nova.compute.provider_tree [None req-697cd893-2279-44a9-ae0e-12ce1ebe45c1 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] Inventory has not changed in ProviderTree for provider: e2cec974-59b2-4c77-a53d-a7f4e5a30d75 {{(pid=73572) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 10:17:46 user nova-compute[73572]: DEBUG nova.network.neutron [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] Successfully updated port: c0c6f2bc-3209-461a-bcc3-edf740139ca2 {{(pid=73572) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 10:17:46 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-697cd893-2279-44a9-ae0e-12ce1ebe45c1 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] Inventory has not changed for provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73572) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 10:17:46 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-697cd893-2279-44a9-ae0e-12ce1ebe45c1 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.406s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:17:46 user nova-compute[73572]: INFO nova.scheduler.client.report [None req-697cd893-2279-44a9-ae0e-12ce1ebe45c1 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] Deleted allocations for instance b837eafb-db4e-4696-9b9f-bcfa1a30192a
Aug 26 10:17:46 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-697cd893-2279-44a9-ae0e-12ce1ebe45c1 tempest-VolumesActionsTest-1871113041 tempest-VolumesActionsTest-1871113041-project-member] Lock "b837eafb-db4e-4696-9b9f-bcfa1a30192a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.117s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:17:46 user nova-compute[73572]: DEBUG nova.compute.manager [req-41474282-6671-4bae-92de-90b354460bf6 req-23f40b33-4bc6-429e-ad51-c5cb2c81f60a service nova] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] Received event network-changed-f264d951-8920-4151-8276-33baa6a9def9 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:17:46 user nova-compute[73572]: DEBUG nova.compute.manager [req-41474282-6671-4bae-92de-90b354460bf6 req-23f40b33-4bc6-429e-ad51-c5cb2c81f60a service nova] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] Refreshing instance network info cache due to event network-changed-f264d951-8920-4151-8276-33baa6a9def9. {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 10:17:46 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-41474282-6671-4bae-92de-90b354460bf6 req-23f40b33-4bc6-429e-ad51-c5cb2c81f60a service nova] Acquiring lock "refresh_cache-41c1ef7a-4f98-4cbb-9948-acb96bd9d557" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:17:46 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-41474282-6671-4bae-92de-90b354460bf6 req-23f40b33-4bc6-429e-ad51-c5cb2c81f60a service nova] Acquired lock "refresh_cache-41c1ef7a-4f98-4cbb-9948-acb96bd9d557" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:17:46 user nova-compute[73572]: DEBUG nova.network.neutron [req-41474282-6671-4bae-92de-90b354460bf6 req-23f40b33-4bc6-429e-ad51-c5cb2c81f60a service nova] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] Refreshing network info cache for port f264d951-8920-4151-8276-33baa6a9def9 {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 10:17:46 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._sync_power_states {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:17:46 user nova-compute[73572]: DEBUG nova.network.neutron [req-41474282-6671-4bae-92de-90b354460bf6 req-23f40b33-4bc6-429e-ad51-c5cb2c81f60a service nova] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] Instance cache missing network info. {{(pid=73572) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 10:17:46 user nova-compute[73572]: WARNING nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] While synchronizing instance power states, found 12 instances in the database and 10 instances on the hypervisor.
Aug 26 10:17:46 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Triggering sync for uuid c785b609-0068-442f-91f5-d26e888a993f {{(pid=73572) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 10:17:46 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Triggering sync for uuid 8302d6e7-aaf3-461c-a55e-f2e685d1800d {{(pid=73572) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 10:17:46 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Triggering sync for uuid c555f971-b177-4c26-a38e-09e0e78bf7b9 {{(pid=73572) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 10:17:46 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Triggering sync for uuid ee9bcbaa-25a6-4588-b757-2a2ae15b6cf8 {{(pid=73572) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 10:17:46 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Triggering sync for uuid 14fab12e-52be-4fe6-8777-bc7ebf3c25f1 {{(pid=73572) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 10:17:46 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Triggering sync for uuid 00c47a06-2bf8-427d-bcb1-304688584511 {{(pid=73572) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 10:17:46 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Triggering sync for uuid d2970584-8c2a-4f99-922c-d66d59489504 {{(pid=73572) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 10:17:46 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Triggering sync for uuid 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55 {{(pid=73572) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 10:17:46 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Triggering sync for uuid 682138af-ba6a-47f1-a9a5-03ae2661f54d {{(pid=73572) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 10:17:46 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Triggering sync for uuid 0dceaa35-4a13-453b-961f-831f66c35af0 {{(pid=73572) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 10:17:46 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Triggering sync for uuid 339517ef-c023-4f13-a8cc-d84f7176dfcd {{(pid=73572) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 10:17:46 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Triggering sync for uuid 41c1ef7a-4f98-4cbb-9948-acb96bd9d557 {{(pid=73572) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 10:17:46 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquiring lock "c785b609-0068-442f-91f5-d26e888a993f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:17:46 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "c785b609-0068-442f-91f5-d26e888a993f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:17:46 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquiring lock "8302d6e7-aaf3-461c-a55e-f2e685d1800d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:17:46 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "8302d6e7-aaf3-461c-a55e-f2e685d1800d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:17:46 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquiring lock "c555f971-b177-4c26-a38e-09e0e78bf7b9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:17:46 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "c555f971-b177-4c26-a38e-09e0e78bf7b9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:17:46 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquiring lock "ee9bcbaa-25a6-4588-b757-2a2ae15b6cf8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:17:46 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "ee9bcbaa-25a6-4588-b757-2a2ae15b6cf8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:17:46 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquiring lock "14fab12e-52be-4fe6-8777-bc7ebf3c25f1" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:17:46 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "14fab12e-52be-4fe6-8777-bc7ebf3c25f1" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:17:46 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquiring lock "00c47a06-2bf8-427d-bcb1-304688584511" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:17:46 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "00c47a06-2bf8-427d-bcb1-304688584511" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:17:46 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquiring lock "d2970584-8c2a-4f99-922c-d66d59489504" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:17:46 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "d2970584-8c2a-4f99-922c-d66d59489504" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:17:46 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquiring lock "0fe47a17-4ffb-48ce-b0f6-a9b43002bd55" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:17:46 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "0fe47a17-4ffb-48ce-b0f6-a9b43002bd55" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:17:46 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquiring lock "682138af-ba6a-47f1-a9a5-03ae2661f54d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:17:46 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "682138af-ba6a-47f1-a9a5-03ae2661f54d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:17:46 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquiring lock "0dceaa35-4a13-453b-961f-831f66c35af0" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:17:46 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "0dceaa35-4a13-453b-961f-831f66c35af0" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:17:46 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquiring lock "339517ef-c023-4f13-a8cc-d84f7176dfcd" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:17:46 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquiring lock "41c1ef7a-4f98-4cbb-9948-acb96bd9d557" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:17:46 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "c555f971-b177-4c26-a38e-09e0e78bf7b9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.085s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:17:46 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "682138af-ba6a-47f1-a9a5-03ae2661f54d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.087s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:17:46 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "8302d6e7-aaf3-461c-a55e-f2e685d1800d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.095s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:17:46 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "c785b609-0068-442f-91f5-d26e888a993f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.097s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:17:46 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "ee9bcbaa-25a6-4588-b757-2a2ae15b6cf8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.097s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:17:46 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "00c47a06-2bf8-427d-bcb1-304688584511" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.096s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:17:46 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "14fab12e-52be-4fe6-8777-bc7ebf3c25f1" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.099s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:17:46 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "0fe47a17-4ffb-48ce-b0f6-a9b43002bd55" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.104s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:17:46 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "0dceaa35-4a13-453b-961f-831f66c35af0" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.110s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:17:46 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "d2970584-8c2a-4f99-922c-d66d59489504" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.117s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:17:47 user nova-compute[73572]: DEBUG nova.compute.manager [req-515cb293-8b4f-4ee6-af18-9915b88faddc req-b5f01062-1500-4c58-b31b-558621d6ba8d service nova] [instance: b837eafb-db4e-4696-9b9f-bcfa1a30192a] Received event network-vif-plugged-7e24882c-25ba-47d9-bc1f-9f45dac8291a {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:17:47 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-515cb293-8b4f-4ee6-af18-9915b88faddc req-b5f01062-1500-4c58-b31b-558621d6ba8d service nova] Acquiring lock "b837eafb-db4e-4696-9b9f-bcfa1a30192a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:17:47 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-515cb293-8b4f-4ee6-af18-9915b88faddc req-b5f01062-1500-4c58-b31b-558621d6ba8d service nova] Lock "b837eafb-db4e-4696-9b9f-bcfa1a30192a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:17:47 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-515cb293-8b4f-4ee6-af18-9915b88faddc req-b5f01062-1500-4c58-b31b-558621d6ba8d service nova] Lock "b837eafb-db4e-4696-9b9f-bcfa1a30192a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:17:47 user nova-compute[73572]: DEBUG nova.compute.manager [req-515cb293-8b4f-4ee6-af18-9915b88faddc req-b5f01062-1500-4c58-b31b-558621d6ba8d service nova] [instance: b837eafb-db4e-4696-9b9f-bcfa1a30192a] No waiting events found dispatching network-vif-plugged-7e24882c-25ba-47d9-bc1f-9f45dac8291a {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:17:47 user nova-compute[73572]: WARNING nova.compute.manager [req-515cb293-8b4f-4ee6-af18-9915b88faddc req-b5f01062-1500-4c58-b31b-558621d6ba8d service nova] [instance: b837eafb-db4e-4696-9b9f-bcfa1a30192a] Received unexpected event network-vif-plugged-7e24882c-25ba-47d9-bc1f-9f45dac8291a for instance with vm_state deleted and task_state None.
Aug 26 10:17:47 user nova-compute[73572]: DEBUG nova.network.neutron [req-41474282-6671-4bae-92de-90b354460bf6 req-23f40b33-4bc6-429e-ad51-c5cb2c81f60a service nova] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] Updating instance_info_cache with network_info: [] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:17:47 user nova-compute[73572]: DEBUG nova.network.neutron [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] Successfully updated port: 2fe25c93-5639-47a6-80de-8cc83615e3c4 {{(pid=73572) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 10:17:47 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-41474282-6671-4bae-92de-90b354460bf6 req-23f40b33-4bc6-429e-ad51-c5cb2c81f60a service nova] Releasing lock "refresh_cache-41c1ef7a-4f98-4cbb-9948-acb96bd9d557" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:17:47 user nova-compute[73572]: DEBUG nova.compute.manager [req-41474282-6671-4bae-92de-90b354460bf6 req-23f40b33-4bc6-429e-ad51-c5cb2c81f60a service nova] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] Received event network-changed-c0c6f2bc-3209-461a-bcc3-edf740139ca2 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:17:47 user nova-compute[73572]: DEBUG nova.compute.manager [req-41474282-6671-4bae-92de-90b354460bf6 req-23f40b33-4bc6-429e-ad51-c5cb2c81f60a service nova] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] Refreshing instance network info cache due to event network-changed-c0c6f2bc-3209-461a-bcc3-edf740139ca2. {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 10:17:47 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-41474282-6671-4bae-92de-90b354460bf6 req-23f40b33-4bc6-429e-ad51-c5cb2c81f60a service nova] Acquiring lock "refresh_cache-41c1ef7a-4f98-4cbb-9948-acb96bd9d557" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:17:47 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-41474282-6671-4bae-92de-90b354460bf6 req-23f40b33-4bc6-429e-ad51-c5cb2c81f60a service nova] Acquired lock "refresh_cache-41c1ef7a-4f98-4cbb-9948-acb96bd9d557" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:17:47 user nova-compute[73572]: DEBUG nova.network.neutron [req-41474282-6671-4bae-92de-90b354460bf6 req-23f40b33-4bc6-429e-ad51-c5cb2c81f60a service nova] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] Refreshing network info cache for port c0c6f2bc-3209-461a-bcc3-edf740139ca2 {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 10:17:47 user nova-compute[73572]: DEBUG nova.network.neutron [req-41474282-6671-4bae-92de-90b354460bf6 req-23f40b33-4bc6-429e-ad51-c5cb2c81f60a service nova] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] Instance cache missing network info. {{(pid=73572) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 10:17:47 user nova-compute[73572]: DEBUG nova.network.neutron [req-41474282-6671-4bae-92de-90b354460bf6 req-23f40b33-4bc6-429e-ad51-c5cb2c81f60a service nova] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] Updating instance_info_cache with network_info: [] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:17:47 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-41474282-6671-4bae-92de-90b354460bf6 req-23f40b33-4bc6-429e-ad51-c5cb2c81f60a service nova] Releasing lock "refresh_cache-41c1ef7a-4f98-4cbb-9948-acb96bd9d557" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:17:48 user nova-compute[73572]: DEBUG nova.network.neutron [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] Successfully updated port: 8bc3e6f9-0fb7-4283-973c-cbb09e440e68 {{(pid=73572) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 10:17:48 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] Acquiring lock "refresh_cache-41c1ef7a-4f98-4cbb-9948-acb96bd9d557" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:17:48 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] Acquired lock "refresh_cache-41c1ef7a-4f98-4cbb-9948-acb96bd9d557" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:17:48 user nova-compute[73572]: DEBUG nova.network.neutron [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] Building network info cache for instance {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 10:17:48 user nova-compute[73572]: DEBUG nova.network.neutron [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] Instance cache missing network info. {{(pid=73572) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 10:17:48 user nova-compute[73572]: DEBUG nova.compute.manager [req-25acbcd3-3334-405a-b007-01a4c0c21992 req-025aaef5-208c-43a4-b93f-667cebb05470 service nova] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] Received event network-changed-2fe25c93-5639-47a6-80de-8cc83615e3c4 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:17:48 user nova-compute[73572]: DEBUG nova.compute.manager [req-25acbcd3-3334-405a-b007-01a4c0c21992 req-025aaef5-208c-43a4-b93f-667cebb05470 service nova] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] Refreshing instance network info cache due to event network-changed-2fe25c93-5639-47a6-80de-8cc83615e3c4. {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 10:17:48 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-25acbcd3-3334-405a-b007-01a4c0c21992 req-025aaef5-208c-43a4-b93f-667cebb05470 service nova] Acquiring lock "refresh_cache-41c1ef7a-4f98-4cbb-9948-acb96bd9d557" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:17:49 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:17:49 user nova-compute[73572]: INFO nova.virt.block_device [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] Booting with volume 57b56972-76f9-44aa-905c-14d04f924f76 at /dev/vdb
Aug 26 10:17:50 user nova-compute[73572]: DEBUG os_brick.utils [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 10:17:50 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:17:50 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:17:50 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[66771530-29a6-4d1e-a2bf-5f08af046492]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:de8a79ed912\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:17:50 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:17:50 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:17:50 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[3674b829-37bc-4ae8-a1c0-e571bdbe6cea]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:17:50 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:17:50 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:17:50 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[affecc21-9791-42cc-902c-5bd46a17354a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:17:50 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[63f465d9-ac71-4736-911e-93052e2ac7ac]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:17:50 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] Running cmd (subprocess): nvme version {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:17:50 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] 'nvme version' failed. Not Retrying. {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 10:17:50 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:17:50 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] nvme not present on system {{(pid=73572) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 10:17:50 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:17:50 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 10:17:50 user nova-compute[73572]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 10:17:50 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[94b7e252-0749-4dcb-938b-af289962e989]: (4, '') {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:17:50 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.lightos [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73572) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 10:17:50 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.lightos [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73572) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 10:17:50 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.lightos [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] LIGHTOS: no hostnqn found. {{(pid=73572) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 10:17:50 user nova-compute[73572]: DEBUG os_brick.utils [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] <== get_connector_properties: return (142ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:de8a79ed912', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 10:17:50 user nova-compute[73572]: DEBUG nova.virt.block_device [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] Updating existing volume attachment record: 7c869b51-77dd-47a0-8819-82d79bd7a175 {{(pid=73572) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 10:17:50 user nova-compute[73572]: DEBUG nova.network.neutron [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] Updating instance_info_cache with network_info: [{"id": "123d944e-47d4-4f95-94bc-73e1920ecbc1", "address": "fa:16:3e:95:40:4c", "network": {"id": "ce8484e9-f124-4a9c-9682-289ed99917e2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1080187713-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cf2ae4dd7d3474394090e3276c957ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap123d944e-47", "ovs_interfaceid": "123d944e-47d4-4f95-94bc-73e1920ecbc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "696cd753-312c-437d-b140-c40b4158554e", "address": "fa:16:3e:13:c8:34", "network": {"id": "c0d598c4-68c6-4cfc-adf1-dc0360861788", "bridge": "br-int", "label": "tempest-device-tagging-net1-1696215747", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.77", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7cf2ae4dd7d3474394090e3276c957ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap696cd753-31", "ovs_interfaceid": "696cd753-312c-437d-b140-c40b4158554e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3e7d3f56-193b-43ba-9cc5-c5373755e06f", "address": "fa:16:3e:85:00:8b", "network": {"id": "c0d598c4-68c6-4cfc-adf1-dc0360861788", "bridge": "br-int", "label": "tempest-device-tagging-net1-1696215747", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.177", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7cf2ae4dd7d3474394090e3276c957ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e7d3f56-19", "ovs_interfaceid": "3e7d3f56-193b-43ba-9cc5-c5373755e06f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f264d951-8920-4151-8276-33baa6a9def9", "address": "fa:16:3e:a7:e2:2a", "network": {"id": "c0d598c4-68c6-4cfc-adf1-dc0360861788", "bridge": "br-int", "label": "tempest-device-tagging-net1-1696215747", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7cf2ae4dd7d3474394090e3276c957ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf264d951-89", "ovs_interfaceid": "f264d951-8920-4151-8276-33baa6a9def9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c0c6f2bc-3209-461a-bcc3-edf740139ca2", "address": "fa:16:3e:d1:c7:a5", "network": {"id": "c0d598c4-68c6-4cfc-adf1-dc0360861788", "bridge": "br-int", "label": "tempest-device-tagging-net1-1696215747", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.224", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7cf2ae4dd7d3474394090e3276c957ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0c6f2bc-32", "ovs_interfaceid": "c0c6f2bc-3209-461a-bcc3-edf740139ca2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2fe25c93-5639-47a6-80de-8cc83615e3c4", "address": "fa:16:3e:59:09:63", "network": {"id": "f69a6193-9faf-4224-b21b-bc60491f9aea", "bridge": "br-int", "label": "tempest-device-tagging-net2-1404521418", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7cf2ae4dd7d3474394090e3276c957ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fe25c93-56", "ovs_interfaceid": "2fe25c93-5639-47a6-80de-8cc83615e3c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8bc3e6f9-0fb7-4283-973c-cbb09e440e68", "address": "fa:16:3e:3d:e7:4c", "network": {"id": "f69a6193-9faf-4224-b21b-bc60491f9aea", "bridge": "br-int", "label": "tempest-device-tagging-net2-1404521418", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7cf2ae4dd7d3474394090e3276c957ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bc3e6f9-0f", "ovs_interfaceid": "8bc3e6f9-0fb7-4283-973c-cbb09e440e68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:17:50 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] Releasing lock "refresh_cache-41c1ef7a-4f98-4cbb-9948-acb96bd9d557" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:17:50 user nova-compute[73572]: DEBUG nova.compute.manager [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] Instance network_info: |[{"id": "123d944e-47d4-4f95-94bc-73e1920ecbc1", "address": "fa:16:3e:95:40:4c", "network": {"id": "ce8484e9-f124-4a9c-9682-289ed99917e2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1080187713-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cf2ae4dd7d3474394090e3276c957ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap123d944e-47", "ovs_interfaceid": "123d944e-47d4-4f95-94bc-73e1920ecbc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "696cd753-312c-437d-b140-c40b4158554e", "address": "fa:16:3e:13:c8:34", "network": {"id": "c0d598c4-68c6-4cfc-adf1-dc0360861788", "bridge": "br-int", "label": "tempest-device-tagging-net1-1696215747", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.77", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7cf2ae4dd7d3474394090e3276c957ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap696cd753-31", "ovs_interfaceid": "696cd753-312c-437d-b140-c40b4158554e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3e7d3f56-193b-43ba-9cc5-c5373755e06f", "address": "fa:16:3e:85:00:8b", "network": {"id": "c0d598c4-68c6-4cfc-adf1-dc0360861788", "bridge": "br-int", "label": "tempest-device-tagging-net1-1696215747", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.177", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7cf2ae4dd7d3474394090e3276c957ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e7d3f56-19", "ovs_interfaceid": "3e7d3f56-193b-43ba-9cc5-c5373755e06f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f264d951-8920-4151-8276-33baa6a9def9", "address": "fa:16:3e:a7:e2:2a", "network": {"id": "c0d598c4-68c6-4cfc-adf1-dc0360861788", "bridge": "br-int", "label": "tempest-device-tagging-net1-1696215747", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7cf2ae4dd7d3474394090e3276c957ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf264d951-89", "ovs_interfaceid": "f264d951-8920-4151-8276-33baa6a9def9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c0c6f2bc-3209-461a-bcc3-edf740139ca2", "address": "fa:16:3e:d1:c7:a5", "network": {"id": "c0d598c4-68c6-4cfc-adf1-dc0360861788", "bridge": "br-int", "label": "tempest-device-tagging-net1-1696215747", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.224", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7cf2ae4dd7d3474394090e3276c957ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0c6f2bc-32", "ovs_interfaceid": "c0c6f2bc-3209-461a-bcc3-edf740139ca2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2fe25c93-5639-47a6-80de-8cc83615e3c4", "address": "fa:16:3e:59:09:63", "network": {"id": "f69a6193-9faf-4224-b21b-bc60491f9aea", "bridge": "br-int", "label": "tempest-device-tagging-net2-1404521418", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7cf2ae4dd7d3474394090e3276c957ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fe25c93-56", "ovs_interfaceid": "2fe25c93-5639-47a6-80de-8cc83615e3c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8bc3e6f9-0fb7-4283-973c-cbb09e440e68", "address": "fa:16:3e:3d:e7:4c", "network": {"id": "f69a6193-9faf-4224-b21b-bc60491f9aea", "bridge": "br-int", "label": "tempest-device-tagging-net2-1404521418", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7cf2ae4dd7d3474394090e3276c957ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bc3e6f9-0f", "ovs_interfaceid": "8bc3e6f9-0fb7-4283-973c-cbb09e440e68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73572) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 10:17:50 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-25acbcd3-3334-405a-b007-01a4c0c21992 req-025aaef5-208c-43a4-b93f-667cebb05470 service nova] Acquired lock "refresh_cache-41c1ef7a-4f98-4cbb-9948-acb96bd9d557" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:17:50 user nova-compute[73572]: DEBUG nova.network.neutron [req-25acbcd3-3334-405a-b007-01a4c0c21992 req-025aaef5-208c-43a4-b93f-667cebb05470 service nova] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] Refreshing network info cache for port 2fe25c93-5639-47a6-80de-8cc83615e3c4 {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 10:17:51 user nova-compute[73572]: DEBUG nova.network.neutron [req-25acbcd3-3334-405a-b007-01a4c0c21992 req-025aaef5-208c-43a4-b93f-667cebb05470 service nova] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] Updated VIF entry in instance network info cache for port 2fe25c93-5639-47a6-80de-8cc83615e3c4. {{(pid=73572) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 10:17:51 user nova-compute[73572]: DEBUG nova.network.neutron [req-25acbcd3-3334-405a-b007-01a4c0c21992 req-025aaef5-208c-43a4-b93f-667cebb05470 service nova] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] Updating instance_info_cache with network_info: [{"id": "123d944e-47d4-4f95-94bc-73e1920ecbc1", "address": "fa:16:3e:95:40:4c", "network": {"id": "ce8484e9-f124-4a9c-9682-289ed99917e2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1080187713-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cf2ae4dd7d3474394090e3276c957ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap123d944e-47", "ovs_interfaceid": "123d944e-47d4-4f95-94bc-73e1920ecbc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "696cd753-312c-437d-b140-c40b4158554e", "address": "fa:16:3e:13:c8:34", "network": {"id": "c0d598c4-68c6-4cfc-adf1-dc0360861788", "bridge": "br-int", "label": "tempest-device-tagging-net1-1696215747", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.77", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7cf2ae4dd7d3474394090e3276c957ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap696cd753-31", "ovs_interfaceid": "696cd753-312c-437d-b140-c40b4158554e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3e7d3f56-193b-43ba-9cc5-c5373755e06f", "address": "fa:16:3e:85:00:8b", "network": {"id": "c0d598c4-68c6-4cfc-adf1-dc0360861788", "bridge": "br-int", "label": "tempest-device-tagging-net1-1696215747", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.177", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7cf2ae4dd7d3474394090e3276c957ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e7d3f56-19", "ovs_interfaceid": "3e7d3f56-193b-43ba-9cc5-c5373755e06f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f264d951-8920-4151-8276-33baa6a9def9", "address": "fa:16:3e:a7:e2:2a", "network": {"id": "c0d598c4-68c6-4cfc-adf1-dc0360861788", "bridge": "br-int", "label": "tempest-device-tagging-net1-1696215747", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7cf2ae4dd7d3474394090e3276c957ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf264d951-89", "ovs_interfaceid": "f264d951-8920-4151-8276-33baa6a9def9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c0c6f2bc-3209-461a-bcc3-edf740139ca2", "address": "fa:16:3e:d1:c7:a5", "network": {"id": "c0d598c4-68c6-4cfc-adf1-dc0360861788", "bridge": "br-int", "label": "tempest-device-tagging-net1-1696215747", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.224", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7cf2ae4dd7d3474394090e3276c957ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0c6f2bc-32", "ovs_interfaceid": "c0c6f2bc-3209-461a-bcc3-edf740139ca2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2fe25c93-5639-47a6-80de-8cc83615e3c4", "address": "fa:16:3e:59:09:63", "network": {"id": "f69a6193-9faf-4224-b21b-bc60491f9aea", "bridge": "br-int", "label": "tempest-device-tagging-net2-1404521418", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7cf2ae4dd7d3474394090e3276c957ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fe25c93-56", "ovs_interfaceid": "2fe25c93-5639-47a6-80de-8cc83615e3c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8bc3e6f9-0fb7-4283-973c-cbb09e440e68", "address": "fa:16:3e:3d:e7:4c", "network": {"id": "f69a6193-9faf-4224-b21b-bc60491f9aea", "bridge": "br-int", "label": "tempest-device-tagging-net2-1404521418", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7cf2ae4dd7d3474394090e3276c957ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bc3e6f9-0f", "ovs_interfaceid": "8bc3e6f9-0fb7-4283-973c-cbb09e440e68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:17:51 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-25acbcd3-3334-405a-b007-01a4c0c21992 req-025aaef5-208c-43a4-b93f-667cebb05470 service nova] Releasing lock "refresh_cache-41c1ef7a-4f98-4cbb-9948-acb96bd9d557" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:17:51 user nova-compute[73572]: DEBUG nova.compute.manager [req-25acbcd3-3334-405a-b007-01a4c0c21992 req-025aaef5-208c-43a4-b93f-667cebb05470 service nova] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] Received event network-changed-8bc3e6f9-0fb7-4283-973c-cbb09e440e68 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:17:51 user nova-compute[73572]: DEBUG nova.compute.manager [req-25acbcd3-3334-405a-b007-01a4c0c21992 req-025aaef5-208c-43a4-b93f-667cebb05470 service nova] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] Refreshing instance network info cache due to event network-changed-8bc3e6f9-0fb7-4283-973c-cbb09e440e68. {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 10:17:51 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-25acbcd3-3334-405a-b007-01a4c0c21992 req-025aaef5-208c-43a4-b93f-667cebb05470 service nova] Acquiring lock "refresh_cache-41c1ef7a-4f98-4cbb-9948-acb96bd9d557" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:17:51 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-25acbcd3-3334-405a-b007-01a4c0c21992 req-025aaef5-208c-43a4-b93f-667cebb05470 service nova] Acquired lock "refresh_cache-41c1ef7a-4f98-4cbb-9948-acb96bd9d557" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:17:51 user nova-compute[73572]: DEBUG nova.network.neutron [req-25acbcd3-3334-405a-b007-01a4c0c21992 req-025aaef5-208c-43a4-b93f-667cebb05470 service nova] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] Refreshing network info cache for port 8bc3e6f9-0fb7-4283-973c-cbb09e440e68 {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 10:17:51 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-6e79aff4-4e23-4967-8efd-5be3a838101a tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] Acquiring lock "c555f971-b177-4c26-a38e-09e0e78bf7b9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:17:51 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-6e79aff4-4e23-4967-8efd-5be3a838101a tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] Lock "c555f971-b177-4c26-a38e-09e0e78bf7b9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:17:51 user nova-compute[73572]: INFO nova.compute.manager [None req-6e79aff4-4e23-4967-8efd-5be3a838101a tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] [instance: c555f971-b177-4c26-a38e-09e0e78bf7b9] Detaching volume ac5c1ee2-3656-49b3-942f-5fc992dc001b
Aug 26 10:17:51 user nova-compute[73572]: INFO nova.virt.block_device [None req-6e79aff4-4e23-4967-8efd-5be3a838101a tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] [instance: c555f971-b177-4c26-a38e-09e0e78bf7b9] Attempting to driver detach volume ac5c1ee2-3656-49b3-942f-5fc992dc001b from mountpoint /dev/vdb
Aug 26 10:17:51 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-6e79aff4-4e23-4967-8efd-5be3a838101a tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] Attempting to detach device vdb from instance c555f971-b177-4c26-a38e-09e0e78bf7b9 from the persistent domain config. {{(pid=73572) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 10:17:51 user nova-compute[73572]: DEBUG nova.virt.libvirt.guest [None req-6e79aff4-4e23-4967-8efd-5be3a838101a tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 10:17:51 user nova-compute[73572]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 10:17:51 user nova-compute[73572]:   <source dev="/dev/sde"/>
Aug 26 10:17:51 user nova-compute[73572]:   <target dev="vdb" bus="virtio"/>
Aug 26 10:17:51 user nova-compute[73572]:   <serial>ac5c1ee2-3656-49b3-942f-5fc992dc001b</serial>
Aug 26 10:17:51 user nova-compute[73572]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 10:17:51 user nova-compute[73572]: </disk>
Aug 26 10:17:51 user nova-compute[73572]:  {{(pid=73572) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 10:17:51 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-6e79aff4-4e23-4967-8efd-5be3a838101a tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] Successfully detached device vdb from instance c555f971-b177-4c26-a38e-09e0e78bf7b9 from the persistent domain config.
Aug 26 10:17:51 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-6e79aff4-4e23-4967-8efd-5be3a838101a tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c555f971-b177-4c26-a38e-09e0e78bf7b9 from the live domain config. {{(pid=73572) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 10:17:51 user nova-compute[73572]: DEBUG nova.virt.libvirt.guest [None req-6e79aff4-4e23-4967-8efd-5be3a838101a tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 10:17:51 user nova-compute[73572]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 10:17:51 user nova-compute[73572]:   <source dev="/dev/sde"/>
Aug 26 10:17:51 user nova-compute[73572]:   <target dev="vdb" bus="virtio"/>
Aug 26 10:17:51 user nova-compute[73572]:   <serial>ac5c1ee2-3656-49b3-942f-5fc992dc001b</serial>
Aug 26 10:17:51 user nova-compute[73572]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 10:17:51 user nova-compute[73572]: </disk>
Aug 26 10:17:51 user nova-compute[73572]:  {{(pid=73572) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 10:17:51 user nova-compute[73572]: DEBUG nova.network.neutron [req-25acbcd3-3334-405a-b007-01a4c0c21992 req-025aaef5-208c-43a4-b93f-667cebb05470 service nova] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] Updated VIF entry in instance network info cache for port 8bc3e6f9-0fb7-4283-973c-cbb09e440e68. {{(pid=73572) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 10:17:51 user nova-compute[73572]: DEBUG nova.network.neutron [req-25acbcd3-3334-405a-b007-01a4c0c21992 req-025aaef5-208c-43a4-b93f-667cebb05470 service nova] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] Updating instance_info_cache with network_info: [{"id": "123d944e-47d4-4f95-94bc-73e1920ecbc1", "address": "fa:16:3e:95:40:4c", "network": {"id": "ce8484e9-f124-4a9c-9682-289ed99917e2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1080187713-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cf2ae4dd7d3474394090e3276c957ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap123d944e-47", "ovs_interfaceid": "123d944e-47d4-4f95-94bc-73e1920ecbc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "696cd753-312c-437d-b140-c40b4158554e", "address": "fa:16:3e:13:c8:34", "network": {"id": "c0d598c4-68c6-4cfc-adf1-dc0360861788", "bridge": "br-int", "label": "tempest-device-tagging-net1-1696215747", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.77", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7cf2ae4dd7d3474394090e3276c957ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap696cd753-31", "ovs_interfaceid": "696cd753-312c-437d-b140-c40b4158554e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3e7d3f56-193b-43ba-9cc5-c5373755e06f", "address": "fa:16:3e:85:00:8b", "network": {"id": "c0d598c4-68c6-4cfc-adf1-dc0360861788", "bridge": "br-int", "label": "tempest-device-tagging-net1-1696215747", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.177", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7cf2ae4dd7d3474394090e3276c957ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e7d3f56-19", "ovs_interfaceid": "3e7d3f56-193b-43ba-9cc5-c5373755e06f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f264d951-8920-4151-8276-33baa6a9def9", "address": "fa:16:3e:a7:e2:2a", "network": {"id": "c0d598c4-68c6-4cfc-adf1-dc0360861788", "bridge": "br-int", "label": "tempest-device-tagging-net1-1696215747", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7cf2ae4dd7d3474394090e3276c957ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf264d951-89", "ovs_interfaceid": "f264d951-8920-4151-8276-33baa6a9def9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c0c6f2bc-3209-461a-bcc3-edf740139ca2", "address": "fa:16:3e:d1:c7:a5", "network": {"id": "c0d598c4-68c6-4cfc-adf1-dc0360861788", "bridge": "br-int", "label": "tempest-device-tagging-net1-1696215747", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.224", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7cf2ae4dd7d3474394090e3276c957ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0c6f2bc-32", "ovs_interfaceid": "c0c6f2bc-3209-461a-bcc3-edf740139ca2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2fe25c93-5639-47a6-80de-8cc83615e3c4", "address": "fa:16:3e:59:09:63", "network": {"id": "f69a6193-9faf-4224-b21b-bc60491f9aea", "bridge": "br-int", "label": "tempest-device-tagging-net2-1404521418", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7cf2ae4dd7d3474394090e3276c957ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fe25c93-56", "ovs_interfaceid": "2fe25c93-5639-47a6-80de-8cc83615e3c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8bc3e6f9-0fb7-4283-973c-cbb09e440e68", "address": "fa:16:3e:3d:e7:4c", "network": {"id": "f69a6193-9faf-4224-b21b-bc60491f9aea", "bridge": "br-int", "label": "tempest-device-tagging-net2-1404521418", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7cf2ae4dd7d3474394090e3276c957ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bc3e6f9-0f", "ovs_interfaceid": "8bc3e6f9-0fb7-4283-973c-cbb09e440e68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:17:51 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-25acbcd3-3334-405a-b007-01a4c0c21992 req-025aaef5-208c-43a4-b93f-667cebb05470 service nova] Releasing lock "refresh_cache-41c1ef7a-4f98-4cbb-9948-acb96bd9d557" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:17:52 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Received event <DeviceRemovedEvent: 1693045072.009662, c555f971-b177-4c26-a38e-09e0e78bf7b9 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73572) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 10:17:52 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-6e79aff4-4e23-4967-8efd-5be3a838101a tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c555f971-b177-4c26-a38e-09e0e78bf7b9 {{(pid=73572) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 10:17:52 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-6e79aff4-4e23-4967-8efd-5be3a838101a tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] Successfully detached device vdb from instance c555f971-b177-4c26-a38e-09e0e78bf7b9 from the live domain config.
Aug 26 10:17:52 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6e79aff4-4e23-4967-8efd-5be3a838101a tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] [instance: c555f971-b177-4c26-a38e-09e0e78bf7b9] calling os-brick to detach iSCSI Volume {{(pid=73572) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 10:17:52 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e79aff4-4e23-4967-8efd-5be3a838101a tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc89c3d6a10>, {'target_iqns': ['iqn.2010-10.org.openstack:ac5c1ee2-3656-49b3-942f-5fc992dc001b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TqBgdYHa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 10:17:52 user nova-compute[73572]: WARNING os_brick.initiator.connectors.base [None req-6e79aff4-4e23-4967-8efd-5be3a838101a tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 10:17:52 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-6e79aff4-4e23-4967-8efd-5be3a838101a tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 10:17:52 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-6e79aff4-4e23-4967-8efd-5be3a838101a tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 10:17:52 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e79aff4-4e23-4967-8efd-5be3a838101a tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ac5c1ee2-3656-49b3-942f-5fc992dc001b', 0)] {{(pid=73572) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 10:17:52 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:17:52 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:17:52 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[a13b2bb1-7927-491f-86ce-e3ba9d35904e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ac5c1ee2-3656-49b3-942f-5fc992dc001b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:17:52 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:17:52 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:17:52 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[0547e6aa-d3a8-4666-8da4-1320c3a48992]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac5c1ee2-3656-49b3-942f-5fc992dc001b (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478 (non-flash)\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:17:52 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e79aff4-4e23-4967-8efd-5be3a838101a tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac5c1ee2-3656-49b3-942f-5fc992dc001b (non-flash)
Aug 26 10:17:52 user nova-compute[73572]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)
Aug 26 10:17:52 user nova-compute[73572]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478 (non-flash)
Aug 26 10:17:52 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 10:17:52 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e79aff4-4e23-4967-8efd-5be3a838101a tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac5c1ee2-3656-49b3-942f-5fc992dc001b (non-flash)
Aug 26 10:17:52 user nova-compute[73572]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)
Aug 26 10:17:52 user nova-compute[73572]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478 (non-flash)
Aug 26 10:17:52 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 10:17:52 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e79aff4-4e23-4967-8efd-5be3a838101a tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc878d3bac0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ac5c1ee2-3656-49b3-942f-5fc992dc001b'): ({'sde'}, set())}) {{(pid=73572) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 10:17:52 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-6e79aff4-4e23-4967-8efd-5be3a838101a tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] Removing single pathed devices sde {{(pid=73572) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 10:17:52 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:17:52 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:17:52 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[94d8371d-ddcf-424a-95f4-dfd0ad05ba36]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:17:52 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:17:52 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:17:52 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ae6dd05-c022-4ebf-9759-530879e33338]: (4, ('ok\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:17:52 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-6e79aff4-4e23-4967-8efd-5be3a838101a tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] Flushing IO for device /dev/sde {{(pid=73572) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 10:17:52 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:17:52 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:17:52 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[12616d28-ed68-4f6b-8b6e-0d30cd45207b]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:17:52 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-6e79aff4-4e23-4967-8efd-5be3a838101a tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73572) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 10:17:52 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:17:52 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.042s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:17:52 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[0970969a-6dee-4c7c-a292-c94bcb5cb9bf]: (4, ('1', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:17:52 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-6e79aff4-4e23-4967-8efd-5be3a838101a tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73572) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 10:17:52 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-6e79aff4-4e23-4967-8efd-5be3a838101a tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] SCSI volumes sde have been removed. {{(pid=73572) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 10:17:52 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e79aff4-4e23-4967-8efd-5be3a838101a tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ac5c1ee2-3656-49b3-942f-5fc992dc001b')] {{(pid=73572) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 10:17:52 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac5c1ee2-3656-49b3-942f-5fc992dc001b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:17:52 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac5c1ee2-3656-49b3-942f-5fc992dc001b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:17:52 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[72b004df-d7e4-47d0-96aa-41c30cad965b]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:17:52 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e79aff4-4e23-4967-8efd-5be3a838101a tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:17:52 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac5c1ee2-3656-49b3-942f-5fc992dc001b -p 172.16.0.220:3260 --logout {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:17:52 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac5c1ee2-3656-49b3-942f-5fc992dc001b -p 172.16.0.220:3260 --logout" returned: 0 in 0.044s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:17:52 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[58d9d97a-00d4-49a8-b7d8-c06562744651]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:ac5c1ee2-3656-49b3-942f-5fc992dc001b, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:ac5c1ee2-3656-49b3-942f-5fc992dc001b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:17:52 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e79aff4-4e23-4967-8efd-5be3a838101a tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:ac5c1ee2-3656-49b3-942f-5fc992dc001b, portal: 172.16.0.220,3260]
Aug 26 10:17:52 user nova-compute[73572]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:ac5c1ee2-3656-49b3-942f-5fc992dc001b, portal: 172.16.0.220,3260] successful.
Aug 26 10:17:52 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:17:52 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac5c1ee2-3656-49b3-942f-5fc992dc001b -p 172.16.0.220:3260 --op delete {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:17:52 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac5c1ee2-3656-49b3-942f-5fc992dc001b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:17:52 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[56bc7a66-f183-4fb8-99e9-4a5f12f4131b]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:17:52 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e79aff4-4e23-4967-8efd-5be3a838101a tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:17:52 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-6e79aff4-4e23-4967-8efd-5be3a838101a tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.260s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 10:17:52 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e79aff4-4e23-4967-8efd-5be3a838101a tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] <== disconnect_volume: return (261ms) None {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 10:17:52 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6e79aff4-4e23-4967-8efd-5be3a838101a tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] [instance: c555f971-b177-4c26-a38e-09e0e78bf7b9] Disconnected iSCSI Volume {{(pid=73572) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 10:17:52 user nova-compute[73572]: DEBUG nova.compute.manager [None req-a43fc977-4f45-4f43-a35a-0b4564e891c4 tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] [instance: 339517ef-c023-4f13-a8cc-d84f7176dfcd] Start spawning the instance on the hypervisor. {{(pid=73572) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 10:17:52 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-a43fc977-4f45-4f43-a35a-0b4564e891c4 tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] [instance: 339517ef-c023-4f13-a8cc-d84f7176dfcd] Creating instance directory {{(pid=73572) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 10:17:52 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-a43fc977-4f45-4f43-a35a-0b4564e891c4 tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] [instance: 339517ef-c023-4f13-a8cc-d84f7176dfcd] Creating image(s)
Aug 26 10:17:52 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-a43fc977-4f45-4f43-a35a-0b4564e891c4 tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] [instance: 339517ef-c023-4f13-a8cc-d84f7176dfcd] Did not create local disks {{(pid=73572) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 26 10:17:52 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-a43fc977-4f45-4f43-a35a-0b4564e891c4 tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] [instance: 339517ef-c023-4f13-a8cc-d84f7176dfcd] Ensure instance console log exists: /opt/stack/data/nova/instances/339517ef-c023-4f13-a8cc-d84f7176dfcd/console.log {{(pid=73572) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 10:17:52 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-a43fc977-4f45-4f43-a35a-0b4564e891c4 tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:17:52 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-a43fc977-4f45-4f43-a35a-0b4564e891c4 tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:17:52 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-a43fc977-4f45-4f43-a35a-0b4564e891c4 tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:17:52 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-a43fc977-4f45-4f43-a35a-0b4564e891c4 tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] [instance: 339517ef-c023-4f13-a8cc-d84f7176dfcd] Start _get_guest_xml network_info=[{"id": "0545369e-80c9-45cc-a9a2-330705df9241", "address": "fa:16:3e:ae:3c:b5", "network": {"id": "a9900fc6-80c0-41e3-ac1a-4fa11bda2d38", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1804146753-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b5f7c995974418c972eb33e591fab75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0545369e-80", "ovs_interfaceid": "0545369e-80c9-45cc-a9a2-330705df9241", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'disk_bus': 'virtio', 'boot_index': 0, 'mount_device': '/dev/vda', 'attachment_id': '888e4985-ee83-4b83-bfe4-aa9b0c7257b7', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:d94556c8-9096-4e9a-9cfc-f9d17846ed06'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LpSxZEgY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '339517ef-c023-4f13-a8cc-d84f7176dfcd', 'attached_at': '', 'detached_at': '', 'volume_id': 'd94556c8-9096-4e9a-9cfc-f9d17846ed06', 'serial': 'd94556c8-9096-4e9a-9cfc-f9d17846ed06'}, 'guest_format': None, 'device_type': 'disk', 'volume_type': None} {{(pid=73572) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 10:17:52 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-a43fc977-4f45-4f43-a35a-0b4564e891c4 tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:17:52 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-a43fc977-4f45-4f43-a35a-0b4564e891c4 tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:17:52 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-a43fc977-4f45-4f43-a35a-0b4564e891c4 tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73572) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 10:17:52 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-a43fc977-4f45-4f43-a35a-0b4564e891c4 tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] CPU controller missing on host. {{(pid=73572) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 10:17:52 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-a43fc977-4f45-4f43-a35a-0b4564e891c4 tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73572) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 10:17:52 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-a43fc977-4f45-4f43-a35a-0b4564e891c4 tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] CPU controller found on host. {{(pid=73572) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 10:17:52 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-a43fc977-4f45-4f43-a35a-0b4564e891c4 tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73572) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 10:17:52 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-a43fc977-4f45-4f43-a35a-0b4564e891c4 tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T10:07:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 10:17:52 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-a43fc977-4f45-4f43-a35a-0b4564e891c4 tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] Flavor limits 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 10:17:52 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-a43fc977-4f45-4f43-a35a-0b4564e891c4 tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] Image limits 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 10:17:52 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-a43fc977-4f45-4f43-a35a-0b4564e891c4 tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] Flavor pref 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 10:17:52 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-a43fc977-4f45-4f43-a35a-0b4564e891c4 tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] Image pref 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 10:17:52 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-a43fc977-4f45-4f43-a35a-0b4564e891c4 tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 10:17:52 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-a43fc977-4f45-4f43-a35a-0b4564e891c4 tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 10:17:52 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-a43fc977-4f45-4f43-a35a-0b4564e891c4 tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73572) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 10:17:52 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-a43fc977-4f45-4f43-a35a-0b4564e891c4 tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] Got 1 possible topologies {{(pid=73572) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 10:17:52 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-a43fc977-4f45-4f43-a35a-0b4564e891c4 tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 10:17:52 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-a43fc977-4f45-4f43-a35a-0b4564e891c4 tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 10:17:52 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a43fc977-4f45-4f43-a35a-0b4564e891c4 tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] [instance: 339517ef-c023-4f13-a8cc-d84f7176dfcd] Calling os-brick to attach iSCSI Volume {{(pid=73572) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 10:17:52 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-a43fc977-4f45-4f43-a35a-0b4564e891c4 tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc89c3d6a10>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:d94556c8-9096-4e9a-9cfc-f9d17846ed06'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LpSxZEgY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 10:17:52 user nova-compute[73572]: WARNING os_brick.initiator.connectors.base [None req-a43fc977-4f45-4f43-a35a-0b4564e891c4 tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 10:17:52 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-a43fc977-4f45-4f43-a35a-0b4564e891c4 tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 10:17:52 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-a43fc977-4f45-4f43-a35a-0b4564e891c4 tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 10:17:52 user nova-compute[73572]: WARNING os_brick.initiator.connectors.base [None req-a43fc977-4f45-4f43-a35a-0b4564e891c4 tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 10:17:52 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-a43fc977-4f45-4f43-a35a-0b4564e891c4 tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d94556c8-9096-4e9a-9cfc-f9d17846ed06" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 10:17:52 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-a43fc977-4f45-4f43-a35a-0b4564e891c4 tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d94556c8-9096-4e9a-9cfc-f9d17846ed06" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 10:17:52 user nova-compute[73572]: INFO os_brick.initiator.connectors.iscsi [None req-a43fc977-4f45-4f43-a35a-0b4564e891c4 tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 10:17:52 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d94556c8-9096-4e9a-9cfc-f9d17846ed06 -p 172.16.0.220:3260 {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:17:52 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d94556c8-9096-4e9a-9cfc-f9d17846ed06 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:17:52 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[635f90c3-3c0f-44c9-8ac0-55604a91c087]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:17:52 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-a43fc977-4f45-4f43-a35a-0b4564e891c4 tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 10:17:52 user nova-compute[73572]:  {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:17:52 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d94556c8-9096-4e9a-9cfc-f9d17846ed06 -p 172.16.0.220:3260 --interface default --op new {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:17:52 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d94556c8-9096-4e9a-9cfc-f9d17846ed06 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:17:52 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[d47901c4-20ce-48c9-abcb-d9f35847b1a0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d94556c8-9096-4e9a-9cfc-f9d17846ed06] added\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:17:52 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-a43fc977-4f45-4f43-a35a-0b4564e891c4 tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d94556c8-9096-4e9a-9cfc-f9d17846ed06] added
Aug 26 10:17:52 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:17:52 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d94556c8-9096-4e9a-9cfc-f9d17846ed06 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:17:52 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d94556c8-9096-4e9a-9cfc-f9d17846ed06 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:17:52 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[b04f0bd6-7bdd-4758-9cfb-eb7c7ea8eb25]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:17:52 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-a43fc977-4f45-4f43-a35a-0b4564e891c4 tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:17:52 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d94556c8-9096-4e9a-9cfc-f9d17846ed06 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:17:52 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d94556c8-9096-4e9a-9cfc-f9d17846ed06 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:17:52 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[2475e188-86dd-4088-938a-7e6bf84fe01d]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:17:52 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-a43fc977-4f45-4f43-a35a-0b4564e891c4 tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:17:52 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d94556c8-9096-4e9a-9cfc-f9d17846ed06 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LpSxZEgY {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:17:52 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d94556c8-9096-4e9a-9cfc-f9d17846ed06 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LpSxZEgY" returned: 0 in 0.018s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:17:52 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[40bc5055-0e99-486a-8f02-f75ff1cd24e3]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:17:52 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-a43fc977-4f45-4f43-a35a-0b4564e891c4 tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LpSxZEgY'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:17:52 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d94556c8-9096-4e9a-9cfc-f9d17846ed06 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:17:52 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d94556c8-9096-4e9a-9cfc-f9d17846ed06 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:17:52 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef84319a-6eaf-48d0-aece-35d691ed3004]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:17:52 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-a43fc977-4f45-4f43-a35a-0b4564e891c4 tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:17:52 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:17:52 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:17:52 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc69d406-1d84-4a5c-8e58-7f7fc856f96d]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478 (non-flash)\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:17:52 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-a43fc977-4f45-4f43-a35a-0b4564e891c4 tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)
Aug 26 10:17:52 user nova-compute[73572]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478 (non-flash)
Aug 26 10:17:52 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 10:17:52 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-a43fc977-4f45-4f43-a35a-0b4564e891c4 tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)
Aug 26 10:17:52 user nova-compute[73572]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478 (non-flash)
Aug 26 10:17:52 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 10:17:52 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d94556c8-9096-4e9a-9cfc-f9d17846ed06 -p 172.16.0.220:3260 --login {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:17:53 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d94556c8-9096-4e9a-9cfc-f9d17846ed06 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:17:53 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cf66d88-b249-49f7-a45b-7076770c3ce8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d94556c8-9096-4e9a-9cfc-f9d17846ed06, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d94556c8-9096-4e9a-9cfc-f9d17846ed06, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:17:53 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-a43fc977-4f45-4f43-a35a-0b4564e891c4 tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d94556c8-9096-4e9a-9cfc-f9d17846ed06, portal: 172.16.0.220,3260]
Aug 26 10:17:53 user nova-compute[73572]: Login to [iface: default, target: iqn.2010-10.org.openstack:d94556c8-9096-4e9a-9cfc-f9d17846ed06, portal: 172.16.0.220,3260] successful.
Aug 26 10:17:53 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:17:53 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d94556c8-9096-4e9a-9cfc-f9d17846ed06 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:17:53 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d94556c8-9096-4e9a-9cfc-f9d17846ed06 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:17:53 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea9f4503-84f2-46bf-baaa-8773adc71d24]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:17:53 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-a43fc977-4f45-4f43-a35a-0b4564e891c4 tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:17:53 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:17:53 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-50e218f3-f901-4235-bd89-e3cb24d044f2 tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] Acquiring lock "ee9bcbaa-25a6-4588-b757-2a2ae15b6cf8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:17:53 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-50e218f3-f901-4235-bd89-e3cb24d044f2 tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] Lock "ee9bcbaa-25a6-4588-b757-2a2ae15b6cf8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:17:53 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-50e218f3-f901-4235-bd89-e3cb24d044f2 tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] Acquiring lock "ee9bcbaa-25a6-4588-b757-2a2ae15b6cf8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:17:53 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-50e218f3-f901-4235-bd89-e3cb24d044f2 tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] Lock "ee9bcbaa-25a6-4588-b757-2a2ae15b6cf8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:17:53 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-50e218f3-f901-4235-bd89-e3cb24d044f2 tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] Lock "ee9bcbaa-25a6-4588-b757-2a2ae15b6cf8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:17:53 user nova-compute[73572]: INFO nova.compute.manager [None req-50e218f3-f901-4235-bd89-e3cb24d044f2 tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] [instance: ee9bcbaa-25a6-4588-b757-2a2ae15b6cf8] Terminating instance
Aug 26 10:17:53 user nova-compute[73572]: DEBUG nova.compute.manager [None req-50e218f3-f901-4235-bd89-e3cb24d044f2 tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] [instance: ee9bcbaa-25a6-4588-b757-2a2ae15b6cf8] Start destroying the instance on the hypervisor. {{(pid=73572) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 10:17:53 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:17:53 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[b24ab4bf-84cf-4452-abdb-6c2ffd704bfe]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d94556c8-9096-4e9a-9cfc-f9d17846ed06 (non-flash)\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:17:53 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-a43fc977-4f45-4f43-a35a-0b4564e891c4 tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)
Aug 26 10:17:53 user nova-compute[73572]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478 (non-flash)
Aug 26 10:17:53 user nova-compute[73572]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d94556c8-9096-4e9a-9cfc-f9d17846ed06 (non-flash)
Aug 26 10:17:53 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 10:17:53 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-a43fc977-4f45-4f43-a35a-0b4564e891c4 tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)
Aug 26 10:17:53 user nova-compute[73572]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478 (non-flash)
Aug 26 10:17:53 user nova-compute[73572]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d94556c8-9096-4e9a-9cfc-f9d17846ed06 (non-flash)
Aug 26 10:17:53 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 10:17:53 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-a43fc977-4f45-4f43-a35a-0b4564e891c4 tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d94556c8-9096-4e9a-9cfc-f9d17846ed06" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.309s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 10:17:53 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-a43fc977-4f45-4f43-a35a-0b4564e891c4 tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] Connected to 172.16.0.220:3260 {{(pid=73572) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 10:17:53 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-a43fc977-4f45-4f43-a35a-0b4564e891c4 tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] HCTL ('34', '-', '-', 0) found on session 16 with lun 0 {{(pid=73572) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 10:17:53 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-a43fc977-4f45-4f43-a35a-0b4564e891c4 tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73572) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 10:17:53 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:17:53 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:17:53 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[6872f657-529a-4968-87b3-ef67dc1e86a0]: (4, ('- - 0', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:17:53 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-a43fc977-4f45-4f43-a35a-0b4564e891c4 tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] Searching for a device in session 16 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73572) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 10:17:53 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-a43fc977-4f45-4f43-a35a-0b4564e891c4 tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LpSxZEgY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73572) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 10:17:53 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:17:53 user nova-compute[73572]: DEBUG nova.objects.instance [None req-6e79aff4-4e23-4967-8efd-5be3a838101a tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] Lazy-loading 'flavor' on Instance uuid c555f971-b177-4c26-a38e-09e0e78bf7b9 {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:17:53 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:17:53 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:17:53 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-6e79aff4-4e23-4967-8efd-5be3a838101a tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] Lock "c555f971-b177-4c26-a38e-09e0e78bf7b9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.788s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:17:53 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:17:53 user nova-compute[73572]: DEBUG nova.compute.manager [req-04c79ff8-73f1-40b8-9ee8-126662fda73d req-60362095-0015-4449-9e25-755432460f00 service nova] [instance: ee9bcbaa-25a6-4588-b757-2a2ae15b6cf8] Received event network-vif-unplugged-f47d01ad-ade6-4b38-8b96-ea183c06134c {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:17:53 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-04c79ff8-73f1-40b8-9ee8-126662fda73d req-60362095-0015-4449-9e25-755432460f00 service nova] Acquiring lock "ee9bcbaa-25a6-4588-b757-2a2ae15b6cf8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:17:53 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-04c79ff8-73f1-40b8-9ee8-126662fda73d req-60362095-0015-4449-9e25-755432460f00 service nova] Lock "ee9bcbaa-25a6-4588-b757-2a2ae15b6cf8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:17:53 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-04c79ff8-73f1-40b8-9ee8-126662fda73d req-60362095-0015-4449-9e25-755432460f00 service nova] Lock "ee9bcbaa-25a6-4588-b757-2a2ae15b6cf8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:17:53 user nova-compute[73572]: DEBUG nova.compute.manager [req-04c79ff8-73f1-40b8-9ee8-126662fda73d req-60362095-0015-4449-9e25-755432460f00 service nova] [instance: ee9bcbaa-25a6-4588-b757-2a2ae15b6cf8] No waiting events found dispatching network-vif-unplugged-f47d01ad-ade6-4b38-8b96-ea183c06134c {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:17:53 user nova-compute[73572]: DEBUG nova.compute.manager [req-04c79ff8-73f1-40b8-9ee8-126662fda73d req-60362095-0015-4449-9e25-755432460f00 service nova] [instance: ee9bcbaa-25a6-4588-b757-2a2ae15b6cf8] Received event network-vif-unplugged-f47d01ad-ade6-4b38-8b96-ea183c06134c for instance with task_state deleting. {{(pid=73572) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 10:17:54 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:17:54 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:17:54 user nova-compute[73572]: INFO nova.virt.libvirt.driver [-] [instance: ee9bcbaa-25a6-4588-b757-2a2ae15b6cf8] Instance destroyed successfully.
Aug 26 10:17:54 user nova-compute[73572]: DEBUG nova.objects.instance [None req-50e218f3-f901-4235-bd89-e3cb24d044f2 tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] Lazy-loading 'resources' on Instance uuid ee9bcbaa-25a6-4588-b757-2a2ae15b6cf8 {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:17:54 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-50e218f3-f901-4235-bd89-e3cb24d044f2 tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T10:11:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1079910466',display_name='tempest-VolumesAdminNegativeTest-server-1079910466',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1079910466',id=5,image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCaJcau7rrfdR3HBjlRDbFHBk+A8rThFiajgOy3KSx+oiPaFDl3xNbwQP3H0+I+NPSaumYh7Y24HyFBNaBDT6hnhIjJIzrW4M9QvwFAosaQa3iWtxP6Z66yPtDZS5WHqMg==',key_name='tempest-keypair-624891862',keypairs=<?>,launch_index=0,launched_at=2023-08-26T10:11:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a9898b65714845e7aea403cc39182df7',ramdisk_id='',reservation_id='r-ungn8o0c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-119088495',owner_user_name='tempest-VolumesAdminNegativeTest-119088495-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T10:11:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fe58afb632fe4189a29df22dc61fb0ae',uuid=ee9bcbaa-25a6-4588-b757-2a2ae15b6cf8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f47d01ad-ade6-4b38-8b96-ea183c06134c", "address": "fa:16:3e:f9:ca:45", "network": {"id": "529bb981-16ba-47c5-afb0-55f4aa577ecc", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-265382654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9898b65714845e7aea403cc39182df7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf47d01ad-ad", "ovs_interfaceid": "f47d01ad-ade6-4b38-8b96-ea183c06134c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 10:17:54 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-50e218f3-f901-4235-bd89-e3cb24d044f2 tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] Converting VIF {"id": "f47d01ad-ade6-4b38-8b96-ea183c06134c", "address": "fa:16:3e:f9:ca:45", "network": {"id": "529bb981-16ba-47c5-afb0-55f4aa577ecc", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-265382654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9898b65714845e7aea403cc39182df7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf47d01ad-ad", "ovs_interfaceid": "f47d01ad-ade6-4b38-8b96-ea183c06134c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:17:54 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-50e218f3-f901-4235-bd89-e3cb24d044f2 tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f9:ca:45,bridge_name='br-int',has_traffic_filtering=True,id=f47d01ad-ade6-4b38-8b96-ea183c06134c,network=Network(529bb981-16ba-47c5-afb0-55f4aa577ecc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf47d01ad-ad') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:17:54 user nova-compute[73572]: DEBUG os_vif [None req-50e218f3-f901-4235-bd89-e3cb24d044f2 tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f9:ca:45,bridge_name='br-int',has_traffic_filtering=True,id=f47d01ad-ade6-4b38-8b96-ea183c06134c,network=Network(529bb981-16ba-47c5-afb0-55f4aa577ecc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf47d01ad-ad') {{(pid=73572) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 10:17:54 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:17:54 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf47d01ad-ad, bridge=br-int, if_exists=True) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:17:54 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:17:54 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:17:54 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:17:54 user nova-compute[73572]: INFO os_vif [None req-50e218f3-f901-4235-bd89-e3cb24d044f2 tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f9:ca:45,bridge_name='br-int',has_traffic_filtering=True,id=f47d01ad-ade6-4b38-8b96-ea183c06134c,network=Network(529bb981-16ba-47c5-afb0-55f4aa577ecc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf47d01ad-ad')
Aug 26 10:17:54 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-50e218f3-f901-4235-bd89-e3cb24d044f2 tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] [instance: ee9bcbaa-25a6-4588-b757-2a2ae15b6cf8] Deleting instance files /opt/stack/data/nova/instances/ee9bcbaa-25a6-4588-b757-2a2ae15b6cf8_del
Aug 26 10:17:54 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-50e218f3-f901-4235-bd89-e3cb24d044f2 tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] [instance: ee9bcbaa-25a6-4588-b757-2a2ae15b6cf8] Deletion of /opt/stack/data/nova/instances/ee9bcbaa-25a6-4588-b757-2a2ae15b6cf8_del complete
Aug 26 10:17:54 user nova-compute[73572]: INFO nova.compute.manager [None req-50e218f3-f901-4235-bd89-e3cb24d044f2 tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] [instance: ee9bcbaa-25a6-4588-b757-2a2ae15b6cf8] Took 1.01 seconds to destroy the instance on the hypervisor.
Aug 26 10:17:54 user nova-compute[73572]: DEBUG oslo.service.loopingcall [None req-50e218f3-f901-4235-bd89-e3cb24d044f2 tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73572) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 10:17:54 user nova-compute[73572]: DEBUG nova.compute.manager [-] [instance: ee9bcbaa-25a6-4588-b757-2a2ae15b6cf8] Deallocating network for instance {{(pid=73572) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 10:17:54 user nova-compute[73572]: DEBUG nova.network.neutron [-] [instance: ee9bcbaa-25a6-4588-b757-2a2ae15b6cf8] deallocate_for_instance() {{(pid=73572) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 10:17:54 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-a43fc977-4f45-4f43-a35a-0b4564e891c4 tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.339s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 10:17:54 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-a43fc977-4f45-4f43-a35a-0b4564e891c4 tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] <== connect_volume: return (1341ms) {'type': 'block', 'scsi_wwn': '23533393162623765', 'path': '/dev/sdc'} {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 10:17:54 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a43fc977-4f45-4f43-a35a-0b4564e891c4 tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] [instance: 339517ef-c023-4f13-a8cc-d84f7176dfcd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23533393162623765', 'path': '/dev/sdc'} {{(pid=73572) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 10:17:54 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-a43fc977-4f45-4f43-a35a-0b4564e891c4 tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T10:17:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1130623721',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1130623721',id=21,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM9/VU/54cn1RTubtcb6hoKsYPJi5XFbRq9x7ny9CP4siDdaewzHcyj5+OCk5iyU32xzxXp4A9oDvslVWxMVLkr28kptlrAJWcCk28e8n8Kp7D+Tf1GW4OZmlFm8Y1MOSQ==',key_name='tempest-keypair-1829288947',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3b5f7c995974418c972eb33e591fab75',ramdisk_id='',reservation_id='r-ol5nmpv7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-182410381',owner_user_name='tempest-ServerActionsV293TestJSON-182410381-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T10:17:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4ab4c737924c4e8da6b35cdb4051c3be',uuid=339517ef-c023-4f13-a8cc-d84f7176dfcd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0545369e-80c9-45cc-a9a2-330705df9241", "address": "fa:16:3e:ae:3c:b5", "network": {"id": "a9900fc6-80c0-41e3-ac1a-4fa11bda2d38", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1804146753-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b5f7c995974418c972eb33e591fab75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0545369e-80", "ovs_interfaceid": "0545369e-80c9-45cc-a9a2-330705df9241", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73572) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 10:17:54 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-a43fc977-4f45-4f43-a35a-0b4564e891c4 tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] Converting VIF {"id": "0545369e-80c9-45cc-a9a2-330705df9241", "address": "fa:16:3e:ae:3c:b5", "network": {"id": "a9900fc6-80c0-41e3-ac1a-4fa11bda2d38", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1804146753-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b5f7c995974418c972eb33e591fab75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0545369e-80", "ovs_interfaceid": "0545369e-80c9-45cc-a9a2-330705df9241", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:17:54 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-a43fc977-4f45-4f43-a35a-0b4564e891c4 tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:3c:b5,bridge_name='br-int',has_traffic_filtering=True,id=0545369e-80c9-45cc-a9a2-330705df9241,network=Network(a9900fc6-80c0-41e3-ac1a-4fa11bda2d38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0545369e-80') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:17:54 user nova-compute[73572]: DEBUG nova.objects.instance [None req-a43fc977-4f45-4f43-a35a-0b4564e891c4 tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] Lazy-loading 'pci_devices' on Instance uuid 339517ef-c023-4f13-a8cc-d84f7176dfcd {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:17:54 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-a43fc977-4f45-4f43-a35a-0b4564e891c4 tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] [instance: 339517ef-c023-4f13-a8cc-d84f7176dfcd] End _get_guest_xml xml=<domain type="kvm">
Aug 26 10:17:54 user nova-compute[73572]:   <uuid>339517ef-c023-4f13-a8cc-d84f7176dfcd</uuid>
Aug 26 10:17:54 user nova-compute[73572]:   <name>instance-00000015</name>
Aug 26 10:17:54 user nova-compute[73572]:   <memory>524288</memory>
Aug 26 10:17:54 user nova-compute[73572]:   <vcpu>1</vcpu>
Aug 26 10:17:54 user nova-compute[73572]:   <metadata>
Aug 26 10:17:54 user nova-compute[73572]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 10:17:54 user nova-compute[73572]:       <nova:package version="0.0.0"/>
Aug 26 10:17:54 user nova-compute[73572]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1130623721</nova:name>
Aug 26 10:17:54 user nova-compute[73572]:       <nova:creationTime>2023-08-26 10:17:52</nova:creationTime>
Aug 26 10:17:54 user nova-compute[73572]:       <nova:flavor name="m1.tiny">
Aug 26 10:17:54 user nova-compute[73572]:         <nova:memory>512</nova:memory>
Aug 26 10:17:54 user nova-compute[73572]:         <nova:disk>1</nova:disk>
Aug 26 10:17:54 user nova-compute[73572]:         <nova:swap>0</nova:swap>
Aug 26 10:17:54 user nova-compute[73572]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 10:17:54 user nova-compute[73572]:         <nova:vcpus>1</nova:vcpus>
Aug 26 10:17:54 user nova-compute[73572]:       </nova:flavor>
Aug 26 10:17:54 user nova-compute[73572]:       <nova:owner>
Aug 26 10:17:54 user nova-compute[73572]:         <nova:user uuid="4ab4c737924c4e8da6b35cdb4051c3be">tempest-ServerActionsV293TestJSON-182410381-project-member</nova:user>
Aug 26 10:17:54 user nova-compute[73572]:         <nova:project uuid="3b5f7c995974418c972eb33e591fab75">tempest-ServerActionsV293TestJSON-182410381</nova:project>
Aug 26 10:17:54 user nova-compute[73572]:       </nova:owner>
Aug 26 10:17:54 user nova-compute[73572]:       <nova:ports>
Aug 26 10:17:54 user nova-compute[73572]:         <nova:port uuid="0545369e-80c9-45cc-a9a2-330705df9241">
Aug 26 10:17:54 user nova-compute[73572]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 26 10:17:54 user nova-compute[73572]:         </nova:port>
Aug 26 10:17:54 user nova-compute[73572]:       </nova:ports>
Aug 26 10:17:54 user nova-compute[73572]:     </nova:instance>
Aug 26 10:17:54 user nova-compute[73572]:   </metadata>
Aug 26 10:17:54 user nova-compute[73572]:   <sysinfo type="smbios">
Aug 26 10:17:54 user nova-compute[73572]:     <system>
Aug 26 10:17:54 user nova-compute[73572]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 10:17:54 user nova-compute[73572]:       <entry name="product">OpenStack Nova</entry>
Aug 26 10:17:54 user nova-compute[73572]:       <entry name="version">0.0.0</entry>
Aug 26 10:17:54 user nova-compute[73572]:       <entry name="serial">339517ef-c023-4f13-a8cc-d84f7176dfcd</entry>
Aug 26 10:17:54 user nova-compute[73572]:       <entry name="uuid">339517ef-c023-4f13-a8cc-d84f7176dfcd</entry>
Aug 26 10:17:54 user nova-compute[73572]:       <entry name="family">Virtual Machine</entry>
Aug 26 10:17:54 user nova-compute[73572]:     </system>
Aug 26 10:17:54 user nova-compute[73572]:   </sysinfo>
Aug 26 10:17:54 user nova-compute[73572]:   <os>
Aug 26 10:17:54 user nova-compute[73572]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 10:17:54 user nova-compute[73572]:     <boot dev="hd"/>
Aug 26 10:17:54 user nova-compute[73572]:     <smbios mode="sysinfo"/>
Aug 26 10:17:54 user nova-compute[73572]:   </os>
Aug 26 10:17:54 user nova-compute[73572]:   <features>
Aug 26 10:17:54 user nova-compute[73572]:     <acpi/>
Aug 26 10:17:54 user nova-compute[73572]:     <apic/>
Aug 26 10:17:54 user nova-compute[73572]:     <vmcoreinfo/>
Aug 26 10:17:54 user nova-compute[73572]:   </features>
Aug 26 10:17:54 user nova-compute[73572]:   <clock offset="utc">
Aug 26 10:17:54 user nova-compute[73572]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 10:17:54 user nova-compute[73572]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 10:17:54 user nova-compute[73572]:     <timer name="hpet" present="no"/>
Aug 26 10:17:54 user nova-compute[73572]:   </clock>
Aug 26 10:17:54 user nova-compute[73572]:   <cpu mode="custom" match="exact">
Aug 26 10:17:54 user nova-compute[73572]:     <model>Nehalem</model>
Aug 26 10:17:54 user nova-compute[73572]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 10:17:54 user nova-compute[73572]:   </cpu>
Aug 26 10:17:54 user nova-compute[73572]:   <devices>
Aug 26 10:17:54 user nova-compute[73572]:     <disk type="block" device="disk">
Aug 26 10:17:54 user nova-compute[73572]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 10:17:54 user nova-compute[73572]:       <source dev="/dev/sdc"/>
Aug 26 10:17:54 user nova-compute[73572]:       <target dev="vda" bus="virtio"/>
Aug 26 10:17:54 user nova-compute[73572]:       <serial>d94556c8-9096-4e9a-9cfc-f9d17846ed06</serial>
Aug 26 10:17:54 user nova-compute[73572]:     </disk>
Aug 26 10:17:54 user nova-compute[73572]:     <interface type="ethernet">
Aug 26 10:17:54 user nova-compute[73572]:       <mac address="fa:16:3e:ae:3c:b5"/>
Aug 26 10:17:54 user nova-compute[73572]:       <model type="virtio"/>
Aug 26 10:17:54 user nova-compute[73572]:       <mtu size="1442"/>
Aug 26 10:17:54 user nova-compute[73572]:       <target dev="tap0545369e-80"/>
Aug 26 10:17:54 user nova-compute[73572]:     </interface>
Aug 26 10:17:54 user nova-compute[73572]:     <serial type="pty">
Aug 26 10:17:54 user nova-compute[73572]:       <log file="/opt/stack/data/nova/instances/339517ef-c023-4f13-a8cc-d84f7176dfcd/console.log" append="off"/>
Aug 26 10:17:54 user nova-compute[73572]:     </serial>
Aug 26 10:17:54 user nova-compute[73572]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 10:17:54 user nova-compute[73572]:     <video>
Aug 26 10:17:54 user nova-compute[73572]:       <model type="virtio"/>
Aug 26 10:17:54 user nova-compute[73572]:     </video>
Aug 26 10:17:54 user nova-compute[73572]:     <rng model="virtio">
Aug 26 10:17:54 user nova-compute[73572]:       <backend model="random">/dev/urandom</backend>
Aug 26 10:17:54 user nova-compute[73572]:     </rng>
Aug 26 10:17:54 user nova-compute[73572]:     <controller type="usb" index="0" model="none"/>
Aug 26 10:17:54 user nova-compute[73572]:     <memballoon model="virtio">
Aug 26 10:17:54 user nova-compute[73572]:       <stats period="10"/>
Aug 26 10:17:54 user nova-compute[73572]:     </memballoon>
Aug 26 10:17:54 user nova-compute[73572]:   </devices>
Aug 26 10:17:54 user nova-compute[73572]: </domain>
Aug 26 10:17:54 user nova-compute[73572]:  {{(pid=73572) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 10:17:54 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-a43fc977-4f45-4f43-a35a-0b4564e891c4 tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T10:17:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1130623721',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1130623721',id=21,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM9/VU/54cn1RTubtcb6hoKsYPJi5XFbRq9x7ny9CP4siDdaewzHcyj5+OCk5iyU32xzxXp4A9oDvslVWxMVLkr28kptlrAJWcCk28e8n8Kp7D+Tf1GW4OZmlFm8Y1MOSQ==',key_name='tempest-keypair-1829288947',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3b5f7c995974418c972eb33e591fab75',ramdisk_id='',reservation_id='r-ol5nmpv7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-182410381',owner_user_name='tempest-ServerActionsV293TestJSON-182410381-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T10:17:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4ab4c737924c4e8da6b35cdb4051c3be',uuid=339517ef-c023-4f13-a8cc-d84f7176dfcd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0545369e-80c9-45cc-a9a2-330705df9241", "address": "fa:16:3e:ae:3c:b5", "network": {"id": "a9900fc6-80c0-41e3-ac1a-4fa11bda2d38", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1804146753-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b5f7c995974418c972eb33e591fab75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0545369e-80", "ovs_interfaceid": "0545369e-80c9-45cc-a9a2-330705df9241", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 10:17:54 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-a43fc977-4f45-4f43-a35a-0b4564e891c4 tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] Converting VIF {"id": "0545369e-80c9-45cc-a9a2-330705df9241", "address": "fa:16:3e:ae:3c:b5", "network": {"id": "a9900fc6-80c0-41e3-ac1a-4fa11bda2d38", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1804146753-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b5f7c995974418c972eb33e591fab75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0545369e-80", "ovs_interfaceid": "0545369e-80c9-45cc-a9a2-330705df9241", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:17:54 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-a43fc977-4f45-4f43-a35a-0b4564e891c4 tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:3c:b5,bridge_name='br-int',has_traffic_filtering=True,id=0545369e-80c9-45cc-a9a2-330705df9241,network=Network(a9900fc6-80c0-41e3-ac1a-4fa11bda2d38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0545369e-80') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:17:54 user nova-compute[73572]: DEBUG os_vif [None req-a43fc977-4f45-4f43-a35a-0b4564e891c4 tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:3c:b5,bridge_name='br-int',has_traffic_filtering=True,id=0545369e-80c9-45cc-a9a2-330705df9241,network=Network(a9900fc6-80c0-41e3-ac1a-4fa11bda2d38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0545369e-80') {{(pid=73572) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 10:17:54 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:17:54 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:17:54 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 10:17:54 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:17:54 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0545369e-80, may_exist=True, interface_attrs={}) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:17:54 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0545369e-80, col_values=(('external_ids', {'iface-id': '0545369e-80c9-45cc-a9a2-330705df9241', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ae:3c:b5', 'vm-uuid': '339517ef-c023-4f13-a8cc-d84f7176dfcd'}),), if_exists=True) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:17:54 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:17:54 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:17:54 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:17:54 user nova-compute[73572]: INFO os_vif [None req-a43fc977-4f45-4f43-a35a-0b4564e891c4 tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:3c:b5,bridge_name='br-int',has_traffic_filtering=True,id=0545369e-80c9-45cc-a9a2-330705df9241,network=Network(a9900fc6-80c0-41e3-ac1a-4fa11bda2d38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0545369e-80')
Aug 26 10:17:54 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-a43fc977-4f45-4f43-a35a-0b4564e891c4 tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] No BDM found with device name vda, not building metadata. {{(pid=73572) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 10:17:54 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-a43fc977-4f45-4f43-a35a-0b4564e891c4 tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] No VIF found with MAC fa:16:3e:ae:3c:b5, not building metadata {{(pid=73572) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 10:17:54 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:17:54 user nova-compute[73572]: DEBUG nova.network.neutron [-] [instance: ee9bcbaa-25a6-4588-b757-2a2ae15b6cf8] Updating instance_info_cache with network_info: [] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:17:55 user nova-compute[73572]: DEBUG nova.compute.manager [req-0f0191a1-ec23-43ec-9cd4-b20e11bc3ea2 req-5767fe2a-8188-4cf2-9aa4-cd5210ae5a09 service nova] [instance: ee9bcbaa-25a6-4588-b757-2a2ae15b6cf8] Received event network-vif-deleted-f47d01ad-ade6-4b38-8b96-ea183c06134c {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:17:55 user nova-compute[73572]: INFO nova.compute.manager [req-0f0191a1-ec23-43ec-9cd4-b20e11bc3ea2 req-5767fe2a-8188-4cf2-9aa4-cd5210ae5a09 service nova] [instance: ee9bcbaa-25a6-4588-b757-2a2ae15b6cf8] Neutron deleted interface f47d01ad-ade6-4b38-8b96-ea183c06134c; detaching it from the instance and deleting it from the info cache
Aug 26 10:17:55 user nova-compute[73572]: DEBUG nova.network.neutron [req-0f0191a1-ec23-43ec-9cd4-b20e11bc3ea2 req-5767fe2a-8188-4cf2-9aa4-cd5210ae5a09 service nova] [instance: ee9bcbaa-25a6-4588-b757-2a2ae15b6cf8] Updating instance_info_cache with network_info: [] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:17:55 user nova-compute[73572]: INFO nova.compute.manager [-] [instance: ee9bcbaa-25a6-4588-b757-2a2ae15b6cf8] Took 0.94 seconds to deallocate network for instance.
Aug 26 10:17:55 user nova-compute[73572]: DEBUG nova.compute.manager [req-0f0191a1-ec23-43ec-9cd4-b20e11bc3ea2 req-5767fe2a-8188-4cf2-9aa4-cd5210ae5a09 service nova] [instance: ee9bcbaa-25a6-4588-b757-2a2ae15b6cf8] Detach interface failed, port_id=f47d01ad-ade6-4b38-8b96-ea183c06134c, reason: Instance ee9bcbaa-25a6-4588-b757-2a2ae15b6cf8 could not be found. {{(pid=73572) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 10:17:55 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-50e218f3-f901-4235-bd89-e3cb24d044f2 tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:17:55 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-50e218f3-f901-4235-bd89-e3cb24d044f2 tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:17:55 user nova-compute[73572]: DEBUG nova.compute.provider_tree [None req-50e218f3-f901-4235-bd89-e3cb24d044f2 tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] Inventory has not changed in ProviderTree for provider: e2cec974-59b2-4c77-a53d-a7f4e5a30d75 {{(pid=73572) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 10:17:55 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-50e218f3-f901-4235-bd89-e3cb24d044f2 tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] Inventory has not changed for provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73572) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 10:17:55 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-50e218f3-f901-4235-bd89-e3cb24d044f2 tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.366s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:17:55 user nova-compute[73572]: INFO nova.scheduler.client.report [None req-50e218f3-f901-4235-bd89-e3cb24d044f2 tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] Deleted allocations for instance ee9bcbaa-25a6-4588-b757-2a2ae15b6cf8
Aug 26 10:17:55 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:17:55 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:17:55 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:17:55 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:17:55 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-50e218f3-f901-4235-bd89-e3cb24d044f2 tempest-VolumesAdminNegativeTest-119088495 tempest-VolumesAdminNegativeTest-119088495-project-member] Lock "ee9bcbaa-25a6-4588-b757-2a2ae15b6cf8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.567s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:17:55 user nova-compute[73572]: DEBUG nova.compute.manager [req-7c5e37ae-6ddf-4626-8882-189ee05fe807 req-a4c64755-5f2f-4c6d-8255-5e9672116911 service nova] [instance: ee9bcbaa-25a6-4588-b757-2a2ae15b6cf8] Received event network-vif-plugged-f47d01ad-ade6-4b38-8b96-ea183c06134c {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:17:55 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-7c5e37ae-6ddf-4626-8882-189ee05fe807 req-a4c64755-5f2f-4c6d-8255-5e9672116911 service nova] Acquiring lock "ee9bcbaa-25a6-4588-b757-2a2ae15b6cf8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:17:55 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-7c5e37ae-6ddf-4626-8882-189ee05fe807 req-a4c64755-5f2f-4c6d-8255-5e9672116911 service nova] Lock "ee9bcbaa-25a6-4588-b757-2a2ae15b6cf8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:17:55 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-7c5e37ae-6ddf-4626-8882-189ee05fe807 req-a4c64755-5f2f-4c6d-8255-5e9672116911 service nova] Lock "ee9bcbaa-25a6-4588-b757-2a2ae15b6cf8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:17:55 user nova-compute[73572]: DEBUG nova.compute.manager [req-7c5e37ae-6ddf-4626-8882-189ee05fe807 req-a4c64755-5f2f-4c6d-8255-5e9672116911 service nova] [instance: ee9bcbaa-25a6-4588-b757-2a2ae15b6cf8] No waiting events found dispatching network-vif-plugged-f47d01ad-ade6-4b38-8b96-ea183c06134c {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:17:55 user nova-compute[73572]: WARNING nova.compute.manager [req-7c5e37ae-6ddf-4626-8882-189ee05fe807 req-a4c64755-5f2f-4c6d-8255-5e9672116911 service nova] [instance: ee9bcbaa-25a6-4588-b757-2a2ae15b6cf8] Received unexpected event network-vif-plugged-f47d01ad-ade6-4b38-8b96-ea183c06134c for instance with vm_state deleted and task_state None.
Aug 26 10:17:56 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:17:56 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:17:56 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:17:56 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:17:56 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:17:57 user nova-compute[73572]: DEBUG nova.virt.driver [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Emitting event <LifecycleEvent: 1693045077.7186096, 339517ef-c023-4f13-a8cc-d84f7176dfcd => Resumed> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:17:57 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 339517ef-c023-4f13-a8cc-d84f7176dfcd] VM Resumed (Lifecycle Event)
Aug 26 10:17:57 user nova-compute[73572]: DEBUG nova.compute.manager [None req-a43fc977-4f45-4f43-a35a-0b4564e891c4 tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] [instance: 339517ef-c023-4f13-a8cc-d84f7176dfcd] Instance event wait completed in 0 seconds for  {{(pid=73572) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 10:17:57 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-a43fc977-4f45-4f43-a35a-0b4564e891c4 tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] [instance: 339517ef-c023-4f13-a8cc-d84f7176dfcd] Guest created on hypervisor {{(pid=73572) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 10:17:57 user nova-compute[73572]: INFO nova.virt.libvirt.driver [-] [instance: 339517ef-c023-4f13-a8cc-d84f7176dfcd] Instance spawned successfully.
Aug 26 10:17:57 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-a43fc977-4f45-4f43-a35a-0b4564e891c4 tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] [instance: 339517ef-c023-4f13-a8cc-d84f7176dfcd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 10:17:57 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 339517ef-c023-4f13-a8cc-d84f7176dfcd] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:17:57 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 339517ef-c023-4f13-a8cc-d84f7176dfcd] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73572) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 10:17:57 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-a43fc977-4f45-4f43-a35a-0b4564e891c4 tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] [instance: 339517ef-c023-4f13-a8cc-d84f7176dfcd] Found default for hw_cdrom_bus of ide {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:17:57 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-a43fc977-4f45-4f43-a35a-0b4564e891c4 tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] [instance: 339517ef-c023-4f13-a8cc-d84f7176dfcd] Found default for hw_disk_bus of virtio {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:17:57 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-a43fc977-4f45-4f43-a35a-0b4564e891c4 tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] [instance: 339517ef-c023-4f13-a8cc-d84f7176dfcd] Found default for hw_input_bus of None {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:17:57 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-a43fc977-4f45-4f43-a35a-0b4564e891c4 tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] [instance: 339517ef-c023-4f13-a8cc-d84f7176dfcd] Found default for hw_pointer_model of None {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:17:57 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-a43fc977-4f45-4f43-a35a-0b4564e891c4 tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] [instance: 339517ef-c023-4f13-a8cc-d84f7176dfcd] Found default for hw_video_model of virtio {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:17:57 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-a43fc977-4f45-4f43-a35a-0b4564e891c4 tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] [instance: 339517ef-c023-4f13-a8cc-d84f7176dfcd] Found default for hw_vif_model of virtio {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:17:57 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 339517ef-c023-4f13-a8cc-d84f7176dfcd] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 10:17:57 user nova-compute[73572]: DEBUG nova.virt.driver [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Emitting event <LifecycleEvent: 1693045077.7197378, 339517ef-c023-4f13-a8cc-d84f7176dfcd => Started> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:17:57 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 339517ef-c023-4f13-a8cc-d84f7176dfcd] VM Started (Lifecycle Event)
Aug 26 10:17:57 user nova-compute[73572]: DEBUG nova.compute.manager [req-2c97f76a-3899-4d3a-8fa8-104d4f79b7e3 req-58148066-b5aa-4405-9cd8-2041dd05a581 service nova] [instance: 339517ef-c023-4f13-a8cc-d84f7176dfcd] Received event network-vif-plugged-0545369e-80c9-45cc-a9a2-330705df9241 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:17:57 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-2c97f76a-3899-4d3a-8fa8-104d4f79b7e3 req-58148066-b5aa-4405-9cd8-2041dd05a581 service nova] Acquiring lock "339517ef-c023-4f13-a8cc-d84f7176dfcd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:17:57 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-2c97f76a-3899-4d3a-8fa8-104d4f79b7e3 req-58148066-b5aa-4405-9cd8-2041dd05a581 service nova] Lock "339517ef-c023-4f13-a8cc-d84f7176dfcd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:17:57 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-2c97f76a-3899-4d3a-8fa8-104d4f79b7e3 req-58148066-b5aa-4405-9cd8-2041dd05a581 service nova] Lock "339517ef-c023-4f13-a8cc-d84f7176dfcd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:17:57 user nova-compute[73572]: DEBUG nova.compute.manager [req-2c97f76a-3899-4d3a-8fa8-104d4f79b7e3 req-58148066-b5aa-4405-9cd8-2041dd05a581 service nova] [instance: 339517ef-c023-4f13-a8cc-d84f7176dfcd] No waiting events found dispatching network-vif-plugged-0545369e-80c9-45cc-a9a2-330705df9241 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:17:57 user nova-compute[73572]: WARNING nova.compute.manager [req-2c97f76a-3899-4d3a-8fa8-104d4f79b7e3 req-58148066-b5aa-4405-9cd8-2041dd05a581 service nova] [instance: 339517ef-c023-4f13-a8cc-d84f7176dfcd] Received unexpected event network-vif-plugged-0545369e-80c9-45cc-a9a2-330705df9241 for instance with vm_state building and task_state spawning.
Aug 26 10:17:57 user nova-compute[73572]: DEBUG nova.compute.manager [req-2c97f76a-3899-4d3a-8fa8-104d4f79b7e3 req-58148066-b5aa-4405-9cd8-2041dd05a581 service nova] [instance: 339517ef-c023-4f13-a8cc-d84f7176dfcd] Received event network-vif-plugged-0545369e-80c9-45cc-a9a2-330705df9241 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:17:57 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-2c97f76a-3899-4d3a-8fa8-104d4f79b7e3 req-58148066-b5aa-4405-9cd8-2041dd05a581 service nova] Acquiring lock "339517ef-c023-4f13-a8cc-d84f7176dfcd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:17:57 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-2c97f76a-3899-4d3a-8fa8-104d4f79b7e3 req-58148066-b5aa-4405-9cd8-2041dd05a581 service nova] Lock "339517ef-c023-4f13-a8cc-d84f7176dfcd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:17:57 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-2c97f76a-3899-4d3a-8fa8-104d4f79b7e3 req-58148066-b5aa-4405-9cd8-2041dd05a581 service nova] Lock "339517ef-c023-4f13-a8cc-d84f7176dfcd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:17:57 user nova-compute[73572]: DEBUG nova.compute.manager [req-2c97f76a-3899-4d3a-8fa8-104d4f79b7e3 req-58148066-b5aa-4405-9cd8-2041dd05a581 service nova] [instance: 339517ef-c023-4f13-a8cc-d84f7176dfcd] No waiting events found dispatching network-vif-plugged-0545369e-80c9-45cc-a9a2-330705df9241 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:17:57 user nova-compute[73572]: WARNING nova.compute.manager [req-2c97f76a-3899-4d3a-8fa8-104d4f79b7e3 req-58148066-b5aa-4405-9cd8-2041dd05a581 service nova] [instance: 339517ef-c023-4f13-a8cc-d84f7176dfcd] Received unexpected event network-vif-plugged-0545369e-80c9-45cc-a9a2-330705df9241 for instance with vm_state building and task_state spawning.
Aug 26 10:17:57 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 339517ef-c023-4f13-a8cc-d84f7176dfcd] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:17:57 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 339517ef-c023-4f13-a8cc-d84f7176dfcd] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73572) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 10:17:57 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 339517ef-c023-4f13-a8cc-d84f7176dfcd] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 10:17:57 user nova-compute[73572]: INFO nova.compute.manager [None req-a43fc977-4f45-4f43-a35a-0b4564e891c4 tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] [instance: 339517ef-c023-4f13-a8cc-d84f7176dfcd] Took 5.18 seconds to spawn the instance on the hypervisor.
Aug 26 10:17:57 user nova-compute[73572]: DEBUG nova.compute.manager [None req-a43fc977-4f45-4f43-a35a-0b4564e891c4 tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] [instance: 339517ef-c023-4f13-a8cc-d84f7176dfcd] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:17:57 user nova-compute[73572]: INFO nova.compute.manager [None req-a43fc977-4f45-4f43-a35a-0b4564e891c4 tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] [instance: 339517ef-c023-4f13-a8cc-d84f7176dfcd] Took 24.89 seconds to build instance.
Aug 26 10:17:58 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-a43fc977-4f45-4f43-a35a-0b4564e891c4 tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] Lock "339517ef-c023-4f13-a8cc-d84f7176dfcd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 25.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:17:58 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "339517ef-c023-4f13-a8cc-d84f7176dfcd" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 11.144s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:17:58 user nova-compute[73572]: INFO nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] [instance: 339517ef-c023-4f13-a8cc-d84f7176dfcd] During sync_power_state the instance has a pending task (block_device_mapping). Skip.
Aug 26 10:17:58 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "339517ef-c023-4f13-a8cc-d84f7176dfcd" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:17:59 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:17:59 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:18:00 user nova-compute[73572]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693045065.2382526, b837eafb-db4e-4696-9b9f-bcfa1a30192a => Stopped> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:18:00 user nova-compute[73572]: INFO nova.compute.manager [-] [instance: b837eafb-db4e-4696-9b9f-bcfa1a30192a] VM Stopped (Lifecycle Event)
Aug 26 10:18:00 user nova-compute[73572]: DEBUG nova.compute.manager [None req-23c09c58-d0ab-467f-9d0f-f3b8e0011750 None None] [instance: b837eafb-db4e-4696-9b9f-bcfa1a30192a] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:18:02 user nova-compute[73572]: INFO nova.virt.block_device [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] Booting with volume eaa45a8a-93fc-4fac-bc41-ce4fa5173718 at /dev/vdc
Aug 26 10:18:02 user nova-compute[73572]: DEBUG os_brick.utils [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 10:18:02 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:18:02 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:18:02 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[183d8df3-0069-414c-b571-7dd3de99b243]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:de8a79ed912\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:18:02 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:18:02 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:18:02 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[d738efde-6172-4cce-897f-e18461f565a3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:18:02 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:18:02 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:18:02 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[d85608f2-c574-4477-b851-d025c6c3389b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:18:02 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[744d7077-0263-47d0-bf5a-af552e4ab86c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:18:02 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] Running cmd (subprocess): nvme version {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:18:02 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] 'nvme version' failed. Not Retrying. {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 10:18:02 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] nvme not present on system {{(pid=73572) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 10:18:02 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:18:02 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 10:18:02 user nova-compute[73572]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 10:18:02 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce00c919-044f-4b5b-8ce6-018332fae4be]: (4, '') {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:18:02 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.lightos [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73572) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 10:18:02 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.lightos [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73572) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 10:18:02 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.lightos [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] LIGHTOS: no hostnqn found. {{(pid=73572) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 10:18:02 user nova-compute[73572]: DEBUG os_brick.utils [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:de8a79ed912', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 10:18:02 user nova-compute[73572]: DEBUG nova.virt.block_device [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] Updating existing volume attachment record: c56ada0c-2c19-45cb-8425-196038c09a4e {{(pid=73572) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 10:18:04 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:18:08 user nova-compute[73572]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693045073.8695693, ee9bcbaa-25a6-4588-b757-2a2ae15b6cf8 => Stopped> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:18:08 user nova-compute[73572]: INFO nova.compute.manager [-] [instance: ee9bcbaa-25a6-4588-b757-2a2ae15b6cf8] VM Stopped (Lifecycle Event)
Aug 26 10:18:08 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:18:08 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Starting heal instance info cache {{(pid=73572) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 10:18:08 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Rebuilding the list of instances to heal {{(pid=73572) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 10:18:08 user nova-compute[73572]: DEBUG nova.compute.manager [None req-6842358b-f86a-4058-8f0b-308c09cfff14 None None] [instance: ee9bcbaa-25a6-4588-b757-2a2ae15b6cf8] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:18:08 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] Skipping network cache update for instance because it is Building. {{(pid=73572) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 26 10:18:08 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquiring lock "refresh_cache-c785b609-0068-442f-91f5-d26e888a993f" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:18:08 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquired lock "refresh_cache-c785b609-0068-442f-91f5-d26e888a993f" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:18:08 user nova-compute[73572]: DEBUG nova.network.neutron [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] [instance: c785b609-0068-442f-91f5-d26e888a993f] Forcefully refreshing network info cache for instance {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 10:18:08 user nova-compute[73572]: DEBUG nova.objects.instance [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lazy-loading 'info_cache' on Instance uuid c785b609-0068-442f-91f5-d26e888a993f {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:18:09 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:18:09 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:18:09 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73572) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 10:18:09 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73572) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 10:18:09 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73572) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 10:18:09 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:18:09 user nova-compute[73572]: DEBUG nova.network.neutron [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] [instance: c785b609-0068-442f-91f5-d26e888a993f] Updating instance_info_cache with network_info: [{"id": "f01cdcf9-2430-4eb5-bb2d-3d126756dfc1", "address": "fa:16:3e:fa:6c:bc", "network": {"id": "991b9dff-5173-4456-a530-b1f7eb5cfa4a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1845930297-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4636f93c5bfc4653804de097aed2882c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf01cdcf9-24", "ovs_interfaceid": "f01cdcf9-2430-4eb5-bb2d-3d126756dfc1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:18:09 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Releasing lock "refresh_cache-c785b609-0068-442f-91f5-d26e888a993f" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:18:09 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] [instance: c785b609-0068-442f-91f5-d26e888a993f] Updated the network info_cache for instance {{(pid=73572) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 10:18:11 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:18:11 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:18:11 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73572) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 10:18:12 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:18:12 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:18:13 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-86af31cc-0c10-4299-8920-c4a912dd79cf tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Acquiring lock "682138af-ba6a-47f1-a9a5-03ae2661f54d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:18:13 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-86af31cc-0c10-4299-8920-c4a912dd79cf tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Lock "682138af-ba6a-47f1-a9a5-03ae2661f54d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:18:13 user nova-compute[73572]: DEBUG nova.objects.instance [None req-86af31cc-0c10-4299-8920-c4a912dd79cf tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Lazy-loading 'flavor' on Instance uuid 682138af-ba6a-47f1-a9a5-03ae2661f54d {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:18:13 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-86af31cc-0c10-4299-8920-c4a912dd79cf tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Lock "682138af-ba6a-47f1-a9a5-03ae2661f54d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:18:13 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-86af31cc-0c10-4299-8920-c4a912dd79cf tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Acquiring lock "682138af-ba6a-47f1-a9a5-03ae2661f54d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:18:13 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-86af31cc-0c10-4299-8920-c4a912dd79cf tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Lock "682138af-ba6a-47f1-a9a5-03ae2661f54d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:18:13 user nova-compute[73572]: INFO nova.compute.manager [None req-86af31cc-0c10-4299-8920-c4a912dd79cf tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] [instance: 682138af-ba6a-47f1-a9a5-03ae2661f54d] Attaching volume 302c3cfe-f0ec-4b1c-b1d9-dc12d4f4ce40 to /dev/vdb
Aug 26 10:18:13 user nova-compute[73572]: DEBUG os_brick.utils [None req-86af31cc-0c10-4299-8920-c4a912dd79cf tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 10:18:13 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:18:13 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:18:13 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca7b766e-fb23-4d00-a299-90a916dc3fbd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:de8a79ed912\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:18:13 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:18:13 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:18:13 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[c10cfe3e-cec4-418c-8ffa-dd37cef6c86b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:18:13 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:18:13 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:18:13 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[778b8c4a-935c-456e-ac5b-f2fe2710375c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:18:13 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf92a52d-4ca6-4c76-b13d-61884bf6108b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:18:13 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-86af31cc-0c10-4299-8920-c4a912dd79cf tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Running cmd (subprocess): nvme version {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:18:13 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-86af31cc-0c10-4299-8920-c4a912dd79cf tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] 'nvme version' failed. Not Retrying. {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 10:18:13 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.nvmeof [None req-86af31cc-0c10-4299-8920-c4a912dd79cf tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] nvme not present on system {{(pid=73572) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 10:18:13 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:18:13 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 10:18:13 user nova-compute[73572]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 10:18:13 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9926d44-1b73-4346-bbb6-02e387e1a4c7]: (4, '') {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:18:13 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.lightos [None req-86af31cc-0c10-4299-8920-c4a912dd79cf tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73572) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 10:18:13 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.lightos [None req-86af31cc-0c10-4299-8920-c4a912dd79cf tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73572) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 10:18:13 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.lightos [None req-86af31cc-0c10-4299-8920-c4a912dd79cf tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] LIGHTOS: no hostnqn found. {{(pid=73572) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 10:18:13 user nova-compute[73572]: DEBUG os_brick.utils [None req-86af31cc-0c10-4299-8920-c4a912dd79cf tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] <== get_connector_properties: return (112ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:de8a79ed912', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 10:18:13 user nova-compute[73572]: DEBUG nova.virt.block_device [None req-86af31cc-0c10-4299-8920-c4a912dd79cf tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] [instance: 682138af-ba6a-47f1-a9a5-03ae2661f54d] Updating existing volume attachment record: ddd65bf7-a858-43be-b11b-0a4d5891bc14 {{(pid=73572) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 10:18:14 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:18:14 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:18:14 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:18:14 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:18:14 user nova-compute[73572]: DEBUG nova.compute.manager [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] Start spawning the instance on the hypervisor. {{(pid=73572) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 10:18:14 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] Creating instance directory {{(pid=73572) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 10:18:14 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] Creating image(s)
Aug 26 10:18:14 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] Did not create local disks {{(pid=73572) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 26 10:18:14 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] Ensure instance console log exists: /opt/stack/data/nova/instances/41c1ef7a-4f98-4cbb-9948-acb96bd9d557/console.log {{(pid=73572) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 10:18:14 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:18:14 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:18:14 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:18:14 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] Start _get_guest_xml network_info=[{"id": "123d944e-47d4-4f95-94bc-73e1920ecbc1", "address": "fa:16:3e:95:40:4c", "network": {"id": "ce8484e9-f124-4a9c-9682-289ed99917e2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1080187713-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cf2ae4dd7d3474394090e3276c957ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap123d944e-47", "ovs_interfaceid": "123d944e-47d4-4f95-94bc-73e1920ecbc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "696cd753-312c-437d-b140-c40b4158554e", "address": "fa:16:3e:13:c8:34", "network": {"id": "c0d598c4-68c6-4cfc-adf1-dc0360861788", "bridge": "br-int", "label": "tempest-device-tagging-net1-1696215747", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.77", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7cf2ae4dd7d3474394090e3276c957ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap696cd753-31", "ovs_interfaceid": "696cd753-312c-437d-b140-c40b4158554e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3e7d3f56-193b-43ba-9cc5-c5373755e06f", "address": "fa:16:3e:85:00:8b", "network": {"id": "c0d598c4-68c6-4cfc-adf1-dc0360861788", "bridge": "br-int", "label": "tempest-device-tagging-net1-1696215747", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.177", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7cf2ae4dd7d3474394090e3276c957ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e7d3f56-19", "ovs_interfaceid": "3e7d3f56-193b-43ba-9cc5-c5373755e06f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f264d951-8920-4151-8276-33baa6a9def9", "address": "fa:16:3e:a7:e2:2a", "network": {"id": "c0d598c4-68c6-4cfc-adf1-dc0360861788", "bridge": "br-int", "label": "tempest-device-tagging-net1-1696215747", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7cf2ae4dd7d3474394090e3276c957ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf264d951-89", "ovs_interfaceid": "f264d951-8920-4151-8276-33baa6a9def9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c0c6f2bc-3209-461a-bcc3-edf740139ca2", "address": "fa:16:3e:d1:c7:a5", "network": {"id": "c0d598c4-68c6-4cfc-adf1-dc0360861788", "bridge": "br-int", "label": "tempest-device-tagging-net1-1696215747", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.224", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7cf2ae4dd7d3474394090e3276c957ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0c6f2bc-32", "ovs_interfaceid": "c0c6f2bc-3209-461a-bcc3-edf740139ca2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2fe25c93-5639-47a6-80de-8cc83615e3c4", "address": "fa:16:3e:59:09:63", "network": {"id": "f69a6193-9faf-4224-b21b-bc60491f9aea", "bridge": "br-int", "label": "tempest-device-tagging-net2-1404521418", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7cf2ae4dd7d3474394090e3276c957ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fe25c93-56", "ovs_interfaceid": "2fe25c93-5639-47a6-80de-8cc83615e3c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8bc3e6f9-0fb7-4283-973c-cbb09e440e68", "address": "fa:16:3e:3d:e7:4c", "network": {"id": "f69a6193-9faf-4224-b21b-bc60491f9aea", "bridge": "br-int", "label": "tempest-device-tagging-net2-1404521418", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7cf2ae4dd7d3474394090e3276c957ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bc3e6f9-0f", "ovs_interfaceid": "8bc3e6f9-0fb7-4283-973c-cbb09e440e68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T10:07:33Z,direct_url=<?>,disk_format='qcow2',id=299da0c9-e1c4-48f0-be55-fbe20dd06bc9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5c995f8bbbab4368b67a253e0df3971a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T10:07:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'disk_bus': 'virtio', 'boot_index': 0, 'mount_device': '/dev/vda', 'attachment_id': '49029723-0912-4186-a0fd-b0839b9fa74f', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:c22666f6-bb12-41a8-b565-837f4617df4e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fwvpiNzA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '41c1ef7a-4f98-4cbb-9948-acb96bd9d557', 'attached_at': '', 'detached_at': '', 'volume_id': 'c22666f6-bb12-41a8-b565-837f4617df4e', 'serial': 'c22666f6-bb12-41a8-b565-837f4617df4e'}, 'guest_format': None, 'device_type': 'disk', 'volume_type': None}, {'delete_on_termination': False, 'disk_bus': 'virtio', 'boot_index': 1, 'mount_device': '/dev/vdb', 'attachment_id': '7c869b51-77dd-47a0-8819-82d79bd7a175', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:57b56972-76f9-44aa-905c-14d04f924f76'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QtJkoDyh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '41c1ef7a-4f98-4cbb-9948-acb96bd9d557', 'attached_at': '', 'detached_at': '', 'volume_id': '57b56972-76f9-44aa-905c-14d04f924f76', 'serial': '57b56972-76f9-44aa-905c-14d04f924f76'}, 'guest_format': None, 'device_type': 'disk', 'volume_type': None}, {'delete_on_termination': False, 'disk_bus': 'virtio', 'boot_index': 2, 'mount_device': '/dev/vdc', 'attachment_id': 'c56ada0c-2c19-45cb-8425-196038c09a4e', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:eaa45a8a-93fc-4fac-bc41-ce4fa5173718'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tSyrqeso', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '41c1ef7a-4f98-4cbb-9948-acb96bd9d557', 'attached_at': '', 'detached_at': '', 'volume_id': 'eaa45a8a-93fc-4fac-bc41-ce4fa5173718', 'serial': 'eaa45a8a-93fc-4fac-bc41-ce4fa5173718'}, 'guest_format': None, 'device_type': 'disk', 'volume_type': None} {{(pid=73572) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 10:18:14 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:18:14 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:18:14 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73572) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 10:18:14 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] CPU controller missing on host. {{(pid=73572) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 10:18:14 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73572) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 10:18:14 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] CPU controller found on host. {{(pid=73572) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 10:18:14 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73572) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 10:18:14 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T10:07:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T10:07:33Z,direct_url=<?>,disk_format='qcow2',id=299da0c9-e1c4-48f0-be55-fbe20dd06bc9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5c995f8bbbab4368b67a253e0df3971a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T10:07:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 10:18:14 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] Flavor limits 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 10:18:14 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] Image limits 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 10:18:14 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] Flavor pref 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 10:18:14 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] Image pref 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 10:18:14 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 10:18:14 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 10:18:14 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73572) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 10:18:14 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] Got 1 possible topologies {{(pid=73572) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 10:18:14 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 10:18:14 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 10:18:15 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] Calling os-brick to attach iSCSI Volume {{(pid=73572) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 10:18:15 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc89c3d6a10>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:c22666f6-bb12-41a8-b565-837f4617df4e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fwvpiNzA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 10:18:15 user nova-compute[73572]: WARNING os_brick.initiator.connectors.base [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 10:18:15 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 10:18:15 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 10:18:15 user nova-compute[73572]: WARNING os_brick.initiator.connectors.base [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 10:18:15 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c22666f6-bb12-41a8-b565-837f4617df4e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 10:18:15 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c22666f6-bb12-41a8-b565-837f4617df4e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 10:18:15 user nova-compute[73572]: INFO os_brick.initiator.connectors.iscsi [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 10:18:15 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c22666f6-bb12-41a8-b565-837f4617df4e -p 172.16.0.220:3260 {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:18:15 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c22666f6-bb12-41a8-b565-837f4617df4e -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:18:15 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6fcae36-b45b-488d-b4e4-e49a6dcbff95]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:18:15 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 10:18:15 user nova-compute[73572]:  {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:18:15 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c22666f6-bb12-41a8-b565-837f4617df4e -p 172.16.0.220:3260 --interface default --op new {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:18:15 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c22666f6-bb12-41a8-b565-837f4617df4e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:18:15 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca04e86d-b4c1-4df8-a562-c3931b95a251]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c22666f6-bb12-41a8-b565-837f4617df4e] added\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:18:15 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c22666f6-bb12-41a8-b565-837f4617df4e] added
Aug 26 10:18:15 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:18:15 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c22666f6-bb12-41a8-b565-837f4617df4e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:18:15 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c22666f6-bb12-41a8-b565-837f4617df4e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:18:15 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a46ad1e-c0d0-4295-a492-31a0640ba857]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:18:15 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:18:15 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c22666f6-bb12-41a8-b565-837f4617df4e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:18:15 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c22666f6-bb12-41a8-b565-837f4617df4e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:18:15 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[906d1175-ea9c-4bf1-a454-5eda1b7b6684]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:18:15 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:18:15 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c22666f6-bb12-41a8-b565-837f4617df4e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fwvpiNzA {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:18:15 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c22666f6-bb12-41a8-b565-837f4617df4e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fwvpiNzA" returned: 0 in 0.018s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:18:15 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0224220-0c75-4f17-b513-d609b16d14ef]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:18:15 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fwvpiNzA'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:18:15 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c22666f6-bb12-41a8-b565-837f4617df4e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:18:15 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c22666f6-bb12-41a8-b565-837f4617df4e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:18:15 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[30c53646-6970-44b1-9a51-c20b212856a4]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:18:15 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:18:15 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:18:15 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:18:15 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb48f9b9-23e0-408d-addd-6cf3acd75c9e]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d94556c8-9096-4e9a-9cfc-f9d17846ed06 (non-flash)\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:18:15 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)
Aug 26 10:18:15 user nova-compute[73572]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478 (non-flash)
Aug 26 10:18:15 user nova-compute[73572]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d94556c8-9096-4e9a-9cfc-f9d17846ed06 (non-flash)
Aug 26 10:18:15 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 10:18:15 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)
Aug 26 10:18:15 user nova-compute[73572]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478 (non-flash)
Aug 26 10:18:15 user nova-compute[73572]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d94556c8-9096-4e9a-9cfc-f9d17846ed06 (non-flash)
Aug 26 10:18:15 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 10:18:15 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c22666f6-bb12-41a8-b565-837f4617df4e -p 172.16.0.220:3260 --login {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:18:15 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c22666f6-bb12-41a8-b565-837f4617df4e -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:18:15 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f164434-ef35-48c5-a380-f78a60429e0e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c22666f6-bb12-41a8-b565-837f4617df4e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c22666f6-bb12-41a8-b565-837f4617df4e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:18:15 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c22666f6-bb12-41a8-b565-837f4617df4e, portal: 172.16.0.220,3260]
Aug 26 10:18:15 user nova-compute[73572]: Login to [iface: default, target: iqn.2010-10.org.openstack:c22666f6-bb12-41a8-b565-837f4617df4e, portal: 172.16.0.220,3260] successful.
Aug 26 10:18:15 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:18:15 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c22666f6-bb12-41a8-b565-837f4617df4e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:18:15 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c22666f6-bb12-41a8-b565-837f4617df4e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:18:15 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd0e071d-636e-4ed6-975a-2f1effd64d41]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:18:15 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:18:15 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:18:15 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:18:15 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cc86b01-f3f2-42d3-9155-d87d1f94b074]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d94556c8-9096-4e9a-9cfc-f9d17846ed06 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c22666f6-bb12-41a8-b565-837f4617df4e (non-flash)\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:18:15 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)
Aug 26 10:18:15 user nova-compute[73572]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478 (non-flash)
Aug 26 10:18:15 user nova-compute[73572]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d94556c8-9096-4e9a-9cfc-f9d17846ed06 (non-flash)
Aug 26 10:18:15 user nova-compute[73572]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c22666f6-bb12-41a8-b565-837f4617df4e (non-flash)
Aug 26 10:18:15 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 10:18:15 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)
Aug 26 10:18:15 user nova-compute[73572]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478 (non-flash)
Aug 26 10:18:15 user nova-compute[73572]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d94556c8-9096-4e9a-9cfc-f9d17846ed06 (non-flash)
Aug 26 10:18:15 user nova-compute[73572]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c22666f6-bb12-41a8-b565-837f4617df4e (non-flash)
Aug 26 10:18:15 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 10:18:15 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c22666f6-bb12-41a8-b565-837f4617df4e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.274s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 10:18:15 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] Connected to 172.16.0.220:3260 {{(pid=73572) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 10:18:15 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] HCTL ('35', '-', '-', 0) found on session 17 with lun 0 {{(pid=73572) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 10:18:15 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73572) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 10:18:15 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:18:15 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:18:15 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[be010a1d-803a-4cdb-bb4b-d4524d08c8b1]: (4, ('- - 0', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:18:15 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] Searching for a device in session 17 and hctl ['35', '*', '*', 0] yield: None {{(pid=73572) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 10:18:15 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:18:16 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] Searching for a device in session 17 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73572) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 10:18:16 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fwvpiNzA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73572) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 10:18:16 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.307s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 10:18:16 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] <== connect_volume: return (1309ms) {'type': 'block', 'scsi_wwn': '23865396132633736', 'path': '/dev/sdd'} {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 10:18:16 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23865396132633736', 'path': '/dev/sdd'} {{(pid=73572) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 10:18:16 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] Calling os-brick to attach iSCSI Volume {{(pid=73572) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 10:18:16 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc89c3d6a10>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:57b56972-76f9-44aa-905c-14d04f924f76'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QtJkoDyh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 10:18:16 user nova-compute[73572]: WARNING os_brick.initiator.connectors.base [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 10:18:16 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 10:18:16 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 10:18:16 user nova-compute[73572]: WARNING os_brick.initiator.connectors.base [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 10:18:16 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:57b56972-76f9-44aa-905c-14d04f924f76" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 10:18:16 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:57b56972-76f9-44aa-905c-14d04f924f76" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 10:18:16 user nova-compute[73572]: INFO os_brick.initiator.connectors.iscsi [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 10:18:16 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57b56972-76f9-44aa-905c-14d04f924f76 -p 172.16.0.220:3260 {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:18:16 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57b56972-76f9-44aa-905c-14d04f924f76 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:18:16 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1959f2a-1dde-4d66-a725-58a9e1f34a0f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:18:16 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 10:18:16 user nova-compute[73572]:  {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:18:16 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57b56972-76f9-44aa-905c-14d04f924f76 -p 172.16.0.220:3260 --interface default --op new {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:18:16 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57b56972-76f9-44aa-905c-14d04f924f76 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:18:16 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa04a591-8ea6-4276-9ff9-0efb33dd2b87]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:57b56972-76f9-44aa-905c-14d04f924f76] added\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:18:16 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:57b56972-76f9-44aa-905c-14d04f924f76] added
Aug 26 10:18:16 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:18:16 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57b56972-76f9-44aa-905c-14d04f924f76 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:18:16 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57b56972-76f9-44aa-905c-14d04f924f76 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:18:16 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2bcb6bf-6833-48ae-a3c9-ac7162927e11]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:18:16 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:18:16 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57b56972-76f9-44aa-905c-14d04f924f76 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:18:16 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57b56972-76f9-44aa-905c-14d04f924f76 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:18:16 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fc4ce1d-85c9-4974-9ad3-3e3dc2c029d6]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:18:16 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:18:16 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57b56972-76f9-44aa-905c-14d04f924f76 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QtJkoDyh {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:18:16 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57b56972-76f9-44aa-905c-14d04f924f76 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QtJkoDyh" returned: 0 in 0.018s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:18:16 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[644b9e87-2649-488d-83dc-0cc7da1bd8d9]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:18:16 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QtJkoDyh'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:18:16 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57b56972-76f9-44aa-905c-14d04f924f76 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:18:16 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57b56972-76f9-44aa-905c-14d04f924f76 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.028s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:18:16 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[691c9e49-dc51-4ca1-b7e7-fc163e97a333]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:18:16 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:18:16 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:18:16 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:18:16 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f16f9e6-9912-44c4-879f-9f1729736c46]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d94556c8-9096-4e9a-9cfc-f9d17846ed06 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c22666f6-bb12-41a8-b565-837f4617df4e (non-flash)\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:18:16 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)
Aug 26 10:18:16 user nova-compute[73572]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478 (non-flash)
Aug 26 10:18:16 user nova-compute[73572]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d94556c8-9096-4e9a-9cfc-f9d17846ed06 (non-flash)
Aug 26 10:18:16 user nova-compute[73572]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c22666f6-bb12-41a8-b565-837f4617df4e (non-flash)
Aug 26 10:18:16 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 10:18:16 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)
Aug 26 10:18:16 user nova-compute[73572]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478 (non-flash)
Aug 26 10:18:16 user nova-compute[73572]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d94556c8-9096-4e9a-9cfc-f9d17846ed06 (non-flash)
Aug 26 10:18:16 user nova-compute[73572]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c22666f6-bb12-41a8-b565-837f4617df4e (non-flash)
Aug 26 10:18:16 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 10:18:16 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57b56972-76f9-44aa-905c-14d04f924f76 -p 172.16.0.220:3260 --login {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:18:16 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57b56972-76f9-44aa-905c-14d04f924f76 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:18:16 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cb5f861-7ab3-4ff2-b29e-4460ef6470c7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:57b56972-76f9-44aa-905c-14d04f924f76, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:57b56972-76f9-44aa-905c-14d04f924f76, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:18:16 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:57b56972-76f9-44aa-905c-14d04f924f76, portal: 172.16.0.220,3260]
Aug 26 10:18:16 user nova-compute[73572]: Login to [iface: default, target: iqn.2010-10.org.openstack:57b56972-76f9-44aa-905c-14d04f924f76, portal: 172.16.0.220,3260] successful.
Aug 26 10:18:16 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:18:16 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57b56972-76f9-44aa-905c-14d04f924f76 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:18:16 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57b56972-76f9-44aa-905c-14d04f924f76 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:18:16 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fbb1b6e-e294-40fc-9214-3c6460235c30]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:18:16 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:18:16 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:18:16 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:18:16 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[55270192-f82b-4ea1-a2b7-9f95d7091fdd]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d94556c8-9096-4e9a-9cfc-f9d17846ed06 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c22666f6-bb12-41a8-b565-837f4617df4e (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57b56972-76f9-44aa-905c-14d04f924f76 (non-flash)\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:18:16 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)
Aug 26 10:18:16 user nova-compute[73572]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478 (non-flash)
Aug 26 10:18:16 user nova-compute[73572]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d94556c8-9096-4e9a-9cfc-f9d17846ed06 (non-flash)
Aug 26 10:18:16 user nova-compute[73572]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c22666f6-bb12-41a8-b565-837f4617df4e (non-flash)
Aug 26 10:18:16 user nova-compute[73572]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57b56972-76f9-44aa-905c-14d04f924f76 (non-flash)
Aug 26 10:18:16 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 10:18:16 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)
Aug 26 10:18:16 user nova-compute[73572]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478 (non-flash)
Aug 26 10:18:16 user nova-compute[73572]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d94556c8-9096-4e9a-9cfc-f9d17846ed06 (non-flash)
Aug 26 10:18:16 user nova-compute[73572]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c22666f6-bb12-41a8-b565-837f4617df4e (non-flash)
Aug 26 10:18:16 user nova-compute[73572]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57b56972-76f9-44aa-905c-14d04f924f76 (non-flash)
Aug 26 10:18:16 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 10:18:16 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:57b56972-76f9-44aa-905c-14d04f924f76" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.287s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 10:18:16 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] Connected to 172.16.0.220:3260 {{(pid=73572) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 10:18:16 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] HCTL ('36', '-', '-', 0) found on session 18 with lun 0 {{(pid=73572) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 10:18:16 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73572) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 10:18:16 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:18:16 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:18:16 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[48241cd2-d4fa-45ac-9bfc-40b36cacb56b]: (4, ('- - 0', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:18:16 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] Searching for a device in session 18 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73572) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 10:18:16 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QtJkoDyh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73572) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 10:18:17 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.322s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 10:18:17 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] <== connect_volume: return (1324ms) {'type': 'block', 'scsi_wwn': '23636633963386162', 'path': '/dev/sde'} {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 10:18:17 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23636633963386162', 'path': '/dev/sde'} {{(pid=73572) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 10:18:17 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] Calling os-brick to attach iSCSI Volume {{(pid=73572) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 10:18:17 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc89c3d6a10>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:eaa45a8a-93fc-4fac-bc41-ce4fa5173718'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tSyrqeso', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 10:18:17 user nova-compute[73572]: WARNING os_brick.initiator.connectors.base [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 10:18:17 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 10:18:17 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 10:18:17 user nova-compute[73572]: WARNING os_brick.initiator.connectors.base [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 10:18:17 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eaa45a8a-93fc-4fac-bc41-ce4fa5173718" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 10:18:17 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eaa45a8a-93fc-4fac-bc41-ce4fa5173718" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 10:18:17 user nova-compute[73572]: INFO os_brick.initiator.connectors.iscsi [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 10:18:17 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eaa45a8a-93fc-4fac-bc41-ce4fa5173718 -p 172.16.0.220:3260 {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:18:17 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eaa45a8a-93fc-4fac-bc41-ce4fa5173718 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:18:17 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b735bac-4975-4640-a2e6-72500d77801b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:18:17 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 10:18:17 user nova-compute[73572]:  {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:18:17 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eaa45a8a-93fc-4fac-bc41-ce4fa5173718 -p 172.16.0.220:3260 --interface default --op new {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:18:17 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eaa45a8a-93fc-4fac-bc41-ce4fa5173718 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:18:17 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[a84c9376-2d49-4741-94f0-95150dfa4bea]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:eaa45a8a-93fc-4fac-bc41-ce4fa5173718] added\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:18:17 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:eaa45a8a-93fc-4fac-bc41-ce4fa5173718] added
Aug 26 10:18:17 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:18:17 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eaa45a8a-93fc-4fac-bc41-ce4fa5173718 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:18:17 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eaa45a8a-93fc-4fac-bc41-ce4fa5173718 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:18:17 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[064dd309-e2cb-44ff-96a0-08d49a16a523]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:18:17 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:18:17 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eaa45a8a-93fc-4fac-bc41-ce4fa5173718 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:18:17 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eaa45a8a-93fc-4fac-bc41-ce4fa5173718 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:18:17 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cb78149-3f62-491f-9333-51bb6185b622]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:18:17 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:18:17 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eaa45a8a-93fc-4fac-bc41-ce4fa5173718 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tSyrqeso {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:18:17 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eaa45a8a-93fc-4fac-bc41-ce4fa5173718 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tSyrqeso" returned: 0 in 0.018s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:18:17 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[0630f76a-8b00-4fca-bc2a-89ebd6597dc4]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:18:17 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tSyrqeso'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:18:17 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eaa45a8a-93fc-4fac-bc41-ce4fa5173718 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:18:17 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eaa45a8a-93fc-4fac-bc41-ce4fa5173718 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:18:17 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[edc99192-7235-4ba5-8be6-61197530b9dd]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:18:17 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:18:17 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:18:17 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:18:17 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e9aa107-3c38-4b3b-b4fa-afe036e4accf]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d94556c8-9096-4e9a-9cfc-f9d17846ed06 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c22666f6-bb12-41a8-b565-837f4617df4e (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57b56972-76f9-44aa-905c-14d04f924f76 (non-flash)\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:18:17 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)
Aug 26 10:18:17 user nova-compute[73572]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478 (non-flash)
Aug 26 10:18:17 user nova-compute[73572]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d94556c8-9096-4e9a-9cfc-f9d17846ed06 (non-flash)
Aug 26 10:18:17 user nova-compute[73572]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c22666f6-bb12-41a8-b565-837f4617df4e (non-flash)
Aug 26 10:18:17 user nova-compute[73572]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57b56972-76f9-44aa-905c-14d04f924f76 (non-flash)
Aug 26 10:18:17 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 10:18:17 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)
Aug 26 10:18:17 user nova-compute[73572]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478 (non-flash)
Aug 26 10:18:17 user nova-compute[73572]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d94556c8-9096-4e9a-9cfc-f9d17846ed06 (non-flash)
Aug 26 10:18:17 user nova-compute[73572]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c22666f6-bb12-41a8-b565-837f4617df4e (non-flash)
Aug 26 10:18:17 user nova-compute[73572]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57b56972-76f9-44aa-905c-14d04f924f76 (non-flash)
Aug 26 10:18:17 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 10:18:17 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eaa45a8a-93fc-4fac-bc41-ce4fa5173718 -p 172.16.0.220:3260 --login {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:18:17 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eaa45a8a-93fc-4fac-bc41-ce4fa5173718 -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:18:17 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[c745be85-6b56-4848-9e99-a23e9d620bb5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:eaa45a8a-93fc-4fac-bc41-ce4fa5173718, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:eaa45a8a-93fc-4fac-bc41-ce4fa5173718, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:18:17 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:eaa45a8a-93fc-4fac-bc41-ce4fa5173718, portal: 172.16.0.220,3260]
Aug 26 10:18:17 user nova-compute[73572]: Login to [iface: default, target: iqn.2010-10.org.openstack:eaa45a8a-93fc-4fac-bc41-ce4fa5173718, portal: 172.16.0.220,3260] successful.
Aug 26 10:18:17 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:18:17 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eaa45a8a-93fc-4fac-bc41-ce4fa5173718 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:18:17 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eaa45a8a-93fc-4fac-bc41-ce4fa5173718 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:18:17 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a842b0b-3d3f-45fe-88f0-2d9b732d96d2]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:18:17 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:18:17 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:18:18 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:18:18 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[41d04922-de48-477b-b429-69ada5afd8be]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d94556c8-9096-4e9a-9cfc-f9d17846ed06 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c22666f6-bb12-41a8-b565-837f4617df4e (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57b56972-76f9-44aa-905c-14d04f924f76 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaa45a8a-93fc-4fac-bc41-ce4fa5173718 (non-flash)\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:18:18 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)
Aug 26 10:18:18 user nova-compute[73572]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478 (non-flash)
Aug 26 10:18:18 user nova-compute[73572]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d94556c8-9096-4e9a-9cfc-f9d17846ed06 (non-flash)
Aug 26 10:18:18 user nova-compute[73572]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c22666f6-bb12-41a8-b565-837f4617df4e (non-flash)
Aug 26 10:18:18 user nova-compute[73572]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57b56972-76f9-44aa-905c-14d04f924f76 (non-flash)
Aug 26 10:18:18 user nova-compute[73572]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaa45a8a-93fc-4fac-bc41-ce4fa5173718 (non-flash)
Aug 26 10:18:18 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 10:18:18 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)
Aug 26 10:18:18 user nova-compute[73572]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478 (non-flash)
Aug 26 10:18:18 user nova-compute[73572]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d94556c8-9096-4e9a-9cfc-f9d17846ed06 (non-flash)
Aug 26 10:18:18 user nova-compute[73572]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c22666f6-bb12-41a8-b565-837f4617df4e (non-flash)
Aug 26 10:18:18 user nova-compute[73572]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57b56972-76f9-44aa-905c-14d04f924f76 (non-flash)
Aug 26 10:18:18 user nova-compute[73572]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaa45a8a-93fc-4fac-bc41-ce4fa5173718 (non-flash)
Aug 26 10:18:18 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 10:18:18 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eaa45a8a-93fc-4fac-bc41-ce4fa5173718" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.295s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 10:18:18 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] Connected to 172.16.0.220:3260 {{(pid=73572) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 10:18:18 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] HCTL ('38', '-', '-', 0) found on session 19 with lun 0 {{(pid=73572) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 10:18:18 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=73572) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 10:18:18 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:18:18 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.022s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:18:18 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4941f2e-9793-45e2-8531-a60a1f7eb645]: (4, ('- - 0', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:18:18 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] Searching for a device in session 19 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=73572) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 10:18:18 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tSyrqeso', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73572) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 10:18:19 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.336s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 10:18:19 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] <== connect_volume: return (1337ms) {'type': 'block', 'scsi_wwn': '23736316235343839', 'path': '/dev/sdg'} {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 10:18:19 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23736316235343839', 'path': '/dev/sdg'} {{(pid=73572) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 10:18:19 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T10:17:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-134774677',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-134774677',id=22,image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMM+PyzPMQ665kAGppNf46HsUT3HYJTkwTVFQbIbkDU4VagIXaQ7SGc4u3qE2bya41WFz6iVsv2EpJnZJz5aQ7MB5uYF8zBmhQDv3kMfZLp/PrDgRH/onZJ/CCLLihoJzA==',key_name='tempest-keypair-1169777187',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7cf2ae4dd7d3474394090e3276c957ec',ramdisk_id='',reservation_id='r-r8s410lq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2076699378',owner_user_name='tempest-TaggedBootDevicesTest_v242-2076699378-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T10:17:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='25fdd7b9201b4f6eaf5eb6d55bb09ab5',uuid=41c1ef7a-4f98-4cbb-9948-acb96bd9d557,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "123d944e-47d4-4f95-94bc-73e1920ecbc1", "address": "fa:16:3e:95:40:4c", "network": {"id": "ce8484e9-f124-4a9c-9682-289ed99917e2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1080187713-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cf2ae4dd7d3474394090e3276c957ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap123d944e-47", "ovs_interfaceid": "123d944e-47d4-4f95-94bc-73e1920ecbc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73572) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 10:18:19 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] Converting VIF {"id": "123d944e-47d4-4f95-94bc-73e1920ecbc1", "address": "fa:16:3e:95:40:4c", "network": {"id": "ce8484e9-f124-4a9c-9682-289ed99917e2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1080187713-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cf2ae4dd7d3474394090e3276c957ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap123d944e-47", "ovs_interfaceid": "123d944e-47d4-4f95-94bc-73e1920ecbc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:18:19 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:40:4c,bridge_name='br-int',has_traffic_filtering=True,id=123d944e-47d4-4f95-94bc-73e1920ecbc1,network=Network(ce8484e9-f124-4a9c-9682-289ed99917e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap123d944e-47') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:18:19 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T10:17:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-134774677',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-134774677',id=22,image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMM+PyzPMQ665kAGppNf46HsUT3HYJTkwTVFQbIbkDU4VagIXaQ7SGc4u3qE2bya41WFz6iVsv2EpJnZJz5aQ7MB5uYF8zBmhQDv3kMfZLp/PrDgRH/onZJ/CCLLihoJzA==',key_name='tempest-keypair-1169777187',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7cf2ae4dd7d3474394090e3276c957ec',ramdisk_id='',reservation_id='r-r8s410lq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2076699378',owner_user_name='tempest-TaggedBootDevicesTest_v242-2076699378-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T10:17:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='25fdd7b9201b4f6eaf5eb6d55bb09ab5',uuid=41c1ef7a-4f98-4cbb-9948-acb96bd9d557,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "696cd753-312c-437d-b140-c40b4158554e", "address": "fa:16:3e:13:c8:34", "network": {"id": "c0d598c4-68c6-4cfc-adf1-dc0360861788", "bridge": "br-int", "label": "tempest-device-tagging-net1-1696215747", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.77", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7cf2ae4dd7d3474394090e3276c957ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap696cd753-31", "ovs_interfaceid": "696cd753-312c-437d-b140-c40b4158554e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73572) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 10:18:19 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] Converting VIF {"id": "696cd753-312c-437d-b140-c40b4158554e", "address": "fa:16:3e:13:c8:34", "network": {"id": "c0d598c4-68c6-4cfc-adf1-dc0360861788", "bridge": "br-int", "label": "tempest-device-tagging-net1-1696215747", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.77", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7cf2ae4dd7d3474394090e3276c957ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap696cd753-31", "ovs_interfaceid": "696cd753-312c-437d-b140-c40b4158554e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:18:19 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:c8:34,bridge_name='br-int',has_traffic_filtering=True,id=696cd753-312c-437d-b140-c40b4158554e,network=Network(c0d598c4-68c6-4cfc-adf1-dc0360861788),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap696cd753-31') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:18:19 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T10:17:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-134774677',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-134774677',id=22,image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMM+PyzPMQ665kAGppNf46HsUT3HYJTkwTVFQbIbkDU4VagIXaQ7SGc4u3qE2bya41WFz6iVsv2EpJnZJz5aQ7MB5uYF8zBmhQDv3kMfZLp/PrDgRH/onZJ/CCLLihoJzA==',key_name='tempest-keypair-1169777187',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7cf2ae4dd7d3474394090e3276c957ec',ramdisk_id='',reservation_id='r-r8s410lq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2076699378',owner_user_name='tempest-TaggedBootDevicesTest_v242-2076699378-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T10:17:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='25fdd7b9201b4f6eaf5eb6d55bb09ab5',uuid=41c1ef7a-4f98-4cbb-9948-acb96bd9d557,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3e7d3f56-193b-43ba-9cc5-c5373755e06f", "address": "fa:16:3e:85:00:8b", "network": {"id": "c0d598c4-68c6-4cfc-adf1-dc0360861788", "bridge": "br-int", "label": "tempest-device-tagging-net1-1696215747", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.177", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7cf2ae4dd7d3474394090e3276c957ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e7d3f56-19", "ovs_interfaceid": "3e7d3f56-193b-43ba-9cc5-c5373755e06f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73572) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 10:18:19 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] Converting VIF {"id": "3e7d3f56-193b-43ba-9cc5-c5373755e06f", "address": "fa:16:3e:85:00:8b", "network": {"id": "c0d598c4-68c6-4cfc-adf1-dc0360861788", "bridge": "br-int", "label": "tempest-device-tagging-net1-1696215747", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.177", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7cf2ae4dd7d3474394090e3276c957ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e7d3f56-19", "ovs_interfaceid": "3e7d3f56-193b-43ba-9cc5-c5373755e06f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:18:19 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:85:00:8b,bridge_name='br-int',has_traffic_filtering=True,id=3e7d3f56-193b-43ba-9cc5-c5373755e06f,network=Network(c0d598c4-68c6-4cfc-adf1-dc0360861788),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3e7d3f56-19') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:18:19 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T10:17:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-134774677',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-134774677',id=22,image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMM+PyzPMQ665kAGppNf46HsUT3HYJTkwTVFQbIbkDU4VagIXaQ7SGc4u3qE2bya41WFz6iVsv2EpJnZJz5aQ7MB5uYF8zBmhQDv3kMfZLp/PrDgRH/onZJ/CCLLihoJzA==',key_name='tempest-keypair-1169777187',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7cf2ae4dd7d3474394090e3276c957ec',ramdisk_id='',reservation_id='r-r8s410lq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2076699378',owner_user_name='tempest-TaggedBootDevicesTest_v242-2076699378-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T10:17:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='25fdd7b9201b4f6eaf5eb6d55bb09ab5',uuid=41c1ef7a-4f98-4cbb-9948-acb96bd9d557,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f264d951-8920-4151-8276-33baa6a9def9", "address": "fa:16:3e:a7:e2:2a", "network": {"id": "c0d598c4-68c6-4cfc-adf1-dc0360861788", "bridge": "br-int", "label": "tempest-device-tagging-net1-1696215747", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7cf2ae4dd7d3474394090e3276c957ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf264d951-89", "ovs_interfaceid": "f264d951-8920-4151-8276-33baa6a9def9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73572) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 10:18:19 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] Converting VIF {"id": "f264d951-8920-4151-8276-33baa6a9def9", "address": "fa:16:3e:a7:e2:2a", "network": {"id": "c0d598c4-68c6-4cfc-adf1-dc0360861788", "bridge": "br-int", "label": "tempest-device-tagging-net1-1696215747", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7cf2ae4dd7d3474394090e3276c957ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf264d951-89", "ovs_interfaceid": "f264d951-8920-4151-8276-33baa6a9def9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:18:19 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:e2:2a,bridge_name='br-int',has_traffic_filtering=True,id=f264d951-8920-4151-8276-33baa6a9def9,network=Network(c0d598c4-68c6-4cfc-adf1-dc0360861788),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf264d951-89') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:18:19 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T10:17:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-134774677',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-134774677',id=22,image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMM+PyzPMQ665kAGppNf46HsUT3HYJTkwTVFQbIbkDU4VagIXaQ7SGc4u3qE2bya41WFz6iVsv2EpJnZJz5aQ7MB5uYF8zBmhQDv3kMfZLp/PrDgRH/onZJ/CCLLihoJzA==',key_name='tempest-keypair-1169777187',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7cf2ae4dd7d3474394090e3276c957ec',ramdisk_id='',reservation_id='r-r8s410lq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2076699378',owner_user_name='tempest-TaggedBootDevicesTest_v242-2076699378-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T10:17:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='25fdd7b9201b4f6eaf5eb6d55bb09ab5',uuid=41c1ef7a-4f98-4cbb-9948-acb96bd9d557,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c0c6f2bc-3209-461a-bcc3-edf740139ca2", "address": "fa:16:3e:d1:c7:a5", "network": {"id": "c0d598c4-68c6-4cfc-adf1-dc0360861788", "bridge": "br-int", "label": "tempest-device-tagging-net1-1696215747", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.224", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7cf2ae4dd7d3474394090e3276c957ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0c6f2bc-32", "ovs_interfaceid": "c0c6f2bc-3209-461a-bcc3-edf740139ca2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73572) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 10:18:19 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] Converting VIF {"id": "c0c6f2bc-3209-461a-bcc3-edf740139ca2", "address": "fa:16:3e:d1:c7:a5", "network": {"id": "c0d598c4-68c6-4cfc-adf1-dc0360861788", "bridge": "br-int", "label": "tempest-device-tagging-net1-1696215747", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.224", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7cf2ae4dd7d3474394090e3276c957ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0c6f2bc-32", "ovs_interfaceid": "c0c6f2bc-3209-461a-bcc3-edf740139ca2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:18:19 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:c7:a5,bridge_name='br-int',has_traffic_filtering=True,id=c0c6f2bc-3209-461a-bcc3-edf740139ca2,network=Network(c0d598c4-68c6-4cfc-adf1-dc0360861788),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0c6f2bc-32') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:18:19 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T10:17:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-134774677',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-134774677',id=22,image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMM+PyzPMQ665kAGppNf46HsUT3HYJTkwTVFQbIbkDU4VagIXaQ7SGc4u3qE2bya41WFz6iVsv2EpJnZJz5aQ7MB5uYF8zBmhQDv3kMfZLp/PrDgRH/onZJ/CCLLihoJzA==',key_name='tempest-keypair-1169777187',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7cf2ae4dd7d3474394090e3276c957ec',ramdisk_id='',reservation_id='r-r8s410lq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2076699378',owner_user_name='tempest-TaggedBootDevicesTest_v242-2076699378-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T10:17:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='25fdd7b9201b4f6eaf5eb6d55bb09ab5',uuid=41c1ef7a-4f98-4cbb-9948-acb96bd9d557,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2fe25c93-5639-47a6-80de-8cc83615e3c4", "address": "fa:16:3e:59:09:63", "network": {"id": "f69a6193-9faf-4224-b21b-bc60491f9aea", "bridge": "br-int", "label": "tempest-device-tagging-net2-1404521418", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7cf2ae4dd7d3474394090e3276c957ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fe25c93-56", "ovs_interfaceid": "2fe25c93-5639-47a6-80de-8cc83615e3c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73572) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 10:18:19 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] Converting VIF {"id": "2fe25c93-5639-47a6-80de-8cc83615e3c4", "address": "fa:16:3e:59:09:63", "network": {"id": "f69a6193-9faf-4224-b21b-bc60491f9aea", "bridge": "br-int", "label": "tempest-device-tagging-net2-1404521418", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7cf2ae4dd7d3474394090e3276c957ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fe25c93-56", "ovs_interfaceid": "2fe25c93-5639-47a6-80de-8cc83615e3c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:18:19 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:09:63,bridge_name='br-int',has_traffic_filtering=True,id=2fe25c93-5639-47a6-80de-8cc83615e3c4,network=Network(f69a6193-9faf-4224-b21b-bc60491f9aea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2fe25c93-56') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:18:19 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T10:17:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-134774677',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-134774677',id=22,image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMM+PyzPMQ665kAGppNf46HsUT3HYJTkwTVFQbIbkDU4VagIXaQ7SGc4u3qE2bya41WFz6iVsv2EpJnZJz5aQ7MB5uYF8zBmhQDv3kMfZLp/PrDgRH/onZJ/CCLLihoJzA==',key_name='tempest-keypair-1169777187',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7cf2ae4dd7d3474394090e3276c957ec',ramdisk_id='',reservation_id='r-r8s410lq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2076699378',owner_user_name='tempest-TaggedBootDevicesTest_v242-2076699378-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T10:17:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='25fdd7b9201b4f6eaf5eb6d55bb09ab5',uuid=41c1ef7a-4f98-4cbb-9948-acb96bd9d557,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8bc3e6f9-0fb7-4283-973c-cbb09e440e68", "address": "fa:16:3e:3d:e7:4c", "network": {"id": "f69a6193-9faf-4224-b21b-bc60491f9aea", "bridge": "br-int", "label": "tempest-device-tagging-net2-1404521418", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7cf2ae4dd7d3474394090e3276c957ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bc3e6f9-0f", "ovs_interfaceid": "8bc3e6f9-0fb7-4283-973c-cbb09e440e68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73572) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 10:18:19 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] Converting VIF {"id": "8bc3e6f9-0fb7-4283-973c-cbb09e440e68", "address": "fa:16:3e:3d:e7:4c", "network": {"id": "f69a6193-9faf-4224-b21b-bc60491f9aea", "bridge": "br-int", "label": "tempest-device-tagging-net2-1404521418", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7cf2ae4dd7d3474394090e3276c957ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bc3e6f9-0f", "ovs_interfaceid": "8bc3e6f9-0fb7-4283-973c-cbb09e440e68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:18:19 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:e7:4c,bridge_name='br-int',has_traffic_filtering=True,id=8bc3e6f9-0fb7-4283-973c-cbb09e440e68,network=Network(f69a6193-9faf-4224-b21b-bc60491f9aea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8bc3e6f9-0f') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:18:19 user nova-compute[73572]: DEBUG nova.objects.instance [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] Lazy-loading 'pci_devices' on Instance uuid 41c1ef7a-4f98-4cbb-9948-acb96bd9d557 {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:18:19 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] End _get_guest_xml xml=<domain type="kvm">
Aug 26 10:18:19 user nova-compute[73572]:   <uuid>41c1ef7a-4f98-4cbb-9948-acb96bd9d557</uuid>
Aug 26 10:18:19 user nova-compute[73572]:   <name>instance-00000016</name>
Aug 26 10:18:19 user nova-compute[73572]:   <memory>524288</memory>
Aug 26 10:18:19 user nova-compute[73572]:   <vcpu>1</vcpu>
Aug 26 10:18:19 user nova-compute[73572]:   <metadata>
Aug 26 10:18:19 user nova-compute[73572]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 10:18:19 user nova-compute[73572]:       <nova:package version="0.0.0"/>
Aug 26 10:18:19 user nova-compute[73572]:       <nova:name>tempest-device-tagging-server-134774677</nova:name>
Aug 26 10:18:19 user nova-compute[73572]:       <nova:creationTime>2023-08-26 10:18:14</nova:creationTime>
Aug 26 10:18:19 user nova-compute[73572]:       <nova:flavor name="m1.tiny">
Aug 26 10:18:19 user nova-compute[73572]:         <nova:memory>512</nova:memory>
Aug 26 10:18:19 user nova-compute[73572]:         <nova:disk>1</nova:disk>
Aug 26 10:18:19 user nova-compute[73572]:         <nova:swap>0</nova:swap>
Aug 26 10:18:19 user nova-compute[73572]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 10:18:19 user nova-compute[73572]:         <nova:vcpus>1</nova:vcpus>
Aug 26 10:18:19 user nova-compute[73572]:       </nova:flavor>
Aug 26 10:18:19 user nova-compute[73572]:       <nova:owner>
Aug 26 10:18:19 user nova-compute[73572]:         <nova:user uuid="25fdd7b9201b4f6eaf5eb6d55bb09ab5">tempest-TaggedBootDevicesTest_v242-2076699378-project-member</nova:user>
Aug 26 10:18:19 user nova-compute[73572]:         <nova:project uuid="7cf2ae4dd7d3474394090e3276c957ec">tempest-TaggedBootDevicesTest_v242-2076699378</nova:project>
Aug 26 10:18:19 user nova-compute[73572]:       </nova:owner>
Aug 26 10:18:19 user nova-compute[73572]:       <nova:root type="image" uuid="299da0c9-e1c4-48f0-be55-fbe20dd06bc9"/>
Aug 26 10:18:19 user nova-compute[73572]:       <nova:ports>
Aug 26 10:18:19 user nova-compute[73572]:         <nova:port uuid="123d944e-47d4-4f95-94bc-73e1920ecbc1">
Aug 26 10:18:19 user nova-compute[73572]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 26 10:18:19 user nova-compute[73572]:         </nova:port>
Aug 26 10:18:19 user nova-compute[73572]:         <nova:port uuid="696cd753-312c-437d-b140-c40b4158554e">
Aug 26 10:18:19 user nova-compute[73572]:           <nova:ip type="fixed" address="10.1.1.77" ipVersion="4"/>
Aug 26 10:18:19 user nova-compute[73572]:         </nova:port>
Aug 26 10:18:19 user nova-compute[73572]:         <nova:port uuid="3e7d3f56-193b-43ba-9cc5-c5373755e06f">
Aug 26 10:18:19 user nova-compute[73572]:           <nova:ip type="fixed" address="10.1.1.177" ipVersion="4"/>
Aug 26 10:18:19 user nova-compute[73572]:         </nova:port>
Aug 26 10:18:19 user nova-compute[73572]:         <nova:port uuid="f264d951-8920-4151-8276-33baa6a9def9">
Aug 26 10:18:19 user nova-compute[73572]:           <nova:ip type="fixed" address="10.1.1.14" ipVersion="4"/>
Aug 26 10:18:19 user nova-compute[73572]:         </nova:port>
Aug 26 10:18:19 user nova-compute[73572]:         <nova:port uuid="c0c6f2bc-3209-461a-bcc3-edf740139ca2">
Aug 26 10:18:19 user nova-compute[73572]:           <nova:ip type="fixed" address="10.1.1.224" ipVersion="4"/>
Aug 26 10:18:19 user nova-compute[73572]:         </nova:port>
Aug 26 10:18:19 user nova-compute[73572]:         <nova:port uuid="2fe25c93-5639-47a6-80de-8cc83615e3c4">
Aug 26 10:18:19 user nova-compute[73572]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Aug 26 10:18:19 user nova-compute[73572]:         </nova:port>
Aug 26 10:18:19 user nova-compute[73572]:         <nova:port uuid="8bc3e6f9-0fb7-4283-973c-cbb09e440e68">
Aug 26 10:18:19 user nova-compute[73572]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Aug 26 10:18:19 user nova-compute[73572]:         </nova:port>
Aug 26 10:18:19 user nova-compute[73572]:       </nova:ports>
Aug 26 10:18:19 user nova-compute[73572]:     </nova:instance>
Aug 26 10:18:19 user nova-compute[73572]:   </metadata>
Aug 26 10:18:19 user nova-compute[73572]:   <sysinfo type="smbios">
Aug 26 10:18:19 user nova-compute[73572]:     <system>
Aug 26 10:18:19 user nova-compute[73572]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 10:18:19 user nova-compute[73572]:       <entry name="product">OpenStack Nova</entry>
Aug 26 10:18:19 user nova-compute[73572]:       <entry name="version">0.0.0</entry>
Aug 26 10:18:19 user nova-compute[73572]:       <entry name="serial">41c1ef7a-4f98-4cbb-9948-acb96bd9d557</entry>
Aug 26 10:18:19 user nova-compute[73572]:       <entry name="uuid">41c1ef7a-4f98-4cbb-9948-acb96bd9d557</entry>
Aug 26 10:18:19 user nova-compute[73572]:       <entry name="family">Virtual Machine</entry>
Aug 26 10:18:19 user nova-compute[73572]:     </system>
Aug 26 10:18:19 user nova-compute[73572]:   </sysinfo>
Aug 26 10:18:19 user nova-compute[73572]:   <os>
Aug 26 10:18:19 user nova-compute[73572]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 10:18:19 user nova-compute[73572]:     <boot dev="hd"/>
Aug 26 10:18:19 user nova-compute[73572]:     <smbios mode="sysinfo"/>
Aug 26 10:18:19 user nova-compute[73572]:   </os>
Aug 26 10:18:19 user nova-compute[73572]:   <features>
Aug 26 10:18:19 user nova-compute[73572]:     <acpi/>
Aug 26 10:18:19 user nova-compute[73572]:     <apic/>
Aug 26 10:18:19 user nova-compute[73572]:     <vmcoreinfo/>
Aug 26 10:18:19 user nova-compute[73572]:   </features>
Aug 26 10:18:19 user nova-compute[73572]:   <clock offset="utc">
Aug 26 10:18:19 user nova-compute[73572]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 10:18:19 user nova-compute[73572]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 10:18:19 user nova-compute[73572]:     <timer name="hpet" present="no"/>
Aug 26 10:18:19 user nova-compute[73572]:   </clock>
Aug 26 10:18:19 user nova-compute[73572]:   <cpu mode="custom" match="exact">
Aug 26 10:18:19 user nova-compute[73572]:     <model>Nehalem</model>
Aug 26 10:18:19 user nova-compute[73572]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 10:18:19 user nova-compute[73572]:   </cpu>
Aug 26 10:18:19 user nova-compute[73572]:   <devices>
Aug 26 10:18:19 user nova-compute[73572]:     <disk type="file" device="cdrom">
Aug 26 10:18:19 user nova-compute[73572]:       <driver name="qemu" type="raw" cache="none"/>
Aug 26 10:18:19 user nova-compute[73572]:       <source file="/opt/stack/data/nova/instances/41c1ef7a-4f98-4cbb-9948-acb96bd9d557/disk.config"/>
Aug 26 10:18:19 user nova-compute[73572]:       <target dev="hda" bus="ide"/>
Aug 26 10:18:19 user nova-compute[73572]:     </disk>
Aug 26 10:18:19 user nova-compute[73572]:     <disk type="block" device="disk">
Aug 26 10:18:19 user nova-compute[73572]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 10:18:19 user nova-compute[73572]:       <source dev="/dev/sdd"/>
Aug 26 10:18:19 user nova-compute[73572]:       <target dev="vda" bus="virtio"/>
Aug 26 10:18:19 user nova-compute[73572]:       <serial>c22666f6-bb12-41a8-b565-837f4617df4e</serial>
Aug 26 10:18:19 user nova-compute[73572]:     </disk>
Aug 26 10:18:19 user nova-compute[73572]:     <disk type="block" device="disk">
Aug 26 10:18:19 user nova-compute[73572]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 10:18:19 user nova-compute[73572]:       <source dev="/dev/sde"/>
Aug 26 10:18:19 user nova-compute[73572]:       <target dev="vdb" bus="virtio"/>
Aug 26 10:18:19 user nova-compute[73572]:       <serial>57b56972-76f9-44aa-905c-14d04f924f76</serial>
Aug 26 10:18:19 user nova-compute[73572]:     </disk>
Aug 26 10:18:19 user nova-compute[73572]:     <disk type="block" device="disk">
Aug 26 10:18:19 user nova-compute[73572]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 10:18:19 user nova-compute[73572]:       <source dev="/dev/sdg"/>
Aug 26 10:18:19 user nova-compute[73572]:       <target dev="vdc" bus="virtio"/>
Aug 26 10:18:19 user nova-compute[73572]:       <serial>eaa45a8a-93fc-4fac-bc41-ce4fa5173718</serial>
Aug 26 10:18:19 user nova-compute[73572]:     </disk>
Aug 26 10:18:19 user nova-compute[73572]:     <interface type="ethernet">
Aug 26 10:18:19 user nova-compute[73572]:       <mac address="fa:16:3e:95:40:4c"/>
Aug 26 10:18:19 user nova-compute[73572]:       <model type="virtio"/>
Aug 26 10:18:19 user nova-compute[73572]:       <mtu size="1442"/>
Aug 26 10:18:19 user nova-compute[73572]:       <target dev="tap123d944e-47"/>
Aug 26 10:18:19 user nova-compute[73572]:     </interface>
Aug 26 10:18:19 user nova-compute[73572]:     <interface type="ethernet">
Aug 26 10:18:19 user nova-compute[73572]:       <mac address="fa:16:3e:13:c8:34"/>
Aug 26 10:18:19 user nova-compute[73572]:       <model type="virtio"/>
Aug 26 10:18:19 user nova-compute[73572]:       <mtu size="1442"/>
Aug 26 10:18:19 user nova-compute[73572]:       <target dev="tap696cd753-31"/>
Aug 26 10:18:19 user nova-compute[73572]:     </interface>
Aug 26 10:18:19 user nova-compute[73572]:     <interface type="ethernet">
Aug 26 10:18:19 user nova-compute[73572]:       <mac address="fa:16:3e:85:00:8b"/>
Aug 26 10:18:19 user nova-compute[73572]:       <model type="virtio"/>
Aug 26 10:18:19 user nova-compute[73572]:       <mtu size="1442"/>
Aug 26 10:18:19 user nova-compute[73572]:       <target dev="tap3e7d3f56-19"/>
Aug 26 10:18:19 user nova-compute[73572]:     </interface>
Aug 26 10:18:19 user nova-compute[73572]:     <interface type="ethernet">
Aug 26 10:18:19 user nova-compute[73572]:       <mac address="fa:16:3e:a7:e2:2a"/>
Aug 26 10:18:19 user nova-compute[73572]:       <model type="virtio"/>
Aug 26 10:18:19 user nova-compute[73572]:       <mtu size="1442"/>
Aug 26 10:18:19 user nova-compute[73572]:       <target dev="tapf264d951-89"/>
Aug 26 10:18:19 user nova-compute[73572]:     </interface>
Aug 26 10:18:19 user nova-compute[73572]:     <interface type="ethernet">
Aug 26 10:18:19 user nova-compute[73572]:       <mac address="fa:16:3e:d1:c7:a5"/>
Aug 26 10:18:19 user nova-compute[73572]:       <model type="virtio"/>
Aug 26 10:18:19 user nova-compute[73572]:       <mtu size="1442"/>
Aug 26 10:18:19 user nova-compute[73572]:       <target dev="tapc0c6f2bc-32"/>
Aug 26 10:18:19 user nova-compute[73572]:     </interface>
Aug 26 10:18:19 user nova-compute[73572]:     <interface type="ethernet">
Aug 26 10:18:19 user nova-compute[73572]:       <mac address="fa:16:3e:59:09:63"/>
Aug 26 10:18:19 user nova-compute[73572]:       <model type="virtio"/>
Aug 26 10:18:19 user nova-compute[73572]:       <mtu size="1442"/>
Aug 26 10:18:19 user nova-compute[73572]:       <target dev="tap2fe25c93-56"/>
Aug 26 10:18:19 user nova-compute[73572]:     </interface>
Aug 26 10:18:19 user nova-compute[73572]:     <interface type="ethernet">
Aug 26 10:18:19 user nova-compute[73572]:       <mac address="fa:16:3e:3d:e7:4c"/>
Aug 26 10:18:19 user nova-compute[73572]:       <model type="virtio"/>
Aug 26 10:18:19 user nova-compute[73572]:       <mtu size="1442"/>
Aug 26 10:18:19 user nova-compute[73572]:       <target dev="tap8bc3e6f9-0f"/>
Aug 26 10:18:19 user nova-compute[73572]:     </interface>
Aug 26 10:18:19 user nova-compute[73572]:     <serial type="pty">
Aug 26 10:18:19 user nova-compute[73572]:       <log file="/opt/stack/data/nova/instances/41c1ef7a-4f98-4cbb-9948-acb96bd9d557/console.log" append="off"/>
Aug 26 10:18:19 user nova-compute[73572]:     </serial>
Aug 26 10:18:19 user nova-compute[73572]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 10:18:19 user nova-compute[73572]:     <video>
Aug 26 10:18:19 user nova-compute[73572]:       <model type="virtio"/>
Aug 26 10:18:19 user nova-compute[73572]:     </video>
Aug 26 10:18:19 user nova-compute[73572]:     <rng model="virtio">
Aug 26 10:18:19 user nova-compute[73572]:       <backend model="random">/dev/urandom</backend>
Aug 26 10:18:19 user nova-compute[73572]:     </rng>
Aug 26 10:18:19 user nova-compute[73572]:     <controller type="usb" index="0" model="none"/>
Aug 26 10:18:19 user nova-compute[73572]:     <memballoon model="virtio">
Aug 26 10:18:19 user nova-compute[73572]:       <stats period="10"/>
Aug 26 10:18:19 user nova-compute[73572]:     </memballoon>
Aug 26 10:18:19 user nova-compute[73572]:   </devices>
Aug 26 10:18:19 user nova-compute[73572]: </domain>
Aug 26 10:18:19 user nova-compute[73572]:  {{(pid=73572) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 10:18:19 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T10:17:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-134774677',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-134774677',id=22,image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMM+PyzPMQ665kAGppNf46HsUT3HYJTkwTVFQbIbkDU4VagIXaQ7SGc4u3qE2bya41WFz6iVsv2EpJnZJz5aQ7MB5uYF8zBmhQDv3kMfZLp/PrDgRH/onZJ/CCLLihoJzA==',key_name='tempest-keypair-1169777187',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7cf2ae4dd7d3474394090e3276c957ec',ramdisk_id='',reservation_id='r-r8s410lq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2076699378',owner_user_name='tempest-TaggedBootDevicesTest_v242-2076699378-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T10:17:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='25fdd7b9201b4f6eaf5eb6d55bb09ab5',uuid=41c1ef7a-4f98-4cbb-9948-acb96bd9d557,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "123d944e-47d4-4f95-94bc-73e1920ecbc1", "address": "fa:16:3e:95:40:4c", "network": {"id": "ce8484e9-f124-4a9c-9682-289ed99917e2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1080187713-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cf2ae4dd7d3474394090e3276c957ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap123d944e-47", "ovs_interfaceid": "123d944e-47d4-4f95-94bc-73e1920ecbc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 10:18:19 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] Converting VIF {"id": "123d944e-47d4-4f95-94bc-73e1920ecbc1", "address": "fa:16:3e:95:40:4c", "network": {"id": "ce8484e9-f124-4a9c-9682-289ed99917e2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1080187713-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cf2ae4dd7d3474394090e3276c957ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap123d944e-47", "ovs_interfaceid": "123d944e-47d4-4f95-94bc-73e1920ecbc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:18:19 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:40:4c,bridge_name='br-int',has_traffic_filtering=True,id=123d944e-47d4-4f95-94bc-73e1920ecbc1,network=Network(ce8484e9-f124-4a9c-9682-289ed99917e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap123d944e-47') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:18:19 user nova-compute[73572]: DEBUG os_vif [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:40:4c,bridge_name='br-int',has_traffic_filtering=True,id=123d944e-47d4-4f95-94bc-73e1920ecbc1,network=Network(ce8484e9-f124-4a9c-9682-289ed99917e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap123d944e-47') {{(pid=73572) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 10:18:19 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:18:19 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:18:19 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 10:18:19 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:18:19 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap123d944e-47, may_exist=True, interface_attrs={}) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:18:19 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap123d944e-47, col_values=(('external_ids', {'iface-id': '123d944e-47d4-4f95-94bc-73e1920ecbc1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:95:40:4c', 'vm-uuid': '41c1ef7a-4f98-4cbb-9948-acb96bd9d557'}),), if_exists=True) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:18:19 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:18:19 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:18:19 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:18:19 user nova-compute[73572]: INFO os_vif [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:40:4c,bridge_name='br-int',has_traffic_filtering=True,id=123d944e-47d4-4f95-94bc-73e1920ecbc1,network=Network(ce8484e9-f124-4a9c-9682-289ed99917e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap123d944e-47')
Aug 26 10:18:19 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T10:17:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-134774677',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-134774677',id=22,image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMM+PyzPMQ665kAGppNf46HsUT3HYJTkwTVFQbIbkDU4VagIXaQ7SGc4u3qE2bya41WFz6iVsv2EpJnZJz5aQ7MB5uYF8zBmhQDv3kMfZLp/PrDgRH/onZJ/CCLLihoJzA==',key_name='tempest-keypair-1169777187',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7cf2ae4dd7d3474394090e3276c957ec',ramdisk_id='',reservation_id='r-r8s410lq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2076699378',owner_user_name='tempest-TaggedBootDevicesTest_v242-2076699378-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T10:17:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='25fdd7b9201b4f6eaf5eb6d55bb09ab5',uuid=41c1ef7a-4f98-4cbb-9948-acb96bd9d557,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "696cd753-312c-437d-b140-c40b4158554e", "address": "fa:16:3e:13:c8:34", "network": {"id": "c0d598c4-68c6-4cfc-adf1-dc0360861788", "bridge": "br-int", "label": "tempest-device-tagging-net1-1696215747", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.77", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7cf2ae4dd7d3474394090e3276c957ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap696cd753-31", "ovs_interfaceid": "696cd753-312c-437d-b140-c40b4158554e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73572) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 10:18:19 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] Converting VIF {"id": "696cd753-312c-437d-b140-c40b4158554e", "address": "fa:16:3e:13:c8:34", "network": {"id": "c0d598c4-68c6-4cfc-adf1-dc0360861788", "bridge": "br-int", "label": "tempest-device-tagging-net1-1696215747", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.77", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7cf2ae4dd7d3474394090e3276c957ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap696cd753-31", "ovs_interfaceid": "696cd753-312c-437d-b140-c40b4158554e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:18:19 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:c8:34,bridge_name='br-int',has_traffic_filtering=True,id=696cd753-312c-437d-b140-c40b4158554e,network=Network(c0d598c4-68c6-4cfc-adf1-dc0360861788),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap696cd753-31') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:18:19 user nova-compute[73572]: DEBUG os_vif [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:c8:34,bridge_name='br-int',has_traffic_filtering=True,id=696cd753-312c-437d-b140-c40b4158554e,network=Network(c0d598c4-68c6-4cfc-adf1-dc0360861788),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap696cd753-31') {{(pid=73572) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 10:18:19 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:18:19 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:18:19 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 10:18:19 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:18:19 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap696cd753-31, may_exist=True, interface_attrs={}) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:18:19 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap696cd753-31, col_values=(('external_ids', {'iface-id': '696cd753-312c-437d-b140-c40b4158554e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:13:c8:34', 'vm-uuid': '41c1ef7a-4f98-4cbb-9948-acb96bd9d557'}),), if_exists=True) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:18:19 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:18:19 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:18:19 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:18:19 user nova-compute[73572]: INFO os_vif [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:c8:34,bridge_name='br-int',has_traffic_filtering=True,id=696cd753-312c-437d-b140-c40b4158554e,network=Network(c0d598c4-68c6-4cfc-adf1-dc0360861788),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap696cd753-31')
Aug 26 10:18:19 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T10:17:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-134774677',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-134774677',id=22,image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMM+PyzPMQ665kAGppNf46HsUT3HYJTkwTVFQbIbkDU4VagIXaQ7SGc4u3qE2bya41WFz6iVsv2EpJnZJz5aQ7MB5uYF8zBmhQDv3kMfZLp/PrDgRH/onZJ/CCLLihoJzA==',key_name='tempest-keypair-1169777187',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7cf2ae4dd7d3474394090e3276c957ec',ramdisk_id='',reservation_id='r-r8s410lq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2076699378',owner_user_name='tempest-TaggedBootDevicesTest_v242-2076699378-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T10:17:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='25fdd7b9201b4f6eaf5eb6d55bb09ab5',uuid=41c1ef7a-4f98-4cbb-9948-acb96bd9d557,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3e7d3f56-193b-43ba-9cc5-c5373755e06f", "address": "fa:16:3e:85:00:8b", "network": {"id": "c0d598c4-68c6-4cfc-adf1-dc0360861788", "bridge": "br-int", "label": "tempest-device-tagging-net1-1696215747", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.177", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7cf2ae4dd7d3474394090e3276c957ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e7d3f56-19", "ovs_interfaceid": "3e7d3f56-193b-43ba-9cc5-c5373755e06f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73572) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 10:18:19 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] Converting VIF {"id": "3e7d3f56-193b-43ba-9cc5-c5373755e06f", "address": "fa:16:3e:85:00:8b", "network": {"id": "c0d598c4-68c6-4cfc-adf1-dc0360861788", "bridge": "br-int", "label": "tempest-device-tagging-net1-1696215747", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.177", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7cf2ae4dd7d3474394090e3276c957ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e7d3f56-19", "ovs_interfaceid": "3e7d3f56-193b-43ba-9cc5-c5373755e06f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:18:19 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:85:00:8b,bridge_name='br-int',has_traffic_filtering=True,id=3e7d3f56-193b-43ba-9cc5-c5373755e06f,network=Network(c0d598c4-68c6-4cfc-adf1-dc0360861788),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3e7d3f56-19') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:18:19 user nova-compute[73572]: DEBUG os_vif [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:85:00:8b,bridge_name='br-int',has_traffic_filtering=True,id=3e7d3f56-193b-43ba-9cc5-c5373755e06f,network=Network(c0d598c4-68c6-4cfc-adf1-dc0360861788),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3e7d3f56-19') {{(pid=73572) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 10:18:19 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:18:19 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:18:19 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 10:18:19 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:18:19 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3e7d3f56-19, may_exist=True, interface_attrs={}) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:18:19 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3e7d3f56-19, col_values=(('external_ids', {'iface-id': '3e7d3f56-193b-43ba-9cc5-c5373755e06f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:85:00:8b', 'vm-uuid': '41c1ef7a-4f98-4cbb-9948-acb96bd9d557'}),), if_exists=True) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:18:19 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:18:19 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:18:19 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:18:19 user nova-compute[73572]: INFO os_vif [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:85:00:8b,bridge_name='br-int',has_traffic_filtering=True,id=3e7d3f56-193b-43ba-9cc5-c5373755e06f,network=Network(c0d598c4-68c6-4cfc-adf1-dc0360861788),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3e7d3f56-19')
Aug 26 10:18:19 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T10:17:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-134774677',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-134774677',id=22,image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMM+PyzPMQ665kAGppNf46HsUT3HYJTkwTVFQbIbkDU4VagIXaQ7SGc4u3qE2bya41WFz6iVsv2EpJnZJz5aQ7MB5uYF8zBmhQDv3kMfZLp/PrDgRH/onZJ/CCLLihoJzA==',key_name='tempest-keypair-1169777187',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7cf2ae4dd7d3474394090e3276c957ec',ramdisk_id='',reservation_id='r-r8s410lq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2076699378',owner_user_name='tempest-TaggedBootDevicesTest_v242-2076699378-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T10:17:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='25fdd7b9201b4f6eaf5eb6d55bb09ab5',uuid=41c1ef7a-4f98-4cbb-9948-acb96bd9d557,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f264d951-8920-4151-8276-33baa6a9def9", "address": "fa:16:3e:a7:e2:2a", "network": {"id": "c0d598c4-68c6-4cfc-adf1-dc0360861788", "bridge": "br-int", "label": "tempest-device-tagging-net1-1696215747", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7cf2ae4dd7d3474394090e3276c957ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf264d951-89", "ovs_interfaceid": "f264d951-8920-4151-8276-33baa6a9def9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 10:18:19 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] Converting VIF {"id": "f264d951-8920-4151-8276-33baa6a9def9", "address": "fa:16:3e:a7:e2:2a", "network": {"id": "c0d598c4-68c6-4cfc-adf1-dc0360861788", "bridge": "br-int", "label": "tempest-device-tagging-net1-1696215747", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7cf2ae4dd7d3474394090e3276c957ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf264d951-89", "ovs_interfaceid": "f264d951-8920-4151-8276-33baa6a9def9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:18:19 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:e2:2a,bridge_name='br-int',has_traffic_filtering=True,id=f264d951-8920-4151-8276-33baa6a9def9,network=Network(c0d598c4-68c6-4cfc-adf1-dc0360861788),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf264d951-89') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:18:19 user nova-compute[73572]: DEBUG os_vif [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:e2:2a,bridge_name='br-int',has_traffic_filtering=True,id=f264d951-8920-4151-8276-33baa6a9def9,network=Network(c0d598c4-68c6-4cfc-adf1-dc0360861788),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf264d951-89') {{(pid=73572) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 10:18:19 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:18:19 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:18:19 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 10:18:19 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:18:19 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf264d951-89, may_exist=True, interface_attrs={}) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:18:19 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf264d951-89, col_values=(('external_ids', {'iface-id': 'f264d951-8920-4151-8276-33baa6a9def9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a7:e2:2a', 'vm-uuid': '41c1ef7a-4f98-4cbb-9948-acb96bd9d557'}),), if_exists=True) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:18:19 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:18:19 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:18:19 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:18:19 user nova-compute[73572]: INFO os_vif [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:e2:2a,bridge_name='br-int',has_traffic_filtering=True,id=f264d951-8920-4151-8276-33baa6a9def9,network=Network(c0d598c4-68c6-4cfc-adf1-dc0360861788),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf264d951-89')
Aug 26 10:18:19 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T10:17:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-134774677',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-134774677',id=22,image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMM+PyzPMQ665kAGppNf46HsUT3HYJTkwTVFQbIbkDU4VagIXaQ7SGc4u3qE2bya41WFz6iVsv2EpJnZJz5aQ7MB5uYF8zBmhQDv3kMfZLp/PrDgRH/onZJ/CCLLihoJzA==',key_name='tempest-keypair-1169777187',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7cf2ae4dd7d3474394090e3276c957ec',ramdisk_id='',reservation_id='r-r8s410lq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2076699378',owner_user_name='tempest-TaggedBootDevicesTest_v242-2076699378-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T10:17:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='25fdd7b9201b4f6eaf5eb6d55bb09ab5',uuid=41c1ef7a-4f98-4cbb-9948-acb96bd9d557,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c0c6f2bc-3209-461a-bcc3-edf740139ca2", "address": "fa:16:3e:d1:c7:a5", "network": {"id": "c0d598c4-68c6-4cfc-adf1-dc0360861788", "bridge": "br-int", "label": "tempest-device-tagging-net1-1696215747", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.224", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7cf2ae4dd7d3474394090e3276c957ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0c6f2bc-32", "ovs_interfaceid": "c0c6f2bc-3209-461a-bcc3-edf740139ca2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 10:18:19 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] Converting VIF {"id": "c0c6f2bc-3209-461a-bcc3-edf740139ca2", "address": "fa:16:3e:d1:c7:a5", "network": {"id": "c0d598c4-68c6-4cfc-adf1-dc0360861788", "bridge": "br-int", "label": "tempest-device-tagging-net1-1696215747", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.224", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7cf2ae4dd7d3474394090e3276c957ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0c6f2bc-32", "ovs_interfaceid": "c0c6f2bc-3209-461a-bcc3-edf740139ca2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:18:19 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:c7:a5,bridge_name='br-int',has_traffic_filtering=True,id=c0c6f2bc-3209-461a-bcc3-edf740139ca2,network=Network(c0d598c4-68c6-4cfc-adf1-dc0360861788),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0c6f2bc-32') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:18:19 user nova-compute[73572]: DEBUG os_vif [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:c7:a5,bridge_name='br-int',has_traffic_filtering=True,id=c0c6f2bc-3209-461a-bcc3-edf740139ca2,network=Network(c0d598c4-68c6-4cfc-adf1-dc0360861788),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0c6f2bc-32') {{(pid=73572) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 10:18:19 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:18:19 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:18:19 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 10:18:19 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:18:19 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc0c6f2bc-32, may_exist=True, interface_attrs={}) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:18:19 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc0c6f2bc-32, col_values=(('external_ids', {'iface-id': 'c0c6f2bc-3209-461a-bcc3-edf740139ca2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d1:c7:a5', 'vm-uuid': '41c1ef7a-4f98-4cbb-9948-acb96bd9d557'}),), if_exists=True) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:18:19 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:18:19 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:18:19 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:18:19 user nova-compute[73572]: INFO os_vif [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:c7:a5,bridge_name='br-int',has_traffic_filtering=True,id=c0c6f2bc-3209-461a-bcc3-edf740139ca2,network=Network(c0d598c4-68c6-4cfc-adf1-dc0360861788),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0c6f2bc-32')
Aug 26 10:18:19 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T10:17:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-134774677',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-134774677',id=22,image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMM+PyzPMQ665kAGppNf46HsUT3HYJTkwTVFQbIbkDU4VagIXaQ7SGc4u3qE2bya41WFz6iVsv2EpJnZJz5aQ7MB5uYF8zBmhQDv3kMfZLp/PrDgRH/onZJ/CCLLihoJzA==',key_name='tempest-keypair-1169777187',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7cf2ae4dd7d3474394090e3276c957ec',ramdisk_id='',reservation_id='r-r8s410lq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2076699378',owner_user_name='tempest-TaggedBootDevicesTest_v242-2076699378-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T10:17:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='25fdd7b9201b4f6eaf5eb6d55bb09ab5',uuid=41c1ef7a-4f98-4cbb-9948-acb96bd9d557,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2fe25c93-5639-47a6-80de-8cc83615e3c4", "address": "fa:16:3e:59:09:63", "network": {"id": "f69a6193-9faf-4224-b21b-bc60491f9aea", "bridge": "br-int", "label": "tempest-device-tagging-net2-1404521418", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7cf2ae4dd7d3474394090e3276c957ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fe25c93-56", "ovs_interfaceid": "2fe25c93-5639-47a6-80de-8cc83615e3c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 10:18:19 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] Converting VIF {"id": "2fe25c93-5639-47a6-80de-8cc83615e3c4", "address": "fa:16:3e:59:09:63", "network": {"id": "f69a6193-9faf-4224-b21b-bc60491f9aea", "bridge": "br-int", "label": "tempest-device-tagging-net2-1404521418", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7cf2ae4dd7d3474394090e3276c957ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fe25c93-56", "ovs_interfaceid": "2fe25c93-5639-47a6-80de-8cc83615e3c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:18:19 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:09:63,bridge_name='br-int',has_traffic_filtering=True,id=2fe25c93-5639-47a6-80de-8cc83615e3c4,network=Network(f69a6193-9faf-4224-b21b-bc60491f9aea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2fe25c93-56') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:18:19 user nova-compute[73572]: DEBUG os_vif [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:09:63,bridge_name='br-int',has_traffic_filtering=True,id=2fe25c93-5639-47a6-80de-8cc83615e3c4,network=Network(f69a6193-9faf-4224-b21b-bc60491f9aea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2fe25c93-56') {{(pid=73572) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 10:18:19 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:18:19 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:18:19 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 10:18:19 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:18:19 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:18:19 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2fe25c93-56, may_exist=True, interface_attrs={}) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:18:19 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2fe25c93-56, col_values=(('external_ids', {'iface-id': '2fe25c93-5639-47a6-80de-8cc83615e3c4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:59:09:63', 'vm-uuid': '41c1ef7a-4f98-4cbb-9948-acb96bd9d557'}),), if_exists=True) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:18:19 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:18:19 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:18:19 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:18:19 user nova-compute[73572]: INFO os_vif [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:09:63,bridge_name='br-int',has_traffic_filtering=True,id=2fe25c93-5639-47a6-80de-8cc83615e3c4,network=Network(f69a6193-9faf-4224-b21b-bc60491f9aea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2fe25c93-56')
Aug 26 10:18:19 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T10:17:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-134774677',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-134774677',id=22,image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMM+PyzPMQ665kAGppNf46HsUT3HYJTkwTVFQbIbkDU4VagIXaQ7SGc4u3qE2bya41WFz6iVsv2EpJnZJz5aQ7MB5uYF8zBmhQDv3kMfZLp/PrDgRH/onZJ/CCLLihoJzA==',key_name='tempest-keypair-1169777187',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7cf2ae4dd7d3474394090e3276c957ec',ramdisk_id='',reservation_id='r-r8s410lq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2076699378',owner_user_name='tempest-TaggedBootDevicesTest_v242-2076699378-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T10:17:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='25fdd7b9201b4f6eaf5eb6d55bb09ab5',uuid=41c1ef7a-4f98-4cbb-9948-acb96bd9d557,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8bc3e6f9-0fb7-4283-973c-cbb09e440e68", "address": "fa:16:3e:3d:e7:4c", "network": {"id": "f69a6193-9faf-4224-b21b-bc60491f9aea", "bridge": "br-int", "label": "tempest-device-tagging-net2-1404521418", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7cf2ae4dd7d3474394090e3276c957ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bc3e6f9-0f", "ovs_interfaceid": "8bc3e6f9-0fb7-4283-973c-cbb09e440e68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 10:18:19 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] Converting VIF {"id": "8bc3e6f9-0fb7-4283-973c-cbb09e440e68", "address": "fa:16:3e:3d:e7:4c", "network": {"id": "f69a6193-9faf-4224-b21b-bc60491f9aea", "bridge": "br-int", "label": "tempest-device-tagging-net2-1404521418", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7cf2ae4dd7d3474394090e3276c957ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bc3e6f9-0f", "ovs_interfaceid": "8bc3e6f9-0fb7-4283-973c-cbb09e440e68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:18:19 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:e7:4c,bridge_name='br-int',has_traffic_filtering=True,id=8bc3e6f9-0fb7-4283-973c-cbb09e440e68,network=Network(f69a6193-9faf-4224-b21b-bc60491f9aea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8bc3e6f9-0f') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:18:19 user nova-compute[73572]: DEBUG os_vif [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:e7:4c,bridge_name='br-int',has_traffic_filtering=True,id=8bc3e6f9-0fb7-4283-973c-cbb09e440e68,network=Network(f69a6193-9faf-4224-b21b-bc60491f9aea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8bc3e6f9-0f') {{(pid=73572) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 10:18:19 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:18:19 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:18:19 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 10:18:19 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:18:19 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8bc3e6f9-0f, may_exist=True, interface_attrs={}) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:18:19 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8bc3e6f9-0f, col_values=(('external_ids', {'iface-id': '8bc3e6f9-0fb7-4283-973c-cbb09e440e68', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3d:e7:4c', 'vm-uuid': '41c1ef7a-4f98-4cbb-9948-acb96bd9d557'}),), if_exists=True) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:18:19 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:18:19 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:18:19 user nova-compute[73572]: INFO os_vif [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:e7:4c,bridge_name='br-int',has_traffic_filtering=True,id=8bc3e6f9-0fb7-4283-973c-cbb09e440e68,network=Network(f69a6193-9faf-4224-b21b-bc60491f9aea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8bc3e6f9-0f')
Aug 26 10:18:19 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] No BDM found with device name hda, not building metadata. {{(pid=73572) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 10:18:19 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] No BDM found with device name vdc, not building metadata. {{(pid=73572) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 10:18:19 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] No VIF found with MAC fa:16:3e:95:40:4c, not building metadata {{(pid=73572) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 10:18:19 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] No VIF found with MAC fa:16:3e:d1:c7:a5, not building metadata {{(pid=73572) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 10:18:19 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] Using config drive
Aug 26 10:18:19 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] Creating config drive at /opt/stack/data/nova/instances/41c1ef7a-4f98-4cbb-9948-acb96bd9d557/disk.config
Aug 26 10:18:19 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/41c1ef7a-4f98-4cbb-9948-acb96bd9d557/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpaatvr3oo {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:18:19 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:18:19 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/41c1ef7a-4f98-4cbb-9948-acb96bd9d557/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpaatvr3oo" returned: 0 in 0.052s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:18:19 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:18:19 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:18:19 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:18:19 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Auditing locally available compute resources for user (node: user) {{(pid=73572) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 10:18:21 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:18:21 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:18:21 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:18:21 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:18:21 user nova-compute[73572]: DEBUG nova.compute.manager [req-45ee205c-2d86-43dc-b987-60e6ef450d28 req-04bc364f-5558-4631-aaba-1c957e04d742 service nova] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] Received event network-vif-plugged-123d944e-47d4-4f95-94bc-73e1920ecbc1 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:18:21 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-45ee205c-2d86-43dc-b987-60e6ef450d28 req-04bc364f-5558-4631-aaba-1c957e04d742 service nova] Acquiring lock "41c1ef7a-4f98-4cbb-9948-acb96bd9d557-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:18:21 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-45ee205c-2d86-43dc-b987-60e6ef450d28 req-04bc364f-5558-4631-aaba-1c957e04d742 service nova] Lock "41c1ef7a-4f98-4cbb-9948-acb96bd9d557-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:18:21 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-45ee205c-2d86-43dc-b987-60e6ef450d28 req-04bc364f-5558-4631-aaba-1c957e04d742 service nova] Lock "41c1ef7a-4f98-4cbb-9948-acb96bd9d557-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:18:21 user nova-compute[73572]: DEBUG nova.compute.manager [req-45ee205c-2d86-43dc-b987-60e6ef450d28 req-04bc364f-5558-4631-aaba-1c957e04d742 service nova] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] No waiting events found dispatching network-vif-plugged-123d944e-47d4-4f95-94bc-73e1920ecbc1 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:18:21 user nova-compute[73572]: WARNING nova.compute.manager [req-45ee205c-2d86-43dc-b987-60e6ef450d28 req-04bc364f-5558-4631-aaba-1c957e04d742 service nova] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] Received unexpected event network-vif-plugged-123d944e-47d4-4f95-94bc-73e1920ecbc1 for instance with vm_state building and task_state spawning.
Aug 26 10:18:21 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:18:21 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:18:21 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:18:21 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:18:21 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:18:21 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:18:21 user nova-compute[73572]: DEBUG nova.compute.manager [req-777060e2-de26-4158-b109-bcadbdfef712 req-d45d0d4c-e149-419f-b19d-aba3add13018 service nova] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] Received event network-vif-plugged-696cd753-312c-437d-b140-c40b4158554e {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:18:21 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-777060e2-de26-4158-b109-bcadbdfef712 req-d45d0d4c-e149-419f-b19d-aba3add13018 service nova] Acquiring lock "41c1ef7a-4f98-4cbb-9948-acb96bd9d557-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:18:21 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-777060e2-de26-4158-b109-bcadbdfef712 req-d45d0d4c-e149-419f-b19d-aba3add13018 service nova] Lock "41c1ef7a-4f98-4cbb-9948-acb96bd9d557-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:18:21 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-777060e2-de26-4158-b109-bcadbdfef712 req-d45d0d4c-e149-419f-b19d-aba3add13018 service nova] Lock "41c1ef7a-4f98-4cbb-9948-acb96bd9d557-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:18:21 user nova-compute[73572]: DEBUG nova.compute.manager [req-777060e2-de26-4158-b109-bcadbdfef712 req-d45d0d4c-e149-419f-b19d-aba3add13018 service nova] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] No waiting events found dispatching network-vif-plugged-696cd753-312c-437d-b140-c40b4158554e {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:18:21 user nova-compute[73572]: WARNING nova.compute.manager [req-777060e2-de26-4158-b109-bcadbdfef712 req-d45d0d4c-e149-419f-b19d-aba3add13018 service nova] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] Received unexpected event network-vif-plugged-696cd753-312c-437d-b140-c40b4158554e for instance with vm_state building and task_state spawning.
Aug 26 10:18:21 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:18:22 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:18:22 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:18:22 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:18:22 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:18:22 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:18:22 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:18:22 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:18:22 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:18:22 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:18:22 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:18:22 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:18:22 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:18:22 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:18:22 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:18:22 user nova-compute[73572]: DEBUG nova.compute.manager [req-3e19649f-6a8b-4f61-ac40-7aa278a65214 req-f0d3d0b4-dd92-4dde-b8b3-6a1c3e2ffd75 service nova] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] Received event network-vif-plugged-c0c6f2bc-3209-461a-bcc3-edf740139ca2 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:18:22 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-3e19649f-6a8b-4f61-ac40-7aa278a65214 req-f0d3d0b4-dd92-4dde-b8b3-6a1c3e2ffd75 service nova] Acquiring lock "41c1ef7a-4f98-4cbb-9948-acb96bd9d557-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:18:22 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-3e19649f-6a8b-4f61-ac40-7aa278a65214 req-f0d3d0b4-dd92-4dde-b8b3-6a1c3e2ffd75 service nova] Lock "41c1ef7a-4f98-4cbb-9948-acb96bd9d557-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:18:22 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-3e19649f-6a8b-4f61-ac40-7aa278a65214 req-f0d3d0b4-dd92-4dde-b8b3-6a1c3e2ffd75 service nova] Lock "41c1ef7a-4f98-4cbb-9948-acb96bd9d557-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:18:22 user nova-compute[73572]: DEBUG nova.compute.manager [req-3e19649f-6a8b-4f61-ac40-7aa278a65214 req-f0d3d0b4-dd92-4dde-b8b3-6a1c3e2ffd75 service nova] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] No waiting events found dispatching network-vif-plugged-c0c6f2bc-3209-461a-bcc3-edf740139ca2 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:18:22 user nova-compute[73572]: WARNING nova.compute.manager [req-3e19649f-6a8b-4f61-ac40-7aa278a65214 req-f0d3d0b4-dd92-4dde-b8b3-6a1c3e2ffd75 service nova] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] Received unexpected event network-vif-plugged-c0c6f2bc-3209-461a-bcc3-edf740139ca2 for instance with vm_state building and task_state spawning.
Aug 26 10:18:22 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:18:23 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:18:23 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:18:23 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:18:23 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:18:23 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:18:23 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:18:23 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:18:23 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:18:23 user nova-compute[73572]: DEBUG nova.compute.manager [req-1426cde9-2f91-48e1-884a-35ad665c77cc req-6d06cf88-9ec9-4ebf-bf3e-253b4e2c841a service nova] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] Received event network-vif-plugged-123d944e-47d4-4f95-94bc-73e1920ecbc1 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:18:23 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-1426cde9-2f91-48e1-884a-35ad665c77cc req-6d06cf88-9ec9-4ebf-bf3e-253b4e2c841a service nova] Acquiring lock "41c1ef7a-4f98-4cbb-9948-acb96bd9d557-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:18:23 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-1426cde9-2f91-48e1-884a-35ad665c77cc req-6d06cf88-9ec9-4ebf-bf3e-253b4e2c841a service nova] Lock "41c1ef7a-4f98-4cbb-9948-acb96bd9d557-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:18:23 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-1426cde9-2f91-48e1-884a-35ad665c77cc req-6d06cf88-9ec9-4ebf-bf3e-253b4e2c841a service nova] Lock "41c1ef7a-4f98-4cbb-9948-acb96bd9d557-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:18:23 user nova-compute[73572]: DEBUG nova.compute.manager [req-1426cde9-2f91-48e1-884a-35ad665c77cc req-6d06cf88-9ec9-4ebf-bf3e-253b4e2c841a service nova] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] No waiting events found dispatching network-vif-plugged-123d944e-47d4-4f95-94bc-73e1920ecbc1 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:18:23 user nova-compute[73572]: WARNING nova.compute.manager [req-1426cde9-2f91-48e1-884a-35ad665c77cc req-6d06cf88-9ec9-4ebf-bf3e-253b4e2c841a service nova] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] Received unexpected event network-vif-plugged-123d944e-47d4-4f95-94bc-73e1920ecbc1 for instance with vm_state building and task_state spawning.
Aug 26 10:18:23 user nova-compute[73572]: DEBUG nova.compute.manager [req-1426cde9-2f91-48e1-884a-35ad665c77cc req-6d06cf88-9ec9-4ebf-bf3e-253b4e2c841a service nova] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] Received event network-vif-plugged-3e7d3f56-193b-43ba-9cc5-c5373755e06f {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:18:23 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-1426cde9-2f91-48e1-884a-35ad665c77cc req-6d06cf88-9ec9-4ebf-bf3e-253b4e2c841a service nova] Acquiring lock "41c1ef7a-4f98-4cbb-9948-acb96bd9d557-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:18:23 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-1426cde9-2f91-48e1-884a-35ad665c77cc req-6d06cf88-9ec9-4ebf-bf3e-253b4e2c841a service nova] Lock "41c1ef7a-4f98-4cbb-9948-acb96bd9d557-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:18:23 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-1426cde9-2f91-48e1-884a-35ad665c77cc req-6d06cf88-9ec9-4ebf-bf3e-253b4e2c841a service nova] Lock "41c1ef7a-4f98-4cbb-9948-acb96bd9d557-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:18:23 user nova-compute[73572]: DEBUG nova.compute.manager [req-1426cde9-2f91-48e1-884a-35ad665c77cc req-6d06cf88-9ec9-4ebf-bf3e-253b4e2c841a service nova] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] No waiting events found dispatching network-vif-plugged-3e7d3f56-193b-43ba-9cc5-c5373755e06f {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:18:23 user nova-compute[73572]: WARNING nova.compute.manager [req-1426cde9-2f91-48e1-884a-35ad665c77cc req-6d06cf88-9ec9-4ebf-bf3e-253b4e2c841a service nova] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] Received unexpected event network-vif-plugged-3e7d3f56-193b-43ba-9cc5-c5373755e06f for instance with vm_state building and task_state spawning.
Aug 26 10:18:23 user nova-compute[73572]: DEBUG nova.compute.manager [req-1426cde9-2f91-48e1-884a-35ad665c77cc req-6d06cf88-9ec9-4ebf-bf3e-253b4e2c841a service nova] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] Received event network-vif-plugged-3e7d3f56-193b-43ba-9cc5-c5373755e06f {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:18:23 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-1426cde9-2f91-48e1-884a-35ad665c77cc req-6d06cf88-9ec9-4ebf-bf3e-253b4e2c841a service nova] Acquiring lock "41c1ef7a-4f98-4cbb-9948-acb96bd9d557-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:18:23 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-1426cde9-2f91-48e1-884a-35ad665c77cc req-6d06cf88-9ec9-4ebf-bf3e-253b4e2c841a service nova] Lock "41c1ef7a-4f98-4cbb-9948-acb96bd9d557-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:18:23 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-1426cde9-2f91-48e1-884a-35ad665c77cc req-6d06cf88-9ec9-4ebf-bf3e-253b4e2c841a service nova] Lock "41c1ef7a-4f98-4cbb-9948-acb96bd9d557-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:18:23 user nova-compute[73572]: DEBUG nova.compute.manager [req-1426cde9-2f91-48e1-884a-35ad665c77cc req-6d06cf88-9ec9-4ebf-bf3e-253b4e2c841a service nova] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] No waiting events found dispatching network-vif-plugged-3e7d3f56-193b-43ba-9cc5-c5373755e06f {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:18:23 user nova-compute[73572]: WARNING nova.compute.manager [req-1426cde9-2f91-48e1-884a-35ad665c77cc req-6d06cf88-9ec9-4ebf-bf3e-253b4e2c841a service nova] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] Received unexpected event network-vif-plugged-3e7d3f56-193b-43ba-9cc5-c5373755e06f for instance with vm_state building and task_state spawning.
Aug 26 10:18:23 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:18:23 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:18:23 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8302d6e7-aaf3-461c-a55e-f2e685d1800d/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:18:24 user nova-compute[73572]: DEBUG nova.compute.manager [req-442646c7-4261-4477-989e-8e3ce6af37fb req-5a3864c3-9ea7-4e67-b440-236fd4b23912 service nova] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] Received event network-vif-plugged-696cd753-312c-437d-b140-c40b4158554e {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:18:24 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-442646c7-4261-4477-989e-8e3ce6af37fb req-5a3864c3-9ea7-4e67-b440-236fd4b23912 service nova] Acquiring lock "41c1ef7a-4f98-4cbb-9948-acb96bd9d557-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:18:24 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-442646c7-4261-4477-989e-8e3ce6af37fb req-5a3864c3-9ea7-4e67-b440-236fd4b23912 service nova] Lock "41c1ef7a-4f98-4cbb-9948-acb96bd9d557-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:18:24 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-442646c7-4261-4477-989e-8e3ce6af37fb req-5a3864c3-9ea7-4e67-b440-236fd4b23912 service nova] Lock "41c1ef7a-4f98-4cbb-9948-acb96bd9d557-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:18:24 user nova-compute[73572]: DEBUG nova.compute.manager [req-442646c7-4261-4477-989e-8e3ce6af37fb req-5a3864c3-9ea7-4e67-b440-236fd4b23912 service nova] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] No waiting events found dispatching network-vif-plugged-696cd753-312c-437d-b140-c40b4158554e {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:18:24 user nova-compute[73572]: WARNING nova.compute.manager [req-442646c7-4261-4477-989e-8e3ce6af37fb req-5a3864c3-9ea7-4e67-b440-236fd4b23912 service nova] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] Received unexpected event network-vif-plugged-696cd753-312c-437d-b140-c40b4158554e for instance with vm_state building and task_state spawning.
Aug 26 10:18:24 user nova-compute[73572]: DEBUG nova.compute.manager [req-442646c7-4261-4477-989e-8e3ce6af37fb req-5a3864c3-9ea7-4e67-b440-236fd4b23912 service nova] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] Received event network-vif-plugged-f264d951-8920-4151-8276-33baa6a9def9 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:18:24 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-442646c7-4261-4477-989e-8e3ce6af37fb req-5a3864c3-9ea7-4e67-b440-236fd4b23912 service nova] Acquiring lock "41c1ef7a-4f98-4cbb-9948-acb96bd9d557-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:18:24 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-442646c7-4261-4477-989e-8e3ce6af37fb req-5a3864c3-9ea7-4e67-b440-236fd4b23912 service nova] Lock "41c1ef7a-4f98-4cbb-9948-acb96bd9d557-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:18:24 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-442646c7-4261-4477-989e-8e3ce6af37fb req-5a3864c3-9ea7-4e67-b440-236fd4b23912 service nova] Lock "41c1ef7a-4f98-4cbb-9948-acb96bd9d557-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:18:24 user nova-compute[73572]: DEBUG nova.compute.manager [req-442646c7-4261-4477-989e-8e3ce6af37fb req-5a3864c3-9ea7-4e67-b440-236fd4b23912 service nova] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] No waiting events found dispatching network-vif-plugged-f264d951-8920-4151-8276-33baa6a9def9 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:18:24 user nova-compute[73572]: WARNING nova.compute.manager [req-442646c7-4261-4477-989e-8e3ce6af37fb req-5a3864c3-9ea7-4e67-b440-236fd4b23912 service nova] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] Received unexpected event network-vif-plugged-f264d951-8920-4151-8276-33baa6a9def9 for instance with vm_state building and task_state spawning.
Aug 26 10:18:24 user nova-compute[73572]: DEBUG nova.compute.manager [req-442646c7-4261-4477-989e-8e3ce6af37fb req-5a3864c3-9ea7-4e67-b440-236fd4b23912 service nova] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] Received event network-vif-plugged-f264d951-8920-4151-8276-33baa6a9def9 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:18:24 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-442646c7-4261-4477-989e-8e3ce6af37fb req-5a3864c3-9ea7-4e67-b440-236fd4b23912 service nova] Acquiring lock "41c1ef7a-4f98-4cbb-9948-acb96bd9d557-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:18:24 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-442646c7-4261-4477-989e-8e3ce6af37fb req-5a3864c3-9ea7-4e67-b440-236fd4b23912 service nova] Lock "41c1ef7a-4f98-4cbb-9948-acb96bd9d557-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:18:24 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-442646c7-4261-4477-989e-8e3ce6af37fb req-5a3864c3-9ea7-4e67-b440-236fd4b23912 service nova] Lock "41c1ef7a-4f98-4cbb-9948-acb96bd9d557-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:18:24 user nova-compute[73572]: DEBUG nova.compute.manager [req-442646c7-4261-4477-989e-8e3ce6af37fb req-5a3864c3-9ea7-4e67-b440-236fd4b23912 service nova] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] No waiting events found dispatching network-vif-plugged-f264d951-8920-4151-8276-33baa6a9def9 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:18:24 user nova-compute[73572]: WARNING nova.compute.manager [req-442646c7-4261-4477-989e-8e3ce6af37fb req-5a3864c3-9ea7-4e67-b440-236fd4b23912 service nova] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] Received unexpected event network-vif-plugged-f264d951-8920-4151-8276-33baa6a9def9 for instance with vm_state building and task_state spawning.
Aug 26 10:18:24 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8302d6e7-aaf3-461c-a55e-f2e685d1800d/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:18:24 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8302d6e7-aaf3-461c-a55e-f2e685d1800d/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:18:24 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8302d6e7-aaf3-461c-a55e-f2e685d1800d/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:18:24 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c785b609-0068-442f-91f5-d26e888a993f/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:18:24 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:18:24 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:18:24 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:18:24 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:18:24 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:18:24 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:18:24 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:18:24 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c785b609-0068-442f-91f5-d26e888a993f/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:18:24 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c785b609-0068-442f-91f5-d26e888a993f/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:18:24 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c785b609-0068-442f-91f5-d26e888a993f/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:18:24 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dceaa35-4a13-453b-961f-831f66c35af0/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:18:24 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:18:24 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:18:24 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dceaa35-4a13-453b-961f-831f66c35af0/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:18:24 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dceaa35-4a13-453b-961f-831f66c35af0/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:18:25 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dceaa35-4a13-453b-961f-831f66c35af0/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:18:25 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73572) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 10:18:25 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00c47a06-2bf8-427d-bcb1-304688584511/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:18:25 user nova-compute[73572]: DEBUG nova.compute.manager [req-811cba30-576b-482e-a631-7c107d3e106d req-2a3d4cac-654d-4177-8f25-c947e99eec64 service nova] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] Received event network-vif-plugged-c0c6f2bc-3209-461a-bcc3-edf740139ca2 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:18:25 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-811cba30-576b-482e-a631-7c107d3e106d req-2a3d4cac-654d-4177-8f25-c947e99eec64 service nova] Acquiring lock "41c1ef7a-4f98-4cbb-9948-acb96bd9d557-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:18:25 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-811cba30-576b-482e-a631-7c107d3e106d req-2a3d4cac-654d-4177-8f25-c947e99eec64 service nova] Lock "41c1ef7a-4f98-4cbb-9948-acb96bd9d557-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:18:25 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-811cba30-576b-482e-a631-7c107d3e106d req-2a3d4cac-654d-4177-8f25-c947e99eec64 service nova] Lock "41c1ef7a-4f98-4cbb-9948-acb96bd9d557-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:18:25 user nova-compute[73572]: DEBUG nova.compute.manager [req-811cba30-576b-482e-a631-7c107d3e106d req-2a3d4cac-654d-4177-8f25-c947e99eec64 service nova] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] No waiting events found dispatching network-vif-plugged-c0c6f2bc-3209-461a-bcc3-edf740139ca2 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:18:25 user nova-compute[73572]: WARNING nova.compute.manager [req-811cba30-576b-482e-a631-7c107d3e106d req-2a3d4cac-654d-4177-8f25-c947e99eec64 service nova] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] Received unexpected event network-vif-plugged-c0c6f2bc-3209-461a-bcc3-edf740139ca2 for instance with vm_state building and task_state spawning.
Aug 26 10:18:25 user nova-compute[73572]: DEBUG nova.compute.manager [req-811cba30-576b-482e-a631-7c107d3e106d req-2a3d4cac-654d-4177-8f25-c947e99eec64 service nova] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] Received event network-vif-plugged-2fe25c93-5639-47a6-80de-8cc83615e3c4 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:18:25 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-811cba30-576b-482e-a631-7c107d3e106d req-2a3d4cac-654d-4177-8f25-c947e99eec64 service nova] Acquiring lock "41c1ef7a-4f98-4cbb-9948-acb96bd9d557-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:18:25 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-811cba30-576b-482e-a631-7c107d3e106d req-2a3d4cac-654d-4177-8f25-c947e99eec64 service nova] Lock "41c1ef7a-4f98-4cbb-9948-acb96bd9d557-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:18:25 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-811cba30-576b-482e-a631-7c107d3e106d req-2a3d4cac-654d-4177-8f25-c947e99eec64 service nova] Lock "41c1ef7a-4f98-4cbb-9948-acb96bd9d557-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:18:25 user nova-compute[73572]: DEBUG nova.compute.manager [req-811cba30-576b-482e-a631-7c107d3e106d req-2a3d4cac-654d-4177-8f25-c947e99eec64 service nova] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] No waiting events found dispatching network-vif-plugged-2fe25c93-5639-47a6-80de-8cc83615e3c4 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:18:25 user nova-compute[73572]: WARNING nova.compute.manager [req-811cba30-576b-482e-a631-7c107d3e106d req-2a3d4cac-654d-4177-8f25-c947e99eec64 service nova] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] Received unexpected event network-vif-plugged-2fe25c93-5639-47a6-80de-8cc83615e3c4 for instance with vm_state building and task_state spawning.
Aug 26 10:18:25 user nova-compute[73572]: DEBUG nova.compute.manager [req-811cba30-576b-482e-a631-7c107d3e106d req-2a3d4cac-654d-4177-8f25-c947e99eec64 service nova] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] Received event network-vif-plugged-2fe25c93-5639-47a6-80de-8cc83615e3c4 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:18:25 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-811cba30-576b-482e-a631-7c107d3e106d req-2a3d4cac-654d-4177-8f25-c947e99eec64 service nova] Acquiring lock "41c1ef7a-4f98-4cbb-9948-acb96bd9d557-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:18:25 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-811cba30-576b-482e-a631-7c107d3e106d req-2a3d4cac-654d-4177-8f25-c947e99eec64 service nova] Lock "41c1ef7a-4f98-4cbb-9948-acb96bd9d557-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:18:25 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-811cba30-576b-482e-a631-7c107d3e106d req-2a3d4cac-654d-4177-8f25-c947e99eec64 service nova] Lock "41c1ef7a-4f98-4cbb-9948-acb96bd9d557-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:18:25 user nova-compute[73572]: DEBUG nova.compute.manager [req-811cba30-576b-482e-a631-7c107d3e106d req-2a3d4cac-654d-4177-8f25-c947e99eec64 service nova] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] No waiting events found dispatching network-vif-plugged-2fe25c93-5639-47a6-80de-8cc83615e3c4 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:18:25 user nova-compute[73572]: WARNING nova.compute.manager [req-811cba30-576b-482e-a631-7c107d3e106d req-2a3d4cac-654d-4177-8f25-c947e99eec64 service nova] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] Received unexpected event network-vif-plugged-2fe25c93-5639-47a6-80de-8cc83615e3c4 for instance with vm_state building and task_state spawning.
Aug 26 10:18:25 user nova-compute[73572]: DEBUG nova.compute.manager [req-811cba30-576b-482e-a631-7c107d3e106d req-2a3d4cac-654d-4177-8f25-c947e99eec64 service nova] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] Received event network-vif-plugged-8bc3e6f9-0fb7-4283-973c-cbb09e440e68 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:18:25 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-811cba30-576b-482e-a631-7c107d3e106d req-2a3d4cac-654d-4177-8f25-c947e99eec64 service nova] Acquiring lock "41c1ef7a-4f98-4cbb-9948-acb96bd9d557-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:18:25 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-811cba30-576b-482e-a631-7c107d3e106d req-2a3d4cac-654d-4177-8f25-c947e99eec64 service nova] Lock "41c1ef7a-4f98-4cbb-9948-acb96bd9d557-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:18:25 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-811cba30-576b-482e-a631-7c107d3e106d req-2a3d4cac-654d-4177-8f25-c947e99eec64 service nova] Lock "41c1ef7a-4f98-4cbb-9948-acb96bd9d557-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:18:25 user nova-compute[73572]: DEBUG nova.compute.manager [req-811cba30-576b-482e-a631-7c107d3e106d req-2a3d4cac-654d-4177-8f25-c947e99eec64 service nova] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] No waiting events found dispatching network-vif-plugged-8bc3e6f9-0fb7-4283-973c-cbb09e440e68 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:18:25 user nova-compute[73572]: WARNING nova.compute.manager [req-811cba30-576b-482e-a631-7c107d3e106d req-2a3d4cac-654d-4177-8f25-c947e99eec64 service nova] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] Received unexpected event network-vif-plugged-8bc3e6f9-0fb7-4283-973c-cbb09e440e68 for instance with vm_state building and task_state spawning.
Aug 26 10:18:25 user nova-compute[73572]: DEBUG nova.compute.manager [req-811cba30-576b-482e-a631-7c107d3e106d req-2a3d4cac-654d-4177-8f25-c947e99eec64 service nova] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] Received event network-vif-plugged-8bc3e6f9-0fb7-4283-973c-cbb09e440e68 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:18:25 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-811cba30-576b-482e-a631-7c107d3e106d req-2a3d4cac-654d-4177-8f25-c947e99eec64 service nova] Acquiring lock "41c1ef7a-4f98-4cbb-9948-acb96bd9d557-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:18:25 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-811cba30-576b-482e-a631-7c107d3e106d req-2a3d4cac-654d-4177-8f25-c947e99eec64 service nova] Lock "41c1ef7a-4f98-4cbb-9948-acb96bd9d557-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:18:25 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-811cba30-576b-482e-a631-7c107d3e106d req-2a3d4cac-654d-4177-8f25-c947e99eec64 service nova] Lock "41c1ef7a-4f98-4cbb-9948-acb96bd9d557-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:18:25 user nova-compute[73572]: DEBUG nova.compute.manager [req-811cba30-576b-482e-a631-7c107d3e106d req-2a3d4cac-654d-4177-8f25-c947e99eec64 service nova] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] No waiting events found dispatching network-vif-plugged-8bc3e6f9-0fb7-4283-973c-cbb09e440e68 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:18:25 user nova-compute[73572]: WARNING nova.compute.manager [req-811cba30-576b-482e-a631-7c107d3e106d req-2a3d4cac-654d-4177-8f25-c947e99eec64 service nova] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] Received unexpected event network-vif-plugged-8bc3e6f9-0fb7-4283-973c-cbb09e440e68 for instance with vm_state building and task_state spawning.
Aug 26 10:18:25 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00c47a06-2bf8-427d-bcb1-304688584511/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:18:25 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00c47a06-2bf8-427d-bcb1-304688584511/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:18:25 user nova-compute[73572]: DEBUG nova.virt.driver [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Emitting event <LifecycleEvent: 1693045105.4202518, 41c1ef7a-4f98-4cbb-9948-acb96bd9d557 => Resumed> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:18:25 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] VM Resumed (Lifecycle Event)
Aug 26 10:18:25 user nova-compute[73572]: DEBUG nova.compute.manager [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] Instance event wait completed in 0 seconds for  {{(pid=73572) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 10:18:25 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] Guest created on hypervisor {{(pid=73572) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 10:18:25 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00c47a06-2bf8-427d-bcb1-304688584511/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:18:25 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73572) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 10:18:25 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=73572) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 10:18:25 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14fab12e-52be-4fe6-8777-bc7ebf3c25f1/disk.rescue --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:18:25 user nova-compute[73572]: INFO nova.virt.libvirt.driver [-] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] Instance spawned successfully.
Aug 26 10:18:25 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:18:25 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 10:18:25 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73572) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 10:18:25 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] Found default for hw_cdrom_bus of ide {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:18:25 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] Found default for hw_disk_bus of virtio {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:18:25 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] Found default for hw_input_bus of None {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:18:25 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] Found default for hw_pointer_model of None {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:18:25 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] Found default for hw_video_model of virtio {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:18:25 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] Found default for hw_vif_model of virtio {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:18:25 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 10:18:25 user nova-compute[73572]: DEBUG nova.virt.driver [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Emitting event <LifecycleEvent: 1693045105.4255142, 41c1ef7a-4f98-4cbb-9948-acb96bd9d557 => Started> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:18:25 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] VM Started (Lifecycle Event)
Aug 26 10:18:25 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:18:25 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73572) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 10:18:25 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 10:18:25 user nova-compute[73572]: INFO nova.compute.manager [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] Took 10.67 seconds to spawn the instance on the hypervisor.
Aug 26 10:18:25 user nova-compute[73572]: DEBUG nova.compute.manager [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:18:25 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14fab12e-52be-4fe6-8777-bc7ebf3c25f1/disk.rescue --force-share --output=json" returned: 0 in 0.196s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:18:25 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14fab12e-52be-4fe6-8777-bc7ebf3c25f1/disk.rescue --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:18:25 user nova-compute[73572]: INFO nova.compute.manager [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] Took 48.73 seconds to build instance.
Aug 26 10:18:25 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-b4da9bee-868d-4e5c-8615-599452050543 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] Lock "41c1ef7a-4f98-4cbb-9948-acb96bd9d557" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 48.839s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:18:25 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "41c1ef7a-4f98-4cbb-9948-acb96bd9d557" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 38.900s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:18:25 user nova-compute[73572]: INFO nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] During sync_power_state the instance has a pending task (block_device_mapping). Skip.
Aug 26 10:18:25 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "41c1ef7a-4f98-4cbb-9948-acb96bd9d557" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:18:25 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14fab12e-52be-4fe6-8777-bc7ebf3c25f1/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:18:25 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c555f971-b177-4c26-a38e-09e0e78bf7b9/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:18:26 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c555f971-b177-4c26-a38e-09e0e78bf7b9/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:18:26 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c555f971-b177-4c26-a38e-09e0e78bf7b9/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:18:26 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-86af31cc-0c10-4299-8920-c4a912dd79cf tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] [instance: 682138af-ba6a-47f1-a9a5-03ae2661f54d] Calling os-brick to attach iSCSI Volume {{(pid=73572) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 10:18:26 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-86af31cc-0c10-4299-8920-c4a912dd79cf tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc89c3d6a10>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:302c3cfe-f0ec-4b1c-b1d9-dc12d4f4ce40'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UwbOMKoP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 10:18:26 user nova-compute[73572]: WARNING os_brick.initiator.connectors.base [None req-86af31cc-0c10-4299-8920-c4a912dd79cf tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 10:18:26 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-86af31cc-0c10-4299-8920-c4a912dd79cf tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 10:18:26 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-86af31cc-0c10-4299-8920-c4a912dd79cf tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 10:18:26 user nova-compute[73572]: WARNING os_brick.initiator.connectors.base [None req-86af31cc-0c10-4299-8920-c4a912dd79cf tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 10:18:26 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-86af31cc-0c10-4299-8920-c4a912dd79cf tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:302c3cfe-f0ec-4b1c-b1d9-dc12d4f4ce40" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 10:18:26 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-86af31cc-0c10-4299-8920-c4a912dd79cf tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:302c3cfe-f0ec-4b1c-b1d9-dc12d4f4ce40" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 10:18:26 user nova-compute[73572]: INFO os_brick.initiator.connectors.iscsi [None req-86af31cc-0c10-4299-8920-c4a912dd79cf tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 10:18:26 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:302c3cfe-f0ec-4b1c-b1d9-dc12d4f4ce40 -p 172.16.0.220:3260 {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:18:26 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:302c3cfe-f0ec-4b1c-b1d9-dc12d4f4ce40 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:18:26 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[1303fccd-36b3-4594-b686-6e0a2a589c0d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:18:26 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-86af31cc-0c10-4299-8920-c4a912dd79cf tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 10:18:26 user nova-compute[73572]:  {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:18:26 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:302c3cfe-f0ec-4b1c-b1d9-dc12d4f4ce40 -p 172.16.0.220:3260 --interface default --op new {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:18:26 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:302c3cfe-f0ec-4b1c-b1d9-dc12d4f4ce40 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:18:26 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c555f971-b177-4c26-a38e-09e0e78bf7b9/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:18:26 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[79c928c4-646c-4693-9f5a-1226416802c9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:302c3cfe-f0ec-4b1c-b1d9-dc12d4f4ce40] added\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:18:26 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-86af31cc-0c10-4299-8920-c4a912dd79cf tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:302c3cfe-f0ec-4b1c-b1d9-dc12d4f4ce40] added
Aug 26 10:18:26 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:18:26 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:302c3cfe-f0ec-4b1c-b1d9-dc12d4f4ce40 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:18:26 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/682138af-ba6a-47f1-a9a5-03ae2661f54d/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:18:26 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:302c3cfe-f0ec-4b1c-b1d9-dc12d4f4ce40 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:18:26 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[78ff69ca-4347-49c6-8b27-c769d84b3247]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:18:26 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-86af31cc-0c10-4299-8920-c4a912dd79cf tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:18:26 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:302c3cfe-f0ec-4b1c-b1d9-dc12d4f4ce40 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:18:26 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:302c3cfe-f0ec-4b1c-b1d9-dc12d4f4ce40 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:18:26 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[44df7f69-c591-46da-a971-8a8d7d9c1db3]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:18:26 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-86af31cc-0c10-4299-8920-c4a912dd79cf tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:18:26 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:302c3cfe-f0ec-4b1c-b1d9-dc12d4f4ce40 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UwbOMKoP {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:18:26 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:302c3cfe-f0ec-4b1c-b1d9-dc12d4f4ce40 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UwbOMKoP" returned: 0 in 0.018s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:18:26 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc0cd6d3-e29c-4f46-8ad3-7e9137eb2c47]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:18:26 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-86af31cc-0c10-4299-8920-c4a912dd79cf tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UwbOMKoP'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:18:26 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:302c3cfe-f0ec-4b1c-b1d9-dc12d4f4ce40 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:18:26 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:302c3cfe-f0ec-4b1c-b1d9-dc12d4f4ce40 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:18:26 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6e734f7-f0a7-47db-a7f5-9261ac029c34]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:18:26 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-86af31cc-0c10-4299-8920-c4a912dd79cf tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:18:26 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:18:26 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:18:26 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[966aa515-b794-4cad-8ad1-497fab0cab80]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d94556c8-9096-4e9a-9cfc-f9d17846ed06 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c22666f6-bb12-41a8-b565-837f4617df4e (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57b56972-76f9-44aa-905c-14d04f924f76 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaa45a8a-93fc-4fac-bc41-ce4fa5173718 (non-flash)\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:18:26 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-86af31cc-0c10-4299-8920-c4a912dd79cf tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)
Aug 26 10:18:26 user nova-compute[73572]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478 (non-flash)
Aug 26 10:18:26 user nova-compute[73572]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d94556c8-9096-4e9a-9cfc-f9d17846ed06 (non-flash)
Aug 26 10:18:26 user nova-compute[73572]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c22666f6-bb12-41a8-b565-837f4617df4e (non-flash)
Aug 26 10:18:26 user nova-compute[73572]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57b56972-76f9-44aa-905c-14d04f924f76 (non-flash)
Aug 26 10:18:26 user nova-compute[73572]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaa45a8a-93fc-4fac-bc41-ce4fa5173718 (non-flash)
Aug 26 10:18:26 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 10:18:26 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-86af31cc-0c10-4299-8920-c4a912dd79cf tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)
Aug 26 10:18:26 user nova-compute[73572]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478 (non-flash)
Aug 26 10:18:26 user nova-compute[73572]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d94556c8-9096-4e9a-9cfc-f9d17846ed06 (non-flash)
Aug 26 10:18:26 user nova-compute[73572]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c22666f6-bb12-41a8-b565-837f4617df4e (non-flash)
Aug 26 10:18:26 user nova-compute[73572]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57b56972-76f9-44aa-905c-14d04f924f76 (non-flash)
Aug 26 10:18:26 user nova-compute[73572]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaa45a8a-93fc-4fac-bc41-ce4fa5173718 (non-flash)
Aug 26 10:18:26 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 10:18:26 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:302c3cfe-f0ec-4b1c-b1d9-dc12d4f4ce40 -p 172.16.0.220:3260 --login {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:18:26 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/682138af-ba6a-47f1-a9a5-03ae2661f54d/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:18:26 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/682138af-ba6a-47f1-a9a5-03ae2661f54d/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:18:26 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:302c3cfe-f0ec-4b1c-b1d9-dc12d4f4ce40 -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:18:26 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e5539d7-d0a4-41e8-a10d-ef766d1ffd83]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:302c3cfe-f0ec-4b1c-b1d9-dc12d4f4ce40, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:302c3cfe-f0ec-4b1c-b1d9-dc12d4f4ce40, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:18:26 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-86af31cc-0c10-4299-8920-c4a912dd79cf tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:302c3cfe-f0ec-4b1c-b1d9-dc12d4f4ce40, portal: 172.16.0.220,3260]
Aug 26 10:18:26 user nova-compute[73572]: Login to [iface: default, target: iqn.2010-10.org.openstack:302c3cfe-f0ec-4b1c-b1d9-dc12d4f4ce40, portal: 172.16.0.220,3260] successful.
Aug 26 10:18:26 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:18:26 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:302c3cfe-f0ec-4b1c-b1d9-dc12d4f4ce40 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:18:26 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:302c3cfe-f0ec-4b1c-b1d9-dc12d4f4ce40 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:18:26 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[37b85517-7f01-4f21-be48-10c1f55119d1]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:18:26 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-86af31cc-0c10-4299-8920-c4a912dd79cf tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:18:26 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:18:26 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.045s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:18:26 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[93627bc5-b1d1-4a7d-969d-9015fb100a72]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d94556c8-9096-4e9a-9cfc-f9d17846ed06 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c22666f6-bb12-41a8-b565-837f4617df4e (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57b56972-76f9-44aa-905c-14d04f924f76 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaa45a8a-93fc-4fac-bc41-ce4fa5173718 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:302c3cfe-f0ec-4b1c-b1d9-dc12d4f4ce40 (non-flash)\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:18:26 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-86af31cc-0c10-4299-8920-c4a912dd79cf tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)
Aug 26 10:18:26 user nova-compute[73572]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478 (non-flash)
Aug 26 10:18:26 user nova-compute[73572]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d94556c8-9096-4e9a-9cfc-f9d17846ed06 (non-flash)
Aug 26 10:18:26 user nova-compute[73572]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c22666f6-bb12-41a8-b565-837f4617df4e (non-flash)
Aug 26 10:18:26 user nova-compute[73572]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57b56972-76f9-44aa-905c-14d04f924f76 (non-flash)
Aug 26 10:18:26 user nova-compute[73572]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaa45a8a-93fc-4fac-bc41-ce4fa5173718 (non-flash)
Aug 26 10:18:26 user nova-compute[73572]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:302c3cfe-f0ec-4b1c-b1d9-dc12d4f4ce40 (non-flash)
Aug 26 10:18:26 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 10:18:26 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-86af31cc-0c10-4299-8920-c4a912dd79cf tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)
Aug 26 10:18:26 user nova-compute[73572]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478 (non-flash)
Aug 26 10:18:26 user nova-compute[73572]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d94556c8-9096-4e9a-9cfc-f9d17846ed06 (non-flash)
Aug 26 10:18:26 user nova-compute[73572]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c22666f6-bb12-41a8-b565-837f4617df4e (non-flash)
Aug 26 10:18:26 user nova-compute[73572]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57b56972-76f9-44aa-905c-14d04f924f76 (non-flash)
Aug 26 10:18:26 user nova-compute[73572]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaa45a8a-93fc-4fac-bc41-ce4fa5173718 (non-flash)
Aug 26 10:18:26 user nova-compute[73572]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:302c3cfe-f0ec-4b1c-b1d9-dc12d4f4ce40 (non-flash)
Aug 26 10:18:26 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 10:18:26 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-86af31cc-0c10-4299-8920-c4a912dd79cf tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:302c3cfe-f0ec-4b1c-b1d9-dc12d4f4ce40" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.349s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 10:18:26 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-86af31cc-0c10-4299-8920-c4a912dd79cf tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Connected to 172.16.0.220:3260 {{(pid=73572) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 10:18:26 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-86af31cc-0c10-4299-8920-c4a912dd79cf tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] HCTL ('39', '-', '-', 0) found on session 20 with lun 0 {{(pid=73572) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 10:18:26 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-86af31cc-0c10-4299-8920-c4a912dd79cf tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=73572) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 10:18:26 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:18:26 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.016s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:18:26 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d7c13dd-95ce-4fee-9fc9-057db959a9d0]: (4, ('- - 0', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:18:26 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-86af31cc-0c10-4299-8920-c4a912dd79cf tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Searching for a device in session 20 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=73572) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 10:18:26 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-86af31cc-0c10-4299-8920-c4a912dd79cf tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Connected to sdh using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UwbOMKoP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73572) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 10:18:26 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/682138af-ba6a-47f1-a9a5-03ae2661f54d/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:18:26 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73572) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 10:18:26 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=73572) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 10:18:26 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=73572) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 10:18:26 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2970584-8c2a-4f99-922c-d66d59489504/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:18:26 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2970584-8c2a-4f99-922c-d66d59489504/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:18:26 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2970584-8c2a-4f99-922c-d66d59489504/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:18:26 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2970584-8c2a-4f99-922c-d66d59489504/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:18:26 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fe47a17-4ffb-48ce-b0f6-a9b43002bd55/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:18:27 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fe47a17-4ffb-48ce-b0f6-a9b43002bd55/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:18:27 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fe47a17-4ffb-48ce-b0f6-a9b43002bd55/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:18:27 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fe47a17-4ffb-48ce-b0f6-a9b43002bd55/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:18:27 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-86af31cc-0c10-4299-8920-c4a912dd79cf tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.665s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 10:18:27 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-86af31cc-0c10-4299-8920-c4a912dd79cf tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] <== connect_volume: return (1668ms) {'type': 'block', 'scsi_wwn': '26338323065626331', 'path': '/dev/sdh'} {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 10:18:27 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-86af31cc-0c10-4299-8920-c4a912dd79cf tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] [instance: 682138af-ba6a-47f1-a9a5-03ae2661f54d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26338323065626331', 'path': '/dev/sdh'} {{(pid=73572) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 10:18:27 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:18:27 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:18:27 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Hypervisor/Node resource view: name=user free_ram=7147MB free_disk=25.23326873779297GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=73572) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 10:18:27 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:18:27 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:18:27 user nova-compute[73572]: DEBUG nova.objects.instance [None req-86af31cc-0c10-4299-8920-c4a912dd79cf tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Lazy-loading 'flavor' on Instance uuid 682138af-ba6a-47f1-a9a5-03ae2661f54d {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:18:27 user nova-compute[73572]: DEBUG nova.virt.libvirt.guest [None req-86af31cc-0c10-4299-8920-c4a912dd79cf tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 10:18:27 user nova-compute[73572]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 10:18:27 user nova-compute[73572]:   <source dev="/dev/sdh"/>
Aug 26 10:18:27 user nova-compute[73572]:   <target dev="vdb" bus="virtio"/>
Aug 26 10:18:27 user nova-compute[73572]:   <serial>302c3cfe-f0ec-4b1c-b1d9-dc12d4f4ce40</serial>
Aug 26 10:18:27 user nova-compute[73572]: </disk>
Aug 26 10:18:27 user nova-compute[73572]:  {{(pid=73572) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 10:18:27 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance c785b609-0068-442f-91f5-d26e888a993f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:18:27 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance 8302d6e7-aaf3-461c-a55e-f2e685d1800d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:18:27 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance c555f971-b177-4c26-a38e-09e0e78bf7b9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:18:27 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance 14fab12e-52be-4fe6-8777-bc7ebf3c25f1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:18:27 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance 00c47a06-2bf8-427d-bcb1-304688584511 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:18:27 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance d2970584-8c2a-4f99-922c-d66d59489504 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:18:27 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:18:27 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance 682138af-ba6a-47f1-a9a5-03ae2661f54d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:18:27 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance 0dceaa35-4a13-453b-961f-831f66c35af0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:18:27 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance 339517ef-c023-4f13-a8cc-d84f7176dfcd actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:18:27 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance 41c1ef7a-4f98-4cbb-9948-acb96bd9d557 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:18:27 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=73572) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 10:18:27 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=73572) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 10:18:28 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-86af31cc-0c10-4299-8920-c4a912dd79cf tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] No BDM found with device name vda, not building metadata. {{(pid=73572) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 10:18:28 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-86af31cc-0c10-4299-8920-c4a912dd79cf tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73572) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 10:18:28 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-86af31cc-0c10-4299-8920-c4a912dd79cf tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] No VIF found with MAC fa:16:3e:d2:52:c7, not building metadata {{(pid=73572) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 10:18:28 user nova-compute[73572]: DEBUG nova.compute.provider_tree [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Inventory has not changed in ProviderTree for provider: e2cec974-59b2-4c77-a53d-a7f4e5a30d75 {{(pid=73572) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 10:18:28 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Inventory has not changed for provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73572) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 10:18:28 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Compute_service record updated for user:user {{(pid=73572) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 10:18:28 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.526s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:18:28 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-86af31cc-0c10-4299-8920-c4a912dd79cf tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Lock "682138af-ba6a-47f1-a9a5-03ae2661f54d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.934s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:18:29 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:18:29 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:18:34 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:18:34 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:18:34 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73572) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 10:18:34 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73572) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 10:18:34 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73572) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 10:18:34 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:18:35 user nova-compute[73572]: DEBUG nova.compute.manager [req-077e6651-7f3a-49d5-8b87-cc790eedc4b1 req-f6cf417b-1965-4a57-97a1-b8dcc10ce13a service nova] [instance: 0dceaa35-4a13-453b-961f-831f66c35af0] Received event network-changed-3c5d5d20-da80-4401-b027-3c4b0df169c6 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:18:35 user nova-compute[73572]: DEBUG nova.compute.manager [req-077e6651-7f3a-49d5-8b87-cc790eedc4b1 req-f6cf417b-1965-4a57-97a1-b8dcc10ce13a service nova] [instance: 0dceaa35-4a13-453b-961f-831f66c35af0] Refreshing instance network info cache due to event network-changed-3c5d5d20-da80-4401-b027-3c4b0df169c6. {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 10:18:35 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-077e6651-7f3a-49d5-8b87-cc790eedc4b1 req-f6cf417b-1965-4a57-97a1-b8dcc10ce13a service nova] Acquiring lock "refresh_cache-0dceaa35-4a13-453b-961f-831f66c35af0" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:18:35 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-077e6651-7f3a-49d5-8b87-cc790eedc4b1 req-f6cf417b-1965-4a57-97a1-b8dcc10ce13a service nova] Acquired lock "refresh_cache-0dceaa35-4a13-453b-961f-831f66c35af0" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:18:35 user nova-compute[73572]: DEBUG nova.network.neutron [req-077e6651-7f3a-49d5-8b87-cc790eedc4b1 req-f6cf417b-1965-4a57-97a1-b8dcc10ce13a service nova] [instance: 0dceaa35-4a13-453b-961f-831f66c35af0] Refreshing network info cache for port 3c5d5d20-da80-4401-b027-3c4b0df169c6 {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 10:18:35 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-94bb322b-e1ba-4226-9463-d8aef378024b tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] Acquiring lock "interface-0dceaa35-4a13-453b-961f-831f66c35af0-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:18:35 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-94bb322b-e1ba-4226-9463-d8aef378024b tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] Lock "interface-0dceaa35-4a13-453b-961f-831f66c35af0-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:18:35 user nova-compute[73572]: DEBUG nova.objects.instance [None req-94bb322b-e1ba-4226-9463-d8aef378024b tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] Lazy-loading 'flavor' on Instance uuid 0dceaa35-4a13-453b-961f-831f66c35af0 {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:18:35 user nova-compute[73572]: DEBUG nova.network.neutron [req-077e6651-7f3a-49d5-8b87-cc790eedc4b1 req-f6cf417b-1965-4a57-97a1-b8dcc10ce13a service nova] [instance: 0dceaa35-4a13-453b-961f-831f66c35af0] Updated VIF entry in instance network info cache for port 3c5d5d20-da80-4401-b027-3c4b0df169c6. {{(pid=73572) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 10:18:35 user nova-compute[73572]: DEBUG nova.network.neutron [req-077e6651-7f3a-49d5-8b87-cc790eedc4b1 req-f6cf417b-1965-4a57-97a1-b8dcc10ce13a service nova] [instance: 0dceaa35-4a13-453b-961f-831f66c35af0] Updating instance_info_cache with network_info: [{"id": "3c5d5d20-da80-4401-b027-3c4b0df169c6", "address": "fa:16:3e:ad:63:c3", "network": {"id": "92949b0a-01f9-413c-9f96-a25b9b648f84", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-167588816-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d2915087eb04830831062675024f835", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c5d5d20-da", "ovs_interfaceid": "3c5d5d20-da80-4401-b027-3c4b0df169c6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:18:35 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-077e6651-7f3a-49d5-8b87-cc790eedc4b1 req-f6cf417b-1965-4a57-97a1-b8dcc10ce13a service nova] Releasing lock "refresh_cache-0dceaa35-4a13-453b-961f-831f66c35af0" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:18:35 user nova-compute[73572]: DEBUG nova.objects.instance [None req-94bb322b-e1ba-4226-9463-d8aef378024b tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] Lazy-loading 'pci_requests' on Instance uuid 0dceaa35-4a13-453b-961f-831f66c35af0 {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:18:35 user nova-compute[73572]: DEBUG nova.objects.base [None req-94bb322b-e1ba-4226-9463-d8aef378024b tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] Object Instance<0dceaa35-4a13-453b-961f-831f66c35af0> lazy-loaded attributes: flavor,pci_requests {{(pid=73572) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 10:18:35 user nova-compute[73572]: DEBUG nova.network.neutron [None req-94bb322b-e1ba-4226-9463-d8aef378024b tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] [instance: 0dceaa35-4a13-453b-961f-831f66c35af0] allocate_for_instance() {{(pid=73572) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 10:18:36 user nova-compute[73572]: DEBUG nova.policy [None req-94bb322b-e1ba-4226-9463-d8aef378024b tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5ff395781b5f403fa56cada31e168817', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d2915087eb04830831062675024f835', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73572) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 10:18:36 user nova-compute[73572]: DEBUG nova.network.neutron [None req-94bb322b-e1ba-4226-9463-d8aef378024b tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] [instance: 0dceaa35-4a13-453b-961f-831f66c35af0] Successfully created port: 953f6a62-54f7-40f2-8bde-2639ab34c351 {{(pid=73572) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 10:18:37 user nova-compute[73572]: DEBUG nova.network.neutron [None req-94bb322b-e1ba-4226-9463-d8aef378024b tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] [instance: 0dceaa35-4a13-453b-961f-831f66c35af0] Successfully updated port: 953f6a62-54f7-40f2-8bde-2639ab34c351 {{(pid=73572) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 10:18:37 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-94bb322b-e1ba-4226-9463-d8aef378024b tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] Acquiring lock "refresh_cache-0dceaa35-4a13-453b-961f-831f66c35af0" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:18:37 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-94bb322b-e1ba-4226-9463-d8aef378024b tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] Acquired lock "refresh_cache-0dceaa35-4a13-453b-961f-831f66c35af0" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:18:37 user nova-compute[73572]: DEBUG nova.network.neutron [None req-94bb322b-e1ba-4226-9463-d8aef378024b tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] [instance: 0dceaa35-4a13-453b-961f-831f66c35af0] Building network info cache for instance {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 10:18:37 user nova-compute[73572]: DEBUG nova.compute.manager [req-fc8aeb4f-3bad-475c-9002-a35375a32ef2 req-3eb6b53f-b858-44ab-9d58-9df7597e5383 service nova] [instance: 0dceaa35-4a13-453b-961f-831f66c35af0] Received event network-changed-953f6a62-54f7-40f2-8bde-2639ab34c351 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:18:37 user nova-compute[73572]: DEBUG nova.compute.manager [req-fc8aeb4f-3bad-475c-9002-a35375a32ef2 req-3eb6b53f-b858-44ab-9d58-9df7597e5383 service nova] [instance: 0dceaa35-4a13-453b-961f-831f66c35af0] Refreshing instance network info cache due to event network-changed-953f6a62-54f7-40f2-8bde-2639ab34c351. {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 10:18:37 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-fc8aeb4f-3bad-475c-9002-a35375a32ef2 req-3eb6b53f-b858-44ab-9d58-9df7597e5383 service nova] Acquiring lock "refresh_cache-0dceaa35-4a13-453b-961f-831f66c35af0" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:18:38 user nova-compute[73572]: DEBUG nova.network.neutron [None req-94bb322b-e1ba-4226-9463-d8aef378024b tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] [instance: 0dceaa35-4a13-453b-961f-831f66c35af0] Updating instance_info_cache with network_info: [{"id": "3c5d5d20-da80-4401-b027-3c4b0df169c6", "address": "fa:16:3e:ad:63:c3", "network": {"id": "92949b0a-01f9-413c-9f96-a25b9b648f84", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-167588816-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d2915087eb04830831062675024f835", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c5d5d20-da", "ovs_interfaceid": "3c5d5d20-da80-4401-b027-3c4b0df169c6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "953f6a62-54f7-40f2-8bde-2639ab34c351", "address": "fa:16:3e:de:2b:93", "network": {"id": "4562dd45-7d3c-4cca-b97c-a3114383641b", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1852107155", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.28", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "6d2915087eb04830831062675024f835", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap953f6a62-54", "ovs_interfaceid": "953f6a62-54f7-40f2-8bde-2639ab34c351", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:18:38 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-94bb322b-e1ba-4226-9463-d8aef378024b tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] Releasing lock "refresh_cache-0dceaa35-4a13-453b-961f-831f66c35af0" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:18:38 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-fc8aeb4f-3bad-475c-9002-a35375a32ef2 req-3eb6b53f-b858-44ab-9d58-9df7597e5383 service nova] Acquired lock "refresh_cache-0dceaa35-4a13-453b-961f-831f66c35af0" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:18:38 user nova-compute[73572]: DEBUG nova.network.neutron [req-fc8aeb4f-3bad-475c-9002-a35375a32ef2 req-3eb6b53f-b858-44ab-9d58-9df7597e5383 service nova] [instance: 0dceaa35-4a13-453b-961f-831f66c35af0] Refreshing network info cache for port 953f6a62-54f7-40f2-8bde-2639ab34c351 {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 10:18:38 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-94bb322b-e1ba-4226-9463-d8aef378024b tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T10:16:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1180989107',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1180989107',id=20,image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCoQLfbNOsScPlPdH7TTAWBoUTtprP7Wt9D2iobB5TEO7soZAUDBZvsnw8EfneOw36+/lna9tLwlSS51wnghWJumalBKBT2droQjZV+qAgp3BnIGzzIB2rwkhacN2zLmGg==',key_name='tempest-keypair-1046141656',keypairs=<?>,launch_index=0,launched_at=2023-08-26T10:16:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='6d2915087eb04830831062675024f835',ramdisk_id='',reservation_id='r-untu6l5l',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1639980618',owner_user_name='tempest-TaggedAttachmentsTest-1639980618-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T10:16:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5ff395781b5f403fa56cada31e168817',uuid=0dceaa35-4a13-453b-961f-831f66c35af0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "953f6a62-54f7-40f2-8bde-2639ab34c351", "address": "fa:16:3e:de:2b:93", "network": {"id": "4562dd45-7d3c-4cca-b97c-a3114383641b", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1852107155", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.28", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "6d2915087eb04830831062675024f835", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap953f6a62-54", "ovs_interfaceid": "953f6a62-54f7-40f2-8bde-2639ab34c351", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 10:18:38 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-94bb322b-e1ba-4226-9463-d8aef378024b tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] Converting VIF {"id": "953f6a62-54f7-40f2-8bde-2639ab34c351", "address": "fa:16:3e:de:2b:93", "network": {"id": "4562dd45-7d3c-4cca-b97c-a3114383641b", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1852107155", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.28", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "6d2915087eb04830831062675024f835", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap953f6a62-54", "ovs_interfaceid": "953f6a62-54f7-40f2-8bde-2639ab34c351", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:18:38 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-94bb322b-e1ba-4226-9463-d8aef378024b tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:2b:93,bridge_name='br-int',has_traffic_filtering=True,id=953f6a62-54f7-40f2-8bde-2639ab34c351,network=Network(4562dd45-7d3c-4cca-b97c-a3114383641b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap953f6a62-54') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:18:38 user nova-compute[73572]: DEBUG os_vif [None req-94bb322b-e1ba-4226-9463-d8aef378024b tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:2b:93,bridge_name='br-int',has_traffic_filtering=True,id=953f6a62-54f7-40f2-8bde-2639ab34c351,network=Network(4562dd45-7d3c-4cca-b97c-a3114383641b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap953f6a62-54') {{(pid=73572) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 10:18:38 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:18:38 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:18:38 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 10:18:38 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:18:38 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap953f6a62-54, may_exist=True, interface_attrs={}) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:18:38 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap953f6a62-54, col_values=(('external_ids', {'iface-id': '953f6a62-54f7-40f2-8bde-2639ab34c351', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:de:2b:93', 'vm-uuid': '0dceaa35-4a13-453b-961f-831f66c35af0'}),), if_exists=True) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:18:38 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:18:38 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:18:38 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:18:38 user nova-compute[73572]: INFO os_vif [None req-94bb322b-e1ba-4226-9463-d8aef378024b tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:2b:93,bridge_name='br-int',has_traffic_filtering=True,id=953f6a62-54f7-40f2-8bde-2639ab34c351,network=Network(4562dd45-7d3c-4cca-b97c-a3114383641b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap953f6a62-54')
Aug 26 10:18:38 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-94bb322b-e1ba-4226-9463-d8aef378024b tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T10:16:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1180989107',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1180989107',id=20,image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCoQLfbNOsScPlPdH7TTAWBoUTtprP7Wt9D2iobB5TEO7soZAUDBZvsnw8EfneOw36+/lna9tLwlSS51wnghWJumalBKBT2droQjZV+qAgp3BnIGzzIB2rwkhacN2zLmGg==',key_name='tempest-keypair-1046141656',keypairs=<?>,launch_index=0,launched_at=2023-08-26T10:16:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='6d2915087eb04830831062675024f835',ramdisk_id='',reservation_id='r-untu6l5l',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1639980618',owner_user_name='tempest-TaggedAttachmentsTest-1639980618-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T10:16:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5ff395781b5f403fa56cada31e168817',uuid=0dceaa35-4a13-453b-961f-831f66c35af0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "953f6a62-54f7-40f2-8bde-2639ab34c351", "address": "fa:16:3e:de:2b:93", "network": {"id": "4562dd45-7d3c-4cca-b97c-a3114383641b", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1852107155", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.28", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "6d2915087eb04830831062675024f835", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap953f6a62-54", "ovs_interfaceid": "953f6a62-54f7-40f2-8bde-2639ab34c351", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73572) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 10:18:38 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-94bb322b-e1ba-4226-9463-d8aef378024b tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] Converting VIF {"id": "953f6a62-54f7-40f2-8bde-2639ab34c351", "address": "fa:16:3e:de:2b:93", "network": {"id": "4562dd45-7d3c-4cca-b97c-a3114383641b", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1852107155", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.28", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "6d2915087eb04830831062675024f835", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap953f6a62-54", "ovs_interfaceid": "953f6a62-54f7-40f2-8bde-2639ab34c351", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:18:38 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-94bb322b-e1ba-4226-9463-d8aef378024b tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:2b:93,bridge_name='br-int',has_traffic_filtering=True,id=953f6a62-54f7-40f2-8bde-2639ab34c351,network=Network(4562dd45-7d3c-4cca-b97c-a3114383641b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap953f6a62-54') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:18:38 user nova-compute[73572]: DEBUG nova.virt.libvirt.guest [None req-94bb322b-e1ba-4226-9463-d8aef378024b tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] attach device xml: <interface type="ethernet">
Aug 26 10:18:38 user nova-compute[73572]:   <mac address="fa:16:3e:de:2b:93"/>
Aug 26 10:18:38 user nova-compute[73572]:   <model type="virtio"/>
Aug 26 10:18:38 user nova-compute[73572]:   <mtu size="1442"/>
Aug 26 10:18:38 user nova-compute[73572]:   <target dev="tap953f6a62-54"/>
Aug 26 10:18:38 user nova-compute[73572]: </interface>
Aug 26 10:18:38 user nova-compute[73572]:  {{(pid=73572) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 10:18:38 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:18:38 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:18:38 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:18:38 user nova-compute[73572]: DEBUG nova.compute.manager [req-07d9ed8a-61ab-488b-bc1c-813344be0b33 req-a2514a5f-659d-4d5f-b0ff-b45013e91d81 service nova] [instance: 0dceaa35-4a13-453b-961f-831f66c35af0] Received event network-vif-plugged-953f6a62-54f7-40f2-8bde-2639ab34c351 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:18:38 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-07d9ed8a-61ab-488b-bc1c-813344be0b33 req-a2514a5f-659d-4d5f-b0ff-b45013e91d81 service nova] Acquiring lock "0dceaa35-4a13-453b-961f-831f66c35af0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:18:38 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-07d9ed8a-61ab-488b-bc1c-813344be0b33 req-a2514a5f-659d-4d5f-b0ff-b45013e91d81 service nova] Lock "0dceaa35-4a13-453b-961f-831f66c35af0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:18:38 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-07d9ed8a-61ab-488b-bc1c-813344be0b33 req-a2514a5f-659d-4d5f-b0ff-b45013e91d81 service nova] Lock "0dceaa35-4a13-453b-961f-831f66c35af0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:18:38 user nova-compute[73572]: DEBUG nova.compute.manager [req-07d9ed8a-61ab-488b-bc1c-813344be0b33 req-a2514a5f-659d-4d5f-b0ff-b45013e91d81 service nova] [instance: 0dceaa35-4a13-453b-961f-831f66c35af0] No waiting events found dispatching network-vif-plugged-953f6a62-54f7-40f2-8bde-2639ab34c351 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:18:38 user nova-compute[73572]: WARNING nova.compute.manager [req-07d9ed8a-61ab-488b-bc1c-813344be0b33 req-a2514a5f-659d-4d5f-b0ff-b45013e91d81 service nova] [instance: 0dceaa35-4a13-453b-961f-831f66c35af0] Received unexpected event network-vif-plugged-953f6a62-54f7-40f2-8bde-2639ab34c351 for instance with vm_state active and task_state None.
Aug 26 10:18:39 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-94bb322b-e1ba-4226-9463-d8aef378024b tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] No BDM found with device name vda, not building metadata. {{(pid=73572) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 10:18:39 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-94bb322b-e1ba-4226-9463-d8aef378024b tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] No BDM found with device name hda, not building metadata. {{(pid=73572) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 10:18:39 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-94bb322b-e1ba-4226-9463-d8aef378024b tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] No VIF found with MAC fa:16:3e:ad:63:c3, not building metadata {{(pid=73572) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 10:18:39 user nova-compute[73572]: DEBUG nova.network.neutron [req-fc8aeb4f-3bad-475c-9002-a35375a32ef2 req-3eb6b53f-b858-44ab-9d58-9df7597e5383 service nova] [instance: 0dceaa35-4a13-453b-961f-831f66c35af0] Updated VIF entry in instance network info cache for port 953f6a62-54f7-40f2-8bde-2639ab34c351. {{(pid=73572) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 10:18:39 user nova-compute[73572]: DEBUG nova.network.neutron [req-fc8aeb4f-3bad-475c-9002-a35375a32ef2 req-3eb6b53f-b858-44ab-9d58-9df7597e5383 service nova] [instance: 0dceaa35-4a13-453b-961f-831f66c35af0] Updating instance_info_cache with network_info: [{"id": "3c5d5d20-da80-4401-b027-3c4b0df169c6", "address": "fa:16:3e:ad:63:c3", "network": {"id": "92949b0a-01f9-413c-9f96-a25b9b648f84", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-167588816-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d2915087eb04830831062675024f835", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c5d5d20-da", "ovs_interfaceid": "3c5d5d20-da80-4401-b027-3c4b0df169c6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "953f6a62-54f7-40f2-8bde-2639ab34c351", "address": "fa:16:3e:de:2b:93", "network": {"id": "4562dd45-7d3c-4cca-b97c-a3114383641b", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1852107155", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.28", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "6d2915087eb04830831062675024f835", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap953f6a62-54", "ovs_interfaceid": "953f6a62-54f7-40f2-8bde-2639ab34c351", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:18:39 user nova-compute[73572]: DEBUG nova.virt.libvirt.guest [None req-94bb322b-e1ba-4226-9463-d8aef378024b tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 10:18:39 user nova-compute[73572]:   <nova:package version="0.0.0"/>
Aug 26 10:18:39 user nova-compute[73572]:   <nova:name>tempest-device-tagging-server-1180989107</nova:name>
Aug 26 10:18:39 user nova-compute[73572]:   <nova:creationTime>2023-08-26 10:18:39</nova:creationTime>
Aug 26 10:18:39 user nova-compute[73572]:   <nova:flavor name="m1.tiny">
Aug 26 10:18:39 user nova-compute[73572]:     <nova:memory>512</nova:memory>
Aug 26 10:18:39 user nova-compute[73572]:     <nova:disk>1</nova:disk>
Aug 26 10:18:39 user nova-compute[73572]:     <nova:swap>0</nova:swap>
Aug 26 10:18:39 user nova-compute[73572]:     <nova:ephemeral>0</nova:ephemeral>
Aug 26 10:18:39 user nova-compute[73572]:     <nova:vcpus>1</nova:vcpus>
Aug 26 10:18:39 user nova-compute[73572]:   </nova:flavor>
Aug 26 10:18:39 user nova-compute[73572]:   <nova:owner>
Aug 26 10:18:39 user nova-compute[73572]:     <nova:user uuid="5ff395781b5f403fa56cada31e168817">tempest-TaggedAttachmentsTest-1639980618-project-member</nova:user>
Aug 26 10:18:39 user nova-compute[73572]:     <nova:project uuid="6d2915087eb04830831062675024f835">tempest-TaggedAttachmentsTest-1639980618</nova:project>
Aug 26 10:18:39 user nova-compute[73572]:   </nova:owner>
Aug 26 10:18:39 user nova-compute[73572]:   <nova:root type="image" uuid="299da0c9-e1c4-48f0-be55-fbe20dd06bc9"/>
Aug 26 10:18:39 user nova-compute[73572]:   <nova:ports>
Aug 26 10:18:39 user nova-compute[73572]:     <nova:port uuid="3c5d5d20-da80-4401-b027-3c4b0df169c6">
Aug 26 10:18:39 user nova-compute[73572]:       <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 26 10:18:39 user nova-compute[73572]:     </nova:port>
Aug 26 10:18:39 user nova-compute[73572]:     <nova:port uuid="953f6a62-54f7-40f2-8bde-2639ab34c351">
Aug 26 10:18:39 user nova-compute[73572]:       <nova:ip type="fixed" address="10.10.10.28" ipVersion="4"/>
Aug 26 10:18:39 user nova-compute[73572]:     </nova:port>
Aug 26 10:18:39 user nova-compute[73572]:   </nova:ports>
Aug 26 10:18:39 user nova-compute[73572]: </nova:instance>
Aug 26 10:18:39 user nova-compute[73572]:  {{(pid=73572) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Aug 26 10:18:39 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-fc8aeb4f-3bad-475c-9002-a35375a32ef2 req-3eb6b53f-b858-44ab-9d58-9df7597e5383 service nova] Releasing lock "refresh_cache-0dceaa35-4a13-453b-961f-831f66c35af0" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:18:39 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-94bb322b-e1ba-4226-9463-d8aef378024b tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] Lock "interface-0dceaa35-4a13-453b-961f-831f66c35af0-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 3.412s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:18:39 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:18:39 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:18:39 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:18:39 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:18:39 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:18:39 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:18:39 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-6b2accfb-5a46-4ac1-a996-d3ed9783b4da tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] Acquiring lock "0dceaa35-4a13-453b-961f-831f66c35af0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:18:39 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-6b2accfb-5a46-4ac1-a996-d3ed9783b4da tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] Lock "0dceaa35-4a13-453b-961f-831f66c35af0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:18:39 user nova-compute[73572]: DEBUG nova.objects.instance [None req-6b2accfb-5a46-4ac1-a996-d3ed9783b4da tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] Lazy-loading 'flavor' on Instance uuid 0dceaa35-4a13-453b-961f-831f66c35af0 {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:18:39 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-6b2accfb-5a46-4ac1-a996-d3ed9783b4da tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] Lock "0dceaa35-4a13-453b-961f-831f66c35af0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.068s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:18:39 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-6b2accfb-5a46-4ac1-a996-d3ed9783b4da tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] Acquiring lock "0dceaa35-4a13-453b-961f-831f66c35af0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:18:39 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-6b2accfb-5a46-4ac1-a996-d3ed9783b4da tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] Lock "0dceaa35-4a13-453b-961f-831f66c35af0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:18:39 user nova-compute[73572]: INFO nova.compute.manager [None req-6b2accfb-5a46-4ac1-a996-d3ed9783b4da tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] [instance: 0dceaa35-4a13-453b-961f-831f66c35af0] Attaching volume 054581d6-82cb-4ac5-9ff2-c1d3a3c0b2ae to /dev/vdb
Aug 26 10:18:39 user nova-compute[73572]: DEBUG os_brick.utils [None req-6b2accfb-5a46-4ac1-a996-d3ed9783b4da tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 10:18:39 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:18:39 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:18:39 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebf423ce-b451-4f82-8c08-ddc3a8357d2a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:de8a79ed912\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:18:39 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:18:39 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:18:39 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[45ab131b-3ba8-4279-ba0f-d3f398f84d84]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:18:39 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:18:39 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:18:39 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9c896d1-b530-4dff-910d-a7273aa5924b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:18:39 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5ec2be5-2ec7-4d29-afba-76054c87106b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:18:39 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-6b2accfb-5a46-4ac1-a996-d3ed9783b4da tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] Running cmd (subprocess): nvme version {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:18:39 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-6b2accfb-5a46-4ac1-a996-d3ed9783b4da tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] 'nvme version' failed. Not Retrying. {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 10:18:39 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6b2accfb-5a46-4ac1-a996-d3ed9783b4da tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] nvme not present on system {{(pid=73572) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 10:18:39 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:18:39 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 10:18:39 user nova-compute[73572]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 10:18:39 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[d36a985b-5f2b-418c-b347-65e55336494f]: (4, '') {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:18:39 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.lightos [None req-6b2accfb-5a46-4ac1-a996-d3ed9783b4da tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73572) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 10:18:39 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.lightos [None req-6b2accfb-5a46-4ac1-a996-d3ed9783b4da tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73572) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 10:18:39 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.lightos [None req-6b2accfb-5a46-4ac1-a996-d3ed9783b4da tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] LIGHTOS: no hostnqn found. {{(pid=73572) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 10:18:39 user nova-compute[73572]: DEBUG os_brick.utils [None req-6b2accfb-5a46-4ac1-a996-d3ed9783b4da tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:de8a79ed912', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 10:18:39 user nova-compute[73572]: DEBUG nova.virt.block_device [None req-6b2accfb-5a46-4ac1-a996-d3ed9783b4da tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] [instance: 0dceaa35-4a13-453b-961f-831f66c35af0] Updating existing volume attachment record: 5d975675-7d0a-4bff-bd31-d75ad550c14a {{(pid=73572) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 10:18:40 user nova-compute[73572]: DEBUG nova.compute.manager [None req-0126ecad-3436-4098-9d79-e8cf6e5b6fe9 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] [instance: d2970584-8c2a-4f99-922c-d66d59489504] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:18:40 user nova-compute[73572]: INFO nova.compute.manager [None req-0126ecad-3436-4098-9d79-e8cf6e5b6fe9 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] [instance: d2970584-8c2a-4f99-922c-d66d59489504] instance snapshotting
Aug 26 10:18:40 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-0126ecad-3436-4098-9d79-e8cf6e5b6fe9 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] [instance: d2970584-8c2a-4f99-922c-d66d59489504] Beginning live snapshot process
Aug 26 10:18:40 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-0126ecad-3436-4098-9d79-e8cf6e5b6fe9 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2970584-8c2a-4f99-922c-d66d59489504/disk --force-share --output=json -f qcow2 {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:18:41 user nova-compute[73572]: DEBUG nova.compute.manager [req-46d7a34f-feb6-4d7d-ac01-1e804a68c467 req-f4155ba2-2107-4bce-b4ad-a09fa0fda3e2 service nova] [instance: 0dceaa35-4a13-453b-961f-831f66c35af0] Received event network-vif-plugged-953f6a62-54f7-40f2-8bde-2639ab34c351 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:18:41 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-46d7a34f-feb6-4d7d-ac01-1e804a68c467 req-f4155ba2-2107-4bce-b4ad-a09fa0fda3e2 service nova] Acquiring lock "0dceaa35-4a13-453b-961f-831f66c35af0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:18:41 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-46d7a34f-feb6-4d7d-ac01-1e804a68c467 req-f4155ba2-2107-4bce-b4ad-a09fa0fda3e2 service nova] Lock "0dceaa35-4a13-453b-961f-831f66c35af0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:18:41 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-46d7a34f-feb6-4d7d-ac01-1e804a68c467 req-f4155ba2-2107-4bce-b4ad-a09fa0fda3e2 service nova] Lock "0dceaa35-4a13-453b-961f-831f66c35af0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:18:41 user nova-compute[73572]: DEBUG nova.compute.manager [req-46d7a34f-feb6-4d7d-ac01-1e804a68c467 req-f4155ba2-2107-4bce-b4ad-a09fa0fda3e2 service nova] [instance: 0dceaa35-4a13-453b-961f-831f66c35af0] No waiting events found dispatching network-vif-plugged-953f6a62-54f7-40f2-8bde-2639ab34c351 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:18:41 user nova-compute[73572]: WARNING nova.compute.manager [req-46d7a34f-feb6-4d7d-ac01-1e804a68c467 req-f4155ba2-2107-4bce-b4ad-a09fa0fda3e2 service nova] [instance: 0dceaa35-4a13-453b-961f-831f66c35af0] Received unexpected event network-vif-plugged-953f6a62-54f7-40f2-8bde-2639ab34c351 for instance with vm_state active and task_state None.
Aug 26 10:18:41 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-0126ecad-3436-4098-9d79-e8cf6e5b6fe9 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2970584-8c2a-4f99-922c-d66d59489504/disk --force-share --output=json -f qcow2" returned: 0 in 0.186s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:18:41 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-0126ecad-3436-4098-9d79-e8cf6e5b6fe9 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2970584-8c2a-4f99-922c-d66d59489504/disk --force-share --output=json -f qcow2 {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:18:41 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-0126ecad-3436-4098-9d79-e8cf6e5b6fe9 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2970584-8c2a-4f99-922c-d66d59489504/disk --force-share --output=json -f qcow2" returned: 0 in 0.171s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:18:41 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-0126ecad-3436-4098-9d79-e8cf6e5b6fe9 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:18:41 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-0126ecad-3436-4098-9d79-e8cf6e5b6fe9 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json" returned: 0 in 0.180s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:18:41 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-0126ecad-3436-4098-9d79-e8cf6e5b6fe9 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpcnpftu1d/48f64153088745c7a7247dc432b84320.delta 1073741824 {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:18:41 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-0126ecad-3436-4098-9d79-e8cf6e5b6fe9 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpcnpftu1d/48f64153088745c7a7247dc432b84320.delta 1073741824" returned: 0 in 0.056s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:18:41 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-0126ecad-3436-4098-9d79-e8cf6e5b6fe9 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] [instance: d2970584-8c2a-4f99-922c-d66d59489504] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 26 10:18:41 user nova-compute[73572]: DEBUG nova.compute.manager [req-5355a731-66b3-4bb1-b9ee-98c97af8aea6 req-e4abb1e0-df3d-4dd7-bbef-0c2847f9460e service nova] [instance: 682138af-ba6a-47f1-a9a5-03ae2661f54d] Received event network-changed-72fe24f4-00e3-40f1-a44a-014c7669e862 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:18:41 user nova-compute[73572]: DEBUG nova.compute.manager [req-5355a731-66b3-4bb1-b9ee-98c97af8aea6 req-e4abb1e0-df3d-4dd7-bbef-0c2847f9460e service nova] [instance: 682138af-ba6a-47f1-a9a5-03ae2661f54d] Refreshing instance network info cache due to event network-changed-72fe24f4-00e3-40f1-a44a-014c7669e862. {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 10:18:41 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-5355a731-66b3-4bb1-b9ee-98c97af8aea6 req-e4abb1e0-df3d-4dd7-bbef-0c2847f9460e service nova] Acquiring lock "refresh_cache-682138af-ba6a-47f1-a9a5-03ae2661f54d" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:18:41 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-5355a731-66b3-4bb1-b9ee-98c97af8aea6 req-e4abb1e0-df3d-4dd7-bbef-0c2847f9460e service nova] Acquired lock "refresh_cache-682138af-ba6a-47f1-a9a5-03ae2661f54d" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:18:41 user nova-compute[73572]: DEBUG nova.network.neutron [req-5355a731-66b3-4bb1-b9ee-98c97af8aea6 req-e4abb1e0-df3d-4dd7-bbef-0c2847f9460e service nova] [instance: 682138af-ba6a-47f1-a9a5-03ae2661f54d] Refreshing network info cache for port 72fe24f4-00e3-40f1-a44a-014c7669e862 {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 10:18:42 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-bc362937-48f6-4dcf-b4bd-2f2c10272de3 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] Acquiring lock "c555f971-b177-4c26-a38e-09e0e78bf7b9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:18:42 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-bc362937-48f6-4dcf-b4bd-2f2c10272de3 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] Lock "c555f971-b177-4c26-a38e-09e0e78bf7b9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:18:42 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-bc362937-48f6-4dcf-b4bd-2f2c10272de3 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] Acquiring lock "c555f971-b177-4c26-a38e-09e0e78bf7b9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:18:42 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-bc362937-48f6-4dcf-b4bd-2f2c10272de3 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] Lock "c555f971-b177-4c26-a38e-09e0e78bf7b9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:18:42 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-bc362937-48f6-4dcf-b4bd-2f2c10272de3 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] Lock "c555f971-b177-4c26-a38e-09e0e78bf7b9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:18:42 user nova-compute[73572]: INFO nova.compute.manager [None req-bc362937-48f6-4dcf-b4bd-2f2c10272de3 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] [instance: c555f971-b177-4c26-a38e-09e0e78bf7b9] Terminating instance
Aug 26 10:18:42 user nova-compute[73572]: DEBUG nova.compute.manager [None req-bc362937-48f6-4dcf-b4bd-2f2c10272de3 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] [instance: c555f971-b177-4c26-a38e-09e0e78bf7b9] Start destroying the instance on the hypervisor. {{(pid=73572) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 10:18:42 user nova-compute[73572]: DEBUG nova.network.neutron [req-5355a731-66b3-4bb1-b9ee-98c97af8aea6 req-e4abb1e0-df3d-4dd7-bbef-0c2847f9460e service nova] [instance: 682138af-ba6a-47f1-a9a5-03ae2661f54d] Updated VIF entry in instance network info cache for port 72fe24f4-00e3-40f1-a44a-014c7669e862. {{(pid=73572) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 10:18:42 user nova-compute[73572]: DEBUG nova.network.neutron [req-5355a731-66b3-4bb1-b9ee-98c97af8aea6 req-e4abb1e0-df3d-4dd7-bbef-0c2847f9460e service nova] [instance: 682138af-ba6a-47f1-a9a5-03ae2661f54d] Updating instance_info_cache with network_info: [{"id": "72fe24f4-00e3-40f1-a44a-014c7669e862", "address": "fa:16:3e:d2:52:c7", "network": {"id": "2a6e27c9-9bd2-4ccb-abf6-82d85524da90", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1822065121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb6ef2597eac461f959a568abd3031ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72fe24f4-00", "ovs_interfaceid": "72fe24f4-00e3-40f1-a44a-014c7669e862", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:18:42 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-5355a731-66b3-4bb1-b9ee-98c97af8aea6 req-e4abb1e0-df3d-4dd7-bbef-0c2847f9460e service nova] Releasing lock "refresh_cache-682138af-ba6a-47f1-a9a5-03ae2661f54d" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:18:42 user nova-compute[73572]: DEBUG nova.virt.libvirt.guest [None req-0126ecad-3436-4098-9d79-e8cf6e5b6fe9 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] COPY block job progress, current cursor: 65536 final cursor: 75563008 {{(pid=73572) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 10:18:42 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:18:42 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:18:42 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:18:42 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:18:43 user nova-compute[73572]: DEBUG nova.compute.manager [req-9743f8c0-f27b-4663-9bfd-8b7b6760894b req-fbecbbd1-0468-4998-b83e-05b79ee5f18b service nova] [instance: c555f971-b177-4c26-a38e-09e0e78bf7b9] Received event network-vif-unplugged-4ffb7229-16fb-441b-a954-d91308071fb8 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:18:43 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-9743f8c0-f27b-4663-9bfd-8b7b6760894b req-fbecbbd1-0468-4998-b83e-05b79ee5f18b service nova] Acquiring lock "c555f971-b177-4c26-a38e-09e0e78bf7b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:18:43 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-9743f8c0-f27b-4663-9bfd-8b7b6760894b req-fbecbbd1-0468-4998-b83e-05b79ee5f18b service nova] Lock "c555f971-b177-4c26-a38e-09e0e78bf7b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:18:43 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-9743f8c0-f27b-4663-9bfd-8b7b6760894b req-fbecbbd1-0468-4998-b83e-05b79ee5f18b service nova] Lock "c555f971-b177-4c26-a38e-09e0e78bf7b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:18:43 user nova-compute[73572]: DEBUG nova.compute.manager [req-9743f8c0-f27b-4663-9bfd-8b7b6760894b req-fbecbbd1-0468-4998-b83e-05b79ee5f18b service nova] [instance: c555f971-b177-4c26-a38e-09e0e78bf7b9] No waiting events found dispatching network-vif-unplugged-4ffb7229-16fb-441b-a954-d91308071fb8 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:18:43 user nova-compute[73572]: DEBUG nova.compute.manager [req-9743f8c0-f27b-4663-9bfd-8b7b6760894b req-fbecbbd1-0468-4998-b83e-05b79ee5f18b service nova] [instance: c555f971-b177-4c26-a38e-09e0e78bf7b9] Received event network-vif-unplugged-4ffb7229-16fb-441b-a954-d91308071fb8 for instance with task_state deleting. {{(pid=73572) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 10:18:43 user nova-compute[73572]: DEBUG nova.virt.libvirt.guest [None req-0126ecad-3436-4098-9d79-e8cf6e5b6fe9 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=73572) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 10:18:43 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-0126ecad-3436-4098-9d79-e8cf6e5b6fe9 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] [instance: d2970584-8c2a-4f99-922c-d66d59489504] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 26 10:18:43 user nova-compute[73572]: INFO nova.virt.libvirt.driver [-] [instance: c555f971-b177-4c26-a38e-09e0e78bf7b9] Instance destroyed successfully.
Aug 26 10:18:43 user nova-compute[73572]: DEBUG nova.objects.instance [None req-bc362937-48f6-4dcf-b4bd-2f2c10272de3 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] Lazy-loading 'resources' on Instance uuid c555f971-b177-4c26-a38e-09e0e78bf7b9 {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:18:43 user nova-compute[73572]: DEBUG nova.privsep.utils [None req-0126ecad-3436-4098-9d79-e8cf6e5b6fe9 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73572) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 26 10:18:43 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-0126ecad-3436-4098-9d79-e8cf6e5b6fe9 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpcnpftu1d/48f64153088745c7a7247dc432b84320.delta /opt/stack/data/nova/instances/snapshots/tmpcnpftu1d/48f64153088745c7a7247dc432b84320 {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:18:43 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-bc362937-48f6-4dcf-b4bd-2f2c10272de3 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T10:11:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1454082664',display_name='tempest-ServerStableDeviceRescueTest-server-1454082664',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1454082664',id=4,image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK8A2oE4l13QSyERYwh4Ahnk9uJU+nAPDuhZ37O71VJwdAai0fKJUmgw/2IvPbix5amEMjoghtaXSFXa7D9qX8lOxviBOZZHzhpX2yXB6onP6197FUVAXT21Pc+RZuhqOw==',key_name='tempest-keypair-1487694876',keypairs=<?>,launch_index=0,launched_at=2023-08-26T10:15:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c4556d14c0dd416fbe13ab2274947dec',ramdisk_id='',reservation_id='r-cj50rz21',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1992646584',owner_user_name='tempest-ServerStableDeviceRescueTest-1992646584-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T10:17:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a56cbd5c1fe94cf9b2a0adc3e82f600b',uuid=c555f971-b177-4c26-a38e-09e0e78bf7b9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4ffb7229-16fb-441b-a954-d91308071fb8", "address": "fa:16:3e:26:32:ef", "network": {"id": "e052e34f-ce84-4612-b48b-2ed8474e7177", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-332746918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4556d14c0dd416fbe13ab2274947dec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ffb7229-16", "ovs_interfaceid": "4ffb7229-16fb-441b-a954-d91308071fb8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 10:18:43 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-bc362937-48f6-4dcf-b4bd-2f2c10272de3 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] Converting VIF {"id": "4ffb7229-16fb-441b-a954-d91308071fb8", "address": "fa:16:3e:26:32:ef", "network": {"id": "e052e34f-ce84-4612-b48b-2ed8474e7177", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-332746918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4556d14c0dd416fbe13ab2274947dec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ffb7229-16", "ovs_interfaceid": "4ffb7229-16fb-441b-a954-d91308071fb8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:18:43 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-bc362937-48f6-4dcf-b4bd-2f2c10272de3 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:26:32:ef,bridge_name='br-int',has_traffic_filtering=True,id=4ffb7229-16fb-441b-a954-d91308071fb8,network=Network(e052e34f-ce84-4612-b48b-2ed8474e7177),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ffb7229-16') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:18:43 user nova-compute[73572]: DEBUG os_vif [None req-bc362937-48f6-4dcf-b4bd-2f2c10272de3 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:26:32:ef,bridge_name='br-int',has_traffic_filtering=True,id=4ffb7229-16fb-441b-a954-d91308071fb8,network=Network(e052e34f-ce84-4612-b48b-2ed8474e7177),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ffb7229-16') {{(pid=73572) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 10:18:43 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:18:43 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:18:43 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4ffb7229-16, bridge=br-int, if_exists=True) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:18:43 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:18:43 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:18:43 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:18:43 user nova-compute[73572]: INFO os_vif [None req-bc362937-48f6-4dcf-b4bd-2f2c10272de3 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:26:32:ef,bridge_name='br-int',has_traffic_filtering=True,id=4ffb7229-16fb-441b-a954-d91308071fb8,network=Network(e052e34f-ce84-4612-b48b-2ed8474e7177),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ffb7229-16')
Aug 26 10:18:43 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-bc362937-48f6-4dcf-b4bd-2f2c10272de3 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] [instance: c555f971-b177-4c26-a38e-09e0e78bf7b9] Deleting instance files /opt/stack/data/nova/instances/c555f971-b177-4c26-a38e-09e0e78bf7b9_del
Aug 26 10:18:43 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-bc362937-48f6-4dcf-b4bd-2f2c10272de3 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] [instance: c555f971-b177-4c26-a38e-09e0e78bf7b9] Deletion of /opt/stack/data/nova/instances/c555f971-b177-4c26-a38e-09e0e78bf7b9_del complete
Aug 26 10:18:43 user nova-compute[73572]: INFO nova.compute.manager [None req-bc362937-48f6-4dcf-b4bd-2f2c10272de3 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] [instance: c555f971-b177-4c26-a38e-09e0e78bf7b9] Took 1.49 seconds to destroy the instance on the hypervisor.
Aug 26 10:18:43 user nova-compute[73572]: DEBUG oslo.service.loopingcall [None req-bc362937-48f6-4dcf-b4bd-2f2c10272de3 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73572) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 10:18:43 user nova-compute[73572]: DEBUG nova.compute.manager [-] [instance: c555f971-b177-4c26-a38e-09e0e78bf7b9] Deallocating network for instance {{(pid=73572) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 10:18:43 user nova-compute[73572]: DEBUG nova.network.neutron [-] [instance: c555f971-b177-4c26-a38e-09e0e78bf7b9] deallocate_for_instance() {{(pid=73572) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 10:18:44 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-0126ecad-3436-4098-9d79-e8cf6e5b6fe9 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpcnpftu1d/48f64153088745c7a7247dc432b84320.delta /opt/stack/data/nova/instances/snapshots/tmpcnpftu1d/48f64153088745c7a7247dc432b84320" returned: 0 in 0.875s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:18:44 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-0126ecad-3436-4098-9d79-e8cf6e5b6fe9 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] [instance: d2970584-8c2a-4f99-922c-d66d59489504] Snapshot extracted, beginning image upload
Aug 26 10:18:44 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:18:44 user nova-compute[73572]: DEBUG nova.network.neutron [-] [instance: c555f971-b177-4c26-a38e-09e0e78bf7b9] Updating instance_info_cache with network_info: [] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:18:44 user nova-compute[73572]: INFO nova.compute.manager [-] [instance: c555f971-b177-4c26-a38e-09e0e78bf7b9] Took 1.29 seconds to deallocate network for instance.
Aug 26 10:18:44 user nova-compute[73572]: DEBUG nova.compute.manager [req-ce8ea9b6-9d52-40c9-bf77-652db34e320f req-4de64b92-2c2d-4597-8c10-e72a79a24c81 service nova] [instance: 682138af-ba6a-47f1-a9a5-03ae2661f54d] Received event network-changed-72fe24f4-00e3-40f1-a44a-014c7669e862 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:18:44 user nova-compute[73572]: DEBUG nova.compute.manager [req-ce8ea9b6-9d52-40c9-bf77-652db34e320f req-4de64b92-2c2d-4597-8c10-e72a79a24c81 service nova] [instance: 682138af-ba6a-47f1-a9a5-03ae2661f54d] Refreshing instance network info cache due to event network-changed-72fe24f4-00e3-40f1-a44a-014c7669e862. {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 10:18:44 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-ce8ea9b6-9d52-40c9-bf77-652db34e320f req-4de64b92-2c2d-4597-8c10-e72a79a24c81 service nova] Acquiring lock "refresh_cache-682138af-ba6a-47f1-a9a5-03ae2661f54d" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:18:44 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-ce8ea9b6-9d52-40c9-bf77-652db34e320f req-4de64b92-2c2d-4597-8c10-e72a79a24c81 service nova] Acquired lock "refresh_cache-682138af-ba6a-47f1-a9a5-03ae2661f54d" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:18:44 user nova-compute[73572]: DEBUG nova.network.neutron [req-ce8ea9b6-9d52-40c9-bf77-652db34e320f req-4de64b92-2c2d-4597-8c10-e72a79a24c81 service nova] [instance: 682138af-ba6a-47f1-a9a5-03ae2661f54d] Refreshing network info cache for port 72fe24f4-00e3-40f1-a44a-014c7669e862 {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 10:18:44 user nova-compute[73572]: DEBUG nova.compute.manager [req-1e3a83e4-e509-4e59-bccf-d8f27537d37c req-92a1f57c-6068-4acd-8d3b-1d3a5a5b22f4 service nova] [instance: c555f971-b177-4c26-a38e-09e0e78bf7b9] Received event network-vif-deleted-4ffb7229-16fb-441b-a954-d91308071fb8 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:18:45 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-bc362937-48f6-4dcf-b4bd-2f2c10272de3 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:18:45 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-bc362937-48f6-4dcf-b4bd-2f2c10272de3 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:18:45 user nova-compute[73572]: DEBUG nova.compute.manager [req-90a29664-147c-46f4-b83d-9c8fea870a9e req-a877f9fd-f67d-4f50-b81c-219d0b0c766c service nova] [instance: c555f971-b177-4c26-a38e-09e0e78bf7b9] Received event network-vif-plugged-4ffb7229-16fb-441b-a954-d91308071fb8 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:18:45 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-90a29664-147c-46f4-b83d-9c8fea870a9e req-a877f9fd-f67d-4f50-b81c-219d0b0c766c service nova] Acquiring lock "c555f971-b177-4c26-a38e-09e0e78bf7b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:18:45 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-90a29664-147c-46f4-b83d-9c8fea870a9e req-a877f9fd-f67d-4f50-b81c-219d0b0c766c service nova] Lock "c555f971-b177-4c26-a38e-09e0e78bf7b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:18:45 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-90a29664-147c-46f4-b83d-9c8fea870a9e req-a877f9fd-f67d-4f50-b81c-219d0b0c766c service nova] Lock "c555f971-b177-4c26-a38e-09e0e78bf7b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:18:45 user nova-compute[73572]: DEBUG nova.compute.manager [req-90a29664-147c-46f4-b83d-9c8fea870a9e req-a877f9fd-f67d-4f50-b81c-219d0b0c766c service nova] [instance: c555f971-b177-4c26-a38e-09e0e78bf7b9] No waiting events found dispatching network-vif-plugged-4ffb7229-16fb-441b-a954-d91308071fb8 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:18:45 user nova-compute[73572]: WARNING nova.compute.manager [req-90a29664-147c-46f4-b83d-9c8fea870a9e req-a877f9fd-f67d-4f50-b81c-219d0b0c766c service nova] [instance: c555f971-b177-4c26-a38e-09e0e78bf7b9] Received unexpected event network-vif-plugged-4ffb7229-16fb-441b-a954-d91308071fb8 for instance with vm_state deleted and task_state None.
Aug 26 10:18:45 user nova-compute[73572]: DEBUG nova.compute.provider_tree [None req-bc362937-48f6-4dcf-b4bd-2f2c10272de3 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] Inventory has not changed in ProviderTree for provider: e2cec974-59b2-4c77-a53d-a7f4e5a30d75 {{(pid=73572) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 10:18:45 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-bc362937-48f6-4dcf-b4bd-2f2c10272de3 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] Inventory has not changed for provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73572) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 10:18:45 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-bc362937-48f6-4dcf-b4bd-2f2c10272de3 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.446s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:18:45 user nova-compute[73572]: INFO nova.scheduler.client.report [None req-bc362937-48f6-4dcf-b4bd-2f2c10272de3 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] Deleted allocations for instance c555f971-b177-4c26-a38e-09e0e78bf7b9
Aug 26 10:18:45 user nova-compute[73572]: DEBUG nova.network.neutron [req-ce8ea9b6-9d52-40c9-bf77-652db34e320f req-4de64b92-2c2d-4597-8c10-e72a79a24c81 service nova] [instance: 682138af-ba6a-47f1-a9a5-03ae2661f54d] Updated VIF entry in instance network info cache for port 72fe24f4-00e3-40f1-a44a-014c7669e862. {{(pid=73572) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 10:18:45 user nova-compute[73572]: DEBUG nova.network.neutron [req-ce8ea9b6-9d52-40c9-bf77-652db34e320f req-4de64b92-2c2d-4597-8c10-e72a79a24c81 service nova] [instance: 682138af-ba6a-47f1-a9a5-03ae2661f54d] Updating instance_info_cache with network_info: [{"id": "72fe24f4-00e3-40f1-a44a-014c7669e862", "address": "fa:16:3e:d2:52:c7", "network": {"id": "2a6e27c9-9bd2-4ccb-abf6-82d85524da90", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1822065121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb6ef2597eac461f959a568abd3031ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72fe24f4-00", "ovs_interfaceid": "72fe24f4-00e3-40f1-a44a-014c7669e862", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:18:45 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-ce8ea9b6-9d52-40c9-bf77-652db34e320f req-4de64b92-2c2d-4597-8c10-e72a79a24c81 service nova] Releasing lock "refresh_cache-682138af-ba6a-47f1-a9a5-03ae2661f54d" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:18:45 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-bc362937-48f6-4dcf-b4bd-2f2c10272de3 tempest-ServerStableDeviceRescueTest-1992646584 tempest-ServerStableDeviceRescueTest-1992646584-project-member] Lock "c555f971-b177-4c26-a38e-09e0e78bf7b9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.566s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:18:46 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-0126ecad-3436-4098-9d79-e8cf6e5b6fe9 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] [instance: d2970584-8c2a-4f99-922c-d66d59489504] Snapshot image upload complete
Aug 26 10:18:46 user nova-compute[73572]: INFO nova.compute.manager [None req-0126ecad-3436-4098-9d79-e8cf6e5b6fe9 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] [instance: d2970584-8c2a-4f99-922c-d66d59489504] Took 6.16 seconds to snapshot the instance on the hypervisor.
Aug 26 10:18:48 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:18:48 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:18:49 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:18:49 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-83111095-563d-47ed-97f7-690e26ce43c9 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Acquiring lock "c901bbcc-3d82-4550-888f-bdbb36ba052d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:18:49 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-83111095-563d-47ed-97f7-690e26ce43c9 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Lock "c901bbcc-3d82-4550-888f-bdbb36ba052d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:18:49 user nova-compute[73572]: DEBUG nova.compute.manager [None req-83111095-563d-47ed-97f7-690e26ce43c9 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] [instance: c901bbcc-3d82-4550-888f-bdbb36ba052d] Starting instance... {{(pid=73572) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 10:18:49 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-83111095-563d-47ed-97f7-690e26ce43c9 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:18:49 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-83111095-563d-47ed-97f7-690e26ce43c9 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:18:49 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-83111095-563d-47ed-97f7-690e26ce43c9 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73572) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 10:18:49 user nova-compute[73572]: INFO nova.compute.claims [None req-83111095-563d-47ed-97f7-690e26ce43c9 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] [instance: c901bbcc-3d82-4550-888f-bdbb36ba052d] Claim successful on node user
Aug 26 10:18:50 user nova-compute[73572]: DEBUG nova.compute.provider_tree [None req-83111095-563d-47ed-97f7-690e26ce43c9 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Inventory has not changed in ProviderTree for provider: e2cec974-59b2-4c77-a53d-a7f4e5a30d75 {{(pid=73572) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 10:18:50 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-83111095-563d-47ed-97f7-690e26ce43c9 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Inventory has not changed for provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73572) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 10:18:50 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-83111095-563d-47ed-97f7-690e26ce43c9 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.498s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:18:50 user nova-compute[73572]: DEBUG nova.compute.manager [None req-83111095-563d-47ed-97f7-690e26ce43c9 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] [instance: c901bbcc-3d82-4550-888f-bdbb36ba052d] Start building networks asynchronously for instance. {{(pid=73572) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 10:18:50 user nova-compute[73572]: DEBUG nova.compute.manager [None req-83111095-563d-47ed-97f7-690e26ce43c9 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] [instance: c901bbcc-3d82-4550-888f-bdbb36ba052d] Allocating IP information in the background. {{(pid=73572) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 10:18:50 user nova-compute[73572]: DEBUG nova.network.neutron [None req-83111095-563d-47ed-97f7-690e26ce43c9 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] [instance: c901bbcc-3d82-4550-888f-bdbb36ba052d] allocate_for_instance() {{(pid=73572) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 10:18:50 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-83111095-563d-47ed-97f7-690e26ce43c9 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] [instance: c901bbcc-3d82-4550-888f-bdbb36ba052d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 10:18:50 user nova-compute[73572]: DEBUG nova.compute.manager [None req-83111095-563d-47ed-97f7-690e26ce43c9 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] [instance: c901bbcc-3d82-4550-888f-bdbb36ba052d] Start building block device mappings for instance. {{(pid=73572) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 10:18:50 user nova-compute[73572]: DEBUG nova.policy [None req-83111095-563d-47ed-97f7-690e26ce43c9 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b990faa34b924d29bf7c0490aaf07644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2be8d4c6c147e98a1b5b7443b3828d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73572) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 10:18:50 user nova-compute[73572]: DEBUG nova.compute.manager [None req-83111095-563d-47ed-97f7-690e26ce43c9 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] [instance: c901bbcc-3d82-4550-888f-bdbb36ba052d] Start spawning the instance on the hypervisor. {{(pid=73572) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 10:18:50 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-83111095-563d-47ed-97f7-690e26ce43c9 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] [instance: c901bbcc-3d82-4550-888f-bdbb36ba052d] Creating instance directory {{(pid=73572) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 10:18:50 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-83111095-563d-47ed-97f7-690e26ce43c9 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] [instance: c901bbcc-3d82-4550-888f-bdbb36ba052d] Creating image(s)
Aug 26 10:18:50 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-83111095-563d-47ed-97f7-690e26ce43c9 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Acquiring lock "/opt/stack/data/nova/instances/c901bbcc-3d82-4550-888f-bdbb36ba052d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:18:50 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-83111095-563d-47ed-97f7-690e26ce43c9 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Lock "/opt/stack/data/nova/instances/c901bbcc-3d82-4550-888f-bdbb36ba052d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:18:50 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-83111095-563d-47ed-97f7-690e26ce43c9 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Lock "/opt/stack/data/nova/instances/c901bbcc-3d82-4550-888f-bdbb36ba052d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:18:50 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-83111095-563d-47ed-97f7-690e26ce43c9 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Acquiring lock "6a30f2d519f1cc16d403081c495de5f8aba77255" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:18:50 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-83111095-563d-47ed-97f7-690e26ce43c9 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Lock "6a30f2d519f1cc16d403081c495de5f8aba77255" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:18:51 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-83111095-563d-47ed-97f7-690e26ce43c9 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a30f2d519f1cc16d403081c495de5f8aba77255.part --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:18:51 user nova-compute[73572]: DEBUG nova.network.neutron [None req-83111095-563d-47ed-97f7-690e26ce43c9 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] [instance: c901bbcc-3d82-4550-888f-bdbb36ba052d] Successfully created port: 7c475446-2ad9-4502-b116-274f100e4d6c {{(pid=73572) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 10:18:52 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-83111095-563d-47ed-97f7-690e26ce43c9 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a30f2d519f1cc16d403081c495de5f8aba77255.part --force-share --output=json" returned: 0 in 0.250s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:18:52 user nova-compute[73572]: DEBUG nova.virt.images [None req-83111095-563d-47ed-97f7-690e26ce43c9 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] 5de36e71-6ad1-4ec6-9f56-b5630d53cad7 was qcow2, converting to raw {{(pid=73572) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 26 10:18:52 user nova-compute[73572]: DEBUG nova.privsep.utils [None req-83111095-563d-47ed-97f7-690e26ce43c9 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73572) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 26 10:18:52 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-83111095-563d-47ed-97f7-690e26ce43c9 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/6a30f2d519f1cc16d403081c495de5f8aba77255.part /opt/stack/data/nova/instances/_base/6a30f2d519f1cc16d403081c495de5f8aba77255.converted {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:18:53 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-83111095-563d-47ed-97f7-690e26ce43c9 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/6a30f2d519f1cc16d403081c495de5f8aba77255.part /opt/stack/data/nova/instances/_base/6a30f2d519f1cc16d403081c495de5f8aba77255.converted" returned: 0 in 1.032s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:18:53 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-83111095-563d-47ed-97f7-690e26ce43c9 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a30f2d519f1cc16d403081c495de5f8aba77255.converted --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:18:53 user nova-compute[73572]: DEBUG nova.network.neutron [None req-83111095-563d-47ed-97f7-690e26ce43c9 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] [instance: c901bbcc-3d82-4550-888f-bdbb36ba052d] Successfully updated port: 7c475446-2ad9-4502-b116-274f100e4d6c {{(pid=73572) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 10:18:53 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-83111095-563d-47ed-97f7-690e26ce43c9 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Acquiring lock "refresh_cache-c901bbcc-3d82-4550-888f-bdbb36ba052d" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:18:53 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-83111095-563d-47ed-97f7-690e26ce43c9 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Acquired lock "refresh_cache-c901bbcc-3d82-4550-888f-bdbb36ba052d" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:18:53 user nova-compute[73572]: DEBUG nova.network.neutron [None req-83111095-563d-47ed-97f7-690e26ce43c9 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] [instance: c901bbcc-3d82-4550-888f-bdbb36ba052d] Building network info cache for instance {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 10:18:53 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-83111095-563d-47ed-97f7-690e26ce43c9 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a30f2d519f1cc16d403081c495de5f8aba77255.converted --force-share --output=json" returned: 0 in 0.191s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:18:53 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-83111095-563d-47ed-97f7-690e26ce43c9 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Lock "6a30f2d519f1cc16d403081c495de5f8aba77255" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.685s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:18:53 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-83111095-563d-47ed-97f7-690e26ce43c9 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a30f2d519f1cc16d403081c495de5f8aba77255 --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:18:53 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-d503d012-2881-4c7c-b32f-8722d864d182 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Acquiring lock "682138af-ba6a-47f1-a9a5-03ae2661f54d" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:18:53 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-d503d012-2881-4c7c-b32f-8722d864d182 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Lock "682138af-ba6a-47f1-a9a5-03ae2661f54d" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.002s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:18:53 user nova-compute[73572]: INFO nova.compute.manager [None req-d503d012-2881-4c7c-b32f-8722d864d182 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] [instance: 682138af-ba6a-47f1-a9a5-03ae2661f54d] Rebooting instance
Aug 26 10:18:53 user nova-compute[73572]: DEBUG nova.compute.manager [req-42be9bcc-efbf-4724-b0e5-a5f5b4712ec0 req-4abe4b47-55f5-4e38-8e9f-174f78c4d9c1 service nova] [instance: c901bbcc-3d82-4550-888f-bdbb36ba052d] Received event network-changed-7c475446-2ad9-4502-b116-274f100e4d6c {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:18:53 user nova-compute[73572]: DEBUG nova.compute.manager [req-42be9bcc-efbf-4724-b0e5-a5f5b4712ec0 req-4abe4b47-55f5-4e38-8e9f-174f78c4d9c1 service nova] [instance: c901bbcc-3d82-4550-888f-bdbb36ba052d] Refreshing instance network info cache due to event network-changed-7c475446-2ad9-4502-b116-274f100e4d6c. {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 10:18:53 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-42be9bcc-efbf-4724-b0e5-a5f5b4712ec0 req-4abe4b47-55f5-4e38-8e9f-174f78c4d9c1 service nova] Acquiring lock "refresh_cache-c901bbcc-3d82-4550-888f-bdbb36ba052d" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:18:53 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-d503d012-2881-4c7c-b32f-8722d864d182 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Acquiring lock "refresh_cache-682138af-ba6a-47f1-a9a5-03ae2661f54d" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:18:53 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-d503d012-2881-4c7c-b32f-8722d864d182 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Acquired lock "refresh_cache-682138af-ba6a-47f1-a9a5-03ae2661f54d" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:18:53 user nova-compute[73572]: DEBUG nova.network.neutron [None req-d503d012-2881-4c7c-b32f-8722d864d182 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] [instance: 682138af-ba6a-47f1-a9a5-03ae2661f54d] Building network info cache for instance {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 10:18:53 user nova-compute[73572]: DEBUG nova.network.neutron [None req-83111095-563d-47ed-97f7-690e26ce43c9 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] [instance: c901bbcc-3d82-4550-888f-bdbb36ba052d] Instance cache missing network info. {{(pid=73572) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 10:18:53 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:18:53 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-83111095-563d-47ed-97f7-690e26ce43c9 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a30f2d519f1cc16d403081c495de5f8aba77255 --force-share --output=json" returned: 0 in 0.209s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:18:53 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-83111095-563d-47ed-97f7-690e26ce43c9 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Acquiring lock "6a30f2d519f1cc16d403081c495de5f8aba77255" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:18:53 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-83111095-563d-47ed-97f7-690e26ce43c9 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Lock "6a30f2d519f1cc16d403081c495de5f8aba77255" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:18:53 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-83111095-563d-47ed-97f7-690e26ce43c9 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a30f2d519f1cc16d403081c495de5f8aba77255 --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:18:53 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-83111095-563d-47ed-97f7-690e26ce43c9 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a30f2d519f1cc16d403081c495de5f8aba77255 --force-share --output=json" returned: 0 in 0.195s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:18:53 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-83111095-563d-47ed-97f7-690e26ce43c9 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6a30f2d519f1cc16d403081c495de5f8aba77255,backing_fmt=raw /opt/stack/data/nova/instances/c901bbcc-3d82-4550-888f-bdbb36ba052d/disk 1073741824 {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:18:53 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-83111095-563d-47ed-97f7-690e26ce43c9 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6a30f2d519f1cc16d403081c495de5f8aba77255,backing_fmt=raw /opt/stack/data/nova/instances/c901bbcc-3d82-4550-888f-bdbb36ba052d/disk 1073741824" returned: 0 in 0.047s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:18:53 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-83111095-563d-47ed-97f7-690e26ce43c9 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Lock "6a30f2d519f1cc16d403081c495de5f8aba77255" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.251s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:18:53 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-83111095-563d-47ed-97f7-690e26ce43c9 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a30f2d519f1cc16d403081c495de5f8aba77255 --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:18:53 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:18:53 user nova-compute[73572]: DEBUG nova.network.neutron [None req-83111095-563d-47ed-97f7-690e26ce43c9 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] [instance: c901bbcc-3d82-4550-888f-bdbb36ba052d] Updating instance_info_cache with network_info: [{"id": "7c475446-2ad9-4502-b116-274f100e4d6c", "address": "fa:16:3e:b7:b1:84", "network": {"id": "e565abb6-25f8-4f92-9cca-69db36e4216a", "bridge": "br-int", "label": "tempest-TestStampPattern-1866566708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f2be8d4c6c147e98a1b5b7443b3828d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c475446-2a", "ovs_interfaceid": "7c475446-2ad9-4502-b116-274f100e4d6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:18:53 user nova-compute[73572]: INFO nova.compute.manager [None req-16dbe192-bfcb-4a13-b430-aa57bc46c6c2 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: 14fab12e-52be-4fe6-8777-bc7ebf3c25f1] Unrescuing
Aug 26 10:18:53 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-16dbe192-bfcb-4a13-b430-aa57bc46c6c2 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Acquiring lock "refresh_cache-14fab12e-52be-4fe6-8777-bc7ebf3c25f1" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:18:53 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-16dbe192-bfcb-4a13-b430-aa57bc46c6c2 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Acquired lock "refresh_cache-14fab12e-52be-4fe6-8777-bc7ebf3c25f1" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:18:53 user nova-compute[73572]: DEBUG nova.network.neutron [None req-16dbe192-bfcb-4a13-b430-aa57bc46c6c2 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: 14fab12e-52be-4fe6-8777-bc7ebf3c25f1] Building network info cache for instance {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 10:18:53 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-83111095-563d-47ed-97f7-690e26ce43c9 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Releasing lock "refresh_cache-c901bbcc-3d82-4550-888f-bdbb36ba052d" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:18:53 user nova-compute[73572]: DEBUG nova.compute.manager [None req-83111095-563d-47ed-97f7-690e26ce43c9 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] [instance: c901bbcc-3d82-4550-888f-bdbb36ba052d] Instance network_info: |[{"id": "7c475446-2ad9-4502-b116-274f100e4d6c", "address": "fa:16:3e:b7:b1:84", "network": {"id": "e565abb6-25f8-4f92-9cca-69db36e4216a", "bridge": "br-int", "label": "tempest-TestStampPattern-1866566708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f2be8d4c6c147e98a1b5b7443b3828d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c475446-2a", "ovs_interfaceid": "7c475446-2ad9-4502-b116-274f100e4d6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73572) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 10:18:53 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-42be9bcc-efbf-4724-b0e5-a5f5b4712ec0 req-4abe4b47-55f5-4e38-8e9f-174f78c4d9c1 service nova] Acquired lock "refresh_cache-c901bbcc-3d82-4550-888f-bdbb36ba052d" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:18:53 user nova-compute[73572]: DEBUG nova.network.neutron [req-42be9bcc-efbf-4724-b0e5-a5f5b4712ec0 req-4abe4b47-55f5-4e38-8e9f-174f78c4d9c1 service nova] [instance: c901bbcc-3d82-4550-888f-bdbb36ba052d] Refreshing network info cache for port 7c475446-2ad9-4502-b116-274f100e4d6c {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 10:18:53 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b2accfb-5a46-4ac1-a996-d3ed9783b4da tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] [instance: 0dceaa35-4a13-453b-961f-831f66c35af0] Calling os-brick to attach iSCSI Volume {{(pid=73572) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 10:18:53 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b2accfb-5a46-4ac1-a996-d3ed9783b4da tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc89c3d6a10>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:054581d6-82cb-4ac5-9ff2-c1d3a3c0b2ae'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yPIsRikw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 10:18:53 user nova-compute[73572]: WARNING os_brick.initiator.connectors.base [None req-6b2accfb-5a46-4ac1-a996-d3ed9783b4da tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 10:18:53 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-6b2accfb-5a46-4ac1-a996-d3ed9783b4da tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 10:18:53 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-6b2accfb-5a46-4ac1-a996-d3ed9783b4da tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 10:18:53 user nova-compute[73572]: WARNING os_brick.initiator.connectors.base [None req-6b2accfb-5a46-4ac1-a996-d3ed9783b4da tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 10:18:53 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-6b2accfb-5a46-4ac1-a996-d3ed9783b4da tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:054581d6-82cb-4ac5-9ff2-c1d3a3c0b2ae" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 10:18:53 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-6b2accfb-5a46-4ac1-a996-d3ed9783b4da tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:054581d6-82cb-4ac5-9ff2-c1d3a3c0b2ae" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 10:18:53 user nova-compute[73572]: INFO os_brick.initiator.connectors.iscsi [None req-6b2accfb-5a46-4ac1-a996-d3ed9783b4da tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 10:18:53 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-83111095-563d-47ed-97f7-690e26ce43c9 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a30f2d519f1cc16d403081c495de5f8aba77255 --force-share --output=json" returned: 0 in 0.176s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:18:53 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:054581d6-82cb-4ac5-9ff2-c1d3a3c0b2ae -p 172.16.0.220:3260 {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:18:53 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-83111095-563d-47ed-97f7-690e26ce43c9 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] [instance: c901bbcc-3d82-4550-888f-bdbb36ba052d] Created local disks {{(pid=73572) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 10:18:53 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-83111095-563d-47ed-97f7-690e26ce43c9 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] [instance: c901bbcc-3d82-4550-888f-bdbb36ba052d] Ensure instance console log exists: /opt/stack/data/nova/instances/c901bbcc-3d82-4550-888f-bdbb36ba052d/console.log {{(pid=73572) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 10:18:53 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-83111095-563d-47ed-97f7-690e26ce43c9 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:18:53 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-83111095-563d-47ed-97f7-690e26ce43c9 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:18:53 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-83111095-563d-47ed-97f7-690e26ce43c9 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:18:53 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-83111095-563d-47ed-97f7-690e26ce43c9 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] [instance: c901bbcc-3d82-4550-888f-bdbb36ba052d] Start _get_guest_xml network_info=[{"id": "7c475446-2ad9-4502-b116-274f100e4d6c", "address": "fa:16:3e:b7:b1:84", "network": {"id": "e565abb6-25f8-4f92-9cca-69db36e4216a", "bridge": "br-int", "label": "tempest-TestStampPattern-1866566708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f2be8d4c6c147e98a1b5b7443b3828d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c475446-2a", "ovs_interfaceid": "7c475446-2ad9-4502-b116-274f100e4d6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='355088c0f24aee3700236c3c47a87d91',container_format='bare',created_at=2023-08-26T10:18:40Z,direct_url=<?>,disk_format='qcow2',id=5de36e71-6ad1-4ec6-9f56-b5630d53cad7,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-326196628',owner='6f2be8d4c6c147e98a1b5b7443b3828d',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-26T10:18:47Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'guest_format': None, 'size': 0, 'encryption_format': None, 'device_type': 'disk', 'image_id': '5de36e71-6ad1-4ec6-9f56-b5630d53cad7'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73572) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 10:18:53 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-83111095-563d-47ed-97f7-690e26ce43c9 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:18:53 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-83111095-563d-47ed-97f7-690e26ce43c9 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:18:53 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-83111095-563d-47ed-97f7-690e26ce43c9 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73572) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 10:18:53 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-83111095-563d-47ed-97f7-690e26ce43c9 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] CPU controller missing on host. {{(pid=73572) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 10:18:53 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:054581d6-82cb-4ac5-9ff2-c1d3a3c0b2ae -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:18:53 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a55fe80-8ecb-4808-a28f-da8862dba127]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:18:53 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b2accfb-5a46-4ac1-a996-d3ed9783b4da tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 10:18:53 user nova-compute[73572]:  {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:18:53 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:054581d6-82cb-4ac5-9ff2-c1d3a3c0b2ae -p 172.16.0.220:3260 --interface default --op new {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:18:53 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-83111095-563d-47ed-97f7-690e26ce43c9 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73572) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 10:18:53 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-83111095-563d-47ed-97f7-690e26ce43c9 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] CPU controller found on host. {{(pid=73572) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 10:18:53 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-83111095-563d-47ed-97f7-690e26ce43c9 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73572) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 10:18:53 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-83111095-563d-47ed-97f7-690e26ce43c9 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T10:07:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='355088c0f24aee3700236c3c47a87d91',container_format='bare',created_at=2023-08-26T10:18:40Z,direct_url=<?>,disk_format='qcow2',id=5de36e71-6ad1-4ec6-9f56-b5630d53cad7,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-326196628',owner='6f2be8d4c6c147e98a1b5b7443b3828d',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-26T10:18:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 10:18:53 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-83111095-563d-47ed-97f7-690e26ce43c9 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Flavor limits 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 10:18:53 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-83111095-563d-47ed-97f7-690e26ce43c9 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Image limits 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 10:18:53 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-83111095-563d-47ed-97f7-690e26ce43c9 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Flavor pref 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 10:18:53 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-83111095-563d-47ed-97f7-690e26ce43c9 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Image pref 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 10:18:53 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-83111095-563d-47ed-97f7-690e26ce43c9 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 10:18:53 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-83111095-563d-47ed-97f7-690e26ce43c9 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 10:18:53 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-83111095-563d-47ed-97f7-690e26ce43c9 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73572) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 10:18:53 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-83111095-563d-47ed-97f7-690e26ce43c9 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Got 1 possible topologies {{(pid=73572) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 10:18:53 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-83111095-563d-47ed-97f7-690e26ce43c9 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 10:18:53 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-83111095-563d-47ed-97f7-690e26ce43c9 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 10:18:54 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-83111095-563d-47ed-97f7-690e26ce43c9 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T10:18:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1903954468',display_name='tempest-TestStampPattern-server-1903954468',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1903954468',id=23,image_ref='5de36e71-6ad1-4ec6-9f56-b5630d53cad7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP9vHc9cYvgcHQg/aK0omfrRC7E/+64q6slnxR+kteK1TJpzyHka+ebCIfWJOJFiXL5L634G/nkiqr1k6bVjV80fgSFGxhy9wnZsw6PuJmiL2f9/rm8j19mT+daCzhQYQw==',key_name='tempest-TestStampPattern-1944573374',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6f2be8d4c6c147e98a1b5b7443b3828d',ramdisk_id='',reservation_id='r-cdmcv9nm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='d2970584-8c2a-4f99-922c-d66d59489504',image_min_disk='1',image_min_ram='0',image_owner_id='6f2be8d4c6c147e98a1b5b7443b3828d',image_owner_project_name='tempest-TestStampPattern-478976113',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-478976113-project-member',image_user_id='b990faa34b924d29bf7c0490aaf07644',network_allocated='True',owner_project_name='tempest-TestStampPattern-478976113',owner_user_name='tempest-TestStampPattern-478976113-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T10:18:51Z,user_data=None,user_id='b990faa34b924d29bf7c0490aaf07644',uuid=c901bbcc-3d82-4550-888f-bdbb36ba052d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7c475446-2ad9-4502-b116-274f100e4d6c", "address": "fa:16:3e:b7:b1:84", "network": {"id": "e565abb6-25f8-4f92-9cca-69db36e4216a", "bridge": "br-int", "label": "tempest-TestStampPattern-1866566708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f2be8d4c6c147e98a1b5b7443b3828d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c475446-2a", "ovs_interfaceid": "7c475446-2ad9-4502-b116-274f100e4d6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73572) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 10:18:54 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-83111095-563d-47ed-97f7-690e26ce43c9 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Converting VIF {"id": "7c475446-2ad9-4502-b116-274f100e4d6c", "address": "fa:16:3e:b7:b1:84", "network": {"id": "e565abb6-25f8-4f92-9cca-69db36e4216a", "bridge": "br-int", "label": "tempest-TestStampPattern-1866566708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f2be8d4c6c147e98a1b5b7443b3828d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c475446-2a", "ovs_interfaceid": "7c475446-2ad9-4502-b116-274f100e4d6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:18:54 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-83111095-563d-47ed-97f7-690e26ce43c9 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:b1:84,bridge_name='br-int',has_traffic_filtering=True,id=7c475446-2ad9-4502-b116-274f100e4d6c,network=Network(e565abb6-25f8-4f92-9cca-69db36e4216a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c475446-2a') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:18:54 user nova-compute[73572]: DEBUG nova.objects.instance [None req-83111095-563d-47ed-97f7-690e26ce43c9 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Lazy-loading 'pci_devices' on Instance uuid c901bbcc-3d82-4550-888f-bdbb36ba052d {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:18:54 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:054581d6-82cb-4ac5-9ff2-c1d3a3c0b2ae -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:18:54 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd7cc960-3f5a-4f5d-83c2-47b4229c9982]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:054581d6-82cb-4ac5-9ff2-c1d3a3c0b2ae] added\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:18:54 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b2accfb-5a46-4ac1-a996-d3ed9783b4da tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:054581d6-82cb-4ac5-9ff2-c1d3a3c0b2ae] added
Aug 26 10:18:54 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:18:54 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-83111095-563d-47ed-97f7-690e26ce43c9 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] [instance: c901bbcc-3d82-4550-888f-bdbb36ba052d] End _get_guest_xml xml=<domain type="kvm">
Aug 26 10:18:54 user nova-compute[73572]:   <uuid>c901bbcc-3d82-4550-888f-bdbb36ba052d</uuid>
Aug 26 10:18:54 user nova-compute[73572]:   <name>instance-00000017</name>
Aug 26 10:18:54 user nova-compute[73572]:   <memory>524288</memory>
Aug 26 10:18:54 user nova-compute[73572]:   <vcpu>1</vcpu>
Aug 26 10:18:54 user nova-compute[73572]:   <metadata>
Aug 26 10:18:54 user nova-compute[73572]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 10:18:54 user nova-compute[73572]:       <nova:package version="0.0.0"/>
Aug 26 10:18:54 user nova-compute[73572]:       <nova:name>tempest-TestStampPattern-server-1903954468</nova:name>
Aug 26 10:18:54 user nova-compute[73572]:       <nova:creationTime>2023-08-26 10:18:53</nova:creationTime>
Aug 26 10:18:54 user nova-compute[73572]:       <nova:flavor name="m1.tiny">
Aug 26 10:18:54 user nova-compute[73572]:         <nova:memory>512</nova:memory>
Aug 26 10:18:54 user nova-compute[73572]:         <nova:disk>1</nova:disk>
Aug 26 10:18:54 user nova-compute[73572]:         <nova:swap>0</nova:swap>
Aug 26 10:18:54 user nova-compute[73572]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 10:18:54 user nova-compute[73572]:         <nova:vcpus>1</nova:vcpus>
Aug 26 10:18:54 user nova-compute[73572]:       </nova:flavor>
Aug 26 10:18:54 user nova-compute[73572]:       <nova:owner>
Aug 26 10:18:54 user nova-compute[73572]:         <nova:user uuid="b990faa34b924d29bf7c0490aaf07644">tempest-TestStampPattern-478976113-project-member</nova:user>
Aug 26 10:18:54 user nova-compute[73572]:         <nova:project uuid="6f2be8d4c6c147e98a1b5b7443b3828d">tempest-TestStampPattern-478976113</nova:project>
Aug 26 10:18:54 user nova-compute[73572]:       </nova:owner>
Aug 26 10:18:54 user nova-compute[73572]:       <nova:root type="image" uuid="5de36e71-6ad1-4ec6-9f56-b5630d53cad7"/>
Aug 26 10:18:54 user nova-compute[73572]:       <nova:ports>
Aug 26 10:18:54 user nova-compute[73572]:         <nova:port uuid="7c475446-2ad9-4502-b116-274f100e4d6c">
Aug 26 10:18:54 user nova-compute[73572]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 26 10:18:54 user nova-compute[73572]:         </nova:port>
Aug 26 10:18:54 user nova-compute[73572]:       </nova:ports>
Aug 26 10:18:54 user nova-compute[73572]:     </nova:instance>
Aug 26 10:18:54 user nova-compute[73572]:   </metadata>
Aug 26 10:18:54 user nova-compute[73572]:   <sysinfo type="smbios">
Aug 26 10:18:54 user nova-compute[73572]:     <system>
Aug 26 10:18:54 user nova-compute[73572]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 10:18:54 user nova-compute[73572]:       <entry name="product">OpenStack Nova</entry>
Aug 26 10:18:54 user nova-compute[73572]:       <entry name="version">0.0.0</entry>
Aug 26 10:18:54 user nova-compute[73572]:       <entry name="serial">c901bbcc-3d82-4550-888f-bdbb36ba052d</entry>
Aug 26 10:18:54 user nova-compute[73572]:       <entry name="uuid">c901bbcc-3d82-4550-888f-bdbb36ba052d</entry>
Aug 26 10:18:54 user nova-compute[73572]:       <entry name="family">Virtual Machine</entry>
Aug 26 10:18:54 user nova-compute[73572]:     </system>
Aug 26 10:18:54 user nova-compute[73572]:   </sysinfo>
Aug 26 10:18:54 user nova-compute[73572]:   <os>
Aug 26 10:18:54 user nova-compute[73572]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 10:18:54 user nova-compute[73572]:     <boot dev="hd"/>
Aug 26 10:18:54 user nova-compute[73572]:     <smbios mode="sysinfo"/>
Aug 26 10:18:54 user nova-compute[73572]:   </os>
Aug 26 10:18:54 user nova-compute[73572]:   <features>
Aug 26 10:18:54 user nova-compute[73572]:     <acpi/>
Aug 26 10:18:54 user nova-compute[73572]:     <apic/>
Aug 26 10:18:54 user nova-compute[73572]:     <vmcoreinfo/>
Aug 26 10:18:54 user nova-compute[73572]:   </features>
Aug 26 10:18:54 user nova-compute[73572]:   <clock offset="utc">
Aug 26 10:18:54 user nova-compute[73572]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 10:18:54 user nova-compute[73572]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 10:18:54 user nova-compute[73572]:     <timer name="hpet" present="no"/>
Aug 26 10:18:54 user nova-compute[73572]:   </clock>
Aug 26 10:18:54 user nova-compute[73572]:   <cpu mode="custom" match="exact">
Aug 26 10:18:54 user nova-compute[73572]:     <model>Nehalem</model>
Aug 26 10:18:54 user nova-compute[73572]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 10:18:54 user nova-compute[73572]:   </cpu>
Aug 26 10:18:54 user nova-compute[73572]:   <devices>
Aug 26 10:18:54 user nova-compute[73572]:     <disk type="file" device="disk">
Aug 26 10:18:54 user nova-compute[73572]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 10:18:54 user nova-compute[73572]:       <source file="/opt/stack/data/nova/instances/c901bbcc-3d82-4550-888f-bdbb36ba052d/disk"/>
Aug 26 10:18:54 user nova-compute[73572]:       <target dev="vda" bus="virtio"/>
Aug 26 10:18:54 user nova-compute[73572]:     </disk>
Aug 26 10:18:54 user nova-compute[73572]:     <interface type="ethernet">
Aug 26 10:18:54 user nova-compute[73572]:       <mac address="fa:16:3e:b7:b1:84"/>
Aug 26 10:18:54 user nova-compute[73572]:       <model type="virtio"/>
Aug 26 10:18:54 user nova-compute[73572]:       <mtu size="1442"/>
Aug 26 10:18:54 user nova-compute[73572]:       <target dev="tap7c475446-2a"/>
Aug 26 10:18:54 user nova-compute[73572]:     </interface>
Aug 26 10:18:54 user nova-compute[73572]:     <serial type="pty">
Aug 26 10:18:54 user nova-compute[73572]:       <log file="/opt/stack/data/nova/instances/c901bbcc-3d82-4550-888f-bdbb36ba052d/console.log" append="off"/>
Aug 26 10:18:54 user nova-compute[73572]:     </serial>
Aug 26 10:18:54 user nova-compute[73572]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 10:18:54 user nova-compute[73572]:     <video>
Aug 26 10:18:54 user nova-compute[73572]:       <model type="virtio"/>
Aug 26 10:18:54 user nova-compute[73572]:     </video>
Aug 26 10:18:54 user nova-compute[73572]:     <rng model="virtio">
Aug 26 10:18:54 user nova-compute[73572]:       <backend model="random">/dev/urandom</backend>
Aug 26 10:18:54 user nova-compute[73572]:     </rng>
Aug 26 10:18:54 user nova-compute[73572]:     <controller type="usb" index="0" model="none"/>
Aug 26 10:18:54 user nova-compute[73572]:     <memballoon model="virtio">
Aug 26 10:18:54 user nova-compute[73572]:       <stats period="10"/>
Aug 26 10:18:54 user nova-compute[73572]:     </memballoon>
Aug 26 10:18:54 user nova-compute[73572]:   </devices>
Aug 26 10:18:54 user nova-compute[73572]: </domain>
Aug 26 10:18:54 user nova-compute[73572]:  {{(pid=73572) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 10:18:54 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-83111095-563d-47ed-97f7-690e26ce43c9 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T10:18:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1903954468',display_name='tempest-TestStampPattern-server-1903954468',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1903954468',id=23,image_ref='5de36e71-6ad1-4ec6-9f56-b5630d53cad7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP9vHc9cYvgcHQg/aK0omfrRC7E/+64q6slnxR+kteK1TJpzyHka+ebCIfWJOJFiXL5L634G/nkiqr1k6bVjV80fgSFGxhy9wnZsw6PuJmiL2f9/rm8j19mT+daCzhQYQw==',key_name='tempest-TestStampPattern-1944573374',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6f2be8d4c6c147e98a1b5b7443b3828d',ramdisk_id='',reservation_id='r-cdmcv9nm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='d2970584-8c2a-4f99-922c-d66d59489504',image_min_disk='1',image_min_ram='0',image_owner_id='6f2be8d4c6c147e98a1b5b7443b3828d',image_owner_project_name='tempest-TestStampPattern-478976113',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-478976113-project-member',image_user_id='b990faa34b924d29bf7c0490aaf07644',network_allocated='True',owner_project_name='tempest-TestStampPattern-478976113',owner_user_name='tempest-TestStampPattern-478976113-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T10:18:51Z,user_data=None,user_id='b990faa34b924d29bf7c0490aaf07644',uuid=c901bbcc-3d82-4550-888f-bdbb36ba052d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7c475446-2ad9-4502-b116-274f100e4d6c", "address": "fa:16:3e:b7:b1:84", "network": {"id": "e565abb6-25f8-4f92-9cca-69db36e4216a", "bridge": "br-int", "label": "tempest-TestStampPattern-1866566708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f2be8d4c6c147e98a1b5b7443b3828d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c475446-2a", "ovs_interfaceid": "7c475446-2ad9-4502-b116-274f100e4d6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 10:18:54 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-83111095-563d-47ed-97f7-690e26ce43c9 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Converting VIF {"id": "7c475446-2ad9-4502-b116-274f100e4d6c", "address": "fa:16:3e:b7:b1:84", "network": {"id": "e565abb6-25f8-4f92-9cca-69db36e4216a", "bridge": "br-int", "label": "tempest-TestStampPattern-1866566708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f2be8d4c6c147e98a1b5b7443b3828d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c475446-2a", "ovs_interfaceid": "7c475446-2ad9-4502-b116-274f100e4d6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:18:54 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-83111095-563d-47ed-97f7-690e26ce43c9 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:b1:84,bridge_name='br-int',has_traffic_filtering=True,id=7c475446-2ad9-4502-b116-274f100e4d6c,network=Network(e565abb6-25f8-4f92-9cca-69db36e4216a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c475446-2a') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:18:54 user nova-compute[73572]: DEBUG os_vif [None req-83111095-563d-47ed-97f7-690e26ce43c9 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:b1:84,bridge_name='br-int',has_traffic_filtering=True,id=7c475446-2ad9-4502-b116-274f100e4d6c,network=Network(e565abb6-25f8-4f92-9cca-69db36e4216a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c475446-2a') {{(pid=73572) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 10:18:54 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:054581d6-82cb-4ac5-9ff2-c1d3a3c0b2ae -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:18:54 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:18:54 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:18:54 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 10:18:54 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:18:54 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7c475446-2a, may_exist=True, interface_attrs={}) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:18:54 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7c475446-2a, col_values=(('external_ids', {'iface-id': '7c475446-2ad9-4502-b116-274f100e4d6c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b7:b1:84', 'vm-uuid': 'c901bbcc-3d82-4550-888f-bdbb36ba052d'}),), if_exists=True) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:18:54 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:18:54 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:18:54 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:054581d6-82cb-4ac5-9ff2-c1d3a3c0b2ae -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.032s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:18:54 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[62987aa3-5c0f-44e2-840f-7067d233fe16]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:18:54 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b2accfb-5a46-4ac1-a996-d3ed9783b4da tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:18:54 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:054581d6-82cb-4ac5-9ff2-c1d3a3c0b2ae -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:18:54 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:18:54 user nova-compute[73572]: INFO os_vif [None req-83111095-563d-47ed-97f7-690e26ce43c9 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:b1:84,bridge_name='br-int',has_traffic_filtering=True,id=7c475446-2ad9-4502-b116-274f100e4d6c,network=Network(e565abb6-25f8-4f92-9cca-69db36e4216a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c475446-2a')
Aug 26 10:18:54 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:054581d6-82cb-4ac5-9ff2-c1d3a3c0b2ae -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:18:54 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[f627a794-6a42-48be-8d0c-a9b29962efac]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:18:54 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b2accfb-5a46-4ac1-a996-d3ed9783b4da tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:18:54 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:054581d6-82cb-4ac5-9ff2-c1d3a3c0b2ae -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yPIsRikw {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:18:54 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:054581d6-82cb-4ac5-9ff2-c1d3a3c0b2ae -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yPIsRikw" returned: 0 in 0.023s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:18:54 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[73b60f15-b4da-4c17-b10e-cf6836834db3]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:18:54 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b2accfb-5a46-4ac1-a996-d3ed9783b4da tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yPIsRikw'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:18:54 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:054581d6-82cb-4ac5-9ff2-c1d3a3c0b2ae -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:18:54 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-83111095-563d-47ed-97f7-690e26ce43c9 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] No BDM found with device name vda, not building metadata. {{(pid=73572) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 10:18:54 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-83111095-563d-47ed-97f7-690e26ce43c9 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] No VIF found with MAC fa:16:3e:b7:b1:84, not building metadata {{(pid=73572) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 10:18:54 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:054581d6-82cb-4ac5-9ff2-c1d3a3c0b2ae -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:18:54 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b795a92-38d3-46f8-9ec4-972e24816f0c]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:18:54 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b2accfb-5a46-4ac1-a996-d3ed9783b4da tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:18:54 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:18:54 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:18:54 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9339724-40d5-4a14-95d7-52d027209c87]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d94556c8-9096-4e9a-9cfc-f9d17846ed06 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c22666f6-bb12-41a8-b565-837f4617df4e (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57b56972-76f9-44aa-905c-14d04f924f76 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaa45a8a-93fc-4fac-bc41-ce4fa5173718 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:302c3cfe-f0ec-4b1c-b1d9-dc12d4f4ce40 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54d51db2-8d79-4497-8726-758fd483a0e2 (non-flash)\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:18:54 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b2accfb-5a46-4ac1-a996-d3ed9783b4da tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)
Aug 26 10:18:54 user nova-compute[73572]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478 (non-flash)
Aug 26 10:18:54 user nova-compute[73572]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d94556c8-9096-4e9a-9cfc-f9d17846ed06 (non-flash)
Aug 26 10:18:54 user nova-compute[73572]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c22666f6-bb12-41a8-b565-837f4617df4e (non-flash)
Aug 26 10:18:54 user nova-compute[73572]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57b56972-76f9-44aa-905c-14d04f924f76 (non-flash)
Aug 26 10:18:54 user nova-compute[73572]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaa45a8a-93fc-4fac-bc41-ce4fa5173718 (non-flash)
Aug 26 10:18:54 user nova-compute[73572]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:302c3cfe-f0ec-4b1c-b1d9-dc12d4f4ce40 (non-flash)
Aug 26 10:18:54 user nova-compute[73572]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54d51db2-8d79-4497-8726-758fd483a0e2 (non-flash)
Aug 26 10:18:54 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 10:18:54 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b2accfb-5a46-4ac1-a996-d3ed9783b4da tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)
Aug 26 10:18:54 user nova-compute[73572]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478 (non-flash)
Aug 26 10:18:54 user nova-compute[73572]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d94556c8-9096-4e9a-9cfc-f9d17846ed06 (non-flash)
Aug 26 10:18:54 user nova-compute[73572]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c22666f6-bb12-41a8-b565-837f4617df4e (non-flash)
Aug 26 10:18:54 user nova-compute[73572]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57b56972-76f9-44aa-905c-14d04f924f76 (non-flash)
Aug 26 10:18:54 user nova-compute[73572]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaa45a8a-93fc-4fac-bc41-ce4fa5173718 (non-flash)
Aug 26 10:18:54 user nova-compute[73572]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:302c3cfe-f0ec-4b1c-b1d9-dc12d4f4ce40 (non-flash)
Aug 26 10:18:54 user nova-compute[73572]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54d51db2-8d79-4497-8726-758fd483a0e2 (non-flash)
Aug 26 10:18:54 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 10:18:54 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:054581d6-82cb-4ac5-9ff2-c1d3a3c0b2ae -p 172.16.0.220:3260 --login {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:18:54 user nova-compute[73572]: DEBUG nova.network.neutron [None req-d503d012-2881-4c7c-b32f-8722d864d182 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] [instance: 682138af-ba6a-47f1-a9a5-03ae2661f54d] Updating instance_info_cache with network_info: [{"id": "72fe24f4-00e3-40f1-a44a-014c7669e862", "address": "fa:16:3e:d2:52:c7", "network": {"id": "2a6e27c9-9bd2-4ccb-abf6-82d85524da90", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1822065121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb6ef2597eac461f959a568abd3031ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72fe24f4-00", "ovs_interfaceid": "72fe24f4-00e3-40f1-a44a-014c7669e862", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:18:54 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-d503d012-2881-4c7c-b32f-8722d864d182 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Releasing lock "refresh_cache-682138af-ba6a-47f1-a9a5-03ae2661f54d" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:18:54 user nova-compute[73572]: DEBUG nova.compute.manager [None req-d503d012-2881-4c7c-b32f-8722d864d182 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] [instance: 682138af-ba6a-47f1-a9a5-03ae2661f54d] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:18:54 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:054581d6-82cb-4ac5-9ff2-c1d3a3c0b2ae -p 172.16.0.220:3260 --login" returned: 0 in 0.097s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:18:54 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[79d7c5da-54a1-471b-b71b-b11f47990ff4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:054581d6-82cb-4ac5-9ff2-c1d3a3c0b2ae, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:054581d6-82cb-4ac5-9ff2-c1d3a3c0b2ae, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:18:54 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b2accfb-5a46-4ac1-a996-d3ed9783b4da tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:054581d6-82cb-4ac5-9ff2-c1d3a3c0b2ae, portal: 172.16.0.220,3260]
Aug 26 10:18:54 user nova-compute[73572]: Login to [iface: default, target: iqn.2010-10.org.openstack:054581d6-82cb-4ac5-9ff2-c1d3a3c0b2ae, portal: 172.16.0.220,3260] successful.
Aug 26 10:18:54 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:18:54 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:054581d6-82cb-4ac5-9ff2-c1d3a3c0b2ae -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:18:54 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:054581d6-82cb-4ac5-9ff2-c1d3a3c0b2ae -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:18:54 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f9b823e-644d-4c2a-93a6-0ebd197f42d5]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:18:54 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b2accfb-5a46-4ac1-a996-d3ed9783b4da tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:18:54 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:18:54 user nova-compute[73572]: DEBUG nova.network.neutron [None req-16dbe192-bfcb-4a13-b430-aa57bc46c6c2 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: 14fab12e-52be-4fe6-8777-bc7ebf3c25f1] Updating instance_info_cache with network_info: [{"id": "1b2121f4-88b1-4815-9329-3c9e3172a2f6", "address": "fa:16:3e:b0:35:f5", "network": {"id": "991b9dff-5173-4456-a530-b1f7eb5cfa4a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1845930297-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4636f93c5bfc4653804de097aed2882c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b2121f4-88", "ovs_interfaceid": "1b2121f4-88b1-4815-9329-3c9e3172a2f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:18:54 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:18:54 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[acd31f8d-53c2-4cf1-8437-49f5511e9807]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d94556c8-9096-4e9a-9cfc-f9d17846ed06 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c22666f6-bb12-41a8-b565-837f4617df4e (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57b56972-76f9-44aa-905c-14d04f924f76 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaa45a8a-93fc-4fac-bc41-ce4fa5173718 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:302c3cfe-f0ec-4b1c-b1d9-dc12d4f4ce40 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54d51db2-8d79-4497-8726-758fd483a0e2 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:054581d6-82cb-4ac5-9ff2-c1d3a3c0b2ae (non-flash)\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:18:54 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b2accfb-5a46-4ac1-a996-d3ed9783b4da tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)
Aug 26 10:18:54 user nova-compute[73572]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478 (non-flash)
Aug 26 10:18:54 user nova-compute[73572]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d94556c8-9096-4e9a-9cfc-f9d17846ed06 (non-flash)
Aug 26 10:18:54 user nova-compute[73572]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c22666f6-bb12-41a8-b565-837f4617df4e (non-flash)
Aug 26 10:18:54 user nova-compute[73572]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57b56972-76f9-44aa-905c-14d04f924f76 (non-flash)
Aug 26 10:18:54 user nova-compute[73572]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaa45a8a-93fc-4fac-bc41-ce4fa5173718 (non-flash)
Aug 26 10:18:54 user nova-compute[73572]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:302c3cfe-f0ec-4b1c-b1d9-dc12d4f4ce40 (non-flash)
Aug 26 10:18:54 user nova-compute[73572]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54d51db2-8d79-4497-8726-758fd483a0e2 (non-flash)
Aug 26 10:18:54 user nova-compute[73572]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:054581d6-82cb-4ac5-9ff2-c1d3a3c0b2ae (non-flash)
Aug 26 10:18:54 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 10:18:54 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b2accfb-5a46-4ac1-a996-d3ed9783b4da tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)
Aug 26 10:18:54 user nova-compute[73572]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478 (non-flash)
Aug 26 10:18:54 user nova-compute[73572]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d94556c8-9096-4e9a-9cfc-f9d17846ed06 (non-flash)
Aug 26 10:18:54 user nova-compute[73572]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c22666f6-bb12-41a8-b565-837f4617df4e (non-flash)
Aug 26 10:18:54 user nova-compute[73572]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57b56972-76f9-44aa-905c-14d04f924f76 (non-flash)
Aug 26 10:18:54 user nova-compute[73572]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaa45a8a-93fc-4fac-bc41-ce4fa5173718 (non-flash)
Aug 26 10:18:54 user nova-compute[73572]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:302c3cfe-f0ec-4b1c-b1d9-dc12d4f4ce40 (non-flash)
Aug 26 10:18:54 user nova-compute[73572]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54d51db2-8d79-4497-8726-758fd483a0e2 (non-flash)
Aug 26 10:18:54 user nova-compute[73572]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:054581d6-82cb-4ac5-9ff2-c1d3a3c0b2ae (non-flash)
Aug 26 10:18:54 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 10:18:54 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-6b2accfb-5a46-4ac1-a996-d3ed9783b4da tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:054581d6-82cb-4ac5-9ff2-c1d3a3c0b2ae" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.428s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 10:18:54 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b2accfb-5a46-4ac1-a996-d3ed9783b4da tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] Connected to 172.16.0.220:3260 {{(pid=73572) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 10:18:54 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-6b2accfb-5a46-4ac1-a996-d3ed9783b4da tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] HCTL ('41', '-', '-', 0) found on session 22 with lun 0 {{(pid=73572) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 10:18:54 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-6b2accfb-5a46-4ac1-a996-d3ed9783b4da tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] Scanning host 41 c: -, t: -, l: 0) {{(pid=73572) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 10:18:54 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-16dbe192-bfcb-4a13-b430-aa57bc46c6c2 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Releasing lock "refresh_cache-14fab12e-52be-4fe6-8777-bc7ebf3c25f1" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:18:54 user nova-compute[73572]: DEBUG nova.objects.instance [None req-16dbe192-bfcb-4a13-b430-aa57bc46c6c2 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Lazy-loading 'flavor' on Instance uuid 14fab12e-52be-4fe6-8777-bc7ebf3c25f1 {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:18:54 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:18:54 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.021s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:18:54 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e091051-9ac5-4123-bc82-4906664169da]: (4, ('- - 0', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:18:54 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-6b2accfb-5a46-4ac1-a996-d3ed9783b4da tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] Searching for a device in session 22 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=73572) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 10:18:54 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b2accfb-5a46-4ac1-a996-d3ed9783b4da tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] Connected to sdj using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yPIsRikw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73572) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 10:18:54 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:18:54 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:18:54 user nova-compute[73572]: DEBUG nova.network.neutron [req-42be9bcc-efbf-4724-b0e5-a5f5b4712ec0 req-4abe4b47-55f5-4e38-8e9f-174f78c4d9c1 service nova] [instance: c901bbcc-3d82-4550-888f-bdbb36ba052d] Updated VIF entry in instance network info cache for port 7c475446-2ad9-4502-b116-274f100e4d6c. {{(pid=73572) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 10:18:54 user nova-compute[73572]: DEBUG nova.network.neutron [req-42be9bcc-efbf-4724-b0e5-a5f5b4712ec0 req-4abe4b47-55f5-4e38-8e9f-174f78c4d9c1 service nova] [instance: c901bbcc-3d82-4550-888f-bdbb36ba052d] Updating instance_info_cache with network_info: [{"id": "7c475446-2ad9-4502-b116-274f100e4d6c", "address": "fa:16:3e:b7:b1:84", "network": {"id": "e565abb6-25f8-4f92-9cca-69db36e4216a", "bridge": "br-int", "label": "tempest-TestStampPattern-1866566708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f2be8d4c6c147e98a1b5b7443b3828d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c475446-2a", "ovs_interfaceid": "7c475446-2ad9-4502-b116-274f100e4d6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:18:54 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:18:54 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-42be9bcc-efbf-4724-b0e5-a5f5b4712ec0 req-4abe4b47-55f5-4e38-8e9f-174f78c4d9c1 service nova] Releasing lock "refresh_cache-c901bbcc-3d82-4550-888f-bdbb36ba052d" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:18:54 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:18:54 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:18:54 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:18:54 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:18:54 user nova-compute[73572]: DEBUG nova.compute.manager [req-52404ae6-00c9-40f1-9199-0cbd84877688 req-35e6ac76-3692-4e61-a0f2-11732bbd4feb service nova] [instance: 682138af-ba6a-47f1-a9a5-03ae2661f54d] Received event network-vif-unplugged-72fe24f4-00e3-40f1-a44a-014c7669e862 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:18:54 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-52404ae6-00c9-40f1-9199-0cbd84877688 req-35e6ac76-3692-4e61-a0f2-11732bbd4feb service nova] Acquiring lock "682138af-ba6a-47f1-a9a5-03ae2661f54d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:18:54 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-52404ae6-00c9-40f1-9199-0cbd84877688 req-35e6ac76-3692-4e61-a0f2-11732bbd4feb service nova] Lock "682138af-ba6a-47f1-a9a5-03ae2661f54d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:18:54 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-52404ae6-00c9-40f1-9199-0cbd84877688 req-35e6ac76-3692-4e61-a0f2-11732bbd4feb service nova] Lock "682138af-ba6a-47f1-a9a5-03ae2661f54d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:18:54 user nova-compute[73572]: DEBUG nova.compute.manager [req-52404ae6-00c9-40f1-9199-0cbd84877688 req-35e6ac76-3692-4e61-a0f2-11732bbd4feb service nova] [instance: 682138af-ba6a-47f1-a9a5-03ae2661f54d] No waiting events found dispatching network-vif-unplugged-72fe24f4-00e3-40f1-a44a-014c7669e862 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:18:54 user nova-compute[73572]: WARNING nova.compute.manager [req-52404ae6-00c9-40f1-9199-0cbd84877688 req-35e6ac76-3692-4e61-a0f2-11732bbd4feb service nova] [instance: 682138af-ba6a-47f1-a9a5-03ae2661f54d] Received unexpected event network-vif-unplugged-72fe24f4-00e3-40f1-a44a-014c7669e862 for instance with vm_state active and task_state reboot_started_hard.
Aug 26 10:18:55 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:18:55 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:18:55 user nova-compute[73572]: DEBUG nova.compute.manager [req-95cb0e3a-6ddc-4cf5-b13a-17a178840dab req-f30b09f9-e385-40c9-932b-fee5c9844186 service nova] [instance: 14fab12e-52be-4fe6-8777-bc7ebf3c25f1] Received event network-vif-unplugged-1b2121f4-88b1-4815-9329-3c9e3172a2f6 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:18:55 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-95cb0e3a-6ddc-4cf5-b13a-17a178840dab req-f30b09f9-e385-40c9-932b-fee5c9844186 service nova] Acquiring lock "14fab12e-52be-4fe6-8777-bc7ebf3c25f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:18:55 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-95cb0e3a-6ddc-4cf5-b13a-17a178840dab req-f30b09f9-e385-40c9-932b-fee5c9844186 service nova] Lock "14fab12e-52be-4fe6-8777-bc7ebf3c25f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:18:55 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-95cb0e3a-6ddc-4cf5-b13a-17a178840dab req-f30b09f9-e385-40c9-932b-fee5c9844186 service nova] Lock "14fab12e-52be-4fe6-8777-bc7ebf3c25f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:18:55 user nova-compute[73572]: DEBUG nova.compute.manager [req-95cb0e3a-6ddc-4cf5-b13a-17a178840dab req-f30b09f9-e385-40c9-932b-fee5c9844186 service nova] [instance: 14fab12e-52be-4fe6-8777-bc7ebf3c25f1] No waiting events found dispatching network-vif-unplugged-1b2121f4-88b1-4815-9329-3c9e3172a2f6 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:18:55 user nova-compute[73572]: WARNING nova.compute.manager [req-95cb0e3a-6ddc-4cf5-b13a-17a178840dab req-f30b09f9-e385-40c9-932b-fee5c9844186 service nova] [instance: 14fab12e-52be-4fe6-8777-bc7ebf3c25f1] Received unexpected event network-vif-unplugged-1b2121f4-88b1-4815-9329-3c9e3172a2f6 for instance with vm_state rescued and task_state unrescuing.
Aug 26 10:18:55 user nova-compute[73572]: DEBUG nova.compute.manager [req-95cb0e3a-6ddc-4cf5-b13a-17a178840dab req-f30b09f9-e385-40c9-932b-fee5c9844186 service nova] [instance: 14fab12e-52be-4fe6-8777-bc7ebf3c25f1] Received event network-vif-plugged-1b2121f4-88b1-4815-9329-3c9e3172a2f6 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:18:55 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-95cb0e3a-6ddc-4cf5-b13a-17a178840dab req-f30b09f9-e385-40c9-932b-fee5c9844186 service nova] Acquiring lock "14fab12e-52be-4fe6-8777-bc7ebf3c25f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:18:55 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-95cb0e3a-6ddc-4cf5-b13a-17a178840dab req-f30b09f9-e385-40c9-932b-fee5c9844186 service nova] Lock "14fab12e-52be-4fe6-8777-bc7ebf3c25f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:18:55 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-95cb0e3a-6ddc-4cf5-b13a-17a178840dab req-f30b09f9-e385-40c9-932b-fee5c9844186 service nova] Lock "14fab12e-52be-4fe6-8777-bc7ebf3c25f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:18:55 user nova-compute[73572]: DEBUG nova.compute.manager [req-95cb0e3a-6ddc-4cf5-b13a-17a178840dab req-f30b09f9-e385-40c9-932b-fee5c9844186 service nova] [instance: 14fab12e-52be-4fe6-8777-bc7ebf3c25f1] No waiting events found dispatching network-vif-plugged-1b2121f4-88b1-4815-9329-3c9e3172a2f6 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:18:55 user nova-compute[73572]: WARNING nova.compute.manager [req-95cb0e3a-6ddc-4cf5-b13a-17a178840dab req-f30b09f9-e385-40c9-932b-fee5c9844186 service nova] [instance: 14fab12e-52be-4fe6-8777-bc7ebf3c25f1] Received unexpected event network-vif-plugged-1b2121f4-88b1-4815-9329-3c9e3172a2f6 for instance with vm_state rescued and task_state unrescuing.
Aug 26 10:18:55 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-6b2accfb-5a46-4ac1-a996-d3ed9783b4da tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.479s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 10:18:55 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b2accfb-5a46-4ac1-a996-d3ed9783b4da tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] <== connect_volume: return (1481ms) {'type': 'block', 'scsi_wwn': '23637373761343138', 'path': '/dev/sdj'} {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 10:18:55 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b2accfb-5a46-4ac1-a996-d3ed9783b4da tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] [instance: 0dceaa35-4a13-453b-961f-831f66c35af0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23637373761343138', 'path': '/dev/sdj'} {{(pid=73572) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 10:18:55 user nova-compute[73572]: DEBUG nova.objects.instance [None req-6b2accfb-5a46-4ac1-a996-d3ed9783b4da tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] Lazy-loading 'flavor' on Instance uuid 0dceaa35-4a13-453b-961f-831f66c35af0 {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:18:55 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:18:55 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:18:55 user nova-compute[73572]: DEBUG nova.virt.libvirt.guest [None req-6b2accfb-5a46-4ac1-a996-d3ed9783b4da tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 10:18:55 user nova-compute[73572]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 10:18:55 user nova-compute[73572]:   <source dev="/dev/sdj"/>
Aug 26 10:18:55 user nova-compute[73572]:   <target dev="vdb" bus="virtio"/>
Aug 26 10:18:55 user nova-compute[73572]:   <serial>054581d6-82cb-4ac5-9ff2-c1d3a3c0b2ae</serial>
Aug 26 10:18:55 user nova-compute[73572]: </disk>
Aug 26 10:18:55 user nova-compute[73572]:  {{(pid=73572) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 10:18:55 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:18:55 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:18:55 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:18:55 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:18:55 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:18:55 user nova-compute[73572]: INFO nova.virt.libvirt.driver [-] [instance: 14fab12e-52be-4fe6-8777-bc7ebf3c25f1] Instance destroyed successfully.
Aug 26 10:18:56 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:18:56 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:18:56 user nova-compute[73572]: INFO nova.virt.libvirt.driver [-] [instance: 682138af-ba6a-47f1-a9a5-03ae2661f54d] Instance destroyed successfully.
Aug 26 10:18:56 user nova-compute[73572]: DEBUG nova.objects.instance [None req-d503d012-2881-4c7c-b32f-8722d864d182 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Lazy-loading 'resources' on Instance uuid 682138af-ba6a-47f1-a9a5-03ae2661f54d {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:18:56 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-d503d012-2881-4c7c-b32f-8722d864d182 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T10:16:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-599563112',display_name='tempest-TestMinimumBasicScenario-server-599563112',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-599563112',id=19,image_ref='bd4d7dcc-4b94-4755-8f4d-82a35910708b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAPaLciMuuXDmK5UDnc9dDAL0q42nrYLkWq/GzkjjE2uLKRfJ9mMrCN1hVlbNdhdzgF+EEXM/a0Wtl8GXTyBJxG1WbLNcxpzQzC0r1tfMhaC51ige81Z2TsBef7Q/w6+Iw==',key_name='tempest-TestMinimumBasicScenario-908269596',keypairs=<?>,launch_index=0,launched_at=2023-08-26T10:16:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='eb6ef2597eac461f959a568abd3031ca',ramdisk_id='',reservation_id='r-gemevwm3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bd4d7dcc-4b94-4755-8f4d-82a35910708b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1705958769',owner_user_name='tempest-TestMinimumBasicScenario-1705958769-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T10:18:54Z,user_data=None,user_id='a354eb6764fd4c95a53b8962544bc49b',uuid=682138af-ba6a-47f1-a9a5-03ae2661f54d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "72fe24f4-00e3-40f1-a44a-014c7669e862", "address": "fa:16:3e:d2:52:c7", "network": {"id": "2a6e27c9-9bd2-4ccb-abf6-82d85524da90", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1822065121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb6ef2597eac461f959a568abd3031ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72fe24f4-00", "ovs_interfaceid": "72fe24f4-00e3-40f1-a44a-014c7669e862", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 10:18:56 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-d503d012-2881-4c7c-b32f-8722d864d182 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Converting VIF {"id": "72fe24f4-00e3-40f1-a44a-014c7669e862", "address": "fa:16:3e:d2:52:c7", "network": {"id": "2a6e27c9-9bd2-4ccb-abf6-82d85524da90", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1822065121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb6ef2597eac461f959a568abd3031ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72fe24f4-00", "ovs_interfaceid": "72fe24f4-00e3-40f1-a44a-014c7669e862", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:18:56 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-d503d012-2881-4c7c-b32f-8722d864d182 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d2:52:c7,bridge_name='br-int',has_traffic_filtering=True,id=72fe24f4-00e3-40f1-a44a-014c7669e862,network=Network(2a6e27c9-9bd2-4ccb-abf6-82d85524da90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72fe24f4-00') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:18:56 user nova-compute[73572]: DEBUG os_vif [None req-d503d012-2881-4c7c-b32f-8722d864d182 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d2:52:c7,bridge_name='br-int',has_traffic_filtering=True,id=72fe24f4-00e3-40f1-a44a-014c7669e862,network=Network(2a6e27c9-9bd2-4ccb-abf6-82d85524da90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72fe24f4-00') {{(pid=73572) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 10:18:56 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:18:56 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap72fe24f4-00, bridge=br-int, if_exists=True) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:18:56 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:18:56 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:18:56 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-6b2accfb-5a46-4ac1-a996-d3ed9783b4da tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] No BDM found with device name vda, not building metadata. {{(pid=73572) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 10:18:56 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-6b2accfb-5a46-4ac1-a996-d3ed9783b4da tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] No BDM found with device name hda, not building metadata. {{(pid=73572) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 10:18:56 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-6b2accfb-5a46-4ac1-a996-d3ed9783b4da tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] No VIF found with MAC fa:16:3e:ad:63:c3, not building metadata {{(pid=73572) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 10:18:56 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:18:56 user nova-compute[73572]: INFO os_vif [None req-d503d012-2881-4c7c-b32f-8722d864d182 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d2:52:c7,bridge_name='br-int',has_traffic_filtering=True,id=72fe24f4-00e3-40f1-a44a-014c7669e862,network=Network(2a6e27c9-9bd2-4ccb-abf6-82d85524da90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72fe24f4-00')
Aug 26 10:18:56 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d503d012-2881-4c7c-b32f-8722d864d182 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] [instance: 682138af-ba6a-47f1-a9a5-03ae2661f54d] calling os-brick to detach iSCSI Volume {{(pid=73572) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 10:18:56 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-d503d012-2881-4c7c-b32f-8722d864d182 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc89c3d6a10>, {'target_iqns': ['iqn.2010-10.org.openstack:302c3cfe-f0ec-4b1c-b1d9-dc12d4f4ce40'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UwbOMKoP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': True}}" {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 10:18:56 user nova-compute[73572]: WARNING os_brick.initiator.connectors.base [None req-d503d012-2881-4c7c-b32f-8722d864d182 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 10:18:56 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-d503d012-2881-4c7c-b32f-8722d864d182 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 10:18:56 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-d503d012-2881-4c7c-b32f-8722d864d182 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 10:18:56 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-d503d012-2881-4c7c-b32f-8722d864d182 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:302c3cfe-f0ec-4b1c-b1d9-dc12d4f4ce40', 0)] {{(pid=73572) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 10:18:56 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:18:56 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:18:56 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[f269a85b-190b-4255-9af3-e73fa11d18f1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:054581d6-82cb-4ac5-9ff2-c1d3a3c0b2ae\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:302c3cfe-f0ec-4b1c-b1d9-dc12d4f4ce40\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:54d51db2-8d79-4497-8726-758fd483a0e2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:57b56972-76f9-44aa-905c-14d04f924f76\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c22666f6-bb12-41a8-b565-837f4617df4e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d94556c8-9096-4e9a-9cfc-f9d17846ed06\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eaa45a8a-93fc-4fac-bc41-ce4fa5173718\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:18:56 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:18:56 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:18:56 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d5cea0f-941a-4dab-9404-5dc3c5585f9a]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d94556c8-9096-4e9a-9cfc-f9d17846ed06 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c22666f6-bb12-41a8-b565-837f4617df4e (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57b56972-76f9-44aa-905c-14d04f924f76 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaa45a8a-93fc-4fac-bc41-ce4fa5173718 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:302c3cfe-f0ec-4b1c-b1d9-dc12d4f4ce40 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54d51db2-8d79-4497-8726-758fd483a0e2 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:054581d6-82cb-4ac5-9ff2-c1d3a3c0b2ae (non-flash)\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:18:56 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-d503d012-2881-4c7c-b32f-8722d864d182 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)
Aug 26 10:18:56 user nova-compute[73572]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478 (non-flash)
Aug 26 10:18:56 user nova-compute[73572]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d94556c8-9096-4e9a-9cfc-f9d17846ed06 (non-flash)
Aug 26 10:18:56 user nova-compute[73572]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c22666f6-bb12-41a8-b565-837f4617df4e (non-flash)
Aug 26 10:18:56 user nova-compute[73572]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57b56972-76f9-44aa-905c-14d04f924f76 (non-flash)
Aug 26 10:18:56 user nova-compute[73572]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaa45a8a-93fc-4fac-bc41-ce4fa5173718 (non-flash)
Aug 26 10:18:56 user nova-compute[73572]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:302c3cfe-f0ec-4b1c-b1d9-dc12d4f4ce40 (non-flash)
Aug 26 10:18:56 user nova-compute[73572]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54d51db2-8d79-4497-8726-758fd483a0e2 (non-flash)
Aug 26 10:18:56 user nova-compute[73572]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:054581d6-82cb-4ac5-9ff2-c1d3a3c0b2ae (non-flash)
Aug 26 10:18:56 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 10:18:56 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-d503d012-2881-4c7c-b32f-8722d864d182 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)
Aug 26 10:18:56 user nova-compute[73572]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478 (non-flash)
Aug 26 10:18:56 user nova-compute[73572]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d94556c8-9096-4e9a-9cfc-f9d17846ed06 (non-flash)
Aug 26 10:18:56 user nova-compute[73572]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c22666f6-bb12-41a8-b565-837f4617df4e (non-flash)
Aug 26 10:18:56 user nova-compute[73572]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57b56972-76f9-44aa-905c-14d04f924f76 (non-flash)
Aug 26 10:18:56 user nova-compute[73572]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaa45a8a-93fc-4fac-bc41-ce4fa5173718 (non-flash)
Aug 26 10:18:56 user nova-compute[73572]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:302c3cfe-f0ec-4b1c-b1d9-dc12d4f4ce40 (non-flash)
Aug 26 10:18:56 user nova-compute[73572]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54d51db2-8d79-4497-8726-758fd483a0e2 (non-flash)
Aug 26 10:18:56 user nova-compute[73572]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:054581d6-82cb-4ac5-9ff2-c1d3a3c0b2ae (non-flash)
Aug 26 10:18:56 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 10:18:56 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-d503d012-2881-4c7c-b32f-8722d864d182 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc878c083a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:302c3cfe-f0ec-4b1c-b1d9-dc12d4f4ce40'): ({'sdh'}, set())}) {{(pid=73572) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 10:18:56 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-d503d012-2881-4c7c-b32f-8722d864d182 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Removing single pathed devices sdh {{(pid=73572) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 10:18:56 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:18:56 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:18:56 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f013a36-224b-4fdf-a839-e7debd579daf]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:18:56 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:18:56 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.023s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:18:56 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[08698bea-dbe4-4ef1-b197-4605b600a28c]: (4, ('ok\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:18:56 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-d503d012-2881-4c7c-b32f-8722d864d182 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Flushing IO for device /dev/sdh {{(pid=73572) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 10:18:56 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:18:56 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-6b2accfb-5a46-4ac1-a996-d3ed9783b4da tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] Lock "0dceaa35-4a13-453b-961f-831f66c35af0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 16.604s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:18:56 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.015s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:18:56 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a8dcaa6-0268-45b8-9a84-5a1019d89df5]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:18:56 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-d503d012-2881-4c7c-b32f-8722d864d182 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=73572) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 10:18:56 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:18:56 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.044s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:18:56 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7fe73fc-7766-4db2-b83f-02e3a1b234a4]: (4, ('1', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:18:56 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-d503d012-2881-4c7c-b32f-8722d864d182 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=73572) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 10:18:56 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-d503d012-2881-4c7c-b32f-8722d864d182 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] SCSI volumes sdh have been removed. {{(pid=73572) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 10:18:56 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-d503d012-2881-4c7c-b32f-8722d864d182 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:302c3cfe-f0ec-4b1c-b1d9-dc12d4f4ce40')] {{(pid=73572) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 10:18:56 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:302c3cfe-f0ec-4b1c-b1d9-dc12d4f4ce40 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:18:56 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:302c3cfe-f0ec-4b1c-b1d9-dc12d4f4ce40 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:18:56 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[85ea5451-0201-4b0d-bf56-3ef0429771ad]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:18:56 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-d503d012-2881-4c7c-b32f-8722d864d182 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:18:56 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:302c3cfe-f0ec-4b1c-b1d9-dc12d4f4ce40 -p 172.16.0.220:3260 --logout {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:18:56 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:302c3cfe-f0ec-4b1c-b1d9-dc12d4f4ce40 -p 172.16.0.220:3260 --logout" returned: 0 in 0.110s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:18:56 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e52078b-9fe8-4364-997a-df314d6499ed]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:302c3cfe-f0ec-4b1c-b1d9-dc12d4f4ce40, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:302c3cfe-f0ec-4b1c-b1d9-dc12d4f4ce40, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:18:56 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-d503d012-2881-4c7c-b32f-8722d864d182 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:302c3cfe-f0ec-4b1c-b1d9-dc12d4f4ce40, portal: 172.16.0.220,3260]
Aug 26 10:18:56 user nova-compute[73572]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:302c3cfe-f0ec-4b1c-b1d9-dc12d4f4ce40, portal: 172.16.0.220,3260] successful.
Aug 26 10:18:56 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:18:56 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:302c3cfe-f0ec-4b1c-b1d9-dc12d4f4ce40 -p 172.16.0.220:3260 --op delete {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:18:56 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:302c3cfe-f0ec-4b1c-b1d9-dc12d4f4ce40 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:18:56 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[101203cb-d148-4915-a2a9-c83a12933f43]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:18:56 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-d503d012-2881-4c7c-b32f-8722d864d182 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:18:56 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-d503d012-2881-4c7c-b32f-8722d864d182 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.371s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 10:18:56 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-d503d012-2881-4c7c-b32f-8722d864d182 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] <== disconnect_volume: return (373ms) None {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 10:18:56 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d503d012-2881-4c7c-b32f-8722d864d182 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] [instance: 682138af-ba6a-47f1-a9a5-03ae2661f54d] Disconnected iSCSI Volume {{(pid=73572) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 10:18:56 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-d503d012-2881-4c7c-b32f-8722d864d182 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] [instance: 682138af-ba6a-47f1-a9a5-03ae2661f54d] Start _get_guest_xml network_info=[{"id": "72fe24f4-00e3-40f1-a44a-014c7669e862", "address": "fa:16:3e:d2:52:c7", "network": {"id": "2a6e27c9-9bd2-4ccb-abf6-82d85524da90", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1822065121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb6ef2597eac461f959a568abd3031ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72fe24f4-00", "ovs_interfaceid": "72fe24f4-00e3-40f1-a44a-014c7669e862", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=bd4d7dcc-4b94-4755-8f4d-82a35910708b,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'guest_format': None, 'size': 0, 'encryption_format': None, 'device_type': 'disk', 'image_id': 'bd4d7dcc-4b94-4755-8f4d-82a35910708b'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'disk_bus': 'virtio', 'boot_index': None, 'mount_device': '/dev/vdb', 'attachment_id': 'ddd65bf7-a858-43be-b11b-0a4d5891bc14', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:302c3cfe-f0ec-4b1c-b1d9-dc12d4f4ce40'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UwbOMKoP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, 'status': 'reserved', 'instance': '682138af-ba6a-47f1-a9a5-03ae2661f54d', 'attached_at': '', 'detached_at': '', 'volume_id': '302c3cfe-f0ec-4b1c-b1d9-dc12d4f4ce40', 'serial': '302c3cfe-f0ec-4b1c-b1d9-dc12d4f4ce40'}, 'guest_format': None, 'device_type': 'disk', 'volume_type': None} {{(pid=73572) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 10:18:56 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-d503d012-2881-4c7c-b32f-8722d864d182 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:18:56 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-d503d012-2881-4c7c-b32f-8722d864d182 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:18:56 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-d503d012-2881-4c7c-b32f-8722d864d182 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73572) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 10:18:56 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-d503d012-2881-4c7c-b32f-8722d864d182 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] CPU controller missing on host. {{(pid=73572) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 10:18:56 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-d503d012-2881-4c7c-b32f-8722d864d182 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73572) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 10:18:56 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-d503d012-2881-4c7c-b32f-8722d864d182 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] CPU controller found on host. {{(pid=73572) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 10:18:56 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-d503d012-2881-4c7c-b32f-8722d864d182 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73572) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 10:18:56 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-d503d012-2881-4c7c-b32f-8722d864d182 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T10:07:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=bd4d7dcc-4b94-4755-8f4d-82a35910708b,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 10:18:56 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-d503d012-2881-4c7c-b32f-8722d864d182 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Flavor limits 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 10:18:56 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-d503d012-2881-4c7c-b32f-8722d864d182 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Image limits 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 10:18:56 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-d503d012-2881-4c7c-b32f-8722d864d182 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Flavor pref 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 10:18:56 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-d503d012-2881-4c7c-b32f-8722d864d182 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Image pref 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 10:18:56 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-d503d012-2881-4c7c-b32f-8722d864d182 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 10:18:56 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-d503d012-2881-4c7c-b32f-8722d864d182 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 10:18:56 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-d503d012-2881-4c7c-b32f-8722d864d182 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73572) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 10:18:56 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-d503d012-2881-4c7c-b32f-8722d864d182 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Got 1 possible topologies {{(pid=73572) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 10:18:56 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-d503d012-2881-4c7c-b32f-8722d864d182 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 10:18:56 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-d503d012-2881-4c7c-b32f-8722d864d182 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 10:18:56 user nova-compute[73572]: DEBUG nova.objects.instance [None req-d503d012-2881-4c7c-b32f-8722d864d182 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Lazy-loading 'vcpu_model' on Instance uuid 682138af-ba6a-47f1-a9a5-03ae2661f54d {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:18:56 user nova-compute[73572]: DEBUG nova.objects.base [None req-d503d012-2881-4c7c-b32f-8722d864d182 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Object Instance<682138af-ba6a-47f1-a9a5-03ae2661f54d> lazy-loaded attributes: resources,vcpu_model {{(pid=73572) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 10:18:56 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d503d012-2881-4c7c-b32f-8722d864d182 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] [instance: 682138af-ba6a-47f1-a9a5-03ae2661f54d] Calling os-brick to attach iSCSI Volume {{(pid=73572) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 10:18:56 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-d503d012-2881-4c7c-b32f-8722d864d182 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc89c3d6a10>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:302c3cfe-f0ec-4b1c-b1d9-dc12d4f4ce40'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UwbOMKoP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 10:18:56 user nova-compute[73572]: WARNING os_brick.initiator.connectors.base [None req-d503d012-2881-4c7c-b32f-8722d864d182 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 10:18:56 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-d503d012-2881-4c7c-b32f-8722d864d182 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 10:18:56 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-d503d012-2881-4c7c-b32f-8722d864d182 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 10:18:56 user nova-compute[73572]: WARNING os_brick.initiator.connectors.base [None req-d503d012-2881-4c7c-b32f-8722d864d182 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 10:18:56 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-d503d012-2881-4c7c-b32f-8722d864d182 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:302c3cfe-f0ec-4b1c-b1d9-dc12d4f4ce40" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 10:18:56 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-d503d012-2881-4c7c-b32f-8722d864d182 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:302c3cfe-f0ec-4b1c-b1d9-dc12d4f4ce40" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 10:18:56 user nova-compute[73572]: INFO os_brick.initiator.connectors.iscsi [None req-d503d012-2881-4c7c-b32f-8722d864d182 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 10:18:56 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:302c3cfe-f0ec-4b1c-b1d9-dc12d4f4ce40 -p 172.16.0.220:3260 {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:18:56 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:302c3cfe-f0ec-4b1c-b1d9-dc12d4f4ce40 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:18:56 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f88e367-2f22-4064-baf7-040544439926]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:18:56 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-d503d012-2881-4c7c-b32f-8722d864d182 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 10:18:56 user nova-compute[73572]:  {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:18:56 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:302c3cfe-f0ec-4b1c-b1d9-dc12d4f4ce40 -p 172.16.0.220:3260 --interface default --op new {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:18:56 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:302c3cfe-f0ec-4b1c-b1d9-dc12d4f4ce40 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:18:56 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b4f0ecd-66ad-46ea-8a9f-e4e338fc804c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:302c3cfe-f0ec-4b1c-b1d9-dc12d4f4ce40] added\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:18:56 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-d503d012-2881-4c7c-b32f-8722d864d182 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:302c3cfe-f0ec-4b1c-b1d9-dc12d4f4ce40] added
Aug 26 10:18:56 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:18:56 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:302c3cfe-f0ec-4b1c-b1d9-dc12d4f4ce40 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:18:56 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:302c3cfe-f0ec-4b1c-b1d9-dc12d4f4ce40 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:18:56 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd25bf35-dda8-4c9a-8f0e-69570e4fb897]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:18:56 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-d503d012-2881-4c7c-b32f-8722d864d182 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:18:56 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:302c3cfe-f0ec-4b1c-b1d9-dc12d4f4ce40 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:18:56 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:302c3cfe-f0ec-4b1c-b1d9-dc12d4f4ce40 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:18:56 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cdddee4-e196-4cf8-a14a-b84af67d3608]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:18:56 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-d503d012-2881-4c7c-b32f-8722d864d182 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:18:56 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:302c3cfe-f0ec-4b1c-b1d9-dc12d4f4ce40 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UwbOMKoP {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:18:56 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:302c3cfe-f0ec-4b1c-b1d9-dc12d4f4ce40 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UwbOMKoP" returned: 0 in 0.020s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:18:56 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[31117970-c444-4b5f-bb3b-c961d9ad6525]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:18:56 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-d503d012-2881-4c7c-b32f-8722d864d182 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UwbOMKoP'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:18:56 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:302c3cfe-f0ec-4b1c-b1d9-dc12d4f4ce40 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:18:56 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:302c3cfe-f0ec-4b1c-b1d9-dc12d4f4ce40 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:18:56 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[989e3cd1-3ef7-401c-87c9-946dc583f41e]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:18:56 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-d503d012-2881-4c7c-b32f-8722d864d182 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:18:56 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:18:56 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:18:56 user nova-compute[73572]: DEBUG nova.compute.manager [req-2b16ef68-617d-4a8b-a180-26dffaad1682 req-41cd4062-7be2-4af7-9860-8108805fbcb5 service nova] [instance: 682138af-ba6a-47f1-a9a5-03ae2661f54d] Received event network-vif-plugged-72fe24f4-00e3-40f1-a44a-014c7669e862 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:18:56 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-2b16ef68-617d-4a8b-a180-26dffaad1682 req-41cd4062-7be2-4af7-9860-8108805fbcb5 service nova] Acquiring lock "682138af-ba6a-47f1-a9a5-03ae2661f54d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:18:56 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-2b16ef68-617d-4a8b-a180-26dffaad1682 req-41cd4062-7be2-4af7-9860-8108805fbcb5 service nova] Lock "682138af-ba6a-47f1-a9a5-03ae2661f54d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:18:56 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-2b16ef68-617d-4a8b-a180-26dffaad1682 req-41cd4062-7be2-4af7-9860-8108805fbcb5 service nova] Lock "682138af-ba6a-47f1-a9a5-03ae2661f54d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:18:56 user nova-compute[73572]: DEBUG nova.compute.manager [req-2b16ef68-617d-4a8b-a180-26dffaad1682 req-41cd4062-7be2-4af7-9860-8108805fbcb5 service nova] [instance: 682138af-ba6a-47f1-a9a5-03ae2661f54d] No waiting events found dispatching network-vif-plugged-72fe24f4-00e3-40f1-a44a-014c7669e862 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:18:56 user nova-compute[73572]: WARNING nova.compute.manager [req-2b16ef68-617d-4a8b-a180-26dffaad1682 req-41cd4062-7be2-4af7-9860-8108805fbcb5 service nova] [instance: 682138af-ba6a-47f1-a9a5-03ae2661f54d] Received unexpected event network-vif-plugged-72fe24f4-00e3-40f1-a44a-014c7669e862 for instance with vm_state active and task_state reboot_started_hard.
Aug 26 10:18:56 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:18:56 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[68af9f9c-225c-4d80-b516-701c59c0e66e]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d94556c8-9096-4e9a-9cfc-f9d17846ed06 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c22666f6-bb12-41a8-b565-837f4617df4e (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57b56972-76f9-44aa-905c-14d04f924f76 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaa45a8a-93fc-4fac-bc41-ce4fa5173718 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54d51db2-8d79-4497-8726-758fd483a0e2 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:054581d6-82cb-4ac5-9ff2-c1d3a3c0b2ae (non-flash)\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:18:56 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-d503d012-2881-4c7c-b32f-8722d864d182 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)
Aug 26 10:18:56 user nova-compute[73572]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478 (non-flash)
Aug 26 10:18:56 user nova-compute[73572]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d94556c8-9096-4e9a-9cfc-f9d17846ed06 (non-flash)
Aug 26 10:18:56 user nova-compute[73572]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c22666f6-bb12-41a8-b565-837f4617df4e (non-flash)
Aug 26 10:18:56 user nova-compute[73572]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57b56972-76f9-44aa-905c-14d04f924f76 (non-flash)
Aug 26 10:18:56 user nova-compute[73572]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaa45a8a-93fc-4fac-bc41-ce4fa5173718 (non-flash)
Aug 26 10:18:56 user nova-compute[73572]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54d51db2-8d79-4497-8726-758fd483a0e2 (non-flash)
Aug 26 10:18:56 user nova-compute[73572]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:054581d6-82cb-4ac5-9ff2-c1d3a3c0b2ae (non-flash)
Aug 26 10:18:56 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 10:18:56 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-d503d012-2881-4c7c-b32f-8722d864d182 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)
Aug 26 10:18:56 user nova-compute[73572]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478 (non-flash)
Aug 26 10:18:56 user nova-compute[73572]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d94556c8-9096-4e9a-9cfc-f9d17846ed06 (non-flash)
Aug 26 10:18:56 user nova-compute[73572]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c22666f6-bb12-41a8-b565-837f4617df4e (non-flash)
Aug 26 10:18:56 user nova-compute[73572]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57b56972-76f9-44aa-905c-14d04f924f76 (non-flash)
Aug 26 10:18:56 user nova-compute[73572]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaa45a8a-93fc-4fac-bc41-ce4fa5173718 (non-flash)
Aug 26 10:18:56 user nova-compute[73572]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54d51db2-8d79-4497-8726-758fd483a0e2 (non-flash)
Aug 26 10:18:56 user nova-compute[73572]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:054581d6-82cb-4ac5-9ff2-c1d3a3c0b2ae (non-flash)
Aug 26 10:18:56 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 10:18:56 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:302c3cfe-f0ec-4b1c-b1d9-dc12d4f4ce40 -p 172.16.0.220:3260 --login {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:18:56 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:18:56 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:18:56 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:302c3cfe-f0ec-4b1c-b1d9-dc12d4f4ce40 -p 172.16.0.220:3260 --login" returned: 0 in 0.102s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:18:56 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ff77d53-1b95-4d48-a4be-8cf3d4deb77a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:302c3cfe-f0ec-4b1c-b1d9-dc12d4f4ce40, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:302c3cfe-f0ec-4b1c-b1d9-dc12d4f4ce40, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:18:57 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-d503d012-2881-4c7c-b32f-8722d864d182 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:302c3cfe-f0ec-4b1c-b1d9-dc12d4f4ce40, portal: 172.16.0.220,3260]
Aug 26 10:18:57 user nova-compute[73572]: Login to [iface: default, target: iqn.2010-10.org.openstack:302c3cfe-f0ec-4b1c-b1d9-dc12d4f4ce40, portal: 172.16.0.220,3260] successful.
Aug 26 10:18:57 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:18:57 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:302c3cfe-f0ec-4b1c-b1d9-dc12d4f4ce40 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:18:57 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:302c3cfe-f0ec-4b1c-b1d9-dc12d4f4ce40 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.037s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:18:57 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfe57681-ecc0-4acf-8d27-73c8d47266eb]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:18:57 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-d503d012-2881-4c7c-b32f-8722d864d182 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:18:57 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:18:57 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:18:57 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[05587507-5b5c-4ace-8be0-2849c4a9103f]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d94556c8-9096-4e9a-9cfc-f9d17846ed06 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c22666f6-bb12-41a8-b565-837f4617df4e (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57b56972-76f9-44aa-905c-14d04f924f76 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaa45a8a-93fc-4fac-bc41-ce4fa5173718 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54d51db2-8d79-4497-8726-758fd483a0e2 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:054581d6-82cb-4ac5-9ff2-c1d3a3c0b2ae (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:302c3cfe-f0ec-4b1c-b1d9-dc12d4f4ce40 (non-flash)\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:18:57 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-d503d012-2881-4c7c-b32f-8722d864d182 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)
Aug 26 10:18:57 user nova-compute[73572]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478 (non-flash)
Aug 26 10:18:57 user nova-compute[73572]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d94556c8-9096-4e9a-9cfc-f9d17846ed06 (non-flash)
Aug 26 10:18:57 user nova-compute[73572]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c22666f6-bb12-41a8-b565-837f4617df4e (non-flash)
Aug 26 10:18:57 user nova-compute[73572]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57b56972-76f9-44aa-905c-14d04f924f76 (non-flash)
Aug 26 10:18:57 user nova-compute[73572]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaa45a8a-93fc-4fac-bc41-ce4fa5173718 (non-flash)
Aug 26 10:18:57 user nova-compute[73572]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54d51db2-8d79-4497-8726-758fd483a0e2 (non-flash)
Aug 26 10:18:57 user nova-compute[73572]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:054581d6-82cb-4ac5-9ff2-c1d3a3c0b2ae (non-flash)
Aug 26 10:18:57 user nova-compute[73572]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:302c3cfe-f0ec-4b1c-b1d9-dc12d4f4ce40 (non-flash)
Aug 26 10:18:57 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 10:18:57 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-d503d012-2881-4c7c-b32f-8722d864d182 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)
Aug 26 10:18:57 user nova-compute[73572]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478 (non-flash)
Aug 26 10:18:57 user nova-compute[73572]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d94556c8-9096-4e9a-9cfc-f9d17846ed06 (non-flash)
Aug 26 10:18:57 user nova-compute[73572]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c22666f6-bb12-41a8-b565-837f4617df4e (non-flash)
Aug 26 10:18:57 user nova-compute[73572]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57b56972-76f9-44aa-905c-14d04f924f76 (non-flash)
Aug 26 10:18:57 user nova-compute[73572]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaa45a8a-93fc-4fac-bc41-ce4fa5173718 (non-flash)
Aug 26 10:18:57 user nova-compute[73572]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54d51db2-8d79-4497-8726-758fd483a0e2 (non-flash)
Aug 26 10:18:57 user nova-compute[73572]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:054581d6-82cb-4ac5-9ff2-c1d3a3c0b2ae (non-flash)
Aug 26 10:18:57 user nova-compute[73572]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:302c3cfe-f0ec-4b1c-b1d9-dc12d4f4ce40 (non-flash)
Aug 26 10:18:57 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 10:18:57 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-d503d012-2881-4c7c-b32f-8722d864d182 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:302c3cfe-f0ec-4b1c-b1d9-dc12d4f4ce40" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.391s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 10:18:57 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-d503d012-2881-4c7c-b32f-8722d864d182 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Connected to 172.16.0.220:3260 {{(pid=73572) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 10:18:57 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-d503d012-2881-4c7c-b32f-8722d864d182 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] HCTL ('39', '-', '-', 0) found on session 23 with lun 0 {{(pid=73572) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 10:18:57 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-d503d012-2881-4c7c-b32f-8722d864d182 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=73572) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 10:18:57 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:18:57 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.021s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:18:57 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f875e25-f32b-4125-94a7-f55fbe709561]: (4, ('- - 0', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:18:57 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-d503d012-2881-4c7c-b32f-8722d864d182 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Searching for a device in session 23 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=73572) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 10:18:57 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-d503d012-2881-4c7c-b32f-8722d864d182 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Connected to sdh using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UwbOMKoP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73572) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 10:18:57 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:18:57 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:18:57 user nova-compute[73572]: DEBUG nova.compute.manager [req-9339113d-1433-46a4-adf0-4cffb9eda9e5 req-aaf99e4c-aeac-433c-9303-0ec46363369b service nova] [instance: 14fab12e-52be-4fe6-8777-bc7ebf3c25f1] Received event network-vif-plugged-1b2121f4-88b1-4815-9329-3c9e3172a2f6 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:18:57 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-9339113d-1433-46a4-adf0-4cffb9eda9e5 req-aaf99e4c-aeac-433c-9303-0ec46363369b service nova] Acquiring lock "14fab12e-52be-4fe6-8777-bc7ebf3c25f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:18:57 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-9339113d-1433-46a4-adf0-4cffb9eda9e5 req-aaf99e4c-aeac-433c-9303-0ec46363369b service nova] Lock "14fab12e-52be-4fe6-8777-bc7ebf3c25f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:18:58 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-9339113d-1433-46a4-adf0-4cffb9eda9e5 req-aaf99e4c-aeac-433c-9303-0ec46363369b service nova] Lock "14fab12e-52be-4fe6-8777-bc7ebf3c25f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:18:58 user nova-compute[73572]: DEBUG nova.compute.manager [req-9339113d-1433-46a4-adf0-4cffb9eda9e5 req-aaf99e4c-aeac-433c-9303-0ec46363369b service nova] [instance: 14fab12e-52be-4fe6-8777-bc7ebf3c25f1] No waiting events found dispatching network-vif-plugged-1b2121f4-88b1-4815-9329-3c9e3172a2f6 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:18:58 user nova-compute[73572]: WARNING nova.compute.manager [req-9339113d-1433-46a4-adf0-4cffb9eda9e5 req-aaf99e4c-aeac-433c-9303-0ec46363369b service nova] [instance: 14fab12e-52be-4fe6-8777-bc7ebf3c25f1] Received unexpected event network-vif-plugged-1b2121f4-88b1-4815-9329-3c9e3172a2f6 for instance with vm_state rescued and task_state unrescuing.
Aug 26 10:18:58 user nova-compute[73572]: DEBUG nova.compute.manager [req-9339113d-1433-46a4-adf0-4cffb9eda9e5 req-aaf99e4c-aeac-433c-9303-0ec46363369b service nova] [instance: 14fab12e-52be-4fe6-8777-bc7ebf3c25f1] Received event network-vif-plugged-1b2121f4-88b1-4815-9329-3c9e3172a2f6 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:18:58 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-9339113d-1433-46a4-adf0-4cffb9eda9e5 req-aaf99e4c-aeac-433c-9303-0ec46363369b service nova] Acquiring lock "14fab12e-52be-4fe6-8777-bc7ebf3c25f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:18:58 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-9339113d-1433-46a4-adf0-4cffb9eda9e5 req-aaf99e4c-aeac-433c-9303-0ec46363369b service nova] Lock "14fab12e-52be-4fe6-8777-bc7ebf3c25f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:18:58 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-9339113d-1433-46a4-adf0-4cffb9eda9e5 req-aaf99e4c-aeac-433c-9303-0ec46363369b service nova] Lock "14fab12e-52be-4fe6-8777-bc7ebf3c25f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:18:58 user nova-compute[73572]: DEBUG nova.compute.manager [req-9339113d-1433-46a4-adf0-4cffb9eda9e5 req-aaf99e4c-aeac-433c-9303-0ec46363369b service nova] [instance: 14fab12e-52be-4fe6-8777-bc7ebf3c25f1] No waiting events found dispatching network-vif-plugged-1b2121f4-88b1-4815-9329-3c9e3172a2f6 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:18:58 user nova-compute[73572]: WARNING nova.compute.manager [req-9339113d-1433-46a4-adf0-4cffb9eda9e5 req-aaf99e4c-aeac-433c-9303-0ec46363369b service nova] [instance: 14fab12e-52be-4fe6-8777-bc7ebf3c25f1] Received unexpected event network-vif-plugged-1b2121f4-88b1-4815-9329-3c9e3172a2f6 for instance with vm_state rescued and task_state unrescuing.
Aug 26 10:18:58 user nova-compute[73572]: DEBUG nova.compute.manager [req-9339113d-1433-46a4-adf0-4cffb9eda9e5 req-aaf99e4c-aeac-433c-9303-0ec46363369b service nova] [instance: 14fab12e-52be-4fe6-8777-bc7ebf3c25f1] Received event network-vif-unplugged-1b2121f4-88b1-4815-9329-3c9e3172a2f6 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:18:58 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-9339113d-1433-46a4-adf0-4cffb9eda9e5 req-aaf99e4c-aeac-433c-9303-0ec46363369b service nova] Acquiring lock "14fab12e-52be-4fe6-8777-bc7ebf3c25f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:18:58 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-9339113d-1433-46a4-adf0-4cffb9eda9e5 req-aaf99e4c-aeac-433c-9303-0ec46363369b service nova] Lock "14fab12e-52be-4fe6-8777-bc7ebf3c25f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:18:58 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-9339113d-1433-46a4-adf0-4cffb9eda9e5 req-aaf99e4c-aeac-433c-9303-0ec46363369b service nova] Lock "14fab12e-52be-4fe6-8777-bc7ebf3c25f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:18:58 user nova-compute[73572]: DEBUG nova.compute.manager [req-9339113d-1433-46a4-adf0-4cffb9eda9e5 req-aaf99e4c-aeac-433c-9303-0ec46363369b service nova] [instance: 14fab12e-52be-4fe6-8777-bc7ebf3c25f1] No waiting events found dispatching network-vif-unplugged-1b2121f4-88b1-4815-9329-3c9e3172a2f6 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:18:58 user nova-compute[73572]: WARNING nova.compute.manager [req-9339113d-1433-46a4-adf0-4cffb9eda9e5 req-aaf99e4c-aeac-433c-9303-0ec46363369b service nova] [instance: 14fab12e-52be-4fe6-8777-bc7ebf3c25f1] Received unexpected event network-vif-unplugged-1b2121f4-88b1-4815-9329-3c9e3172a2f6 for instance with vm_state rescued and task_state unrescuing.
Aug 26 10:18:58 user nova-compute[73572]: DEBUG nova.compute.manager [req-9339113d-1433-46a4-adf0-4cffb9eda9e5 req-aaf99e4c-aeac-433c-9303-0ec46363369b service nova] [instance: 14fab12e-52be-4fe6-8777-bc7ebf3c25f1] Received event network-vif-plugged-1b2121f4-88b1-4815-9329-3c9e3172a2f6 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:18:58 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-9339113d-1433-46a4-adf0-4cffb9eda9e5 req-aaf99e4c-aeac-433c-9303-0ec46363369b service nova] Acquiring lock "14fab12e-52be-4fe6-8777-bc7ebf3c25f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:18:58 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-9339113d-1433-46a4-adf0-4cffb9eda9e5 req-aaf99e4c-aeac-433c-9303-0ec46363369b service nova] Lock "14fab12e-52be-4fe6-8777-bc7ebf3c25f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:18:58 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-9339113d-1433-46a4-adf0-4cffb9eda9e5 req-aaf99e4c-aeac-433c-9303-0ec46363369b service nova] Lock "14fab12e-52be-4fe6-8777-bc7ebf3c25f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:18:58 user nova-compute[73572]: DEBUG nova.compute.manager [req-9339113d-1433-46a4-adf0-4cffb9eda9e5 req-aaf99e4c-aeac-433c-9303-0ec46363369b service nova] [instance: 14fab12e-52be-4fe6-8777-bc7ebf3c25f1] No waiting events found dispatching network-vif-plugged-1b2121f4-88b1-4815-9329-3c9e3172a2f6 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:18:58 user nova-compute[73572]: WARNING nova.compute.manager [req-9339113d-1433-46a4-adf0-4cffb9eda9e5 req-aaf99e4c-aeac-433c-9303-0ec46363369b service nova] [instance: 14fab12e-52be-4fe6-8777-bc7ebf3c25f1] Received unexpected event network-vif-plugged-1b2121f4-88b1-4815-9329-3c9e3172a2f6 for instance with vm_state rescued and task_state unrescuing.
Aug 26 10:18:58 user nova-compute[73572]: DEBUG nova.compute.manager [req-9339113d-1433-46a4-adf0-4cffb9eda9e5 req-aaf99e4c-aeac-433c-9303-0ec46363369b service nova] [instance: c901bbcc-3d82-4550-888f-bdbb36ba052d] Received event network-vif-plugged-7c475446-2ad9-4502-b116-274f100e4d6c {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:18:58 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-9339113d-1433-46a4-adf0-4cffb9eda9e5 req-aaf99e4c-aeac-433c-9303-0ec46363369b service nova] Acquiring lock "c901bbcc-3d82-4550-888f-bdbb36ba052d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:18:58 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-9339113d-1433-46a4-adf0-4cffb9eda9e5 req-aaf99e4c-aeac-433c-9303-0ec46363369b service nova] Lock "c901bbcc-3d82-4550-888f-bdbb36ba052d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:18:58 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-9339113d-1433-46a4-adf0-4cffb9eda9e5 req-aaf99e4c-aeac-433c-9303-0ec46363369b service nova] Lock "c901bbcc-3d82-4550-888f-bdbb36ba052d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:18:58 user nova-compute[73572]: DEBUG nova.compute.manager [req-9339113d-1433-46a4-adf0-4cffb9eda9e5 req-aaf99e4c-aeac-433c-9303-0ec46363369b service nova] [instance: c901bbcc-3d82-4550-888f-bdbb36ba052d] No waiting events found dispatching network-vif-plugged-7c475446-2ad9-4502-b116-274f100e4d6c {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:18:58 user nova-compute[73572]: WARNING nova.compute.manager [req-9339113d-1433-46a4-adf0-4cffb9eda9e5 req-aaf99e4c-aeac-433c-9303-0ec46363369b service nova] [instance: c901bbcc-3d82-4550-888f-bdbb36ba052d] Received unexpected event network-vif-plugged-7c475446-2ad9-4502-b116-274f100e4d6c for instance with vm_state building and task_state spawning.
Aug 26 10:18:58 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-d503d012-2881-4c7c-b32f-8722d864d182 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.436s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 10:18:58 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-d503d012-2881-4c7c-b32f-8722d864d182 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] <== connect_volume: return (1438ms) {'type': 'block', 'scsi_wwn': '26338323065626331', 'path': '/dev/sdh'} {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 10:18:58 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d503d012-2881-4c7c-b32f-8722d864d182 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] [instance: 682138af-ba6a-47f1-a9a5-03ae2661f54d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26338323065626331', 'path': '/dev/sdh'} {{(pid=73572) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 10:18:58 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-d503d012-2881-4c7c-b32f-8722d864d182 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T10:16:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-599563112',display_name='tempest-TestMinimumBasicScenario-server-599563112',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-599563112',id=19,image_ref='bd4d7dcc-4b94-4755-8f4d-82a35910708b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAPaLciMuuXDmK5UDnc9dDAL0q42nrYLkWq/GzkjjE2uLKRfJ9mMrCN1hVlbNdhdzgF+EEXM/a0Wtl8GXTyBJxG1WbLNcxpzQzC0r1tfMhaC51ige81Z2TsBef7Q/w6+Iw==',key_name='tempest-TestMinimumBasicScenario-908269596',keypairs=<?>,launch_index=0,launched_at=2023-08-26T10:16:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='eb6ef2597eac461f959a568abd3031ca',ramdisk_id='',reservation_id='r-gemevwm3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bd4d7dcc-4b94-4755-8f4d-82a35910708b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1705958769',owner_user_name='tempest-TestMinimumBasicScenario-1705958769-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T10:18:54Z,user_data=None,user_id='a354eb6764fd4c95a53b8962544bc49b',uuid=682138af-ba6a-47f1-a9a5-03ae2661f54d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "72fe24f4-00e3-40f1-a44a-014c7669e862", "address": "fa:16:3e:d2:52:c7", "network": {"id": "2a6e27c9-9bd2-4ccb-abf6-82d85524da90", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1822065121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb6ef2597eac461f959a568abd3031ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72fe24f4-00", "ovs_interfaceid": "72fe24f4-00e3-40f1-a44a-014c7669e862", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73572) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 10:18:58 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-d503d012-2881-4c7c-b32f-8722d864d182 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Converting VIF {"id": "72fe24f4-00e3-40f1-a44a-014c7669e862", "address": "fa:16:3e:d2:52:c7", "network": {"id": "2a6e27c9-9bd2-4ccb-abf6-82d85524da90", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1822065121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb6ef2597eac461f959a568abd3031ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72fe24f4-00", "ovs_interfaceid": "72fe24f4-00e3-40f1-a44a-014c7669e862", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:18:58 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-d503d012-2881-4c7c-b32f-8722d864d182 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d2:52:c7,bridge_name='br-int',has_traffic_filtering=True,id=72fe24f4-00e3-40f1-a44a-014c7669e862,network=Network(2a6e27c9-9bd2-4ccb-abf6-82d85524da90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72fe24f4-00') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:18:58 user nova-compute[73572]: DEBUG nova.objects.instance [None req-d503d012-2881-4c7c-b32f-8722d864d182 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Lazy-loading 'pci_devices' on Instance uuid 682138af-ba6a-47f1-a9a5-03ae2661f54d {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:18:58 user nova-compute[73572]: DEBUG nova.objects.base [None req-d503d012-2881-4c7c-b32f-8722d864d182 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Object Instance<682138af-ba6a-47f1-a9a5-03ae2661f54d> lazy-loaded attributes: resources,vcpu_model,pci_devices {{(pid=73572) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 10:18:58 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-d503d012-2881-4c7c-b32f-8722d864d182 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] [instance: 682138af-ba6a-47f1-a9a5-03ae2661f54d] End _get_guest_xml xml=<domain type="kvm">
Aug 26 10:18:58 user nova-compute[73572]:   <uuid>682138af-ba6a-47f1-a9a5-03ae2661f54d</uuid>
Aug 26 10:18:58 user nova-compute[73572]:   <name>instance-00000013</name>
Aug 26 10:18:58 user nova-compute[73572]:   <memory>524288</memory>
Aug 26 10:18:58 user nova-compute[73572]:   <vcpu>1</vcpu>
Aug 26 10:18:58 user nova-compute[73572]:   <metadata>
Aug 26 10:18:58 user nova-compute[73572]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 10:18:58 user nova-compute[73572]:       <nova:package version="0.0.0"/>
Aug 26 10:18:58 user nova-compute[73572]:       <nova:name>tempest-TestMinimumBasicScenario-server-599563112</nova:name>
Aug 26 10:18:58 user nova-compute[73572]:       <nova:creationTime>2023-08-26 10:18:56</nova:creationTime>
Aug 26 10:18:58 user nova-compute[73572]:       <nova:flavor name="m1.tiny">
Aug 26 10:18:58 user nova-compute[73572]:         <nova:memory>512</nova:memory>
Aug 26 10:18:58 user nova-compute[73572]:         <nova:disk>1</nova:disk>
Aug 26 10:18:58 user nova-compute[73572]:         <nova:swap>0</nova:swap>
Aug 26 10:18:58 user nova-compute[73572]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 10:18:58 user nova-compute[73572]:         <nova:vcpus>1</nova:vcpus>
Aug 26 10:18:58 user nova-compute[73572]:       </nova:flavor>
Aug 26 10:18:58 user nova-compute[73572]:       <nova:owner>
Aug 26 10:18:58 user nova-compute[73572]:         <nova:user uuid="a354eb6764fd4c95a53b8962544bc49b">tempest-TestMinimumBasicScenario-1705958769-project-member</nova:user>
Aug 26 10:18:58 user nova-compute[73572]:         <nova:project uuid="eb6ef2597eac461f959a568abd3031ca">tempest-TestMinimumBasicScenario-1705958769</nova:project>
Aug 26 10:18:58 user nova-compute[73572]:       </nova:owner>
Aug 26 10:18:58 user nova-compute[73572]:       <nova:root type="image" uuid="bd4d7dcc-4b94-4755-8f4d-82a35910708b"/>
Aug 26 10:18:58 user nova-compute[73572]:       <nova:ports>
Aug 26 10:18:58 user nova-compute[73572]:         <nova:port uuid="72fe24f4-00e3-40f1-a44a-014c7669e862">
Aug 26 10:18:58 user nova-compute[73572]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 26 10:18:58 user nova-compute[73572]:         </nova:port>
Aug 26 10:18:58 user nova-compute[73572]:       </nova:ports>
Aug 26 10:18:58 user nova-compute[73572]:     </nova:instance>
Aug 26 10:18:58 user nova-compute[73572]:   </metadata>
Aug 26 10:18:58 user nova-compute[73572]:   <sysinfo type="smbios">
Aug 26 10:18:58 user nova-compute[73572]:     <system>
Aug 26 10:18:58 user nova-compute[73572]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 10:18:58 user nova-compute[73572]:       <entry name="product">OpenStack Nova</entry>
Aug 26 10:18:58 user nova-compute[73572]:       <entry name="version">0.0.0</entry>
Aug 26 10:18:58 user nova-compute[73572]:       <entry name="serial">682138af-ba6a-47f1-a9a5-03ae2661f54d</entry>
Aug 26 10:18:58 user nova-compute[73572]:       <entry name="uuid">682138af-ba6a-47f1-a9a5-03ae2661f54d</entry>
Aug 26 10:18:58 user nova-compute[73572]:       <entry name="family">Virtual Machine</entry>
Aug 26 10:18:58 user nova-compute[73572]:     </system>
Aug 26 10:18:58 user nova-compute[73572]:   </sysinfo>
Aug 26 10:18:58 user nova-compute[73572]:   <os>
Aug 26 10:18:58 user nova-compute[73572]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 10:18:58 user nova-compute[73572]:     <boot dev="hd"/>
Aug 26 10:18:58 user nova-compute[73572]:     <smbios mode="sysinfo"/>
Aug 26 10:18:58 user nova-compute[73572]:   </os>
Aug 26 10:18:58 user nova-compute[73572]:   <features>
Aug 26 10:18:58 user nova-compute[73572]:     <acpi/>
Aug 26 10:18:58 user nova-compute[73572]:     <apic/>
Aug 26 10:18:58 user nova-compute[73572]:     <vmcoreinfo/>
Aug 26 10:18:58 user nova-compute[73572]:   </features>
Aug 26 10:18:58 user nova-compute[73572]:   <clock offset="utc">
Aug 26 10:18:58 user nova-compute[73572]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 10:18:58 user nova-compute[73572]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 10:18:58 user nova-compute[73572]:     <timer name="hpet" present="no"/>
Aug 26 10:18:58 user nova-compute[73572]:   </clock>
Aug 26 10:18:58 user nova-compute[73572]:   <cpu mode="custom" match="exact">
Aug 26 10:18:58 user nova-compute[73572]:     <model>Nehalem</model>
Aug 26 10:18:58 user nova-compute[73572]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 10:18:58 user nova-compute[73572]:   </cpu>
Aug 26 10:18:58 user nova-compute[73572]:   <devices>
Aug 26 10:18:58 user nova-compute[73572]:     <disk type="file" device="disk">
Aug 26 10:18:58 user nova-compute[73572]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 10:18:58 user nova-compute[73572]:       <source file="/opt/stack/data/nova/instances/682138af-ba6a-47f1-a9a5-03ae2661f54d/disk"/>
Aug 26 10:18:58 user nova-compute[73572]:       <target dev="vda" bus="virtio"/>
Aug 26 10:18:58 user nova-compute[73572]:     </disk>
Aug 26 10:18:58 user nova-compute[73572]:     <disk type="block" device="disk">
Aug 26 10:18:58 user nova-compute[73572]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 10:18:58 user nova-compute[73572]:       <source dev="/dev/sdh"/>
Aug 26 10:18:58 user nova-compute[73572]:       <target dev="vdb" bus="virtio"/>
Aug 26 10:18:58 user nova-compute[73572]:       <serial>302c3cfe-f0ec-4b1c-b1d9-dc12d4f4ce40</serial>
Aug 26 10:18:58 user nova-compute[73572]:     </disk>
Aug 26 10:18:58 user nova-compute[73572]:     <interface type="ethernet">
Aug 26 10:18:58 user nova-compute[73572]:       <mac address="fa:16:3e:d2:52:c7"/>
Aug 26 10:18:58 user nova-compute[73572]:       <model type="virtio"/>
Aug 26 10:18:58 user nova-compute[73572]:       <mtu size="1442"/>
Aug 26 10:18:58 user nova-compute[73572]:       <target dev="tap72fe24f4-00"/>
Aug 26 10:18:58 user nova-compute[73572]:     </interface>
Aug 26 10:18:58 user nova-compute[73572]:     <serial type="pty">
Aug 26 10:18:58 user nova-compute[73572]:       <log file="/opt/stack/data/nova/instances/682138af-ba6a-47f1-a9a5-03ae2661f54d/console.log" append="off"/>
Aug 26 10:18:58 user nova-compute[73572]:     </serial>
Aug 26 10:18:58 user nova-compute[73572]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 10:18:58 user nova-compute[73572]:     <video>
Aug 26 10:18:58 user nova-compute[73572]:       <model type="virtio"/>
Aug 26 10:18:58 user nova-compute[73572]:     </video>
Aug 26 10:18:58 user nova-compute[73572]:     <rng model="virtio">
Aug 26 10:18:58 user nova-compute[73572]:       <backend model="random">/dev/urandom</backend>
Aug 26 10:18:58 user nova-compute[73572]:     </rng>
Aug 26 10:18:58 user nova-compute[73572]:     <controller type="usb" index="0" model="none"/>
Aug 26 10:18:58 user nova-compute[73572]:     <memballoon model="virtio">
Aug 26 10:18:58 user nova-compute[73572]:       <stats period="10"/>
Aug 26 10:18:58 user nova-compute[73572]:     </memballoon>
Aug 26 10:18:58 user nova-compute[73572]:   </devices>
Aug 26 10:18:58 user nova-compute[73572]: </domain>
Aug 26 10:18:58 user nova-compute[73572]:  {{(pid=73572) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 10:18:58 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-d503d012-2881-4c7c-b32f-8722d864d182 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/682138af-ba6a-47f1-a9a5-03ae2661f54d/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:18:58 user nova-compute[73572]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693045123.346666, c555f971-b177-4c26-a38e-09e0e78bf7b9 => Stopped> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:18:58 user nova-compute[73572]: INFO nova.compute.manager [-] [instance: c555f971-b177-4c26-a38e-09e0e78bf7b9] VM Stopped (Lifecycle Event)
Aug 26 10:18:58 user nova-compute[73572]: DEBUG nova.compute.manager [None req-56015bdb-af98-4840-a8a7-2bcb86d7cccc None None] [instance: c555f971-b177-4c26-a38e-09e0e78bf7b9] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:18:58 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-d503d012-2881-4c7c-b32f-8722d864d182 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/682138af-ba6a-47f1-a9a5-03ae2661f54d/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:18:58 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-d503d012-2881-4c7c-b32f-8722d864d182 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/682138af-ba6a-47f1-a9a5-03ae2661f54d/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:18:58 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-d503d012-2881-4c7c-b32f-8722d864d182 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/682138af-ba6a-47f1-a9a5-03ae2661f54d/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:18:58 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-d503d012-2881-4c7c-b32f-8722d864d182 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=73572) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 10:18:58 user nova-compute[73572]: DEBUG nova.objects.instance [None req-d503d012-2881-4c7c-b32f-8722d864d182 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Lazy-loading 'trusted_certs' on Instance uuid 682138af-ba6a-47f1-a9a5-03ae2661f54d {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:18:58 user nova-compute[73572]: DEBUG nova.objects.base [None req-d503d012-2881-4c7c-b32f-8722d864d182 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Object Instance<682138af-ba6a-47f1-a9a5-03ae2661f54d> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs {{(pid=73572) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 10:18:58 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-d503d012-2881-4c7c-b32f-8722d864d182 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07206003e8abff675a157299cdd9d53c100accd6 --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:18:59 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-d503d012-2881-4c7c-b32f-8722d864d182 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07206003e8abff675a157299cdd9d53c100accd6 --force-share --output=json" returned: 0 in 0.208s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:18:59 user nova-compute[73572]: DEBUG nova.virt.disk.api [None req-d503d012-2881-4c7c-b32f-8722d864d182 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Checking if we can resize image /opt/stack/data/nova/instances/682138af-ba6a-47f1-a9a5-03ae2661f54d/disk. size=1073741824 {{(pid=73572) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 10:18:59 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-d503d012-2881-4c7c-b32f-8722d864d182 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/682138af-ba6a-47f1-a9a5-03ae2661f54d/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:18:59 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:18:59 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-6e5dc581-37cd-4e09-9ea6-3ff75134fa95 tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] Acquiring lock "0dceaa35-4a13-453b-961f-831f66c35af0" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:18:59 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-6e5dc581-37cd-4e09-9ea6-3ff75134fa95 tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] Lock "0dceaa35-4a13-453b-961f-831f66c35af0" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:18:59 user nova-compute[73572]: INFO nova.compute.manager [None req-6e5dc581-37cd-4e09-9ea6-3ff75134fa95 tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] [instance: 0dceaa35-4a13-453b-961f-831f66c35af0] Detaching volume 054581d6-82cb-4ac5-9ff2-c1d3a3c0b2ae
Aug 26 10:18:59 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:18:59 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:18:59 user nova-compute[73572]: INFO nova.virt.block_device [None req-6e5dc581-37cd-4e09-9ea6-3ff75134fa95 tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] [instance: 0dceaa35-4a13-453b-961f-831f66c35af0] Attempting to driver detach volume 054581d6-82cb-4ac5-9ff2-c1d3a3c0b2ae from mountpoint /dev/vdb
Aug 26 10:18:59 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-6e5dc581-37cd-4e09-9ea6-3ff75134fa95 tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] Attempting to detach device vdb from instance 0dceaa35-4a13-453b-961f-831f66c35af0 from the persistent domain config. {{(pid=73572) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 10:18:59 user nova-compute[73572]: DEBUG nova.virt.libvirt.guest [None req-6e5dc581-37cd-4e09-9ea6-3ff75134fa95 tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 10:18:59 user nova-compute[73572]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 10:18:59 user nova-compute[73572]:   <source dev="/dev/sdj"/>
Aug 26 10:18:59 user nova-compute[73572]:   <target dev="vdb" bus="virtio"/>
Aug 26 10:18:59 user nova-compute[73572]:   <serial>054581d6-82cb-4ac5-9ff2-c1d3a3c0b2ae</serial>
Aug 26 10:18:59 user nova-compute[73572]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 26 10:18:59 user nova-compute[73572]: </disk>
Aug 26 10:18:59 user nova-compute[73572]:  {{(pid=73572) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 10:18:59 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-d503d012-2881-4c7c-b32f-8722d864d182 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/682138af-ba6a-47f1-a9a5-03ae2661f54d/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:18:59 user nova-compute[73572]: DEBUG nova.virt.disk.api [None req-d503d012-2881-4c7c-b32f-8722d864d182 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Cannot resize image /opt/stack/data/nova/instances/682138af-ba6a-47f1-a9a5-03ae2661f54d/disk to a smaller size. {{(pid=73572) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 10:18:59 user nova-compute[73572]: DEBUG nova.objects.instance [None req-d503d012-2881-4c7c-b32f-8722d864d182 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Lazy-loading 'migration_context' on Instance uuid 682138af-ba6a-47f1-a9a5-03ae2661f54d {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:18:59 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-6e5dc581-37cd-4e09-9ea6-3ff75134fa95 tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] Successfully detached device vdb from instance 0dceaa35-4a13-453b-961f-831f66c35af0 from the persistent domain config.
Aug 26 10:18:59 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-6e5dc581-37cd-4e09-9ea6-3ff75134fa95 tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0dceaa35-4a13-453b-961f-831f66c35af0 from the live domain config. {{(pid=73572) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 10:18:59 user nova-compute[73572]: DEBUG nova.virt.libvirt.guest [None req-6e5dc581-37cd-4e09-9ea6-3ff75134fa95 tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 10:18:59 user nova-compute[73572]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 10:18:59 user nova-compute[73572]:   <source dev="/dev/sdj"/>
Aug 26 10:18:59 user nova-compute[73572]:   <target dev="vdb" bus="virtio"/>
Aug 26 10:18:59 user nova-compute[73572]:   <serial>054581d6-82cb-4ac5-9ff2-c1d3a3c0b2ae</serial>
Aug 26 10:18:59 user nova-compute[73572]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 26 10:18:59 user nova-compute[73572]: </disk>
Aug 26 10:18:59 user nova-compute[73572]:  {{(pid=73572) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 10:18:59 user nova-compute[73572]: DEBUG nova.objects.base [None req-d503d012-2881-4c7c-b32f-8722d864d182 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Object Instance<682138af-ba6a-47f1-a9a5-03ae2661f54d> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=73572) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 10:18:59 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-d503d012-2881-4c7c-b32f-8722d864d182 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T10:16:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-599563112',display_name='tempest-TestMinimumBasicScenario-server-599563112',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-599563112',id=19,image_ref='bd4d7dcc-4b94-4755-8f4d-82a35910708b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAPaLciMuuXDmK5UDnc9dDAL0q42nrYLkWq/GzkjjE2uLKRfJ9mMrCN1hVlbNdhdzgF+EEXM/a0Wtl8GXTyBJxG1WbLNcxpzQzC0r1tfMhaC51ige81Z2TsBef7Q/w6+Iw==',key_name='tempest-TestMinimumBasicScenario-908269596',keypairs=<?>,launch_index=0,launched_at=2023-08-26T10:16:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='eb6ef2597eac461f959a568abd3031ca',ramdisk_id='',reservation_id='r-gemevwm3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bd4d7dcc-4b94-4755-8f4d-82a35910708b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1705958769',owner_user_name='tempest-TestMinimumBasicScenario-1705958769-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T10:18:54Z,user_data=None,user_id='a354eb6764fd4c95a53b8962544bc49b',uuid=682138af-ba6a-47f1-a9a5-03ae2661f54d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "72fe24f4-00e3-40f1-a44a-014c7669e862", "address": "fa:16:3e:d2:52:c7", "network": {"id": "2a6e27c9-9bd2-4ccb-abf6-82d85524da90", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1822065121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb6ef2597eac461f959a568abd3031ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72fe24f4-00", "ovs_interfaceid": "72fe24f4-00e3-40f1-a44a-014c7669e862", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 10:18:59 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-d503d012-2881-4c7c-b32f-8722d864d182 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Converting VIF {"id": "72fe24f4-00e3-40f1-a44a-014c7669e862", "address": "fa:16:3e:d2:52:c7", "network": {"id": "2a6e27c9-9bd2-4ccb-abf6-82d85524da90", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1822065121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb6ef2597eac461f959a568abd3031ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72fe24f4-00", "ovs_interfaceid": "72fe24f4-00e3-40f1-a44a-014c7669e862", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:18:59 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-d503d012-2881-4c7c-b32f-8722d864d182 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d2:52:c7,bridge_name='br-int',has_traffic_filtering=True,id=72fe24f4-00e3-40f1-a44a-014c7669e862,network=Network(2a6e27c9-9bd2-4ccb-abf6-82d85524da90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72fe24f4-00') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:18:59 user nova-compute[73572]: DEBUG os_vif [None req-d503d012-2881-4c7c-b32f-8722d864d182 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d2:52:c7,bridge_name='br-int',has_traffic_filtering=True,id=72fe24f4-00e3-40f1-a44a-014c7669e862,network=Network(2a6e27c9-9bd2-4ccb-abf6-82d85524da90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72fe24f4-00') {{(pid=73572) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 10:18:59 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:18:59 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:18:59 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 10:18:59 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:18:59 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap72fe24f4-00, may_exist=True, interface_attrs={}) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:18:59 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap72fe24f4-00, col_values=(('external_ids', {'iface-id': '72fe24f4-00e3-40f1-a44a-014c7669e862', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d2:52:c7', 'vm-uuid': '682138af-ba6a-47f1-a9a5-03ae2661f54d'}),), if_exists=True) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:18:59 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:18:59 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:18:59 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:18:59 user nova-compute[73572]: INFO os_vif [None req-d503d012-2881-4c7c-b32f-8722d864d182 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d2:52:c7,bridge_name='br-int',has_traffic_filtering=True,id=72fe24f4-00e3-40f1-a44a-014c7669e862,network=Network(2a6e27c9-9bd2-4ccb-abf6-82d85524da90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72fe24f4-00')
Aug 26 10:18:59 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:18:59 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:18:59 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:18:59 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Received event <DeviceRemovedEvent: 1693045139.6874244, 0dceaa35-4a13-453b-961f-831f66c35af0 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73572) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 10:18:59 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-6e5dc581-37cd-4e09-9ea6-3ff75134fa95 tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0dceaa35-4a13-453b-961f-831f66c35af0 {{(pid=73572) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 10:18:59 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-6e5dc581-37cd-4e09-9ea6-3ff75134fa95 tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] Successfully detached device vdb from instance 0dceaa35-4a13-453b-961f-831f66c35af0 from the live domain config.
Aug 26 10:18:59 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6e5dc581-37cd-4e09-9ea6-3ff75134fa95 tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] [instance: 0dceaa35-4a13-453b-961f-831f66c35af0] calling os-brick to detach iSCSI Volume {{(pid=73572) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 10:18:59 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e5dc581-37cd-4e09-9ea6-3ff75134fa95 tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc89c3d6a10>, {'target_iqns': ['iqn.2010-10.org.openstack:054581d6-82cb-4ac5-9ff2-c1d3a3c0b2ae'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yPIsRikw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, None), 'kwargs': False}}" {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 10:18:59 user nova-compute[73572]: WARNING os_brick.initiator.connectors.base [None req-6e5dc581-37cd-4e09-9ea6-3ff75134fa95 tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 10:18:59 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-6e5dc581-37cd-4e09-9ea6-3ff75134fa95 tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 10:18:59 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-6e5dc581-37cd-4e09-9ea6-3ff75134fa95 tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 10:18:59 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e5dc581-37cd-4e09-9ea6-3ff75134fa95 tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:054581d6-82cb-4ac5-9ff2-c1d3a3c0b2ae', 0)] {{(pid=73572) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 10:18:59 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:18:59 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:18:59 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[12c82c1f-a259-4121-b68b-dbbb052e8a11]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:054581d6-82cb-4ac5-9ff2-c1d3a3c0b2ae\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:302c3cfe-f0ec-4b1c-b1d9-dc12d4f4ce40\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:54d51db2-8d79-4497-8726-758fd483a0e2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:57b56972-76f9-44aa-905c-14d04f924f76\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c22666f6-bb12-41a8-b565-837f4617df4e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d94556c8-9096-4e9a-9cfc-f9d17846ed06\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eaa45a8a-93fc-4fac-bc41-ce4fa5173718\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:18:59 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:18:59 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:18:59 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[5908e1fe-93bb-4f01-bd8c-e4aa927640c9]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d94556c8-9096-4e9a-9cfc-f9d17846ed06 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c22666f6-bb12-41a8-b565-837f4617df4e (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57b56972-76f9-44aa-905c-14d04f924f76 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaa45a8a-93fc-4fac-bc41-ce4fa5173718 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54d51db2-8d79-4497-8726-758fd483a0e2 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:054581d6-82cb-4ac5-9ff2-c1d3a3c0b2ae (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:302c3cfe-f0ec-4b1c-b1d9-dc12d4f4ce40 (non-flash)\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:18:59 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e5dc581-37cd-4e09-9ea6-3ff75134fa95 tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)
Aug 26 10:18:59 user nova-compute[73572]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478 (non-flash)
Aug 26 10:18:59 user nova-compute[73572]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d94556c8-9096-4e9a-9cfc-f9d17846ed06 (non-flash)
Aug 26 10:18:59 user nova-compute[73572]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c22666f6-bb12-41a8-b565-837f4617df4e (non-flash)
Aug 26 10:18:59 user nova-compute[73572]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57b56972-76f9-44aa-905c-14d04f924f76 (non-flash)
Aug 26 10:18:59 user nova-compute[73572]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaa45a8a-93fc-4fac-bc41-ce4fa5173718 (non-flash)
Aug 26 10:18:59 user nova-compute[73572]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54d51db2-8d79-4497-8726-758fd483a0e2 (non-flash)
Aug 26 10:18:59 user nova-compute[73572]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:054581d6-82cb-4ac5-9ff2-c1d3a3c0b2ae (non-flash)
Aug 26 10:18:59 user nova-compute[73572]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:302c3cfe-f0ec-4b1c-b1d9-dc12d4f4ce40 (non-flash)
Aug 26 10:18:59 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 10:18:59 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e5dc581-37cd-4e09-9ea6-3ff75134fa95 tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)
Aug 26 10:18:59 user nova-compute[73572]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478 (non-flash)
Aug 26 10:18:59 user nova-compute[73572]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d94556c8-9096-4e9a-9cfc-f9d17846ed06 (non-flash)
Aug 26 10:18:59 user nova-compute[73572]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c22666f6-bb12-41a8-b565-837f4617df4e (non-flash)
Aug 26 10:18:59 user nova-compute[73572]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57b56972-76f9-44aa-905c-14d04f924f76 (non-flash)
Aug 26 10:18:59 user nova-compute[73572]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaa45a8a-93fc-4fac-bc41-ce4fa5173718 (non-flash)
Aug 26 10:18:59 user nova-compute[73572]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54d51db2-8d79-4497-8726-758fd483a0e2 (non-flash)
Aug 26 10:18:59 user nova-compute[73572]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:054581d6-82cb-4ac5-9ff2-c1d3a3c0b2ae (non-flash)
Aug 26 10:18:59 user nova-compute[73572]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:302c3cfe-f0ec-4b1c-b1d9-dc12d4f4ce40 (non-flash)
Aug 26 10:18:59 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 10:18:59 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e5dc581-37cd-4e09-9ea6-3ff75134fa95 tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc878c0f130>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:054581d6-82cb-4ac5-9ff2-c1d3a3c0b2ae'): ({'sdj'}, set())}) {{(pid=73572) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 10:18:59 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-6e5dc581-37cd-4e09-9ea6-3ff75134fa95 tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] Removing single pathed devices sdj {{(pid=73572) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 10:18:59 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:18:59 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:18:59 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[475e44a1-ff76-4d7c-bc2a-4053fa17fc64]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:18:59 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:18:59 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.020s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:18:59 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[7583a761-2b9f-4b00-8347-cc1405342f0c]: (4, ('ok\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:18:59 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-6e5dc581-37cd-4e09-9ea6-3ff75134fa95 tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] Flushing IO for device /dev/sdj {{(pid=73572) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 10:18:59 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:18:59 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.025s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:18:59 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad865533-9120-4f96-b2ad-4981c82d29b5]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:18:59 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-6e5dc581-37cd-4e09-9ea6-3ff75134fa95 tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=73572) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 10:18:59 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:18:59 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.051s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:18:59 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c0ba673-8c49-4ded-bc63-359393357b62]: (4, ('1', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:18:59 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-6e5dc581-37cd-4e09-9ea6-3ff75134fa95 tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] Checking to see if SCSI volumes sdj have been removed. {{(pid=73572) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 10:18:59 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-6e5dc581-37cd-4e09-9ea6-3ff75134fa95 tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] SCSI volumes sdj have been removed. {{(pid=73572) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 10:18:59 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e5dc581-37cd-4e09-9ea6-3ff75134fa95 tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:054581d6-82cb-4ac5-9ff2-c1d3a3c0b2ae')] {{(pid=73572) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 10:18:59 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:054581d6-82cb-4ac5-9ff2-c1d3a3c0b2ae -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:19:00 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:054581d6-82cb-4ac5-9ff2-c1d3a3c0b2ae -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.080s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:19:00 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc1765cd-fea4-4f91-b068-6bdc170718cf]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:19:00 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e5dc581-37cd-4e09-9ea6-3ff75134fa95 tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:19:00 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:054581d6-82cb-4ac5-9ff2-c1d3a3c0b2ae -p 172.16.0.220:3260 --logout {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:19:00 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:054581d6-82cb-4ac5-9ff2-c1d3a3c0b2ae -p 172.16.0.220:3260 --logout" returned: 0 in 0.122s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:19:00 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d4fa18e-5131-435d-a9ae-8c17be4b35c2]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:054581d6-82cb-4ac5-9ff2-c1d3a3c0b2ae, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:054581d6-82cb-4ac5-9ff2-c1d3a3c0b2ae, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:19:00 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e5dc581-37cd-4e09-9ea6-3ff75134fa95 tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:054581d6-82cb-4ac5-9ff2-c1d3a3c0b2ae, portal: 172.16.0.220,3260]
Aug 26 10:19:00 user nova-compute[73572]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:054581d6-82cb-4ac5-9ff2-c1d3a3c0b2ae, portal: 172.16.0.220,3260] successful.
Aug 26 10:19:00 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:19:00 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:054581d6-82cb-4ac5-9ff2-c1d3a3c0b2ae -p 172.16.0.220:3260 --op delete {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:19:00 user nova-compute[73572]: DEBUG nova.compute.manager [req-9564c5e8-39cc-4b24-be24-d40e74414184 req-d7327878-4fc3-466c-b27a-b57a5fd43675 service nova] [instance: c901bbcc-3d82-4550-888f-bdbb36ba052d] Received event network-vif-plugged-7c475446-2ad9-4502-b116-274f100e4d6c {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:19:00 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-9564c5e8-39cc-4b24-be24-d40e74414184 req-d7327878-4fc3-466c-b27a-b57a5fd43675 service nova] Acquiring lock "c901bbcc-3d82-4550-888f-bdbb36ba052d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:19:00 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-9564c5e8-39cc-4b24-be24-d40e74414184 req-d7327878-4fc3-466c-b27a-b57a5fd43675 service nova] Lock "c901bbcc-3d82-4550-888f-bdbb36ba052d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:19:00 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-9564c5e8-39cc-4b24-be24-d40e74414184 req-d7327878-4fc3-466c-b27a-b57a5fd43675 service nova] Lock "c901bbcc-3d82-4550-888f-bdbb36ba052d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:19:00 user nova-compute[73572]: DEBUG nova.compute.manager [req-9564c5e8-39cc-4b24-be24-d40e74414184 req-d7327878-4fc3-466c-b27a-b57a5fd43675 service nova] [instance: c901bbcc-3d82-4550-888f-bdbb36ba052d] No waiting events found dispatching network-vif-plugged-7c475446-2ad9-4502-b116-274f100e4d6c {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:19:00 user nova-compute[73572]: WARNING nova.compute.manager [req-9564c5e8-39cc-4b24-be24-d40e74414184 req-d7327878-4fc3-466c-b27a-b57a5fd43675 service nova] [instance: c901bbcc-3d82-4550-888f-bdbb36ba052d] Received unexpected event network-vif-plugged-7c475446-2ad9-4502-b116-274f100e4d6c for instance with vm_state building and task_state spawning.
Aug 26 10:19:00 user nova-compute[73572]: DEBUG nova.compute.manager [req-9564c5e8-39cc-4b24-be24-d40e74414184 req-d7327878-4fc3-466c-b27a-b57a5fd43675 service nova] [instance: 14fab12e-52be-4fe6-8777-bc7ebf3c25f1] Received event network-vif-plugged-1b2121f4-88b1-4815-9329-3c9e3172a2f6 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:19:00 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-9564c5e8-39cc-4b24-be24-d40e74414184 req-d7327878-4fc3-466c-b27a-b57a5fd43675 service nova] Acquiring lock "14fab12e-52be-4fe6-8777-bc7ebf3c25f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:19:00 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-9564c5e8-39cc-4b24-be24-d40e74414184 req-d7327878-4fc3-466c-b27a-b57a5fd43675 service nova] Lock "14fab12e-52be-4fe6-8777-bc7ebf3c25f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:19:00 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-9564c5e8-39cc-4b24-be24-d40e74414184 req-d7327878-4fc3-466c-b27a-b57a5fd43675 service nova] Lock "14fab12e-52be-4fe6-8777-bc7ebf3c25f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:19:00 user nova-compute[73572]: DEBUG nova.compute.manager [req-9564c5e8-39cc-4b24-be24-d40e74414184 req-d7327878-4fc3-466c-b27a-b57a5fd43675 service nova] [instance: 14fab12e-52be-4fe6-8777-bc7ebf3c25f1] No waiting events found dispatching network-vif-plugged-1b2121f4-88b1-4815-9329-3c9e3172a2f6 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:19:00 user nova-compute[73572]: WARNING nova.compute.manager [req-9564c5e8-39cc-4b24-be24-d40e74414184 req-d7327878-4fc3-466c-b27a-b57a5fd43675 service nova] [instance: 14fab12e-52be-4fe6-8777-bc7ebf3c25f1] Received unexpected event network-vif-plugged-1b2121f4-88b1-4815-9329-3c9e3172a2f6 for instance with vm_state rescued and task_state unrescuing.
Aug 26 10:19:00 user nova-compute[73572]: DEBUG nova.compute.manager [req-9564c5e8-39cc-4b24-be24-d40e74414184 req-d7327878-4fc3-466c-b27a-b57a5fd43675 service nova] [instance: 14fab12e-52be-4fe6-8777-bc7ebf3c25f1] Received event network-vif-plugged-1b2121f4-88b1-4815-9329-3c9e3172a2f6 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:19:00 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-9564c5e8-39cc-4b24-be24-d40e74414184 req-d7327878-4fc3-466c-b27a-b57a5fd43675 service nova] Acquiring lock "14fab12e-52be-4fe6-8777-bc7ebf3c25f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:19:00 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-9564c5e8-39cc-4b24-be24-d40e74414184 req-d7327878-4fc3-466c-b27a-b57a5fd43675 service nova] Lock "14fab12e-52be-4fe6-8777-bc7ebf3c25f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:19:00 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-9564c5e8-39cc-4b24-be24-d40e74414184 req-d7327878-4fc3-466c-b27a-b57a5fd43675 service nova] Lock "14fab12e-52be-4fe6-8777-bc7ebf3c25f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:19:00 user nova-compute[73572]: DEBUG nova.compute.manager [req-9564c5e8-39cc-4b24-be24-d40e74414184 req-d7327878-4fc3-466c-b27a-b57a5fd43675 service nova] [instance: 14fab12e-52be-4fe6-8777-bc7ebf3c25f1] No waiting events found dispatching network-vif-plugged-1b2121f4-88b1-4815-9329-3c9e3172a2f6 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:19:00 user nova-compute[73572]: WARNING nova.compute.manager [req-9564c5e8-39cc-4b24-be24-d40e74414184 req-d7327878-4fc3-466c-b27a-b57a5fd43675 service nova] [instance: 14fab12e-52be-4fe6-8777-bc7ebf3c25f1] Received unexpected event network-vif-plugged-1b2121f4-88b1-4815-9329-3c9e3172a2f6 for instance with vm_state rescued and task_state unrescuing.
Aug 26 10:19:00 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:054581d6-82cb-4ac5-9ff2-c1d3a3c0b2ae -p 172.16.0.220:3260 --op delete" returned: 0 in 0.067s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:19:00 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d838d38-ff0e-414f-9a28-bc1089831a40]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:19:00 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e5dc581-37cd-4e09-9ea6-3ff75134fa95 tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:19:00 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-6e5dc581-37cd-4e09-9ea6-3ff75134fa95 tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.524s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 10:19:00 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e5dc581-37cd-4e09-9ea6-3ff75134fa95 tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] <== disconnect_volume: return (525ms) None {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 10:19:00 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6e5dc581-37cd-4e09-9ea6-3ff75134fa95 tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] [instance: 0dceaa35-4a13-453b-961f-831f66c35af0] Disconnected iSCSI Volume {{(pid=73572) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 10:19:01 user nova-compute[73572]: DEBUG nova.objects.instance [None req-6e5dc581-37cd-4e09-9ea6-3ff75134fa95 tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] Lazy-loading 'flavor' on Instance uuid 0dceaa35-4a13-453b-961f-831f66c35af0 {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:19:01 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:19:01 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:19:01 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:19:01 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-6e5dc581-37cd-4e09-9ea6-3ff75134fa95 tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] Lock "0dceaa35-4a13-453b-961f-831f66c35af0" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.327s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:19:01 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-86290aa6-aa45-47b4-876f-b37b8e607e96 tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] Acquiring lock "interface-0dceaa35-4a13-453b-961f-831f66c35af0-953f6a62-54f7-40f2-8bde-2639ab34c351" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:19:01 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-86290aa6-aa45-47b4-876f-b37b8e607e96 tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] Lock "interface-0dceaa35-4a13-453b-961f-831f66c35af0-953f6a62-54f7-40f2-8bde-2639ab34c351" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:19:01 user nova-compute[73572]: DEBUG nova.objects.instance [None req-86290aa6-aa45-47b4-876f-b37b8e607e96 tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] Lazy-loading 'flavor' on Instance uuid 0dceaa35-4a13-453b-961f-831f66c35af0 {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:19:01 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-86290aa6-aa45-47b4-876f-b37b8e607e96 tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T10:16:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1180989107',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1180989107',id=20,image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCoQLfbNOsScPlPdH7TTAWBoUTtprP7Wt9D2iobB5TEO7soZAUDBZvsnw8EfneOw36+/lna9tLwlSS51wnghWJumalBKBT2droQjZV+qAgp3BnIGzzIB2rwkhacN2zLmGg==',key_name='tempest-keypair-1046141656',keypairs=<?>,launch_index=0,launched_at=2023-08-26T10:16:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6d2915087eb04830831062675024f835',ramdisk_id='',reservation_id='r-untu6l5l',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1639980618',owner_user_name='tempest-TaggedAttachmentsTest-1639980618-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T10:16:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5ff395781b5f403fa56cada31e168817',uuid=0dceaa35-4a13-453b-961f-831f66c35af0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "953f6a62-54f7-40f2-8bde-2639ab34c351", "address": "fa:16:3e:de:2b:93", "network": {"id": "4562dd45-7d3c-4cca-b97c-a3114383641b", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1852107155", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.28", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "6d2915087eb04830831062675024f835", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap953f6a62-54", "ovs_interfaceid": "953f6a62-54f7-40f2-8bde-2639ab34c351", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73572) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 10:19:01 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-86290aa6-aa45-47b4-876f-b37b8e607e96 tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] Converting VIF {"id": "953f6a62-54f7-40f2-8bde-2639ab34c351", "address": "fa:16:3e:de:2b:93", "network": {"id": "4562dd45-7d3c-4cca-b97c-a3114383641b", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1852107155", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.28", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "6d2915087eb04830831062675024f835", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap953f6a62-54", "ovs_interfaceid": "953f6a62-54f7-40f2-8bde-2639ab34c351", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:19:01 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-86290aa6-aa45-47b4-876f-b37b8e607e96 tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:2b:93,bridge_name='br-int',has_traffic_filtering=True,id=953f6a62-54f7-40f2-8bde-2639ab34c351,network=Network(4562dd45-7d3c-4cca-b97c-a3114383641b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap953f6a62-54') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:19:01 user nova-compute[73572]: DEBUG nova.virt.libvirt.guest [None req-86290aa6-aa45-47b4-876f-b37b8e607e96 tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:de:2b:93"/><model type="virtio"/><mtu size="1442"/><target dev="tap953f6a62-54"/></interface> {{(pid=73572) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 26 10:19:01 user nova-compute[73572]: DEBUG nova.virt.libvirt.guest [None req-86290aa6-aa45-47b4-876f-b37b8e607e96 tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:de:2b:93"/><model type="virtio"/><mtu size="1442"/><target dev="tap953f6a62-54"/></interface> {{(pid=73572) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 26 10:19:01 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-86290aa6-aa45-47b4-876f-b37b8e607e96 tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] Attempting to detach device tap953f6a62-54 from instance 0dceaa35-4a13-453b-961f-831f66c35af0 from the persistent domain config. {{(pid=73572) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 10:19:01 user nova-compute[73572]: DEBUG nova.virt.libvirt.guest [None req-86290aa6-aa45-47b4-876f-b37b8e607e96 tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] detach device xml: <interface type="ethernet">
Aug 26 10:19:01 user nova-compute[73572]:   <mac address="fa:16:3e:de:2b:93"/>
Aug 26 10:19:01 user nova-compute[73572]:   <model type="virtio"/>
Aug 26 10:19:01 user nova-compute[73572]:   <mtu size="1442"/>
Aug 26 10:19:01 user nova-compute[73572]:   <target dev="tap953f6a62-54"/>
Aug 26 10:19:01 user nova-compute[73572]: </interface>
Aug 26 10:19:01 user nova-compute[73572]:  {{(pid=73572) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 10:19:01 user nova-compute[73572]: DEBUG nova.virt.libvirt.guest [None req-86290aa6-aa45-47b4-876f-b37b8e607e96 tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:de:2b:93"/><model type="virtio"/><mtu size="1442"/><target dev="tap953f6a62-54"/></interface> {{(pid=73572) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 26 10:19:01 user nova-compute[73572]: DEBUG nova.virt.libvirt.guest [None req-86290aa6-aa45-47b4-876f-b37b8e607e96 tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:de:2b:93"/><model type="virtio"/><mtu size="1442"/><target dev="tap953f6a62-54"/></interface>not found in domain: <domain type='kvm' id='21'>
Aug 26 10:19:01 user nova-compute[73572]:   <name>instance-00000014</name>
Aug 26 10:19:01 user nova-compute[73572]:   <uuid>0dceaa35-4a13-453b-961f-831f66c35af0</uuid>
Aug 26 10:19:01 user nova-compute[73572]:   <metadata>
Aug 26 10:19:01 user nova-compute[73572]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 10:19:01 user nova-compute[73572]:   <nova:package version="0.0.0"/>
Aug 26 10:19:01 user nova-compute[73572]:   <nova:name>tempest-device-tagging-server-1180989107</nova:name>
Aug 26 10:19:01 user nova-compute[73572]:   <nova:creationTime>2023-08-26 10:18:39</nova:creationTime>
Aug 26 10:19:01 user nova-compute[73572]:   <nova:flavor name="m1.tiny">
Aug 26 10:19:01 user nova-compute[73572]:     <nova:memory>512</nova:memory>
Aug 26 10:19:01 user nova-compute[73572]:     <nova:disk>1</nova:disk>
Aug 26 10:19:01 user nova-compute[73572]:     <nova:swap>0</nova:swap>
Aug 26 10:19:01 user nova-compute[73572]:     <nova:ephemeral>0</nova:ephemeral>
Aug 26 10:19:01 user nova-compute[73572]:     <nova:vcpus>1</nova:vcpus>
Aug 26 10:19:01 user nova-compute[73572]:   </nova:flavor>
Aug 26 10:19:01 user nova-compute[73572]:   <nova:owner>
Aug 26 10:19:01 user nova-compute[73572]:     <nova:user uuid="5ff395781b5f403fa56cada31e168817">tempest-TaggedAttachmentsTest-1639980618-project-member</nova:user>
Aug 26 10:19:01 user nova-compute[73572]:     <nova:project uuid="6d2915087eb04830831062675024f835">tempest-TaggedAttachmentsTest-1639980618</nova:project>
Aug 26 10:19:01 user nova-compute[73572]:   </nova:owner>
Aug 26 10:19:01 user nova-compute[73572]:   <nova:root type="image" uuid="299da0c9-e1c4-48f0-be55-fbe20dd06bc9"/>
Aug 26 10:19:01 user nova-compute[73572]:   <nova:ports>
Aug 26 10:19:01 user nova-compute[73572]:     <nova:port uuid="3c5d5d20-da80-4401-b027-3c4b0df169c6">
Aug 26 10:19:01 user nova-compute[73572]:       <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 26 10:19:01 user nova-compute[73572]:     </nova:port>
Aug 26 10:19:01 user nova-compute[73572]:     <nova:port uuid="953f6a62-54f7-40f2-8bde-2639ab34c351">
Aug 26 10:19:01 user nova-compute[73572]:       <nova:ip type="fixed" address="10.10.10.28" ipVersion="4"/>
Aug 26 10:19:01 user nova-compute[73572]:     </nova:port>
Aug 26 10:19:01 user nova-compute[73572]:   </nova:ports>
Aug 26 10:19:01 user nova-compute[73572]: </nova:instance>
Aug 26 10:19:01 user nova-compute[73572]:   </metadata>
Aug 26 10:19:01 user nova-compute[73572]:   <memory unit='KiB'>524288</memory>
Aug 26 10:19:01 user nova-compute[73572]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 26 10:19:01 user nova-compute[73572]:   <vcpu placement='static'>1</vcpu>
Aug 26 10:19:01 user nova-compute[73572]:   <resource>
Aug 26 10:19:01 user nova-compute[73572]:     <partition>/machine</partition>
Aug 26 10:19:01 user nova-compute[73572]:   </resource>
Aug 26 10:19:01 user nova-compute[73572]:   <sysinfo type='smbios'>
Aug 26 10:19:01 user nova-compute[73572]:     <system>
Aug 26 10:19:01 user nova-compute[73572]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 26 10:19:01 user nova-compute[73572]:       <entry name='product'>OpenStack Nova</entry>
Aug 26 10:19:01 user nova-compute[73572]:       <entry name='version'>0.0.0</entry>
Aug 26 10:19:01 user nova-compute[73572]:       <entry name='serial'>0dceaa35-4a13-453b-961f-831f66c35af0</entry>
Aug 26 10:19:01 user nova-compute[73572]:       <entry name='uuid'>0dceaa35-4a13-453b-961f-831f66c35af0</entry>
Aug 26 10:19:01 user nova-compute[73572]:       <entry name='family'>Virtual Machine</entry>
Aug 26 10:19:01 user nova-compute[73572]:     </system>
Aug 26 10:19:01 user nova-compute[73572]:   </sysinfo>
Aug 26 10:19:01 user nova-compute[73572]:   <os>
Aug 26 10:19:01 user nova-compute[73572]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 26 10:19:01 user nova-compute[73572]:     <boot dev='hd'/>
Aug 26 10:19:01 user nova-compute[73572]:     <smbios mode='sysinfo'/>
Aug 26 10:19:01 user nova-compute[73572]:   </os>
Aug 26 10:19:01 user nova-compute[73572]:   <features>
Aug 26 10:19:01 user nova-compute[73572]:     <acpi/>
Aug 26 10:19:01 user nova-compute[73572]:     <apic/>
Aug 26 10:19:01 user nova-compute[73572]:     <vmcoreinfo state='on'/>
Aug 26 10:19:01 user nova-compute[73572]:   </features>
Aug 26 10:19:01 user nova-compute[73572]:   <cpu mode='custom' match='exact' check='full'>
Aug 26 10:19:01 user nova-compute[73572]:     <model fallback='forbid'>Nehalem</model>
Aug 26 10:19:01 user nova-compute[73572]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 26 10:19:01 user nova-compute[73572]:     <feature policy='require' name='vme'/>
Aug 26 10:19:01 user nova-compute[73572]:     <feature policy='require' name='x2apic'/>
Aug 26 10:19:01 user nova-compute[73572]:     <feature policy='require' name='hypervisor'/>
Aug 26 10:19:01 user nova-compute[73572]:   </cpu>
Aug 26 10:19:01 user nova-compute[73572]:   <clock offset='utc'>
Aug 26 10:19:01 user nova-compute[73572]:     <timer name='pit' tickpolicy='delay'/>
Aug 26 10:19:01 user nova-compute[73572]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 26 10:19:01 user nova-compute[73572]:     <timer name='hpet' present='no'/>
Aug 26 10:19:01 user nova-compute[73572]:   </clock>
Aug 26 10:19:01 user nova-compute[73572]:   <on_poweroff>destroy</on_poweroff>
Aug 26 10:19:01 user nova-compute[73572]:   <on_reboot>restart</on_reboot>
Aug 26 10:19:01 user nova-compute[73572]:   <on_crash>destroy</on_crash>
Aug 26 10:19:01 user nova-compute[73572]:   <devices>
Aug 26 10:19:01 user nova-compute[73572]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 26 10:19:01 user nova-compute[73572]:     <disk type='file' device='disk'>
Aug 26 10:19:01 user nova-compute[73572]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 26 10:19:01 user nova-compute[73572]:       <source file='/opt/stack/data/nova/instances/0dceaa35-4a13-453b-961f-831f66c35af0/disk' index='2'/>
Aug 26 10:19:01 user nova-compute[73572]:       <backingStore type='file' index='3'>
Aug 26 10:19:01 user nova-compute[73572]:         <format type='raw'/>
Aug 26 10:19:01 user nova-compute[73572]:         <source file='/opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801'/>
Aug 26 10:19:01 user nova-compute[73572]:         <backingStore/>
Aug 26 10:19:01 user nova-compute[73572]:       </backingStore>
Aug 26 10:19:01 user nova-compute[73572]:       <target dev='vda' bus='virtio'/>
Aug 26 10:19:01 user nova-compute[73572]:       <alias name='virtio-disk0'/>
Aug 26 10:19:01 user nova-compute[73572]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 26 10:19:01 user nova-compute[73572]:     </disk>
Aug 26 10:19:01 user nova-compute[73572]:     <disk type='file' device='cdrom'>
Aug 26 10:19:01 user nova-compute[73572]:       <driver name='qemu' type='raw' cache='none'/>
Aug 26 10:19:01 user nova-compute[73572]:       <source file='/opt/stack/data/nova/instances/0dceaa35-4a13-453b-961f-831f66c35af0/disk.config' index='1'/>
Aug 26 10:19:01 user nova-compute[73572]:       <backingStore/>
Aug 26 10:19:01 user nova-compute[73572]:       <target dev='hda' bus='ide'/>
Aug 26 10:19:01 user nova-compute[73572]:       <readonly/>
Aug 26 10:19:01 user nova-compute[73572]:       <alias name='ide0-0-0'/>
Aug 26 10:19:01 user nova-compute[73572]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 26 10:19:01 user nova-compute[73572]:     </disk>
Aug 26 10:19:01 user nova-compute[73572]:     <controller type='usb' index='0' model='none'>
Aug 26 10:19:01 user nova-compute[73572]:       <alias name='usb'/>
Aug 26 10:19:01 user nova-compute[73572]:     </controller>
Aug 26 10:19:01 user nova-compute[73572]:     <controller type='pci' index='0' model='pci-root'>
Aug 26 10:19:01 user nova-compute[73572]:       <alias name='pci.0'/>
Aug 26 10:19:01 user nova-compute[73572]:     </controller>
Aug 26 10:19:01 user nova-compute[73572]:     <controller type='ide' index='0'>
Aug 26 10:19:01 user nova-compute[73572]:       <alias name='ide'/>
Aug 26 10:19:01 user nova-compute[73572]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 26 10:19:01 user nova-compute[73572]:     </controller>
Aug 26 10:19:01 user nova-compute[73572]:     <interface type='ethernet'>
Aug 26 10:19:01 user nova-compute[73572]:       <mac address='fa:16:3e:ad:63:c3'/>
Aug 26 10:19:01 user nova-compute[73572]:       <target dev='tap3c5d5d20-da'/>
Aug 26 10:19:01 user nova-compute[73572]:       <model type='virtio'/>
Aug 26 10:19:01 user nova-compute[73572]:       <mtu size='1442'/>
Aug 26 10:19:01 user nova-compute[73572]:       <alias name='net0'/>
Aug 26 10:19:01 user nova-compute[73572]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 26 10:19:01 user nova-compute[73572]:     </interface>
Aug 26 10:19:01 user nova-compute[73572]:     <interface type='ethernet'>
Aug 26 10:19:01 user nova-compute[73572]:       <mac address='fa:16:3e:de:2b:93'/>
Aug 26 10:19:01 user nova-compute[73572]:       <target dev='tap953f6a62-54'/>
Aug 26 10:19:01 user nova-compute[73572]:       <model type='virtio'/>
Aug 26 10:19:01 user nova-compute[73572]:       <mtu size='1442'/>
Aug 26 10:19:01 user nova-compute[73572]:       <alias name='net1'/>
Aug 26 10:19:01 user nova-compute[73572]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Aug 26 10:19:01 user nova-compute[73572]:     </interface>
Aug 26 10:19:01 user nova-compute[73572]:     <serial type='pty'>
Aug 26 10:19:01 user nova-compute[73572]:       <source path='/dev/pts/11'/>
Aug 26 10:19:01 user nova-compute[73572]:       <log file='/opt/stack/data/nova/instances/0dceaa35-4a13-453b-961f-831f66c35af0/console.log' append='off'/>
Aug 26 10:19:01 user nova-compute[73572]:       <target type='isa-serial' port='0'>
Aug 26 10:19:01 user nova-compute[73572]:         <model name='isa-serial'/>
Aug 26 10:19:01 user nova-compute[73572]:       </target>
Aug 26 10:19:01 user nova-compute[73572]:       <alias name='serial0'/>
Aug 26 10:19:01 user nova-compute[73572]:     </serial>
Aug 26 10:19:01 user nova-compute[73572]:     <console type='pty' tty='/dev/pts/11'>
Aug 26 10:19:01 user nova-compute[73572]:       <source path='/dev/pts/11'/>
Aug 26 10:19:01 user nova-compute[73572]:       <log file='/opt/stack/data/nova/instances/0dceaa35-4a13-453b-961f-831f66c35af0/console.log' append='off'/>
Aug 26 10:19:01 user nova-compute[73572]:       <target type='serial' port='0'/>
Aug 26 10:19:01 user nova-compute[73572]:       <alias name='serial0'/>
Aug 26 10:19:01 user nova-compute[73572]:     </console>
Aug 26 10:19:01 user nova-compute[73572]:     <input type='mouse' bus='ps2'>
Aug 26 10:19:01 user nova-compute[73572]:       <alias name='input0'/>
Aug 26 10:19:01 user nova-compute[73572]:     </input>
Aug 26 10:19:01 user nova-compute[73572]:     <input type='keyboard' bus='ps2'>
Aug 26 10:19:01 user nova-compute[73572]:       <alias name='input1'/>
Aug 26 10:19:01 user nova-compute[73572]:     </input>
Aug 26 10:19:01 user nova-compute[73572]:     <graphics type='vnc' port='5911' autoport='yes' listen='0.0.0.0'>
Aug 26 10:19:01 user nova-compute[73572]:       <listen type='address' address='0.0.0.0'/>
Aug 26 10:19:01 user nova-compute[73572]:     </graphics>
Aug 26 10:19:01 user nova-compute[73572]:     <audio id='1' type='none'/>
Aug 26 10:19:01 user nova-compute[73572]:     <video>
Aug 26 10:19:01 user nova-compute[73572]:       <model type='virtio' heads='1' primary='yes'/>
Aug 26 10:19:01 user nova-compute[73572]:       <alias name='video0'/>
Aug 26 10:19:01 user nova-compute[73572]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 26 10:19:01 user nova-compute[73572]:     </video>
Aug 26 10:19:01 user nova-compute[73572]:     <memballoon model='virtio'>
Aug 26 10:19:01 user nova-compute[73572]:       <stats period='10'/>
Aug 26 10:19:01 user nova-compute[73572]:       <alias name='balloon0'/>
Aug 26 10:19:01 user nova-compute[73572]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 26 10:19:01 user nova-compute[73572]:     </memballoon>
Aug 26 10:19:01 user nova-compute[73572]:     <rng model='virtio'>
Aug 26 10:19:01 user nova-compute[73572]:       <backend model='random'>/dev/urandom</backend>
Aug 26 10:19:01 user nova-compute[73572]:       <alias name='rng0'/>
Aug 26 10:19:01 user nova-compute[73572]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 26 10:19:01 user nova-compute[73572]:     </rng>
Aug 26 10:19:01 user nova-compute[73572]:   </devices>
Aug 26 10:19:01 user nova-compute[73572]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 26 10:19:01 user nova-compute[73572]:     <label>libvirt-0dceaa35-4a13-453b-961f-831f66c35af0</label>
Aug 26 10:19:01 user nova-compute[73572]:     <imagelabel>libvirt-0dceaa35-4a13-453b-961f-831f66c35af0</imagelabel>
Aug 26 10:19:01 user nova-compute[73572]:   </seclabel>
Aug 26 10:19:01 user nova-compute[73572]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 26 10:19:01 user nova-compute[73572]:     <label>+64055:+108</label>
Aug 26 10:19:01 user nova-compute[73572]:     <imagelabel>+64055:+108</imagelabel>
Aug 26 10:19:01 user nova-compute[73572]:   </seclabel>
Aug 26 10:19:01 user nova-compute[73572]: </domain>
Aug 26 10:19:01 user nova-compute[73572]:  {{(pid=73572) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 26 10:19:01 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-86290aa6-aa45-47b4-876f-b37b8e607e96 tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] Successfully detached device tap953f6a62-54 from instance 0dceaa35-4a13-453b-961f-831f66c35af0 from the persistent domain config.
Aug 26 10:19:01 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-86290aa6-aa45-47b4-876f-b37b8e607e96 tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] (1/8): Attempting to detach device tap953f6a62-54 with device alias net1 from instance 0dceaa35-4a13-453b-961f-831f66c35af0 from the live domain config. {{(pid=73572) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 10:19:01 user nova-compute[73572]: DEBUG nova.virt.libvirt.guest [None req-86290aa6-aa45-47b4-876f-b37b8e607e96 tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] detach device xml: <interface type="ethernet">
Aug 26 10:19:01 user nova-compute[73572]:   <mac address="fa:16:3e:de:2b:93"/>
Aug 26 10:19:01 user nova-compute[73572]:   <model type="virtio"/>
Aug 26 10:19:01 user nova-compute[73572]:   <mtu size="1442"/>
Aug 26 10:19:01 user nova-compute[73572]:   <target dev="tap953f6a62-54"/>
Aug 26 10:19:01 user nova-compute[73572]: </interface>
Aug 26 10:19:01 user nova-compute[73572]:  {{(pid=73572) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 10:19:01 user nova-compute[73572]: DEBUG nova.compute.manager [req-baa2445d-2c73-4804-ae10-f13c6686a36a req-57c937f2-2f2c-493d-9c6c-01057db75310 service nova] [instance: 682138af-ba6a-47f1-a9a5-03ae2661f54d] Received event network-vif-plugged-72fe24f4-00e3-40f1-a44a-014c7669e862 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:19:01 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-baa2445d-2c73-4804-ae10-f13c6686a36a req-57c937f2-2f2c-493d-9c6c-01057db75310 service nova] Acquiring lock "682138af-ba6a-47f1-a9a5-03ae2661f54d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:19:01 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-baa2445d-2c73-4804-ae10-f13c6686a36a req-57c937f2-2f2c-493d-9c6c-01057db75310 service nova] Lock "682138af-ba6a-47f1-a9a5-03ae2661f54d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:19:01 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-baa2445d-2c73-4804-ae10-f13c6686a36a req-57c937f2-2f2c-493d-9c6c-01057db75310 service nova] Lock "682138af-ba6a-47f1-a9a5-03ae2661f54d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:19:01 user nova-compute[73572]: DEBUG nova.compute.manager [req-baa2445d-2c73-4804-ae10-f13c6686a36a req-57c937f2-2f2c-493d-9c6c-01057db75310 service nova] [instance: 682138af-ba6a-47f1-a9a5-03ae2661f54d] No waiting events found dispatching network-vif-plugged-72fe24f4-00e3-40f1-a44a-014c7669e862 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:19:01 user nova-compute[73572]: WARNING nova.compute.manager [req-baa2445d-2c73-4804-ae10-f13c6686a36a req-57c937f2-2f2c-493d-9c6c-01057db75310 service nova] [instance: 682138af-ba6a-47f1-a9a5-03ae2661f54d] Received unexpected event network-vif-plugged-72fe24f4-00e3-40f1-a44a-014c7669e862 for instance with vm_state active and task_state reboot_started_hard.
Aug 26 10:19:02 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:19:02 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Received event <DeviceRemovedEvent: 1693045142.1427252, 0dceaa35-4a13-453b-961f-831f66c35af0 => net1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73572) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 10:19:02 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-86290aa6-aa45-47b4-876f-b37b8e607e96 tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] Start waiting for the detach event from libvirt for device tap953f6a62-54 with device alias net1 for instance 0dceaa35-4a13-453b-961f-831f66c35af0 {{(pid=73572) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 10:19:02 user nova-compute[73572]: DEBUG nova.virt.libvirt.guest [None req-86290aa6-aa45-47b4-876f-b37b8e607e96 tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:de:2b:93"/><model type="virtio"/><mtu size="1442"/><target dev="tap953f6a62-54"/></interface> {{(pid=73572) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 26 10:19:02 user nova-compute[73572]: DEBUG nova.virt.libvirt.guest [None req-86290aa6-aa45-47b4-876f-b37b8e607e96 tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:de:2b:93"/><model type="virtio"/><mtu size="1442"/><target dev="tap953f6a62-54"/></interface>not found in domain: <domain type='kvm' id='21'>
Aug 26 10:19:02 user nova-compute[73572]:   <name>instance-00000014</name>
Aug 26 10:19:02 user nova-compute[73572]:   <uuid>0dceaa35-4a13-453b-961f-831f66c35af0</uuid>
Aug 26 10:19:02 user nova-compute[73572]:   <metadata>
Aug 26 10:19:02 user nova-compute[73572]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 10:19:02 user nova-compute[73572]:   <nova:package version="0.0.0"/>
Aug 26 10:19:02 user nova-compute[73572]:   <nova:name>tempest-device-tagging-server-1180989107</nova:name>
Aug 26 10:19:02 user nova-compute[73572]:   <nova:creationTime>2023-08-26 10:18:39</nova:creationTime>
Aug 26 10:19:02 user nova-compute[73572]:   <nova:flavor name="m1.tiny">
Aug 26 10:19:02 user nova-compute[73572]:     <nova:memory>512</nova:memory>
Aug 26 10:19:02 user nova-compute[73572]:     <nova:disk>1</nova:disk>
Aug 26 10:19:02 user nova-compute[73572]:     <nova:swap>0</nova:swap>
Aug 26 10:19:02 user nova-compute[73572]:     <nova:ephemeral>0</nova:ephemeral>
Aug 26 10:19:02 user nova-compute[73572]:     <nova:vcpus>1</nova:vcpus>
Aug 26 10:19:02 user nova-compute[73572]:   </nova:flavor>
Aug 26 10:19:02 user nova-compute[73572]:   <nova:owner>
Aug 26 10:19:02 user nova-compute[73572]:     <nova:user uuid="5ff395781b5f403fa56cada31e168817">tempest-TaggedAttachmentsTest-1639980618-project-member</nova:user>
Aug 26 10:19:02 user nova-compute[73572]:     <nova:project uuid="6d2915087eb04830831062675024f835">tempest-TaggedAttachmentsTest-1639980618</nova:project>
Aug 26 10:19:02 user nova-compute[73572]:   </nova:owner>
Aug 26 10:19:02 user nova-compute[73572]:   <nova:root type="image" uuid="299da0c9-e1c4-48f0-be55-fbe20dd06bc9"/>
Aug 26 10:19:02 user nova-compute[73572]:   <nova:ports>
Aug 26 10:19:02 user nova-compute[73572]:     <nova:port uuid="3c5d5d20-da80-4401-b027-3c4b0df169c6">
Aug 26 10:19:02 user nova-compute[73572]:       <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 26 10:19:02 user nova-compute[73572]:     </nova:port>
Aug 26 10:19:02 user nova-compute[73572]:     <nova:port uuid="953f6a62-54f7-40f2-8bde-2639ab34c351">
Aug 26 10:19:02 user nova-compute[73572]:       <nova:ip type="fixed" address="10.10.10.28" ipVersion="4"/>
Aug 26 10:19:02 user nova-compute[73572]:     </nova:port>
Aug 26 10:19:02 user nova-compute[73572]:   </nova:ports>
Aug 26 10:19:02 user nova-compute[73572]: </nova:instance>
Aug 26 10:19:02 user nova-compute[73572]:   </metadata>
Aug 26 10:19:02 user nova-compute[73572]:   <memory unit='KiB'>524288</memory>
Aug 26 10:19:02 user nova-compute[73572]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 26 10:19:02 user nova-compute[73572]:   <vcpu placement='static'>1</vcpu>
Aug 26 10:19:02 user nova-compute[73572]:   <resource>
Aug 26 10:19:02 user nova-compute[73572]:     <partition>/machine</partition>
Aug 26 10:19:02 user nova-compute[73572]:   </resource>
Aug 26 10:19:02 user nova-compute[73572]:   <sysinfo type='smbios'>
Aug 26 10:19:02 user nova-compute[73572]:     <system>
Aug 26 10:19:02 user nova-compute[73572]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 26 10:19:02 user nova-compute[73572]:       <entry name='product'>OpenStack Nova</entry>
Aug 26 10:19:02 user nova-compute[73572]:       <entry name='version'>0.0.0</entry>
Aug 26 10:19:02 user nova-compute[73572]:       <entry name='serial'>0dceaa35-4a13-453b-961f-831f66c35af0</entry>
Aug 26 10:19:02 user nova-compute[73572]:       <entry name='uuid'>0dceaa35-4a13-453b-961f-831f66c35af0</entry>
Aug 26 10:19:02 user nova-compute[73572]:       <entry name='family'>Virtual Machine</entry>
Aug 26 10:19:02 user nova-compute[73572]:     </system>
Aug 26 10:19:02 user nova-compute[73572]:   </sysinfo>
Aug 26 10:19:02 user nova-compute[73572]:   <os>
Aug 26 10:19:02 user nova-compute[73572]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 26 10:19:02 user nova-compute[73572]:     <boot dev='hd'/>
Aug 26 10:19:02 user nova-compute[73572]:     <smbios mode='sysinfo'/>
Aug 26 10:19:02 user nova-compute[73572]:   </os>
Aug 26 10:19:02 user nova-compute[73572]:   <features>
Aug 26 10:19:02 user nova-compute[73572]:     <acpi/>
Aug 26 10:19:02 user nova-compute[73572]:     <apic/>
Aug 26 10:19:02 user nova-compute[73572]:     <vmcoreinfo state='on'/>
Aug 26 10:19:02 user nova-compute[73572]:   </features>
Aug 26 10:19:02 user nova-compute[73572]:   <cpu mode='custom' match='exact' check='full'>
Aug 26 10:19:02 user nova-compute[73572]:     <model fallback='forbid'>Nehalem</model>
Aug 26 10:19:02 user nova-compute[73572]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 26 10:19:02 user nova-compute[73572]:     <feature policy='require' name='vme'/>
Aug 26 10:19:02 user nova-compute[73572]:     <feature policy='require' name='x2apic'/>
Aug 26 10:19:02 user nova-compute[73572]:     <feature policy='require' name='hypervisor'/>
Aug 26 10:19:02 user nova-compute[73572]:   </cpu>
Aug 26 10:19:02 user nova-compute[73572]:   <clock offset='utc'>
Aug 26 10:19:02 user nova-compute[73572]:     <timer name='pit' tickpolicy='delay'/>
Aug 26 10:19:02 user nova-compute[73572]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 26 10:19:02 user nova-compute[73572]:     <timer name='hpet' present='no'/>
Aug 26 10:19:02 user nova-compute[73572]:   </clock>
Aug 26 10:19:02 user nova-compute[73572]:   <on_poweroff>destroy</on_poweroff>
Aug 26 10:19:02 user nova-compute[73572]:   <on_reboot>restart</on_reboot>
Aug 26 10:19:02 user nova-compute[73572]:   <on_crash>destroy</on_crash>
Aug 26 10:19:02 user nova-compute[73572]:   <devices>
Aug 26 10:19:02 user nova-compute[73572]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 26 10:19:02 user nova-compute[73572]:     <disk type='file' device='disk'>
Aug 26 10:19:02 user nova-compute[73572]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 26 10:19:02 user nova-compute[73572]:       <source file='/opt/stack/data/nova/instances/0dceaa35-4a13-453b-961f-831f66c35af0/disk' index='2'/>
Aug 26 10:19:02 user nova-compute[73572]:       <backingStore type='file' index='3'>
Aug 26 10:19:02 user nova-compute[73572]:         <format type='raw'/>
Aug 26 10:19:02 user nova-compute[73572]:         <source file='/opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801'/>
Aug 26 10:19:02 user nova-compute[73572]:         <backingStore/>
Aug 26 10:19:02 user nova-compute[73572]:       </backingStore>
Aug 26 10:19:02 user nova-compute[73572]:       <target dev='vda' bus='virtio'/>
Aug 26 10:19:02 user nova-compute[73572]:       <alias name='virtio-disk0'/>
Aug 26 10:19:02 user nova-compute[73572]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 26 10:19:02 user nova-compute[73572]:     </disk>
Aug 26 10:19:02 user nova-compute[73572]:     <disk type='file' device='cdrom'>
Aug 26 10:19:02 user nova-compute[73572]:       <driver name='qemu' type='raw' cache='none'/>
Aug 26 10:19:02 user nova-compute[73572]:       <source file='/opt/stack/data/nova/instances/0dceaa35-4a13-453b-961f-831f66c35af0/disk.config' index='1'/>
Aug 26 10:19:02 user nova-compute[73572]:       <backingStore/>
Aug 26 10:19:02 user nova-compute[73572]:       <target dev='hda' bus='ide'/>
Aug 26 10:19:02 user nova-compute[73572]:       <readonly/>
Aug 26 10:19:02 user nova-compute[73572]:       <alias name='ide0-0-0'/>
Aug 26 10:19:02 user nova-compute[73572]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 26 10:19:02 user nova-compute[73572]:     </disk>
Aug 26 10:19:02 user nova-compute[73572]:     <controller type='usb' index='0' model='none'>
Aug 26 10:19:02 user nova-compute[73572]:       <alias name='usb'/>
Aug 26 10:19:02 user nova-compute[73572]:     </controller>
Aug 26 10:19:02 user nova-compute[73572]:     <controller type='pci' index='0' model='pci-root'>
Aug 26 10:19:02 user nova-compute[73572]:       <alias name='pci.0'/>
Aug 26 10:19:02 user nova-compute[73572]:     </controller>
Aug 26 10:19:02 user nova-compute[73572]:     <controller type='ide' index='0'>
Aug 26 10:19:02 user nova-compute[73572]:       <alias name='ide'/>
Aug 26 10:19:02 user nova-compute[73572]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 26 10:19:02 user nova-compute[73572]:     </controller>
Aug 26 10:19:02 user nova-compute[73572]:     <interface type='ethernet'>
Aug 26 10:19:02 user nova-compute[73572]:       <mac address='fa:16:3e:ad:63:c3'/>
Aug 26 10:19:02 user nova-compute[73572]:       <target dev='tap3c5d5d20-da'/>
Aug 26 10:19:02 user nova-compute[73572]:       <model type='virtio'/>
Aug 26 10:19:02 user nova-compute[73572]:       <mtu size='1442'/>
Aug 26 10:19:02 user nova-compute[73572]:       <alias name='net0'/>
Aug 26 10:19:02 user nova-compute[73572]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 26 10:19:02 user nova-compute[73572]:     </interface>
Aug 26 10:19:02 user nova-compute[73572]:     <serial type='pty'>
Aug 26 10:19:02 user nova-compute[73572]:       <source path='/dev/pts/11'/>
Aug 26 10:19:02 user nova-compute[73572]:       <log file='/opt/stack/data/nova/instances/0dceaa35-4a13-453b-961f-831f66c35af0/console.log' append='off'/>
Aug 26 10:19:02 user nova-compute[73572]:       <target type='isa-serial' port='0'>
Aug 26 10:19:02 user nova-compute[73572]:         <model name='isa-serial'/>
Aug 26 10:19:02 user nova-compute[73572]:       </target>
Aug 26 10:19:02 user nova-compute[73572]:       <alias name='serial0'/>
Aug 26 10:19:02 user nova-compute[73572]:     </serial>
Aug 26 10:19:02 user nova-compute[73572]:     <console type='pty' tty='/dev/pts/11'>
Aug 26 10:19:02 user nova-compute[73572]:       <source path='/dev/pts/11'/>
Aug 26 10:19:02 user nova-compute[73572]:       <log file='/opt/stack/data/nova/instances/0dceaa35-4a13-453b-961f-831f66c35af0/console.log' append='off'/>
Aug 26 10:19:02 user nova-compute[73572]:       <target type='serial' port='0'/>
Aug 26 10:19:02 user nova-compute[73572]:       <alias name='serial0'/>
Aug 26 10:19:02 user nova-compute[73572]:     </console>
Aug 26 10:19:02 user nova-compute[73572]:     <input type='mouse' bus='ps2'>
Aug 26 10:19:02 user nova-compute[73572]:       <alias name='input0'/>
Aug 26 10:19:02 user nova-compute[73572]:     </input>
Aug 26 10:19:02 user nova-compute[73572]:     <input type='keyboard' bus='ps2'>
Aug 26 10:19:02 user nova-compute[73572]:       <alias name='input1'/>
Aug 26 10:19:02 user nova-compute[73572]:     </input>
Aug 26 10:19:02 user nova-compute[73572]:     <graphics type='vnc' port='5911' autoport='yes' listen='0.0.0.0'>
Aug 26 10:19:02 user nova-compute[73572]:       <listen type='address' address='0.0.0.0'/>
Aug 26 10:19:02 user nova-compute[73572]:     </graphics>
Aug 26 10:19:02 user nova-compute[73572]:     <audio id='1' type='none'/>
Aug 26 10:19:02 user nova-compute[73572]:     <video>
Aug 26 10:19:02 user nova-compute[73572]:       <model type='virtio' heads='1' primary='yes'/>
Aug 26 10:19:02 user nova-compute[73572]:       <alias name='video0'/>
Aug 26 10:19:02 user nova-compute[73572]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 26 10:19:02 user nova-compute[73572]:     </video>
Aug 26 10:19:02 user nova-compute[73572]:     <memballoon model='virtio'>
Aug 26 10:19:02 user nova-compute[73572]:       <stats period='10'/>
Aug 26 10:19:02 user nova-compute[73572]:       <alias name='balloon0'/>
Aug 26 10:19:02 user nova-compute[73572]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 26 10:19:02 user nova-compute[73572]:     </memballoon>
Aug 26 10:19:02 user nova-compute[73572]:     <rng model='virtio'>
Aug 26 10:19:02 user nova-compute[73572]:       <backend model='random'>/dev/urandom</backend>
Aug 26 10:19:02 user nova-compute[73572]:       <alias name='rng0'/>
Aug 26 10:19:02 user nova-compute[73572]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 26 10:19:02 user nova-compute[73572]:     </rng>
Aug 26 10:19:02 user nova-compute[73572]:   </devices>
Aug 26 10:19:02 user nova-compute[73572]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 26 10:19:02 user nova-compute[73572]:     <label>libvirt-0dceaa35-4a13-453b-961f-831f66c35af0</label>
Aug 26 10:19:02 user nova-compute[73572]:     <imagelabel>libvirt-0dceaa35-4a13-453b-961f-831f66c35af0</imagelabel>
Aug 26 10:19:02 user nova-compute[73572]:   </seclabel>
Aug 26 10:19:02 user nova-compute[73572]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 26 10:19:02 user nova-compute[73572]:     <label>+64055:+108</label>
Aug 26 10:19:02 user nova-compute[73572]:     <imagelabel>+64055:+108</imagelabel>
Aug 26 10:19:02 user nova-compute[73572]:   </seclabel>
Aug 26 10:19:02 user nova-compute[73572]: </domain>
Aug 26 10:19:02 user nova-compute[73572]:  {{(pid=73572) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 26 10:19:02 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-86290aa6-aa45-47b4-876f-b37b8e607e96 tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] Successfully detached device tap953f6a62-54 from instance 0dceaa35-4a13-453b-961f-831f66c35af0 from the live domain config.
Aug 26 10:19:02 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-86290aa6-aa45-47b4-876f-b37b8e607e96 tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T10:16:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1180989107',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1180989107',id=20,image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCoQLfbNOsScPlPdH7TTAWBoUTtprP7Wt9D2iobB5TEO7soZAUDBZvsnw8EfneOw36+/lna9tLwlSS51wnghWJumalBKBT2droQjZV+qAgp3BnIGzzIB2rwkhacN2zLmGg==',key_name='tempest-keypair-1046141656',keypairs=<?>,launch_index=0,launched_at=2023-08-26T10:16:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6d2915087eb04830831062675024f835',ramdisk_id='',reservation_id='r-untu6l5l',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1639980618',owner_user_name='tempest-TaggedAttachmentsTest-1639980618-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T10:16:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5ff395781b5f403fa56cada31e168817',uuid=0dceaa35-4a13-453b-961f-831f66c35af0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "953f6a62-54f7-40f2-8bde-2639ab34c351", "address": "fa:16:3e:de:2b:93", "network": {"id": "4562dd45-7d3c-4cca-b97c-a3114383641b", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1852107155", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.28", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "6d2915087eb04830831062675024f835", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap953f6a62-54", "ovs_interfaceid": "953f6a62-54f7-40f2-8bde-2639ab34c351", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 10:19:02 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-86290aa6-aa45-47b4-876f-b37b8e607e96 tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] Converting VIF {"id": "953f6a62-54f7-40f2-8bde-2639ab34c351", "address": "fa:16:3e:de:2b:93", "network": {"id": "4562dd45-7d3c-4cca-b97c-a3114383641b", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1852107155", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.28", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "6d2915087eb04830831062675024f835", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap953f6a62-54", "ovs_interfaceid": "953f6a62-54f7-40f2-8bde-2639ab34c351", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:19:02 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-86290aa6-aa45-47b4-876f-b37b8e607e96 tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:2b:93,bridge_name='br-int',has_traffic_filtering=True,id=953f6a62-54f7-40f2-8bde-2639ab34c351,network=Network(4562dd45-7d3c-4cca-b97c-a3114383641b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap953f6a62-54') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:19:02 user nova-compute[73572]: DEBUG os_vif [None req-86290aa6-aa45-47b4-876f-b37b8e607e96 tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:2b:93,bridge_name='br-int',has_traffic_filtering=True,id=953f6a62-54f7-40f2-8bde-2639ab34c351,network=Network(4562dd45-7d3c-4cca-b97c-a3114383641b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap953f6a62-54') {{(pid=73572) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 10:19:02 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:19:02 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap953f6a62-54, bridge=br-int, if_exists=True) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:19:02 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:19:02 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:19:02 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:19:02 user nova-compute[73572]: INFO os_vif [None req-86290aa6-aa45-47b4-876f-b37b8e607e96 tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:2b:93,bridge_name='br-int',has_traffic_filtering=True,id=953f6a62-54f7-40f2-8bde-2639ab34c351,network=Network(4562dd45-7d3c-4cca-b97c-a3114383641b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap953f6a62-54')
Aug 26 10:19:02 user nova-compute[73572]: DEBUG nova.virt.libvirt.guest [None req-86290aa6-aa45-47b4-876f-b37b8e607e96 tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 10:19:02 user nova-compute[73572]:   <nova:package version="0.0.0"/>
Aug 26 10:19:02 user nova-compute[73572]:   <nova:name>tempest-device-tagging-server-1180989107</nova:name>
Aug 26 10:19:02 user nova-compute[73572]:   <nova:creationTime>2023-08-26 10:19:02</nova:creationTime>
Aug 26 10:19:02 user nova-compute[73572]:   <nova:flavor name="m1.tiny">
Aug 26 10:19:02 user nova-compute[73572]:     <nova:memory>512</nova:memory>
Aug 26 10:19:02 user nova-compute[73572]:     <nova:disk>1</nova:disk>
Aug 26 10:19:02 user nova-compute[73572]:     <nova:swap>0</nova:swap>
Aug 26 10:19:02 user nova-compute[73572]:     <nova:ephemeral>0</nova:ephemeral>
Aug 26 10:19:02 user nova-compute[73572]:     <nova:vcpus>1</nova:vcpus>
Aug 26 10:19:02 user nova-compute[73572]:   </nova:flavor>
Aug 26 10:19:02 user nova-compute[73572]:   <nova:owner>
Aug 26 10:19:02 user nova-compute[73572]:     <nova:user uuid="5ff395781b5f403fa56cada31e168817">tempest-TaggedAttachmentsTest-1639980618-project-member</nova:user>
Aug 26 10:19:02 user nova-compute[73572]:     <nova:project uuid="6d2915087eb04830831062675024f835">tempest-TaggedAttachmentsTest-1639980618</nova:project>
Aug 26 10:19:02 user nova-compute[73572]:   </nova:owner>
Aug 26 10:19:02 user nova-compute[73572]:   <nova:root type="image" uuid="299da0c9-e1c4-48f0-be55-fbe20dd06bc9"/>
Aug 26 10:19:02 user nova-compute[73572]:   <nova:ports>
Aug 26 10:19:02 user nova-compute[73572]:     <nova:port uuid="3c5d5d20-da80-4401-b027-3c4b0df169c6">
Aug 26 10:19:02 user nova-compute[73572]:       <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 26 10:19:02 user nova-compute[73572]:     </nova:port>
Aug 26 10:19:02 user nova-compute[73572]:   </nova:ports>
Aug 26 10:19:02 user nova-compute[73572]: </nova:instance>
Aug 26 10:19:02 user nova-compute[73572]:  {{(pid=73572) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Aug 26 10:19:02 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:19:02 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:19:02 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:19:02 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:19:02 user nova-compute[73572]: DEBUG nova.virt.driver [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Emitting event <LifecycleEvent: 1693045142.451128, c901bbcc-3d82-4550-888f-bdbb36ba052d => Resumed> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:19:02 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: c901bbcc-3d82-4550-888f-bdbb36ba052d] VM Resumed (Lifecycle Event)
Aug 26 10:19:02 user nova-compute[73572]: DEBUG nova.compute.manager [None req-83111095-563d-47ed-97f7-690e26ce43c9 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] [instance: c901bbcc-3d82-4550-888f-bdbb36ba052d] Instance event wait completed in 0 seconds for  {{(pid=73572) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 10:19:02 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-83111095-563d-47ed-97f7-690e26ce43c9 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] [instance: c901bbcc-3d82-4550-888f-bdbb36ba052d] Guest created on hypervisor {{(pid=73572) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 10:19:02 user nova-compute[73572]: INFO nova.virt.libvirt.driver [-] [instance: c901bbcc-3d82-4550-888f-bdbb36ba052d] Instance spawned successfully.
Aug 26 10:19:02 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-83111095-563d-47ed-97f7-690e26ce43c9 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] [instance: c901bbcc-3d82-4550-888f-bdbb36ba052d] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 10:19:02 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-83111095-563d-47ed-97f7-690e26ce43c9 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] [instance: c901bbcc-3d82-4550-888f-bdbb36ba052d] Found default for hw_input_bus of None {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:19:02 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-83111095-563d-47ed-97f7-690e26ce43c9 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] [instance: c901bbcc-3d82-4550-888f-bdbb36ba052d] Found default for hw_pointer_model of None {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:19:02 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: c901bbcc-3d82-4550-888f-bdbb36ba052d] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:19:02 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:19:02 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: c901bbcc-3d82-4550-888f-bdbb36ba052d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73572) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 10:19:02 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:19:02 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:19:02 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: c901bbcc-3d82-4550-888f-bdbb36ba052d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 10:19:02 user nova-compute[73572]: DEBUG nova.virt.driver [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Emitting event <LifecycleEvent: 1693045142.4667003, c901bbcc-3d82-4550-888f-bdbb36ba052d => Started> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:19:02 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: c901bbcc-3d82-4550-888f-bdbb36ba052d] VM Started (Lifecycle Event)
Aug 26 10:19:02 user nova-compute[73572]: INFO nova.compute.manager [None req-83111095-563d-47ed-97f7-690e26ce43c9 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] [instance: c901bbcc-3d82-4550-888f-bdbb36ba052d] Took 12.02 seconds to spawn the instance on the hypervisor.
Aug 26 10:19:02 user nova-compute[73572]: DEBUG nova.compute.manager [None req-83111095-563d-47ed-97f7-690e26ce43c9 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] [instance: c901bbcc-3d82-4550-888f-bdbb36ba052d] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:19:02 user nova-compute[73572]: DEBUG nova.compute.manager [req-5111c764-8da9-4a24-8103-83349ee7432c req-4d39fd10-7290-4dc8-b752-a0c8a13f5fe6 service nova] [instance: 0dceaa35-4a13-453b-961f-831f66c35af0] Received event network-vif-unplugged-953f6a62-54f7-40f2-8bde-2639ab34c351 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:19:02 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-5111c764-8da9-4a24-8103-83349ee7432c req-4d39fd10-7290-4dc8-b752-a0c8a13f5fe6 service nova] Acquiring lock "0dceaa35-4a13-453b-961f-831f66c35af0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:19:02 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-5111c764-8da9-4a24-8103-83349ee7432c req-4d39fd10-7290-4dc8-b752-a0c8a13f5fe6 service nova] Lock "0dceaa35-4a13-453b-961f-831f66c35af0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:19:02 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-5111c764-8da9-4a24-8103-83349ee7432c req-4d39fd10-7290-4dc8-b752-a0c8a13f5fe6 service nova] Lock "0dceaa35-4a13-453b-961f-831f66c35af0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:19:02 user nova-compute[73572]: DEBUG nova.compute.manager [req-5111c764-8da9-4a24-8103-83349ee7432c req-4d39fd10-7290-4dc8-b752-a0c8a13f5fe6 service nova] [instance: 0dceaa35-4a13-453b-961f-831f66c35af0] No waiting events found dispatching network-vif-unplugged-953f6a62-54f7-40f2-8bde-2639ab34c351 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:19:02 user nova-compute[73572]: WARNING nova.compute.manager [req-5111c764-8da9-4a24-8103-83349ee7432c req-4d39fd10-7290-4dc8-b752-a0c8a13f5fe6 service nova] [instance: 0dceaa35-4a13-453b-961f-831f66c35af0] Received unexpected event network-vif-unplugged-953f6a62-54f7-40f2-8bde-2639ab34c351 for instance with vm_state active and task_state None.
Aug 26 10:19:02 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: c901bbcc-3d82-4550-888f-bdbb36ba052d] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:19:02 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: c901bbcc-3d82-4550-888f-bdbb36ba052d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73572) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 10:19:02 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: c901bbcc-3d82-4550-888f-bdbb36ba052d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 10:19:02 user nova-compute[73572]: INFO nova.compute.manager [None req-83111095-563d-47ed-97f7-690e26ce43c9 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] [instance: c901bbcc-3d82-4550-888f-bdbb36ba052d] Took 13.00 seconds to build instance.
Aug 26 10:19:02 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-83111095-563d-47ed-97f7-690e26ce43c9 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Lock "c901bbcc-3d82-4550-888f-bdbb36ba052d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.119s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:19:03 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-86290aa6-aa45-47b4-876f-b37b8e607e96 tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] Acquiring lock "refresh_cache-0dceaa35-4a13-453b-961f-831f66c35af0" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:19:03 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-86290aa6-aa45-47b4-876f-b37b8e607e96 tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] Acquired lock "refresh_cache-0dceaa35-4a13-453b-961f-831f66c35af0" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:19:03 user nova-compute[73572]: DEBUG nova.network.neutron [None req-86290aa6-aa45-47b4-876f-b37b8e607e96 tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] [instance: 0dceaa35-4a13-453b-961f-831f66c35af0] Building network info cache for instance {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 10:19:03 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:19:03 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Removed pending event for 14fab12e-52be-4fe6-8777-bc7ebf3c25f1 due to event {{(pid=73572) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 26 10:19:03 user nova-compute[73572]: DEBUG nova.virt.driver [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Emitting event <LifecycleEvent: 1693045143.9429402, 14fab12e-52be-4fe6-8777-bc7ebf3c25f1 => Resumed> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:19:03 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 14fab12e-52be-4fe6-8777-bc7ebf3c25f1] VM Resumed (Lifecycle Event)
Aug 26 10:19:03 user nova-compute[73572]: DEBUG nova.compute.manager [None req-16dbe192-bfcb-4a13-b430-aa57bc46c6c2 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: 14fab12e-52be-4fe6-8777-bc7ebf3c25f1] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:19:03 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 14fab12e-52be-4fe6-8777-bc7ebf3c25f1] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:19:03 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 14fab12e-52be-4fe6-8777-bc7ebf3c25f1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73572) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 10:19:04 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 14fab12e-52be-4fe6-8777-bc7ebf3c25f1] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 26 10:19:04 user nova-compute[73572]: DEBUG nova.virt.driver [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Emitting event <LifecycleEvent: 1693045143.9465773, 14fab12e-52be-4fe6-8777-bc7ebf3c25f1 => Started> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:19:04 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 14fab12e-52be-4fe6-8777-bc7ebf3c25f1] VM Started (Lifecycle Event)
Aug 26 10:19:04 user nova-compute[73572]: DEBUG nova.compute.manager [req-28252cea-aceb-48ea-8a5e-c4233776c1b7 req-f74adbb3-5cdb-458e-970d-19f2721f5f31 service nova] [instance: 682138af-ba6a-47f1-a9a5-03ae2661f54d] Received event network-vif-plugged-72fe24f4-00e3-40f1-a44a-014c7669e862 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:19:04 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-28252cea-aceb-48ea-8a5e-c4233776c1b7 req-f74adbb3-5cdb-458e-970d-19f2721f5f31 service nova] Acquiring lock "682138af-ba6a-47f1-a9a5-03ae2661f54d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:19:04 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-28252cea-aceb-48ea-8a5e-c4233776c1b7 req-f74adbb3-5cdb-458e-970d-19f2721f5f31 service nova] Lock "682138af-ba6a-47f1-a9a5-03ae2661f54d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:19:04 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-28252cea-aceb-48ea-8a5e-c4233776c1b7 req-f74adbb3-5cdb-458e-970d-19f2721f5f31 service nova] Lock "682138af-ba6a-47f1-a9a5-03ae2661f54d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:19:04 user nova-compute[73572]: DEBUG nova.compute.manager [req-28252cea-aceb-48ea-8a5e-c4233776c1b7 req-f74adbb3-5cdb-458e-970d-19f2721f5f31 service nova] [instance: 682138af-ba6a-47f1-a9a5-03ae2661f54d] No waiting events found dispatching network-vif-plugged-72fe24f4-00e3-40f1-a44a-014c7669e862 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:19:04 user nova-compute[73572]: WARNING nova.compute.manager [req-28252cea-aceb-48ea-8a5e-c4233776c1b7 req-f74adbb3-5cdb-458e-970d-19f2721f5f31 service nova] [instance: 682138af-ba6a-47f1-a9a5-03ae2661f54d] Received unexpected event network-vif-plugged-72fe24f4-00e3-40f1-a44a-014c7669e862 for instance with vm_state active and task_state reboot_started_hard.
Aug 26 10:19:04 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 14fab12e-52be-4fe6-8777-bc7ebf3c25f1] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:19:04 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 14fab12e-52be-4fe6-8777-bc7ebf3c25f1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73572) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 10:19:04 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Removed pending event for 682138af-ba6a-47f1-a9a5-03ae2661f54d due to event {{(pid=73572) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 26 10:19:04 user nova-compute[73572]: DEBUG nova.virt.driver [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Emitting event <LifecycleEvent: 1693045144.559607, 682138af-ba6a-47f1-a9a5-03ae2661f54d => Resumed> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:19:04 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 682138af-ba6a-47f1-a9a5-03ae2661f54d] VM Resumed (Lifecycle Event)
Aug 26 10:19:04 user nova-compute[73572]: DEBUG nova.compute.manager [None req-d503d012-2881-4c7c-b32f-8722d864d182 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] [instance: 682138af-ba6a-47f1-a9a5-03ae2661f54d] Instance event wait completed in 0 seconds for  {{(pid=73572) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 10:19:04 user nova-compute[73572]: INFO nova.virt.libvirt.driver [-] [instance: 682138af-ba6a-47f1-a9a5-03ae2661f54d] Instance rebooted successfully.
Aug 26 10:19:04 user nova-compute[73572]: DEBUG nova.compute.manager [None req-d503d012-2881-4c7c-b32f-8722d864d182 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] [instance: 682138af-ba6a-47f1-a9a5-03ae2661f54d] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:19:04 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 682138af-ba6a-47f1-a9a5-03ae2661f54d] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:19:04 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:19:04 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 682138af-ba6a-47f1-a9a5-03ae2661f54d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=73572) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 10:19:04 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 682138af-ba6a-47f1-a9a5-03ae2661f54d] During sync_power_state the instance has a pending task (reboot_started_hard). Skip.
Aug 26 10:19:04 user nova-compute[73572]: DEBUG nova.virt.driver [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Emitting event <LifecycleEvent: 1693045144.559771, 682138af-ba6a-47f1-a9a5-03ae2661f54d => Started> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:19:04 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 682138af-ba6a-47f1-a9a5-03ae2661f54d] VM Started (Lifecycle Event)
Aug 26 10:19:04 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 682138af-ba6a-47f1-a9a5-03ae2661f54d] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:19:04 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 682138af-ba6a-47f1-a9a5-03ae2661f54d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=73572) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 10:19:04 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-d503d012-2881-4c7c-b32f-8722d864d182 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Lock "682138af-ba6a-47f1-a9a5-03ae2661f54d" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 11.364s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:19:04 user nova-compute[73572]: DEBUG nova.compute.manager [req-77fa0fad-101a-4f64-8c35-277b3dbcc58f req-3e86fb0e-0d99-4d79-8ef7-8b8fb4693899 service nova] [instance: 0dceaa35-4a13-453b-961f-831f66c35af0] Received event network-vif-plugged-953f6a62-54f7-40f2-8bde-2639ab34c351 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:19:04 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-77fa0fad-101a-4f64-8c35-277b3dbcc58f req-3e86fb0e-0d99-4d79-8ef7-8b8fb4693899 service nova] Acquiring lock "0dceaa35-4a13-453b-961f-831f66c35af0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:19:04 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-77fa0fad-101a-4f64-8c35-277b3dbcc58f req-3e86fb0e-0d99-4d79-8ef7-8b8fb4693899 service nova] Lock "0dceaa35-4a13-453b-961f-831f66c35af0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:19:04 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-77fa0fad-101a-4f64-8c35-277b3dbcc58f req-3e86fb0e-0d99-4d79-8ef7-8b8fb4693899 service nova] Lock "0dceaa35-4a13-453b-961f-831f66c35af0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:19:04 user nova-compute[73572]: DEBUG nova.compute.manager [req-77fa0fad-101a-4f64-8c35-277b3dbcc58f req-3e86fb0e-0d99-4d79-8ef7-8b8fb4693899 service nova] [instance: 0dceaa35-4a13-453b-961f-831f66c35af0] No waiting events found dispatching network-vif-plugged-953f6a62-54f7-40f2-8bde-2639ab34c351 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:19:04 user nova-compute[73572]: WARNING nova.compute.manager [req-77fa0fad-101a-4f64-8c35-277b3dbcc58f req-3e86fb0e-0d99-4d79-8ef7-8b8fb4693899 service nova] [instance: 0dceaa35-4a13-453b-961f-831f66c35af0] Received unexpected event network-vif-plugged-953f6a62-54f7-40f2-8bde-2639ab34c351 for instance with vm_state active and task_state None.
Aug 26 10:19:04 user nova-compute[73572]: DEBUG nova.compute.manager [req-77fa0fad-101a-4f64-8c35-277b3dbcc58f req-3e86fb0e-0d99-4d79-8ef7-8b8fb4693899 service nova] [instance: 0dceaa35-4a13-453b-961f-831f66c35af0] Received event network-vif-deleted-953f6a62-54f7-40f2-8bde-2639ab34c351 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:19:04 user nova-compute[73572]: INFO nova.compute.manager [req-77fa0fad-101a-4f64-8c35-277b3dbcc58f req-3e86fb0e-0d99-4d79-8ef7-8b8fb4693899 service nova] [instance: 0dceaa35-4a13-453b-961f-831f66c35af0] Neutron deleted interface 953f6a62-54f7-40f2-8bde-2639ab34c351; detaching it from the instance and deleting it from the info cache
Aug 26 10:19:04 user nova-compute[73572]: DEBUG nova.network.neutron [req-77fa0fad-101a-4f64-8c35-277b3dbcc58f req-3e86fb0e-0d99-4d79-8ef7-8b8fb4693899 service nova] [instance: 0dceaa35-4a13-453b-961f-831f66c35af0] Updating instance_info_cache with network_info: [{"id": "3c5d5d20-da80-4401-b027-3c4b0df169c6", "address": "fa:16:3e:ad:63:c3", "network": {"id": "92949b0a-01f9-413c-9f96-a25b9b648f84", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-167588816-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d2915087eb04830831062675024f835", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c5d5d20-da", "ovs_interfaceid": "3c5d5d20-da80-4401-b027-3c4b0df169c6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:19:04 user nova-compute[73572]: DEBUG nova.objects.instance [req-77fa0fad-101a-4f64-8c35-277b3dbcc58f req-3e86fb0e-0d99-4d79-8ef7-8b8fb4693899 service nova] Lazy-loading 'system_metadata' on Instance uuid 0dceaa35-4a13-453b-961f-831f66c35af0 {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:19:04 user nova-compute[73572]: DEBUG nova.objects.instance [req-77fa0fad-101a-4f64-8c35-277b3dbcc58f req-3e86fb0e-0d99-4d79-8ef7-8b8fb4693899 service nova] Lazy-loading 'flavor' on Instance uuid 0dceaa35-4a13-453b-961f-831f66c35af0 {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:19:04 user nova-compute[73572]: DEBUG nova.objects.base [req-77fa0fad-101a-4f64-8c35-277b3dbcc58f req-3e86fb0e-0d99-4d79-8ef7-8b8fb4693899 service nova] Object Instance<0dceaa35-4a13-453b-961f-831f66c35af0> lazy-loaded attributes: system_metadata,flavor {{(pid=73572) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 10:19:04 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [req-77fa0fad-101a-4f64-8c35-277b3dbcc58f req-3e86fb0e-0d99-4d79-8ef7-8b8fb4693899 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T10:16:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1180989107',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1180989107',id=20,image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCoQLfbNOsScPlPdH7TTAWBoUTtprP7Wt9D2iobB5TEO7soZAUDBZvsnw8EfneOw36+/lna9tLwlSS51wnghWJumalBKBT2droQjZV+qAgp3BnIGzzIB2rwkhacN2zLmGg==',key_name='tempest-keypair-1046141656',keypairs=<?>,launch_index=0,launched_at=2023-08-26T10:16:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6d2915087eb04830831062675024f835',ramdisk_id='',reservation_id='r-untu6l5l',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1639980618',owner_user_name='tempest-TaggedAttachmentsTest-1639980618-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T10:16:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5ff395781b5f403fa56cada31e168817',uuid=0dceaa35-4a13-453b-961f-831f66c35af0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "953f6a62-54f7-40f2-8bde-2639ab34c351", "address": "fa:16:3e:de:2b:93", "network": {"id": "4562dd45-7d3c-4cca-b97c-a3114383641b", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1852107155", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.28", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "6d2915087eb04830831062675024f835", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap953f6a62-54", "ovs_interfaceid": "953f6a62-54f7-40f2-8bde-2639ab34c351", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73572) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 10:19:04 user nova-compute[73572]: DEBUG nova.network.os_vif_util [req-77fa0fad-101a-4f64-8c35-277b3dbcc58f req-3e86fb0e-0d99-4d79-8ef7-8b8fb4693899 service nova] Converting VIF {"id": "953f6a62-54f7-40f2-8bde-2639ab34c351", "address": "fa:16:3e:de:2b:93", "network": {"id": "4562dd45-7d3c-4cca-b97c-a3114383641b", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1852107155", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.28", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "6d2915087eb04830831062675024f835", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap953f6a62-54", "ovs_interfaceid": "953f6a62-54f7-40f2-8bde-2639ab34c351", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:19:04 user nova-compute[73572]: DEBUG nova.network.os_vif_util [req-77fa0fad-101a-4f64-8c35-277b3dbcc58f req-3e86fb0e-0d99-4d79-8ef7-8b8fb4693899 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:2b:93,bridge_name='br-int',has_traffic_filtering=True,id=953f6a62-54f7-40f2-8bde-2639ab34c351,network=Network(4562dd45-7d3c-4cca-b97c-a3114383641b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap953f6a62-54') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:19:04 user nova-compute[73572]: INFO nova.network.neutron [None req-86290aa6-aa45-47b4-876f-b37b8e607e96 tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] [instance: 0dceaa35-4a13-453b-961f-831f66c35af0] Port 953f6a62-54f7-40f2-8bde-2639ab34c351 from network info_cache is no longer associated with instance in Neutron. Removing from network info_cache.
Aug 26 10:19:04 user nova-compute[73572]: DEBUG nova.network.neutron [None req-86290aa6-aa45-47b4-876f-b37b8e607e96 tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] [instance: 0dceaa35-4a13-453b-961f-831f66c35af0] Updating instance_info_cache with network_info: [{"id": "3c5d5d20-da80-4401-b027-3c4b0df169c6", "address": "fa:16:3e:ad:63:c3", "network": {"id": "92949b0a-01f9-413c-9f96-a25b9b648f84", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-167588816-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d2915087eb04830831062675024f835", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c5d5d20-da", "ovs_interfaceid": "3c5d5d20-da80-4401-b027-3c4b0df169c6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:19:04 user nova-compute[73572]: DEBUG nova.virt.libvirt.guest [req-77fa0fad-101a-4f64-8c35-277b3dbcc58f req-3e86fb0e-0d99-4d79-8ef7-8b8fb4693899 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:de:2b:93"/><model type="virtio"/><mtu size="1442"/><target dev="tap953f6a62-54"/></interface> {{(pid=73572) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 26 10:19:04 user nova-compute[73572]: DEBUG nova.virt.libvirt.guest [req-77fa0fad-101a-4f64-8c35-277b3dbcc58f req-3e86fb0e-0d99-4d79-8ef7-8b8fb4693899 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:de:2b:93"/><model type="virtio"/><mtu size="1442"/><target dev="tap953f6a62-54"/></interface>not found in domain: <domain type='kvm' id='21'>
Aug 26 10:19:04 user nova-compute[73572]:   <name>instance-00000014</name>
Aug 26 10:19:04 user nova-compute[73572]:   <uuid>0dceaa35-4a13-453b-961f-831f66c35af0</uuid>
Aug 26 10:19:04 user nova-compute[73572]:   <metadata>
Aug 26 10:19:04 user nova-compute[73572]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 10:19:04 user nova-compute[73572]:   <nova:package version="0.0.0"/>
Aug 26 10:19:04 user nova-compute[73572]:   <nova:name>tempest-device-tagging-server-1180989107</nova:name>
Aug 26 10:19:04 user nova-compute[73572]:   <nova:creationTime>2023-08-26 10:19:02</nova:creationTime>
Aug 26 10:19:04 user nova-compute[73572]:   <nova:flavor name="m1.tiny">
Aug 26 10:19:04 user nova-compute[73572]:     <nova:memory>512</nova:memory>
Aug 26 10:19:04 user nova-compute[73572]:     <nova:disk>1</nova:disk>
Aug 26 10:19:04 user nova-compute[73572]:     <nova:swap>0</nova:swap>
Aug 26 10:19:04 user nova-compute[73572]:     <nova:ephemeral>0</nova:ephemeral>
Aug 26 10:19:04 user nova-compute[73572]:     <nova:vcpus>1</nova:vcpus>
Aug 26 10:19:04 user nova-compute[73572]:   </nova:flavor>
Aug 26 10:19:04 user nova-compute[73572]:   <nova:owner>
Aug 26 10:19:04 user nova-compute[73572]:     <nova:user uuid="5ff395781b5f403fa56cada31e168817">tempest-TaggedAttachmentsTest-1639980618-project-member</nova:user>
Aug 26 10:19:04 user nova-compute[73572]:     <nova:project uuid="6d2915087eb04830831062675024f835">tempest-TaggedAttachmentsTest-1639980618</nova:project>
Aug 26 10:19:04 user nova-compute[73572]:   </nova:owner>
Aug 26 10:19:04 user nova-compute[73572]:   <nova:root type="image" uuid="299da0c9-e1c4-48f0-be55-fbe20dd06bc9"/>
Aug 26 10:19:04 user nova-compute[73572]:   <nova:ports>
Aug 26 10:19:04 user nova-compute[73572]:     <nova:port uuid="3c5d5d20-da80-4401-b027-3c4b0df169c6">
Aug 26 10:19:04 user nova-compute[73572]:       <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 26 10:19:04 user nova-compute[73572]:     </nova:port>
Aug 26 10:19:04 user nova-compute[73572]:   </nova:ports>
Aug 26 10:19:04 user nova-compute[73572]: </nova:instance>
Aug 26 10:19:04 user nova-compute[73572]:   </metadata>
Aug 26 10:19:04 user nova-compute[73572]:   <memory unit='KiB'>524288</memory>
Aug 26 10:19:04 user nova-compute[73572]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 26 10:19:04 user nova-compute[73572]:   <vcpu placement='static'>1</vcpu>
Aug 26 10:19:04 user nova-compute[73572]:   <resource>
Aug 26 10:19:04 user nova-compute[73572]:     <partition>/machine</partition>
Aug 26 10:19:04 user nova-compute[73572]:   </resource>
Aug 26 10:19:04 user nova-compute[73572]:   <sysinfo type='smbios'>
Aug 26 10:19:04 user nova-compute[73572]:     <system>
Aug 26 10:19:04 user nova-compute[73572]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 26 10:19:04 user nova-compute[73572]:       <entry name='product'>OpenStack Nova</entry>
Aug 26 10:19:04 user nova-compute[73572]:       <entry name='version'>0.0.0</entry>
Aug 26 10:19:04 user nova-compute[73572]:       <entry name='serial'>0dceaa35-4a13-453b-961f-831f66c35af0</entry>
Aug 26 10:19:04 user nova-compute[73572]:       <entry name='uuid'>0dceaa35-4a13-453b-961f-831f66c35af0</entry>
Aug 26 10:19:04 user nova-compute[73572]:       <entry name='family'>Virtual Machine</entry>
Aug 26 10:19:04 user nova-compute[73572]:     </system>
Aug 26 10:19:04 user nova-compute[73572]:   </sysinfo>
Aug 26 10:19:04 user nova-compute[73572]:   <os>
Aug 26 10:19:04 user nova-compute[73572]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 26 10:19:04 user nova-compute[73572]:     <boot dev='hd'/>
Aug 26 10:19:04 user nova-compute[73572]:     <smbios mode='sysinfo'/>
Aug 26 10:19:04 user nova-compute[73572]:   </os>
Aug 26 10:19:04 user nova-compute[73572]:   <features>
Aug 26 10:19:04 user nova-compute[73572]:     <acpi/>
Aug 26 10:19:04 user nova-compute[73572]:     <apic/>
Aug 26 10:19:04 user nova-compute[73572]:     <vmcoreinfo state='on'/>
Aug 26 10:19:04 user nova-compute[73572]:   </features>
Aug 26 10:19:04 user nova-compute[73572]:   <cpu mode='custom' match='exact' check='full'>
Aug 26 10:19:04 user nova-compute[73572]:     <model fallback='forbid'>Nehalem</model>
Aug 26 10:19:04 user nova-compute[73572]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 26 10:19:04 user nova-compute[73572]:     <feature policy='require' name='vme'/>
Aug 26 10:19:04 user nova-compute[73572]:     <feature policy='require' name='x2apic'/>
Aug 26 10:19:04 user nova-compute[73572]:     <feature policy='require' name='hypervisor'/>
Aug 26 10:19:04 user nova-compute[73572]:   </cpu>
Aug 26 10:19:04 user nova-compute[73572]:   <clock offset='utc'>
Aug 26 10:19:04 user nova-compute[73572]:     <timer name='pit' tickpolicy='delay'/>
Aug 26 10:19:04 user nova-compute[73572]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 26 10:19:04 user nova-compute[73572]:     <timer name='hpet' present='no'/>
Aug 26 10:19:04 user nova-compute[73572]:   </clock>
Aug 26 10:19:04 user nova-compute[73572]:   <on_poweroff>destroy</on_poweroff>
Aug 26 10:19:04 user nova-compute[73572]:   <on_reboot>restart</on_reboot>
Aug 26 10:19:04 user nova-compute[73572]:   <on_crash>destroy</on_crash>
Aug 26 10:19:04 user nova-compute[73572]:   <devices>
Aug 26 10:19:04 user nova-compute[73572]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 26 10:19:04 user nova-compute[73572]:     <disk type='file' device='disk'>
Aug 26 10:19:04 user nova-compute[73572]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 26 10:19:04 user nova-compute[73572]:       <source file='/opt/stack/data/nova/instances/0dceaa35-4a13-453b-961f-831f66c35af0/disk' index='2'/>
Aug 26 10:19:04 user nova-compute[73572]:       <backingStore type='file' index='3'>
Aug 26 10:19:04 user nova-compute[73572]:         <format type='raw'/>
Aug 26 10:19:04 user nova-compute[73572]:         <source file='/opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801'/>
Aug 26 10:19:04 user nova-compute[73572]:         <backingStore/>
Aug 26 10:19:04 user nova-compute[73572]:       </backingStore>
Aug 26 10:19:04 user nova-compute[73572]:       <target dev='vda' bus='virtio'/>
Aug 26 10:19:04 user nova-compute[73572]:       <alias name='virtio-disk0'/>
Aug 26 10:19:04 user nova-compute[73572]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 26 10:19:04 user nova-compute[73572]:     </disk>
Aug 26 10:19:04 user nova-compute[73572]:     <disk type='file' device='cdrom'>
Aug 26 10:19:04 user nova-compute[73572]:       <driver name='qemu' type='raw' cache='none'/>
Aug 26 10:19:04 user nova-compute[73572]:       <source file='/opt/stack/data/nova/instances/0dceaa35-4a13-453b-961f-831f66c35af0/disk.config' index='1'/>
Aug 26 10:19:04 user nova-compute[73572]:       <backingStore/>
Aug 26 10:19:04 user nova-compute[73572]:       <target dev='hda' bus='ide'/>
Aug 26 10:19:04 user nova-compute[73572]:       <readonly/>
Aug 26 10:19:04 user nova-compute[73572]:       <alias name='ide0-0-0'/>
Aug 26 10:19:04 user nova-compute[73572]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 26 10:19:04 user nova-compute[73572]:     </disk>
Aug 26 10:19:04 user nova-compute[73572]:     <controller type='usb' index='0' model='none'>
Aug 26 10:19:04 user nova-compute[73572]:       <alias name='usb'/>
Aug 26 10:19:04 user nova-compute[73572]:     </controller>
Aug 26 10:19:04 user nova-compute[73572]:     <controller type='pci' index='0' model='pci-root'>
Aug 26 10:19:04 user nova-compute[73572]:       <alias name='pci.0'/>
Aug 26 10:19:04 user nova-compute[73572]:     </controller>
Aug 26 10:19:04 user nova-compute[73572]:     <controller type='ide' index='0'>
Aug 26 10:19:04 user nova-compute[73572]:       <alias name='ide'/>
Aug 26 10:19:04 user nova-compute[73572]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 26 10:19:04 user nova-compute[73572]:     </controller>
Aug 26 10:19:04 user nova-compute[73572]:     <interface type='ethernet'>
Aug 26 10:19:04 user nova-compute[73572]:       <mac address='fa:16:3e:ad:63:c3'/>
Aug 26 10:19:04 user nova-compute[73572]:       <target dev='tap3c5d5d20-da'/>
Aug 26 10:19:04 user nova-compute[73572]:       <model type='virtio'/>
Aug 26 10:19:04 user nova-compute[73572]:       <mtu size='1442'/>
Aug 26 10:19:04 user nova-compute[73572]:       <alias name='net0'/>
Aug 26 10:19:04 user nova-compute[73572]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 26 10:19:04 user nova-compute[73572]:     </interface>
Aug 26 10:19:04 user nova-compute[73572]:     <serial type='pty'>
Aug 26 10:19:04 user nova-compute[73572]:       <source path='/dev/pts/11'/>
Aug 26 10:19:04 user nova-compute[73572]:       <log file='/opt/stack/data/nova/instances/0dceaa35-4a13-453b-961f-831f66c35af0/console.log' append='off'/>
Aug 26 10:19:04 user nova-compute[73572]:       <target type='isa-serial' port='0'>
Aug 26 10:19:04 user nova-compute[73572]:         <model name='isa-serial'/>
Aug 26 10:19:04 user nova-compute[73572]:       </target>
Aug 26 10:19:04 user nova-compute[73572]:       <alias name='serial0'/>
Aug 26 10:19:04 user nova-compute[73572]:     </serial>
Aug 26 10:19:04 user nova-compute[73572]:     <console type='pty' tty='/dev/pts/11'>
Aug 26 10:19:04 user nova-compute[73572]:       <source path='/dev/pts/11'/>
Aug 26 10:19:04 user nova-compute[73572]:       <log file='/opt/stack/data/nova/instances/0dceaa35-4a13-453b-961f-831f66c35af0/console.log' append='off'/>
Aug 26 10:19:04 user nova-compute[73572]:       <target type='serial' port='0'/>
Aug 26 10:19:04 user nova-compute[73572]:       <alias name='serial0'/>
Aug 26 10:19:04 user nova-compute[73572]:     </console>
Aug 26 10:19:04 user nova-compute[73572]:     <input type='mouse' bus='ps2'>
Aug 26 10:19:04 user nova-compute[73572]:       <alias name='input0'/>
Aug 26 10:19:04 user nova-compute[73572]:     </input>
Aug 26 10:19:04 user nova-compute[73572]:     <input type='keyboard' bus='ps2'>
Aug 26 10:19:04 user nova-compute[73572]:       <alias name='input1'/>
Aug 26 10:19:04 user nova-compute[73572]:     </input>
Aug 26 10:19:04 user nova-compute[73572]:     <graphics type='vnc' port='5911' autoport='yes' listen='0.0.0.0'>
Aug 26 10:19:04 user nova-compute[73572]:       <listen type='address' address='0.0.0.0'/>
Aug 26 10:19:04 user nova-compute[73572]:     </graphics>
Aug 26 10:19:04 user nova-compute[73572]:     <audio id='1' type='none'/>
Aug 26 10:19:04 user nova-compute[73572]:     <video>
Aug 26 10:19:04 user nova-compute[73572]:       <model type='virtio' heads='1' primary='yes'/>
Aug 26 10:19:04 user nova-compute[73572]:       <alias name='video0'/>
Aug 26 10:19:04 user nova-compute[73572]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 26 10:19:04 user nova-compute[73572]:     </video>
Aug 26 10:19:04 user nova-compute[73572]:     <memballoon model='virtio'>
Aug 26 10:19:04 user nova-compute[73572]:       <stats period='10'/>
Aug 26 10:19:04 user nova-compute[73572]:       <alias name='balloon0'/>
Aug 26 10:19:04 user nova-compute[73572]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 26 10:19:04 user nova-compute[73572]:     </memballoon>
Aug 26 10:19:04 user nova-compute[73572]:     <rng model='virtio'>
Aug 26 10:19:04 user nova-compute[73572]:       <backend model='random'>/dev/urandom</backend>
Aug 26 10:19:04 user nova-compute[73572]:       <alias name='rng0'/>
Aug 26 10:19:04 user nova-compute[73572]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 26 10:19:04 user nova-compute[73572]:     </rng>
Aug 26 10:19:04 user nova-compute[73572]:   </devices>
Aug 26 10:19:04 user nova-compute[73572]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 26 10:19:04 user nova-compute[73572]:     <label>libvirt-0dceaa35-4a13-453b-961f-831f66c35af0</label>
Aug 26 10:19:04 user nova-compute[73572]:     <imagelabel>libvirt-0dceaa35-4a13-453b-961f-831f66c35af0</imagelabel>
Aug 26 10:19:04 user nova-compute[73572]:   </seclabel>
Aug 26 10:19:04 user nova-compute[73572]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 26 10:19:04 user nova-compute[73572]:     <label>+64055:+108</label>
Aug 26 10:19:04 user nova-compute[73572]:     <imagelabel>+64055:+108</imagelabel>
Aug 26 10:19:04 user nova-compute[73572]:   </seclabel>
Aug 26 10:19:04 user nova-compute[73572]: </domain>
Aug 26 10:19:04 user nova-compute[73572]:  {{(pid=73572) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 26 10:19:04 user nova-compute[73572]: DEBUG nova.virt.libvirt.guest [req-77fa0fad-101a-4f64-8c35-277b3dbcc58f req-3e86fb0e-0d99-4d79-8ef7-8b8fb4693899 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:de:2b:93"/><model type="virtio"/><mtu size="1442"/><target dev="tap953f6a62-54"/></interface> {{(pid=73572) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 26 10:19:04 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-86290aa6-aa45-47b4-876f-b37b8e607e96 tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] Releasing lock "refresh_cache-0dceaa35-4a13-453b-961f-831f66c35af0" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:19:04 user nova-compute[73572]: DEBUG nova.virt.libvirt.guest [req-77fa0fad-101a-4f64-8c35-277b3dbcc58f req-3e86fb0e-0d99-4d79-8ef7-8b8fb4693899 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:de:2b:93"/><model type="virtio"/><mtu size="1442"/><target dev="tap953f6a62-54"/></interface>not found in domain: <domain type='kvm' id='21'>
Aug 26 10:19:04 user nova-compute[73572]:   <name>instance-00000014</name>
Aug 26 10:19:04 user nova-compute[73572]:   <uuid>0dceaa35-4a13-453b-961f-831f66c35af0</uuid>
Aug 26 10:19:04 user nova-compute[73572]:   <metadata>
Aug 26 10:19:04 user nova-compute[73572]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 10:19:04 user nova-compute[73572]:   <nova:package version="0.0.0"/>
Aug 26 10:19:04 user nova-compute[73572]:   <nova:name>tempest-device-tagging-server-1180989107</nova:name>
Aug 26 10:19:04 user nova-compute[73572]:   <nova:creationTime>2023-08-26 10:19:02</nova:creationTime>
Aug 26 10:19:04 user nova-compute[73572]:   <nova:flavor name="m1.tiny">
Aug 26 10:19:04 user nova-compute[73572]:     <nova:memory>512</nova:memory>
Aug 26 10:19:04 user nova-compute[73572]:     <nova:disk>1</nova:disk>
Aug 26 10:19:04 user nova-compute[73572]:     <nova:swap>0</nova:swap>
Aug 26 10:19:04 user nova-compute[73572]:     <nova:ephemeral>0</nova:ephemeral>
Aug 26 10:19:04 user nova-compute[73572]:     <nova:vcpus>1</nova:vcpus>
Aug 26 10:19:04 user nova-compute[73572]:   </nova:flavor>
Aug 26 10:19:04 user nova-compute[73572]:   <nova:owner>
Aug 26 10:19:04 user nova-compute[73572]:     <nova:user uuid="5ff395781b5f403fa56cada31e168817">tempest-TaggedAttachmentsTest-1639980618-project-member</nova:user>
Aug 26 10:19:04 user nova-compute[73572]:     <nova:project uuid="6d2915087eb04830831062675024f835">tempest-TaggedAttachmentsTest-1639980618</nova:project>
Aug 26 10:19:04 user nova-compute[73572]:   </nova:owner>
Aug 26 10:19:04 user nova-compute[73572]:   <nova:root type="image" uuid="299da0c9-e1c4-48f0-be55-fbe20dd06bc9"/>
Aug 26 10:19:04 user nova-compute[73572]:   <nova:ports>
Aug 26 10:19:04 user nova-compute[73572]:     <nova:port uuid="3c5d5d20-da80-4401-b027-3c4b0df169c6">
Aug 26 10:19:04 user nova-compute[73572]:       <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 26 10:19:04 user nova-compute[73572]:     </nova:port>
Aug 26 10:19:04 user nova-compute[73572]:   </nova:ports>
Aug 26 10:19:04 user nova-compute[73572]: </nova:instance>
Aug 26 10:19:04 user nova-compute[73572]:   </metadata>
Aug 26 10:19:04 user nova-compute[73572]:   <memory unit='KiB'>524288</memory>
Aug 26 10:19:04 user nova-compute[73572]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 26 10:19:04 user nova-compute[73572]:   <vcpu placement='static'>1</vcpu>
Aug 26 10:19:04 user nova-compute[73572]:   <resource>
Aug 26 10:19:04 user nova-compute[73572]:     <partition>/machine</partition>
Aug 26 10:19:04 user nova-compute[73572]:   </resource>
Aug 26 10:19:04 user nova-compute[73572]:   <sysinfo type='smbios'>
Aug 26 10:19:04 user nova-compute[73572]:     <system>
Aug 26 10:19:04 user nova-compute[73572]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 26 10:19:04 user nova-compute[73572]:       <entry name='product'>OpenStack Nova</entry>
Aug 26 10:19:04 user nova-compute[73572]:       <entry name='version'>0.0.0</entry>
Aug 26 10:19:04 user nova-compute[73572]:       <entry name='serial'>0dceaa35-4a13-453b-961f-831f66c35af0</entry>
Aug 26 10:19:04 user nova-compute[73572]:       <entry name='uuid'>0dceaa35-4a13-453b-961f-831f66c35af0</entry>
Aug 26 10:19:04 user nova-compute[73572]:       <entry name='family'>Virtual Machine</entry>
Aug 26 10:19:04 user nova-compute[73572]:     </system>
Aug 26 10:19:04 user nova-compute[73572]:   </sysinfo>
Aug 26 10:19:04 user nova-compute[73572]:   <os>
Aug 26 10:19:04 user nova-compute[73572]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 26 10:19:04 user nova-compute[73572]:     <boot dev='hd'/>
Aug 26 10:19:04 user nova-compute[73572]:     <smbios mode='sysinfo'/>
Aug 26 10:19:04 user nova-compute[73572]:   </os>
Aug 26 10:19:04 user nova-compute[73572]:   <features>
Aug 26 10:19:04 user nova-compute[73572]:     <acpi/>
Aug 26 10:19:04 user nova-compute[73572]:     <apic/>
Aug 26 10:19:04 user nova-compute[73572]:     <vmcoreinfo state='on'/>
Aug 26 10:19:04 user nova-compute[73572]:   </features>
Aug 26 10:19:04 user nova-compute[73572]:   <cpu mode='custom' match='exact' check='full'>
Aug 26 10:19:04 user nova-compute[73572]:     <model fallback='forbid'>Nehalem</model>
Aug 26 10:19:04 user nova-compute[73572]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 26 10:19:04 user nova-compute[73572]:     <feature policy='require' name='vme'/>
Aug 26 10:19:04 user nova-compute[73572]:     <feature policy='require' name='x2apic'/>
Aug 26 10:19:04 user nova-compute[73572]:     <feature policy='require' name='hypervisor'/>
Aug 26 10:19:04 user nova-compute[73572]:   </cpu>
Aug 26 10:19:04 user nova-compute[73572]:   <clock offset='utc'>
Aug 26 10:19:04 user nova-compute[73572]:     <timer name='pit' tickpolicy='delay'/>
Aug 26 10:19:04 user nova-compute[73572]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 26 10:19:04 user nova-compute[73572]:     <timer name='hpet' present='no'/>
Aug 26 10:19:04 user nova-compute[73572]:   </clock>
Aug 26 10:19:04 user nova-compute[73572]:   <on_poweroff>destroy</on_poweroff>
Aug 26 10:19:04 user nova-compute[73572]:   <on_reboot>restart</on_reboot>
Aug 26 10:19:04 user nova-compute[73572]:   <on_crash>destroy</on_crash>
Aug 26 10:19:04 user nova-compute[73572]:   <devices>
Aug 26 10:19:04 user nova-compute[73572]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 26 10:19:04 user nova-compute[73572]:     <disk type='file' device='disk'>
Aug 26 10:19:04 user nova-compute[73572]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 26 10:19:04 user nova-compute[73572]:       <source file='/opt/stack/data/nova/instances/0dceaa35-4a13-453b-961f-831f66c35af0/disk' index='2'/>
Aug 26 10:19:04 user nova-compute[73572]:       <backingStore type='file' index='3'>
Aug 26 10:19:04 user nova-compute[73572]:         <format type='raw'/>
Aug 26 10:19:04 user nova-compute[73572]:         <source file='/opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801'/>
Aug 26 10:19:04 user nova-compute[73572]:         <backingStore/>
Aug 26 10:19:04 user nova-compute[73572]:       </backingStore>
Aug 26 10:19:04 user nova-compute[73572]:       <target dev='vda' bus='virtio'/>
Aug 26 10:19:04 user nova-compute[73572]:       <alias name='virtio-disk0'/>
Aug 26 10:19:04 user nova-compute[73572]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 26 10:19:04 user nova-compute[73572]:     </disk>
Aug 26 10:19:04 user nova-compute[73572]:     <disk type='file' device='cdrom'>
Aug 26 10:19:04 user nova-compute[73572]:       <driver name='qemu' type='raw' cache='none'/>
Aug 26 10:19:04 user nova-compute[73572]:       <source file='/opt/stack/data/nova/instances/0dceaa35-4a13-453b-961f-831f66c35af0/disk.config' index='1'/>
Aug 26 10:19:04 user nova-compute[73572]:       <backingStore/>
Aug 26 10:19:04 user nova-compute[73572]:       <target dev='hda' bus='ide'/>
Aug 26 10:19:04 user nova-compute[73572]:       <readonly/>
Aug 26 10:19:04 user nova-compute[73572]:       <alias name='ide0-0-0'/>
Aug 26 10:19:04 user nova-compute[73572]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 26 10:19:04 user nova-compute[73572]:     </disk>
Aug 26 10:19:04 user nova-compute[73572]:     <controller type='usb' index='0' model='none'>
Aug 26 10:19:04 user nova-compute[73572]:       <alias name='usb'/>
Aug 26 10:19:04 user nova-compute[73572]:     </controller>
Aug 26 10:19:04 user nova-compute[73572]:     <controller type='pci' index='0' model='pci-root'>
Aug 26 10:19:04 user nova-compute[73572]:       <alias name='pci.0'/>
Aug 26 10:19:04 user nova-compute[73572]:     </controller>
Aug 26 10:19:04 user nova-compute[73572]:     <controller type='ide' index='0'>
Aug 26 10:19:04 user nova-compute[73572]:       <alias name='ide'/>
Aug 26 10:19:04 user nova-compute[73572]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 26 10:19:04 user nova-compute[73572]:     </controller>
Aug 26 10:19:04 user nova-compute[73572]:     <interface type='ethernet'>
Aug 26 10:19:04 user nova-compute[73572]:       <mac address='fa:16:3e:ad:63:c3'/>
Aug 26 10:19:04 user nova-compute[73572]:       <target dev='tap3c5d5d20-da'/>
Aug 26 10:19:04 user nova-compute[73572]:       <model type='virtio'/>
Aug 26 10:19:04 user nova-compute[73572]:       <mtu size='1442'/>
Aug 26 10:19:04 user nova-compute[73572]:       <alias name='net0'/>
Aug 26 10:19:04 user nova-compute[73572]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 26 10:19:04 user nova-compute[73572]:     </interface>
Aug 26 10:19:04 user nova-compute[73572]:     <serial type='pty'>
Aug 26 10:19:04 user nova-compute[73572]:       <source path='/dev/pts/11'/>
Aug 26 10:19:04 user nova-compute[73572]:       <log file='/opt/stack/data/nova/instances/0dceaa35-4a13-453b-961f-831f66c35af0/console.log' append='off'/>
Aug 26 10:19:04 user nova-compute[73572]:       <target type='isa-serial' port='0'>
Aug 26 10:19:04 user nova-compute[73572]:         <model name='isa-serial'/>
Aug 26 10:19:04 user nova-compute[73572]:       </target>
Aug 26 10:19:04 user nova-compute[73572]:       <alias name='serial0'/>
Aug 26 10:19:04 user nova-compute[73572]:     </serial>
Aug 26 10:19:04 user nova-compute[73572]:     <console type='pty' tty='/dev/pts/11'>
Aug 26 10:19:04 user nova-compute[73572]:       <source path='/dev/pts/11'/>
Aug 26 10:19:04 user nova-compute[73572]:       <log file='/opt/stack/data/nova/instances/0dceaa35-4a13-453b-961f-831f66c35af0/console.log' append='off'/>
Aug 26 10:19:04 user nova-compute[73572]:       <target type='serial' port='0'/>
Aug 26 10:19:04 user nova-compute[73572]:       <alias name='serial0'/>
Aug 26 10:19:04 user nova-compute[73572]:     </console>
Aug 26 10:19:04 user nova-compute[73572]:     <input type='mouse' bus='ps2'>
Aug 26 10:19:04 user nova-compute[73572]:       <alias name='input0'/>
Aug 26 10:19:04 user nova-compute[73572]:     </input>
Aug 26 10:19:04 user nova-compute[73572]:     <input type='keyboard' bus='ps2'>
Aug 26 10:19:04 user nova-compute[73572]:       <alias name='input1'/>
Aug 26 10:19:04 user nova-compute[73572]:     </input>
Aug 26 10:19:04 user nova-compute[73572]:     <graphics type='vnc' port='5911' autoport='yes' listen='0.0.0.0'>
Aug 26 10:19:04 user nova-compute[73572]:       <listen type='address' address='0.0.0.0'/>
Aug 26 10:19:04 user nova-compute[73572]:     </graphics>
Aug 26 10:19:04 user nova-compute[73572]:     <audio id='1' type='none'/>
Aug 26 10:19:04 user nova-compute[73572]:     <video>
Aug 26 10:19:04 user nova-compute[73572]:       <model type='virtio' heads='1' primary='yes'/>
Aug 26 10:19:04 user nova-compute[73572]:       <alias name='video0'/>
Aug 26 10:19:04 user nova-compute[73572]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 26 10:19:04 user nova-compute[73572]:     </video>
Aug 26 10:19:04 user nova-compute[73572]:     <memballoon model='virtio'>
Aug 26 10:19:04 user nova-compute[73572]:       <stats period='10'/>
Aug 26 10:19:04 user nova-compute[73572]:       <alias name='balloon0'/>
Aug 26 10:19:04 user nova-compute[73572]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 26 10:19:04 user nova-compute[73572]:     </memballoon>
Aug 26 10:19:04 user nova-compute[73572]:     <rng model='virtio'>
Aug 26 10:19:04 user nova-compute[73572]:       <backend model='random'>/dev/urandom</backend>
Aug 26 10:19:04 user nova-compute[73572]:       <alias name='rng0'/>
Aug 26 10:19:04 user nova-compute[73572]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 26 10:19:04 user nova-compute[73572]:     </rng>
Aug 26 10:19:04 user nova-compute[73572]:   </devices>
Aug 26 10:19:04 user nova-compute[73572]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 26 10:19:04 user nova-compute[73572]:     <label>libvirt-0dceaa35-4a13-453b-961f-831f66c35af0</label>
Aug 26 10:19:04 user nova-compute[73572]:     <imagelabel>libvirt-0dceaa35-4a13-453b-961f-831f66c35af0</imagelabel>
Aug 26 10:19:04 user nova-compute[73572]:   </seclabel>
Aug 26 10:19:04 user nova-compute[73572]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 26 10:19:04 user nova-compute[73572]:     <label>+64055:+108</label>
Aug 26 10:19:04 user nova-compute[73572]:     <imagelabel>+64055:+108</imagelabel>
Aug 26 10:19:04 user nova-compute[73572]:   </seclabel>
Aug 26 10:19:04 user nova-compute[73572]: </domain>
Aug 26 10:19:04 user nova-compute[73572]:  {{(pid=73572) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 26 10:19:04 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [req-77fa0fad-101a-4f64-8c35-277b3dbcc58f req-3e86fb0e-0d99-4d79-8ef7-8b8fb4693899 service nova] [instance: 0dceaa35-4a13-453b-961f-831f66c35af0] Detaching interface fa:16:3e:de:2b:93 failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tap953f6a62-54' not found.
Aug 26 10:19:04 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [req-77fa0fad-101a-4f64-8c35-277b3dbcc58f req-3e86fb0e-0d99-4d79-8ef7-8b8fb4693899 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T10:16:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1180989107',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1180989107',id=20,image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCoQLfbNOsScPlPdH7TTAWBoUTtprP7Wt9D2iobB5TEO7soZAUDBZvsnw8EfneOw36+/lna9tLwlSS51wnghWJumalBKBT2droQjZV+qAgp3BnIGzzIB2rwkhacN2zLmGg==',key_name='tempest-keypair-1046141656',keypairs=<?>,launch_index=0,launched_at=2023-08-26T10:16:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6d2915087eb04830831062675024f835',ramdisk_id='',reservation_id='r-untu6l5l',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1639980618',owner_user_name='tempest-TaggedAttachmentsTest-1639980618-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T10:16:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5ff395781b5f403fa56cada31e168817',uuid=0dceaa35-4a13-453b-961f-831f66c35af0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "953f6a62-54f7-40f2-8bde-2639ab34c351", "address": "fa:16:3e:de:2b:93", "network": {"id": "4562dd45-7d3c-4cca-b97c-a3114383641b", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1852107155", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.28", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "6d2915087eb04830831062675024f835", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap953f6a62-54", "ovs_interfaceid": "953f6a62-54f7-40f2-8bde-2639ab34c351", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 10:19:04 user nova-compute[73572]: DEBUG nova.network.os_vif_util [req-77fa0fad-101a-4f64-8c35-277b3dbcc58f req-3e86fb0e-0d99-4d79-8ef7-8b8fb4693899 service nova] Converting VIF {"id": "953f6a62-54f7-40f2-8bde-2639ab34c351", "address": "fa:16:3e:de:2b:93", "network": {"id": "4562dd45-7d3c-4cca-b97c-a3114383641b", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1852107155", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.28", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "6d2915087eb04830831062675024f835", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap953f6a62-54", "ovs_interfaceid": "953f6a62-54f7-40f2-8bde-2639ab34c351", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:19:04 user nova-compute[73572]: DEBUG nova.network.os_vif_util [req-77fa0fad-101a-4f64-8c35-277b3dbcc58f req-3e86fb0e-0d99-4d79-8ef7-8b8fb4693899 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:2b:93,bridge_name='br-int',has_traffic_filtering=True,id=953f6a62-54f7-40f2-8bde-2639ab34c351,network=Network(4562dd45-7d3c-4cca-b97c-a3114383641b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap953f6a62-54') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:19:04 user nova-compute[73572]: DEBUG os_vif [req-77fa0fad-101a-4f64-8c35-277b3dbcc58f req-3e86fb0e-0d99-4d79-8ef7-8b8fb4693899 service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:2b:93,bridge_name='br-int',has_traffic_filtering=True,id=953f6a62-54f7-40f2-8bde-2639ab34c351,network=Network(4562dd45-7d3c-4cca-b97c-a3114383641b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap953f6a62-54') {{(pid=73572) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 10:19:04 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:19:04 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap953f6a62-54, bridge=br-int, if_exists=True) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:19:04 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 10:19:04 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-86290aa6-aa45-47b4-876f-b37b8e607e96 tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] Lock "interface-0dceaa35-4a13-453b-961f-831f66c35af0-953f6a62-54f7-40f2-8bde-2639ab34c351" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 3.431s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:19:04 user nova-compute[73572]: INFO os_vif [req-77fa0fad-101a-4f64-8c35-277b3dbcc58f req-3e86fb0e-0d99-4d79-8ef7-8b8fb4693899 service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:2b:93,bridge_name='br-int',has_traffic_filtering=True,id=953f6a62-54f7-40f2-8bde-2639ab34c351,network=Network(4562dd45-7d3c-4cca-b97c-a3114383641b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap953f6a62-54')
Aug 26 10:19:04 user nova-compute[73572]: DEBUG nova.virt.libvirt.guest [req-77fa0fad-101a-4f64-8c35-277b3dbcc58f req-3e86fb0e-0d99-4d79-8ef7-8b8fb4693899 service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 10:19:04 user nova-compute[73572]:   <nova:package version="0.0.0"/>
Aug 26 10:19:04 user nova-compute[73572]:   <nova:name>tempest-device-tagging-server-1180989107</nova:name>
Aug 26 10:19:04 user nova-compute[73572]:   <nova:creationTime>2023-08-26 10:19:04</nova:creationTime>
Aug 26 10:19:04 user nova-compute[73572]:   <nova:flavor name="m1.tiny">
Aug 26 10:19:04 user nova-compute[73572]:     <nova:memory>512</nova:memory>
Aug 26 10:19:04 user nova-compute[73572]:     <nova:disk>1</nova:disk>
Aug 26 10:19:04 user nova-compute[73572]:     <nova:swap>0</nova:swap>
Aug 26 10:19:04 user nova-compute[73572]:     <nova:ephemeral>0</nova:ephemeral>
Aug 26 10:19:04 user nova-compute[73572]:     <nova:vcpus>1</nova:vcpus>
Aug 26 10:19:04 user nova-compute[73572]:   </nova:flavor>
Aug 26 10:19:04 user nova-compute[73572]:   <nova:owner>
Aug 26 10:19:04 user nova-compute[73572]:     <nova:user uuid="5ff395781b5f403fa56cada31e168817">tempest-TaggedAttachmentsTest-1639980618-project-member</nova:user>
Aug 26 10:19:04 user nova-compute[73572]:     <nova:project uuid="6d2915087eb04830831062675024f835">tempest-TaggedAttachmentsTest-1639980618</nova:project>
Aug 26 10:19:04 user nova-compute[73572]:   </nova:owner>
Aug 26 10:19:04 user nova-compute[73572]:   <nova:root type="image" uuid="299da0c9-e1c4-48f0-be55-fbe20dd06bc9"/>
Aug 26 10:19:04 user nova-compute[73572]:   <nova:ports>
Aug 26 10:19:04 user nova-compute[73572]:     <nova:port uuid="3c5d5d20-da80-4401-b027-3c4b0df169c6">
Aug 26 10:19:04 user nova-compute[73572]:       <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 26 10:19:04 user nova-compute[73572]:     </nova:port>
Aug 26 10:19:04 user nova-compute[73572]:   </nova:ports>
Aug 26 10:19:04 user nova-compute[73572]: </nova:instance>
Aug 26 10:19:04 user nova-compute[73572]:  {{(pid=73572) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Aug 26 10:19:06 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:19:07 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:19:09 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-38b21fe5-bca1-4a4e-97ca-0e139346eba6 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Acquiring lock "2eaea7c2-a5c0-4950-b033-0012b5cec0ee" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:19:09 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-38b21fe5-bca1-4a4e-97ca-0e139346eba6 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Lock "2eaea7c2-a5c0-4950-b033-0012b5cec0ee" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:19:09 user nova-compute[73572]: DEBUG nova.compute.manager [None req-38b21fe5-bca1-4a4e-97ca-0e139346eba6 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] [instance: 2eaea7c2-a5c0-4950-b033-0012b5cec0ee] Starting instance... {{(pid=73572) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 10:19:09 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-38b21fe5-bca1-4a4e-97ca-0e139346eba6 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:19:09 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-38b21fe5-bca1-4a4e-97ca-0e139346eba6 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:19:09 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-38b21fe5-bca1-4a4e-97ca-0e139346eba6 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73572) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 10:19:09 user nova-compute[73572]: INFO nova.compute.claims [None req-38b21fe5-bca1-4a4e-97ca-0e139346eba6 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] [instance: 2eaea7c2-a5c0-4950-b033-0012b5cec0ee] Claim successful on node user
Aug 26 10:19:09 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:19:10 user nova-compute[73572]: DEBUG nova.compute.provider_tree [None req-38b21fe5-bca1-4a4e-97ca-0e139346eba6 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Inventory has not changed in ProviderTree for provider: e2cec974-59b2-4c77-a53d-a7f4e5a30d75 {{(pid=73572) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 10:19:10 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-38b21fe5-bca1-4a4e-97ca-0e139346eba6 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Inventory has not changed for provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73572) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 10:19:10 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-38b21fe5-bca1-4a4e-97ca-0e139346eba6 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.665s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:19:10 user nova-compute[73572]: DEBUG nova.compute.manager [None req-38b21fe5-bca1-4a4e-97ca-0e139346eba6 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] [instance: 2eaea7c2-a5c0-4950-b033-0012b5cec0ee] Start building networks asynchronously for instance. {{(pid=73572) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 10:19:10 user nova-compute[73572]: DEBUG nova.compute.manager [None req-38b21fe5-bca1-4a4e-97ca-0e139346eba6 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] [instance: 2eaea7c2-a5c0-4950-b033-0012b5cec0ee] Allocating IP information in the background. {{(pid=73572) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 10:19:10 user nova-compute[73572]: DEBUG nova.network.neutron [None req-38b21fe5-bca1-4a4e-97ca-0e139346eba6 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] [instance: 2eaea7c2-a5c0-4950-b033-0012b5cec0ee] allocate_for_instance() {{(pid=73572) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 10:19:10 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-38b21fe5-bca1-4a4e-97ca-0e139346eba6 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] [instance: 2eaea7c2-a5c0-4950-b033-0012b5cec0ee] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 10:19:10 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-2374ab19-78d0-451e-8569-a4e950e97c4f tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Acquiring lock "86923c1a-89a5-4e7a-b488-8bf3a013bf83" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:19:10 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-2374ab19-78d0-451e-8569-a4e950e97c4f tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Lock "86923c1a-89a5-4e7a-b488-8bf3a013bf83" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:19:10 user nova-compute[73572]: DEBUG nova.compute.manager [None req-38b21fe5-bca1-4a4e-97ca-0e139346eba6 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] [instance: 2eaea7c2-a5c0-4950-b033-0012b5cec0ee] Start building block device mappings for instance. {{(pid=73572) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 10:19:10 user nova-compute[73572]: DEBUG nova.compute.manager [None req-2374ab19-78d0-451e-8569-a4e950e97c4f tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] [instance: 86923c1a-89a5-4e7a-b488-8bf3a013bf83] Starting instance... {{(pid=73572) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 10:19:10 user nova-compute[73572]: DEBUG nova.policy [None req-38b21fe5-bca1-4a4e-97ca-0e139346eba6 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '099462c61dcc4816b17d2d0155823873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1bff48d66894950ac6690e1fd0e79b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73572) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 10:19:10 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-2374ab19-78d0-451e-8569-a4e950e97c4f tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:19:10 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-2374ab19-78d0-451e-8569-a4e950e97c4f tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:19:10 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-2374ab19-78d0-451e-8569-a4e950e97c4f tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73572) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 10:19:10 user nova-compute[73572]: INFO nova.compute.claims [None req-2374ab19-78d0-451e-8569-a4e950e97c4f tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] [instance: 86923c1a-89a5-4e7a-b488-8bf3a013bf83] Claim successful on node user
Aug 26 10:19:10 user nova-compute[73572]: DEBUG nova.compute.manager [None req-38b21fe5-bca1-4a4e-97ca-0e139346eba6 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] [instance: 2eaea7c2-a5c0-4950-b033-0012b5cec0ee] Start spawning the instance on the hypervisor. {{(pid=73572) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 10:19:10 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-38b21fe5-bca1-4a4e-97ca-0e139346eba6 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] [instance: 2eaea7c2-a5c0-4950-b033-0012b5cec0ee] Creating instance directory {{(pid=73572) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 10:19:10 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-38b21fe5-bca1-4a4e-97ca-0e139346eba6 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] [instance: 2eaea7c2-a5c0-4950-b033-0012b5cec0ee] Creating image(s)
Aug 26 10:19:10 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-38b21fe5-bca1-4a4e-97ca-0e139346eba6 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Acquiring lock "/opt/stack/data/nova/instances/2eaea7c2-a5c0-4950-b033-0012b5cec0ee/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:19:10 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-38b21fe5-bca1-4a4e-97ca-0e139346eba6 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Lock "/opt/stack/data/nova/instances/2eaea7c2-a5c0-4950-b033-0012b5cec0ee/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:19:10 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-38b21fe5-bca1-4a4e-97ca-0e139346eba6 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Lock "/opt/stack/data/nova/instances/2eaea7c2-a5c0-4950-b033-0012b5cec0ee/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.011s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:19:10 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-38b21fe5-bca1-4a4e-97ca-0e139346eba6 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:19:10 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-38b21fe5-bca1-4a4e-97ca-0e139346eba6 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json" returned: 0 in 0.234s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:19:10 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-38b21fe5-bca1-4a4e-97ca-0e139346eba6 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Acquiring lock "2099350d6f3bcd0de9471c73862d4fe75b049801" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:19:10 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-38b21fe5-bca1-4a4e-97ca-0e139346eba6 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Lock "2099350d6f3bcd0de9471c73862d4fe75b049801" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:19:10 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-38b21fe5-bca1-4a4e-97ca-0e139346eba6 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:19:11 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-38b21fe5-bca1-4a4e-97ca-0e139346eba6 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json" returned: 0 in 0.218s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:19:11 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-38b21fe5-bca1-4a4e-97ca-0e139346eba6 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801,backing_fmt=raw /opt/stack/data/nova/instances/2eaea7c2-a5c0-4950-b033-0012b5cec0ee/disk 1073741824 {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:19:11 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-38b21fe5-bca1-4a4e-97ca-0e139346eba6 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801,backing_fmt=raw /opt/stack/data/nova/instances/2eaea7c2-a5c0-4950-b033-0012b5cec0ee/disk 1073741824" returned: 0 in 0.282s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:19:11 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-38b21fe5-bca1-4a4e-97ca-0e139346eba6 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Lock "2099350d6f3bcd0de9471c73862d4fe75b049801" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.508s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:19:11 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-38b21fe5-bca1-4a4e-97ca-0e139346eba6 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:19:11 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-38b21fe5-bca1-4a4e-97ca-0e139346eba6 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json" returned: 0 in 0.386s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:19:11 user nova-compute[73572]: DEBUG nova.virt.disk.api [None req-38b21fe5-bca1-4a4e-97ca-0e139346eba6 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2eaea7c2-a5c0-4950-b033-0012b5cec0ee/disk. size=1073741824 {{(pid=73572) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 10:19:11 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-38b21fe5-bca1-4a4e-97ca-0e139346eba6 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2eaea7c2-a5c0-4950-b033-0012b5cec0ee/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:19:11 user nova-compute[73572]: DEBUG nova.compute.provider_tree [None req-2374ab19-78d0-451e-8569-a4e950e97c4f tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Inventory has not changed in ProviderTree for provider: e2cec974-59b2-4c77-a53d-a7f4e5a30d75 {{(pid=73572) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 10:19:11 user nova-compute[73572]: DEBUG nova.network.neutron [None req-38b21fe5-bca1-4a4e-97ca-0e139346eba6 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] [instance: 2eaea7c2-a5c0-4950-b033-0012b5cec0ee] Successfully created port: 0b4d66c9-2155-45ae-873a-2ee85776eeb7 {{(pid=73572) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 10:19:12 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-2374ab19-78d0-451e-8569-a4e950e97c4f tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Inventory has not changed for provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73572) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 10:19:12 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-38b21fe5-bca1-4a4e-97ca-0e139346eba6 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2eaea7c2-a5c0-4950-b033-0012b5cec0ee/disk --force-share --output=json" returned: 0 in 0.261s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:19:12 user nova-compute[73572]: DEBUG nova.virt.disk.api [None req-38b21fe5-bca1-4a4e-97ca-0e139346eba6 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Cannot resize image /opt/stack/data/nova/instances/2eaea7c2-a5c0-4950-b033-0012b5cec0ee/disk to a smaller size. {{(pid=73572) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 10:19:12 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-38b21fe5-bca1-4a4e-97ca-0e139346eba6 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] [instance: 2eaea7c2-a5c0-4950-b033-0012b5cec0ee] Created local disks {{(pid=73572) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 10:19:12 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-38b21fe5-bca1-4a4e-97ca-0e139346eba6 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] [instance: 2eaea7c2-a5c0-4950-b033-0012b5cec0ee] Ensure instance console log exists: /opt/stack/data/nova/instances/2eaea7c2-a5c0-4950-b033-0012b5cec0ee/console.log {{(pid=73572) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 10:19:12 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-38b21fe5-bca1-4a4e-97ca-0e139346eba6 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:19:12 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-38b21fe5-bca1-4a4e-97ca-0e139346eba6 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:19:12 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-38b21fe5-bca1-4a4e-97ca-0e139346eba6 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:19:12 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-2374ab19-78d0-451e-8569-a4e950e97c4f tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.555s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:19:12 user nova-compute[73572]: DEBUG nova.compute.manager [None req-2374ab19-78d0-451e-8569-a4e950e97c4f tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] [instance: 86923c1a-89a5-4e7a-b488-8bf3a013bf83] Start building networks asynchronously for instance. {{(pid=73572) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 10:19:12 user nova-compute[73572]: DEBUG nova.compute.manager [None req-2374ab19-78d0-451e-8569-a4e950e97c4f tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] [instance: 86923c1a-89a5-4e7a-b488-8bf3a013bf83] Allocating IP information in the background. {{(pid=73572) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 10:19:12 user nova-compute[73572]: DEBUG nova.network.neutron [None req-2374ab19-78d0-451e-8569-a4e950e97c4f tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] [instance: 86923c1a-89a5-4e7a-b488-8bf3a013bf83] allocate_for_instance() {{(pid=73572) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 10:19:12 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-2374ab19-78d0-451e-8569-a4e950e97c4f tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] [instance: 86923c1a-89a5-4e7a-b488-8bf3a013bf83] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 10:19:12 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:19:12 user nova-compute[73572]: DEBUG nova.compute.manager [None req-2374ab19-78d0-451e-8569-a4e950e97c4f tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] [instance: 86923c1a-89a5-4e7a-b488-8bf3a013bf83] Start building block device mappings for instance. {{(pid=73572) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 10:19:12 user nova-compute[73572]: DEBUG nova.compute.manager [None req-2374ab19-78d0-451e-8569-a4e950e97c4f tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] [instance: 86923c1a-89a5-4e7a-b488-8bf3a013bf83] Start spawning the instance on the hypervisor. {{(pid=73572) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 10:19:12 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-2374ab19-78d0-451e-8569-a4e950e97c4f tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] [instance: 86923c1a-89a5-4e7a-b488-8bf3a013bf83] Creating instance directory {{(pid=73572) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 10:19:12 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-2374ab19-78d0-451e-8569-a4e950e97c4f tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] [instance: 86923c1a-89a5-4e7a-b488-8bf3a013bf83] Creating image(s)
Aug 26 10:19:12 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-2374ab19-78d0-451e-8569-a4e950e97c4f tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Acquiring lock "/opt/stack/data/nova/instances/86923c1a-89a5-4e7a-b488-8bf3a013bf83/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:19:12 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-2374ab19-78d0-451e-8569-a4e950e97c4f tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Lock "/opt/stack/data/nova/instances/86923c1a-89a5-4e7a-b488-8bf3a013bf83/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:19:12 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-2374ab19-78d0-451e-8569-a4e950e97c4f tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Lock "/opt/stack/data/nova/instances/86923c1a-89a5-4e7a-b488-8bf3a013bf83/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:19:12 user nova-compute[73572]: DEBUG nova.policy [None req-2374ab19-78d0-451e-8569-a4e950e97c4f tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '099462c61dcc4816b17d2d0155823873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1bff48d66894950ac6690e1fd0e79b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73572) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 10:19:12 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-2374ab19-78d0-451e-8569-a4e950e97c4f tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:19:12 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-2374ab19-78d0-451e-8569-a4e950e97c4f tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json" returned: 0 in 0.258s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:19:12 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-2374ab19-78d0-451e-8569-a4e950e97c4f tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Acquiring lock "2099350d6f3bcd0de9471c73862d4fe75b049801" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:19:12 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-2374ab19-78d0-451e-8569-a4e950e97c4f tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Lock "2099350d6f3bcd0de9471c73862d4fe75b049801" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:19:12 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-2374ab19-78d0-451e-8569-a4e950e97c4f tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:19:12 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-2374ab19-78d0-451e-8569-a4e950e97c4f tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json" returned: 0 in 0.224s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:19:12 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-2374ab19-78d0-451e-8569-a4e950e97c4f tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801,backing_fmt=raw /opt/stack/data/nova/instances/86923c1a-89a5-4e7a-b488-8bf3a013bf83/disk 1073741824 {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:19:13 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-2374ab19-78d0-451e-8569-a4e950e97c4f tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801,backing_fmt=raw /opt/stack/data/nova/instances/86923c1a-89a5-4e7a-b488-8bf3a013bf83/disk 1073741824" returned: 0 in 0.286s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:19:13 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-2374ab19-78d0-451e-8569-a4e950e97c4f tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Lock "2099350d6f3bcd0de9471c73862d4fe75b049801" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.527s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:19:13 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-2374ab19-78d0-451e-8569-a4e950e97c4f tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:19:13 user nova-compute[73572]: DEBUG nova.network.neutron [None req-38b21fe5-bca1-4a4e-97ca-0e139346eba6 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] [instance: 2eaea7c2-a5c0-4950-b033-0012b5cec0ee] Successfully updated port: 0b4d66c9-2155-45ae-873a-2ee85776eeb7 {{(pid=73572) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 10:19:13 user nova-compute[73572]: DEBUG nova.compute.manager [req-99c0824a-3761-41e0-acfc-7dd18906b834 req-42640b06-e904-435c-b8cd-c3153a8d34de service nova] [instance: 2eaea7c2-a5c0-4950-b033-0012b5cec0ee] Received event network-changed-0b4d66c9-2155-45ae-873a-2ee85776eeb7 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:19:13 user nova-compute[73572]: DEBUG nova.compute.manager [req-99c0824a-3761-41e0-acfc-7dd18906b834 req-42640b06-e904-435c-b8cd-c3153a8d34de service nova] [instance: 2eaea7c2-a5c0-4950-b033-0012b5cec0ee] Refreshing instance network info cache due to event network-changed-0b4d66c9-2155-45ae-873a-2ee85776eeb7. {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 10:19:13 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-99c0824a-3761-41e0-acfc-7dd18906b834 req-42640b06-e904-435c-b8cd-c3153a8d34de service nova] Acquiring lock "refresh_cache-2eaea7c2-a5c0-4950-b033-0012b5cec0ee" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:19:13 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-99c0824a-3761-41e0-acfc-7dd18906b834 req-42640b06-e904-435c-b8cd-c3153a8d34de service nova] Acquired lock "refresh_cache-2eaea7c2-a5c0-4950-b033-0012b5cec0ee" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:19:13 user nova-compute[73572]: DEBUG nova.network.neutron [req-99c0824a-3761-41e0-acfc-7dd18906b834 req-42640b06-e904-435c-b8cd-c3153a8d34de service nova] [instance: 2eaea7c2-a5c0-4950-b033-0012b5cec0ee] Refreshing network info cache for port 0b4d66c9-2155-45ae-873a-2ee85776eeb7 {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 10:19:13 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-38b21fe5-bca1-4a4e-97ca-0e139346eba6 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Acquiring lock "refresh_cache-2eaea7c2-a5c0-4950-b033-0012b5cec0ee" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:19:13 user nova-compute[73572]: DEBUG nova.network.neutron [None req-2374ab19-78d0-451e-8569-a4e950e97c4f tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] [instance: 86923c1a-89a5-4e7a-b488-8bf3a013bf83] Successfully created port: db682944-8949-4bf9-b9d5-2213f0d507bc {{(pid=73572) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 10:19:13 user nova-compute[73572]: DEBUG nova.network.neutron [req-99c0824a-3761-41e0-acfc-7dd18906b834 req-42640b06-e904-435c-b8cd-c3153a8d34de service nova] [instance: 2eaea7c2-a5c0-4950-b033-0012b5cec0ee] Instance cache missing network info. {{(pid=73572) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 10:19:13 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-2374ab19-78d0-451e-8569-a4e950e97c4f tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json" returned: 0 in 0.297s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:19:13 user nova-compute[73572]: DEBUG nova.virt.disk.api [None req-2374ab19-78d0-451e-8569-a4e950e97c4f tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Checking if we can resize image /opt/stack/data/nova/instances/86923c1a-89a5-4e7a-b488-8bf3a013bf83/disk. size=1073741824 {{(pid=73572) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 10:19:13 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-2374ab19-78d0-451e-8569-a4e950e97c4f tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86923c1a-89a5-4e7a-b488-8bf3a013bf83/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:19:13 user nova-compute[73572]: DEBUG nova.network.neutron [req-99c0824a-3761-41e0-acfc-7dd18906b834 req-42640b06-e904-435c-b8cd-c3153a8d34de service nova] [instance: 2eaea7c2-a5c0-4950-b033-0012b5cec0ee] Updating instance_info_cache with network_info: [] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:19:13 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-99c0824a-3761-41e0-acfc-7dd18906b834 req-42640b06-e904-435c-b8cd-c3153a8d34de service nova] Releasing lock "refresh_cache-2eaea7c2-a5c0-4950-b033-0012b5cec0ee" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:19:13 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-38b21fe5-bca1-4a4e-97ca-0e139346eba6 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Acquired lock "refresh_cache-2eaea7c2-a5c0-4950-b033-0012b5cec0ee" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:19:13 user nova-compute[73572]: DEBUG nova.network.neutron [None req-38b21fe5-bca1-4a4e-97ca-0e139346eba6 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] [instance: 2eaea7c2-a5c0-4950-b033-0012b5cec0ee] Building network info cache for instance {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 10:19:13 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-2374ab19-78d0-451e-8569-a4e950e97c4f tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86923c1a-89a5-4e7a-b488-8bf3a013bf83/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:19:13 user nova-compute[73572]: DEBUG nova.virt.disk.api [None req-2374ab19-78d0-451e-8569-a4e950e97c4f tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Cannot resize image /opt/stack/data/nova/instances/86923c1a-89a5-4e7a-b488-8bf3a013bf83/disk to a smaller size. {{(pid=73572) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 10:19:13 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-2374ab19-78d0-451e-8569-a4e950e97c4f tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] [instance: 86923c1a-89a5-4e7a-b488-8bf3a013bf83] Created local disks {{(pid=73572) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 10:19:13 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-2374ab19-78d0-451e-8569-a4e950e97c4f tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] [instance: 86923c1a-89a5-4e7a-b488-8bf3a013bf83] Ensure instance console log exists: /opt/stack/data/nova/instances/86923c1a-89a5-4e7a-b488-8bf3a013bf83/console.log {{(pid=73572) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 10:19:13 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-2374ab19-78d0-451e-8569-a4e950e97c4f tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:19:13 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-2374ab19-78d0-451e-8569-a4e950e97c4f tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:19:13 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-2374ab19-78d0-451e-8569-a4e950e97c4f tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:19:13 user nova-compute[73572]: DEBUG nova.network.neutron [None req-38b21fe5-bca1-4a4e-97ca-0e139346eba6 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] [instance: 2eaea7c2-a5c0-4950-b033-0012b5cec0ee] Instance cache missing network info. {{(pid=73572) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 10:19:14 user nova-compute[73572]: DEBUG nova.network.neutron [None req-38b21fe5-bca1-4a4e-97ca-0e139346eba6 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] [instance: 2eaea7c2-a5c0-4950-b033-0012b5cec0ee] Updating instance_info_cache with network_info: [{"id": "0b4d66c9-2155-45ae-873a-2ee85776eeb7", "address": "fa:16:3e:69:d4:8e", "network": {"id": "757e71b4-5177-45a5-8ef5-9b27f42092f1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1765327616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1bff48d66894950ac6690e1fd0e79b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b4d66c9-21", "ovs_interfaceid": "0b4d66c9-2155-45ae-873a-2ee85776eeb7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:19:14 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-38b21fe5-bca1-4a4e-97ca-0e139346eba6 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Releasing lock "refresh_cache-2eaea7c2-a5c0-4950-b033-0012b5cec0ee" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:19:14 user nova-compute[73572]: DEBUG nova.compute.manager [None req-38b21fe5-bca1-4a4e-97ca-0e139346eba6 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] [instance: 2eaea7c2-a5c0-4950-b033-0012b5cec0ee] Instance network_info: |[{"id": "0b4d66c9-2155-45ae-873a-2ee85776eeb7", "address": "fa:16:3e:69:d4:8e", "network": {"id": "757e71b4-5177-45a5-8ef5-9b27f42092f1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1765327616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1bff48d66894950ac6690e1fd0e79b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b4d66c9-21", "ovs_interfaceid": "0b4d66c9-2155-45ae-873a-2ee85776eeb7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73572) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 10:19:14 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-38b21fe5-bca1-4a4e-97ca-0e139346eba6 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] [instance: 2eaea7c2-a5c0-4950-b033-0012b5cec0ee] Start _get_guest_xml network_info=[{"id": "0b4d66c9-2155-45ae-873a-2ee85776eeb7", "address": "fa:16:3e:69:d4:8e", "network": {"id": "757e71b4-5177-45a5-8ef5-9b27f42092f1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1765327616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1bff48d66894950ac6690e1fd0e79b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b4d66c9-21", "ovs_interfaceid": "0b4d66c9-2155-45ae-873a-2ee85776eeb7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T10:07:33Z,direct_url=<?>,disk_format='qcow2',id=299da0c9-e1c4-48f0-be55-fbe20dd06bc9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5c995f8bbbab4368b67a253e0df3971a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T10:07:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'guest_format': None, 'size': 0, 'encryption_format': None, 'device_type': 'disk', 'image_id': '299da0c9-e1c4-48f0-be55-fbe20dd06bc9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73572) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 10:19:14 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-38b21fe5-bca1-4a4e-97ca-0e139346eba6 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:19:14 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-38b21fe5-bca1-4a4e-97ca-0e139346eba6 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:19:14 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-38b21fe5-bca1-4a4e-97ca-0e139346eba6 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73572) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 10:19:14 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-38b21fe5-bca1-4a4e-97ca-0e139346eba6 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] CPU controller missing on host. {{(pid=73572) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 10:19:14 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-38b21fe5-bca1-4a4e-97ca-0e139346eba6 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73572) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 10:19:14 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-38b21fe5-bca1-4a4e-97ca-0e139346eba6 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] CPU controller found on host. {{(pid=73572) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 10:19:14 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-38b21fe5-bca1-4a4e-97ca-0e139346eba6 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73572) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 10:19:14 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-38b21fe5-bca1-4a4e-97ca-0e139346eba6 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T10:07:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T10:07:33Z,direct_url=<?>,disk_format='qcow2',id=299da0c9-e1c4-48f0-be55-fbe20dd06bc9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5c995f8bbbab4368b67a253e0df3971a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T10:07:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 10:19:14 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-38b21fe5-bca1-4a4e-97ca-0e139346eba6 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Flavor limits 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 10:19:14 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-38b21fe5-bca1-4a4e-97ca-0e139346eba6 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Image limits 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 10:19:14 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-38b21fe5-bca1-4a4e-97ca-0e139346eba6 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Flavor pref 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 10:19:14 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-38b21fe5-bca1-4a4e-97ca-0e139346eba6 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Image pref 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 10:19:14 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-38b21fe5-bca1-4a4e-97ca-0e139346eba6 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 10:19:14 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-38b21fe5-bca1-4a4e-97ca-0e139346eba6 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 10:19:14 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-38b21fe5-bca1-4a4e-97ca-0e139346eba6 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73572) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 10:19:14 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-38b21fe5-bca1-4a4e-97ca-0e139346eba6 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Got 1 possible topologies {{(pid=73572) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 10:19:14 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-38b21fe5-bca1-4a4e-97ca-0e139346eba6 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 10:19:14 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-38b21fe5-bca1-4a4e-97ca-0e139346eba6 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 10:19:14 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-38b21fe5-bca1-4a4e-97ca-0e139346eba6 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T10:19:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-743407268',display_name='tempest-ServerRescueNegativeTestJSON-server-743407268',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-743407268',id=24,image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c1bff48d66894950ac6690e1fd0e79b9',ramdisk_id='',reservation_id='r-qoxdscxl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1710547876',owner_user_name='tempest-ServerRescueNegativeTestJSON-1710547876-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T10:19:10Z,user_data=None,user_id='099462c61dcc4816b17d2d0155823873',uuid=2eaea7c2-a5c0-4950-b033-0012b5cec0ee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0b4d66c9-2155-45ae-873a-2ee85776eeb7", "address": "fa:16:3e:69:d4:8e", "network": {"id": "757e71b4-5177-45a5-8ef5-9b27f42092f1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1765327616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1bff48d66894950ac6690e1fd0e79b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b4d66c9-21", "ovs_interfaceid": "0b4d66c9-2155-45ae-873a-2ee85776eeb7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73572) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 10:19:14 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-38b21fe5-bca1-4a4e-97ca-0e139346eba6 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Converting VIF {"id": "0b4d66c9-2155-45ae-873a-2ee85776eeb7", "address": "fa:16:3e:69:d4:8e", "network": {"id": "757e71b4-5177-45a5-8ef5-9b27f42092f1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1765327616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1bff48d66894950ac6690e1fd0e79b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b4d66c9-21", "ovs_interfaceid": "0b4d66c9-2155-45ae-873a-2ee85776eeb7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:19:14 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-38b21fe5-bca1-4a4e-97ca-0e139346eba6 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:d4:8e,bridge_name='br-int',has_traffic_filtering=True,id=0b4d66c9-2155-45ae-873a-2ee85776eeb7,network=Network(757e71b4-5177-45a5-8ef5-9b27f42092f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b4d66c9-21') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:19:14 user nova-compute[73572]: DEBUG nova.objects.instance [None req-38b21fe5-bca1-4a4e-97ca-0e139346eba6 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Lazy-loading 'pci_devices' on Instance uuid 2eaea7c2-a5c0-4950-b033-0012b5cec0ee {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:19:14 user nova-compute[73572]: DEBUG nova.network.neutron [None req-2374ab19-78d0-451e-8569-a4e950e97c4f tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] [instance: 86923c1a-89a5-4e7a-b488-8bf3a013bf83] Successfully updated port: db682944-8949-4bf9-b9d5-2213f0d507bc {{(pid=73572) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 10:19:14 user nova-compute[73572]: DEBUG nova.compute.manager [req-934273c0-ef22-4d23-90a7-c4a75ad81403 req-9bc8758b-543d-462e-b2e6-308c97e66b4c service nova] [instance: 86923c1a-89a5-4e7a-b488-8bf3a013bf83] Received event network-changed-db682944-8949-4bf9-b9d5-2213f0d507bc {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:19:14 user nova-compute[73572]: DEBUG nova.compute.manager [req-934273c0-ef22-4d23-90a7-c4a75ad81403 req-9bc8758b-543d-462e-b2e6-308c97e66b4c service nova] [instance: 86923c1a-89a5-4e7a-b488-8bf3a013bf83] Refreshing instance network info cache due to event network-changed-db682944-8949-4bf9-b9d5-2213f0d507bc. {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 10:19:14 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-934273c0-ef22-4d23-90a7-c4a75ad81403 req-9bc8758b-543d-462e-b2e6-308c97e66b4c service nova] Acquiring lock "refresh_cache-86923c1a-89a5-4e7a-b488-8bf3a013bf83" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:19:14 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-934273c0-ef22-4d23-90a7-c4a75ad81403 req-9bc8758b-543d-462e-b2e6-308c97e66b4c service nova] Acquired lock "refresh_cache-86923c1a-89a5-4e7a-b488-8bf3a013bf83" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:19:14 user nova-compute[73572]: DEBUG nova.network.neutron [req-934273c0-ef22-4d23-90a7-c4a75ad81403 req-9bc8758b-543d-462e-b2e6-308c97e66b4c service nova] [instance: 86923c1a-89a5-4e7a-b488-8bf3a013bf83] Refreshing network info cache for port db682944-8949-4bf9-b9d5-2213f0d507bc {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 10:19:14 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-38b21fe5-bca1-4a4e-97ca-0e139346eba6 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] [instance: 2eaea7c2-a5c0-4950-b033-0012b5cec0ee] End _get_guest_xml xml=<domain type="kvm">
Aug 26 10:19:14 user nova-compute[73572]:   <uuid>2eaea7c2-a5c0-4950-b033-0012b5cec0ee</uuid>
Aug 26 10:19:14 user nova-compute[73572]:   <name>instance-00000018</name>
Aug 26 10:19:14 user nova-compute[73572]:   <memory>524288</memory>
Aug 26 10:19:14 user nova-compute[73572]:   <vcpu>1</vcpu>
Aug 26 10:19:14 user nova-compute[73572]:   <metadata>
Aug 26 10:19:14 user nova-compute[73572]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 10:19:14 user nova-compute[73572]:       <nova:package version="0.0.0"/>
Aug 26 10:19:14 user nova-compute[73572]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-743407268</nova:name>
Aug 26 10:19:14 user nova-compute[73572]:       <nova:creationTime>2023-08-26 10:19:14</nova:creationTime>
Aug 26 10:19:14 user nova-compute[73572]:       <nova:flavor name="m1.tiny">
Aug 26 10:19:14 user nova-compute[73572]:         <nova:memory>512</nova:memory>
Aug 26 10:19:14 user nova-compute[73572]:         <nova:disk>1</nova:disk>
Aug 26 10:19:14 user nova-compute[73572]:         <nova:swap>0</nova:swap>
Aug 26 10:19:14 user nova-compute[73572]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 10:19:14 user nova-compute[73572]:         <nova:vcpus>1</nova:vcpus>
Aug 26 10:19:14 user nova-compute[73572]:       </nova:flavor>
Aug 26 10:19:14 user nova-compute[73572]:       <nova:owner>
Aug 26 10:19:14 user nova-compute[73572]:         <nova:user uuid="099462c61dcc4816b17d2d0155823873">tempest-ServerRescueNegativeTestJSON-1710547876-project-member</nova:user>
Aug 26 10:19:14 user nova-compute[73572]:         <nova:project uuid="c1bff48d66894950ac6690e1fd0e79b9">tempest-ServerRescueNegativeTestJSON-1710547876</nova:project>
Aug 26 10:19:14 user nova-compute[73572]:       </nova:owner>
Aug 26 10:19:14 user nova-compute[73572]:       <nova:root type="image" uuid="299da0c9-e1c4-48f0-be55-fbe20dd06bc9"/>
Aug 26 10:19:14 user nova-compute[73572]:       <nova:ports>
Aug 26 10:19:14 user nova-compute[73572]:         <nova:port uuid="0b4d66c9-2155-45ae-873a-2ee85776eeb7">
Aug 26 10:19:14 user nova-compute[73572]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 26 10:19:14 user nova-compute[73572]:         </nova:port>
Aug 26 10:19:14 user nova-compute[73572]:       </nova:ports>
Aug 26 10:19:14 user nova-compute[73572]:     </nova:instance>
Aug 26 10:19:14 user nova-compute[73572]:   </metadata>
Aug 26 10:19:14 user nova-compute[73572]:   <sysinfo type="smbios">
Aug 26 10:19:14 user nova-compute[73572]:     <system>
Aug 26 10:19:14 user nova-compute[73572]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 10:19:14 user nova-compute[73572]:       <entry name="product">OpenStack Nova</entry>
Aug 26 10:19:14 user nova-compute[73572]:       <entry name="version">0.0.0</entry>
Aug 26 10:19:14 user nova-compute[73572]:       <entry name="serial">2eaea7c2-a5c0-4950-b033-0012b5cec0ee</entry>
Aug 26 10:19:14 user nova-compute[73572]:       <entry name="uuid">2eaea7c2-a5c0-4950-b033-0012b5cec0ee</entry>
Aug 26 10:19:14 user nova-compute[73572]:       <entry name="family">Virtual Machine</entry>
Aug 26 10:19:14 user nova-compute[73572]:     </system>
Aug 26 10:19:14 user nova-compute[73572]:   </sysinfo>
Aug 26 10:19:14 user nova-compute[73572]:   <os>
Aug 26 10:19:14 user nova-compute[73572]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 10:19:14 user nova-compute[73572]:     <boot dev="hd"/>
Aug 26 10:19:14 user nova-compute[73572]:     <smbios mode="sysinfo"/>
Aug 26 10:19:14 user nova-compute[73572]:   </os>
Aug 26 10:19:14 user nova-compute[73572]:   <features>
Aug 26 10:19:14 user nova-compute[73572]:     <acpi/>
Aug 26 10:19:14 user nova-compute[73572]:     <apic/>
Aug 26 10:19:14 user nova-compute[73572]:     <vmcoreinfo/>
Aug 26 10:19:14 user nova-compute[73572]:   </features>
Aug 26 10:19:14 user nova-compute[73572]:   <clock offset="utc">
Aug 26 10:19:14 user nova-compute[73572]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 10:19:14 user nova-compute[73572]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 10:19:14 user nova-compute[73572]:     <timer name="hpet" present="no"/>
Aug 26 10:19:14 user nova-compute[73572]:   </clock>
Aug 26 10:19:14 user nova-compute[73572]:   <cpu mode="custom" match="exact">
Aug 26 10:19:14 user nova-compute[73572]:     <model>Nehalem</model>
Aug 26 10:19:14 user nova-compute[73572]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 10:19:14 user nova-compute[73572]:   </cpu>
Aug 26 10:19:14 user nova-compute[73572]:   <devices>
Aug 26 10:19:14 user nova-compute[73572]:     <disk type="file" device="disk">
Aug 26 10:19:14 user nova-compute[73572]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 10:19:14 user nova-compute[73572]:       <source file="/opt/stack/data/nova/instances/2eaea7c2-a5c0-4950-b033-0012b5cec0ee/disk"/>
Aug 26 10:19:14 user nova-compute[73572]:       <target dev="vda" bus="virtio"/>
Aug 26 10:19:14 user nova-compute[73572]:     </disk>
Aug 26 10:19:14 user nova-compute[73572]:     <interface type="ethernet">
Aug 26 10:19:14 user nova-compute[73572]:       <mac address="fa:16:3e:69:d4:8e"/>
Aug 26 10:19:14 user nova-compute[73572]:       <model type="virtio"/>
Aug 26 10:19:14 user nova-compute[73572]:       <mtu size="1442"/>
Aug 26 10:19:14 user nova-compute[73572]:       <target dev="tap0b4d66c9-21"/>
Aug 26 10:19:14 user nova-compute[73572]:     </interface>
Aug 26 10:19:14 user nova-compute[73572]:     <serial type="pty">
Aug 26 10:19:14 user nova-compute[73572]:       <log file="/opt/stack/data/nova/instances/2eaea7c2-a5c0-4950-b033-0012b5cec0ee/console.log" append="off"/>
Aug 26 10:19:14 user nova-compute[73572]:     </serial>
Aug 26 10:19:14 user nova-compute[73572]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 10:19:14 user nova-compute[73572]:     <video>
Aug 26 10:19:14 user nova-compute[73572]:       <model type="virtio"/>
Aug 26 10:19:14 user nova-compute[73572]:     </video>
Aug 26 10:19:14 user nova-compute[73572]:     <rng model="virtio">
Aug 26 10:19:14 user nova-compute[73572]:       <backend model="random">/dev/urandom</backend>
Aug 26 10:19:14 user nova-compute[73572]:     </rng>
Aug 26 10:19:14 user nova-compute[73572]:     <controller type="usb" index="0" model="none"/>
Aug 26 10:19:14 user nova-compute[73572]:     <memballoon model="virtio">
Aug 26 10:19:14 user nova-compute[73572]:       <stats period="10"/>
Aug 26 10:19:14 user nova-compute[73572]:     </memballoon>
Aug 26 10:19:14 user nova-compute[73572]:   </devices>
Aug 26 10:19:14 user nova-compute[73572]: </domain>
Aug 26 10:19:14 user nova-compute[73572]:  {{(pid=73572) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 10:19:14 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-38b21fe5-bca1-4a4e-97ca-0e139346eba6 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T10:19:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-743407268',display_name='tempest-ServerRescueNegativeTestJSON-server-743407268',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-743407268',id=24,image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c1bff48d66894950ac6690e1fd0e79b9',ramdisk_id='',reservation_id='r-qoxdscxl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1710547876',owner_user_name='tempest-ServerRescueNegativeTestJSON-1710547876-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T10:19:10Z,user_data=None,user_id='099462c61dcc4816b17d2d0155823873',uuid=2eaea7c2-a5c0-4950-b033-0012b5cec0ee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0b4d66c9-2155-45ae-873a-2ee85776eeb7", "address": "fa:16:3e:69:d4:8e", "network": {"id": "757e71b4-5177-45a5-8ef5-9b27f42092f1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1765327616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1bff48d66894950ac6690e1fd0e79b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b4d66c9-21", "ovs_interfaceid": "0b4d66c9-2155-45ae-873a-2ee85776eeb7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 10:19:14 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-38b21fe5-bca1-4a4e-97ca-0e139346eba6 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Converting VIF {"id": "0b4d66c9-2155-45ae-873a-2ee85776eeb7", "address": "fa:16:3e:69:d4:8e", "network": {"id": "757e71b4-5177-45a5-8ef5-9b27f42092f1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1765327616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1bff48d66894950ac6690e1fd0e79b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b4d66c9-21", "ovs_interfaceid": "0b4d66c9-2155-45ae-873a-2ee85776eeb7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:19:14 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-38b21fe5-bca1-4a4e-97ca-0e139346eba6 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:d4:8e,bridge_name='br-int',has_traffic_filtering=True,id=0b4d66c9-2155-45ae-873a-2ee85776eeb7,network=Network(757e71b4-5177-45a5-8ef5-9b27f42092f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b4d66c9-21') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:19:14 user nova-compute[73572]: DEBUG os_vif [None req-38b21fe5-bca1-4a4e-97ca-0e139346eba6 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:d4:8e,bridge_name='br-int',has_traffic_filtering=True,id=0b4d66c9-2155-45ae-873a-2ee85776eeb7,network=Network(757e71b4-5177-45a5-8ef5-9b27f42092f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b4d66c9-21') {{(pid=73572) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 10:19:14 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:19:14 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:19:14 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 10:19:14 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-2374ab19-78d0-451e-8569-a4e950e97c4f tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Acquiring lock "refresh_cache-86923c1a-89a5-4e7a-b488-8bf3a013bf83" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:19:14 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:19:14 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0b4d66c9-21, may_exist=True, interface_attrs={}) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:19:14 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0b4d66c9-21, col_values=(('external_ids', {'iface-id': '0b4d66c9-2155-45ae-873a-2ee85776eeb7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:69:d4:8e', 'vm-uuid': '2eaea7c2-a5c0-4950-b033-0012b5cec0ee'}),), if_exists=True) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:19:14 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:19:14 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:19:14 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:19:14 user nova-compute[73572]: INFO os_vif [None req-38b21fe5-bca1-4a4e-97ca-0e139346eba6 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:d4:8e,bridge_name='br-int',has_traffic_filtering=True,id=0b4d66c9-2155-45ae-873a-2ee85776eeb7,network=Network(757e71b4-5177-45a5-8ef5-9b27f42092f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b4d66c9-21')
Aug 26 10:19:14 user nova-compute[73572]: DEBUG nova.network.neutron [req-934273c0-ef22-4d23-90a7-c4a75ad81403 req-9bc8758b-543d-462e-b2e6-308c97e66b4c service nova] [instance: 86923c1a-89a5-4e7a-b488-8bf3a013bf83] Instance cache missing network info. {{(pid=73572) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 10:19:14 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-38b21fe5-bca1-4a4e-97ca-0e139346eba6 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] No BDM found with device name vda, not building metadata. {{(pid=73572) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 10:19:14 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-38b21fe5-bca1-4a4e-97ca-0e139346eba6 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] No VIF found with MAC fa:16:3e:69:d4:8e, not building metadata {{(pid=73572) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 10:19:14 user nova-compute[73572]: DEBUG nova.network.neutron [req-934273c0-ef22-4d23-90a7-c4a75ad81403 req-9bc8758b-543d-462e-b2e6-308c97e66b4c service nova] [instance: 86923c1a-89a5-4e7a-b488-8bf3a013bf83] Updating instance_info_cache with network_info: [] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:19:14 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-934273c0-ef22-4d23-90a7-c4a75ad81403 req-9bc8758b-543d-462e-b2e6-308c97e66b4c service nova] Releasing lock "refresh_cache-86923c1a-89a5-4e7a-b488-8bf3a013bf83" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:19:14 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-2374ab19-78d0-451e-8569-a4e950e97c4f tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Acquired lock "refresh_cache-86923c1a-89a5-4e7a-b488-8bf3a013bf83" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:19:14 user nova-compute[73572]: DEBUG nova.network.neutron [None req-2374ab19-78d0-451e-8569-a4e950e97c4f tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] [instance: 86923c1a-89a5-4e7a-b488-8bf3a013bf83] Building network info cache for instance {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 10:19:14 user nova-compute[73572]: DEBUG nova.network.neutron [None req-2374ab19-78d0-451e-8569-a4e950e97c4f tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] [instance: 86923c1a-89a5-4e7a-b488-8bf3a013bf83] Instance cache missing network info. {{(pid=73572) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 10:19:14 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:19:14 user nova-compute[73572]: DEBUG nova.network.neutron [None req-2374ab19-78d0-451e-8569-a4e950e97c4f tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] [instance: 86923c1a-89a5-4e7a-b488-8bf3a013bf83] Updating instance_info_cache with network_info: [{"id": "db682944-8949-4bf9-b9d5-2213f0d507bc", "address": "fa:16:3e:7d:b9:15", "network": {"id": "757e71b4-5177-45a5-8ef5-9b27f42092f1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1765327616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1bff48d66894950ac6690e1fd0e79b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb682944-89", "ovs_interfaceid": "db682944-8949-4bf9-b9d5-2213f0d507bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:19:14 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-2374ab19-78d0-451e-8569-a4e950e97c4f tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Releasing lock "refresh_cache-86923c1a-89a5-4e7a-b488-8bf3a013bf83" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:19:14 user nova-compute[73572]: DEBUG nova.compute.manager [None req-2374ab19-78d0-451e-8569-a4e950e97c4f tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] [instance: 86923c1a-89a5-4e7a-b488-8bf3a013bf83] Instance network_info: |[{"id": "db682944-8949-4bf9-b9d5-2213f0d507bc", "address": "fa:16:3e:7d:b9:15", "network": {"id": "757e71b4-5177-45a5-8ef5-9b27f42092f1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1765327616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1bff48d66894950ac6690e1fd0e79b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb682944-89", "ovs_interfaceid": "db682944-8949-4bf9-b9d5-2213f0d507bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73572) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 10:19:14 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-2374ab19-78d0-451e-8569-a4e950e97c4f tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] [instance: 86923c1a-89a5-4e7a-b488-8bf3a013bf83] Start _get_guest_xml network_info=[{"id": "db682944-8949-4bf9-b9d5-2213f0d507bc", "address": "fa:16:3e:7d:b9:15", "network": {"id": "757e71b4-5177-45a5-8ef5-9b27f42092f1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1765327616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1bff48d66894950ac6690e1fd0e79b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb682944-89", "ovs_interfaceid": "db682944-8949-4bf9-b9d5-2213f0d507bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T10:07:33Z,direct_url=<?>,disk_format='qcow2',id=299da0c9-e1c4-48f0-be55-fbe20dd06bc9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5c995f8bbbab4368b67a253e0df3971a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T10:07:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'guest_format': None, 'size': 0, 'encryption_format': None, 'device_type': 'disk', 'image_id': '299da0c9-e1c4-48f0-be55-fbe20dd06bc9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73572) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 10:19:14 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-2374ab19-78d0-451e-8569-a4e950e97c4f tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:19:14 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-2374ab19-78d0-451e-8569-a4e950e97c4f tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:19:14 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-2374ab19-78d0-451e-8569-a4e950e97c4f tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73572) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 10:19:14 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-2374ab19-78d0-451e-8569-a4e950e97c4f tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] CPU controller missing on host. {{(pid=73572) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 10:19:14 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-2374ab19-78d0-451e-8569-a4e950e97c4f tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73572) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 10:19:14 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-2374ab19-78d0-451e-8569-a4e950e97c4f tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] CPU controller found on host. {{(pid=73572) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 10:19:14 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-2374ab19-78d0-451e-8569-a4e950e97c4f tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73572) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 10:19:14 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-2374ab19-78d0-451e-8569-a4e950e97c4f tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T10:07:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T10:07:33Z,direct_url=<?>,disk_format='qcow2',id=299da0c9-e1c4-48f0-be55-fbe20dd06bc9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5c995f8bbbab4368b67a253e0df3971a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T10:07:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 10:19:14 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-2374ab19-78d0-451e-8569-a4e950e97c4f tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Flavor limits 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 10:19:14 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-2374ab19-78d0-451e-8569-a4e950e97c4f tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Image limits 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 10:19:14 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-2374ab19-78d0-451e-8569-a4e950e97c4f tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Flavor pref 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 10:19:14 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-2374ab19-78d0-451e-8569-a4e950e97c4f tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Image pref 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 10:19:14 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-2374ab19-78d0-451e-8569-a4e950e97c4f tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 10:19:14 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-2374ab19-78d0-451e-8569-a4e950e97c4f tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 10:19:14 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-2374ab19-78d0-451e-8569-a4e950e97c4f tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73572) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 10:19:14 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-2374ab19-78d0-451e-8569-a4e950e97c4f tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Got 1 possible topologies {{(pid=73572) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 10:19:14 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-2374ab19-78d0-451e-8569-a4e950e97c4f tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 10:19:14 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-2374ab19-78d0-451e-8569-a4e950e97c4f tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 10:19:14 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-2374ab19-78d0-451e-8569-a4e950e97c4f tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T10:19:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1567915986',display_name='tempest-ServerRescueNegativeTestJSON-server-1567915986',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1567915986',id=25,image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c1bff48d66894950ac6690e1fd0e79b9',ramdisk_id='',reservation_id='r-btw4ruhw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1710547876',owner_user_name='tempest-ServerRescueNegativeTestJSON-1710547876-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T10:19:12Z,user_data=None,user_id='099462c61dcc4816b17d2d0155823873',uuid=86923c1a-89a5-4e7a-b488-8bf3a013bf83,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "db682944-8949-4bf9-b9d5-2213f0d507bc", "address": "fa:16:3e:7d:b9:15", "network": {"id": "757e71b4-5177-45a5-8ef5-9b27f42092f1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1765327616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1bff48d66894950ac6690e1fd0e79b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb682944-89", "ovs_interfaceid": "db682944-8949-4bf9-b9d5-2213f0d507bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73572) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 10:19:14 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-2374ab19-78d0-451e-8569-a4e950e97c4f tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Converting VIF {"id": "db682944-8949-4bf9-b9d5-2213f0d507bc", "address": "fa:16:3e:7d:b9:15", "network": {"id": "757e71b4-5177-45a5-8ef5-9b27f42092f1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1765327616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1bff48d66894950ac6690e1fd0e79b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb682944-89", "ovs_interfaceid": "db682944-8949-4bf9-b9d5-2213f0d507bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:19:14 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-2374ab19-78d0-451e-8569-a4e950e97c4f tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:b9:15,bridge_name='br-int',has_traffic_filtering=True,id=db682944-8949-4bf9-b9d5-2213f0d507bc,network=Network(757e71b4-5177-45a5-8ef5-9b27f42092f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb682944-89') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:19:14 user nova-compute[73572]: DEBUG nova.objects.instance [None req-2374ab19-78d0-451e-8569-a4e950e97c4f tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Lazy-loading 'pci_devices' on Instance uuid 86923c1a-89a5-4e7a-b488-8bf3a013bf83 {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:19:14 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-2374ab19-78d0-451e-8569-a4e950e97c4f tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] [instance: 86923c1a-89a5-4e7a-b488-8bf3a013bf83] End _get_guest_xml xml=<domain type="kvm">
Aug 26 10:19:14 user nova-compute[73572]:   <uuid>86923c1a-89a5-4e7a-b488-8bf3a013bf83</uuid>
Aug 26 10:19:14 user nova-compute[73572]:   <name>instance-00000019</name>
Aug 26 10:19:14 user nova-compute[73572]:   <memory>524288</memory>
Aug 26 10:19:14 user nova-compute[73572]:   <vcpu>1</vcpu>
Aug 26 10:19:14 user nova-compute[73572]:   <metadata>
Aug 26 10:19:14 user nova-compute[73572]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 10:19:14 user nova-compute[73572]:       <nova:package version="0.0.0"/>
Aug 26 10:19:14 user nova-compute[73572]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1567915986</nova:name>
Aug 26 10:19:14 user nova-compute[73572]:       <nova:creationTime>2023-08-26 10:19:14</nova:creationTime>
Aug 26 10:19:14 user nova-compute[73572]:       <nova:flavor name="m1.tiny">
Aug 26 10:19:14 user nova-compute[73572]:         <nova:memory>512</nova:memory>
Aug 26 10:19:14 user nova-compute[73572]:         <nova:disk>1</nova:disk>
Aug 26 10:19:14 user nova-compute[73572]:         <nova:swap>0</nova:swap>
Aug 26 10:19:14 user nova-compute[73572]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 10:19:14 user nova-compute[73572]:         <nova:vcpus>1</nova:vcpus>
Aug 26 10:19:14 user nova-compute[73572]:       </nova:flavor>
Aug 26 10:19:14 user nova-compute[73572]:       <nova:owner>
Aug 26 10:19:14 user nova-compute[73572]:         <nova:user uuid="099462c61dcc4816b17d2d0155823873">tempest-ServerRescueNegativeTestJSON-1710547876-project-member</nova:user>
Aug 26 10:19:14 user nova-compute[73572]:         <nova:project uuid="c1bff48d66894950ac6690e1fd0e79b9">tempest-ServerRescueNegativeTestJSON-1710547876</nova:project>
Aug 26 10:19:14 user nova-compute[73572]:       </nova:owner>
Aug 26 10:19:14 user nova-compute[73572]:       <nova:root type="image" uuid="299da0c9-e1c4-48f0-be55-fbe20dd06bc9"/>
Aug 26 10:19:14 user nova-compute[73572]:       <nova:ports>
Aug 26 10:19:14 user nova-compute[73572]:         <nova:port uuid="db682944-8949-4bf9-b9d5-2213f0d507bc">
Aug 26 10:19:14 user nova-compute[73572]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 26 10:19:14 user nova-compute[73572]:         </nova:port>
Aug 26 10:19:14 user nova-compute[73572]:       </nova:ports>
Aug 26 10:19:14 user nova-compute[73572]:     </nova:instance>
Aug 26 10:19:14 user nova-compute[73572]:   </metadata>
Aug 26 10:19:14 user nova-compute[73572]:   <sysinfo type="smbios">
Aug 26 10:19:14 user nova-compute[73572]:     <system>
Aug 26 10:19:14 user nova-compute[73572]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 10:19:14 user nova-compute[73572]:       <entry name="product">OpenStack Nova</entry>
Aug 26 10:19:14 user nova-compute[73572]:       <entry name="version">0.0.0</entry>
Aug 26 10:19:14 user nova-compute[73572]:       <entry name="serial">86923c1a-89a5-4e7a-b488-8bf3a013bf83</entry>
Aug 26 10:19:14 user nova-compute[73572]:       <entry name="uuid">86923c1a-89a5-4e7a-b488-8bf3a013bf83</entry>
Aug 26 10:19:14 user nova-compute[73572]:       <entry name="family">Virtual Machine</entry>
Aug 26 10:19:14 user nova-compute[73572]:     </system>
Aug 26 10:19:14 user nova-compute[73572]:   </sysinfo>
Aug 26 10:19:14 user nova-compute[73572]:   <os>
Aug 26 10:19:14 user nova-compute[73572]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 10:19:14 user nova-compute[73572]:     <boot dev="hd"/>
Aug 26 10:19:14 user nova-compute[73572]:     <smbios mode="sysinfo"/>
Aug 26 10:19:14 user nova-compute[73572]:   </os>
Aug 26 10:19:14 user nova-compute[73572]:   <features>
Aug 26 10:19:14 user nova-compute[73572]:     <acpi/>
Aug 26 10:19:14 user nova-compute[73572]:     <apic/>
Aug 26 10:19:14 user nova-compute[73572]:     <vmcoreinfo/>
Aug 26 10:19:14 user nova-compute[73572]:   </features>
Aug 26 10:19:14 user nova-compute[73572]:   <clock offset="utc">
Aug 26 10:19:14 user nova-compute[73572]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 10:19:14 user nova-compute[73572]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 10:19:14 user nova-compute[73572]:     <timer name="hpet" present="no"/>
Aug 26 10:19:14 user nova-compute[73572]:   </clock>
Aug 26 10:19:14 user nova-compute[73572]:   <cpu mode="custom" match="exact">
Aug 26 10:19:14 user nova-compute[73572]:     <model>Nehalem</model>
Aug 26 10:19:14 user nova-compute[73572]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 10:19:14 user nova-compute[73572]:   </cpu>
Aug 26 10:19:14 user nova-compute[73572]:   <devices>
Aug 26 10:19:14 user nova-compute[73572]:     <disk type="file" device="disk">
Aug 26 10:19:14 user nova-compute[73572]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 10:19:14 user nova-compute[73572]:       <source file="/opt/stack/data/nova/instances/86923c1a-89a5-4e7a-b488-8bf3a013bf83/disk"/>
Aug 26 10:19:14 user nova-compute[73572]:       <target dev="vda" bus="virtio"/>
Aug 26 10:19:14 user nova-compute[73572]:     </disk>
Aug 26 10:19:14 user nova-compute[73572]:     <interface type="ethernet">
Aug 26 10:19:14 user nova-compute[73572]:       <mac address="fa:16:3e:7d:b9:15"/>
Aug 26 10:19:14 user nova-compute[73572]:       <model type="virtio"/>
Aug 26 10:19:14 user nova-compute[73572]:       <mtu size="1442"/>
Aug 26 10:19:14 user nova-compute[73572]:       <target dev="tapdb682944-89"/>
Aug 26 10:19:14 user nova-compute[73572]:     </interface>
Aug 26 10:19:14 user nova-compute[73572]:     <serial type="pty">
Aug 26 10:19:14 user nova-compute[73572]:       <log file="/opt/stack/data/nova/instances/86923c1a-89a5-4e7a-b488-8bf3a013bf83/console.log" append="off"/>
Aug 26 10:19:14 user nova-compute[73572]:     </serial>
Aug 26 10:19:14 user nova-compute[73572]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 10:19:14 user nova-compute[73572]:     <video>
Aug 26 10:19:14 user nova-compute[73572]:       <model type="virtio"/>
Aug 26 10:19:14 user nova-compute[73572]:     </video>
Aug 26 10:19:14 user nova-compute[73572]:     <rng model="virtio">
Aug 26 10:19:14 user nova-compute[73572]:       <backend model="random">/dev/urandom</backend>
Aug 26 10:19:14 user nova-compute[73572]:     </rng>
Aug 26 10:19:14 user nova-compute[73572]:     <controller type="usb" index="0" model="none"/>
Aug 26 10:19:14 user nova-compute[73572]:     <memballoon model="virtio">
Aug 26 10:19:14 user nova-compute[73572]:       <stats period="10"/>
Aug 26 10:19:14 user nova-compute[73572]:     </memballoon>
Aug 26 10:19:14 user nova-compute[73572]:   </devices>
Aug 26 10:19:14 user nova-compute[73572]: </domain>
Aug 26 10:19:14 user nova-compute[73572]:  {{(pid=73572) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 10:19:14 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-2374ab19-78d0-451e-8569-a4e950e97c4f tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T10:19:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1567915986',display_name='tempest-ServerRescueNegativeTestJSON-server-1567915986',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1567915986',id=25,image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c1bff48d66894950ac6690e1fd0e79b9',ramdisk_id='',reservation_id='r-btw4ruhw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1710547876',owner_user_name='tempest-ServerRescueNegativeTestJSON-1710547876-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T10:19:12Z,user_data=None,user_id='099462c61dcc4816b17d2d0155823873',uuid=86923c1a-89a5-4e7a-b488-8bf3a013bf83,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "db682944-8949-4bf9-b9d5-2213f0d507bc", "address": "fa:16:3e:7d:b9:15", "network": {"id": "757e71b4-5177-45a5-8ef5-9b27f42092f1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1765327616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1bff48d66894950ac6690e1fd0e79b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb682944-89", "ovs_interfaceid": "db682944-8949-4bf9-b9d5-2213f0d507bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 10:19:14 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-2374ab19-78d0-451e-8569-a4e950e97c4f tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Converting VIF {"id": "db682944-8949-4bf9-b9d5-2213f0d507bc", "address": "fa:16:3e:7d:b9:15", "network": {"id": "757e71b4-5177-45a5-8ef5-9b27f42092f1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1765327616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1bff48d66894950ac6690e1fd0e79b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb682944-89", "ovs_interfaceid": "db682944-8949-4bf9-b9d5-2213f0d507bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:19:14 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-2374ab19-78d0-451e-8569-a4e950e97c4f tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:b9:15,bridge_name='br-int',has_traffic_filtering=True,id=db682944-8949-4bf9-b9d5-2213f0d507bc,network=Network(757e71b4-5177-45a5-8ef5-9b27f42092f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb682944-89') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:19:14 user nova-compute[73572]: DEBUG os_vif [None req-2374ab19-78d0-451e-8569-a4e950e97c4f tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:b9:15,bridge_name='br-int',has_traffic_filtering=True,id=db682944-8949-4bf9-b9d5-2213f0d507bc,network=Network(757e71b4-5177-45a5-8ef5-9b27f42092f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb682944-89') {{(pid=73572) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 10:19:14 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:19:14 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:19:14 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 10:19:14 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:19:14 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdb682944-89, may_exist=True, interface_attrs={}) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:19:14 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapdb682944-89, col_values=(('external_ids', {'iface-id': 'db682944-8949-4bf9-b9d5-2213f0d507bc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7d:b9:15', 'vm-uuid': '86923c1a-89a5-4e7a-b488-8bf3a013bf83'}),), if_exists=True) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:19:14 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:19:14 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:19:15 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:19:15 user nova-compute[73572]: INFO os_vif [None req-2374ab19-78d0-451e-8569-a4e950e97c4f tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:b9:15,bridge_name='br-int',has_traffic_filtering=True,id=db682944-8949-4bf9-b9d5-2213f0d507bc,network=Network(757e71b4-5177-45a5-8ef5-9b27f42092f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb682944-89')
Aug 26 10:19:15 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-2374ab19-78d0-451e-8569-a4e950e97c4f tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] No BDM found with device name vda, not building metadata. {{(pid=73572) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 10:19:15 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-2374ab19-78d0-451e-8569-a4e950e97c4f tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] No VIF found with MAC fa:16:3e:7d:b9:15, not building metadata {{(pid=73572) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 10:19:15 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:19:16 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:19:16 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:19:16 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:19:16 user nova-compute[73572]: DEBUG nova.compute.manager [req-a670ca58-2b61-4d79-b3bc-fc4b76becdd8 req-97ee36c5-2473-48fd-9c41-52ccd301fec2 service nova] [instance: 2eaea7c2-a5c0-4950-b033-0012b5cec0ee] Received event network-vif-plugged-0b4d66c9-2155-45ae-873a-2ee85776eeb7 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:19:16 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-a670ca58-2b61-4d79-b3bc-fc4b76becdd8 req-97ee36c5-2473-48fd-9c41-52ccd301fec2 service nova] Acquiring lock "2eaea7c2-a5c0-4950-b033-0012b5cec0ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:19:16 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-a670ca58-2b61-4d79-b3bc-fc4b76becdd8 req-97ee36c5-2473-48fd-9c41-52ccd301fec2 service nova] Lock "2eaea7c2-a5c0-4950-b033-0012b5cec0ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:19:16 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-a670ca58-2b61-4d79-b3bc-fc4b76becdd8 req-97ee36c5-2473-48fd-9c41-52ccd301fec2 service nova] Lock "2eaea7c2-a5c0-4950-b033-0012b5cec0ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:19:16 user nova-compute[73572]: DEBUG nova.compute.manager [req-a670ca58-2b61-4d79-b3bc-fc4b76becdd8 req-97ee36c5-2473-48fd-9c41-52ccd301fec2 service nova] [instance: 2eaea7c2-a5c0-4950-b033-0012b5cec0ee] No waiting events found dispatching network-vif-plugged-0b4d66c9-2155-45ae-873a-2ee85776eeb7 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:19:16 user nova-compute[73572]: WARNING nova.compute.manager [req-a670ca58-2b61-4d79-b3bc-fc4b76becdd8 req-97ee36c5-2473-48fd-9c41-52ccd301fec2 service nova] [instance: 2eaea7c2-a5c0-4950-b033-0012b5cec0ee] Received unexpected event network-vif-plugged-0b4d66c9-2155-45ae-873a-2ee85776eeb7 for instance with vm_state building and task_state spawning.
Aug 26 10:19:16 user nova-compute[73572]: DEBUG nova.objects.instance [None req-7aab74aa-265c-4686-8a25-440187a7fe1c tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Lazy-loading 'flavor' on Instance uuid 00c47a06-2bf8-427d-bcb1-304688584511 {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:19:16 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-7aab74aa-265c-4686-8a25-440187a7fe1c tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Acquiring lock "refresh_cache-00c47a06-2bf8-427d-bcb1-304688584511" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:19:16 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-7aab74aa-265c-4686-8a25-440187a7fe1c tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Acquired lock "refresh_cache-00c47a06-2bf8-427d-bcb1-304688584511" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:19:16 user nova-compute[73572]: DEBUG nova.network.neutron [None req-7aab74aa-265c-4686-8a25-440187a7fe1c tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] [instance: 00c47a06-2bf8-427d-bcb1-304688584511] Building network info cache for instance {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 10:19:16 user nova-compute[73572]: DEBUG nova.objects.instance [None req-7aab74aa-265c-4686-8a25-440187a7fe1c tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Lazy-loading 'info_cache' on Instance uuid 00c47a06-2bf8-427d-bcb1-304688584511 {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:19:16 user nova-compute[73572]: DEBUG nova.objects.base [None req-7aab74aa-265c-4686-8a25-440187a7fe1c tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Object Instance<00c47a06-2bf8-427d-bcb1-304688584511> lazy-loaded attributes: flavor,info_cache {{(pid=73572) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 10:19:16 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:19:16 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:19:16 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:19:16 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:19:17 user nova-compute[73572]: DEBUG nova.network.neutron [None req-7aab74aa-265c-4686-8a25-440187a7fe1c tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] [instance: 00c47a06-2bf8-427d-bcb1-304688584511] Updating instance_info_cache with network_info: [{"id": "d18bfeb9-ad63-41d9-8d66-56df3d3306d8", "address": "fa:16:3e:a2:f2:f4", "network": {"id": "81543fb3-a8fe-4e9c-8180-c65fa4dcc9e1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-469390371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "084df935eab842e58bad79afad7090f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd18bfeb9-ad", "ovs_interfaceid": "d18bfeb9-ad63-41d9-8d66-56df3d3306d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:19:17 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-7aab74aa-265c-4686-8a25-440187a7fe1c tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Releasing lock "refresh_cache-00c47a06-2bf8-427d-bcb1-304688584511" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:19:17 user nova-compute[73572]: INFO nova.virt.libvirt.driver [-] [instance: 00c47a06-2bf8-427d-bcb1-304688584511] Instance destroyed successfully.
Aug 26 10:19:17 user nova-compute[73572]: DEBUG nova.objects.instance [None req-7aab74aa-265c-4686-8a25-440187a7fe1c tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Lazy-loading 'resources' on Instance uuid 00c47a06-2bf8-427d-bcb1-304688584511 {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:19:17 user nova-compute[73572]: DEBUG nova.objects.base [None req-7aab74aa-265c-4686-8a25-440187a7fe1c tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Object Instance<00c47a06-2bf8-427d-bcb1-304688584511> lazy-loaded attributes: flavor,info_cache,resources {{(pid=73572) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 10:19:17 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-7aab74aa-265c-4686-8a25-440187a7fe1c tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T10:15:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-767184678',display_name='tempest-AttachVolumeTestJSON-server-767184678',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-767184678',id=15,image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDUM4e46LSrHmno1gp4T3RRXiXfjHx917gcUppmI/sxQPEY8hKY/vqoEhT+Bxby7kAu1Ei3af6xY5p/QME/Z3JthPiVJQ1F4Ur+7V+CECg8DAf4Z/fI85QJzneAszEfomQ==',key_name='tempest-keypair-643189050',keypairs=<?>,launch_index=0,launched_at=2023-08-26T10:15:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='084df935eab842e58bad79afad7090f3',ramdisk_id='',reservation_id='r-d4j1rgky',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-716261196',owner_user_name='tempest-AttachVolumeTestJSON-716261196-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T10:17:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2a2ef00486924f318ff1e7e502e835a6',uuid=00c47a06-2bf8-427d-bcb1-304688584511,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "d18bfeb9-ad63-41d9-8d66-56df3d3306d8", "address": "fa:16:3e:a2:f2:f4", "network": {"id": "81543fb3-a8fe-4e9c-8180-c65fa4dcc9e1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-469390371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "084df935eab842e58bad79afad7090f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd18bfeb9-ad", "ovs_interfaceid": "d18bfeb9-ad63-41d9-8d66-56df3d3306d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 10:19:17 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-7aab74aa-265c-4686-8a25-440187a7fe1c tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Converting VIF {"id": "d18bfeb9-ad63-41d9-8d66-56df3d3306d8", "address": "fa:16:3e:a2:f2:f4", "network": {"id": "81543fb3-a8fe-4e9c-8180-c65fa4dcc9e1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-469390371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "084df935eab842e58bad79afad7090f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd18bfeb9-ad", "ovs_interfaceid": "d18bfeb9-ad63-41d9-8d66-56df3d3306d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:19:17 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-7aab74aa-265c-4686-8a25-440187a7fe1c tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:f2:f4,bridge_name='br-int',has_traffic_filtering=True,id=d18bfeb9-ad63-41d9-8d66-56df3d3306d8,network=Network(81543fb3-a8fe-4e9c-8180-c65fa4dcc9e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd18bfeb9-ad') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:19:17 user nova-compute[73572]: DEBUG os_vif [None req-7aab74aa-265c-4686-8a25-440187a7fe1c tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:f2:f4,bridge_name='br-int',has_traffic_filtering=True,id=d18bfeb9-ad63-41d9-8d66-56df3d3306d8,network=Network(81543fb3-a8fe-4e9c-8180-c65fa4dcc9e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd18bfeb9-ad') {{(pid=73572) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 10:19:17 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:19:17 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd18bfeb9-ad, bridge=br-int, if_exists=True) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:19:17 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:19:17 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:19:17 user nova-compute[73572]: INFO os_vif [None req-7aab74aa-265c-4686-8a25-440187a7fe1c tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:f2:f4,bridge_name='br-int',has_traffic_filtering=True,id=d18bfeb9-ad63-41d9-8d66-56df3d3306d8,network=Network(81543fb3-a8fe-4e9c-8180-c65fa4dcc9e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd18bfeb9-ad')
Aug 26 10:19:17 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7aab74aa-265c-4686-8a25-440187a7fe1c tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] [instance: 00c47a06-2bf8-427d-bcb1-304688584511] calling os-brick to detach iSCSI Volume {{(pid=73572) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 10:19:17 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-7aab74aa-265c-4686-8a25-440187a7fe1c tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc89c3d6a10>, {'target_iqns': ['iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bpfqgBQW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 10:19:17 user nova-compute[73572]: WARNING os_brick.initiator.connectors.base [None req-7aab74aa-265c-4686-8a25-440187a7fe1c tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 10:19:17 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-7aab74aa-265c-4686-8a25-440187a7fe1c tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 10:19:17 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-7aab74aa-265c-4686-8a25-440187a7fe1c tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 10:19:17 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-7aab74aa-265c-4686-8a25-440187a7fe1c tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478', 0)] {{(pid=73572) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 10:19:17 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:19:17 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:19:17 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[91b3a6ca-4949-46fa-b315-82ff9e6e87d3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:302c3cfe-f0ec-4b1c-b1d9-dc12d4f4ce40\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:57b56972-76f9-44aa-905c-14d04f924f76\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c22666f6-bb12-41a8-b565-837f4617df4e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d94556c8-9096-4e9a-9cfc-f9d17846ed06\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eaa45a8a-93fc-4fac-bc41-ce4fa5173718\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:19:17 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:19:17 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:19:17 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d1d3034-3a62-40d1-94b8-10e0e9bea61b]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d94556c8-9096-4e9a-9cfc-f9d17846ed06 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c22666f6-bb12-41a8-b565-837f4617df4e (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57b56972-76f9-44aa-905c-14d04f924f76 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaa45a8a-93fc-4fac-bc41-ce4fa5173718 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:302c3cfe-f0ec-4b1c-b1d9-dc12d4f4ce40 (non-flash)\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:19:17 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-7aab74aa-265c-4686-8a25-440187a7fe1c tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)
Aug 26 10:19:17 user nova-compute[73572]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478 (non-flash)
Aug 26 10:19:17 user nova-compute[73572]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d94556c8-9096-4e9a-9cfc-f9d17846ed06 (non-flash)
Aug 26 10:19:17 user nova-compute[73572]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c22666f6-bb12-41a8-b565-837f4617df4e (non-flash)
Aug 26 10:19:17 user nova-compute[73572]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57b56972-76f9-44aa-905c-14d04f924f76 (non-flash)
Aug 26 10:19:17 user nova-compute[73572]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaa45a8a-93fc-4fac-bc41-ce4fa5173718 (non-flash)
Aug 26 10:19:17 user nova-compute[73572]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:302c3cfe-f0ec-4b1c-b1d9-dc12d4f4ce40 (non-flash)
Aug 26 10:19:17 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 10:19:17 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-7aab74aa-265c-4686-8a25-440187a7fe1c tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)
Aug 26 10:19:17 user nova-compute[73572]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478 (non-flash)
Aug 26 10:19:17 user nova-compute[73572]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d94556c8-9096-4e9a-9cfc-f9d17846ed06 (non-flash)
Aug 26 10:19:17 user nova-compute[73572]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c22666f6-bb12-41a8-b565-837f4617df4e (non-flash)
Aug 26 10:19:17 user nova-compute[73572]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57b56972-76f9-44aa-905c-14d04f924f76 (non-flash)
Aug 26 10:19:17 user nova-compute[73572]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaa45a8a-93fc-4fac-bc41-ce4fa5173718 (non-flash)
Aug 26 10:19:17 user nova-compute[73572]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:302c3cfe-f0ec-4b1c-b1d9-dc12d4f4ce40 (non-flash)
Aug 26 10:19:17 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 10:19:17 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-7aab74aa-265c-4686-8a25-440187a7fe1c tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc878dc6dd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478'): ({'sdb'}, set())}) {{(pid=73572) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 10:19:17 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-7aab74aa-265c-4686-8a25-440187a7fe1c tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Removing single pathed devices sdb {{(pid=73572) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 10:19:17 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:19:17 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:19:17 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:19:17 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[41656711-2e56-40e0-b592-2a92d1314740]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:19:17 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:19:17 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.037s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:19:17 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec7bd2be-b63e-4dce-a43f-d37b48b59d07]: (4, ('ok\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:19:17 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-7aab74aa-265c-4686-8a25-440187a7fe1c tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Flushing IO for device /dev/sdb {{(pid=73572) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 10:19:17 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:19:17 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:19:17 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:19:17 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:19:17 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[82d71a50-d56a-4a53-be5d-ceeb07fab415]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:19:17 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-7aab74aa-265c-4686-8a25-440187a7fe1c tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73572) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 10:19:17 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:19:17 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:19:17 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:19:17 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:19:17 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Starting heal instance info cache {{(pid=73572) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 10:19:17 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.050s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:19:17 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[0274b798-1583-4ee5-b8e9-f7a20dc5cec0]: (4, ('1', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:19:17 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-7aab74aa-265c-4686-8a25-440187a7fe1c tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73572) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 10:19:17 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-7aab74aa-265c-4686-8a25-440187a7fe1c tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] SCSI volumes sdb have been removed. {{(pid=73572) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 10:19:17 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-7aab74aa-265c-4686-8a25-440187a7fe1c tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478')] {{(pid=73572) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 10:19:17 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:19:17 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:19:17 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9a9cc05-f4e8-40e8-91d5-f6a49b75aff9]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:19:17 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-7aab74aa-265c-4686-8a25-440187a7fe1c tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:19:17 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478 -p 172.16.0.220:3260 --logout {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:19:17 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478 -p 172.16.0.220:3260 --logout" returned: 0 in 0.078s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:19:17 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[b51e9d71-d878-4ddc-9715-94fd88c2b917]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:19:17 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-7aab74aa-265c-4686-8a25-440187a7fe1c tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478, portal: 172.16.0.220,3260]
Aug 26 10:19:17 user nova-compute[73572]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478, portal: 172.16.0.220,3260] successful.
Aug 26 10:19:17 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:19:17 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478 -p 172.16.0.220:3260 --op delete {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:19:17 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquiring lock "refresh_cache-8302d6e7-aaf3-461c-a55e-f2e685d1800d" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:19:17 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquired lock "refresh_cache-8302d6e7-aaf3-461c-a55e-f2e685d1800d" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:19:17 user nova-compute[73572]: DEBUG nova.network.neutron [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] [instance: 8302d6e7-aaf3-461c-a55e-f2e685d1800d] Forcefully refreshing network info cache for instance {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 10:19:17 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:19:17 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8fe15df-7e2f-42dc-a324-37171ecfa592]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:19:17 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-7aab74aa-265c-4686-8a25-440187a7fe1c tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:19:17 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-7aab74aa-265c-4686-8a25-440187a7fe1c tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.395s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 10:19:17 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-7aab74aa-265c-4686-8a25-440187a7fe1c tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] <== disconnect_volume: return (397ms) None {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 10:19:17 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7aab74aa-265c-4686-8a25-440187a7fe1c tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] [instance: 00c47a06-2bf8-427d-bcb1-304688584511] Disconnected iSCSI Volume {{(pid=73572) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 10:19:17 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-7aab74aa-265c-4686-8a25-440187a7fe1c tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] [instance: 00c47a06-2bf8-427d-bcb1-304688584511] Start _get_guest_xml network_info=[{"id": "d18bfeb9-ad63-41d9-8d66-56df3d3306d8", "address": "fa:16:3e:a2:f2:f4", "network": {"id": "81543fb3-a8fe-4e9c-8180-c65fa4dcc9e1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-469390371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "084df935eab842e58bad79afad7090f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd18bfeb9-ad", "ovs_interfaceid": "d18bfeb9-ad63-41d9-8d66-56df3d3306d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=299da0c9-e1c4-48f0-be55-fbe20dd06bc9,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'guest_format': None, 'size': 0, 'encryption_format': None, 'device_type': 'disk', 'image_id': '299da0c9-e1c4-48f0-be55-fbe20dd06bc9'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'disk_bus': 'virtio', 'boot_index': None, 'mount_device': '/dev/vdb', 'attachment_id': '72c3ccf1-c005-4caf-a75a-edf67652de29', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bpfqgBQW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '00c47a06-2bf8-427d-bcb1-304688584511', 'attached_at': '', 'detached_at': '', 'volume_id': 'fceee937-cad2-4ce8-8a00-49b3ffab9478', 'serial': 'fceee937-cad2-4ce8-8a00-49b3ffab9478'}, 'guest_format': None, 'device_type': 'disk', 'volume_type': None} {{(pid=73572) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 10:19:17 user nova-compute[73572]: DEBUG nova.objects.instance [None req-7aab74aa-265c-4686-8a25-440187a7fe1c tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Lazy-loading 'numa_topology' on Instance uuid 00c47a06-2bf8-427d-bcb1-304688584511 {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:19:17 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:19:17 user nova-compute[73572]: DEBUG nova.objects.base [None req-7aab74aa-265c-4686-8a25-440187a7fe1c tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Object Instance<00c47a06-2bf8-427d-bcb1-304688584511> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=73572) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 10:19:17 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-7aab74aa-265c-4686-8a25-440187a7fe1c tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:19:17 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-7aab74aa-265c-4686-8a25-440187a7fe1c tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:19:17 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-7aab74aa-265c-4686-8a25-440187a7fe1c tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73572) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 10:19:17 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-7aab74aa-265c-4686-8a25-440187a7fe1c tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] CPU controller missing on host. {{(pid=73572) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 10:19:17 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-7aab74aa-265c-4686-8a25-440187a7fe1c tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73572) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 10:19:17 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-7aab74aa-265c-4686-8a25-440187a7fe1c tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] CPU controller found on host. {{(pid=73572) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 10:19:17 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-7aab74aa-265c-4686-8a25-440187a7fe1c tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73572) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 10:19:17 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-7aab74aa-265c-4686-8a25-440187a7fe1c tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T10:07:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=299da0c9-e1c4-48f0-be55-fbe20dd06bc9,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 10:19:17 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-7aab74aa-265c-4686-8a25-440187a7fe1c tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Flavor limits 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 10:19:17 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-7aab74aa-265c-4686-8a25-440187a7fe1c tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Image limits 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 10:19:17 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-7aab74aa-265c-4686-8a25-440187a7fe1c tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Flavor pref 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 10:19:17 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-7aab74aa-265c-4686-8a25-440187a7fe1c tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Image pref 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 10:19:17 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-7aab74aa-265c-4686-8a25-440187a7fe1c tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 10:19:17 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-7aab74aa-265c-4686-8a25-440187a7fe1c tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 10:19:17 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-7aab74aa-265c-4686-8a25-440187a7fe1c tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73572) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 10:19:17 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-7aab74aa-265c-4686-8a25-440187a7fe1c tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Got 1 possible topologies {{(pid=73572) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 10:19:17 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-7aab74aa-265c-4686-8a25-440187a7fe1c tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 10:19:17 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-7aab74aa-265c-4686-8a25-440187a7fe1c tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 10:19:17 user nova-compute[73572]: DEBUG nova.objects.instance [None req-7aab74aa-265c-4686-8a25-440187a7fe1c tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Lazy-loading 'vcpu_model' on Instance uuid 00c47a06-2bf8-427d-bcb1-304688584511 {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:19:17 user nova-compute[73572]: DEBUG nova.objects.base [None req-7aab74aa-265c-4686-8a25-440187a7fe1c tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Object Instance<00c47a06-2bf8-427d-bcb1-304688584511> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=73572) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 10:19:17 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7aab74aa-265c-4686-8a25-440187a7fe1c tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] [instance: 00c47a06-2bf8-427d-bcb1-304688584511] Calling os-brick to attach iSCSI Volume {{(pid=73572) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 10:19:17 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-7aab74aa-265c-4686-8a25-440187a7fe1c tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc89c3d6a10>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bpfqgBQW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 10:19:17 user nova-compute[73572]: WARNING os_brick.initiator.connectors.base [None req-7aab74aa-265c-4686-8a25-440187a7fe1c tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 10:19:17 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-7aab74aa-265c-4686-8a25-440187a7fe1c tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 10:19:17 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-7aab74aa-265c-4686-8a25-440187a7fe1c tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 10:19:17 user nova-compute[73572]: WARNING os_brick.initiator.connectors.base [None req-7aab74aa-265c-4686-8a25-440187a7fe1c tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 10:19:17 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-7aab74aa-265c-4686-8a25-440187a7fe1c tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 10:19:17 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-7aab74aa-265c-4686-8a25-440187a7fe1c tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 10:19:17 user nova-compute[73572]: INFO os_brick.initiator.connectors.iscsi [None req-7aab74aa-265c-4686-8a25-440187a7fe1c tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 10:19:17 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478 -p 172.16.0.220:3260 {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:19:17 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:19:17 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[938d9f88-4b34-4aae-90c2-8b9798cdd0dd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:19:17 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-7aab74aa-265c-4686-8a25-440187a7fe1c tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 10:19:17 user nova-compute[73572]:  {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:19:17 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478 -p 172.16.0.220:3260 --interface default --op new {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:19:17 user nova-compute[73572]: DEBUG nova.compute.manager [req-debe14ba-9b76-4e15-8594-7b293cfb3ecd req-db161185-abf8-4ec6-9af5-991a3aac80d1 service nova] [instance: 86923c1a-89a5-4e7a-b488-8bf3a013bf83] Received event network-vif-plugged-db682944-8949-4bf9-b9d5-2213f0d507bc {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:19:17 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-debe14ba-9b76-4e15-8594-7b293cfb3ecd req-db161185-abf8-4ec6-9af5-991a3aac80d1 service nova] Acquiring lock "86923c1a-89a5-4e7a-b488-8bf3a013bf83-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:19:17 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-debe14ba-9b76-4e15-8594-7b293cfb3ecd req-db161185-abf8-4ec6-9af5-991a3aac80d1 service nova] Lock "86923c1a-89a5-4e7a-b488-8bf3a013bf83-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:19:17 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-debe14ba-9b76-4e15-8594-7b293cfb3ecd req-db161185-abf8-4ec6-9af5-991a3aac80d1 service nova] Lock "86923c1a-89a5-4e7a-b488-8bf3a013bf83-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:19:17 user nova-compute[73572]: DEBUG nova.compute.manager [req-debe14ba-9b76-4e15-8594-7b293cfb3ecd req-db161185-abf8-4ec6-9af5-991a3aac80d1 service nova] [instance: 86923c1a-89a5-4e7a-b488-8bf3a013bf83] No waiting events found dispatching network-vif-plugged-db682944-8949-4bf9-b9d5-2213f0d507bc {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:19:17 user nova-compute[73572]: WARNING nova.compute.manager [req-debe14ba-9b76-4e15-8594-7b293cfb3ecd req-db161185-abf8-4ec6-9af5-991a3aac80d1 service nova] [instance: 86923c1a-89a5-4e7a-b488-8bf3a013bf83] Received unexpected event network-vif-plugged-db682944-8949-4bf9-b9d5-2213f0d507bc for instance with vm_state building and task_state spawning.
Aug 26 10:19:17 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:19:17 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[542f1f63-6140-4b2f-936d-74a93829f134]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478] added\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:19:17 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-7aab74aa-265c-4686-8a25-440187a7fe1c tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478] added
Aug 26 10:19:17 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:19:17 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:19:17 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:19:17 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[8335c89f-d762-42c0-a6fa-9f69488df8a2]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:19:17 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-7aab74aa-265c-4686-8a25-440187a7fe1c tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:19:17 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:19:17 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.036s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:19:17 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ae10c7a-2e80-4cb5-ada7-8ee9e1d52245]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:19:17 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-7aab74aa-265c-4686-8a25-440187a7fe1c tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:19:17 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bpfqgBQW {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:19:17 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bpfqgBQW" returned: 0 in 0.026s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:19:17 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ba7ad70-7202-4b1e-a312-5cb4ac482a87]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:19:17 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-7aab74aa-265c-4686-8a25-440187a7fe1c tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bpfqgBQW'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:19:17 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:19:17 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:19:17 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[e16fe250-f6da-41a3-a78d-a260d93be6f5]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:19:17 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-7aab74aa-265c-4686-8a25-440187a7fe1c tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:19:17 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:19:17 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:19:17 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[71921761-91da-424f-995e-797f3774a6ed]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d94556c8-9096-4e9a-9cfc-f9d17846ed06 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c22666f6-bb12-41a8-b565-837f4617df4e (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57b56972-76f9-44aa-905c-14d04f924f76 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaa45a8a-93fc-4fac-bc41-ce4fa5173718 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:302c3cfe-f0ec-4b1c-b1d9-dc12d4f4ce40 (non-flash)\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:19:17 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-7aab74aa-265c-4686-8a25-440187a7fe1c tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)
Aug 26 10:19:17 user nova-compute[73572]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d94556c8-9096-4e9a-9cfc-f9d17846ed06 (non-flash)
Aug 26 10:19:17 user nova-compute[73572]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c22666f6-bb12-41a8-b565-837f4617df4e (non-flash)
Aug 26 10:19:17 user nova-compute[73572]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57b56972-76f9-44aa-905c-14d04f924f76 (non-flash)
Aug 26 10:19:17 user nova-compute[73572]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaa45a8a-93fc-4fac-bc41-ce4fa5173718 (non-flash)
Aug 26 10:19:17 user nova-compute[73572]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:302c3cfe-f0ec-4b1c-b1d9-dc12d4f4ce40 (non-flash)
Aug 26 10:19:17 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 10:19:17 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-7aab74aa-265c-4686-8a25-440187a7fe1c tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)
Aug 26 10:19:17 user nova-compute[73572]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d94556c8-9096-4e9a-9cfc-f9d17846ed06 (non-flash)
Aug 26 10:19:17 user nova-compute[73572]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c22666f6-bb12-41a8-b565-837f4617df4e (non-flash)
Aug 26 10:19:17 user nova-compute[73572]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57b56972-76f9-44aa-905c-14d04f924f76 (non-flash)
Aug 26 10:19:17 user nova-compute[73572]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaa45a8a-93fc-4fac-bc41-ce4fa5173718 (non-flash)
Aug 26 10:19:17 user nova-compute[73572]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:302c3cfe-f0ec-4b1c-b1d9-dc12d4f4ce40 (non-flash)
Aug 26 10:19:17 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 10:19:17 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478 -p 172.16.0.220:3260 --login {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:19:18 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478 -p 172.16.0.220:3260 --login" returned: 0 in 0.084s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:19:18 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d3dea6d-3314-4904-9235-3114e0181181]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:19:18 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-7aab74aa-265c-4686-8a25-440187a7fe1c tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478, portal: 172.16.0.220,3260]
Aug 26 10:19:18 user nova-compute[73572]: Login to [iface: default, target: iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478, portal: 172.16.0.220,3260] successful.
Aug 26 10:19:18 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:19:18 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:19:18 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:19:18 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[18444b8e-e894-40aa-bdca-028d41810c94]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:19:18 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-7aab74aa-265c-4686-8a25-440187a7fe1c tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:19:18 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:19:18 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:19:18 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc94a14d-2dea-4133-b25d-4c7e203642ea]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d94556c8-9096-4e9a-9cfc-f9d17846ed06 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c22666f6-bb12-41a8-b565-837f4617df4e (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57b56972-76f9-44aa-905c-14d04f924f76 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaa45a8a-93fc-4fac-bc41-ce4fa5173718 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:302c3cfe-f0ec-4b1c-b1d9-dc12d4f4ce40 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478 (non-flash)\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:19:18 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-7aab74aa-265c-4686-8a25-440187a7fe1c tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)
Aug 26 10:19:18 user nova-compute[73572]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d94556c8-9096-4e9a-9cfc-f9d17846ed06 (non-flash)
Aug 26 10:19:18 user nova-compute[73572]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c22666f6-bb12-41a8-b565-837f4617df4e (non-flash)
Aug 26 10:19:18 user nova-compute[73572]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57b56972-76f9-44aa-905c-14d04f924f76 (non-flash)
Aug 26 10:19:18 user nova-compute[73572]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaa45a8a-93fc-4fac-bc41-ce4fa5173718 (non-flash)
Aug 26 10:19:18 user nova-compute[73572]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:302c3cfe-f0ec-4b1c-b1d9-dc12d4f4ce40 (non-flash)
Aug 26 10:19:18 user nova-compute[73572]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478 (non-flash)
Aug 26 10:19:18 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 10:19:18 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-7aab74aa-265c-4686-8a25-440187a7fe1c tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)
Aug 26 10:19:18 user nova-compute[73572]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d94556c8-9096-4e9a-9cfc-f9d17846ed06 (non-flash)
Aug 26 10:19:18 user nova-compute[73572]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c22666f6-bb12-41a8-b565-837f4617df4e (non-flash)
Aug 26 10:19:18 user nova-compute[73572]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57b56972-76f9-44aa-905c-14d04f924f76 (non-flash)
Aug 26 10:19:18 user nova-compute[73572]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaa45a8a-93fc-4fac-bc41-ce4fa5173718 (non-flash)
Aug 26 10:19:18 user nova-compute[73572]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:302c3cfe-f0ec-4b1c-b1d9-dc12d4f4ce40 (non-flash)
Aug 26 10:19:18 user nova-compute[73572]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478 (non-flash)
Aug 26 10:19:18 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 10:19:18 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-7aab74aa-265c-4686-8a25-440187a7fe1c tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.399s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 10:19:18 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-7aab74aa-265c-4686-8a25-440187a7fe1c tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Connected to 172.16.0.220:3260 {{(pid=73572) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 10:19:18 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-7aab74aa-265c-4686-8a25-440187a7fe1c tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] HCTL ('33', '-', '-', 0) found on session 24 with lun 0 {{(pid=73572) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 10:19:18 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-7aab74aa-265c-4686-8a25-440187a7fe1c tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73572) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 10:19:18 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:19:18 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.024s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:19:18 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[caa95b23-efcc-4761-bfd8-56d9e2bab4e1]: (4, ('- - 0', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:19:18 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-7aab74aa-265c-4686-8a25-440187a7fe1c tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Searching for a device in session 24 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73572) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 10:19:18 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-7aab74aa-265c-4686-8a25-440187a7fe1c tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bpfqgBQW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73572) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 10:19:18 user nova-compute[73572]: DEBUG nova.compute.manager [req-917634b7-bcbf-46a9-8b39-024b8d0cdcb9 req-e6c5ecf1-9385-427c-95cd-828969061a98 service nova] [instance: 2eaea7c2-a5c0-4950-b033-0012b5cec0ee] Received event network-vif-plugged-0b4d66c9-2155-45ae-873a-2ee85776eeb7 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:19:18 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-917634b7-bcbf-46a9-8b39-024b8d0cdcb9 req-e6c5ecf1-9385-427c-95cd-828969061a98 service nova] Acquiring lock "2eaea7c2-a5c0-4950-b033-0012b5cec0ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:19:18 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-917634b7-bcbf-46a9-8b39-024b8d0cdcb9 req-e6c5ecf1-9385-427c-95cd-828969061a98 service nova] Lock "2eaea7c2-a5c0-4950-b033-0012b5cec0ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:19:18 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-917634b7-bcbf-46a9-8b39-024b8d0cdcb9 req-e6c5ecf1-9385-427c-95cd-828969061a98 service nova] Lock "2eaea7c2-a5c0-4950-b033-0012b5cec0ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:19:18 user nova-compute[73572]: DEBUG nova.compute.manager [req-917634b7-bcbf-46a9-8b39-024b8d0cdcb9 req-e6c5ecf1-9385-427c-95cd-828969061a98 service nova] [instance: 2eaea7c2-a5c0-4950-b033-0012b5cec0ee] No waiting events found dispatching network-vif-plugged-0b4d66c9-2155-45ae-873a-2ee85776eeb7 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:19:18 user nova-compute[73572]: WARNING nova.compute.manager [req-917634b7-bcbf-46a9-8b39-024b8d0cdcb9 req-e6c5ecf1-9385-427c-95cd-828969061a98 service nova] [instance: 2eaea7c2-a5c0-4950-b033-0012b5cec0ee] Received unexpected event network-vif-plugged-0b4d66c9-2155-45ae-873a-2ee85776eeb7 for instance with vm_state building and task_state spawning.
Aug 26 10:19:18 user nova-compute[73572]: DEBUG nova.network.neutron [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] [instance: 8302d6e7-aaf3-461c-a55e-f2e685d1800d] Updating instance_info_cache with network_info: [{"id": "61c82fb7-2eee-4be0-a37f-669791ea6d9c", "address": "fa:16:3e:6a:1a:9f", "network": {"id": "f4c05fef-baf8-4c06-876f-1bdccd5a8689", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-169805980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27e946bd18464231965d43e20f1d2201", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61c82fb7-2e", "ovs_interfaceid": "61c82fb7-2eee-4be0-a37f-669791ea6d9c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:19:18 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Releasing lock "refresh_cache-8302d6e7-aaf3-461c-a55e-f2e685d1800d" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:19:18 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] [instance: 8302d6e7-aaf3-461c-a55e-f2e685d1800d] Updated the network info_cache for instance {{(pid=73572) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 10:19:18 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:19:18 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:19:18 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:19:18 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:19:18 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:19:18 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:19:18 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73572) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 10:19:19 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-7aab74aa-265c-4686-8a25-440187a7fe1c tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.464s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 10:19:19 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-7aab74aa-265c-4686-8a25-440187a7fe1c tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] <== connect_volume: return (1466ms) {'type': 'block', 'scsi_wwn': '23365316561383430', 'path': '/dev/sdb'} {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 10:19:19 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7aab74aa-265c-4686-8a25-440187a7fe1c tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] [instance: 00c47a06-2bf8-427d-bcb1-304688584511] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23365316561383430', 'path': '/dev/sdb'} {{(pid=73572) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 10:19:19 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-7aab74aa-265c-4686-8a25-440187a7fe1c tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T10:15:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-767184678',display_name='tempest-AttachVolumeTestJSON-server-767184678',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-767184678',id=15,image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDUM4e46LSrHmno1gp4T3RRXiXfjHx917gcUppmI/sxQPEY8hKY/vqoEhT+Bxby7kAu1Ei3af6xY5p/QME/Z3JthPiVJQ1F4Ur+7V+CECg8DAf4Z/fI85QJzneAszEfomQ==',key_name='tempest-keypair-643189050',keypairs=<?>,launch_index=0,launched_at=2023-08-26T10:15:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='084df935eab842e58bad79afad7090f3',ramdisk_id='',reservation_id='r-d4j1rgky',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-716261196',owner_user_name='tempest-AttachVolumeTestJSON-716261196-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T10:17:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2a2ef00486924f318ff1e7e502e835a6',uuid=00c47a06-2bf8-427d-bcb1-304688584511,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "d18bfeb9-ad63-41d9-8d66-56df3d3306d8", "address": "fa:16:3e:a2:f2:f4", "network": {"id": "81543fb3-a8fe-4e9c-8180-c65fa4dcc9e1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-469390371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "084df935eab842e58bad79afad7090f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd18bfeb9-ad", "ovs_interfaceid": "d18bfeb9-ad63-41d9-8d66-56df3d3306d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73572) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 10:19:19 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-7aab74aa-265c-4686-8a25-440187a7fe1c tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Converting VIF {"id": "d18bfeb9-ad63-41d9-8d66-56df3d3306d8", "address": "fa:16:3e:a2:f2:f4", "network": {"id": "81543fb3-a8fe-4e9c-8180-c65fa4dcc9e1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-469390371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "084df935eab842e58bad79afad7090f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd18bfeb9-ad", "ovs_interfaceid": "d18bfeb9-ad63-41d9-8d66-56df3d3306d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:19:19 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-7aab74aa-265c-4686-8a25-440187a7fe1c tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:f2:f4,bridge_name='br-int',has_traffic_filtering=True,id=d18bfeb9-ad63-41d9-8d66-56df3d3306d8,network=Network(81543fb3-a8fe-4e9c-8180-c65fa4dcc9e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd18bfeb9-ad') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:19:19 user nova-compute[73572]: DEBUG nova.objects.instance [None req-7aab74aa-265c-4686-8a25-440187a7fe1c tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Lazy-loading 'pci_devices' on Instance uuid 00c47a06-2bf8-427d-bcb1-304688584511 {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:19:19 user nova-compute[73572]: DEBUG nova.objects.base [None req-7aab74aa-265c-4686-8a25-440187a7fe1c tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Object Instance<00c47a06-2bf8-427d-bcb1-304688584511> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=73572) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 10:19:19 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-7aab74aa-265c-4686-8a25-440187a7fe1c tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] [instance: 00c47a06-2bf8-427d-bcb1-304688584511] End _get_guest_xml xml=<domain type="kvm">
Aug 26 10:19:19 user nova-compute[73572]:   <uuid>00c47a06-2bf8-427d-bcb1-304688584511</uuid>
Aug 26 10:19:19 user nova-compute[73572]:   <name>instance-0000000f</name>
Aug 26 10:19:19 user nova-compute[73572]:   <memory>524288</memory>
Aug 26 10:19:19 user nova-compute[73572]:   <vcpu>1</vcpu>
Aug 26 10:19:19 user nova-compute[73572]:   <metadata>
Aug 26 10:19:19 user nova-compute[73572]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 10:19:19 user nova-compute[73572]:       <nova:package version="0.0.0"/>
Aug 26 10:19:19 user nova-compute[73572]:       <nova:name>tempest-AttachVolumeTestJSON-server-767184678</nova:name>
Aug 26 10:19:19 user nova-compute[73572]:       <nova:creationTime>2023-08-26 10:19:17</nova:creationTime>
Aug 26 10:19:19 user nova-compute[73572]:       <nova:flavor name="m1.tiny">
Aug 26 10:19:19 user nova-compute[73572]:         <nova:memory>512</nova:memory>
Aug 26 10:19:19 user nova-compute[73572]:         <nova:disk>1</nova:disk>
Aug 26 10:19:19 user nova-compute[73572]:         <nova:swap>0</nova:swap>
Aug 26 10:19:19 user nova-compute[73572]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 10:19:19 user nova-compute[73572]:         <nova:vcpus>1</nova:vcpus>
Aug 26 10:19:19 user nova-compute[73572]:       </nova:flavor>
Aug 26 10:19:19 user nova-compute[73572]:       <nova:owner>
Aug 26 10:19:19 user nova-compute[73572]:         <nova:user uuid="2a2ef00486924f318ff1e7e502e835a6">tempest-AttachVolumeTestJSON-716261196-project-member</nova:user>
Aug 26 10:19:19 user nova-compute[73572]:         <nova:project uuid="084df935eab842e58bad79afad7090f3">tempest-AttachVolumeTestJSON-716261196</nova:project>
Aug 26 10:19:19 user nova-compute[73572]:       </nova:owner>
Aug 26 10:19:19 user nova-compute[73572]:       <nova:root type="image" uuid="299da0c9-e1c4-48f0-be55-fbe20dd06bc9"/>
Aug 26 10:19:19 user nova-compute[73572]:       <nova:ports>
Aug 26 10:19:19 user nova-compute[73572]:         <nova:port uuid="d18bfeb9-ad63-41d9-8d66-56df3d3306d8">
Aug 26 10:19:19 user nova-compute[73572]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 26 10:19:19 user nova-compute[73572]:         </nova:port>
Aug 26 10:19:19 user nova-compute[73572]:       </nova:ports>
Aug 26 10:19:19 user nova-compute[73572]:     </nova:instance>
Aug 26 10:19:19 user nova-compute[73572]:   </metadata>
Aug 26 10:19:19 user nova-compute[73572]:   <sysinfo type="smbios">
Aug 26 10:19:19 user nova-compute[73572]:     <system>
Aug 26 10:19:19 user nova-compute[73572]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 10:19:19 user nova-compute[73572]:       <entry name="product">OpenStack Nova</entry>
Aug 26 10:19:19 user nova-compute[73572]:       <entry name="version">0.0.0</entry>
Aug 26 10:19:19 user nova-compute[73572]:       <entry name="serial">00c47a06-2bf8-427d-bcb1-304688584511</entry>
Aug 26 10:19:19 user nova-compute[73572]:       <entry name="uuid">00c47a06-2bf8-427d-bcb1-304688584511</entry>
Aug 26 10:19:19 user nova-compute[73572]:       <entry name="family">Virtual Machine</entry>
Aug 26 10:19:19 user nova-compute[73572]:     </system>
Aug 26 10:19:19 user nova-compute[73572]:   </sysinfo>
Aug 26 10:19:19 user nova-compute[73572]:   <os>
Aug 26 10:19:19 user nova-compute[73572]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 10:19:19 user nova-compute[73572]:     <boot dev="hd"/>
Aug 26 10:19:19 user nova-compute[73572]:     <smbios mode="sysinfo"/>
Aug 26 10:19:19 user nova-compute[73572]:   </os>
Aug 26 10:19:19 user nova-compute[73572]:   <features>
Aug 26 10:19:19 user nova-compute[73572]:     <acpi/>
Aug 26 10:19:19 user nova-compute[73572]:     <apic/>
Aug 26 10:19:19 user nova-compute[73572]:     <vmcoreinfo/>
Aug 26 10:19:19 user nova-compute[73572]:   </features>
Aug 26 10:19:19 user nova-compute[73572]:   <clock offset="utc">
Aug 26 10:19:19 user nova-compute[73572]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 10:19:19 user nova-compute[73572]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 10:19:19 user nova-compute[73572]:     <timer name="hpet" present="no"/>
Aug 26 10:19:19 user nova-compute[73572]:   </clock>
Aug 26 10:19:19 user nova-compute[73572]:   <cpu mode="custom" match="exact">
Aug 26 10:19:19 user nova-compute[73572]:     <model>Nehalem</model>
Aug 26 10:19:19 user nova-compute[73572]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 10:19:19 user nova-compute[73572]:   </cpu>
Aug 26 10:19:19 user nova-compute[73572]:   <devices>
Aug 26 10:19:19 user nova-compute[73572]:     <disk type="file" device="disk">
Aug 26 10:19:19 user nova-compute[73572]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 10:19:19 user nova-compute[73572]:       <source file="/opt/stack/data/nova/instances/00c47a06-2bf8-427d-bcb1-304688584511/disk"/>
Aug 26 10:19:19 user nova-compute[73572]:       <target dev="vda" bus="virtio"/>
Aug 26 10:19:19 user nova-compute[73572]:     </disk>
Aug 26 10:19:19 user nova-compute[73572]:     <disk type="block" device="disk">
Aug 26 10:19:19 user nova-compute[73572]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 10:19:19 user nova-compute[73572]:       <source dev="/dev/sdb"/>
Aug 26 10:19:19 user nova-compute[73572]:       <target dev="vdb" bus="virtio"/>
Aug 26 10:19:19 user nova-compute[73572]:       <serial>fceee937-cad2-4ce8-8a00-49b3ffab9478</serial>
Aug 26 10:19:19 user nova-compute[73572]:     </disk>
Aug 26 10:19:19 user nova-compute[73572]:     <interface type="ethernet">
Aug 26 10:19:19 user nova-compute[73572]:       <mac address="fa:16:3e:a2:f2:f4"/>
Aug 26 10:19:19 user nova-compute[73572]:       <model type="virtio"/>
Aug 26 10:19:19 user nova-compute[73572]:       <mtu size="1442"/>
Aug 26 10:19:19 user nova-compute[73572]:       <target dev="tapd18bfeb9-ad"/>
Aug 26 10:19:19 user nova-compute[73572]:     </interface>
Aug 26 10:19:19 user nova-compute[73572]:     <serial type="pty">
Aug 26 10:19:19 user nova-compute[73572]:       <log file="/opt/stack/data/nova/instances/00c47a06-2bf8-427d-bcb1-304688584511/console.log" append="off"/>
Aug 26 10:19:19 user nova-compute[73572]:     </serial>
Aug 26 10:19:19 user nova-compute[73572]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 10:19:19 user nova-compute[73572]:     <video>
Aug 26 10:19:19 user nova-compute[73572]:       <model type="virtio"/>
Aug 26 10:19:19 user nova-compute[73572]:     </video>
Aug 26 10:19:19 user nova-compute[73572]:     <rng model="virtio">
Aug 26 10:19:19 user nova-compute[73572]:       <backend model="random">/dev/urandom</backend>
Aug 26 10:19:19 user nova-compute[73572]:     </rng>
Aug 26 10:19:19 user nova-compute[73572]:     <controller type="usb" index="0" model="none"/>
Aug 26 10:19:19 user nova-compute[73572]:     <memballoon model="virtio">
Aug 26 10:19:19 user nova-compute[73572]:       <stats period="10"/>
Aug 26 10:19:19 user nova-compute[73572]:     </memballoon>
Aug 26 10:19:19 user nova-compute[73572]:   </devices>
Aug 26 10:19:19 user nova-compute[73572]: </domain>
Aug 26 10:19:19 user nova-compute[73572]:  {{(pid=73572) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 10:19:19 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-7aab74aa-265c-4686-8a25-440187a7fe1c tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00c47a06-2bf8-427d-bcb1-304688584511/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:19:19 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-7aab74aa-265c-4686-8a25-440187a7fe1c tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00c47a06-2bf8-427d-bcb1-304688584511/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:19:19 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-7aab74aa-265c-4686-8a25-440187a7fe1c tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00c47a06-2bf8-427d-bcb1-304688584511/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:19:19 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-7aab74aa-265c-4686-8a25-440187a7fe1c tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00c47a06-2bf8-427d-bcb1-304688584511/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:19:19 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-7aab74aa-265c-4686-8a25-440187a7fe1c tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73572) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 10:19:19 user nova-compute[73572]: DEBUG nova.objects.instance [None req-7aab74aa-265c-4686-8a25-440187a7fe1c tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Lazy-loading 'trusted_certs' on Instance uuid 00c47a06-2bf8-427d-bcb1-304688584511 {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:19:19 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:19:19 user nova-compute[73572]: DEBUG nova.objects.base [None req-7aab74aa-265c-4686-8a25-440187a7fe1c tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Object Instance<00c47a06-2bf8-427d-bcb1-304688584511> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=73572) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 10:19:19 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-7aab74aa-265c-4686-8a25-440187a7fe1c tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:19:19 user nova-compute[73572]: DEBUG nova.compute.manager [req-01bbffdc-a01b-45e4-92bf-f9e068f41ffa req-30585f96-dd00-4262-900a-5df11315a865 service nova] [instance: 86923c1a-89a5-4e7a-b488-8bf3a013bf83] Received event network-vif-plugged-db682944-8949-4bf9-b9d5-2213f0d507bc {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:19:19 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-01bbffdc-a01b-45e4-92bf-f9e068f41ffa req-30585f96-dd00-4262-900a-5df11315a865 service nova] Acquiring lock "86923c1a-89a5-4e7a-b488-8bf3a013bf83-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:19:19 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-01bbffdc-a01b-45e4-92bf-f9e068f41ffa req-30585f96-dd00-4262-900a-5df11315a865 service nova] Lock "86923c1a-89a5-4e7a-b488-8bf3a013bf83-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:19:19 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-01bbffdc-a01b-45e4-92bf-f9e068f41ffa req-30585f96-dd00-4262-900a-5df11315a865 service nova] Lock "86923c1a-89a5-4e7a-b488-8bf3a013bf83-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:19:19 user nova-compute[73572]: DEBUG nova.compute.manager [req-01bbffdc-a01b-45e4-92bf-f9e068f41ffa req-30585f96-dd00-4262-900a-5df11315a865 service nova] [instance: 86923c1a-89a5-4e7a-b488-8bf3a013bf83] No waiting events found dispatching network-vif-plugged-db682944-8949-4bf9-b9d5-2213f0d507bc {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:19:19 user nova-compute[73572]: WARNING nova.compute.manager [req-01bbffdc-a01b-45e4-92bf-f9e068f41ffa req-30585f96-dd00-4262-900a-5df11315a865 service nova] [instance: 86923c1a-89a5-4e7a-b488-8bf3a013bf83] Received unexpected event network-vif-plugged-db682944-8949-4bf9-b9d5-2213f0d507bc for instance with vm_state building and task_state spawning.
Aug 26 10:19:19 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-7aab74aa-265c-4686-8a25-440187a7fe1c tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json" returned: 0 in 0.202s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:19:19 user nova-compute[73572]: DEBUG nova.virt.disk.api [None req-7aab74aa-265c-4686-8a25-440187a7fe1c tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Checking if we can resize image /opt/stack/data/nova/instances/00c47a06-2bf8-427d-bcb1-304688584511/disk. size=1073741824 {{(pid=73572) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 10:19:19 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-7aab74aa-265c-4686-8a25-440187a7fe1c tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00c47a06-2bf8-427d-bcb1-304688584511/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:19:19 user nova-compute[73572]: DEBUG nova.virt.driver [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Emitting event <LifecycleEvent: 1693045159.8895528, 86923c1a-89a5-4e7a-b488-8bf3a013bf83 => Resumed> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:19:19 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 86923c1a-89a5-4e7a-b488-8bf3a013bf83] VM Resumed (Lifecycle Event)
Aug 26 10:19:19 user nova-compute[73572]: DEBUG nova.compute.manager [None req-38b21fe5-bca1-4a4e-97ca-0e139346eba6 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] [instance: 2eaea7c2-a5c0-4950-b033-0012b5cec0ee] Instance event wait completed in 0 seconds for  {{(pid=73572) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 10:19:19 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-38b21fe5-bca1-4a4e-97ca-0e139346eba6 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] [instance: 2eaea7c2-a5c0-4950-b033-0012b5cec0ee] Guest created on hypervisor {{(pid=73572) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 10:19:19 user nova-compute[73572]: DEBUG nova.compute.manager [None req-2374ab19-78d0-451e-8569-a4e950e97c4f tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] [instance: 86923c1a-89a5-4e7a-b488-8bf3a013bf83] Instance event wait completed in 0 seconds for  {{(pid=73572) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 10:19:19 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-2374ab19-78d0-451e-8569-a4e950e97c4f tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] [instance: 86923c1a-89a5-4e7a-b488-8bf3a013bf83] Guest created on hypervisor {{(pid=73572) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 10:19:19 user nova-compute[73572]: INFO nova.virt.libvirt.driver [-] [instance: 2eaea7c2-a5c0-4950-b033-0012b5cec0ee] Instance spawned successfully.
Aug 26 10:19:19 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-38b21fe5-bca1-4a4e-97ca-0e139346eba6 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] [instance: 2eaea7c2-a5c0-4950-b033-0012b5cec0ee] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 10:19:19 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 86923c1a-89a5-4e7a-b488-8bf3a013bf83] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:19:19 user nova-compute[73572]: INFO nova.virt.libvirt.driver [-] [instance: 86923c1a-89a5-4e7a-b488-8bf3a013bf83] Instance spawned successfully.
Aug 26 10:19:19 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-2374ab19-78d0-451e-8569-a4e950e97c4f tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] [instance: 86923c1a-89a5-4e7a-b488-8bf3a013bf83] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 10:19:19 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-38b21fe5-bca1-4a4e-97ca-0e139346eba6 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] [instance: 2eaea7c2-a5c0-4950-b033-0012b5cec0ee] Found default for hw_cdrom_bus of ide {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:19:19 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-38b21fe5-bca1-4a4e-97ca-0e139346eba6 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] [instance: 2eaea7c2-a5c0-4950-b033-0012b5cec0ee] Found default for hw_disk_bus of virtio {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:19:19 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-38b21fe5-bca1-4a4e-97ca-0e139346eba6 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] [instance: 2eaea7c2-a5c0-4950-b033-0012b5cec0ee] Found default for hw_input_bus of None {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:19:19 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-38b21fe5-bca1-4a4e-97ca-0e139346eba6 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] [instance: 2eaea7c2-a5c0-4950-b033-0012b5cec0ee] Found default for hw_pointer_model of None {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:19:19 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-38b21fe5-bca1-4a4e-97ca-0e139346eba6 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] [instance: 2eaea7c2-a5c0-4950-b033-0012b5cec0ee] Found default for hw_video_model of virtio {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:19:19 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-38b21fe5-bca1-4a4e-97ca-0e139346eba6 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] [instance: 2eaea7c2-a5c0-4950-b033-0012b5cec0ee] Found default for hw_vif_model of virtio {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:19:19 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 86923c1a-89a5-4e7a-b488-8bf3a013bf83] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73572) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 10:19:20 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-2374ab19-78d0-451e-8569-a4e950e97c4f tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] [instance: 86923c1a-89a5-4e7a-b488-8bf3a013bf83] Found default for hw_cdrom_bus of ide {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:19:20 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-2374ab19-78d0-451e-8569-a4e950e97c4f tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] [instance: 86923c1a-89a5-4e7a-b488-8bf3a013bf83] Found default for hw_disk_bus of virtio {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:19:20 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-2374ab19-78d0-451e-8569-a4e950e97c4f tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] [instance: 86923c1a-89a5-4e7a-b488-8bf3a013bf83] Found default for hw_input_bus of None {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:19:20 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-2374ab19-78d0-451e-8569-a4e950e97c4f tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] [instance: 86923c1a-89a5-4e7a-b488-8bf3a013bf83] Found default for hw_pointer_model of None {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:19:20 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-2374ab19-78d0-451e-8569-a4e950e97c4f tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] [instance: 86923c1a-89a5-4e7a-b488-8bf3a013bf83] Found default for hw_video_model of virtio {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:19:20 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-2374ab19-78d0-451e-8569-a4e950e97c4f tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] [instance: 86923c1a-89a5-4e7a-b488-8bf3a013bf83] Found default for hw_vif_model of virtio {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:19:20 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 86923c1a-89a5-4e7a-b488-8bf3a013bf83] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 10:19:20 user nova-compute[73572]: DEBUG nova.virt.driver [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Emitting event <LifecycleEvent: 1693045159.9292846, 2eaea7c2-a5c0-4950-b033-0012b5cec0ee => Resumed> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:19:20 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 2eaea7c2-a5c0-4950-b033-0012b5cec0ee] VM Resumed (Lifecycle Event)
Aug 26 10:19:20 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-7aab74aa-265c-4686-8a25-440187a7fe1c tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00c47a06-2bf8-427d-bcb1-304688584511/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:19:20 user nova-compute[73572]: DEBUG nova.virt.disk.api [None req-7aab74aa-265c-4686-8a25-440187a7fe1c tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Cannot resize image /opt/stack/data/nova/instances/00c47a06-2bf8-427d-bcb1-304688584511/disk to a smaller size. {{(pid=73572) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 10:19:20 user nova-compute[73572]: DEBUG nova.objects.instance [None req-7aab74aa-265c-4686-8a25-440187a7fe1c tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Lazy-loading 'migration_context' on Instance uuid 00c47a06-2bf8-427d-bcb1-304688584511 {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:19:20 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 2eaea7c2-a5c0-4950-b033-0012b5cec0ee] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:19:20 user nova-compute[73572]: INFO nova.compute.manager [None req-2374ab19-78d0-451e-8569-a4e950e97c4f tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] [instance: 86923c1a-89a5-4e7a-b488-8bf3a013bf83] Took 7.77 seconds to spawn the instance on the hypervisor.
Aug 26 10:19:20 user nova-compute[73572]: DEBUG nova.compute.manager [None req-2374ab19-78d0-451e-8569-a4e950e97c4f tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] [instance: 86923c1a-89a5-4e7a-b488-8bf3a013bf83] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:19:20 user nova-compute[73572]: DEBUG nova.objects.base [None req-7aab74aa-265c-4686-8a25-440187a7fe1c tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Object Instance<00c47a06-2bf8-427d-bcb1-304688584511> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=73572) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 10:19:20 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-7aab74aa-265c-4686-8a25-440187a7fe1c tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T10:15:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-767184678',display_name='tempest-AttachVolumeTestJSON-server-767184678',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-767184678',id=15,image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDUM4e46LSrHmno1gp4T3RRXiXfjHx917gcUppmI/sxQPEY8hKY/vqoEhT+Bxby7kAu1Ei3af6xY5p/QME/Z3JthPiVJQ1F4Ur+7V+CECg8DAf4Z/fI85QJzneAszEfomQ==',key_name='tempest-keypair-643189050',keypairs=<?>,launch_index=0,launched_at=2023-08-26T10:15:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='084df935eab842e58bad79afad7090f3',ramdisk_id='',reservation_id='r-d4j1rgky',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-716261196',owner_user_name='tempest-AttachVolumeTestJSON-716261196-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T10:17:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2a2ef00486924f318ff1e7e502e835a6',uuid=00c47a06-2bf8-427d-bcb1-304688584511,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "d18bfeb9-ad63-41d9-8d66-56df3d3306d8", "address": "fa:16:3e:a2:f2:f4", "network": {"id": "81543fb3-a8fe-4e9c-8180-c65fa4dcc9e1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-469390371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "084df935eab842e58bad79afad7090f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd18bfeb9-ad", "ovs_interfaceid": "d18bfeb9-ad63-41d9-8d66-56df3d3306d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 10:19:20 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-7aab74aa-265c-4686-8a25-440187a7fe1c tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Converting VIF {"id": "d18bfeb9-ad63-41d9-8d66-56df3d3306d8", "address": "fa:16:3e:a2:f2:f4", "network": {"id": "81543fb3-a8fe-4e9c-8180-c65fa4dcc9e1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-469390371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "084df935eab842e58bad79afad7090f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd18bfeb9-ad", "ovs_interfaceid": "d18bfeb9-ad63-41d9-8d66-56df3d3306d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:19:20 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-7aab74aa-265c-4686-8a25-440187a7fe1c tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:f2:f4,bridge_name='br-int',has_traffic_filtering=True,id=d18bfeb9-ad63-41d9-8d66-56df3d3306d8,network=Network(81543fb3-a8fe-4e9c-8180-c65fa4dcc9e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd18bfeb9-ad') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:19:20 user nova-compute[73572]: DEBUG os_vif [None req-7aab74aa-265c-4686-8a25-440187a7fe1c tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:f2:f4,bridge_name='br-int',has_traffic_filtering=True,id=d18bfeb9-ad63-41d9-8d66-56df3d3306d8,network=Network(81543fb3-a8fe-4e9c-8180-c65fa4dcc9e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd18bfeb9-ad') {{(pid=73572) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 10:19:20 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:19:20 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:19:20 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 10:19:20 user nova-compute[73572]: INFO nova.compute.manager [None req-38b21fe5-bca1-4a4e-97ca-0e139346eba6 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] [instance: 2eaea7c2-a5c0-4950-b033-0012b5cec0ee] Took 9.58 seconds to spawn the instance on the hypervisor.
Aug 26 10:19:20 user nova-compute[73572]: DEBUG nova.compute.manager [None req-38b21fe5-bca1-4a4e-97ca-0e139346eba6 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] [instance: 2eaea7c2-a5c0-4950-b033-0012b5cec0ee] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:19:20 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:19:20 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd18bfeb9-ad, may_exist=True, interface_attrs={}) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:19:20 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd18bfeb9-ad, col_values=(('external_ids', {'iface-id': 'd18bfeb9-ad63-41d9-8d66-56df3d3306d8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a2:f2:f4', 'vm-uuid': '00c47a06-2bf8-427d-bcb1-304688584511'}),), if_exists=True) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:19:20 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:19:20 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:19:20 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:19:20 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 2eaea7c2-a5c0-4950-b033-0012b5cec0ee] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73572) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 10:19:20 user nova-compute[73572]: INFO os_vif [None req-7aab74aa-265c-4686-8a25-440187a7fe1c tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:f2:f4,bridge_name='br-int',has_traffic_filtering=True,id=d18bfeb9-ad63-41d9-8d66-56df3d3306d8,network=Network(81543fb3-a8fe-4e9c-8180-c65fa4dcc9e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd18bfeb9-ad')
Aug 26 10:19:20 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 2eaea7c2-a5c0-4950-b033-0012b5cec0ee] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 10:19:20 user nova-compute[73572]: DEBUG nova.virt.driver [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Emitting event <LifecycleEvent: 1693045159.9296107, 86923c1a-89a5-4e7a-b488-8bf3a013bf83 => Started> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:19:20 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 86923c1a-89a5-4e7a-b488-8bf3a013bf83] VM Started (Lifecycle Event)
Aug 26 10:19:20 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 86923c1a-89a5-4e7a-b488-8bf3a013bf83] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:19:20 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 86923c1a-89a5-4e7a-b488-8bf3a013bf83] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73572) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 10:19:20 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 86923c1a-89a5-4e7a-b488-8bf3a013bf83] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 10:19:20 user nova-compute[73572]: DEBUG nova.virt.driver [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Emitting event <LifecycleEvent: 1693045159.9297009, 2eaea7c2-a5c0-4950-b033-0012b5cec0ee => Started> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:19:20 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 2eaea7c2-a5c0-4950-b033-0012b5cec0ee] VM Started (Lifecycle Event)
Aug 26 10:19:20 user nova-compute[73572]: INFO nova.compute.manager [None req-38b21fe5-bca1-4a4e-97ca-0e139346eba6 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] [instance: 2eaea7c2-a5c0-4950-b033-0012b5cec0ee] Took 10.76 seconds to build instance.
Aug 26 10:19:20 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 2eaea7c2-a5c0-4950-b033-0012b5cec0ee] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:19:20 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-38b21fe5-bca1-4a4e-97ca-0e139346eba6 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Lock "2eaea7c2-a5c0-4950-b033-0012b5cec0ee" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.934s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:19:20 user nova-compute[73572]: INFO nova.compute.manager [None req-2374ab19-78d0-451e-8569-a4e950e97c4f tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] [instance: 86923c1a-89a5-4e7a-b488-8bf3a013bf83] Took 9.87 seconds to build instance.
Aug 26 10:19:20 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 2eaea7c2-a5c0-4950-b033-0012b5cec0ee] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73572) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 10:19:20 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-2374ab19-78d0-451e-8569-a4e950e97c4f tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Lock "86923c1a-89a5-4e7a-b488-8bf3a013bf83" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.987s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:19:21 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:19:21 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:19:21 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:19:21 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:19:21 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:19:21 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:19:21 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:19:21 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Auditing locally available compute resources for user (node: user) {{(pid=73572) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 10:19:21 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:19:22 user nova-compute[73572]: DEBUG nova.compute.manager [req-52349996-72a5-424e-a199-df5d9324c7a3 req-32877035-6df2-4edd-b537-3f1c2aa1e50f service nova] [instance: 00c47a06-2bf8-427d-bcb1-304688584511] Received event network-vif-plugged-d18bfeb9-ad63-41d9-8d66-56df3d3306d8 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:19:22 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-52349996-72a5-424e-a199-df5d9324c7a3 req-32877035-6df2-4edd-b537-3f1c2aa1e50f service nova] Acquiring lock "00c47a06-2bf8-427d-bcb1-304688584511-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:19:22 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-52349996-72a5-424e-a199-df5d9324c7a3 req-32877035-6df2-4edd-b537-3f1c2aa1e50f service nova] Lock "00c47a06-2bf8-427d-bcb1-304688584511-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:19:22 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-52349996-72a5-424e-a199-df5d9324c7a3 req-32877035-6df2-4edd-b537-3f1c2aa1e50f service nova] Lock "00c47a06-2bf8-427d-bcb1-304688584511-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:19:22 user nova-compute[73572]: DEBUG nova.compute.manager [req-52349996-72a5-424e-a199-df5d9324c7a3 req-32877035-6df2-4edd-b537-3f1c2aa1e50f service nova] [instance: 00c47a06-2bf8-427d-bcb1-304688584511] No waiting events found dispatching network-vif-plugged-d18bfeb9-ad63-41d9-8d66-56df3d3306d8 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:19:22 user nova-compute[73572]: WARNING nova.compute.manager [req-52349996-72a5-424e-a199-df5d9324c7a3 req-32877035-6df2-4edd-b537-3f1c2aa1e50f service nova] [instance: 00c47a06-2bf8-427d-bcb1-304688584511] Received unexpected event network-vif-plugged-d18bfeb9-ad63-41d9-8d66-56df3d3306d8 for instance with vm_state stopped and task_state powering-on.
Aug 26 10:19:22 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:19:22 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:19:22 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:19:22 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:19:22 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:19:24 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-608d0797-dbf2-4e29-8a25-b1302683dbc0 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Acquiring lock "0fe47a17-4ffb-48ce-b0f6-a9b43002bd55" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:19:24 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-608d0797-dbf2-4e29-8a25-b1302683dbc0 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Lock "0fe47a17-4ffb-48ce-b0f6-a9b43002bd55" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:19:24 user nova-compute[73572]: DEBUG nova.objects.instance [None req-608d0797-dbf2-4e29-8a25-b1302683dbc0 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Lazy-loading 'flavor' on Instance uuid 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55 {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:19:24 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-608d0797-dbf2-4e29-8a25-b1302683dbc0 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Lock "0fe47a17-4ffb-48ce-b0f6-a9b43002bd55" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.071s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:19:24 user nova-compute[73572]: DEBUG nova.compute.manager [req-d6f1e722-05ff-4092-bc79-3616416e0813 req-249cf9c4-7bef-4426-9875-0cb7165c00f0 service nova] [instance: 00c47a06-2bf8-427d-bcb1-304688584511] Received event network-vif-plugged-d18bfeb9-ad63-41d9-8d66-56df3d3306d8 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:19:24 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-d6f1e722-05ff-4092-bc79-3616416e0813 req-249cf9c4-7bef-4426-9875-0cb7165c00f0 service nova] Acquiring lock "00c47a06-2bf8-427d-bcb1-304688584511-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:19:24 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-d6f1e722-05ff-4092-bc79-3616416e0813 req-249cf9c4-7bef-4426-9875-0cb7165c00f0 service nova] Lock "00c47a06-2bf8-427d-bcb1-304688584511-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:19:24 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-d6f1e722-05ff-4092-bc79-3616416e0813 req-249cf9c4-7bef-4426-9875-0cb7165c00f0 service nova] Lock "00c47a06-2bf8-427d-bcb1-304688584511-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:19:24 user nova-compute[73572]: DEBUG nova.compute.manager [req-d6f1e722-05ff-4092-bc79-3616416e0813 req-249cf9c4-7bef-4426-9875-0cb7165c00f0 service nova] [instance: 00c47a06-2bf8-427d-bcb1-304688584511] No waiting events found dispatching network-vif-plugged-d18bfeb9-ad63-41d9-8d66-56df3d3306d8 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:19:24 user nova-compute[73572]: WARNING nova.compute.manager [req-d6f1e722-05ff-4092-bc79-3616416e0813 req-249cf9c4-7bef-4426-9875-0cb7165c00f0 service nova] [instance: 00c47a06-2bf8-427d-bcb1-304688584511] Received unexpected event network-vif-plugged-d18bfeb9-ad63-41d9-8d66-56df3d3306d8 for instance with vm_state stopped and task_state powering-on.
Aug 26 10:19:24 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-608d0797-dbf2-4e29-8a25-b1302683dbc0 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Acquiring lock "0fe47a17-4ffb-48ce-b0f6-a9b43002bd55" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:19:24 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-608d0797-dbf2-4e29-8a25-b1302683dbc0 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Lock "0fe47a17-4ffb-48ce-b0f6-a9b43002bd55" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:19:24 user nova-compute[73572]: INFO nova.compute.manager [None req-608d0797-dbf2-4e29-8a25-b1302683dbc0 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] [instance: 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55] Attaching volume 5f3a153b-1b99-4297-ad26-ea58f33330b8 to /dev/vdb
Aug 26 10:19:24 user nova-compute[73572]: DEBUG os_brick.utils [None req-608d0797-dbf2-4e29-8a25-b1302683dbc0 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 10:19:24 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:19:24 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:19:24 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[188defc9-aee1-432c-8e6e-b5aa46f69c27]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:de8a79ed912\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:19:24 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:19:24 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:19:24 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[97168a94-e74d-47a0-bb6c-969c11061fae]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:19:24 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:19:24 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.026s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:19:24 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab529a1d-b532-4601-b50c-f3a5970c4d13]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:19:24 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a261bb6-024c-42e7-b174-0a8b2509bdb1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:19:24 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-608d0797-dbf2-4e29-8a25-b1302683dbc0 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Running cmd (subprocess): nvme version {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:19:24 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-608d0797-dbf2-4e29-8a25-b1302683dbc0 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] 'nvme version' failed. Not Retrying. {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 10:19:24 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.nvmeof [None req-608d0797-dbf2-4e29-8a25-b1302683dbc0 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] nvme not present on system {{(pid=73572) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 10:19:24 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:19:24 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 10:19:24 user nova-compute[73572]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 10:19:24 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[d74595c8-cd6e-4b74-8440-f0090730a8a4]: (4, '') {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:19:24 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.lightos [None req-608d0797-dbf2-4e29-8a25-b1302683dbc0 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73572) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 10:19:24 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.lightos [None req-608d0797-dbf2-4e29-8a25-b1302683dbc0 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73572) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 10:19:24 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.lightos [None req-608d0797-dbf2-4e29-8a25-b1302683dbc0 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] LIGHTOS: no hostnqn found. {{(pid=73572) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 10:19:24 user nova-compute[73572]: DEBUG os_brick.utils [None req-608d0797-dbf2-4e29-8a25-b1302683dbc0 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] <== get_connector_properties: return (172ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:de8a79ed912', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 10:19:24 user nova-compute[73572]: DEBUG nova.virt.block_device [None req-608d0797-dbf2-4e29-8a25-b1302683dbc0 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] [instance: 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55] Updating existing volume attachment record: 1aeb0f69-12af-451a-a4e8-6c2d73b1336d {{(pid=73572) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 10:19:24 user nova-compute[73572]: DEBUG nova.virt.driver [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Emitting event <LifecycleEvent: 1693045164.599119, 00c47a06-2bf8-427d-bcb1-304688584511 => Resumed> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:19:24 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 00c47a06-2bf8-427d-bcb1-304688584511] VM Resumed (Lifecycle Event)
Aug 26 10:19:24 user nova-compute[73572]: DEBUG nova.compute.manager [None req-7aab74aa-265c-4686-8a25-440187a7fe1c tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] [instance: 00c47a06-2bf8-427d-bcb1-304688584511] Instance event wait completed in 0 seconds for  {{(pid=73572) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 10:19:24 user nova-compute[73572]: INFO nova.virt.libvirt.driver [-] [instance: 00c47a06-2bf8-427d-bcb1-304688584511] Instance rebooted successfully.
Aug 26 10:19:24 user nova-compute[73572]: DEBUG nova.compute.manager [None req-7aab74aa-265c-4686-8a25-440187a7fe1c tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] [instance: 00c47a06-2bf8-427d-bcb1-304688584511] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:19:24 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:19:24 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 00c47a06-2bf8-427d-bcb1-304688584511] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:19:24 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 00c47a06-2bf8-427d-bcb1-304688584511] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=73572) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 10:19:24 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 00c47a06-2bf8-427d-bcb1-304688584511] During sync_power_state the instance has a pending task (powering-on). Skip.
Aug 26 10:19:24 user nova-compute[73572]: DEBUG nova.virt.driver [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Emitting event <LifecycleEvent: 1693045164.6174722, 00c47a06-2bf8-427d-bcb1-304688584511 => Started> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:19:24 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 00c47a06-2bf8-427d-bcb1-304688584511] VM Started (Lifecycle Event)
Aug 26 10:19:24 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 00c47a06-2bf8-427d-bcb1-304688584511] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:19:24 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 00c47a06-2bf8-427d-bcb1-304688584511] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=73572) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 10:19:24 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c901bbcc-3d82-4550-888f-bdbb36ba052d/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:19:25 user nova-compute[73572]: DEBUG nova.compute.manager [req-1d33d1e3-416f-48c7-a3c6-ee59761af116 req-f5a44e9d-fdf4-40c3-a031-67bb98dae168 service nova] [instance: 339517ef-c023-4f13-a8cc-d84f7176dfcd] Received event network-changed-0545369e-80c9-45cc-a9a2-330705df9241 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:19:25 user nova-compute[73572]: DEBUG nova.compute.manager [req-1d33d1e3-416f-48c7-a3c6-ee59761af116 req-f5a44e9d-fdf4-40c3-a031-67bb98dae168 service nova] [instance: 339517ef-c023-4f13-a8cc-d84f7176dfcd] Refreshing instance network info cache due to event network-changed-0545369e-80c9-45cc-a9a2-330705df9241. {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 10:19:25 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-1d33d1e3-416f-48c7-a3c6-ee59761af116 req-f5a44e9d-fdf4-40c3-a031-67bb98dae168 service nova] Acquiring lock "refresh_cache-339517ef-c023-4f13-a8cc-d84f7176dfcd" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:19:25 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-1d33d1e3-416f-48c7-a3c6-ee59761af116 req-f5a44e9d-fdf4-40c3-a031-67bb98dae168 service nova] Acquired lock "refresh_cache-339517ef-c023-4f13-a8cc-d84f7176dfcd" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:19:25 user nova-compute[73572]: DEBUG nova.network.neutron [req-1d33d1e3-416f-48c7-a3c6-ee59761af116 req-f5a44e9d-fdf4-40c3-a031-67bb98dae168 service nova] [instance: 339517ef-c023-4f13-a8cc-d84f7176dfcd] Refreshing network info cache for port 0545369e-80c9-45cc-a9a2-330705df9241 {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 10:19:25 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:19:25 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c901bbcc-3d82-4550-888f-bdbb36ba052d/disk --force-share --output=json" returned: 0 in 0.262s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:19:25 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c901bbcc-3d82-4550-888f-bdbb36ba052d/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:19:25 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c901bbcc-3d82-4550-888f-bdbb36ba052d/disk --force-share --output=json" returned: 0 in 0.264s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:19:25 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8302d6e7-aaf3-461c-a55e-f2e685d1800d/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:19:25 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8302d6e7-aaf3-461c-a55e-f2e685d1800d/disk --force-share --output=json" returned: 0 in 0.253s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:19:25 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8302d6e7-aaf3-461c-a55e-f2e685d1800d/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:19:25 user nova-compute[73572]: DEBUG nova.network.neutron [req-1d33d1e3-416f-48c7-a3c6-ee59761af116 req-f5a44e9d-fdf4-40c3-a031-67bb98dae168 service nova] [instance: 339517ef-c023-4f13-a8cc-d84f7176dfcd] Updated VIF entry in instance network info cache for port 0545369e-80c9-45cc-a9a2-330705df9241. {{(pid=73572) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 10:19:25 user nova-compute[73572]: DEBUG nova.network.neutron [req-1d33d1e3-416f-48c7-a3c6-ee59761af116 req-f5a44e9d-fdf4-40c3-a031-67bb98dae168 service nova] [instance: 339517ef-c023-4f13-a8cc-d84f7176dfcd] Updating instance_info_cache with network_info: [{"id": "0545369e-80c9-45cc-a9a2-330705df9241", "address": "fa:16:3e:ae:3c:b5", "network": {"id": "a9900fc6-80c0-41e3-ac1a-4fa11bda2d38", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1804146753-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.153", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b5f7c995974418c972eb33e591fab75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0545369e-80", "ovs_interfaceid": "0545369e-80c9-45cc-a9a2-330705df9241", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:19:25 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-1d33d1e3-416f-48c7-a3c6-ee59761af116 req-f5a44e9d-fdf4-40c3-a031-67bb98dae168 service nova] Releasing lock "refresh_cache-339517ef-c023-4f13-a8cc-d84f7176dfcd" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:19:25 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8302d6e7-aaf3-461c-a55e-f2e685d1800d/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:19:25 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c785b609-0068-442f-91f5-d26e888a993f/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:19:26 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c785b609-0068-442f-91f5-d26e888a993f/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:19:26 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c785b609-0068-442f-91f5-d26e888a993f/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:19:26 user nova-compute[73572]: INFO nova.compute.manager [None req-fa39d5b0-5f50-489a-8e4d-ffa55af9ad3e tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] [instance: 339517ef-c023-4f13-a8cc-d84f7176dfcd] Rebuilding instance
Aug 26 10:19:26 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c785b609-0068-442f-91f5-d26e888a993f/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:19:26 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dceaa35-4a13-453b-961f-831f66c35af0/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:19:26 user nova-compute[73572]: DEBUG nova.compute.manager [None req-fa39d5b0-5f50-489a-8e4d-ffa55af9ad3e tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] [instance: 339517ef-c023-4f13-a8cc-d84f7176dfcd] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:19:26 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dceaa35-4a13-453b-961f-831f66c35af0/disk --force-share --output=json" returned: 0 in 0.263s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:19:26 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dceaa35-4a13-453b-961f-831f66c35af0/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:19:26 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:19:26 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:19:26 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:19:26 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:19:27 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dceaa35-4a13-453b-961f-831f66c35af0/disk --force-share --output=json" returned: 0 in 0.301s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:19:27 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73572) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 10:19:27 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00c47a06-2bf8-427d-bcb1-304688584511/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:19:27 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00c47a06-2bf8-427d-bcb1-304688584511/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:19:27 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00c47a06-2bf8-427d-bcb1-304688584511/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:19:27 user nova-compute[73572]: DEBUG nova.compute.manager [req-f44925e7-7320-46ce-8af6-214ef8b55ad7 req-c2e3da5a-4edb-4bd4-877f-41f2a86a93b3 service nova] [instance: 339517ef-c023-4f13-a8cc-d84f7176dfcd] Received event network-vif-unplugged-0545369e-80c9-45cc-a9a2-330705df9241 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:19:27 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-f44925e7-7320-46ce-8af6-214ef8b55ad7 req-c2e3da5a-4edb-4bd4-877f-41f2a86a93b3 service nova] Acquiring lock "339517ef-c023-4f13-a8cc-d84f7176dfcd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:19:27 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-f44925e7-7320-46ce-8af6-214ef8b55ad7 req-c2e3da5a-4edb-4bd4-877f-41f2a86a93b3 service nova] Lock "339517ef-c023-4f13-a8cc-d84f7176dfcd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:19:27 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-f44925e7-7320-46ce-8af6-214ef8b55ad7 req-c2e3da5a-4edb-4bd4-877f-41f2a86a93b3 service nova] Lock "339517ef-c023-4f13-a8cc-d84f7176dfcd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:19:27 user nova-compute[73572]: DEBUG nova.compute.manager [req-f44925e7-7320-46ce-8af6-214ef8b55ad7 req-c2e3da5a-4edb-4bd4-877f-41f2a86a93b3 service nova] [instance: 339517ef-c023-4f13-a8cc-d84f7176dfcd] No waiting events found dispatching network-vif-unplugged-0545369e-80c9-45cc-a9a2-330705df9241 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:19:27 user nova-compute[73572]: WARNING nova.compute.manager [req-f44925e7-7320-46ce-8af6-214ef8b55ad7 req-c2e3da5a-4edb-4bd4-877f-41f2a86a93b3 service nova] [instance: 339517ef-c023-4f13-a8cc-d84f7176dfcd] Received unexpected event network-vif-unplugged-0545369e-80c9-45cc-a9a2-330705df9241 for instance with vm_state active and task_state rebuilding.
Aug 26 10:19:27 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00c47a06-2bf8-427d-bcb1-304688584511/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:19:27 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73572) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 10:19:27 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:19:27 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86923c1a-89a5-4e7a-b488-8bf3a013bf83/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:19:27 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:19:27 user nova-compute[73572]: INFO nova.virt.libvirt.driver [-] [instance: 339517ef-c023-4f13-a8cc-d84f7176dfcd] Instance destroyed successfully.
Aug 26 10:19:27 user nova-compute[73572]: INFO nova.virt.libvirt.driver [-] [instance: 339517ef-c023-4f13-a8cc-d84f7176dfcd] Instance destroyed successfully.
Aug 26 10:19:27 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-fa39d5b0-5f50-489a-8e4d-ffa55af9ad3e tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T10:17:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-633608799',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1130623721',id=21,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM9/VU/54cn1RTubtcb6hoKsYPJi5XFbRq9x7ny9CP4siDdaewzHcyj5+OCk5iyU32xzxXp4A9oDvslVWxMVLkr28kptlrAJWcCk28e8n8Kp7D+Tf1GW4OZmlFm8Y1MOSQ==',key_name='tempest-keypair-1829288947',keypairs=<?>,launch_index=0,launched_at=2023-08-26T10:17:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='3b5f7c995974418c972eb33e591fab75',ramdisk_id='',reservation_id='r-ol5nmpv7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-182410381',owner_user_name='tempest-ServerActionsV293TestJSON-182410381-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T10:19:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4ab4c737924c4e8da6b35cdb4051c3be',uuid=339517ef-c023-4f13-a8cc-d84f7176dfcd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0545369e-80c9-45cc-a9a2-330705df9241", "address": "fa:16:3e:ae:3c:b5", "network": {"id": "a9900fc6-80c0-41e3-ac1a-4fa11bda2d38", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1804146753-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.153", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b5f7c995974418c972eb33e591fab75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0545369e-80", "ovs_interfaceid": "0545369e-80c9-45cc-a9a2-330705df9241", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 10:19:27 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-fa39d5b0-5f50-489a-8e4d-ffa55af9ad3e tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] Converting VIF {"id": "0545369e-80c9-45cc-a9a2-330705df9241", "address": "fa:16:3e:ae:3c:b5", "network": {"id": "a9900fc6-80c0-41e3-ac1a-4fa11bda2d38", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1804146753-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.153", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b5f7c995974418c972eb33e591fab75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0545369e-80", "ovs_interfaceid": "0545369e-80c9-45cc-a9a2-330705df9241", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:19:27 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-fa39d5b0-5f50-489a-8e4d-ffa55af9ad3e tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ae:3c:b5,bridge_name='br-int',has_traffic_filtering=True,id=0545369e-80c9-45cc-a9a2-330705df9241,network=Network(a9900fc6-80c0-41e3-ac1a-4fa11bda2d38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0545369e-80') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:19:27 user nova-compute[73572]: DEBUG os_vif [None req-fa39d5b0-5f50-489a-8e4d-ffa55af9ad3e tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ae:3c:b5,bridge_name='br-int',has_traffic_filtering=True,id=0545369e-80c9-45cc-a9a2-330705df9241,network=Network(a9900fc6-80c0-41e3-ac1a-4fa11bda2d38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0545369e-80') {{(pid=73572) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 10:19:27 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:19:27 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0545369e-80, bridge=br-int, if_exists=True) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:19:27 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:19:27 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:19:27 user nova-compute[73572]: INFO os_vif [None req-fa39d5b0-5f50-489a-8e4d-ffa55af9ad3e tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ae:3c:b5,bridge_name='br-int',has_traffic_filtering=True,id=0545369e-80c9-45cc-a9a2-330705df9241,network=Network(a9900fc6-80c0-41e3-ac1a-4fa11bda2d38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0545369e-80')
Aug 26 10:19:27 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fa39d5b0-5f50-489a-8e4d-ffa55af9ad3e tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] [instance: 339517ef-c023-4f13-a8cc-d84f7176dfcd] calling os-brick to detach iSCSI Volume {{(pid=73572) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 10:19:27 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa39d5b0-5f50-489a-8e4d-ffa55af9ad3e tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc89c3d6a10>, {'target_iqns': ['iqn.2010-10.org.openstack:d94556c8-9096-4e9a-9cfc-f9d17846ed06'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LpSxZEgY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 10:19:27 user nova-compute[73572]: WARNING os_brick.initiator.connectors.base [None req-fa39d5b0-5f50-489a-8e4d-ffa55af9ad3e tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 26 10:19:27 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-fa39d5b0-5f50-489a-8e4d-ffa55af9ad3e tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 10:19:27 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-fa39d5b0-5f50-489a-8e4d-ffa55af9ad3e tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 10:19:27 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa39d5b0-5f50-489a-8e4d-ffa55af9ad3e tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d94556c8-9096-4e9a-9cfc-f9d17846ed06', 0)] {{(pid=73572) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 10:19:27 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:19:27 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.033s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:19:27 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[df895f9a-22d9-4717-aeb3-0116e58f0da2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:302c3cfe-f0ec-4b1c-b1d9-dc12d4f4ce40\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:57b56972-76f9-44aa-905c-14d04f924f76\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c22666f6-bb12-41a8-b565-837f4617df4e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d94556c8-9096-4e9a-9cfc-f9d17846ed06\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eaa45a8a-93fc-4fac-bc41-ce4fa5173718\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:19:27 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:19:27 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.052s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:19:27 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[16d0808d-5a58-4be4-b757-0bca67a8d48c]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d94556c8-9096-4e9a-9cfc-f9d17846ed06 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c22666f6-bb12-41a8-b565-837f4617df4e (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57b56972-76f9-44aa-905c-14d04f924f76 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaa45a8a-93fc-4fac-bc41-ce4fa5173718 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:302c3cfe-f0ec-4b1c-b1d9-dc12d4f4ce40 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478 (non-flash)\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:19:27 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa39d5b0-5f50-489a-8e4d-ffa55af9ad3e tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)
Aug 26 10:19:27 user nova-compute[73572]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d94556c8-9096-4e9a-9cfc-f9d17846ed06 (non-flash)
Aug 26 10:19:27 user nova-compute[73572]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c22666f6-bb12-41a8-b565-837f4617df4e (non-flash)
Aug 26 10:19:27 user nova-compute[73572]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57b56972-76f9-44aa-905c-14d04f924f76 (non-flash)
Aug 26 10:19:27 user nova-compute[73572]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaa45a8a-93fc-4fac-bc41-ce4fa5173718 (non-flash)
Aug 26 10:19:27 user nova-compute[73572]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:302c3cfe-f0ec-4b1c-b1d9-dc12d4f4ce40 (non-flash)
Aug 26 10:19:27 user nova-compute[73572]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478 (non-flash)
Aug 26 10:19:27 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 10:19:27 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa39d5b0-5f50-489a-8e4d-ffa55af9ad3e tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)
Aug 26 10:19:27 user nova-compute[73572]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d94556c8-9096-4e9a-9cfc-f9d17846ed06 (non-flash)
Aug 26 10:19:27 user nova-compute[73572]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c22666f6-bb12-41a8-b565-837f4617df4e (non-flash)
Aug 26 10:19:27 user nova-compute[73572]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57b56972-76f9-44aa-905c-14d04f924f76 (non-flash)
Aug 26 10:19:27 user nova-compute[73572]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaa45a8a-93fc-4fac-bc41-ce4fa5173718 (non-flash)
Aug 26 10:19:27 user nova-compute[73572]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:302c3cfe-f0ec-4b1c-b1d9-dc12d4f4ce40 (non-flash)
Aug 26 10:19:27 user nova-compute[73572]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478 (non-flash)
Aug 26 10:19:27 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 10:19:27 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa39d5b0-5f50-489a-8e4d-ffa55af9ad3e tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc878d3b910>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d94556c8-9096-4e9a-9cfc-f9d17846ed06'): ({'sdc'}, set())}) {{(pid=73572) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 10:19:27 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-fa39d5b0-5f50-489a-8e4d-ffa55af9ad3e tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] Removing single pathed devices sdc {{(pid=73572) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 10:19:27 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86923c1a-89a5-4e7a-b488-8bf3a013bf83/disk --force-share --output=json" returned: 0 in 0.279s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:19:27 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:19:27 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86923c1a-89a5-4e7a-b488-8bf3a013bf83/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:19:27 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.030s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:19:27 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[96cb4229-934d-4368-b564-6f8d50809547]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:19:27 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:19:27 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.024s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:19:27 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[abd7a79e-b235-48c6-9d90-ed247e78a109]: (4, ('ok\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:19:27 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-fa39d5b0-5f50-489a-8e4d-ffa55af9ad3e tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] Flushing IO for device /dev/sdc {{(pid=73572) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 10:19:27 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:19:27 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.029s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:19:27 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bcdffb0-e2c0-4f32-9d5e-72bc39c16c5f]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:19:27 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-fa39d5b0-5f50-489a-8e4d-ffa55af9ad3e tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73572) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 10:19:27 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:19:28 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.079s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:19:28 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e748d0f-eec6-41ce-98fb-fd9a5f08b1d2]: (4, ('1', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:19:28 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-fa39d5b0-5f50-489a-8e4d-ffa55af9ad3e tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73572) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 10:19:28 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-fa39d5b0-5f50-489a-8e4d-ffa55af9ad3e tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] SCSI volumes sdc have been removed. {{(pid=73572) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 10:19:28 user nova-compute[73572]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOe525c950-5391bb7e2140faef', '/dev/disk/by-id/scsi-23533393162623765', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_e525c950') {{(pid=84543) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 26 10:19:28 user nova-compute[73572]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIOe525c950-5391bb7e2140faef
Aug 26 10:19:28 user nova-compute[73572]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-23533393162623765
Aug 26 10:19:28 user nova-compute[73572]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_e525c950
Aug 26 10:19:28 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa0b9f5c-a59c-4a8b-82bd-475d49669e99]: (4, None) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:19:28 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa39d5b0-5f50-489a-8e4d-ffa55af9ad3e tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d94556c8-9096-4e9a-9cfc-f9d17846ed06')] {{(pid=73572) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 10:19:28 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d94556c8-9096-4e9a-9cfc-f9d17846ed06 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:19:28 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d94556c8-9096-4e9a-9cfc-f9d17846ed06 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:19:28 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[db449e91-1213-457e-bb74-63b5271e47c9]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:19:28 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa39d5b0-5f50-489a-8e4d-ffa55af9ad3e tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:19:28 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d94556c8-9096-4e9a-9cfc-f9d17846ed06 -p 172.16.0.220:3260 --logout {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:19:28 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86923c1a-89a5-4e7a-b488-8bf3a013bf83/disk --force-share --output=json" returned: 0 in 0.305s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:19:28 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=73572) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 10:19:28 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/682138af-ba6a-47f1-a9a5-03ae2661f54d/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:19:28 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d94556c8-9096-4e9a-9cfc-f9d17846ed06 -p 172.16.0.220:3260 --logout" returned: 0 in 0.094s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:19:28 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bf84703-adff-4dda-8849-3254af7b549f]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:d94556c8-9096-4e9a-9cfc-f9d17846ed06, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:d94556c8-9096-4e9a-9cfc-f9d17846ed06, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:19:28 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa39d5b0-5f50-489a-8e4d-ffa55af9ad3e tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:d94556c8-9096-4e9a-9cfc-f9d17846ed06, portal: 172.16.0.220,3260]
Aug 26 10:19:28 user nova-compute[73572]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:d94556c8-9096-4e9a-9cfc-f9d17846ed06, portal: 172.16.0.220,3260] successful.
Aug 26 10:19:28 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:19:28 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d94556c8-9096-4e9a-9cfc-f9d17846ed06 -p 172.16.0.220:3260 --op delete {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:19:28 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d94556c8-9096-4e9a-9cfc-f9d17846ed06 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.046s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:19:28 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[70a3ea35-cb9b-4f37-bb06-ab0da3ecf22f]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:19:28 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa39d5b0-5f50-489a-8e4d-ffa55af9ad3e tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:19:28 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-fa39d5b0-5f50-489a-8e4d-ffa55af9ad3e tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.562s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 10:19:28 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa39d5b0-5f50-489a-8e4d-ffa55af9ad3e tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] <== disconnect_volume: return (565ms) None {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 10:19:28 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fa39d5b0-5f50-489a-8e4d-ffa55af9ad3e tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] [instance: 339517ef-c023-4f13-a8cc-d84f7176dfcd] Disconnected iSCSI Volume {{(pid=73572) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 10:19:28 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-fa39d5b0-5f50-489a-8e4d-ffa55af9ad3e tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] [instance: 339517ef-c023-4f13-a8cc-d84f7176dfcd] Deleting instance files /opt/stack/data/nova/instances/339517ef-c023-4f13-a8cc-d84f7176dfcd_del
Aug 26 10:19:28 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-fa39d5b0-5f50-489a-8e4d-ffa55af9ad3e tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] [instance: 339517ef-c023-4f13-a8cc-d84f7176dfcd] Deletion of /opt/stack/data/nova/instances/339517ef-c023-4f13-a8cc-d84f7176dfcd_del complete
Aug 26 10:19:28 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/682138af-ba6a-47f1-a9a5-03ae2661f54d/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:19:28 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/682138af-ba6a-47f1-a9a5-03ae2661f54d/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:19:28 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/682138af-ba6a-47f1-a9a5-03ae2661f54d/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:19:28 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=73572) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 10:19:28 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73572) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 10:19:28 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=73572) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 10:19:28 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=73572) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 10:19:28 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2970584-8c2a-4f99-922c-d66d59489504/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:19:28 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-fa39d5b0-5f50-489a-8e4d-ffa55af9ad3e tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] [instance: 339517ef-c023-4f13-a8cc-d84f7176dfcd] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance 339517ef-c023-4f13-a8cc-d84f7176dfcd could not be found.
Aug 26 10:19:28 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fa39d5b0-5f50-489a-8e4d-ffa55af9ad3e tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] [instance: 339517ef-c023-4f13-a8cc-d84f7176dfcd] calling os-brick to detach iSCSI Volume {{(pid=73572) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 10:19:28 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa39d5b0-5f50-489a-8e4d-ffa55af9ad3e tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc89c3d6a10>, {'target_iqns': ['iqn.2010-10.org.openstack:d94556c8-9096-4e9a-9cfc-f9d17846ed06'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LpSxZEgY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 10:19:28 user nova-compute[73572]: WARNING os_brick.initiator.connectors.base [None req-fa39d5b0-5f50-489a-8e4d-ffa55af9ad3e tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 26 10:19:28 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-fa39d5b0-5f50-489a-8e4d-ffa55af9ad3e tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 10:19:28 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-fa39d5b0-5f50-489a-8e4d-ffa55af9ad3e tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 10:19:28 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa39d5b0-5f50-489a-8e4d-ffa55af9ad3e tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d94556c8-9096-4e9a-9cfc-f9d17846ed06', 0)] {{(pid=73572) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 10:19:28 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:19:28 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:19:28 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ea4a6a5-b5df-469c-9861-0fbe05eb8a30]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:302c3cfe-f0ec-4b1c-b1d9-dc12d4f4ce40\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:57b56972-76f9-44aa-905c-14d04f924f76\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c22666f6-bb12-41a8-b565-837f4617df4e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eaa45a8a-93fc-4fac-bc41-ce4fa5173718\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:19:28 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:19:28 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.041s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:19:28 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[86644079-1a15-466a-8b31-493bbb863619]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c22666f6-bb12-41a8-b565-837f4617df4e (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57b56972-76f9-44aa-905c-14d04f924f76 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaa45a8a-93fc-4fac-bc41-ce4fa5173718 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:302c3cfe-f0ec-4b1c-b1d9-dc12d4f4ce40 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478 (non-flash)\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:19:28 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa39d5b0-5f50-489a-8e4d-ffa55af9ad3e tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)
Aug 26 10:19:28 user nova-compute[73572]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c22666f6-bb12-41a8-b565-837f4617df4e (non-flash)
Aug 26 10:19:28 user nova-compute[73572]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57b56972-76f9-44aa-905c-14d04f924f76 (non-flash)
Aug 26 10:19:28 user nova-compute[73572]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaa45a8a-93fc-4fac-bc41-ce4fa5173718 (non-flash)
Aug 26 10:19:28 user nova-compute[73572]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:302c3cfe-f0ec-4b1c-b1d9-dc12d4f4ce40 (non-flash)
Aug 26 10:19:28 user nova-compute[73572]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478 (non-flash)
Aug 26 10:19:28 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 10:19:28 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa39d5b0-5f50-489a-8e4d-ffa55af9ad3e tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)
Aug 26 10:19:28 user nova-compute[73572]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c22666f6-bb12-41a8-b565-837f4617df4e (non-flash)
Aug 26 10:19:28 user nova-compute[73572]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57b56972-76f9-44aa-905c-14d04f924f76 (non-flash)
Aug 26 10:19:28 user nova-compute[73572]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaa45a8a-93fc-4fac-bc41-ce4fa5173718 (non-flash)
Aug 26 10:19:28 user nova-compute[73572]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:302c3cfe-f0ec-4b1c-b1d9-dc12d4f4ce40 (non-flash)
Aug 26 10:19:28 user nova-compute[73572]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478 (non-flash)
Aug 26 10:19:28 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 10:19:28 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa39d5b0-5f50-489a-8e4d-ffa55af9ad3e tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc89c3c9120>, {}) {{(pid=73572) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 10:19:28 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa39d5b0-5f50-489a-8e4d-ffa55af9ad3e tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] Disconnecting from: [] {{(pid=73572) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 10:19:28 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-fa39d5b0-5f50-489a-8e4d-ffa55af9ad3e tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.081s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 10:19:28 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa39d5b0-5f50-489a-8e4d-ffa55af9ad3e tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] <== disconnect_volume: return (84ms) None {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 10:19:28 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fa39d5b0-5f50-489a-8e4d-ffa55af9ad3e tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] [instance: 339517ef-c023-4f13-a8cc-d84f7176dfcd] Disconnected iSCSI Volume {{(pid=73572) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 10:19:28 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2970584-8c2a-4f99-922c-d66d59489504/disk --force-share --output=json" returned: 0 in 0.287s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:19:28 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2970584-8c2a-4f99-922c-d66d59489504/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:19:29 user nova-compute[73572]: DEBUG nova.compute.manager [req-23699356-9d7d-4ae9-8fb5-73d641760966 req-9e004d99-48d0-4089-aa86-ba2591d94af6 service nova] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] Received event network-changed-123d944e-47d4-4f95-94bc-73e1920ecbc1 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:19:29 user nova-compute[73572]: DEBUG nova.compute.manager [req-23699356-9d7d-4ae9-8fb5-73d641760966 req-9e004d99-48d0-4089-aa86-ba2591d94af6 service nova] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] Refreshing instance network info cache due to event network-changed-123d944e-47d4-4f95-94bc-73e1920ecbc1. {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 10:19:29 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-23699356-9d7d-4ae9-8fb5-73d641760966 req-9e004d99-48d0-4089-aa86-ba2591d94af6 service nova] Acquiring lock "refresh_cache-41c1ef7a-4f98-4cbb-9948-acb96bd9d557" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:19:29 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-23699356-9d7d-4ae9-8fb5-73d641760966 req-9e004d99-48d0-4089-aa86-ba2591d94af6 service nova] Acquired lock "refresh_cache-41c1ef7a-4f98-4cbb-9948-acb96bd9d557" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:19:29 user nova-compute[73572]: DEBUG nova.network.neutron [req-23699356-9d7d-4ae9-8fb5-73d641760966 req-9e004d99-48d0-4089-aa86-ba2591d94af6 service nova] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] Refreshing network info cache for port 123d944e-47d4-4f95-94bc-73e1920ecbc1 {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 10:19:29 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2970584-8c2a-4f99-922c-d66d59489504/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:19:29 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2eaea7c2-a5c0-4950-b033-0012b5cec0ee/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:19:29 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2eaea7c2-a5c0-4950-b033-0012b5cec0ee/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:19:29 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2eaea7c2-a5c0-4950-b033-0012b5cec0ee/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:19:29 user nova-compute[73572]: DEBUG nova.compute.manager [req-8eb2464a-0e80-4863-a7df-a3f97aa12659 req-3c48cc28-b1aa-4eb2-880b-89c8728d9875 service nova] [instance: 339517ef-c023-4f13-a8cc-d84f7176dfcd] Received event network-vif-plugged-0545369e-80c9-45cc-a9a2-330705df9241 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:19:29 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-8eb2464a-0e80-4863-a7df-a3f97aa12659 req-3c48cc28-b1aa-4eb2-880b-89c8728d9875 service nova] Acquiring lock "339517ef-c023-4f13-a8cc-d84f7176dfcd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:19:29 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-8eb2464a-0e80-4863-a7df-a3f97aa12659 req-3c48cc28-b1aa-4eb2-880b-89c8728d9875 service nova] Lock "339517ef-c023-4f13-a8cc-d84f7176dfcd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:19:29 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-8eb2464a-0e80-4863-a7df-a3f97aa12659 req-3c48cc28-b1aa-4eb2-880b-89c8728d9875 service nova] Lock "339517ef-c023-4f13-a8cc-d84f7176dfcd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:19:29 user nova-compute[73572]: DEBUG nova.compute.manager [req-8eb2464a-0e80-4863-a7df-a3f97aa12659 req-3c48cc28-b1aa-4eb2-880b-89c8728d9875 service nova] [instance: 339517ef-c023-4f13-a8cc-d84f7176dfcd] No waiting events found dispatching network-vif-plugged-0545369e-80c9-45cc-a9a2-330705df9241 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:19:29 user nova-compute[73572]: WARNING nova.compute.manager [req-8eb2464a-0e80-4863-a7df-a3f97aa12659 req-3c48cc28-b1aa-4eb2-880b-89c8728d9875 service nova] [instance: 339517ef-c023-4f13-a8cc-d84f7176dfcd] Received unexpected event network-vif-plugged-0545369e-80c9-45cc-a9a2-330705df9241 for instance with vm_state active and task_state rebuilding.
Aug 26 10:19:29 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:19:29 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2eaea7c2-a5c0-4950-b033-0012b5cec0ee/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:19:29 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fe47a17-4ffb-48ce-b0f6-a9b43002bd55/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:19:29 user nova-compute[73572]: DEBUG nova.compute.manager [None req-fa39d5b0-5f50-489a-8e4d-ffa55af9ad3e tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] [instance: 339517ef-c023-4f13-a8cc-d84f7176dfcd] Preparing to wait for external event volume-reimaged-d94556c8-9096-4e9a-9cfc-f9d17846ed06 {{(pid=73572) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Aug 26 10:19:29 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-fa39d5b0-5f50-489a-8e4d-ffa55af9ad3e tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] Acquiring lock "339517ef-c023-4f13-a8cc-d84f7176dfcd-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:19:29 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-fa39d5b0-5f50-489a-8e4d-ffa55af9ad3e tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] Lock "339517ef-c023-4f13-a8cc-d84f7176dfcd-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.002s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:19:29 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-fa39d5b0-5f50-489a-8e4d-ffa55af9ad3e tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] Lock "339517ef-c023-4f13-a8cc-d84f7176dfcd-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:19:30 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fe47a17-4ffb-48ce-b0f6-a9b43002bd55/disk --force-share --output=json" returned: 0 in 0.305s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:19:30 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fe47a17-4ffb-48ce-b0f6-a9b43002bd55/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:19:30 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:19:30 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fe47a17-4ffb-48ce-b0f6-a9b43002bd55/disk --force-share --output=json" returned: 0 in 0.293s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:19:31 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:19:31 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:19:31 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Hypervisor/Node resource view: name=user free_ram=7177MB free_disk=25.189952850341797GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=73572) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 10:19:31 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:19:31 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:19:31 user nova-compute[73572]: DEBUG nova.network.neutron [req-23699356-9d7d-4ae9-8fb5-73d641760966 req-9e004d99-48d0-4089-aa86-ba2591d94af6 service nova] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] Updated VIF entry in instance network info cache for port 123d944e-47d4-4f95-94bc-73e1920ecbc1. {{(pid=73572) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 10:19:31 user nova-compute[73572]: DEBUG nova.network.neutron [req-23699356-9d7d-4ae9-8fb5-73d641760966 req-9e004d99-48d0-4089-aa86-ba2591d94af6 service nova] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] Updating instance_info_cache with network_info: [{"id": "123d944e-47d4-4f95-94bc-73e1920ecbc1", "address": "fa:16:3e:95:40:4c", "network": {"id": "ce8484e9-f124-4a9c-9682-289ed99917e2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1080187713-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cf2ae4dd7d3474394090e3276c957ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap123d944e-47", "ovs_interfaceid": "123d944e-47d4-4f95-94bc-73e1920ecbc1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "696cd753-312c-437d-b140-c40b4158554e", "address": "fa:16:3e:13:c8:34", "network": {"id": "c0d598c4-68c6-4cfc-adf1-dc0360861788", "bridge": "br-int", "label": "tempest-device-tagging-net1-1696215747", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.77", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7cf2ae4dd7d3474394090e3276c957ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap696cd753-31", "ovs_interfaceid": "696cd753-312c-437d-b140-c40b4158554e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3e7d3f56-193b-43ba-9cc5-c5373755e06f", "address": "fa:16:3e:85:00:8b", "network": {"id": "c0d598c4-68c6-4cfc-adf1-dc0360861788", "bridge": "br-int", "label": "tempest-device-tagging-net1-1696215747", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.177", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7cf2ae4dd7d3474394090e3276c957ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e7d3f56-19", "ovs_interfaceid": "3e7d3f56-193b-43ba-9cc5-c5373755e06f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f264d951-8920-4151-8276-33baa6a9def9", "address": "fa:16:3e:a7:e2:2a", "network": {"id": "c0d598c4-68c6-4cfc-adf1-dc0360861788", "bridge": "br-int", "label": "tempest-device-tagging-net1-1696215747", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7cf2ae4dd7d3474394090e3276c957ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf264d951-89", "ovs_interfaceid": "f264d951-8920-4151-8276-33baa6a9def9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c0c6f2bc-3209-461a-bcc3-edf740139ca2", "address": "fa:16:3e:d1:c7:a5", "network": {"id": "c0d598c4-68c6-4cfc-adf1-dc0360861788", "bridge": "br-int", "label": "tempest-device-tagging-net1-1696215747", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.224", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7cf2ae4dd7d3474394090e3276c957ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0c6f2bc-32", "ovs_interfaceid": "c0c6f2bc-3209-461a-bcc3-edf740139ca2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2fe25c93-5639-47a6-80de-8cc83615e3c4", "address": "fa:16:3e:59:09:63", "network": {"id": "f69a6193-9faf-4224-b21b-bc60491f9aea", "bridge": "br-int", "label": "tempest-device-tagging-net2-1404521418", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7cf2ae4dd7d3474394090e3276c957ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fe25c93-56", "ovs_interfaceid": "2fe25c93-5639-47a6-80de-8cc83615e3c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8bc3e6f9-0fb7-4283-973c-cbb09e440e68", "address": "fa:16:3e:3d:e7:4c", "network": {"id": "f69a6193-9faf-4224-b21b-bc60491f9aea", "bridge": "br-int", "label": "tempest-device-tagging-net2-1404521418", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7cf2ae4dd7d3474394090e3276c957ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bc3e6f9-0f", "ovs_interfaceid": "8bc3e6f9-0fb7-4283-973c-cbb09e440e68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:19:31 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-23699356-9d7d-4ae9-8fb5-73d641760966 req-9e004d99-48d0-4089-aa86-ba2591d94af6 service nova] Releasing lock "refresh_cache-41c1ef7a-4f98-4cbb-9948-acb96bd9d557" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:19:31 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance c785b609-0068-442f-91f5-d26e888a993f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:19:31 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance 8302d6e7-aaf3-461c-a55e-f2e685d1800d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:19:31 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance 14fab12e-52be-4fe6-8777-bc7ebf3c25f1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:19:31 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance 00c47a06-2bf8-427d-bcb1-304688584511 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:19:31 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance d2970584-8c2a-4f99-922c-d66d59489504 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:19:31 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:19:31 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance 682138af-ba6a-47f1-a9a5-03ae2661f54d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:19:31 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance 0dceaa35-4a13-453b-961f-831f66c35af0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:19:31 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance 339517ef-c023-4f13-a8cc-d84f7176dfcd actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:19:31 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance 41c1ef7a-4f98-4cbb-9948-acb96bd9d557 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:19:31 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance c901bbcc-3d82-4550-888f-bdbb36ba052d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:19:31 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance 2eaea7c2-a5c0-4950-b033-0012b5cec0ee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:19:31 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance 86923c1a-89a5-4e7a-b488-8bf3a013bf83 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:19:31 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=73572) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 10:19:31 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=73572) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 10:19:31 user nova-compute[73572]: DEBUG nova.compute.provider_tree [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Inventory has not changed in ProviderTree for provider: e2cec974-59b2-4c77-a53d-a7f4e5a30d75 {{(pid=73572) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 10:19:31 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Inventory has not changed for provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73572) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 10:19:31 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Compute_service record updated for user:user {{(pid=73572) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 10:19:31 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.820s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:19:32 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-a5b8c78d-5639-454a-a211-bd872ff85a61 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] Acquiring lock "41c1ef7a-4f98-4cbb-9948-acb96bd9d557" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:19:32 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-a5b8c78d-5639-454a-a211-bd872ff85a61 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] Lock "41c1ef7a-4f98-4cbb-9948-acb96bd9d557" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:19:32 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-a5b8c78d-5639-454a-a211-bd872ff85a61 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] Acquiring lock "41c1ef7a-4f98-4cbb-9948-acb96bd9d557-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:19:32 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-a5b8c78d-5639-454a-a211-bd872ff85a61 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] Lock "41c1ef7a-4f98-4cbb-9948-acb96bd9d557-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:19:32 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-a5b8c78d-5639-454a-a211-bd872ff85a61 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] Lock "41c1ef7a-4f98-4cbb-9948-acb96bd9d557-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:19:32 user nova-compute[73572]: INFO nova.compute.manager [None req-a5b8c78d-5639-454a-a211-bd872ff85a61 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] Terminating instance
Aug 26 10:19:32 user nova-compute[73572]: DEBUG nova.compute.manager [None req-a5b8c78d-5639-454a-a211-bd872ff85a61 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] Start destroying the instance on the hypervisor. {{(pid=73572) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 10:19:32 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:19:32 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:19:32 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:19:32 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:19:32 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:19:32 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:19:32 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:19:32 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:19:32 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:19:32 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:19:33 user nova-compute[73572]: DEBUG nova.compute.manager [req-aea8413f-c0b8-4cf6-ac72-e4ba8b96fff9 req-1dd87cb8-fdf3-468b-91b2-793dd37716ec service nova] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] Received event network-vif-unplugged-123d944e-47d4-4f95-94bc-73e1920ecbc1 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:19:33 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-aea8413f-c0b8-4cf6-ac72-e4ba8b96fff9 req-1dd87cb8-fdf3-468b-91b2-793dd37716ec service nova] Acquiring lock "41c1ef7a-4f98-4cbb-9948-acb96bd9d557-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:19:33 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-aea8413f-c0b8-4cf6-ac72-e4ba8b96fff9 req-1dd87cb8-fdf3-468b-91b2-793dd37716ec service nova] Lock "41c1ef7a-4f98-4cbb-9948-acb96bd9d557-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:19:33 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-aea8413f-c0b8-4cf6-ac72-e4ba8b96fff9 req-1dd87cb8-fdf3-468b-91b2-793dd37716ec service nova] Lock "41c1ef7a-4f98-4cbb-9948-acb96bd9d557-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:19:33 user nova-compute[73572]: DEBUG nova.compute.manager [req-aea8413f-c0b8-4cf6-ac72-e4ba8b96fff9 req-1dd87cb8-fdf3-468b-91b2-793dd37716ec service nova] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] No waiting events found dispatching network-vif-unplugged-123d944e-47d4-4f95-94bc-73e1920ecbc1 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:19:33 user nova-compute[73572]: DEBUG nova.compute.manager [req-aea8413f-c0b8-4cf6-ac72-e4ba8b96fff9 req-1dd87cb8-fdf3-468b-91b2-793dd37716ec service nova] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] Received event network-vif-unplugged-123d944e-47d4-4f95-94bc-73e1920ecbc1 for instance with task_state deleting. {{(pid=73572) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 10:19:33 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:19:33 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:19:33 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:19:33 user nova-compute[73572]: DEBUG nova.compute.manager [req-97feb58c-c644-4f3e-8615-416d3b08d0ea req-69457595-12b5-45af-820b-3dd2a202f20f service nova] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] Received event network-vif-unplugged-696cd753-312c-437d-b140-c40b4158554e {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:19:33 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-97feb58c-c644-4f3e-8615-416d3b08d0ea req-69457595-12b5-45af-820b-3dd2a202f20f service nova] Acquiring lock "41c1ef7a-4f98-4cbb-9948-acb96bd9d557-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:19:33 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-97feb58c-c644-4f3e-8615-416d3b08d0ea req-69457595-12b5-45af-820b-3dd2a202f20f service nova] Lock "41c1ef7a-4f98-4cbb-9948-acb96bd9d557-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:19:33 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-97feb58c-c644-4f3e-8615-416d3b08d0ea req-69457595-12b5-45af-820b-3dd2a202f20f service nova] Lock "41c1ef7a-4f98-4cbb-9948-acb96bd9d557-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:19:33 user nova-compute[73572]: DEBUG nova.compute.manager [req-97feb58c-c644-4f3e-8615-416d3b08d0ea req-69457595-12b5-45af-820b-3dd2a202f20f service nova] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] No waiting events found dispatching network-vif-unplugged-696cd753-312c-437d-b140-c40b4158554e {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:19:33 user nova-compute[73572]: DEBUG nova.compute.manager [req-97feb58c-c644-4f3e-8615-416d3b08d0ea req-69457595-12b5-45af-820b-3dd2a202f20f service nova] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] Received event network-vif-unplugged-696cd753-312c-437d-b140-c40b4158554e for instance with task_state deleting. {{(pid=73572) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 10:19:33 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:19:33 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:19:33 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:19:33 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:19:33 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:19:33 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:19:33 user nova-compute[73572]: DEBUG nova.compute.manager [req-2845fe2b-f027-4aed-b0b7-90e34ffd367c req-3f7d54af-ab5b-4856-86f3-9afb91e42b8d service nova] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] Received event network-vif-unplugged-c0c6f2bc-3209-461a-bcc3-edf740139ca2 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:19:33 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-2845fe2b-f027-4aed-b0b7-90e34ffd367c req-3f7d54af-ab5b-4856-86f3-9afb91e42b8d service nova] Acquiring lock "41c1ef7a-4f98-4cbb-9948-acb96bd9d557-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:19:33 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-2845fe2b-f027-4aed-b0b7-90e34ffd367c req-3f7d54af-ab5b-4856-86f3-9afb91e42b8d service nova] Lock "41c1ef7a-4f98-4cbb-9948-acb96bd9d557-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:19:33 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-2845fe2b-f027-4aed-b0b7-90e34ffd367c req-3f7d54af-ab5b-4856-86f3-9afb91e42b8d service nova] Lock "41c1ef7a-4f98-4cbb-9948-acb96bd9d557-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:19:33 user nova-compute[73572]: DEBUG nova.compute.manager [req-2845fe2b-f027-4aed-b0b7-90e34ffd367c req-3f7d54af-ab5b-4856-86f3-9afb91e42b8d service nova] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] No waiting events found dispatching network-vif-unplugged-c0c6f2bc-3209-461a-bcc3-edf740139ca2 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:19:33 user nova-compute[73572]: DEBUG nova.compute.manager [req-2845fe2b-f027-4aed-b0b7-90e34ffd367c req-3f7d54af-ab5b-4856-86f3-9afb91e42b8d service nova] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] Received event network-vif-unplugged-c0c6f2bc-3209-461a-bcc3-edf740139ca2 for instance with task_state deleting. {{(pid=73572) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 10:19:33 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:19:33 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:19:34 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:19:34 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:19:34 user nova-compute[73572]: INFO nova.virt.libvirt.driver [-] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] Instance destroyed successfully.
Aug 26 10:19:34 user nova-compute[73572]: DEBUG nova.objects.instance [None req-a5b8c78d-5639-454a-a211-bd872ff85a61 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] Lazy-loading 'resources' on Instance uuid 41c1ef7a-4f98-4cbb-9948-acb96bd9d557 {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:19:34 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-a5b8c78d-5639-454a-a211-bd872ff85a61 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T10:17:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-134774677',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-134774677',id=22,image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMM+PyzPMQ665kAGppNf46HsUT3HYJTkwTVFQbIbkDU4VagIXaQ7SGc4u3qE2bya41WFz6iVsv2EpJnZJz5aQ7MB5uYF8zBmhQDv3kMfZLp/PrDgRH/onZJ/CCLLihoJzA==',key_name='tempest-keypair-1169777187',keypairs=<?>,launch_index=0,launched_at=2023-08-26T10:18:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7cf2ae4dd7d3474394090e3276c957ec',ramdisk_id='',reservation_id='r-r8s410lq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-2076699378',owner_user_name='tempest-TaggedBootDevicesTest_v242-2076699378-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T10:18:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='25fdd7b9201b4f6eaf5eb6d55bb09ab5',uuid=41c1ef7a-4f98-4cbb-9948-acb96bd9d557,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "123d944e-47d4-4f95-94bc-73e1920ecbc1", "address": "fa:16:3e:95:40:4c", "network": {"id": "ce8484e9-f124-4a9c-9682-289ed99917e2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1080187713-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cf2ae4dd7d3474394090e3276c957ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap123d944e-47", "ovs_interfaceid": "123d944e-47d4-4f95-94bc-73e1920ecbc1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 10:19:34 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-a5b8c78d-5639-454a-a211-bd872ff85a61 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] Converting VIF {"id": "123d944e-47d4-4f95-94bc-73e1920ecbc1", "address": "fa:16:3e:95:40:4c", "network": {"id": "ce8484e9-f124-4a9c-9682-289ed99917e2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1080187713-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cf2ae4dd7d3474394090e3276c957ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap123d944e-47", "ovs_interfaceid": "123d944e-47d4-4f95-94bc-73e1920ecbc1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:19:34 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-a5b8c78d-5639-454a-a211-bd872ff85a61 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:95:40:4c,bridge_name='br-int',has_traffic_filtering=True,id=123d944e-47d4-4f95-94bc-73e1920ecbc1,network=Network(ce8484e9-f124-4a9c-9682-289ed99917e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap123d944e-47') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:19:34 user nova-compute[73572]: DEBUG os_vif [None req-a5b8c78d-5639-454a-a211-bd872ff85a61 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:95:40:4c,bridge_name='br-int',has_traffic_filtering=True,id=123d944e-47d4-4f95-94bc-73e1920ecbc1,network=Network(ce8484e9-f124-4a9c-9682-289ed99917e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap123d944e-47') {{(pid=73572) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 10:19:34 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:19:34 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap123d944e-47, bridge=br-int, if_exists=True) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:19:34 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:19:34 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:19:34 user nova-compute[73572]: INFO os_vif [None req-a5b8c78d-5639-454a-a211-bd872ff85a61 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:95:40:4c,bridge_name='br-int',has_traffic_filtering=True,id=123d944e-47d4-4f95-94bc-73e1920ecbc1,network=Network(ce8484e9-f124-4a9c-9682-289ed99917e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap123d944e-47')
Aug 26 10:19:34 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-a5b8c78d-5639-454a-a211-bd872ff85a61 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T10:17:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-134774677',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-134774677',id=22,image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMM+PyzPMQ665kAGppNf46HsUT3HYJTkwTVFQbIbkDU4VagIXaQ7SGc4u3qE2bya41WFz6iVsv2EpJnZJz5aQ7MB5uYF8zBmhQDv3kMfZLp/PrDgRH/onZJ/CCLLihoJzA==',key_name='tempest-keypair-1169777187',keypairs=<?>,launch_index=0,launched_at=2023-08-26T10:18:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7cf2ae4dd7d3474394090e3276c957ec',ramdisk_id='',reservation_id='r-r8s410lq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-2076699378',owner_user_name='tempest-TaggedBootDevicesTest_v242-2076699378-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T10:18:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='25fdd7b9201b4f6eaf5eb6d55bb09ab5',uuid=41c1ef7a-4f98-4cbb-9948-acb96bd9d557,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "696cd753-312c-437d-b140-c40b4158554e", "address": "fa:16:3e:13:c8:34", "network": {"id": "c0d598c4-68c6-4cfc-adf1-dc0360861788", "bridge": "br-int", "label": "tempest-device-tagging-net1-1696215747", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.77", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7cf2ae4dd7d3474394090e3276c957ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap696cd753-31", "ovs_interfaceid": "696cd753-312c-437d-b140-c40b4158554e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73572) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 10:19:34 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-a5b8c78d-5639-454a-a211-bd872ff85a61 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] Converting VIF {"id": "696cd753-312c-437d-b140-c40b4158554e", "address": "fa:16:3e:13:c8:34", "network": {"id": "c0d598c4-68c6-4cfc-adf1-dc0360861788", "bridge": "br-int", "label": "tempest-device-tagging-net1-1696215747", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.77", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7cf2ae4dd7d3474394090e3276c957ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap696cd753-31", "ovs_interfaceid": "696cd753-312c-437d-b140-c40b4158554e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:19:34 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-a5b8c78d-5639-454a-a211-bd872ff85a61 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:c8:34,bridge_name='br-int',has_traffic_filtering=True,id=696cd753-312c-437d-b140-c40b4158554e,network=Network(c0d598c4-68c6-4cfc-adf1-dc0360861788),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap696cd753-31') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:19:34 user nova-compute[73572]: DEBUG os_vif [None req-a5b8c78d-5639-454a-a211-bd872ff85a61 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:c8:34,bridge_name='br-int',has_traffic_filtering=True,id=696cd753-312c-437d-b140-c40b4158554e,network=Network(c0d598c4-68c6-4cfc-adf1-dc0360861788),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap696cd753-31') {{(pid=73572) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 10:19:34 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:19:34 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap696cd753-31, bridge=br-int, if_exists=True) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:19:34 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:19:34 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:19:34 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:19:34 user nova-compute[73572]: INFO os_vif [None req-a5b8c78d-5639-454a-a211-bd872ff85a61 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:c8:34,bridge_name='br-int',has_traffic_filtering=True,id=696cd753-312c-437d-b140-c40b4158554e,network=Network(c0d598c4-68c6-4cfc-adf1-dc0360861788),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap696cd753-31')
Aug 26 10:19:34 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-a5b8c78d-5639-454a-a211-bd872ff85a61 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T10:17:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-134774677',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-134774677',id=22,image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMM+PyzPMQ665kAGppNf46HsUT3HYJTkwTVFQbIbkDU4VagIXaQ7SGc4u3qE2bya41WFz6iVsv2EpJnZJz5aQ7MB5uYF8zBmhQDv3kMfZLp/PrDgRH/onZJ/CCLLihoJzA==',key_name='tempest-keypair-1169777187',keypairs=<?>,launch_index=0,launched_at=2023-08-26T10:18:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7cf2ae4dd7d3474394090e3276c957ec',ramdisk_id='',reservation_id='r-r8s410lq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-2076699378',owner_user_name='tempest-TaggedBootDevicesTest_v242-2076699378-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T10:18:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='25fdd7b9201b4f6eaf5eb6d55bb09ab5',uuid=41c1ef7a-4f98-4cbb-9948-acb96bd9d557,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3e7d3f56-193b-43ba-9cc5-c5373755e06f", "address": "fa:16:3e:85:00:8b", "network": {"id": "c0d598c4-68c6-4cfc-adf1-dc0360861788", "bridge": "br-int", "label": "tempest-device-tagging-net1-1696215747", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.177", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7cf2ae4dd7d3474394090e3276c957ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e7d3f56-19", "ovs_interfaceid": "3e7d3f56-193b-43ba-9cc5-c5373755e06f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73572) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 10:19:34 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-a5b8c78d-5639-454a-a211-bd872ff85a61 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] Converting VIF {"id": "3e7d3f56-193b-43ba-9cc5-c5373755e06f", "address": "fa:16:3e:85:00:8b", "network": {"id": "c0d598c4-68c6-4cfc-adf1-dc0360861788", "bridge": "br-int", "label": "tempest-device-tagging-net1-1696215747", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.177", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7cf2ae4dd7d3474394090e3276c957ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e7d3f56-19", "ovs_interfaceid": "3e7d3f56-193b-43ba-9cc5-c5373755e06f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:19:34 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-a5b8c78d-5639-454a-a211-bd872ff85a61 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:85:00:8b,bridge_name='br-int',has_traffic_filtering=True,id=3e7d3f56-193b-43ba-9cc5-c5373755e06f,network=Network(c0d598c4-68c6-4cfc-adf1-dc0360861788),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3e7d3f56-19') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:19:34 user nova-compute[73572]: DEBUG os_vif [None req-a5b8c78d-5639-454a-a211-bd872ff85a61 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:85:00:8b,bridge_name='br-int',has_traffic_filtering=True,id=3e7d3f56-193b-43ba-9cc5-c5373755e06f,network=Network(c0d598c4-68c6-4cfc-adf1-dc0360861788),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3e7d3f56-19') {{(pid=73572) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 10:19:34 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:19:34 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3e7d3f56-19, bridge=br-int, if_exists=True) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:19:34 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:19:34 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:19:34 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:19:34 user nova-compute[73572]: INFO os_vif [None req-a5b8c78d-5639-454a-a211-bd872ff85a61 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:85:00:8b,bridge_name='br-int',has_traffic_filtering=True,id=3e7d3f56-193b-43ba-9cc5-c5373755e06f,network=Network(c0d598c4-68c6-4cfc-adf1-dc0360861788),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3e7d3f56-19')
Aug 26 10:19:34 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-a5b8c78d-5639-454a-a211-bd872ff85a61 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T10:17:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-134774677',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-134774677',id=22,image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMM+PyzPMQ665kAGppNf46HsUT3HYJTkwTVFQbIbkDU4VagIXaQ7SGc4u3qE2bya41WFz6iVsv2EpJnZJz5aQ7MB5uYF8zBmhQDv3kMfZLp/PrDgRH/onZJ/CCLLihoJzA==',key_name='tempest-keypair-1169777187',keypairs=<?>,launch_index=0,launched_at=2023-08-26T10:18:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7cf2ae4dd7d3474394090e3276c957ec',ramdisk_id='',reservation_id='r-r8s410lq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-2076699378',owner_user_name='tempest-TaggedBootDevicesTest_v242-2076699378-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T10:18:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='25fdd7b9201b4f6eaf5eb6d55bb09ab5',uuid=41c1ef7a-4f98-4cbb-9948-acb96bd9d557,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f264d951-8920-4151-8276-33baa6a9def9", "address": "fa:16:3e:a7:e2:2a", "network": {"id": "c0d598c4-68c6-4cfc-adf1-dc0360861788", "bridge": "br-int", "label": "tempest-device-tagging-net1-1696215747", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7cf2ae4dd7d3474394090e3276c957ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf264d951-89", "ovs_interfaceid": "f264d951-8920-4151-8276-33baa6a9def9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 10:19:34 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-a5b8c78d-5639-454a-a211-bd872ff85a61 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] Converting VIF {"id": "f264d951-8920-4151-8276-33baa6a9def9", "address": "fa:16:3e:a7:e2:2a", "network": {"id": "c0d598c4-68c6-4cfc-adf1-dc0360861788", "bridge": "br-int", "label": "tempest-device-tagging-net1-1696215747", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7cf2ae4dd7d3474394090e3276c957ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf264d951-89", "ovs_interfaceid": "f264d951-8920-4151-8276-33baa6a9def9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:19:34 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-a5b8c78d-5639-454a-a211-bd872ff85a61 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:e2:2a,bridge_name='br-int',has_traffic_filtering=True,id=f264d951-8920-4151-8276-33baa6a9def9,network=Network(c0d598c4-68c6-4cfc-adf1-dc0360861788),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf264d951-89') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:19:34 user nova-compute[73572]: DEBUG os_vif [None req-a5b8c78d-5639-454a-a211-bd872ff85a61 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:e2:2a,bridge_name='br-int',has_traffic_filtering=True,id=f264d951-8920-4151-8276-33baa6a9def9,network=Network(c0d598c4-68c6-4cfc-adf1-dc0360861788),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf264d951-89') {{(pid=73572) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 10:19:34 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:19:34 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf264d951-89, bridge=br-int, if_exists=True) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:19:34 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:19:34 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:19:34 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:19:34 user nova-compute[73572]: INFO os_vif [None req-a5b8c78d-5639-454a-a211-bd872ff85a61 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:e2:2a,bridge_name='br-int',has_traffic_filtering=True,id=f264d951-8920-4151-8276-33baa6a9def9,network=Network(c0d598c4-68c6-4cfc-adf1-dc0360861788),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf264d951-89')
Aug 26 10:19:34 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-a5b8c78d-5639-454a-a211-bd872ff85a61 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T10:17:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-134774677',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-134774677',id=22,image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMM+PyzPMQ665kAGppNf46HsUT3HYJTkwTVFQbIbkDU4VagIXaQ7SGc4u3qE2bya41WFz6iVsv2EpJnZJz5aQ7MB5uYF8zBmhQDv3kMfZLp/PrDgRH/onZJ/CCLLihoJzA==',key_name='tempest-keypair-1169777187',keypairs=<?>,launch_index=0,launched_at=2023-08-26T10:18:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7cf2ae4dd7d3474394090e3276c957ec',ramdisk_id='',reservation_id='r-r8s410lq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-2076699378',owner_user_name='tempest-TaggedBootDevicesTest_v242-2076699378-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T10:18:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='25fdd7b9201b4f6eaf5eb6d55bb09ab5',uuid=41c1ef7a-4f98-4cbb-9948-acb96bd9d557,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c0c6f2bc-3209-461a-bcc3-edf740139ca2", "address": "fa:16:3e:d1:c7:a5", "network": {"id": "c0d598c4-68c6-4cfc-adf1-dc0360861788", "bridge": "br-int", "label": "tempest-device-tagging-net1-1696215747", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.224", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7cf2ae4dd7d3474394090e3276c957ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0c6f2bc-32", "ovs_interfaceid": "c0c6f2bc-3209-461a-bcc3-edf740139ca2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 10:19:34 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-a5b8c78d-5639-454a-a211-bd872ff85a61 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] Converting VIF {"id": "c0c6f2bc-3209-461a-bcc3-edf740139ca2", "address": "fa:16:3e:d1:c7:a5", "network": {"id": "c0d598c4-68c6-4cfc-adf1-dc0360861788", "bridge": "br-int", "label": "tempest-device-tagging-net1-1696215747", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.224", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7cf2ae4dd7d3474394090e3276c957ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0c6f2bc-32", "ovs_interfaceid": "c0c6f2bc-3209-461a-bcc3-edf740139ca2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:19:34 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-a5b8c78d-5639-454a-a211-bd872ff85a61 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:c7:a5,bridge_name='br-int',has_traffic_filtering=True,id=c0c6f2bc-3209-461a-bcc3-edf740139ca2,network=Network(c0d598c4-68c6-4cfc-adf1-dc0360861788),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0c6f2bc-32') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:19:34 user nova-compute[73572]: DEBUG os_vif [None req-a5b8c78d-5639-454a-a211-bd872ff85a61 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:c7:a5,bridge_name='br-int',has_traffic_filtering=True,id=c0c6f2bc-3209-461a-bcc3-edf740139ca2,network=Network(c0d598c4-68c6-4cfc-adf1-dc0360861788),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0c6f2bc-32') {{(pid=73572) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 10:19:34 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:19:34 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc0c6f2bc-32, bridge=br-int, if_exists=True) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:19:34 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:19:34 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:19:34 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:19:34 user nova-compute[73572]: INFO os_vif [None req-a5b8c78d-5639-454a-a211-bd872ff85a61 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:c7:a5,bridge_name='br-int',has_traffic_filtering=True,id=c0c6f2bc-3209-461a-bcc3-edf740139ca2,network=Network(c0d598c4-68c6-4cfc-adf1-dc0360861788),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0c6f2bc-32')
Aug 26 10:19:34 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-a5b8c78d-5639-454a-a211-bd872ff85a61 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T10:17:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-134774677',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-134774677',id=22,image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMM+PyzPMQ665kAGppNf46HsUT3HYJTkwTVFQbIbkDU4VagIXaQ7SGc4u3qE2bya41WFz6iVsv2EpJnZJz5aQ7MB5uYF8zBmhQDv3kMfZLp/PrDgRH/onZJ/CCLLihoJzA==',key_name='tempest-keypair-1169777187',keypairs=<?>,launch_index=0,launched_at=2023-08-26T10:18:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7cf2ae4dd7d3474394090e3276c957ec',ramdisk_id='',reservation_id='r-r8s410lq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-2076699378',owner_user_name='tempest-TaggedBootDevicesTest_v242-2076699378-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T10:18:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='25fdd7b9201b4f6eaf5eb6d55bb09ab5',uuid=41c1ef7a-4f98-4cbb-9948-acb96bd9d557,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2fe25c93-5639-47a6-80de-8cc83615e3c4", "address": "fa:16:3e:59:09:63", "network": {"id": "f69a6193-9faf-4224-b21b-bc60491f9aea", "bridge": "br-int", "label": "tempest-device-tagging-net2-1404521418", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7cf2ae4dd7d3474394090e3276c957ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fe25c93-56", "ovs_interfaceid": "2fe25c93-5639-47a6-80de-8cc83615e3c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 10:19:34 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-a5b8c78d-5639-454a-a211-bd872ff85a61 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] Converting VIF {"id": "2fe25c93-5639-47a6-80de-8cc83615e3c4", "address": "fa:16:3e:59:09:63", "network": {"id": "f69a6193-9faf-4224-b21b-bc60491f9aea", "bridge": "br-int", "label": "tempest-device-tagging-net2-1404521418", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7cf2ae4dd7d3474394090e3276c957ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fe25c93-56", "ovs_interfaceid": "2fe25c93-5639-47a6-80de-8cc83615e3c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:19:34 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-a5b8c78d-5639-454a-a211-bd872ff85a61 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:09:63,bridge_name='br-int',has_traffic_filtering=True,id=2fe25c93-5639-47a6-80de-8cc83615e3c4,network=Network(f69a6193-9faf-4224-b21b-bc60491f9aea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2fe25c93-56') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:19:34 user nova-compute[73572]: DEBUG os_vif [None req-a5b8c78d-5639-454a-a211-bd872ff85a61 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:09:63,bridge_name='br-int',has_traffic_filtering=True,id=2fe25c93-5639-47a6-80de-8cc83615e3c4,network=Network(f69a6193-9faf-4224-b21b-bc60491f9aea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2fe25c93-56') {{(pid=73572) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 10:19:34 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:19:34 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2fe25c93-56, bridge=br-int, if_exists=True) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:19:34 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:19:34 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:19:34 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:19:34 user nova-compute[73572]: INFO os_vif [None req-a5b8c78d-5639-454a-a211-bd872ff85a61 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:09:63,bridge_name='br-int',has_traffic_filtering=True,id=2fe25c93-5639-47a6-80de-8cc83615e3c4,network=Network(f69a6193-9faf-4224-b21b-bc60491f9aea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2fe25c93-56')
Aug 26 10:19:34 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-a5b8c78d-5639-454a-a211-bd872ff85a61 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T10:17:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-134774677',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-134774677',id=22,image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMM+PyzPMQ665kAGppNf46HsUT3HYJTkwTVFQbIbkDU4VagIXaQ7SGc4u3qE2bya41WFz6iVsv2EpJnZJz5aQ7MB5uYF8zBmhQDv3kMfZLp/PrDgRH/onZJ/CCLLihoJzA==',key_name='tempest-keypair-1169777187',keypairs=<?>,launch_index=0,launched_at=2023-08-26T10:18:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7cf2ae4dd7d3474394090e3276c957ec',ramdisk_id='',reservation_id='r-r8s410lq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-2076699378',owner_user_name='tempest-TaggedBootDevicesTest_v242-2076699378-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T10:18:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='25fdd7b9201b4f6eaf5eb6d55bb09ab5',uuid=41c1ef7a-4f98-4cbb-9948-acb96bd9d557,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8bc3e6f9-0fb7-4283-973c-cbb09e440e68", "address": "fa:16:3e:3d:e7:4c", "network": {"id": "f69a6193-9faf-4224-b21b-bc60491f9aea", "bridge": "br-int", "label": "tempest-device-tagging-net2-1404521418", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7cf2ae4dd7d3474394090e3276c957ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bc3e6f9-0f", "ovs_interfaceid": "8bc3e6f9-0fb7-4283-973c-cbb09e440e68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 10:19:34 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-a5b8c78d-5639-454a-a211-bd872ff85a61 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] Converting VIF {"id": "8bc3e6f9-0fb7-4283-973c-cbb09e440e68", "address": "fa:16:3e:3d:e7:4c", "network": {"id": "f69a6193-9faf-4224-b21b-bc60491f9aea", "bridge": "br-int", "label": "tempest-device-tagging-net2-1404521418", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7cf2ae4dd7d3474394090e3276c957ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bc3e6f9-0f", "ovs_interfaceid": "8bc3e6f9-0fb7-4283-973c-cbb09e440e68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:19:34 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-a5b8c78d-5639-454a-a211-bd872ff85a61 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:e7:4c,bridge_name='br-int',has_traffic_filtering=True,id=8bc3e6f9-0fb7-4283-973c-cbb09e440e68,network=Network(f69a6193-9faf-4224-b21b-bc60491f9aea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8bc3e6f9-0f') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:19:34 user nova-compute[73572]: DEBUG os_vif [None req-a5b8c78d-5639-454a-a211-bd872ff85a61 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:e7:4c,bridge_name='br-int',has_traffic_filtering=True,id=8bc3e6f9-0fb7-4283-973c-cbb09e440e68,network=Network(f69a6193-9faf-4224-b21b-bc60491f9aea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8bc3e6f9-0f') {{(pid=73572) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 10:19:34 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:19:34 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8bc3e6f9-0f, bridge=br-int, if_exists=True) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:19:34 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:19:34 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:19:34 user nova-compute[73572]: INFO os_vif [None req-a5b8c78d-5639-454a-a211-bd872ff85a61 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:e7:4c,bridge_name='br-int',has_traffic_filtering=True,id=8bc3e6f9-0fb7-4283-973c-cbb09e440e68,network=Network(f69a6193-9faf-4224-b21b-bc60491f9aea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8bc3e6f9-0f')
Aug 26 10:19:34 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a5b8c78d-5639-454a-a211-bd872ff85a61 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] calling os-brick to detach iSCSI Volume {{(pid=73572) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 10:19:34 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5b8c78d-5639-454a-a211-bd872ff85a61 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc89c3d6a10>, {'target_iqns': ['iqn.2010-10.org.openstack:c22666f6-bb12-41a8-b565-837f4617df4e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fwvpiNzA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 10:19:34 user nova-compute[73572]: WARNING os_brick.initiator.connectors.base [None req-a5b8c78d-5639-454a-a211-bd872ff85a61 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 10:19:34 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-a5b8c78d-5639-454a-a211-bd872ff85a61 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 10:19:34 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-a5b8c78d-5639-454a-a211-bd872ff85a61 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 10:19:34 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5b8c78d-5639-454a-a211-bd872ff85a61 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c22666f6-bb12-41a8-b565-837f4617df4e', 0)] {{(pid=73572) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 10:19:34 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:19:34 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:19:34 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[91e5274d-8e3a-4e0c-8ee1-d4918507dc12]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:302c3cfe-f0ec-4b1c-b1d9-dc12d4f4ce40\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:57b56972-76f9-44aa-905c-14d04f924f76\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c22666f6-bb12-41a8-b565-837f4617df4e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eaa45a8a-93fc-4fac-bc41-ce4fa5173718\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:19:34 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:19:34 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.040s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:19:34 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[07ab397f-6705-48f0-a564-076016d6368c]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c22666f6-bb12-41a8-b565-837f4617df4e (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57b56972-76f9-44aa-905c-14d04f924f76 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaa45a8a-93fc-4fac-bc41-ce4fa5173718 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:302c3cfe-f0ec-4b1c-b1d9-dc12d4f4ce40 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478 (non-flash)\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:19:34 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5b8c78d-5639-454a-a211-bd872ff85a61 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)
Aug 26 10:19:34 user nova-compute[73572]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c22666f6-bb12-41a8-b565-837f4617df4e (non-flash)
Aug 26 10:19:34 user nova-compute[73572]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57b56972-76f9-44aa-905c-14d04f924f76 (non-flash)
Aug 26 10:19:34 user nova-compute[73572]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaa45a8a-93fc-4fac-bc41-ce4fa5173718 (non-flash)
Aug 26 10:19:34 user nova-compute[73572]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:302c3cfe-f0ec-4b1c-b1d9-dc12d4f4ce40 (non-flash)
Aug 26 10:19:34 user nova-compute[73572]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478 (non-flash)
Aug 26 10:19:34 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 10:19:34 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5b8c78d-5639-454a-a211-bd872ff85a61 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)
Aug 26 10:19:34 user nova-compute[73572]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c22666f6-bb12-41a8-b565-837f4617df4e (non-flash)
Aug 26 10:19:34 user nova-compute[73572]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57b56972-76f9-44aa-905c-14d04f924f76 (non-flash)
Aug 26 10:19:34 user nova-compute[73572]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaa45a8a-93fc-4fac-bc41-ce4fa5173718 (non-flash)
Aug 26 10:19:34 user nova-compute[73572]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:302c3cfe-f0ec-4b1c-b1d9-dc12d4f4ce40 (non-flash)
Aug 26 10:19:34 user nova-compute[73572]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478 (non-flash)
Aug 26 10:19:34 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 10:19:34 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5b8c78d-5639-454a-a211-bd872ff85a61 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc89c5b1480>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c22666f6-bb12-41a8-b565-837f4617df4e'): ({'sdd'}, set())}) {{(pid=73572) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 10:19:34 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-a5b8c78d-5639-454a-a211-bd872ff85a61 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] Removing single pathed devices sdd {{(pid=73572) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 10:19:34 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:19:34 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:19:34 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[50e6b1b0-070f-4c72-8a80-9387a7940028]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:19:34 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:19:35 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.034s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:19:35 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ddd5f7e-0cde-474b-80ec-f672410072ee]: (4, ('ok\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:19:35 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-a5b8c78d-5639-454a-a211-bd872ff85a61 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] Flushing IO for device /dev/sdd {{(pid=73572) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 10:19:35 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:19:35 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.017s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:19:35 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d40e08d-3624-49c4-9a68-b18a4dcfef79]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:19:35 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-a5b8c78d-5639-454a-a211-bd872ff85a61 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73572) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 10:19:35 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:19:35 user nova-compute[73572]: DEBUG nova.compute.manager [req-9cedb889-5f25-4d97-96df-cf3ff4ebcd47 req-aa3d871a-e39c-4857-8d5c-4d582cb81455 service nova] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] Received event network-vif-plugged-123d944e-47d4-4f95-94bc-73e1920ecbc1 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:19:35 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-9cedb889-5f25-4d97-96df-cf3ff4ebcd47 req-aa3d871a-e39c-4857-8d5c-4d582cb81455 service nova] Acquiring lock "41c1ef7a-4f98-4cbb-9948-acb96bd9d557-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:19:35 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-9cedb889-5f25-4d97-96df-cf3ff4ebcd47 req-aa3d871a-e39c-4857-8d5c-4d582cb81455 service nova] Lock "41c1ef7a-4f98-4cbb-9948-acb96bd9d557-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:19:35 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-9cedb889-5f25-4d97-96df-cf3ff4ebcd47 req-aa3d871a-e39c-4857-8d5c-4d582cb81455 service nova] Lock "41c1ef7a-4f98-4cbb-9948-acb96bd9d557-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:19:35 user nova-compute[73572]: DEBUG nova.compute.manager [req-9cedb889-5f25-4d97-96df-cf3ff4ebcd47 req-aa3d871a-e39c-4857-8d5c-4d582cb81455 service nova] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] No waiting events found dispatching network-vif-plugged-123d944e-47d4-4f95-94bc-73e1920ecbc1 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:19:35 user nova-compute[73572]: WARNING nova.compute.manager [req-9cedb889-5f25-4d97-96df-cf3ff4ebcd47 req-aa3d871a-e39c-4857-8d5c-4d582cb81455 service nova] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] Received unexpected event network-vif-plugged-123d944e-47d4-4f95-94bc-73e1920ecbc1 for instance with vm_state active and task_state deleting.
Aug 26 10:19:35 user nova-compute[73572]: DEBUG nova.compute.manager [req-9cedb889-5f25-4d97-96df-cf3ff4ebcd47 req-aa3d871a-e39c-4857-8d5c-4d582cb81455 service nova] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] Received event network-vif-unplugged-3e7d3f56-193b-43ba-9cc5-c5373755e06f {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:19:35 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-9cedb889-5f25-4d97-96df-cf3ff4ebcd47 req-aa3d871a-e39c-4857-8d5c-4d582cb81455 service nova] Acquiring lock "41c1ef7a-4f98-4cbb-9948-acb96bd9d557-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:19:35 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-9cedb889-5f25-4d97-96df-cf3ff4ebcd47 req-aa3d871a-e39c-4857-8d5c-4d582cb81455 service nova] Lock "41c1ef7a-4f98-4cbb-9948-acb96bd9d557-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:19:35 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-9cedb889-5f25-4d97-96df-cf3ff4ebcd47 req-aa3d871a-e39c-4857-8d5c-4d582cb81455 service nova] Lock "41c1ef7a-4f98-4cbb-9948-acb96bd9d557-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:19:35 user nova-compute[73572]: DEBUG nova.compute.manager [req-9cedb889-5f25-4d97-96df-cf3ff4ebcd47 req-aa3d871a-e39c-4857-8d5c-4d582cb81455 service nova] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] No waiting events found dispatching network-vif-unplugged-3e7d3f56-193b-43ba-9cc5-c5373755e06f {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:19:35 user nova-compute[73572]: DEBUG nova.compute.manager [req-9cedb889-5f25-4d97-96df-cf3ff4ebcd47 req-aa3d871a-e39c-4857-8d5c-4d582cb81455 service nova] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] Received event network-vif-unplugged-3e7d3f56-193b-43ba-9cc5-c5373755e06f for instance with task_state deleting. {{(pid=73572) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 10:19:35 user nova-compute[73572]: DEBUG nova.compute.manager [req-9cedb889-5f25-4d97-96df-cf3ff4ebcd47 req-aa3d871a-e39c-4857-8d5c-4d582cb81455 service nova] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] Received event network-vif-plugged-3e7d3f56-193b-43ba-9cc5-c5373755e06f {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:19:35 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-9cedb889-5f25-4d97-96df-cf3ff4ebcd47 req-aa3d871a-e39c-4857-8d5c-4d582cb81455 service nova] Acquiring lock "41c1ef7a-4f98-4cbb-9948-acb96bd9d557-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:19:35 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-9cedb889-5f25-4d97-96df-cf3ff4ebcd47 req-aa3d871a-e39c-4857-8d5c-4d582cb81455 service nova] Lock "41c1ef7a-4f98-4cbb-9948-acb96bd9d557-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:19:35 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-9cedb889-5f25-4d97-96df-cf3ff4ebcd47 req-aa3d871a-e39c-4857-8d5c-4d582cb81455 service nova] Lock "41c1ef7a-4f98-4cbb-9948-acb96bd9d557-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:19:35 user nova-compute[73572]: DEBUG nova.compute.manager [req-9cedb889-5f25-4d97-96df-cf3ff4ebcd47 req-aa3d871a-e39c-4857-8d5c-4d582cb81455 service nova] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] No waiting events found dispatching network-vif-plugged-3e7d3f56-193b-43ba-9cc5-c5373755e06f {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:19:35 user nova-compute[73572]: WARNING nova.compute.manager [req-9cedb889-5f25-4d97-96df-cf3ff4ebcd47 req-aa3d871a-e39c-4857-8d5c-4d582cb81455 service nova] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] Received unexpected event network-vif-plugged-3e7d3f56-193b-43ba-9cc5-c5373755e06f for instance with vm_state active and task_state deleting.
Aug 26 10:19:35 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.056s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:19:35 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[86aa3c27-03a8-48de-9b2e-d03512ba80de]: (4, ('1', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:19:35 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-a5b8c78d-5639-454a-a211-bd872ff85a61 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73572) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 10:19:35 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-a5b8c78d-5639-454a-a211-bd872ff85a61 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] SCSI volumes sdd have been removed. {{(pid=73572) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 10:19:35 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5b8c78d-5639-454a-a211-bd872ff85a61 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c22666f6-bb12-41a8-b565-837f4617df4e')] {{(pid=73572) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 10:19:35 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c22666f6-bb12-41a8-b565-837f4617df4e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:19:35 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c22666f6-bb12-41a8-b565-837f4617df4e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.046s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:19:35 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[a366a159-0d56-4f1e-a8b8-f89ad9ec63e1]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:19:35 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5b8c78d-5639-454a-a211-bd872ff85a61 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:19:35 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c22666f6-bb12-41a8-b565-837f4617df4e -p 172.16.0.220:3260 --logout {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:19:35 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c22666f6-bb12-41a8-b565-837f4617df4e -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:19:35 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[1442164e-023f-4a79-a3f8-8cf1a13ea241]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:c22666f6-bb12-41a8-b565-837f4617df4e, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:c22666f6-bb12-41a8-b565-837f4617df4e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:19:35 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5b8c78d-5639-454a-a211-bd872ff85a61 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:c22666f6-bb12-41a8-b565-837f4617df4e, portal: 172.16.0.220,3260]
Aug 26 10:19:35 user nova-compute[73572]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:c22666f6-bb12-41a8-b565-837f4617df4e, portal: 172.16.0.220,3260] successful.
Aug 26 10:19:35 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:19:35 user nova-compute[73572]: DEBUG nova.compute.manager [req-9dd9978a-c2cc-4640-a217-2eb1ff1da731 req-394f52e7-31a0-4a8a-ab81-31324bbb810d service nova] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] Received event network-vif-plugged-696cd753-312c-437d-b140-c40b4158554e {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:19:35 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-9dd9978a-c2cc-4640-a217-2eb1ff1da731 req-394f52e7-31a0-4a8a-ab81-31324bbb810d service nova] Acquiring lock "41c1ef7a-4f98-4cbb-9948-acb96bd9d557-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:19:35 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-9dd9978a-c2cc-4640-a217-2eb1ff1da731 req-394f52e7-31a0-4a8a-ab81-31324bbb810d service nova] Lock "41c1ef7a-4f98-4cbb-9948-acb96bd9d557-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:19:35 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-9dd9978a-c2cc-4640-a217-2eb1ff1da731 req-394f52e7-31a0-4a8a-ab81-31324bbb810d service nova] Lock "41c1ef7a-4f98-4cbb-9948-acb96bd9d557-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:19:35 user nova-compute[73572]: DEBUG nova.compute.manager [req-9dd9978a-c2cc-4640-a217-2eb1ff1da731 req-394f52e7-31a0-4a8a-ab81-31324bbb810d service nova] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] No waiting events found dispatching network-vif-plugged-696cd753-312c-437d-b140-c40b4158554e {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:19:35 user nova-compute[73572]: WARNING nova.compute.manager [req-9dd9978a-c2cc-4640-a217-2eb1ff1da731 req-394f52e7-31a0-4a8a-ab81-31324bbb810d service nova] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] Received unexpected event network-vif-plugged-696cd753-312c-437d-b140-c40b4158554e for instance with vm_state active and task_state deleting.
Aug 26 10:19:35 user nova-compute[73572]: DEBUG nova.compute.manager [req-9dd9978a-c2cc-4640-a217-2eb1ff1da731 req-394f52e7-31a0-4a8a-ab81-31324bbb810d service nova] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] Received event network-vif-unplugged-f264d951-8920-4151-8276-33baa6a9def9 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:19:35 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-9dd9978a-c2cc-4640-a217-2eb1ff1da731 req-394f52e7-31a0-4a8a-ab81-31324bbb810d service nova] Acquiring lock "41c1ef7a-4f98-4cbb-9948-acb96bd9d557-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:19:35 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-9dd9978a-c2cc-4640-a217-2eb1ff1da731 req-394f52e7-31a0-4a8a-ab81-31324bbb810d service nova] Lock "41c1ef7a-4f98-4cbb-9948-acb96bd9d557-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:19:35 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-9dd9978a-c2cc-4640-a217-2eb1ff1da731 req-394f52e7-31a0-4a8a-ab81-31324bbb810d service nova] Lock "41c1ef7a-4f98-4cbb-9948-acb96bd9d557-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:19:35 user nova-compute[73572]: DEBUG nova.compute.manager [req-9dd9978a-c2cc-4640-a217-2eb1ff1da731 req-394f52e7-31a0-4a8a-ab81-31324bbb810d service nova] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] No waiting events found dispatching network-vif-unplugged-f264d951-8920-4151-8276-33baa6a9def9 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:19:35 user nova-compute[73572]: DEBUG nova.compute.manager [req-9dd9978a-c2cc-4640-a217-2eb1ff1da731 req-394f52e7-31a0-4a8a-ab81-31324bbb810d service nova] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] Received event network-vif-unplugged-f264d951-8920-4151-8276-33baa6a9def9 for instance with task_state deleting. {{(pid=73572) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 10:19:35 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c22666f6-bb12-41a8-b565-837f4617df4e -p 172.16.0.220:3260 --op delete {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:19:35 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c22666f6-bb12-41a8-b565-837f4617df4e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:19:35 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fd5b088-bed9-4090-8ec0-c6c883cf6861]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:19:35 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5b8c78d-5639-454a-a211-bd872ff85a61 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:19:35 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-a5b8c78d-5639-454a-a211-bd872ff85a61 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.401s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 10:19:35 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5b8c78d-5639-454a-a211-bd872ff85a61 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] <== disconnect_volume: return (402ms) None {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 10:19:35 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a5b8c78d-5639-454a-a211-bd872ff85a61 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] Disconnected iSCSI Volume {{(pid=73572) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 10:19:35 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a5b8c78d-5639-454a-a211-bd872ff85a61 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] calling os-brick to detach iSCSI Volume {{(pid=73572) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 10:19:35 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5b8c78d-5639-454a-a211-bd872ff85a61 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc89c3d6a10>, {'target_iqns': ['iqn.2010-10.org.openstack:57b56972-76f9-44aa-905c-14d04f924f76'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QtJkoDyh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 10:19:35 user nova-compute[73572]: WARNING os_brick.initiator.connectors.base [None req-a5b8c78d-5639-454a-a211-bd872ff85a61 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 10:19:35 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-a5b8c78d-5639-454a-a211-bd872ff85a61 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 10:19:35 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-a5b8c78d-5639-454a-a211-bd872ff85a61 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 10:19:35 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5b8c78d-5639-454a-a211-bd872ff85a61 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:57b56972-76f9-44aa-905c-14d04f924f76', 0)] {{(pid=73572) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 10:19:35 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:19:35 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:19:35 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e3acb94-0d91-4e45-b29d-95a502c0bfba]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:302c3cfe-f0ec-4b1c-b1d9-dc12d4f4ce40\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:57b56972-76f9-44aa-905c-14d04f924f76\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eaa45a8a-93fc-4fac-bc41-ce4fa5173718\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:19:35 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:19:35 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:19:35 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7983eec-c730-422b-ba57-0c87838fcf62]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57b56972-76f9-44aa-905c-14d04f924f76 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaa45a8a-93fc-4fac-bc41-ce4fa5173718 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:302c3cfe-f0ec-4b1c-b1d9-dc12d4f4ce40 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478 (non-flash)\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:19:35 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5b8c78d-5639-454a-a211-bd872ff85a61 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)
Aug 26 10:19:35 user nova-compute[73572]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57b56972-76f9-44aa-905c-14d04f924f76 (non-flash)
Aug 26 10:19:35 user nova-compute[73572]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaa45a8a-93fc-4fac-bc41-ce4fa5173718 (non-flash)
Aug 26 10:19:35 user nova-compute[73572]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:302c3cfe-f0ec-4b1c-b1d9-dc12d4f4ce40 (non-flash)
Aug 26 10:19:35 user nova-compute[73572]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478 (non-flash)
Aug 26 10:19:35 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 10:19:35 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5b8c78d-5639-454a-a211-bd872ff85a61 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)
Aug 26 10:19:35 user nova-compute[73572]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57b56972-76f9-44aa-905c-14d04f924f76 (non-flash)
Aug 26 10:19:35 user nova-compute[73572]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaa45a8a-93fc-4fac-bc41-ce4fa5173718 (non-flash)
Aug 26 10:19:35 user nova-compute[73572]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:302c3cfe-f0ec-4b1c-b1d9-dc12d4f4ce40 (non-flash)
Aug 26 10:19:35 user nova-compute[73572]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478 (non-flash)
Aug 26 10:19:35 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 10:19:35 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5b8c78d-5639-454a-a211-bd872ff85a61 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc89c5f7f40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:57b56972-76f9-44aa-905c-14d04f924f76'): ({'sde'}, set())}) {{(pid=73572) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 10:19:35 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-a5b8c78d-5639-454a-a211-bd872ff85a61 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] Removing single pathed devices sde {{(pid=73572) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 10:19:35 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:19:35 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:19:35 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c3022d6-944a-4da5-8f73-469469476982]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:19:35 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:19:35 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.027s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:19:35 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b703712-7673-4a33-af3c-430641f54f5e]: (4, ('ok\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:19:35 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-a5b8c78d-5639-454a-a211-bd872ff85a61 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] Flushing IO for device /dev/sde {{(pid=73572) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 10:19:35 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:19:35 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.022s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:19:35 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[d12fad1b-82eb-4b47-b310-dcde608b1ed1]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:19:35 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-a5b8c78d-5639-454a-a211-bd872ff85a61 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73572) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 10:19:35 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:19:35 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.049s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:19:35 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[63b599e0-f28c-4780-9dbe-8cac7f816388]: (4, ('1', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:19:35 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-a5b8c78d-5639-454a-a211-bd872ff85a61 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73572) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 10:19:35 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-a5b8c78d-5639-454a-a211-bd872ff85a61 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] SCSI volumes sde have been removed. {{(pid=73572) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 10:19:35 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5b8c78d-5639-454a-a211-bd872ff85a61 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:57b56972-76f9-44aa-905c-14d04f924f76')] {{(pid=73572) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 10:19:35 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57b56972-76f9-44aa-905c-14d04f924f76 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:19:35 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57b56972-76f9-44aa-905c-14d04f924f76 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.030s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:19:35 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[29182e87-2f40-418b-812f-489fc1d335f8]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:19:35 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5b8c78d-5639-454a-a211-bd872ff85a61 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:19:35 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57b56972-76f9-44aa-905c-14d04f924f76 -p 172.16.0.220:3260 --logout {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:19:35 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57b56972-76f9-44aa-905c-14d04f924f76 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:19:35 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2626a61-aff3-4be5-bcc7-b6fded892653]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:57b56972-76f9-44aa-905c-14d04f924f76, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:57b56972-76f9-44aa-905c-14d04f924f76, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:19:35 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5b8c78d-5639-454a-a211-bd872ff85a61 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:57b56972-76f9-44aa-905c-14d04f924f76, portal: 172.16.0.220,3260]
Aug 26 10:19:35 user nova-compute[73572]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:57b56972-76f9-44aa-905c-14d04f924f76, portal: 172.16.0.220,3260] successful.
Aug 26 10:19:35 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:19:35 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57b56972-76f9-44aa-905c-14d04f924f76 -p 172.16.0.220:3260 --op delete {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:19:35 user nova-compute[73572]: DEBUG nova.compute.manager [req-13350e2a-49ed-4eea-9e1a-87ee6b2eb1e0 req-8f4f559e-6be2-4528-92ae-cd44031a99bd service nova] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] Received event network-vif-plugged-c0c6f2bc-3209-461a-bcc3-edf740139ca2 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:19:35 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-13350e2a-49ed-4eea-9e1a-87ee6b2eb1e0 req-8f4f559e-6be2-4528-92ae-cd44031a99bd service nova] Acquiring lock "41c1ef7a-4f98-4cbb-9948-acb96bd9d557-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:19:35 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-13350e2a-49ed-4eea-9e1a-87ee6b2eb1e0 req-8f4f559e-6be2-4528-92ae-cd44031a99bd service nova] Lock "41c1ef7a-4f98-4cbb-9948-acb96bd9d557-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:19:35 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-13350e2a-49ed-4eea-9e1a-87ee6b2eb1e0 req-8f4f559e-6be2-4528-92ae-cd44031a99bd service nova] Lock "41c1ef7a-4f98-4cbb-9948-acb96bd9d557-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:19:35 user nova-compute[73572]: DEBUG nova.compute.manager [req-13350e2a-49ed-4eea-9e1a-87ee6b2eb1e0 req-8f4f559e-6be2-4528-92ae-cd44031a99bd service nova] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] No waiting events found dispatching network-vif-plugged-c0c6f2bc-3209-461a-bcc3-edf740139ca2 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:19:35 user nova-compute[73572]: WARNING nova.compute.manager [req-13350e2a-49ed-4eea-9e1a-87ee6b2eb1e0 req-8f4f559e-6be2-4528-92ae-cd44031a99bd service nova] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] Received unexpected event network-vif-plugged-c0c6f2bc-3209-461a-bcc3-edf740139ca2 for instance with vm_state active and task_state deleting.
Aug 26 10:19:35 user nova-compute[73572]: DEBUG nova.compute.manager [req-13350e2a-49ed-4eea-9e1a-87ee6b2eb1e0 req-8f4f559e-6be2-4528-92ae-cd44031a99bd service nova] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] Received event network-vif-unplugged-2fe25c93-5639-47a6-80de-8cc83615e3c4 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:19:35 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-13350e2a-49ed-4eea-9e1a-87ee6b2eb1e0 req-8f4f559e-6be2-4528-92ae-cd44031a99bd service nova] Acquiring lock "41c1ef7a-4f98-4cbb-9948-acb96bd9d557-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:19:35 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-13350e2a-49ed-4eea-9e1a-87ee6b2eb1e0 req-8f4f559e-6be2-4528-92ae-cd44031a99bd service nova] Lock "41c1ef7a-4f98-4cbb-9948-acb96bd9d557-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:19:35 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-13350e2a-49ed-4eea-9e1a-87ee6b2eb1e0 req-8f4f559e-6be2-4528-92ae-cd44031a99bd service nova] Lock "41c1ef7a-4f98-4cbb-9948-acb96bd9d557-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:19:35 user nova-compute[73572]: DEBUG nova.compute.manager [req-13350e2a-49ed-4eea-9e1a-87ee6b2eb1e0 req-8f4f559e-6be2-4528-92ae-cd44031a99bd service nova] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] No waiting events found dispatching network-vif-unplugged-2fe25c93-5639-47a6-80de-8cc83615e3c4 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:19:35 user nova-compute[73572]: DEBUG nova.compute.manager [req-13350e2a-49ed-4eea-9e1a-87ee6b2eb1e0 req-8f4f559e-6be2-4528-92ae-cd44031a99bd service nova] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] Received event network-vif-unplugged-2fe25c93-5639-47a6-80de-8cc83615e3c4 for instance with task_state deleting. {{(pid=73572) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 10:19:35 user nova-compute[73572]: DEBUG nova.compute.manager [req-13350e2a-49ed-4eea-9e1a-87ee6b2eb1e0 req-8f4f559e-6be2-4528-92ae-cd44031a99bd service nova] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] Received event network-vif-plugged-2fe25c93-5639-47a6-80de-8cc83615e3c4 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:19:35 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-13350e2a-49ed-4eea-9e1a-87ee6b2eb1e0 req-8f4f559e-6be2-4528-92ae-cd44031a99bd service nova] Acquiring lock "41c1ef7a-4f98-4cbb-9948-acb96bd9d557-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:19:35 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-13350e2a-49ed-4eea-9e1a-87ee6b2eb1e0 req-8f4f559e-6be2-4528-92ae-cd44031a99bd service nova] Lock "41c1ef7a-4f98-4cbb-9948-acb96bd9d557-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:19:35 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-13350e2a-49ed-4eea-9e1a-87ee6b2eb1e0 req-8f4f559e-6be2-4528-92ae-cd44031a99bd service nova] Lock "41c1ef7a-4f98-4cbb-9948-acb96bd9d557-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:19:35 user nova-compute[73572]: DEBUG nova.compute.manager [req-13350e2a-49ed-4eea-9e1a-87ee6b2eb1e0 req-8f4f559e-6be2-4528-92ae-cd44031a99bd service nova] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] No waiting events found dispatching network-vif-plugged-2fe25c93-5639-47a6-80de-8cc83615e3c4 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:19:35 user nova-compute[73572]: WARNING nova.compute.manager [req-13350e2a-49ed-4eea-9e1a-87ee6b2eb1e0 req-8f4f559e-6be2-4528-92ae-cd44031a99bd service nova] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] Received unexpected event network-vif-plugged-2fe25c93-5639-47a6-80de-8cc83615e3c4 for instance with vm_state active and task_state deleting.
Aug 26 10:19:35 user nova-compute[73572]: DEBUG nova.compute.manager [req-13350e2a-49ed-4eea-9e1a-87ee6b2eb1e0 req-8f4f559e-6be2-4528-92ae-cd44031a99bd service nova] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] Received event network-vif-unplugged-8bc3e6f9-0fb7-4283-973c-cbb09e440e68 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:19:35 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-13350e2a-49ed-4eea-9e1a-87ee6b2eb1e0 req-8f4f559e-6be2-4528-92ae-cd44031a99bd service nova] Acquiring lock "41c1ef7a-4f98-4cbb-9948-acb96bd9d557-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:19:35 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-13350e2a-49ed-4eea-9e1a-87ee6b2eb1e0 req-8f4f559e-6be2-4528-92ae-cd44031a99bd service nova] Lock "41c1ef7a-4f98-4cbb-9948-acb96bd9d557-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:19:35 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-13350e2a-49ed-4eea-9e1a-87ee6b2eb1e0 req-8f4f559e-6be2-4528-92ae-cd44031a99bd service nova] Lock "41c1ef7a-4f98-4cbb-9948-acb96bd9d557-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:19:35 user nova-compute[73572]: DEBUG nova.compute.manager [req-13350e2a-49ed-4eea-9e1a-87ee6b2eb1e0 req-8f4f559e-6be2-4528-92ae-cd44031a99bd service nova] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] No waiting events found dispatching network-vif-unplugged-8bc3e6f9-0fb7-4283-973c-cbb09e440e68 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:19:35 user nova-compute[73572]: DEBUG nova.compute.manager [req-13350e2a-49ed-4eea-9e1a-87ee6b2eb1e0 req-8f4f559e-6be2-4528-92ae-cd44031a99bd service nova] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] Received event network-vif-unplugged-8bc3e6f9-0fb7-4283-973c-cbb09e440e68 for instance with task_state deleting. {{(pid=73572) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 10:19:35 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57b56972-76f9-44aa-905c-14d04f924f76 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.039s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:19:35 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d56c0ca-6667-417c-815b-89cabd53895d]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:19:35 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5b8c78d-5639-454a-a211-bd872ff85a61 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:19:35 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-a5b8c78d-5639-454a-a211-bd872ff85a61 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.389s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 10:19:35 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5b8c78d-5639-454a-a211-bd872ff85a61 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] <== disconnect_volume: return (391ms) None {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 10:19:35 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a5b8c78d-5639-454a-a211-bd872ff85a61 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] Disconnected iSCSI Volume {{(pid=73572) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 10:19:35 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a5b8c78d-5639-454a-a211-bd872ff85a61 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] calling os-brick to detach iSCSI Volume {{(pid=73572) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 10:19:35 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5b8c78d-5639-454a-a211-bd872ff85a61 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc89c3d6a10>, {'target_iqns': ['iqn.2010-10.org.openstack:eaa45a8a-93fc-4fac-bc41-ce4fa5173718'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tSyrqeso', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 10:19:35 user nova-compute[73572]: WARNING os_brick.initiator.connectors.base [None req-a5b8c78d-5639-454a-a211-bd872ff85a61 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 10:19:35 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-a5b8c78d-5639-454a-a211-bd872ff85a61 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 10:19:35 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-a5b8c78d-5639-454a-a211-bd872ff85a61 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 10:19:35 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5b8c78d-5639-454a-a211-bd872ff85a61 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eaa45a8a-93fc-4fac-bc41-ce4fa5173718', 0)] {{(pid=73572) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 10:19:35 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:19:35 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.028s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:19:35 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[9edc8333-0fbb-4dd4-84ba-670cf2f5cd35]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:302c3cfe-f0ec-4b1c-b1d9-dc12d4f4ce40\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eaa45a8a-93fc-4fac-bc41-ce4fa5173718\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:19:35 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:19:35 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:19:35 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb245806-425b-4f92-8eec-ba848e5bb475]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaa45a8a-93fc-4fac-bc41-ce4fa5173718 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:302c3cfe-f0ec-4b1c-b1d9-dc12d4f4ce40 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478 (non-flash)\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:19:35 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5b8c78d-5639-454a-a211-bd872ff85a61 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)
Aug 26 10:19:35 user nova-compute[73572]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaa45a8a-93fc-4fac-bc41-ce4fa5173718 (non-flash)
Aug 26 10:19:35 user nova-compute[73572]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:302c3cfe-f0ec-4b1c-b1d9-dc12d4f4ce40 (non-flash)
Aug 26 10:19:35 user nova-compute[73572]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478 (non-flash)
Aug 26 10:19:35 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 10:19:35 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5b8c78d-5639-454a-a211-bd872ff85a61 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)
Aug 26 10:19:35 user nova-compute[73572]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaa45a8a-93fc-4fac-bc41-ce4fa5173718 (non-flash)
Aug 26 10:19:35 user nova-compute[73572]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:302c3cfe-f0ec-4b1c-b1d9-dc12d4f4ce40 (non-flash)
Aug 26 10:19:35 user nova-compute[73572]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478 (non-flash)
Aug 26 10:19:35 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 10:19:35 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5b8c78d-5639-454a-a211-bd872ff85a61 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc89c3e08b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eaa45a8a-93fc-4fac-bc41-ce4fa5173718'): ({'sdg'}, set())}) {{(pid=73572) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 10:19:35 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-a5b8c78d-5639-454a-a211-bd872ff85a61 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] Removing single pathed devices sdg {{(pid=73572) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 10:19:35 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:19:35 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:19:35 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[248f38c3-ca96-4bd5-8973-138ca24a2d53]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:19:35 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:19:35 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.024s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:19:35 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e45d840-bc2f-4143-94d9-5ff432134105]: (4, ('ok\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:19:35 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-a5b8c78d-5639-454a-a211-bd872ff85a61 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] Flushing IO for device /dev/sdg {{(pid=73572) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 10:19:35 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:19:35 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.022s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:19:35 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[d61aafa2-792e-4004-9b53-eb878bab10ae]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:19:35 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-a5b8c78d-5639-454a-a211-bd872ff85a61 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=73572) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 10:19:35 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:19:35 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.048s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:19:35 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[536dcf44-a7af-48d4-a371-b958b218f80d]: (4, ('1', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:19:35 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-a5b8c78d-5639-454a-a211-bd872ff85a61 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=73572) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 10:19:35 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-a5b8c78d-5639-454a-a211-bd872ff85a61 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] SCSI volumes sdg have been removed. {{(pid=73572) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 10:19:35 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5b8c78d-5639-454a-a211-bd872ff85a61 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eaa45a8a-93fc-4fac-bc41-ce4fa5173718')] {{(pid=73572) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 10:19:35 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eaa45a8a-93fc-4fac-bc41-ce4fa5173718 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:19:35 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eaa45a8a-93fc-4fac-bc41-ce4fa5173718 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:19:35 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[0102f121-3ab4-4d37-bbea-cef1dd13f4c7]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:19:35 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5b8c78d-5639-454a-a211-bd872ff85a61 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:19:35 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eaa45a8a-93fc-4fac-bc41-ce4fa5173718 -p 172.16.0.220:3260 --logout {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:19:36 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eaa45a8a-93fc-4fac-bc41-ce4fa5173718 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:19:36 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[45774bd7-a50a-4db7-a1e0-5f85005435ab]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:eaa45a8a-93fc-4fac-bc41-ce4fa5173718, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:eaa45a8a-93fc-4fac-bc41-ce4fa5173718, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:19:36 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5b8c78d-5639-454a-a211-bd872ff85a61 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:eaa45a8a-93fc-4fac-bc41-ce4fa5173718, portal: 172.16.0.220,3260]
Aug 26 10:19:36 user nova-compute[73572]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:eaa45a8a-93fc-4fac-bc41-ce4fa5173718, portal: 172.16.0.220,3260] successful.
Aug 26 10:19:36 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:19:36 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eaa45a8a-93fc-4fac-bc41-ce4fa5173718 -p 172.16.0.220:3260 --op delete {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:19:36 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eaa45a8a-93fc-4fac-bc41-ce4fa5173718 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:19:36 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[800f2676-6f24-40ee-8fcf-a6bdb4630718]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:19:36 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5b8c78d-5639-454a-a211-bd872ff85a61 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:19:36 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-a5b8c78d-5639-454a-a211-bd872ff85a61 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.356s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 10:19:36 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5b8c78d-5639-454a-a211-bd872ff85a61 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] <== disconnect_volume: return (358ms) None {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 10:19:36 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a5b8c78d-5639-454a-a211-bd872ff85a61 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] Disconnected iSCSI Volume {{(pid=73572) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 10:19:36 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-a5b8c78d-5639-454a-a211-bd872ff85a61 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] Deleting instance files /opt/stack/data/nova/instances/41c1ef7a-4f98-4cbb-9948-acb96bd9d557_del
Aug 26 10:19:36 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-a5b8c78d-5639-454a-a211-bd872ff85a61 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] Deletion of /opt/stack/data/nova/instances/41c1ef7a-4f98-4cbb-9948-acb96bd9d557_del complete
Aug 26 10:19:36 user nova-compute[73572]: INFO nova.compute.manager [None req-a5b8c78d-5639-454a-a211-bd872ff85a61 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] Took 3.96 seconds to destroy the instance on the hypervisor.
Aug 26 10:19:36 user nova-compute[73572]: DEBUG oslo.service.loopingcall [None req-a5b8c78d-5639-454a-a211-bd872ff85a61 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73572) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 10:19:36 user nova-compute[73572]: DEBUG nova.compute.manager [-] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] Deallocating network for instance {{(pid=73572) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 10:19:36 user nova-compute[73572]: DEBUG nova.network.neutron [-] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] deallocate_for_instance() {{(pid=73572) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 10:19:37 user nova-compute[73572]: DEBUG nova.compute.manager [req-c7047eb5-7182-4cf9-b427-a1cdad466cb8 req-848084e3-5d91-4799-813c-92ef821681be service nova] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] Received event network-vif-plugged-f264d951-8920-4151-8276-33baa6a9def9 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:19:37 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-c7047eb5-7182-4cf9-b427-a1cdad466cb8 req-848084e3-5d91-4799-813c-92ef821681be service nova] Acquiring lock "41c1ef7a-4f98-4cbb-9948-acb96bd9d557-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:19:37 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-c7047eb5-7182-4cf9-b427-a1cdad466cb8 req-848084e3-5d91-4799-813c-92ef821681be service nova] Lock "41c1ef7a-4f98-4cbb-9948-acb96bd9d557-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:19:37 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-c7047eb5-7182-4cf9-b427-a1cdad466cb8 req-848084e3-5d91-4799-813c-92ef821681be service nova] Lock "41c1ef7a-4f98-4cbb-9948-acb96bd9d557-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:19:37 user nova-compute[73572]: DEBUG nova.compute.manager [req-c7047eb5-7182-4cf9-b427-a1cdad466cb8 req-848084e3-5d91-4799-813c-92ef821681be service nova] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] No waiting events found dispatching network-vif-plugged-f264d951-8920-4151-8276-33baa6a9def9 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:19:37 user nova-compute[73572]: WARNING nova.compute.manager [req-c7047eb5-7182-4cf9-b427-a1cdad466cb8 req-848084e3-5d91-4799-813c-92ef821681be service nova] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] Received unexpected event network-vif-plugged-f264d951-8920-4151-8276-33baa6a9def9 for instance with vm_state active and task_state deleting.
Aug 26 10:19:37 user nova-compute[73572]: DEBUG nova.compute.manager [req-b42d2b72-c2ad-4324-a835-3bffeb5f43fd req-644c7332-0d84-44fb-8929-ac0a7a35da84 service nova] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] Received event network-vif-plugged-8bc3e6f9-0fb7-4283-973c-cbb09e440e68 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:19:37 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-b42d2b72-c2ad-4324-a835-3bffeb5f43fd req-644c7332-0d84-44fb-8929-ac0a7a35da84 service nova] Acquiring lock "41c1ef7a-4f98-4cbb-9948-acb96bd9d557-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:19:37 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-b42d2b72-c2ad-4324-a835-3bffeb5f43fd req-644c7332-0d84-44fb-8929-ac0a7a35da84 service nova] Lock "41c1ef7a-4f98-4cbb-9948-acb96bd9d557-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:19:37 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-b42d2b72-c2ad-4324-a835-3bffeb5f43fd req-644c7332-0d84-44fb-8929-ac0a7a35da84 service nova] Lock "41c1ef7a-4f98-4cbb-9948-acb96bd9d557-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:19:37 user nova-compute[73572]: DEBUG nova.compute.manager [req-b42d2b72-c2ad-4324-a835-3bffeb5f43fd req-644c7332-0d84-44fb-8929-ac0a7a35da84 service nova] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] No waiting events found dispatching network-vif-plugged-8bc3e6f9-0fb7-4283-973c-cbb09e440e68 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:19:37 user nova-compute[73572]: WARNING nova.compute.manager [req-b42d2b72-c2ad-4324-a835-3bffeb5f43fd req-644c7332-0d84-44fb-8929-ac0a7a35da84 service nova] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] Received unexpected event network-vif-plugged-8bc3e6f9-0fb7-4283-973c-cbb09e440e68 for instance with vm_state active and task_state deleting.
Aug 26 10:19:39 user nova-compute[73572]: DEBUG nova.compute.manager [req-e921b015-eb4c-494b-b4c1-bb7ce0de618f req-91808b71-cab8-44ba-bd01-129d4cc9a964 service nova] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] Received event network-vif-deleted-c0c6f2bc-3209-461a-bcc3-edf740139ca2 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:19:39 user nova-compute[73572]: INFO nova.compute.manager [req-e921b015-eb4c-494b-b4c1-bb7ce0de618f req-91808b71-cab8-44ba-bd01-129d4cc9a964 service nova] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] Neutron deleted interface c0c6f2bc-3209-461a-bcc3-edf740139ca2; detaching it from the instance and deleting it from the info cache
Aug 26 10:19:39 user nova-compute[73572]: DEBUG nova.network.neutron [req-e921b015-eb4c-494b-b4c1-bb7ce0de618f req-91808b71-cab8-44ba-bd01-129d4cc9a964 service nova] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] Updating instance_info_cache with network_info: [{"id": "123d944e-47d4-4f95-94bc-73e1920ecbc1", "address": "fa:16:3e:95:40:4c", "network": {"id": "ce8484e9-f124-4a9c-9682-289ed99917e2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1080187713-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cf2ae4dd7d3474394090e3276c957ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap123d944e-47", "ovs_interfaceid": "123d944e-47d4-4f95-94bc-73e1920ecbc1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "696cd753-312c-437d-b140-c40b4158554e", "address": "fa:16:3e:13:c8:34", "network": {"id": "c0d598c4-68c6-4cfc-adf1-dc0360861788", "bridge": "br-int", "label": "tempest-device-tagging-net1-1696215747", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.77", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7cf2ae4dd7d3474394090e3276c957ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap696cd753-31", "ovs_interfaceid": "696cd753-312c-437d-b140-c40b4158554e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3e7d3f56-193b-43ba-9cc5-c5373755e06f", "address": "fa:16:3e:85:00:8b", "network": {"id": "c0d598c4-68c6-4cfc-adf1-dc0360861788", "bridge": "br-int", "label": "tempest-device-tagging-net1-1696215747", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.177", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7cf2ae4dd7d3474394090e3276c957ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e7d3f56-19", "ovs_interfaceid": "3e7d3f56-193b-43ba-9cc5-c5373755e06f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f264d951-8920-4151-8276-33baa6a9def9", "address": "fa:16:3e:a7:e2:2a", "network": {"id": "c0d598c4-68c6-4cfc-adf1-dc0360861788", "bridge": "br-int", "label": "tempest-device-tagging-net1-1696215747", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7cf2ae4dd7d3474394090e3276c957ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf264d951-89", "ovs_interfaceid": "f264d951-8920-4151-8276-33baa6a9def9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2fe25c93-5639-47a6-80de-8cc83615e3c4", "address": "fa:16:3e:59:09:63", "network": {"id": "f69a6193-9faf-4224-b21b-bc60491f9aea", "bridge": "br-int", "label": "tempest-device-tagging-net2-1404521418", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7cf2ae4dd7d3474394090e3276c957ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fe25c93-56", "ovs_interfaceid": "2fe25c93-5639-47a6-80de-8cc83615e3c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8bc3e6f9-0fb7-4283-973c-cbb09e440e68", "address": "fa:16:3e:3d:e7:4c", "network": {"id": "f69a6193-9faf-4224-b21b-bc60491f9aea", "bridge": "br-int", "label": "tempest-device-tagging-net2-1404521418", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7cf2ae4dd7d3474394090e3276c957ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bc3e6f9-0f", "ovs_interfaceid": "8bc3e6f9-0fb7-4283-973c-cbb09e440e68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:19:39 user nova-compute[73572]: DEBUG nova.compute.manager [req-e921b015-eb4c-494b-b4c1-bb7ce0de618f req-91808b71-cab8-44ba-bd01-129d4cc9a964 service nova] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] Detach interface failed, port_id=c0c6f2bc-3209-461a-bcc3-edf740139ca2, reason: Instance 41c1ef7a-4f98-4cbb-9948-acb96bd9d557 could not be found. {{(pid=73572) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 10:19:39 user nova-compute[73572]: DEBUG nova.compute.manager [req-e921b015-eb4c-494b-b4c1-bb7ce0de618f req-91808b71-cab8-44ba-bd01-129d4cc9a964 service nova] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] Received event network-vif-deleted-f264d951-8920-4151-8276-33baa6a9def9 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:19:39 user nova-compute[73572]: INFO nova.compute.manager [req-e921b015-eb4c-494b-b4c1-bb7ce0de618f req-91808b71-cab8-44ba-bd01-129d4cc9a964 service nova] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] Neutron deleted interface f264d951-8920-4151-8276-33baa6a9def9; detaching it from the instance and deleting it from the info cache
Aug 26 10:19:39 user nova-compute[73572]: DEBUG nova.network.neutron [req-e921b015-eb4c-494b-b4c1-bb7ce0de618f req-91808b71-cab8-44ba-bd01-129d4cc9a964 service nova] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] Updating instance_info_cache with network_info: [{"id": "123d944e-47d4-4f95-94bc-73e1920ecbc1", "address": "fa:16:3e:95:40:4c", "network": {"id": "ce8484e9-f124-4a9c-9682-289ed99917e2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1080187713-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cf2ae4dd7d3474394090e3276c957ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap123d944e-47", "ovs_interfaceid": "123d944e-47d4-4f95-94bc-73e1920ecbc1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "696cd753-312c-437d-b140-c40b4158554e", "address": "fa:16:3e:13:c8:34", "network": {"id": "c0d598c4-68c6-4cfc-adf1-dc0360861788", "bridge": "br-int", "label": "tempest-device-tagging-net1-1696215747", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.77", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7cf2ae4dd7d3474394090e3276c957ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap696cd753-31", "ovs_interfaceid": "696cd753-312c-437d-b140-c40b4158554e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3e7d3f56-193b-43ba-9cc5-c5373755e06f", "address": "fa:16:3e:85:00:8b", "network": {"id": "c0d598c4-68c6-4cfc-adf1-dc0360861788", "bridge": "br-int", "label": "tempest-device-tagging-net1-1696215747", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.177", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7cf2ae4dd7d3474394090e3276c957ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e7d3f56-19", "ovs_interfaceid": "3e7d3f56-193b-43ba-9cc5-c5373755e06f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2fe25c93-5639-47a6-80de-8cc83615e3c4", "address": "fa:16:3e:59:09:63", "network": {"id": "f69a6193-9faf-4224-b21b-bc60491f9aea", "bridge": "br-int", "label": "tempest-device-tagging-net2-1404521418", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7cf2ae4dd7d3474394090e3276c957ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fe25c93-56", "ovs_interfaceid": "2fe25c93-5639-47a6-80de-8cc83615e3c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8bc3e6f9-0fb7-4283-973c-cbb09e440e68", "address": "fa:16:3e:3d:e7:4c", "network": {"id": "f69a6193-9faf-4224-b21b-bc60491f9aea", "bridge": "br-int", "label": "tempest-device-tagging-net2-1404521418", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7cf2ae4dd7d3474394090e3276c957ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bc3e6f9-0f", "ovs_interfaceid": "8bc3e6f9-0fb7-4283-973c-cbb09e440e68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:19:39 user nova-compute[73572]: DEBUG nova.compute.manager [req-e921b015-eb4c-494b-b4c1-bb7ce0de618f req-91808b71-cab8-44ba-bd01-129d4cc9a964 service nova] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] Detach interface failed, port_id=f264d951-8920-4151-8276-33baa6a9def9, reason: Instance 41c1ef7a-4f98-4cbb-9948-acb96bd9d557 could not be found. {{(pid=73572) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 10:19:39 user nova-compute[73572]: DEBUG nova.compute.manager [req-e921b015-eb4c-494b-b4c1-bb7ce0de618f req-91808b71-cab8-44ba-bd01-129d4cc9a964 service nova] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] Received event network-vif-deleted-2fe25c93-5639-47a6-80de-8cc83615e3c4 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:19:39 user nova-compute[73572]: INFO nova.compute.manager [req-e921b015-eb4c-494b-b4c1-bb7ce0de618f req-91808b71-cab8-44ba-bd01-129d4cc9a964 service nova] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] Neutron deleted interface 2fe25c93-5639-47a6-80de-8cc83615e3c4; detaching it from the instance and deleting it from the info cache
Aug 26 10:19:39 user nova-compute[73572]: DEBUG nova.network.neutron [req-e921b015-eb4c-494b-b4c1-bb7ce0de618f req-91808b71-cab8-44ba-bd01-129d4cc9a964 service nova] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] Updating instance_info_cache with network_info: [{"id": "123d944e-47d4-4f95-94bc-73e1920ecbc1", "address": "fa:16:3e:95:40:4c", "network": {"id": "ce8484e9-f124-4a9c-9682-289ed99917e2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1080187713-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cf2ae4dd7d3474394090e3276c957ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap123d944e-47", "ovs_interfaceid": "123d944e-47d4-4f95-94bc-73e1920ecbc1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "696cd753-312c-437d-b140-c40b4158554e", "address": "fa:16:3e:13:c8:34", "network": {"id": "c0d598c4-68c6-4cfc-adf1-dc0360861788", "bridge": "br-int", "label": "tempest-device-tagging-net1-1696215747", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.77", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7cf2ae4dd7d3474394090e3276c957ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap696cd753-31", "ovs_interfaceid": "696cd753-312c-437d-b140-c40b4158554e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3e7d3f56-193b-43ba-9cc5-c5373755e06f", "address": "fa:16:3e:85:00:8b", "network": {"id": "c0d598c4-68c6-4cfc-adf1-dc0360861788", "bridge": "br-int", "label": "tempest-device-tagging-net1-1696215747", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.177", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7cf2ae4dd7d3474394090e3276c957ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e7d3f56-19", "ovs_interfaceid": "3e7d3f56-193b-43ba-9cc5-c5373755e06f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8bc3e6f9-0fb7-4283-973c-cbb09e440e68", "address": "fa:16:3e:3d:e7:4c", "network": {"id": "f69a6193-9faf-4224-b21b-bc60491f9aea", "bridge": "br-int", "label": "tempest-device-tagging-net2-1404521418", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7cf2ae4dd7d3474394090e3276c957ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bc3e6f9-0f", "ovs_interfaceid": "8bc3e6f9-0fb7-4283-973c-cbb09e440e68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:19:39 user nova-compute[73572]: DEBUG nova.compute.manager [req-e921b015-eb4c-494b-b4c1-bb7ce0de618f req-91808b71-cab8-44ba-bd01-129d4cc9a964 service nova] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] Detach interface failed, port_id=2fe25c93-5639-47a6-80de-8cc83615e3c4, reason: Instance 41c1ef7a-4f98-4cbb-9948-acb96bd9d557 could not be found. {{(pid=73572) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 10:19:39 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:19:39 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:19:39 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:19:40 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-608d0797-dbf2-4e29-8a25-b1302683dbc0 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] [instance: 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55] Calling os-brick to attach iSCSI Volume {{(pid=73572) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 10:19:40 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-608d0797-dbf2-4e29-8a25-b1302683dbc0 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc89c3d6a10>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:5f3a153b-1b99-4297-ad26-ea58f33330b8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qjvgYBLw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 10:19:40 user nova-compute[73572]: WARNING os_brick.initiator.connectors.base [None req-608d0797-dbf2-4e29-8a25-b1302683dbc0 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 10:19:40 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-608d0797-dbf2-4e29-8a25-b1302683dbc0 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 10:19:40 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-608d0797-dbf2-4e29-8a25-b1302683dbc0 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 10:19:40 user nova-compute[73572]: WARNING os_brick.initiator.connectors.base [None req-608d0797-dbf2-4e29-8a25-b1302683dbc0 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 10:19:40 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-608d0797-dbf2-4e29-8a25-b1302683dbc0 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5f3a153b-1b99-4297-ad26-ea58f33330b8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 10:19:40 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-608d0797-dbf2-4e29-8a25-b1302683dbc0 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5f3a153b-1b99-4297-ad26-ea58f33330b8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 10:19:40 user nova-compute[73572]: INFO os_brick.initiator.connectors.iscsi [None req-608d0797-dbf2-4e29-8a25-b1302683dbc0 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 10:19:40 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f3a153b-1b99-4297-ad26-ea58f33330b8 -p 172.16.0.220:3260 {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:19:40 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f3a153b-1b99-4297-ad26-ea58f33330b8 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:19:40 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf1a98b5-f07d-4bf7-b4d3-f8e560a5b5e8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:19:40 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-608d0797-dbf2-4e29-8a25-b1302683dbc0 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 10:19:40 user nova-compute[73572]:  {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:19:40 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f3a153b-1b99-4297-ad26-ea58f33330b8 -p 172.16.0.220:3260 --interface default --op new {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:19:40 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f3a153b-1b99-4297-ad26-ea58f33330b8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:19:40 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[744cc4e0-b39b-4ccb-9b98-1c17902cdce7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5f3a153b-1b99-4297-ad26-ea58f33330b8] added\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:19:40 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-608d0797-dbf2-4e29-8a25-b1302683dbc0 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5f3a153b-1b99-4297-ad26-ea58f33330b8] added
Aug 26 10:19:40 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:19:40 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f3a153b-1b99-4297-ad26-ea58f33330b8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:19:40 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f3a153b-1b99-4297-ad26-ea58f33330b8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:19:40 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccb123c7-1aaa-412b-a98b-5bf48bcd0cf5]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:19:40 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-608d0797-dbf2-4e29-8a25-b1302683dbc0 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:19:40 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f3a153b-1b99-4297-ad26-ea58f33330b8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:19:40 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f3a153b-1b99-4297-ad26-ea58f33330b8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:19:40 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[01a45af4-413b-43e1-ae42-420140ac5762]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:19:40 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-608d0797-dbf2-4e29-8a25-b1302683dbc0 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:19:40 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f3a153b-1b99-4297-ad26-ea58f33330b8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qjvgYBLw {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:19:40 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f3a153b-1b99-4297-ad26-ea58f33330b8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qjvgYBLw" returned: 0 in 0.022s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:19:40 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[91ffbf45-fbaf-47b5-8d9b-7fd92600aa81]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:19:40 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-608d0797-dbf2-4e29-8a25-b1302683dbc0 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qjvgYBLw'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:19:40 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f3a153b-1b99-4297-ad26-ea58f33330b8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:19:40 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f3a153b-1b99-4297-ad26-ea58f33330b8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:19:40 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[c43dc29b-becb-4ed3-a675-8ad07be055a1]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:19:40 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-608d0797-dbf2-4e29-8a25-b1302683dbc0 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:19:40 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:19:41 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:19:41 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[67d4620c-89dc-47a0-a6d8-0c19055b1174]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:302c3cfe-f0ec-4b1c-b1d9-dc12d4f4ce40 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478 (non-flash)\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:19:41 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-608d0797-dbf2-4e29-8a25-b1302683dbc0 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)
Aug 26 10:19:41 user nova-compute[73572]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:302c3cfe-f0ec-4b1c-b1d9-dc12d4f4ce40 (non-flash)
Aug 26 10:19:41 user nova-compute[73572]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478 (non-flash)
Aug 26 10:19:41 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 10:19:41 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-608d0797-dbf2-4e29-8a25-b1302683dbc0 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)
Aug 26 10:19:41 user nova-compute[73572]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:302c3cfe-f0ec-4b1c-b1d9-dc12d4f4ce40 (non-flash)
Aug 26 10:19:41 user nova-compute[73572]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478 (non-flash)
Aug 26 10:19:41 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 10:19:41 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f3a153b-1b99-4297-ad26-ea58f33330b8 -p 172.16.0.220:3260 --login {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:19:41 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f3a153b-1b99-4297-ad26-ea58f33330b8 -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:19:41 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[62fa8d04-052e-432b-9b8c-050f1da87350]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5f3a153b-1b99-4297-ad26-ea58f33330b8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5f3a153b-1b99-4297-ad26-ea58f33330b8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:19:41 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-608d0797-dbf2-4e29-8a25-b1302683dbc0 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5f3a153b-1b99-4297-ad26-ea58f33330b8, portal: 172.16.0.220,3260]
Aug 26 10:19:41 user nova-compute[73572]: Login to [iface: default, target: iqn.2010-10.org.openstack:5f3a153b-1b99-4297-ad26-ea58f33330b8, portal: 172.16.0.220,3260] successful.
Aug 26 10:19:41 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:19:41 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f3a153b-1b99-4297-ad26-ea58f33330b8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:19:41 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f3a153b-1b99-4297-ad26-ea58f33330b8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:19:41 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[d444cca4-3395-4ca0-b230-5dadeadd72a7]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:19:41 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-608d0797-dbf2-4e29-8a25-b1302683dbc0 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:19:41 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:19:41 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:19:41 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc19fa5e-e4e2-495e-b93a-c0285621d43b]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:302c3cfe-f0ec-4b1c-b1d9-dc12d4f4ce40 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f3a153b-1b99-4297-ad26-ea58f33330b8 (non-flash)\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:19:41 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-608d0797-dbf2-4e29-8a25-b1302683dbc0 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)
Aug 26 10:19:41 user nova-compute[73572]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:302c3cfe-f0ec-4b1c-b1d9-dc12d4f4ce40 (non-flash)
Aug 26 10:19:41 user nova-compute[73572]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478 (non-flash)
Aug 26 10:19:41 user nova-compute[73572]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f3a153b-1b99-4297-ad26-ea58f33330b8 (non-flash)
Aug 26 10:19:41 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 10:19:41 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-608d0797-dbf2-4e29-8a25-b1302683dbc0 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)
Aug 26 10:19:41 user nova-compute[73572]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:302c3cfe-f0ec-4b1c-b1d9-dc12d4f4ce40 (non-flash)
Aug 26 10:19:41 user nova-compute[73572]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478 (non-flash)
Aug 26 10:19:41 user nova-compute[73572]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f3a153b-1b99-4297-ad26-ea58f33330b8 (non-flash)
Aug 26 10:19:41 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 10:19:41 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-608d0797-dbf2-4e29-8a25-b1302683dbc0 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5f3a153b-1b99-4297-ad26-ea58f33330b8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.337s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 10:19:41 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-608d0797-dbf2-4e29-8a25-b1302683dbc0 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Connected to 172.16.0.220:3260 {{(pid=73572) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 10:19:41 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-608d0797-dbf2-4e29-8a25-b1302683dbc0 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] HCTL ('34', '-', '-', 0) found on session 25 with lun 0 {{(pid=73572) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 10:19:41 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-608d0797-dbf2-4e29-8a25-b1302683dbc0 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73572) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 10:19:41 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:19:41 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:19:41 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[1572cce4-037a-4a1a-95b2-c655b73c5040]: (4, ('- - 0', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:19:41 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-608d0797-dbf2-4e29-8a25-b1302683dbc0 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Searching for a device in session 25 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73572) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 10:19:41 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-608d0797-dbf2-4e29-8a25-b1302683dbc0 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qjvgYBLw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73572) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 10:19:41 user nova-compute[73572]: DEBUG nova.compute.manager [req-c8a9292c-e7fb-438c-9191-b262f590025b req-40c6b33e-efe0-4e80-8cd5-bfb27791d5d5 service nova] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] Received event network-vif-deleted-8bc3e6f9-0fb7-4283-973c-cbb09e440e68 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:19:41 user nova-compute[73572]: INFO nova.compute.manager [req-c8a9292c-e7fb-438c-9191-b262f590025b req-40c6b33e-efe0-4e80-8cd5-bfb27791d5d5 service nova] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] Neutron deleted interface 8bc3e6f9-0fb7-4283-973c-cbb09e440e68; detaching it from the instance and deleting it from the info cache
Aug 26 10:19:41 user nova-compute[73572]: DEBUG nova.network.neutron [req-c8a9292c-e7fb-438c-9191-b262f590025b req-40c6b33e-efe0-4e80-8cd5-bfb27791d5d5 service nova] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] Updating instance_info_cache with network_info: [{"id": "123d944e-47d4-4f95-94bc-73e1920ecbc1", "address": "fa:16:3e:95:40:4c", "network": {"id": "ce8484e9-f124-4a9c-9682-289ed99917e2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1080187713-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cf2ae4dd7d3474394090e3276c957ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap123d944e-47", "ovs_interfaceid": "123d944e-47d4-4f95-94bc-73e1920ecbc1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "696cd753-312c-437d-b140-c40b4158554e", "address": "fa:16:3e:13:c8:34", "network": {"id": "c0d598c4-68c6-4cfc-adf1-dc0360861788", "bridge": "br-int", "label": "tempest-device-tagging-net1-1696215747", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.77", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7cf2ae4dd7d3474394090e3276c957ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap696cd753-31", "ovs_interfaceid": "696cd753-312c-437d-b140-c40b4158554e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3e7d3f56-193b-43ba-9cc5-c5373755e06f", "address": "fa:16:3e:85:00:8b", "network": {"id": "c0d598c4-68c6-4cfc-adf1-dc0360861788", "bridge": "br-int", "label": "tempest-device-tagging-net1-1696215747", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.177", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7cf2ae4dd7d3474394090e3276c957ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e7d3f56-19", "ovs_interfaceid": "3e7d3f56-193b-43ba-9cc5-c5373755e06f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:19:41 user nova-compute[73572]: DEBUG nova.compute.manager [req-c8a9292c-e7fb-438c-9191-b262f590025b req-40c6b33e-efe0-4e80-8cd5-bfb27791d5d5 service nova] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] Detach interface failed, port_id=8bc3e6f9-0fb7-4283-973c-cbb09e440e68, reason: Instance 41c1ef7a-4f98-4cbb-9948-acb96bd9d557 could not be found. {{(pid=73572) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 10:19:41 user nova-compute[73572]: DEBUG nova.network.neutron [-] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] Updating instance_info_cache with network_info: [] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:19:41 user nova-compute[73572]: INFO nova.compute.manager [-] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] Took 5.64 seconds to deallocate network for instance.
Aug 26 10:19:42 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:19:42 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-608d0797-dbf2-4e29-8a25-b1302683dbc0 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.376s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 10:19:42 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-608d0797-dbf2-4e29-8a25-b1302683dbc0 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] <== connect_volume: return (1377ms) {'type': 'block', 'scsi_wwn': '23835633333663462', 'path': '/dev/sdc'} {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 10:19:42 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-608d0797-dbf2-4e29-8a25-b1302683dbc0 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] [instance: 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23835633333663462', 'path': '/dev/sdc'} {{(pid=73572) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 10:19:42 user nova-compute[73572]: DEBUG nova.objects.instance [None req-608d0797-dbf2-4e29-8a25-b1302683dbc0 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Lazy-loading 'flavor' on Instance uuid 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55 {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:19:42 user nova-compute[73572]: DEBUG nova.virt.libvirt.guest [None req-608d0797-dbf2-4e29-8a25-b1302683dbc0 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 10:19:42 user nova-compute[73572]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 10:19:42 user nova-compute[73572]:   <source dev="/dev/sdc"/>
Aug 26 10:19:42 user nova-compute[73572]:   <target dev="vdb" bus="virtio"/>
Aug 26 10:19:42 user nova-compute[73572]:   <serial>5f3a153b-1b99-4297-ad26-ea58f33330b8</serial>
Aug 26 10:19:42 user nova-compute[73572]: </disk>
Aug 26 10:19:42 user nova-compute[73572]:  {{(pid=73572) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 10:19:42 user nova-compute[73572]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693045167.6325681, 339517ef-c023-4f13-a8cc-d84f7176dfcd => Stopped> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:19:42 user nova-compute[73572]: INFO nova.compute.manager [-] [instance: 339517ef-c023-4f13-a8cc-d84f7176dfcd] VM Stopped (Lifecycle Event)
Aug 26 10:19:42 user nova-compute[73572]: DEBUG nova.compute.manager [None req-45ca0ed8-bb94-419e-b0eb-0bf39fd4f748 None None] [instance: 339517ef-c023-4f13-a8cc-d84f7176dfcd] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:19:42 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-608d0797-dbf2-4e29-8a25-b1302683dbc0 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] No BDM found with device name vda, not building metadata. {{(pid=73572) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 10:19:42 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-608d0797-dbf2-4e29-8a25-b1302683dbc0 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73572) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 10:19:42 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-608d0797-dbf2-4e29-8a25-b1302683dbc0 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] No VIF found with MAC fa:16:3e:49:23:6a, not building metadata {{(pid=73572) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 10:19:42 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-608d0797-dbf2-4e29-8a25-b1302683dbc0 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Lock "0fe47a17-4ffb-48ce-b0f6-a9b43002bd55" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 18.597s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:19:43 user nova-compute[73572]: DEBUG nova.compute.manager [req-7fa0a770-efa0-4a5d-8ae0-f9071027bf68 req-a6951b11-93bb-4748-80da-9f04003923f2 service nova] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] Received event network-vif-deleted-123d944e-47d4-4f95-94bc-73e1920ecbc1 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:19:44 user nova-compute[73572]: INFO nova.compute.manager [None req-a5b8c78d-5639-454a-a211-bd872ff85a61 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] Took 2.75 seconds to detach 3 volumes for instance.
Aug 26 10:19:44 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-a5b8c78d-5639-454a-a211-bd872ff85a61 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:19:44 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-a5b8c78d-5639-454a-a211-bd872ff85a61 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:19:44 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:19:44 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:19:45 user nova-compute[73572]: DEBUG nova.compute.provider_tree [None req-a5b8c78d-5639-454a-a211-bd872ff85a61 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] Inventory has not changed in ProviderTree for provider: e2cec974-59b2-4c77-a53d-a7f4e5a30d75 {{(pid=73572) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 10:19:45 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-a5b8c78d-5639-454a-a211-bd872ff85a61 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] Inventory has not changed for provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73572) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 10:19:45 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-a5b8c78d-5639-454a-a211-bd872ff85a61 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.439s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:19:45 user nova-compute[73572]: DEBUG nova.compute.manager [None req-2873906f-13e4-4858-b75c-73cf8f5f8ec9 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] [instance: 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55] Stashing vm_state: active {{(pid=73572) _prep_resize /opt/stack/nova/nova/compute/manager.py:5535}}
Aug 26 10:19:45 user nova-compute[73572]: INFO nova.scheduler.client.report [None req-a5b8c78d-5639-454a-a211-bd872ff85a61 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] Deleted allocations for instance 41c1ef7a-4f98-4cbb-9948-acb96bd9d557
Aug 26 10:19:45 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-a5b8c78d-5639-454a-a211-bd872ff85a61 tempest-TaggedBootDevicesTest_v242-2076699378 tempest-TaggedBootDevicesTest_v242-2076699378-project-member] Lock "41c1ef7a-4f98-4cbb-9948-acb96bd9d557" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 13.071s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:19:45 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-2873906f-13e4-4858-b75c-73cf8f5f8ec9 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:19:45 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-2873906f-13e4-4858-b75c-73cf8f5f8ec9 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:19:45 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-2873906f-13e4-4858-b75c-73cf8f5f8ec9 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73572) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 10:19:45 user nova-compute[73572]: INFO nova.compute.claims [None req-2873906f-13e4-4858-b75c-73cf8f5f8ec9 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] [instance: 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55] Claim successful on node user
Aug 26 10:19:45 user nova-compute[73572]: INFO nova.compute.resource_tracker [None req-2873906f-13e4-4858-b75c-73cf8f5f8ec9 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] [instance: 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55] Updating resource usage from migration 1eeef6fc-489c-436a-9c1c-404ef89802a6
Aug 26 10:19:45 user nova-compute[73572]: DEBUG nova.compute.provider_tree [None req-2873906f-13e4-4858-b75c-73cf8f5f8ec9 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Inventory has not changed in ProviderTree for provider: e2cec974-59b2-4c77-a53d-a7f4e5a30d75 {{(pid=73572) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 10:19:45 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-2873906f-13e4-4858-b75c-73cf8f5f8ec9 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Inventory has not changed for provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73572) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 10:19:45 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-2873906f-13e4-4858-b75c-73cf8f5f8ec9 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.566s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:19:45 user nova-compute[73572]: INFO nova.compute.manager [None req-2873906f-13e4-4858-b75c-73cf8f5f8ec9 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] [instance: 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55] Migrating
Aug 26 10:19:45 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-2873906f-13e4-4858-b75c-73cf8f5f8ec9 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:19:45 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-2873906f-13e4-4858-b75c-73cf8f5f8ec9 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Acquired lock "compute-rpcapi-router" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:19:45 user nova-compute[73572]: INFO nova.compute.rpcapi [None req-2873906f-13e4-4858-b75c-73cf8f5f8ec9 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Aug 26 10:19:45 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-2873906f-13e4-4858-b75c-73cf8f5f8ec9 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Releasing lock "compute-rpcapi-router" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:19:45 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-2873906f-13e4-4858-b75c-73cf8f5f8ec9 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Acquiring lock "refresh_cache-0fe47a17-4ffb-48ce-b0f6-a9b43002bd55" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:19:45 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-2873906f-13e4-4858-b75c-73cf8f5f8ec9 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Acquired lock "refresh_cache-0fe47a17-4ffb-48ce-b0f6-a9b43002bd55" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:19:45 user nova-compute[73572]: DEBUG nova.network.neutron [None req-2873906f-13e4-4858-b75c-73cf8f5f8ec9 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] [instance: 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55] Building network info cache for instance {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 10:19:47 user nova-compute[73572]: DEBUG nova.network.neutron [None req-2873906f-13e4-4858-b75c-73cf8f5f8ec9 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] [instance: 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55] Updating instance_info_cache with network_info: [{"id": "ebf9f385-e59b-4060-9bf9-a8d2006327b4", "address": "fa:16:3e:49:23:6a", "network": {"id": "7c89c22a-96d4-4e60-9c4c-b5a82a7eca55", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1976182948-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d2c922711fb445aa99ae4f30b802c12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebf9f385-e5", "ovs_interfaceid": "ebf9f385-e59b-4060-9bf9-a8d2006327b4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:19:47 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-2873906f-13e4-4858-b75c-73cf8f5f8ec9 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Releasing lock "refresh_cache-0fe47a17-4ffb-48ce-b0f6-a9b43002bd55" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:19:47 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-2873906f-13e4-4858-b75c-73cf8f5f8ec9 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] [instance: 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55] Starting migrate_disk_and_power_off {{(pid=73572) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Aug 26 10:19:47 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:19:47 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:19:47 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:19:47 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:19:47 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:19:48 user nova-compute[73572]: DEBUG nova.compute.manager [req-2d08eecd-c7f0-4c78-86db-a5014d3c35c8 req-df19fde2-820b-46d7-b936-5674e3b38c41 service nova] [instance: 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55] Received event network-vif-unplugged-ebf9f385-e59b-4060-9bf9-a8d2006327b4 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:19:48 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-2d08eecd-c7f0-4c78-86db-a5014d3c35c8 req-df19fde2-820b-46d7-b936-5674e3b38c41 service nova] Acquiring lock "0fe47a17-4ffb-48ce-b0f6-a9b43002bd55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:19:48 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-2d08eecd-c7f0-4c78-86db-a5014d3c35c8 req-df19fde2-820b-46d7-b936-5674e3b38c41 service nova] Lock "0fe47a17-4ffb-48ce-b0f6-a9b43002bd55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:19:48 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-2d08eecd-c7f0-4c78-86db-a5014d3c35c8 req-df19fde2-820b-46d7-b936-5674e3b38c41 service nova] Lock "0fe47a17-4ffb-48ce-b0f6-a9b43002bd55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:19:48 user nova-compute[73572]: DEBUG nova.compute.manager [req-2d08eecd-c7f0-4c78-86db-a5014d3c35c8 req-df19fde2-820b-46d7-b936-5674e3b38c41 service nova] [instance: 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55] No waiting events found dispatching network-vif-unplugged-ebf9f385-e59b-4060-9bf9-a8d2006327b4 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:19:48 user nova-compute[73572]: WARNING nova.compute.manager [req-2d08eecd-c7f0-4c78-86db-a5014d3c35c8 req-df19fde2-820b-46d7-b936-5674e3b38c41 service nova] [instance: 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55] Received unexpected event network-vif-unplugged-ebf9f385-e59b-4060-9bf9-a8d2006327b4 for instance with vm_state active and task_state resize_migrating.
Aug 26 10:19:48 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:19:48 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:19:48 user nova-compute[73572]: INFO nova.virt.libvirt.driver [-] [instance: 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55] Instance destroyed successfully.
Aug 26 10:19:48 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-2873906f-13e4-4858-b75c-73cf8f5f8ec9 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T10:15:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-220365578',display_name='tempest-ServerActionsTestOtherB-server-220365578',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-220365578',id=17,image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNpUMyiGXRzsPFYrzC1k+DPeAQeFXKXREu1ci6G2S65T1Gci+/hLSOFjcdBoLqgENyI+7/uwXL8y2F/F10thQC08ST7hXeII35W/K66MHhxc0L254FUOJIzPARZXOsUESA==',key_name='tempest-keypair-2095276623',keypairs=<?>,launch_index=0,launched_at=2023-08-26T10:15:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='0d2c922711fb445aa99ae4f30b802c12',ramdisk_id='',reservation_id='r-ktz04i2y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1806914349',owner_user_name='tempest-ServerActionsTestOtherB-1806914349-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T10:19:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0ee7e4a9f7db476eb9f16440c6b8e37e',uuid=0fe47a17-4ffb-48ce-b0f6-a9b43002bd55,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ebf9f385-e59b-4060-9bf9-a8d2006327b4", "address": "fa:16:3e:49:23:6a", "network": {"id": "7c89c22a-96d4-4e60-9c4c-b5a82a7eca55", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1976182948-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1976182948-network", "vif_mac": "fa:16:3e:49:23:6a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d2c922711fb445aa99ae4f30b802c12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebf9f385-e5", "ovs_interfaceid": "ebf9f385-e59b-4060-9bf9-a8d2006327b4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 10:19:48 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-2873906f-13e4-4858-b75c-73cf8f5f8ec9 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Converting VIF {"id": "ebf9f385-e59b-4060-9bf9-a8d2006327b4", "address": "fa:16:3e:49:23:6a", "network": {"id": "7c89c22a-96d4-4e60-9c4c-b5a82a7eca55", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1976182948-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1976182948-network", "vif_mac": "fa:16:3e:49:23:6a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d2c922711fb445aa99ae4f30b802c12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebf9f385-e5", "ovs_interfaceid": "ebf9f385-e59b-4060-9bf9-a8d2006327b4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:19:48 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-2873906f-13e4-4858-b75c-73cf8f5f8ec9 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:49:23:6a,bridge_name='br-int',has_traffic_filtering=True,id=ebf9f385-e59b-4060-9bf9-a8d2006327b4,network=Network(7c89c22a-96d4-4e60-9c4c-b5a82a7eca55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebf9f385-e5') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:19:48 user nova-compute[73572]: DEBUG os_vif [None req-2873906f-13e4-4858-b75c-73cf8f5f8ec9 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:49:23:6a,bridge_name='br-int',has_traffic_filtering=True,id=ebf9f385-e59b-4060-9bf9-a8d2006327b4,network=Network(7c89c22a-96d4-4e60-9c4c-b5a82a7eca55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebf9f385-e5') {{(pid=73572) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 10:19:48 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:19:48 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapebf9f385-e5, bridge=br-int, if_exists=True) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:19:48 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:19:48 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:19:48 user nova-compute[73572]: INFO os_vif [None req-2873906f-13e4-4858-b75c-73cf8f5f8ec9 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:49:23:6a,bridge_name='br-int',has_traffic_filtering=True,id=ebf9f385-e59b-4060-9bf9-a8d2006327b4,network=Network(7c89c22a-96d4-4e60-9c4c-b5a82a7eca55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebf9f385-e5')
Aug 26 10:19:48 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2873906f-13e4-4858-b75c-73cf8f5f8ec9 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] [instance: 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55] calling os-brick to detach iSCSI Volume {{(pid=73572) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 10:19:48 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-2873906f-13e4-4858-b75c-73cf8f5f8ec9 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc89c3d6a10>, {'target_iqns': ['iqn.2010-10.org.openstack:5f3a153b-1b99-4297-ad26-ea58f33330b8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qjvgYBLw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 10:19:48 user nova-compute[73572]: WARNING os_brick.initiator.connectors.base [None req-2873906f-13e4-4858-b75c-73cf8f5f8ec9 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 10:19:48 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-2873906f-13e4-4858-b75c-73cf8f5f8ec9 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 10:19:48 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-2873906f-13e4-4858-b75c-73cf8f5f8ec9 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 10:19:48 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-2873906f-13e4-4858-b75c-73cf8f5f8ec9 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5f3a153b-1b99-4297-ad26-ea58f33330b8', 0)] {{(pid=73572) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 10:19:48 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:19:48 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:19:48 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[133a2f1d-d4ee-4d78-9c85-8d1e987459ed]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:302c3cfe-f0ec-4b1c-b1d9-dc12d4f4ce40\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5f3a153b-1b99-4297-ad26-ea58f33330b8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d94556c8-9096-4e9a-9cfc-f9d17846ed06\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:19:48 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:19:48 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:19:48 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dc9fcda-8139-4a30-85ae-15758ff11197]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:302c3cfe-f0ec-4b1c-b1d9-dc12d4f4ce40 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f3a153b-1b99-4297-ad26-ea58f33330b8 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d94556c8-9096-4e9a-9cfc-f9d17846ed06 (non-flash)\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:19:48 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-2873906f-13e4-4858-b75c-73cf8f5f8ec9 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)
Aug 26 10:19:48 user nova-compute[73572]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:302c3cfe-f0ec-4b1c-b1d9-dc12d4f4ce40 (non-flash)
Aug 26 10:19:48 user nova-compute[73572]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478 (non-flash)
Aug 26 10:19:48 user nova-compute[73572]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f3a153b-1b99-4297-ad26-ea58f33330b8 (non-flash)
Aug 26 10:19:48 user nova-compute[73572]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d94556c8-9096-4e9a-9cfc-f9d17846ed06 (non-flash)
Aug 26 10:19:48 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 10:19:48 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-2873906f-13e4-4858-b75c-73cf8f5f8ec9 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)
Aug 26 10:19:48 user nova-compute[73572]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:302c3cfe-f0ec-4b1c-b1d9-dc12d4f4ce40 (non-flash)
Aug 26 10:19:48 user nova-compute[73572]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478 (non-flash)
Aug 26 10:19:48 user nova-compute[73572]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f3a153b-1b99-4297-ad26-ea58f33330b8 (non-flash)
Aug 26 10:19:48 user nova-compute[73572]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d94556c8-9096-4e9a-9cfc-f9d17846ed06 (non-flash)
Aug 26 10:19:48 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 10:19:48 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-2873906f-13e4-4858-b75c-73cf8f5f8ec9 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc89c48d870>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5f3a153b-1b99-4297-ad26-ea58f33330b8'): ({'sdc'}, set())}) {{(pid=73572) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 10:19:48 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-2873906f-13e4-4858-b75c-73cf8f5f8ec9 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Removing single pathed devices sdc {{(pid=73572) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 10:19:48 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:19:48 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:19:48 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c7046b0-7728-4a3f-96a1-84a26f3dfb2b]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:19:48 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:19:48 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.027s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:19:48 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[27350af7-882e-47ce-939c-5c3a1e1330f0]: (4, ('ok\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:19:48 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-2873906f-13e4-4858-b75c-73cf8f5f8ec9 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Flushing IO for device /dev/sdc {{(pid=73572) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 10:19:48 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:19:48 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.035s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:19:48 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[059c49da-8be3-4d08-82fe-26a97244c7e0]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:19:48 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-2873906f-13e4-4858-b75c-73cf8f5f8ec9 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73572) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 10:19:48 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:19:48 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.063s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:19:48 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f95f94e-2a2a-4b76-8e4d-8544070578c1]: (4, ('1', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:19:48 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-2873906f-13e4-4858-b75c-73cf8f5f8ec9 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73572) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 10:19:48 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-2873906f-13e4-4858-b75c-73cf8f5f8ec9 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] SCSI volumes sdc have been removed. {{(pid=73572) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 10:19:48 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-2873906f-13e4-4858-b75c-73cf8f5f8ec9 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5f3a153b-1b99-4297-ad26-ea58f33330b8')] {{(pid=73572) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 10:19:48 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f3a153b-1b99-4297-ad26-ea58f33330b8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:19:48 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f3a153b-1b99-4297-ad26-ea58f33330b8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:19:48 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[63acd1cc-0f8b-4c95-bb28-c67643a18e98]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:19:48 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-2873906f-13e4-4858-b75c-73cf8f5f8ec9 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:19:48 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f3a153b-1b99-4297-ad26-ea58f33330b8 -p 172.16.0.220:3260 --logout {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:19:48 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f3a153b-1b99-4297-ad26-ea58f33330b8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.078s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:19:48 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[11ebfe94-e548-40ca-8465-3a4e3e3708c8]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:5f3a153b-1b99-4297-ad26-ea58f33330b8, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:5f3a153b-1b99-4297-ad26-ea58f33330b8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:19:48 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-2873906f-13e4-4858-b75c-73cf8f5f8ec9 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:5f3a153b-1b99-4297-ad26-ea58f33330b8, portal: 172.16.0.220,3260]
Aug 26 10:19:48 user nova-compute[73572]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:5f3a153b-1b99-4297-ad26-ea58f33330b8, portal: 172.16.0.220,3260] successful.
Aug 26 10:19:48 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:19:48 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f3a153b-1b99-4297-ad26-ea58f33330b8 -p 172.16.0.220:3260 --op delete {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:19:48 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f3a153b-1b99-4297-ad26-ea58f33330b8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:19:48 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[f32c1a38-4a89-4c57-b23e-f9a60f033da3]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:19:48 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-2873906f-13e4-4858-b75c-73cf8f5f8ec9 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:19:48 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-2873906f-13e4-4858-b75c-73cf8f5f8ec9 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.390s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 10:19:48 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-2873906f-13e4-4858-b75c-73cf8f5f8ec9 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] <== disconnect_volume: return (392ms) None {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 10:19:48 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2873906f-13e4-4858-b75c-73cf8f5f8ec9 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] [instance: 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55] Disconnected iSCSI Volume {{(pid=73572) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 10:19:48 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-2873906f-13e4-4858-b75c-73cf8f5f8ec9 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fe47a17-4ffb-48ce-b0f6-a9b43002bd55/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:19:49 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-2873906f-13e4-4858-b75c-73cf8f5f8ec9 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fe47a17-4ffb-48ce-b0f6-a9b43002bd55/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:19:49 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-2873906f-13e4-4858-b75c-73cf8f5f8ec9 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fe47a17-4ffb-48ce-b0f6-a9b43002bd55/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:19:49 user nova-compute[73572]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693045174.2192714, 41c1ef7a-4f98-4cbb-9948-acb96bd9d557 => Stopped> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:19:49 user nova-compute[73572]: INFO nova.compute.manager [-] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] VM Stopped (Lifecycle Event)
Aug 26 10:19:49 user nova-compute[73572]: DEBUG nova.compute.manager [None req-8775420e-9d79-4820-9022-8be52f0aaefe None None] [instance: 41c1ef7a-4f98-4cbb-9948-acb96bd9d557] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:19:49 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-2873906f-13e4-4858-b75c-73cf8f5f8ec9 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fe47a17-4ffb-48ce-b0f6-a9b43002bd55/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:19:49 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-2873906f-13e4-4858-b75c-73cf8f5f8ec9 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73572) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 10:19:49 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-2873906f-13e4-4858-b75c-73cf8f5f8ec9 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/0fe47a17-4ffb-48ce-b0f6-a9b43002bd55_resize/disk /opt/stack/data/nova/instances/0fe47a17-4ffb-48ce-b0f6-a9b43002bd55/disk {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:19:49 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-2873906f-13e4-4858-b75c-73cf8f5f8ec9 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] CMD "cp -r /opt/stack/data/nova/instances/0fe47a17-4ffb-48ce-b0f6-a9b43002bd55_resize/disk /opt/stack/data/nova/instances/0fe47a17-4ffb-48ce-b0f6-a9b43002bd55/disk" returned: 0 in 0.319s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:19:49 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-2873906f-13e4-4858-b75c-73cf8f5f8ec9 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/0fe47a17-4ffb-48ce-b0f6-a9b43002bd55_resize/disk.info /opt/stack/data/nova/instances/0fe47a17-4ffb-48ce-b0f6-a9b43002bd55/disk.info {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:19:49 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-2873906f-13e4-4858-b75c-73cf8f5f8ec9 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] CMD "cp -r /opt/stack/data/nova/instances/0fe47a17-4ffb-48ce-b0f6-a9b43002bd55_resize/disk.info /opt/stack/data/nova/instances/0fe47a17-4ffb-48ce-b0f6-a9b43002bd55/disk.info" returned: 0 in 0.035s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:19:49 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:19:50 user nova-compute[73572]: DEBUG nova.compute.manager [req-0b2c01f4-68e9-451d-8e55-064f5112d4ed req-db3aa7cc-7c98-4ed4-b4ac-c5db558dd0f7 service nova] [instance: 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55] Received event network-vif-plugged-ebf9f385-e59b-4060-9bf9-a8d2006327b4 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:19:50 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-0b2c01f4-68e9-451d-8e55-064f5112d4ed req-db3aa7cc-7c98-4ed4-b4ac-c5db558dd0f7 service nova] Acquiring lock "0fe47a17-4ffb-48ce-b0f6-a9b43002bd55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:19:50 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-0b2c01f4-68e9-451d-8e55-064f5112d4ed req-db3aa7cc-7c98-4ed4-b4ac-c5db558dd0f7 service nova] Lock "0fe47a17-4ffb-48ce-b0f6-a9b43002bd55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:19:50 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-0b2c01f4-68e9-451d-8e55-064f5112d4ed req-db3aa7cc-7c98-4ed4-b4ac-c5db558dd0f7 service nova] Lock "0fe47a17-4ffb-48ce-b0f6-a9b43002bd55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:19:50 user nova-compute[73572]: DEBUG nova.compute.manager [req-0b2c01f4-68e9-451d-8e55-064f5112d4ed req-db3aa7cc-7c98-4ed4-b4ac-c5db558dd0f7 service nova] [instance: 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55] No waiting events found dispatching network-vif-plugged-ebf9f385-e59b-4060-9bf9-a8d2006327b4 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:19:50 user nova-compute[73572]: WARNING nova.compute.manager [req-0b2c01f4-68e9-451d-8e55-064f5112d4ed req-db3aa7cc-7c98-4ed4-b4ac-c5db558dd0f7 service nova] [instance: 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55] Received unexpected event network-vif-plugged-ebf9f385-e59b-4060-9bf9-a8d2006327b4 for instance with vm_state active and task_state resize_migrating.
Aug 26 10:19:51 user nova-compute[73572]: DEBUG nova.network.neutron [None req-2873906f-13e4-4858-b75c-73cf8f5f8ec9 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] [instance: 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55] Port ebf9f385-e59b-4060-9bf9-a8d2006327b4 binding to destination host user is already ACTIVE {{(pid=73572) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 26 10:19:51 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-2873906f-13e4-4858-b75c-73cf8f5f8ec9 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Acquiring lock "0fe47a17-4ffb-48ce-b0f6-a9b43002bd55-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:19:51 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-2873906f-13e4-4858-b75c-73cf8f5f8ec9 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Lock "0fe47a17-4ffb-48ce-b0f6-a9b43002bd55-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:19:51 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-2873906f-13e4-4858-b75c-73cf8f5f8ec9 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Lock "0fe47a17-4ffb-48ce-b0f6-a9b43002bd55-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:19:51 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-2873906f-13e4-4858-b75c-73cf8f5f8ec9 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Acquiring lock "refresh_cache-0fe47a17-4ffb-48ce-b0f6-a9b43002bd55" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:19:51 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-2873906f-13e4-4858-b75c-73cf8f5f8ec9 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Acquired lock "refresh_cache-0fe47a17-4ffb-48ce-b0f6-a9b43002bd55" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:19:51 user nova-compute[73572]: DEBUG nova.network.neutron [None req-2873906f-13e4-4858-b75c-73cf8f5f8ec9 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] [instance: 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55] Building network info cache for instance {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 10:19:52 user nova-compute[73572]: DEBUG nova.network.neutron [None req-2873906f-13e4-4858-b75c-73cf8f5f8ec9 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] [instance: 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55] Updating instance_info_cache with network_info: [{"id": "ebf9f385-e59b-4060-9bf9-a8d2006327b4", "address": "fa:16:3e:49:23:6a", "network": {"id": "7c89c22a-96d4-4e60-9c4c-b5a82a7eca55", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1976182948-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d2c922711fb445aa99ae4f30b802c12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebf9f385-e5", "ovs_interfaceid": "ebf9f385-e59b-4060-9bf9-a8d2006327b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:19:52 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-2873906f-13e4-4858-b75c-73cf8f5f8ec9 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Releasing lock "refresh_cache-0fe47a17-4ffb-48ce-b0f6-a9b43002bd55" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:19:52 user nova-compute[73572]: DEBUG os_brick.utils [None req-2873906f-13e4-4858-b75c-73cf8f5f8ec9 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 10:19:52 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:19:52 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:19:52 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3cf6d89-9bd4-4f1a-8fc2-5c90c0391e78]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:de8a79ed912\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:19:52 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:19:52 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:19:52 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fe1ff1f-862a-4836-a990-16d6df9fa136]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:19:52 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:19:52 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:19:52 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[c942b1d4-d442-4931-86a1-87d61107bbab]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:19:52 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bfdd0d4-4b6b-4188-bdb9-228abdc10b06]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:19:52 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-2873906f-13e4-4858-b75c-73cf8f5f8ec9 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Running cmd (subprocess): nvme version {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:19:52 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-2873906f-13e4-4858-b75c-73cf8f5f8ec9 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] 'nvme version' failed. Not Retrying. {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 10:19:52 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2873906f-13e4-4858-b75c-73cf8f5f8ec9 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] nvme not present on system {{(pid=73572) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 10:19:52 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:19:52 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 10:19:52 user nova-compute[73572]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 10:19:52 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[52ca2a04-16a2-452a-8b66-67321713690e]: (4, '') {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:19:52 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.lightos [None req-2873906f-13e4-4858-b75c-73cf8f5f8ec9 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73572) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 10:19:52 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.lightos [None req-2873906f-13e4-4858-b75c-73cf8f5f8ec9 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73572) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 10:19:52 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.lightos [None req-2873906f-13e4-4858-b75c-73cf8f5f8ec9 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] LIGHTOS: no hostnqn found. {{(pid=73572) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 10:19:52 user nova-compute[73572]: DEBUG os_brick.utils [None req-2873906f-13e4-4858-b75c-73cf8f5f8ec9 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] <== get_connector_properties: return (148ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:de8a79ed912', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 10:19:53 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-ac406b9c-3a29-4431-b638-3d75fa1593c1 tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] Acquiring lock "0dceaa35-4a13-453b-961f-831f66c35af0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:19:53 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-ac406b9c-3a29-4431-b638-3d75fa1593c1 tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] Lock "0dceaa35-4a13-453b-961f-831f66c35af0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:19:53 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-ac406b9c-3a29-4431-b638-3d75fa1593c1 tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] Acquiring lock "0dceaa35-4a13-453b-961f-831f66c35af0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:19:53 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-ac406b9c-3a29-4431-b638-3d75fa1593c1 tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] Lock "0dceaa35-4a13-453b-961f-831f66c35af0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:19:53 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-ac406b9c-3a29-4431-b638-3d75fa1593c1 tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] Lock "0dceaa35-4a13-453b-961f-831f66c35af0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:19:53 user nova-compute[73572]: INFO nova.compute.manager [None req-ac406b9c-3a29-4431-b638-3d75fa1593c1 tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] [instance: 0dceaa35-4a13-453b-961f-831f66c35af0] Terminating instance
Aug 26 10:19:53 user nova-compute[73572]: DEBUG nova.compute.manager [None req-ac406b9c-3a29-4431-b638-3d75fa1593c1 tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] [instance: 0dceaa35-4a13-453b-961f-831f66c35af0] Start destroying the instance on the hypervisor. {{(pid=73572) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 10:19:53 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:19:53 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:19:53 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:19:53 user nova-compute[73572]: DEBUG nova.compute.manager [req-ac82c9ab-ef93-41e6-a9a5-c313c3f575a1 req-1cf068e8-83f7-40ff-a100-050aa6dc9bf0 service nova] [instance: 0dceaa35-4a13-453b-961f-831f66c35af0] Received event network-vif-unplugged-3c5d5d20-da80-4401-b027-3c4b0df169c6 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:19:53 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-ac82c9ab-ef93-41e6-a9a5-c313c3f575a1 req-1cf068e8-83f7-40ff-a100-050aa6dc9bf0 service nova] Acquiring lock "0dceaa35-4a13-453b-961f-831f66c35af0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:19:53 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-ac82c9ab-ef93-41e6-a9a5-c313c3f575a1 req-1cf068e8-83f7-40ff-a100-050aa6dc9bf0 service nova] Lock "0dceaa35-4a13-453b-961f-831f66c35af0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:19:53 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-ac82c9ab-ef93-41e6-a9a5-c313c3f575a1 req-1cf068e8-83f7-40ff-a100-050aa6dc9bf0 service nova] Lock "0dceaa35-4a13-453b-961f-831f66c35af0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:19:53 user nova-compute[73572]: DEBUG nova.compute.manager [req-ac82c9ab-ef93-41e6-a9a5-c313c3f575a1 req-1cf068e8-83f7-40ff-a100-050aa6dc9bf0 service nova] [instance: 0dceaa35-4a13-453b-961f-831f66c35af0] No waiting events found dispatching network-vif-unplugged-3c5d5d20-da80-4401-b027-3c4b0df169c6 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:19:53 user nova-compute[73572]: DEBUG nova.compute.manager [req-ac82c9ab-ef93-41e6-a9a5-c313c3f575a1 req-1cf068e8-83f7-40ff-a100-050aa6dc9bf0 service nova] [instance: 0dceaa35-4a13-453b-961f-831f66c35af0] Received event network-vif-unplugged-3c5d5d20-da80-4401-b027-3c4b0df169c6 for instance with task_state deleting. {{(pid=73572) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 10:19:53 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:19:53 user nova-compute[73572]: INFO nova.virt.libvirt.driver [-] [instance: 0dceaa35-4a13-453b-961f-831f66c35af0] Instance destroyed successfully.
Aug 26 10:19:53 user nova-compute[73572]: DEBUG nova.objects.instance [None req-ac406b9c-3a29-4431-b638-3d75fa1593c1 tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] Lazy-loading 'resources' on Instance uuid 0dceaa35-4a13-453b-961f-831f66c35af0 {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:19:53 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-ac406b9c-3a29-4431-b638-3d75fa1593c1 tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T10:16:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1180989107',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1180989107',id=20,image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCoQLfbNOsScPlPdH7TTAWBoUTtprP7Wt9D2iobB5TEO7soZAUDBZvsnw8EfneOw36+/lna9tLwlSS51wnghWJumalBKBT2droQjZV+qAgp3BnIGzzIB2rwkhacN2zLmGg==',key_name='tempest-keypair-1046141656',keypairs=<?>,launch_index=0,launched_at=2023-08-26T10:16:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6d2915087eb04830831062675024f835',ramdisk_id='',reservation_id='r-untu6l5l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1639980618',owner_user_name='tempest-TaggedAttachmentsTest-1639980618-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T10:16:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5ff395781b5f403fa56cada31e168817',uuid=0dceaa35-4a13-453b-961f-831f66c35af0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3c5d5d20-da80-4401-b027-3c4b0df169c6", "address": "fa:16:3e:ad:63:c3", "network": {"id": "92949b0a-01f9-413c-9f96-a25b9b648f84", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-167588816-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d2915087eb04830831062675024f835", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c5d5d20-da", "ovs_interfaceid": "3c5d5d20-da80-4401-b027-3c4b0df169c6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 10:19:53 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-ac406b9c-3a29-4431-b638-3d75fa1593c1 tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] Converting VIF {"id": "3c5d5d20-da80-4401-b027-3c4b0df169c6", "address": "fa:16:3e:ad:63:c3", "network": {"id": "92949b0a-01f9-413c-9f96-a25b9b648f84", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-167588816-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d2915087eb04830831062675024f835", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c5d5d20-da", "ovs_interfaceid": "3c5d5d20-da80-4401-b027-3c4b0df169c6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:19:53 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-ac406b9c-3a29-4431-b638-3d75fa1593c1 tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ad:63:c3,bridge_name='br-int',has_traffic_filtering=True,id=3c5d5d20-da80-4401-b027-3c4b0df169c6,network=Network(92949b0a-01f9-413c-9f96-a25b9b648f84),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c5d5d20-da') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:19:53 user nova-compute[73572]: DEBUG os_vif [None req-ac406b9c-3a29-4431-b638-3d75fa1593c1 tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ad:63:c3,bridge_name='br-int',has_traffic_filtering=True,id=3c5d5d20-da80-4401-b027-3c4b0df169c6,network=Network(92949b0a-01f9-413c-9f96-a25b9b648f84),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c5d5d20-da') {{(pid=73572) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 10:19:53 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:19:53 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3c5d5d20-da, bridge=br-int, if_exists=True) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:19:53 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:19:53 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:19:53 user nova-compute[73572]: INFO os_vif [None req-ac406b9c-3a29-4431-b638-3d75fa1593c1 tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ad:63:c3,bridge_name='br-int',has_traffic_filtering=True,id=3c5d5d20-da80-4401-b027-3c4b0df169c6,network=Network(92949b0a-01f9-413c-9f96-a25b9b648f84),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c5d5d20-da')
Aug 26 10:19:53 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-ac406b9c-3a29-4431-b638-3d75fa1593c1 tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] [instance: 0dceaa35-4a13-453b-961f-831f66c35af0] Deleting instance files /opt/stack/data/nova/instances/0dceaa35-4a13-453b-961f-831f66c35af0_del
Aug 26 10:19:53 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-ac406b9c-3a29-4431-b638-3d75fa1593c1 tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] [instance: 0dceaa35-4a13-453b-961f-831f66c35af0] Deletion of /opt/stack/data/nova/instances/0dceaa35-4a13-453b-961f-831f66c35af0_del complete
Aug 26 10:19:54 user nova-compute[73572]: INFO nova.compute.manager [None req-ac406b9c-3a29-4431-b638-3d75fa1593c1 tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] [instance: 0dceaa35-4a13-453b-961f-831f66c35af0] Took 0.90 seconds to destroy the instance on the hypervisor.
Aug 26 10:19:54 user nova-compute[73572]: DEBUG oslo.service.loopingcall [None req-ac406b9c-3a29-4431-b638-3d75fa1593c1 tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73572) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 10:19:54 user nova-compute[73572]: DEBUG nova.compute.manager [-] [instance: 0dceaa35-4a13-453b-961f-831f66c35af0] Deallocating network for instance {{(pid=73572) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 10:19:54 user nova-compute[73572]: DEBUG nova.network.neutron [-] [instance: 0dceaa35-4a13-453b-961f-831f66c35af0] deallocate_for_instance() {{(pid=73572) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 10:19:54 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:19:54 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:19:55 user nova-compute[73572]: DEBUG nova.network.neutron [-] [instance: 0dceaa35-4a13-453b-961f-831f66c35af0] Updating instance_info_cache with network_info: [] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:19:55 user nova-compute[73572]: INFO nova.compute.manager [-] [instance: 0dceaa35-4a13-453b-961f-831f66c35af0] Took 1.13 seconds to deallocate network for instance.
Aug 26 10:19:55 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-ac406b9c-3a29-4431-b638-3d75fa1593c1 tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:19:55 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-ac406b9c-3a29-4431-b638-3d75fa1593c1 tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:19:55 user nova-compute[73572]: DEBUG nova.compute.manager [req-8e8f27f3-1c8a-46ba-9c30-47a78e89c0b2 req-6fe41a48-fc2e-44d8-a70b-722a1dceca38 service nova] [instance: 0dceaa35-4a13-453b-961f-831f66c35af0] Received event network-vif-plugged-3c5d5d20-da80-4401-b027-3c4b0df169c6 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:19:55 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-8e8f27f3-1c8a-46ba-9c30-47a78e89c0b2 req-6fe41a48-fc2e-44d8-a70b-722a1dceca38 service nova] Acquiring lock "0dceaa35-4a13-453b-961f-831f66c35af0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:19:55 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-8e8f27f3-1c8a-46ba-9c30-47a78e89c0b2 req-6fe41a48-fc2e-44d8-a70b-722a1dceca38 service nova] Lock "0dceaa35-4a13-453b-961f-831f66c35af0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:19:55 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-8e8f27f3-1c8a-46ba-9c30-47a78e89c0b2 req-6fe41a48-fc2e-44d8-a70b-722a1dceca38 service nova] Lock "0dceaa35-4a13-453b-961f-831f66c35af0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:19:55 user nova-compute[73572]: DEBUG nova.compute.manager [req-8e8f27f3-1c8a-46ba-9c30-47a78e89c0b2 req-6fe41a48-fc2e-44d8-a70b-722a1dceca38 service nova] [instance: 0dceaa35-4a13-453b-961f-831f66c35af0] No waiting events found dispatching network-vif-plugged-3c5d5d20-da80-4401-b027-3c4b0df169c6 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:19:55 user nova-compute[73572]: WARNING nova.compute.manager [req-8e8f27f3-1c8a-46ba-9c30-47a78e89c0b2 req-6fe41a48-fc2e-44d8-a70b-722a1dceca38 service nova] [instance: 0dceaa35-4a13-453b-961f-831f66c35af0] Received unexpected event network-vif-plugged-3c5d5d20-da80-4401-b027-3c4b0df169c6 for instance with vm_state deleted and task_state None.
Aug 26 10:19:55 user nova-compute[73572]: DEBUG nova.compute.manager [req-8e8f27f3-1c8a-46ba-9c30-47a78e89c0b2 req-6fe41a48-fc2e-44d8-a70b-722a1dceca38 service nova] [instance: 0dceaa35-4a13-453b-961f-831f66c35af0] Received event network-vif-deleted-3c5d5d20-da80-4401-b027-3c4b0df169c6 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:19:55 user nova-compute[73572]: DEBUG nova.compute.manager [req-fa39d5b0-5f50-489a-8e4d-ffa55af9ad3e req-c6b002c4-cde1-4d19-a873-6aaf5166d1f0 service nova] [instance: 339517ef-c023-4f13-a8cc-d84f7176dfcd] Received event volume-reimaged-d94556c8-9096-4e9a-9cfc-f9d17846ed06 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:19:55 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-fa39d5b0-5f50-489a-8e4d-ffa55af9ad3e req-c6b002c4-cde1-4d19-a873-6aaf5166d1f0 service nova] Acquiring lock "339517ef-c023-4f13-a8cc-d84f7176dfcd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:19:55 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-fa39d5b0-5f50-489a-8e4d-ffa55af9ad3e req-c6b002c4-cde1-4d19-a873-6aaf5166d1f0 service nova] Lock "339517ef-c023-4f13-a8cc-d84f7176dfcd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:19:55 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-fa39d5b0-5f50-489a-8e4d-ffa55af9ad3e req-c6b002c4-cde1-4d19-a873-6aaf5166d1f0 service nova] Lock "339517ef-c023-4f13-a8cc-d84f7176dfcd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:19:55 user nova-compute[73572]: DEBUG nova.compute.manager [req-fa39d5b0-5f50-489a-8e4d-ffa55af9ad3e req-c6b002c4-cde1-4d19-a873-6aaf5166d1f0 service nova] [instance: 339517ef-c023-4f13-a8cc-d84f7176dfcd] Processing event volume-reimaged-d94556c8-9096-4e9a-9cfc-f9d17846ed06 {{(pid=73572) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10792}}
Aug 26 10:19:55 user nova-compute[73572]: DEBUG nova.compute.manager [None req-fa39d5b0-5f50-489a-8e4d-ffa55af9ad3e tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] [instance: 339517ef-c023-4f13-a8cc-d84f7176dfcd] Instance event wait completed in 25 seconds for volume-reimaged {{(pid=73572) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 10:19:55 user nova-compute[73572]: DEBUG nova.compute.provider_tree [None req-ac406b9c-3a29-4431-b638-3d75fa1593c1 tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] Inventory has not changed in ProviderTree for provider: e2cec974-59b2-4c77-a53d-a7f4e5a30d75 {{(pid=73572) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 10:19:55 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-ac406b9c-3a29-4431-b638-3d75fa1593c1 tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] Inventory has not changed for provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73572) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 10:19:55 user nova-compute[73572]: INFO nova.virt.block_device [None req-fa39d5b0-5f50-489a-8e4d-ffa55af9ad3e tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] [instance: 339517ef-c023-4f13-a8cc-d84f7176dfcd] Booting with volume d94556c8-9096-4e9a-9cfc-f9d17846ed06 at /dev/vda
Aug 26 10:19:55 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-ac406b9c-3a29-4431-b638-3d75fa1593c1 tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.542s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:19:55 user nova-compute[73572]: DEBUG os_brick.utils [None req-fa39d5b0-5f50-489a-8e4d-ffa55af9ad3e tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 10:19:55 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:19:55 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:19:55 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e3db513-b251-4247-9644-8bc441454728]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:de8a79ed912\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:19:55 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:19:55 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:19:55 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[2abf427f-025f-424a-8c6b-c8af809f70c3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:19:55 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:19:55 user nova-compute[73572]: INFO nova.scheduler.client.report [None req-ac406b9c-3a29-4431-b638-3d75fa1593c1 tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] Deleted allocations for instance 0dceaa35-4a13-453b-961f-831f66c35af0
Aug 26 10:19:55 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:19:55 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[b985d243-a821-4b2e-82c6-aa820871ae2d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:19:55 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb18d979-bae5-4598-a957-a944444a2381]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:19:55 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-fa39d5b0-5f50-489a-8e4d-ffa55af9ad3e tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] Running cmd (subprocess): nvme version {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:19:55 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-fa39d5b0-5f50-489a-8e4d-ffa55af9ad3e tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] 'nvme version' failed. Not Retrying. {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 10:19:55 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fa39d5b0-5f50-489a-8e4d-ffa55af9ad3e tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] nvme not present on system {{(pid=73572) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 10:19:55 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:19:55 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 10:19:55 user nova-compute[73572]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 10:19:55 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[1775f828-a219-49e1-8e70-1f3fe1290b31]: (4, '') {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:19:55 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.lightos [None req-fa39d5b0-5f50-489a-8e4d-ffa55af9ad3e tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73572) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 10:19:55 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.lightos [None req-fa39d5b0-5f50-489a-8e4d-ffa55af9ad3e tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73572) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 10:19:55 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.lightos [None req-fa39d5b0-5f50-489a-8e4d-ffa55af9ad3e tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] LIGHTOS: no hostnqn found. {{(pid=73572) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 10:19:55 user nova-compute[73572]: DEBUG os_brick.utils [None req-fa39d5b0-5f50-489a-8e4d-ffa55af9ad3e tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] <== get_connector_properties: return (152ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:de8a79ed912', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 10:19:55 user nova-compute[73572]: DEBUG nova.virt.block_device [None req-fa39d5b0-5f50-489a-8e4d-ffa55af9ad3e tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] [instance: 339517ef-c023-4f13-a8cc-d84f7176dfcd] Updating existing volume attachment record: ae7304a1-8052-49ed-a8ce-39858af5ee91 {{(pid=73572) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 10:19:55 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-ac406b9c-3a29-4431-b638-3d75fa1593c1 tempest-TaggedAttachmentsTest-1639980618 tempest-TaggedAttachmentsTest-1639980618-project-member] Lock "0dceaa35-4a13-453b-961f-831f66c35af0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.818s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:19:57 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:19:58 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:19:59 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:20:01 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-becec0e0-0a58-48c8-befb-452f63b4d564 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Acquiring lock "44a737bf-3704-4193-8d24-b8d132267279" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:20:01 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-becec0e0-0a58-48c8-befb-452f63b4d564 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Lock "44a737bf-3704-4193-8d24-b8d132267279" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:20:01 user nova-compute[73572]: DEBUG nova.compute.manager [None req-becec0e0-0a58-48c8-befb-452f63b4d564 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] [instance: 44a737bf-3704-4193-8d24-b8d132267279] Starting instance... {{(pid=73572) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 10:20:01 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-becec0e0-0a58-48c8-befb-452f63b4d564 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:20:01 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-becec0e0-0a58-48c8-befb-452f63b4d564 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:20:01 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-becec0e0-0a58-48c8-befb-452f63b4d564 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73572) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 10:20:01 user nova-compute[73572]: INFO nova.compute.claims [None req-becec0e0-0a58-48c8-befb-452f63b4d564 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] [instance: 44a737bf-3704-4193-8d24-b8d132267279] Claim successful on node user
Aug 26 10:20:01 user nova-compute[73572]: DEBUG nova.compute.provider_tree [None req-becec0e0-0a58-48c8-befb-452f63b4d564 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Inventory has not changed in ProviderTree for provider: e2cec974-59b2-4c77-a53d-a7f4e5a30d75 {{(pid=73572) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 10:20:01 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-becec0e0-0a58-48c8-befb-452f63b4d564 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Inventory has not changed for provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73572) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 10:20:01 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-becec0e0-0a58-48c8-befb-452f63b4d564 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.554s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:20:01 user nova-compute[73572]: DEBUG nova.compute.manager [None req-becec0e0-0a58-48c8-befb-452f63b4d564 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] [instance: 44a737bf-3704-4193-8d24-b8d132267279] Start building networks asynchronously for instance. {{(pid=73572) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 10:20:01 user nova-compute[73572]: DEBUG nova.compute.manager [None req-becec0e0-0a58-48c8-befb-452f63b4d564 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] [instance: 44a737bf-3704-4193-8d24-b8d132267279] Allocating IP information in the background. {{(pid=73572) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 10:20:01 user nova-compute[73572]: DEBUG nova.network.neutron [None req-becec0e0-0a58-48c8-befb-452f63b4d564 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] [instance: 44a737bf-3704-4193-8d24-b8d132267279] allocate_for_instance() {{(pid=73572) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 10:20:01 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-becec0e0-0a58-48c8-befb-452f63b4d564 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] [instance: 44a737bf-3704-4193-8d24-b8d132267279] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 10:20:01 user nova-compute[73572]: DEBUG nova.compute.manager [None req-becec0e0-0a58-48c8-befb-452f63b4d564 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] [instance: 44a737bf-3704-4193-8d24-b8d132267279] Start building block device mappings for instance. {{(pid=73572) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 10:20:02 user nova-compute[73572]: DEBUG nova.policy [None req-becec0e0-0a58-48c8-befb-452f63b4d564 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c7cf9c8d529d49149141add20c2b2af2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47abd6293c07465389c379e3b5061164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73572) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 10:20:02 user nova-compute[73572]: DEBUG nova.compute.manager [None req-becec0e0-0a58-48c8-befb-452f63b4d564 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] [instance: 44a737bf-3704-4193-8d24-b8d132267279] Start spawning the instance on the hypervisor. {{(pid=73572) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 10:20:02 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-becec0e0-0a58-48c8-befb-452f63b4d564 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] [instance: 44a737bf-3704-4193-8d24-b8d132267279] Creating instance directory {{(pid=73572) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 10:20:02 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-becec0e0-0a58-48c8-befb-452f63b4d564 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] [instance: 44a737bf-3704-4193-8d24-b8d132267279] Creating image(s)
Aug 26 10:20:02 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-becec0e0-0a58-48c8-befb-452f63b4d564 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Acquiring lock "/opt/stack/data/nova/instances/44a737bf-3704-4193-8d24-b8d132267279/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:20:02 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-becec0e0-0a58-48c8-befb-452f63b4d564 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Lock "/opt/stack/data/nova/instances/44a737bf-3704-4193-8d24-b8d132267279/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:20:02 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-becec0e0-0a58-48c8-befb-452f63b4d564 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Lock "/opt/stack/data/nova/instances/44a737bf-3704-4193-8d24-b8d132267279/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:20:02 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-becec0e0-0a58-48c8-befb-452f63b4d564 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:20:02 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-becec0e0-0a58-48c8-befb-452f63b4d564 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json" returned: 0 in 0.216s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:20:02 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-becec0e0-0a58-48c8-befb-452f63b4d564 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Acquiring lock "2099350d6f3bcd0de9471c73862d4fe75b049801" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:20:02 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-becec0e0-0a58-48c8-befb-452f63b4d564 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Lock "2099350d6f3bcd0de9471c73862d4fe75b049801" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:20:02 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-becec0e0-0a58-48c8-befb-452f63b4d564 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:20:02 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-becec0e0-0a58-48c8-befb-452f63b4d564 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json" returned: 0 in 0.197s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:20:02 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-becec0e0-0a58-48c8-befb-452f63b4d564 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801,backing_fmt=raw /opt/stack/data/nova/instances/44a737bf-3704-4193-8d24-b8d132267279/disk 1073741824 {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:20:02 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-becec0e0-0a58-48c8-befb-452f63b4d564 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801,backing_fmt=raw /opt/stack/data/nova/instances/44a737bf-3704-4193-8d24-b8d132267279/disk 1073741824" returned: 0 in 0.065s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:20:02 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-becec0e0-0a58-48c8-befb-452f63b4d564 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Lock "2099350d6f3bcd0de9471c73862d4fe75b049801" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.271s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:20:02 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-becec0e0-0a58-48c8-befb-452f63b4d564 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:20:02 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-6d87a9c0-3c72-40f8-8ac9-def2ceeb0644 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Acquiring lock "693f562f-ae3d-4cfb-926e-9990a1a301cb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:20:02 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-6d87a9c0-3c72-40f8-8ac9-def2ceeb0644 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Lock "693f562f-ae3d-4cfb-926e-9990a1a301cb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:20:02 user nova-compute[73572]: DEBUG nova.compute.manager [None req-6d87a9c0-3c72-40f8-8ac9-def2ceeb0644 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] [instance: 693f562f-ae3d-4cfb-926e-9990a1a301cb] Starting instance... {{(pid=73572) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 10:20:02 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-becec0e0-0a58-48c8-befb-452f63b4d564 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json" returned: 0 in 0.211s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:20:02 user nova-compute[73572]: DEBUG nova.virt.disk.api [None req-becec0e0-0a58-48c8-befb-452f63b4d564 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Checking if we can resize image /opt/stack/data/nova/instances/44a737bf-3704-4193-8d24-b8d132267279/disk. size=1073741824 {{(pid=73572) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 10:20:02 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-becec0e0-0a58-48c8-befb-452f63b4d564 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44a737bf-3704-4193-8d24-b8d132267279/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:20:02 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-6d87a9c0-3c72-40f8-8ac9-def2ceeb0644 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:20:02 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-6d87a9c0-3c72-40f8-8ac9-def2ceeb0644 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.004s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:20:02 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-6d87a9c0-3c72-40f8-8ac9-def2ceeb0644 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73572) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 10:20:02 user nova-compute[73572]: INFO nova.compute.claims [None req-6d87a9c0-3c72-40f8-8ac9-def2ceeb0644 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] [instance: 693f562f-ae3d-4cfb-926e-9990a1a301cb] Claim successful on node user
Aug 26 10:20:03 user nova-compute[73572]: DEBUG nova.network.neutron [None req-becec0e0-0a58-48c8-befb-452f63b4d564 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] [instance: 44a737bf-3704-4193-8d24-b8d132267279] Successfully created port: 4d7425ac-5500-4d32-b0db-448d4bd29651 {{(pid=73572) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 10:20:03 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-becec0e0-0a58-48c8-befb-452f63b4d564 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44a737bf-3704-4193-8d24-b8d132267279/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:20:03 user nova-compute[73572]: DEBUG nova.virt.disk.api [None req-becec0e0-0a58-48c8-befb-452f63b4d564 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Cannot resize image /opt/stack/data/nova/instances/44a737bf-3704-4193-8d24-b8d132267279/disk to a smaller size. {{(pid=73572) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 10:20:03 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-becec0e0-0a58-48c8-befb-452f63b4d564 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] [instance: 44a737bf-3704-4193-8d24-b8d132267279] Created local disks {{(pid=73572) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 10:20:03 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-becec0e0-0a58-48c8-befb-452f63b4d564 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] [instance: 44a737bf-3704-4193-8d24-b8d132267279] Ensure instance console log exists: /opt/stack/data/nova/instances/44a737bf-3704-4193-8d24-b8d132267279/console.log {{(pid=73572) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 10:20:03 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-becec0e0-0a58-48c8-befb-452f63b4d564 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:20:03 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-becec0e0-0a58-48c8-befb-452f63b4d564 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:20:03 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-becec0e0-0a58-48c8-befb-452f63b4d564 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:20:03 user nova-compute[73572]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693045188.4258537, 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55 => Stopped> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:20:03 user nova-compute[73572]: INFO nova.compute.manager [-] [instance: 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55] VM Stopped (Lifecycle Event)
Aug 26 10:20:03 user nova-compute[73572]: DEBUG nova.compute.manager [None req-3079edea-c63c-4a13-8e34-e409ff9bd0b8 None None] [instance: 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:20:03 user nova-compute[73572]: DEBUG nova.compute.manager [None req-3079edea-c63c-4a13-8e34-e409ff9bd0b8 None None] [instance: 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 4 {{(pid=73572) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 10:20:03 user nova-compute[73572]: INFO nova.compute.manager [None req-3079edea-c63c-4a13-8e34-e409ff9bd0b8 None None] [instance: 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 26 10:20:03 user nova-compute[73572]: DEBUG nova.compute.provider_tree [None req-6d87a9c0-3c72-40f8-8ac9-def2ceeb0644 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Inventory has not changed in ProviderTree for provider: e2cec974-59b2-4c77-a53d-a7f4e5a30d75 {{(pid=73572) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 10:20:03 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-6d87a9c0-3c72-40f8-8ac9-def2ceeb0644 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Inventory has not changed for provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73572) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 10:20:03 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-6d87a9c0-3c72-40f8-8ac9-def2ceeb0644 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.661s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:20:03 user nova-compute[73572]: DEBUG nova.compute.manager [None req-6d87a9c0-3c72-40f8-8ac9-def2ceeb0644 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] [instance: 693f562f-ae3d-4cfb-926e-9990a1a301cb] Start building networks asynchronously for instance. {{(pid=73572) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 10:20:03 user nova-compute[73572]: DEBUG nova.compute.manager [None req-6d87a9c0-3c72-40f8-8ac9-def2ceeb0644 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] [instance: 693f562f-ae3d-4cfb-926e-9990a1a301cb] Allocating IP information in the background. {{(pid=73572) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 10:20:03 user nova-compute[73572]: DEBUG nova.network.neutron [None req-6d87a9c0-3c72-40f8-8ac9-def2ceeb0644 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] [instance: 693f562f-ae3d-4cfb-926e-9990a1a301cb] allocate_for_instance() {{(pid=73572) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 10:20:03 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-6d87a9c0-3c72-40f8-8ac9-def2ceeb0644 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] [instance: 693f562f-ae3d-4cfb-926e-9990a1a301cb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 10:20:03 user nova-compute[73572]: DEBUG nova.compute.manager [None req-6d87a9c0-3c72-40f8-8ac9-def2ceeb0644 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] [instance: 693f562f-ae3d-4cfb-926e-9990a1a301cb] Start building block device mappings for instance. {{(pid=73572) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 10:20:03 user nova-compute[73572]: DEBUG nova.policy [None req-6d87a9c0-3c72-40f8-8ac9-def2ceeb0644 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '60fb7b6cd1d14b2ea2e4ab806642e230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e33d9ef6ec45709135edc20c8d7720', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73572) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 10:20:03 user nova-compute[73572]: DEBUG nova.compute.manager [None req-6d87a9c0-3c72-40f8-8ac9-def2ceeb0644 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] [instance: 693f562f-ae3d-4cfb-926e-9990a1a301cb] Start spawning the instance on the hypervisor. {{(pid=73572) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 10:20:03 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-6d87a9c0-3c72-40f8-8ac9-def2ceeb0644 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] [instance: 693f562f-ae3d-4cfb-926e-9990a1a301cb] Creating instance directory {{(pid=73572) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 10:20:03 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-6d87a9c0-3c72-40f8-8ac9-def2ceeb0644 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] [instance: 693f562f-ae3d-4cfb-926e-9990a1a301cb] Creating image(s)
Aug 26 10:20:03 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-6d87a9c0-3c72-40f8-8ac9-def2ceeb0644 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Acquiring lock "/opt/stack/data/nova/instances/693f562f-ae3d-4cfb-926e-9990a1a301cb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:20:03 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-6d87a9c0-3c72-40f8-8ac9-def2ceeb0644 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Lock "/opt/stack/data/nova/instances/693f562f-ae3d-4cfb-926e-9990a1a301cb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:20:03 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-6d87a9c0-3c72-40f8-8ac9-def2ceeb0644 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Lock "/opt/stack/data/nova/instances/693f562f-ae3d-4cfb-926e-9990a1a301cb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:20:03 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-6d87a9c0-3c72-40f8-8ac9-def2ceeb0644 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:20:03 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:20:04 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-6d87a9c0-3c72-40f8-8ac9-def2ceeb0644 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json" returned: 0 in 0.171s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:20:04 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-6d87a9c0-3c72-40f8-8ac9-def2ceeb0644 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Acquiring lock "2099350d6f3bcd0de9471c73862d4fe75b049801" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:20:04 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-6d87a9c0-3c72-40f8-8ac9-def2ceeb0644 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Lock "2099350d6f3bcd0de9471c73862d4fe75b049801" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:20:04 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-6d87a9c0-3c72-40f8-8ac9-def2ceeb0644 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:20:04 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-6d87a9c0-3c72-40f8-8ac9-def2ceeb0644 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json" returned: 0 in 0.199s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:20:04 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-6d87a9c0-3c72-40f8-8ac9-def2ceeb0644 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801,backing_fmt=raw /opt/stack/data/nova/instances/693f562f-ae3d-4cfb-926e-9990a1a301cb/disk 1073741824 {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:20:04 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-6d87a9c0-3c72-40f8-8ac9-def2ceeb0644 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801,backing_fmt=raw /opt/stack/data/nova/instances/693f562f-ae3d-4cfb-926e-9990a1a301cb/disk 1073741824" returned: 0 in 0.072s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:20:04 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-6d87a9c0-3c72-40f8-8ac9-def2ceeb0644 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Lock "2099350d6f3bcd0de9471c73862d4fe75b049801" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.278s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:20:04 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-6d87a9c0-3c72-40f8-8ac9-def2ceeb0644 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:20:04 user nova-compute[73572]: DEBUG nova.network.neutron [None req-becec0e0-0a58-48c8-befb-452f63b4d564 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] [instance: 44a737bf-3704-4193-8d24-b8d132267279] Successfully updated port: 4d7425ac-5500-4d32-b0db-448d4bd29651 {{(pid=73572) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 10:20:04 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-becec0e0-0a58-48c8-befb-452f63b4d564 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Acquiring lock "refresh_cache-44a737bf-3704-4193-8d24-b8d132267279" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:20:04 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-becec0e0-0a58-48c8-befb-452f63b4d564 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Acquired lock "refresh_cache-44a737bf-3704-4193-8d24-b8d132267279" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:20:04 user nova-compute[73572]: DEBUG nova.network.neutron [None req-becec0e0-0a58-48c8-befb-452f63b4d564 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] [instance: 44a737bf-3704-4193-8d24-b8d132267279] Building network info cache for instance {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 10:20:04 user nova-compute[73572]: DEBUG nova.compute.manager [req-964ce679-6b60-422b-a5ab-e5e9149aba5a req-9f66ffdc-0caf-4b32-bb1b-2943ed9e920e service nova] [instance: 44a737bf-3704-4193-8d24-b8d132267279] Received event network-changed-4d7425ac-5500-4d32-b0db-448d4bd29651 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:20:04 user nova-compute[73572]: DEBUG nova.compute.manager [req-964ce679-6b60-422b-a5ab-e5e9149aba5a req-9f66ffdc-0caf-4b32-bb1b-2943ed9e920e service nova] [instance: 44a737bf-3704-4193-8d24-b8d132267279] Refreshing instance network info cache due to event network-changed-4d7425ac-5500-4d32-b0db-448d4bd29651. {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 10:20:04 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-964ce679-6b60-422b-a5ab-e5e9149aba5a req-9f66ffdc-0caf-4b32-bb1b-2943ed9e920e service nova] Acquiring lock "refresh_cache-44a737bf-3704-4193-8d24-b8d132267279" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:20:04 user nova-compute[73572]: DEBUG nova.network.neutron [None req-becec0e0-0a58-48c8-befb-452f63b4d564 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] [instance: 44a737bf-3704-4193-8d24-b8d132267279] Instance cache missing network info. {{(pid=73572) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 10:20:04 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-6d87a9c0-3c72-40f8-8ac9-def2ceeb0644 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json" returned: 0 in 0.194s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:20:04 user nova-compute[73572]: DEBUG nova.virt.disk.api [None req-6d87a9c0-3c72-40f8-8ac9-def2ceeb0644 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Checking if we can resize image /opt/stack/data/nova/instances/693f562f-ae3d-4cfb-926e-9990a1a301cb/disk. size=1073741824 {{(pid=73572) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 10:20:04 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-6d87a9c0-3c72-40f8-8ac9-def2ceeb0644 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/693f562f-ae3d-4cfb-926e-9990a1a301cb/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:20:04 user nova-compute[73572]: DEBUG nova.network.neutron [None req-6d87a9c0-3c72-40f8-8ac9-def2ceeb0644 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] [instance: 693f562f-ae3d-4cfb-926e-9990a1a301cb] Successfully created port: 010eed73-8a66-4648-a616-0b9e7441ab1c {{(pid=73572) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 10:20:04 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:20:04 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-6d87a9c0-3c72-40f8-8ac9-def2ceeb0644 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/693f562f-ae3d-4cfb-926e-9990a1a301cb/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:20:04 user nova-compute[73572]: DEBUG nova.virt.disk.api [None req-6d87a9c0-3c72-40f8-8ac9-def2ceeb0644 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Cannot resize image /opt/stack/data/nova/instances/693f562f-ae3d-4cfb-926e-9990a1a301cb/disk to a smaller size. {{(pid=73572) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 10:20:04 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-6d87a9c0-3c72-40f8-8ac9-def2ceeb0644 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] [instance: 693f562f-ae3d-4cfb-926e-9990a1a301cb] Created local disks {{(pid=73572) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 10:20:04 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-6d87a9c0-3c72-40f8-8ac9-def2ceeb0644 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] [instance: 693f562f-ae3d-4cfb-926e-9990a1a301cb] Ensure instance console log exists: /opt/stack/data/nova/instances/693f562f-ae3d-4cfb-926e-9990a1a301cb/console.log {{(pid=73572) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 10:20:04 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-6d87a9c0-3c72-40f8-8ac9-def2ceeb0644 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:20:04 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-6d87a9c0-3c72-40f8-8ac9-def2ceeb0644 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:20:04 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-6d87a9c0-3c72-40f8-8ac9-def2ceeb0644 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:20:04 user nova-compute[73572]: DEBUG nova.network.neutron [None req-becec0e0-0a58-48c8-befb-452f63b4d564 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] [instance: 44a737bf-3704-4193-8d24-b8d132267279] Updating instance_info_cache with network_info: [{"id": "4d7425ac-5500-4d32-b0db-448d4bd29651", "address": "fa:16:3e:6a:ad:a7", "network": {"id": "880aa066-8f77-469b-a0c4-e4e94ae31e1a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-313654920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47abd6293c07465389c379e3b5061164", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d7425ac-55", "ovs_interfaceid": "4d7425ac-5500-4d32-b0db-448d4bd29651", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:20:04 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-becec0e0-0a58-48c8-befb-452f63b4d564 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Releasing lock "refresh_cache-44a737bf-3704-4193-8d24-b8d132267279" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:20:04 user nova-compute[73572]: DEBUG nova.compute.manager [None req-becec0e0-0a58-48c8-befb-452f63b4d564 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] [instance: 44a737bf-3704-4193-8d24-b8d132267279] Instance network_info: |[{"id": "4d7425ac-5500-4d32-b0db-448d4bd29651", "address": "fa:16:3e:6a:ad:a7", "network": {"id": "880aa066-8f77-469b-a0c4-e4e94ae31e1a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-313654920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47abd6293c07465389c379e3b5061164", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d7425ac-55", "ovs_interfaceid": "4d7425ac-5500-4d32-b0db-448d4bd29651", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73572) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 10:20:04 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-964ce679-6b60-422b-a5ab-e5e9149aba5a req-9f66ffdc-0caf-4b32-bb1b-2943ed9e920e service nova] Acquired lock "refresh_cache-44a737bf-3704-4193-8d24-b8d132267279" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:20:04 user nova-compute[73572]: DEBUG nova.network.neutron [req-964ce679-6b60-422b-a5ab-e5e9149aba5a req-9f66ffdc-0caf-4b32-bb1b-2943ed9e920e service nova] [instance: 44a737bf-3704-4193-8d24-b8d132267279] Refreshing network info cache for port 4d7425ac-5500-4d32-b0db-448d4bd29651 {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 10:20:04 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-becec0e0-0a58-48c8-befb-452f63b4d564 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] [instance: 44a737bf-3704-4193-8d24-b8d132267279] Start _get_guest_xml network_info=[{"id": "4d7425ac-5500-4d32-b0db-448d4bd29651", "address": "fa:16:3e:6a:ad:a7", "network": {"id": "880aa066-8f77-469b-a0c4-e4e94ae31e1a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-313654920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47abd6293c07465389c379e3b5061164", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d7425ac-55", "ovs_interfaceid": "4d7425ac-5500-4d32-b0db-448d4bd29651", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T10:07:33Z,direct_url=<?>,disk_format='qcow2',id=299da0c9-e1c4-48f0-be55-fbe20dd06bc9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5c995f8bbbab4368b67a253e0df3971a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T10:07:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'guest_format': None, 'size': 0, 'encryption_format': None, 'device_type': 'disk', 'image_id': '299da0c9-e1c4-48f0-be55-fbe20dd06bc9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73572) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 10:20:04 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-becec0e0-0a58-48c8-befb-452f63b4d564 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:20:04 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-becec0e0-0a58-48c8-befb-452f63b4d564 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:20:04 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-becec0e0-0a58-48c8-befb-452f63b4d564 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73572) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 10:20:04 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-becec0e0-0a58-48c8-befb-452f63b4d564 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] CPU controller missing on host. {{(pid=73572) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 10:20:04 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-becec0e0-0a58-48c8-befb-452f63b4d564 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73572) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 10:20:04 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-becec0e0-0a58-48c8-befb-452f63b4d564 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] CPU controller found on host. {{(pid=73572) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 10:20:04 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-becec0e0-0a58-48c8-befb-452f63b4d564 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73572) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 10:20:04 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-becec0e0-0a58-48c8-befb-452f63b4d564 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T10:07:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T10:07:33Z,direct_url=<?>,disk_format='qcow2',id=299da0c9-e1c4-48f0-be55-fbe20dd06bc9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5c995f8bbbab4368b67a253e0df3971a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T10:07:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 10:20:04 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-becec0e0-0a58-48c8-befb-452f63b4d564 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Flavor limits 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 10:20:04 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-becec0e0-0a58-48c8-befb-452f63b4d564 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Image limits 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 10:20:04 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-becec0e0-0a58-48c8-befb-452f63b4d564 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Flavor pref 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 10:20:04 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-becec0e0-0a58-48c8-befb-452f63b4d564 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Image pref 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 10:20:04 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-becec0e0-0a58-48c8-befb-452f63b4d564 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 10:20:04 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-becec0e0-0a58-48c8-befb-452f63b4d564 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 10:20:04 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-becec0e0-0a58-48c8-befb-452f63b4d564 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73572) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 10:20:04 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-becec0e0-0a58-48c8-befb-452f63b4d564 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Got 1 possible topologies {{(pid=73572) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 10:20:04 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-becec0e0-0a58-48c8-befb-452f63b4d564 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 10:20:04 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-becec0e0-0a58-48c8-befb-452f63b4d564 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 10:20:04 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-becec0e0-0a58-48c8-befb-452f63b4d564 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T10:20:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-78174165',display_name='tempest-AttachVolumeNegativeTest-server-78174165',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-78174165',id=26,image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHAXZXxh5sr9uv0a1z3l3OFMssLWWpYs2ayEFomQLQNkT5c8CXKXyIDQskEkHQQ3c+pAWzGLev6XdCDbdOJGftkfOWSncTYrStZ+JQ3aj7gzNKVMrEoaaTK4q6UEzCUVpA==',key_name='tempest-keypair-1525083416',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='47abd6293c07465389c379e3b5061164',ramdisk_id='',reservation_id='r-etn04ew6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-608798758',owner_user_name='tempest-AttachVolumeNegativeTest-608798758-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T10:20:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c7cf9c8d529d49149141add20c2b2af2',uuid=44a737bf-3704-4193-8d24-b8d132267279,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4d7425ac-5500-4d32-b0db-448d4bd29651", "address": "fa:16:3e:6a:ad:a7", "network": {"id": "880aa066-8f77-469b-a0c4-e4e94ae31e1a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-313654920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47abd6293c07465389c379e3b5061164", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d7425ac-55", "ovs_interfaceid": "4d7425ac-5500-4d32-b0db-448d4bd29651", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73572) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 10:20:04 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-becec0e0-0a58-48c8-befb-452f63b4d564 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Converting VIF {"id": "4d7425ac-5500-4d32-b0db-448d4bd29651", "address": "fa:16:3e:6a:ad:a7", "network": {"id": "880aa066-8f77-469b-a0c4-e4e94ae31e1a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-313654920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47abd6293c07465389c379e3b5061164", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d7425ac-55", "ovs_interfaceid": "4d7425ac-5500-4d32-b0db-448d4bd29651", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:20:04 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-becec0e0-0a58-48c8-befb-452f63b4d564 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6a:ad:a7,bridge_name='br-int',has_traffic_filtering=True,id=4d7425ac-5500-4d32-b0db-448d4bd29651,network=Network(880aa066-8f77-469b-a0c4-e4e94ae31e1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d7425ac-55') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:20:04 user nova-compute[73572]: DEBUG nova.objects.instance [None req-becec0e0-0a58-48c8-befb-452f63b4d564 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Lazy-loading 'pci_devices' on Instance uuid 44a737bf-3704-4193-8d24-b8d132267279 {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:20:04 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-becec0e0-0a58-48c8-befb-452f63b4d564 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] [instance: 44a737bf-3704-4193-8d24-b8d132267279] End _get_guest_xml xml=<domain type="kvm">
Aug 26 10:20:04 user nova-compute[73572]:   <uuid>44a737bf-3704-4193-8d24-b8d132267279</uuid>
Aug 26 10:20:04 user nova-compute[73572]:   <name>instance-0000001a</name>
Aug 26 10:20:04 user nova-compute[73572]:   <memory>524288</memory>
Aug 26 10:20:04 user nova-compute[73572]:   <vcpu>1</vcpu>
Aug 26 10:20:04 user nova-compute[73572]:   <metadata>
Aug 26 10:20:04 user nova-compute[73572]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 10:20:04 user nova-compute[73572]:       <nova:package version="0.0.0"/>
Aug 26 10:20:04 user nova-compute[73572]:       <nova:name>tempest-AttachVolumeNegativeTest-server-78174165</nova:name>
Aug 26 10:20:04 user nova-compute[73572]:       <nova:creationTime>2023-08-26 10:20:04</nova:creationTime>
Aug 26 10:20:04 user nova-compute[73572]:       <nova:flavor name="m1.tiny">
Aug 26 10:20:04 user nova-compute[73572]:         <nova:memory>512</nova:memory>
Aug 26 10:20:04 user nova-compute[73572]:         <nova:disk>1</nova:disk>
Aug 26 10:20:04 user nova-compute[73572]:         <nova:swap>0</nova:swap>
Aug 26 10:20:04 user nova-compute[73572]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 10:20:04 user nova-compute[73572]:         <nova:vcpus>1</nova:vcpus>
Aug 26 10:20:04 user nova-compute[73572]:       </nova:flavor>
Aug 26 10:20:04 user nova-compute[73572]:       <nova:owner>
Aug 26 10:20:04 user nova-compute[73572]:         <nova:user uuid="c7cf9c8d529d49149141add20c2b2af2">tempest-AttachVolumeNegativeTest-608798758-project-member</nova:user>
Aug 26 10:20:04 user nova-compute[73572]:         <nova:project uuid="47abd6293c07465389c379e3b5061164">tempest-AttachVolumeNegativeTest-608798758</nova:project>
Aug 26 10:20:04 user nova-compute[73572]:       </nova:owner>
Aug 26 10:20:04 user nova-compute[73572]:       <nova:root type="image" uuid="299da0c9-e1c4-48f0-be55-fbe20dd06bc9"/>
Aug 26 10:20:04 user nova-compute[73572]:       <nova:ports>
Aug 26 10:20:04 user nova-compute[73572]:         <nova:port uuid="4d7425ac-5500-4d32-b0db-448d4bd29651">
Aug 26 10:20:04 user nova-compute[73572]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 26 10:20:04 user nova-compute[73572]:         </nova:port>
Aug 26 10:20:04 user nova-compute[73572]:       </nova:ports>
Aug 26 10:20:04 user nova-compute[73572]:     </nova:instance>
Aug 26 10:20:04 user nova-compute[73572]:   </metadata>
Aug 26 10:20:04 user nova-compute[73572]:   <sysinfo type="smbios">
Aug 26 10:20:04 user nova-compute[73572]:     <system>
Aug 26 10:20:04 user nova-compute[73572]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 10:20:04 user nova-compute[73572]:       <entry name="product">OpenStack Nova</entry>
Aug 26 10:20:04 user nova-compute[73572]:       <entry name="version">0.0.0</entry>
Aug 26 10:20:04 user nova-compute[73572]:       <entry name="serial">44a737bf-3704-4193-8d24-b8d132267279</entry>
Aug 26 10:20:04 user nova-compute[73572]:       <entry name="uuid">44a737bf-3704-4193-8d24-b8d132267279</entry>
Aug 26 10:20:04 user nova-compute[73572]:       <entry name="family">Virtual Machine</entry>
Aug 26 10:20:04 user nova-compute[73572]:     </system>
Aug 26 10:20:04 user nova-compute[73572]:   </sysinfo>
Aug 26 10:20:04 user nova-compute[73572]:   <os>
Aug 26 10:20:04 user nova-compute[73572]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 10:20:04 user nova-compute[73572]:     <boot dev="hd"/>
Aug 26 10:20:04 user nova-compute[73572]:     <smbios mode="sysinfo"/>
Aug 26 10:20:04 user nova-compute[73572]:   </os>
Aug 26 10:20:04 user nova-compute[73572]:   <features>
Aug 26 10:20:04 user nova-compute[73572]:     <acpi/>
Aug 26 10:20:04 user nova-compute[73572]:     <apic/>
Aug 26 10:20:04 user nova-compute[73572]:     <vmcoreinfo/>
Aug 26 10:20:04 user nova-compute[73572]:   </features>
Aug 26 10:20:04 user nova-compute[73572]:   <clock offset="utc">
Aug 26 10:20:04 user nova-compute[73572]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 10:20:04 user nova-compute[73572]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 10:20:04 user nova-compute[73572]:     <timer name="hpet" present="no"/>
Aug 26 10:20:04 user nova-compute[73572]:   </clock>
Aug 26 10:20:04 user nova-compute[73572]:   <cpu mode="custom" match="exact">
Aug 26 10:20:04 user nova-compute[73572]:     <model>Nehalem</model>
Aug 26 10:20:04 user nova-compute[73572]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 10:20:04 user nova-compute[73572]:   </cpu>
Aug 26 10:20:04 user nova-compute[73572]:   <devices>
Aug 26 10:20:04 user nova-compute[73572]:     <disk type="file" device="disk">
Aug 26 10:20:04 user nova-compute[73572]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 10:20:04 user nova-compute[73572]:       <source file="/opt/stack/data/nova/instances/44a737bf-3704-4193-8d24-b8d132267279/disk"/>
Aug 26 10:20:04 user nova-compute[73572]:       <target dev="vda" bus="virtio"/>
Aug 26 10:20:04 user nova-compute[73572]:     </disk>
Aug 26 10:20:04 user nova-compute[73572]:     <interface type="ethernet">
Aug 26 10:20:04 user nova-compute[73572]:       <mac address="fa:16:3e:6a:ad:a7"/>
Aug 26 10:20:04 user nova-compute[73572]:       <model type="virtio"/>
Aug 26 10:20:04 user nova-compute[73572]:       <mtu size="1442"/>
Aug 26 10:20:04 user nova-compute[73572]:       <target dev="tap4d7425ac-55"/>
Aug 26 10:20:04 user nova-compute[73572]:     </interface>
Aug 26 10:20:04 user nova-compute[73572]:     <serial type="pty">
Aug 26 10:20:04 user nova-compute[73572]:       <log file="/opt/stack/data/nova/instances/44a737bf-3704-4193-8d24-b8d132267279/console.log" append="off"/>
Aug 26 10:20:04 user nova-compute[73572]:     </serial>
Aug 26 10:20:04 user nova-compute[73572]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 10:20:04 user nova-compute[73572]:     <video>
Aug 26 10:20:04 user nova-compute[73572]:       <model type="virtio"/>
Aug 26 10:20:04 user nova-compute[73572]:     </video>
Aug 26 10:20:04 user nova-compute[73572]:     <rng model="virtio">
Aug 26 10:20:04 user nova-compute[73572]:       <backend model="random">/dev/urandom</backend>
Aug 26 10:20:04 user nova-compute[73572]:     </rng>
Aug 26 10:20:04 user nova-compute[73572]:     <controller type="usb" index="0" model="none"/>
Aug 26 10:20:04 user nova-compute[73572]:     <memballoon model="virtio">
Aug 26 10:20:04 user nova-compute[73572]:       <stats period="10"/>
Aug 26 10:20:04 user nova-compute[73572]:     </memballoon>
Aug 26 10:20:04 user nova-compute[73572]:   </devices>
Aug 26 10:20:04 user nova-compute[73572]: </domain>
Aug 26 10:20:04 user nova-compute[73572]:  {{(pid=73572) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 10:20:04 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-becec0e0-0a58-48c8-befb-452f63b4d564 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T10:20:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-78174165',display_name='tempest-AttachVolumeNegativeTest-server-78174165',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-78174165',id=26,image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHAXZXxh5sr9uv0a1z3l3OFMssLWWpYs2ayEFomQLQNkT5c8CXKXyIDQskEkHQQ3c+pAWzGLev6XdCDbdOJGftkfOWSncTYrStZ+JQ3aj7gzNKVMrEoaaTK4q6UEzCUVpA==',key_name='tempest-keypair-1525083416',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='47abd6293c07465389c379e3b5061164',ramdisk_id='',reservation_id='r-etn04ew6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-608798758',owner_user_name='tempest-AttachVolumeNegativeTest-608798758-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T10:20:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c7cf9c8d529d49149141add20c2b2af2',uuid=44a737bf-3704-4193-8d24-b8d132267279,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4d7425ac-5500-4d32-b0db-448d4bd29651", "address": "fa:16:3e:6a:ad:a7", "network": {"id": "880aa066-8f77-469b-a0c4-e4e94ae31e1a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-313654920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47abd6293c07465389c379e3b5061164", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d7425ac-55", "ovs_interfaceid": "4d7425ac-5500-4d32-b0db-448d4bd29651", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 10:20:04 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-becec0e0-0a58-48c8-befb-452f63b4d564 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Converting VIF {"id": "4d7425ac-5500-4d32-b0db-448d4bd29651", "address": "fa:16:3e:6a:ad:a7", "network": {"id": "880aa066-8f77-469b-a0c4-e4e94ae31e1a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-313654920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47abd6293c07465389c379e3b5061164", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d7425ac-55", "ovs_interfaceid": "4d7425ac-5500-4d32-b0db-448d4bd29651", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:20:04 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-becec0e0-0a58-48c8-befb-452f63b4d564 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6a:ad:a7,bridge_name='br-int',has_traffic_filtering=True,id=4d7425ac-5500-4d32-b0db-448d4bd29651,network=Network(880aa066-8f77-469b-a0c4-e4e94ae31e1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d7425ac-55') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:20:04 user nova-compute[73572]: DEBUG os_vif [None req-becec0e0-0a58-48c8-befb-452f63b4d564 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:ad:a7,bridge_name='br-int',has_traffic_filtering=True,id=4d7425ac-5500-4d32-b0db-448d4bd29651,network=Network(880aa066-8f77-469b-a0c4-e4e94ae31e1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d7425ac-55') {{(pid=73572) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 10:20:04 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:20:04 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:20:04 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 10:20:04 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:20:04 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4d7425ac-55, may_exist=True, interface_attrs={}) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:20:04 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4d7425ac-55, col_values=(('external_ids', {'iface-id': '4d7425ac-5500-4d32-b0db-448d4bd29651', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6a:ad:a7', 'vm-uuid': '44a737bf-3704-4193-8d24-b8d132267279'}),), if_exists=True) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:20:04 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:20:04 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:20:04 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:20:04 user nova-compute[73572]: INFO os_vif [None req-becec0e0-0a58-48c8-befb-452f63b4d564 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:ad:a7,bridge_name='br-int',has_traffic_filtering=True,id=4d7425ac-5500-4d32-b0db-448d4bd29651,network=Network(880aa066-8f77-469b-a0c4-e4e94ae31e1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d7425ac-55')
Aug 26 10:20:05 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-becec0e0-0a58-48c8-befb-452f63b4d564 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] No BDM found with device name vda, not building metadata. {{(pid=73572) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 10:20:05 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-becec0e0-0a58-48c8-befb-452f63b4d564 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] No VIF found with MAC fa:16:3e:6a:ad:a7, not building metadata {{(pid=73572) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 10:20:05 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-2873906f-13e4-4858-b75c-73cf8f5f8ec9 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] [instance: 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55] Starting finish_migration {{(pid=73572) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Aug 26 10:20:05 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-2873906f-13e4-4858-b75c-73cf8f5f8ec9 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] [instance: 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55] Instance directory exists: not creating {{(pid=73572) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 26 10:20:05 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-2873906f-13e4-4858-b75c-73cf8f5f8ec9 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] [instance: 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55] Creating image(s)
Aug 26 10:20:05 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-2873906f-13e4-4858-b75c-73cf8f5f8ec9 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:20:05 user nova-compute[73572]: DEBUG nova.network.neutron [req-964ce679-6b60-422b-a5ab-e5e9149aba5a req-9f66ffdc-0caf-4b32-bb1b-2943ed9e920e service nova] [instance: 44a737bf-3704-4193-8d24-b8d132267279] Updated VIF entry in instance network info cache for port 4d7425ac-5500-4d32-b0db-448d4bd29651. {{(pid=73572) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 10:20:05 user nova-compute[73572]: DEBUG nova.network.neutron [req-964ce679-6b60-422b-a5ab-e5e9149aba5a req-9f66ffdc-0caf-4b32-bb1b-2943ed9e920e service nova] [instance: 44a737bf-3704-4193-8d24-b8d132267279] Updating instance_info_cache with network_info: [{"id": "4d7425ac-5500-4d32-b0db-448d4bd29651", "address": "fa:16:3e:6a:ad:a7", "network": {"id": "880aa066-8f77-469b-a0c4-e4e94ae31e1a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-313654920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47abd6293c07465389c379e3b5061164", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d7425ac-55", "ovs_interfaceid": "4d7425ac-5500-4d32-b0db-448d4bd29651", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:20:05 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-964ce679-6b60-422b-a5ab-e5e9149aba5a req-9f66ffdc-0caf-4b32-bb1b-2943ed9e920e service nova] Releasing lock "refresh_cache-44a737bf-3704-4193-8d24-b8d132267279" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:20:05 user nova-compute[73572]: DEBUG nova.network.neutron [None req-6d87a9c0-3c72-40f8-8ac9-def2ceeb0644 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] [instance: 693f562f-ae3d-4cfb-926e-9990a1a301cb] Successfully updated port: 010eed73-8a66-4648-a616-0b9e7441ab1c {{(pid=73572) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 10:20:05 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-6d87a9c0-3c72-40f8-8ac9-def2ceeb0644 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Acquiring lock "refresh_cache-693f562f-ae3d-4cfb-926e-9990a1a301cb" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:20:05 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-6d87a9c0-3c72-40f8-8ac9-def2ceeb0644 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Acquired lock "refresh_cache-693f562f-ae3d-4cfb-926e-9990a1a301cb" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:20:05 user nova-compute[73572]: DEBUG nova.network.neutron [None req-6d87a9c0-3c72-40f8-8ac9-def2ceeb0644 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] [instance: 693f562f-ae3d-4cfb-926e-9990a1a301cb] Building network info cache for instance {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 10:20:05 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-2873906f-13e4-4858-b75c-73cf8f5f8ec9 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json" returned: 0 in 0.188s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:20:05 user nova-compute[73572]: DEBUG nova.virt.disk.api [None req-2873906f-13e4-4858-b75c-73cf8f5f8ec9 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0fe47a17-4ffb-48ce-b0f6-a9b43002bd55/disk. size=21474836480 {{(pid=73572) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 10:20:05 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-2873906f-13e4-4858-b75c-73cf8f5f8ec9 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fe47a17-4ffb-48ce-b0f6-a9b43002bd55/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:20:05 user nova-compute[73572]: DEBUG nova.compute.manager [req-7934e191-19fb-4b9d-a63d-323a9860b19e req-999d82d4-38fe-4249-b932-803e6a9b0558 service nova] [instance: 693f562f-ae3d-4cfb-926e-9990a1a301cb] Received event network-changed-010eed73-8a66-4648-a616-0b9e7441ab1c {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:20:05 user nova-compute[73572]: DEBUG nova.compute.manager [req-7934e191-19fb-4b9d-a63d-323a9860b19e req-999d82d4-38fe-4249-b932-803e6a9b0558 service nova] [instance: 693f562f-ae3d-4cfb-926e-9990a1a301cb] Refreshing instance network info cache due to event network-changed-010eed73-8a66-4648-a616-0b9e7441ab1c. {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 10:20:05 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-7934e191-19fb-4b9d-a63d-323a9860b19e req-999d82d4-38fe-4249-b932-803e6a9b0558 service nova] Acquiring lock "refresh_cache-693f562f-ae3d-4cfb-926e-9990a1a301cb" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:20:05 user nova-compute[73572]: DEBUG nova.network.neutron [None req-6d87a9c0-3c72-40f8-8ac9-def2ceeb0644 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] [instance: 693f562f-ae3d-4cfb-926e-9990a1a301cb] Instance cache missing network info. {{(pid=73572) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 10:20:05 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-2873906f-13e4-4858-b75c-73cf8f5f8ec9 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fe47a17-4ffb-48ce-b0f6-a9b43002bd55/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:20:05 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-2873906f-13e4-4858-b75c-73cf8f5f8ec9 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/0fe47a17-4ffb-48ce-b0f6-a9b43002bd55/disk 21474836480 {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:20:05 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-2873906f-13e4-4858-b75c-73cf8f5f8ec9 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/0fe47a17-4ffb-48ce-b0f6-a9b43002bd55/disk 21474836480" returned: 0 in 0.056s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:20:05 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-2873906f-13e4-4858-b75c-73cf8f5f8ec9 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] [instance: 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55] Did not create local disks {{(pid=73572) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 26 10:20:05 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-2873906f-13e4-4858-b75c-73cf8f5f8ec9 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] [instance: 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55] Ensure instance console log exists: /opt/stack/data/nova/instances/0fe47a17-4ffb-48ce-b0f6-a9b43002bd55/console.log {{(pid=73572) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 10:20:05 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-2873906f-13e4-4858-b75c-73cf8f5f8ec9 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:20:05 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-2873906f-13e4-4858-b75c-73cf8f5f8ec9 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:20:05 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-2873906f-13e4-4858-b75c-73cf8f5f8ec9 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:20:05 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-2873906f-13e4-4858-b75c-73cf8f5f8ec9 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] [instance: 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55] Start _get_guest_xml network_info=[{"id": "ebf9f385-e59b-4060-9bf9-a8d2006327b4", "address": "fa:16:3e:49:23:6a", "network": {"id": "7c89c22a-96d4-4e60-9c4c-b5a82a7eca55", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1976182948-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1976182948-network", "vif_mac": "fa:16:3e:49:23:6a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d2c922711fb445aa99ae4f30b802c12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebf9f385-e5", "ovs_interfaceid": "ebf9f385-e59b-4060-9bf9-a8d2006327b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T10:07:33Z,direct_url=<?>,disk_format='qcow2',id=299da0c9-e1c4-48f0-be55-fbe20dd06bc9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5c995f8bbbab4368b67a253e0df3971a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T10:07:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'guest_format': None, 'size': 0, 'encryption_format': None, 'device_type': 'disk', 'image_id': '299da0c9-e1c4-48f0-be55-fbe20dd06bc9'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'disk_bus': 'virtio', 'boot_index': None, 'mount_device': '/dev/vdb', 'attachment_id': '249a19d4-787e-429b-9cc4-f681bc1a2b12', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:5f3a153b-1b99-4297-ad26-ea58f33330b8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qjvgYBLw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '0fe47a17-4ffb-48ce-b0f6-a9b43002bd55', 'attached_at': '2023-08-26T10:20:05.000000', 'detached_at': '', 'volume_id': '5f3a153b-1b99-4297-ad26-ea58f33330b8', 'serial': '5f3a153b-1b99-4297-ad26-ea58f33330b8'}, 'guest_format': None, 'device_type': 'disk', 'volume_type': None} {{(pid=73572) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 10:20:05 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-2873906f-13e4-4858-b75c-73cf8f5f8ec9 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:20:05 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-2873906f-13e4-4858-b75c-73cf8f5f8ec9 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:20:05 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-2873906f-13e4-4858-b75c-73cf8f5f8ec9 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73572) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 10:20:05 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-2873906f-13e4-4858-b75c-73cf8f5f8ec9 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] CPU controller missing on host. {{(pid=73572) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 10:20:05 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-2873906f-13e4-4858-b75c-73cf8f5f8ec9 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73572) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 10:20:05 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-2873906f-13e4-4858-b75c-73cf8f5f8ec9 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] CPU controller found on host. {{(pid=73572) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 10:20:05 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-2873906f-13e4-4858-b75c-73cf8f5f8ec9 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73572) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 10:20:05 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-2873906f-13e4-4858-b75c-73cf8f5f8ec9 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T10:07:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T10:07:33Z,direct_url=<?>,disk_format='qcow2',id=299da0c9-e1c4-48f0-be55-fbe20dd06bc9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5c995f8bbbab4368b67a253e0df3971a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T10:07:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 10:20:05 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-2873906f-13e4-4858-b75c-73cf8f5f8ec9 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Flavor limits 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 10:20:05 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-2873906f-13e4-4858-b75c-73cf8f5f8ec9 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Image limits 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 10:20:05 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-2873906f-13e4-4858-b75c-73cf8f5f8ec9 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Flavor pref 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 10:20:05 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-2873906f-13e4-4858-b75c-73cf8f5f8ec9 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Image pref 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 10:20:05 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-2873906f-13e4-4858-b75c-73cf8f5f8ec9 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 10:20:05 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-2873906f-13e4-4858-b75c-73cf8f5f8ec9 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 10:20:05 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-2873906f-13e4-4858-b75c-73cf8f5f8ec9 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73572) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 10:20:05 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-2873906f-13e4-4858-b75c-73cf8f5f8ec9 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Got 1 possible topologies {{(pid=73572) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 10:20:05 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-2873906f-13e4-4858-b75c-73cf8f5f8ec9 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 10:20:05 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-2873906f-13e4-4858-b75c-73cf8f5f8ec9 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 10:20:05 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2873906f-13e4-4858-b75c-73cf8f5f8ec9 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] [instance: 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55] Calling os-brick to attach iSCSI Volume {{(pid=73572) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 10:20:05 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-2873906f-13e4-4858-b75c-73cf8f5f8ec9 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc89c3d6a10>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:5f3a153b-1b99-4297-ad26-ea58f33330b8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qjvgYBLw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 10:20:05 user nova-compute[73572]: WARNING os_brick.initiator.connectors.base [None req-2873906f-13e4-4858-b75c-73cf8f5f8ec9 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 10:20:05 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-2873906f-13e4-4858-b75c-73cf8f5f8ec9 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 10:20:05 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-2873906f-13e4-4858-b75c-73cf8f5f8ec9 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 10:20:05 user nova-compute[73572]: WARNING os_brick.initiator.connectors.base [None req-2873906f-13e4-4858-b75c-73cf8f5f8ec9 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 10:20:05 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-2873906f-13e4-4858-b75c-73cf8f5f8ec9 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5f3a153b-1b99-4297-ad26-ea58f33330b8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 10:20:05 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-2873906f-13e4-4858-b75c-73cf8f5f8ec9 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5f3a153b-1b99-4297-ad26-ea58f33330b8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 10:20:05 user nova-compute[73572]: INFO os_brick.initiator.connectors.iscsi [None req-2873906f-13e4-4858-b75c-73cf8f5f8ec9 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 10:20:05 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f3a153b-1b99-4297-ad26-ea58f33330b8 -p 172.16.0.220:3260 {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:20:05 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f3a153b-1b99-4297-ad26-ea58f33330b8 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:20:05 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e05a3f8-1e32-48af-a5aa-a170cb40464c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:20:05 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-2873906f-13e4-4858-b75c-73cf8f5f8ec9 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 10:20:05 user nova-compute[73572]:  {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:20:05 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f3a153b-1b99-4297-ad26-ea58f33330b8 -p 172.16.0.220:3260 --interface default --op new {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:20:05 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f3a153b-1b99-4297-ad26-ea58f33330b8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:20:05 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff503495-f1e1-4879-b2fc-73183ec87b6b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5f3a153b-1b99-4297-ad26-ea58f33330b8] added\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:20:05 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-2873906f-13e4-4858-b75c-73cf8f5f8ec9 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5f3a153b-1b99-4297-ad26-ea58f33330b8] added
Aug 26 10:20:05 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:20:05 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f3a153b-1b99-4297-ad26-ea58f33330b8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:20:05 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f3a153b-1b99-4297-ad26-ea58f33330b8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:20:05 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc1d25bb-0913-48ba-9797-dd17b1415114]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:20:05 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-2873906f-13e4-4858-b75c-73cf8f5f8ec9 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:20:05 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f3a153b-1b99-4297-ad26-ea58f33330b8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:20:05 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f3a153b-1b99-4297-ad26-ea58f33330b8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:20:05 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[16bec5ca-2435-435c-bd93-afee7b07c3ad]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:20:05 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-2873906f-13e4-4858-b75c-73cf8f5f8ec9 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:20:05 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f3a153b-1b99-4297-ad26-ea58f33330b8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qjvgYBLw {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:20:05 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f3a153b-1b99-4297-ad26-ea58f33330b8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qjvgYBLw" returned: 0 in 0.017s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:20:05 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a0cc6d8-7fd0-49c7-9ba6-804496006218]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:20:05 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-2873906f-13e4-4858-b75c-73cf8f5f8ec9 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qjvgYBLw'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:20:05 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f3a153b-1b99-4297-ad26-ea58f33330b8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:20:05 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f3a153b-1b99-4297-ad26-ea58f33330b8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:20:05 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0b31ff2-546a-460f-968c-0c5ba749bc02]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:20:05 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-2873906f-13e4-4858-b75c-73cf8f5f8ec9 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:20:05 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:20:05 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:20:05 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[26086168-8a57-49e0-b90f-b05ae685ed44]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:302c3cfe-f0ec-4b1c-b1d9-dc12d4f4ce40 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478 (non-flash)\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:20:05 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-2873906f-13e4-4858-b75c-73cf8f5f8ec9 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)
Aug 26 10:20:05 user nova-compute[73572]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:302c3cfe-f0ec-4b1c-b1d9-dc12d4f4ce40 (non-flash)
Aug 26 10:20:05 user nova-compute[73572]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478 (non-flash)
Aug 26 10:20:05 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 10:20:05 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-2873906f-13e4-4858-b75c-73cf8f5f8ec9 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)
Aug 26 10:20:05 user nova-compute[73572]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:302c3cfe-f0ec-4b1c-b1d9-dc12d4f4ce40 (non-flash)
Aug 26 10:20:05 user nova-compute[73572]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478 (non-flash)
Aug 26 10:20:05 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 10:20:05 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f3a153b-1b99-4297-ad26-ea58f33330b8 -p 172.16.0.220:3260 --login {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:20:06 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f3a153b-1b99-4297-ad26-ea58f33330b8 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:20:06 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[debf6b37-98bc-485a-9553-7d34816f52b5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5f3a153b-1b99-4297-ad26-ea58f33330b8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5f3a153b-1b99-4297-ad26-ea58f33330b8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:20:06 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-2873906f-13e4-4858-b75c-73cf8f5f8ec9 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5f3a153b-1b99-4297-ad26-ea58f33330b8, portal: 172.16.0.220,3260]
Aug 26 10:20:06 user nova-compute[73572]: Login to [iface: default, target: iqn.2010-10.org.openstack:5f3a153b-1b99-4297-ad26-ea58f33330b8, portal: 172.16.0.220,3260] successful.
Aug 26 10:20:06 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:20:06 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f3a153b-1b99-4297-ad26-ea58f33330b8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:20:06 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f3a153b-1b99-4297-ad26-ea58f33330b8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:20:06 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[562948e0-94e0-4308-a70e-261672516756]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:20:06 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-2873906f-13e4-4858-b75c-73cf8f5f8ec9 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:20:06 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:20:06 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:20:06 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[88315f8c-30dc-435f-9f8a-74f3fa5a747f]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:302c3cfe-f0ec-4b1c-b1d9-dc12d4f4ce40 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f3a153b-1b99-4297-ad26-ea58f33330b8 (non-flash)\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:20:06 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-2873906f-13e4-4858-b75c-73cf8f5f8ec9 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)
Aug 26 10:20:06 user nova-compute[73572]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:302c3cfe-f0ec-4b1c-b1d9-dc12d4f4ce40 (non-flash)
Aug 26 10:20:06 user nova-compute[73572]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478 (non-flash)
Aug 26 10:20:06 user nova-compute[73572]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f3a153b-1b99-4297-ad26-ea58f33330b8 (non-flash)
Aug 26 10:20:06 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 10:20:06 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-2873906f-13e4-4858-b75c-73cf8f5f8ec9 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)
Aug 26 10:20:06 user nova-compute[73572]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:302c3cfe-f0ec-4b1c-b1d9-dc12d4f4ce40 (non-flash)
Aug 26 10:20:06 user nova-compute[73572]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478 (non-flash)
Aug 26 10:20:06 user nova-compute[73572]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f3a153b-1b99-4297-ad26-ea58f33330b8 (non-flash)
Aug 26 10:20:06 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 10:20:06 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-2873906f-13e4-4858-b75c-73cf8f5f8ec9 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5f3a153b-1b99-4297-ad26-ea58f33330b8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.290s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 10:20:06 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-2873906f-13e4-4858-b75c-73cf8f5f8ec9 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Connected to 172.16.0.220:3260 {{(pid=73572) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 10:20:06 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-2873906f-13e4-4858-b75c-73cf8f5f8ec9 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] HCTL ('34', '-', '-', 0) found on session 27 with lun 0 {{(pid=73572) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 10:20:06 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-2873906f-13e4-4858-b75c-73cf8f5f8ec9 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73572) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 10:20:06 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:20:06 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:20:06 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c168693-9493-463f-b83c-ac532d836c43]: (4, ('- - 0', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:20:06 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-2873906f-13e4-4858-b75c-73cf8f5f8ec9 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Searching for a device in session 27 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73572) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 10:20:06 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-2873906f-13e4-4858-b75c-73cf8f5f8ec9 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qjvgYBLw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73572) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 10:20:06 user nova-compute[73572]: DEBUG nova.network.neutron [None req-6d87a9c0-3c72-40f8-8ac9-def2ceeb0644 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] [instance: 693f562f-ae3d-4cfb-926e-9990a1a301cb] Updating instance_info_cache with network_info: [{"id": "010eed73-8a66-4648-a616-0b9e7441ab1c", "address": "fa:16:3e:f7:66:5e", "network": {"id": "146a7a16-6dfd-48bd-8c96-766bdbe89bed", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-631761752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84e33d9ef6ec45709135edc20c8d7720", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap010eed73-8a", "ovs_interfaceid": "010eed73-8a66-4648-a616-0b9e7441ab1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:20:06 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-6d87a9c0-3c72-40f8-8ac9-def2ceeb0644 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Releasing lock "refresh_cache-693f562f-ae3d-4cfb-926e-9990a1a301cb" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:20:06 user nova-compute[73572]: DEBUG nova.compute.manager [None req-6d87a9c0-3c72-40f8-8ac9-def2ceeb0644 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] [instance: 693f562f-ae3d-4cfb-926e-9990a1a301cb] Instance network_info: |[{"id": "010eed73-8a66-4648-a616-0b9e7441ab1c", "address": "fa:16:3e:f7:66:5e", "network": {"id": "146a7a16-6dfd-48bd-8c96-766bdbe89bed", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-631761752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84e33d9ef6ec45709135edc20c8d7720", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap010eed73-8a", "ovs_interfaceid": "010eed73-8a66-4648-a616-0b9e7441ab1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73572) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 10:20:06 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-7934e191-19fb-4b9d-a63d-323a9860b19e req-999d82d4-38fe-4249-b932-803e6a9b0558 service nova] Acquired lock "refresh_cache-693f562f-ae3d-4cfb-926e-9990a1a301cb" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:20:06 user nova-compute[73572]: DEBUG nova.network.neutron [req-7934e191-19fb-4b9d-a63d-323a9860b19e req-999d82d4-38fe-4249-b932-803e6a9b0558 service nova] [instance: 693f562f-ae3d-4cfb-926e-9990a1a301cb] Refreshing network info cache for port 010eed73-8a66-4648-a616-0b9e7441ab1c {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 10:20:06 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-6d87a9c0-3c72-40f8-8ac9-def2ceeb0644 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] [instance: 693f562f-ae3d-4cfb-926e-9990a1a301cb] Start _get_guest_xml network_info=[{"id": "010eed73-8a66-4648-a616-0b9e7441ab1c", "address": "fa:16:3e:f7:66:5e", "network": {"id": "146a7a16-6dfd-48bd-8c96-766bdbe89bed", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-631761752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84e33d9ef6ec45709135edc20c8d7720", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap010eed73-8a", "ovs_interfaceid": "010eed73-8a66-4648-a616-0b9e7441ab1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T10:07:33Z,direct_url=<?>,disk_format='qcow2',id=299da0c9-e1c4-48f0-be55-fbe20dd06bc9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5c995f8bbbab4368b67a253e0df3971a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T10:07:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'guest_format': None, 'size': 0, 'encryption_format': None, 'device_type': 'disk', 'image_id': '299da0c9-e1c4-48f0-be55-fbe20dd06bc9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73572) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 10:20:06 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-6d87a9c0-3c72-40f8-8ac9-def2ceeb0644 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:20:06 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-6d87a9c0-3c72-40f8-8ac9-def2ceeb0644 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:20:06 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-6d87a9c0-3c72-40f8-8ac9-def2ceeb0644 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73572) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 10:20:06 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-6d87a9c0-3c72-40f8-8ac9-def2ceeb0644 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] CPU controller missing on host. {{(pid=73572) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 10:20:06 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-6d87a9c0-3c72-40f8-8ac9-def2ceeb0644 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73572) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 10:20:06 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-6d87a9c0-3c72-40f8-8ac9-def2ceeb0644 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] CPU controller found on host. {{(pid=73572) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 10:20:06 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-6d87a9c0-3c72-40f8-8ac9-def2ceeb0644 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73572) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 10:20:06 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-6d87a9c0-3c72-40f8-8ac9-def2ceeb0644 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T10:07:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T10:07:33Z,direct_url=<?>,disk_format='qcow2',id=299da0c9-e1c4-48f0-be55-fbe20dd06bc9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5c995f8bbbab4368b67a253e0df3971a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T10:07:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 10:20:06 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-6d87a9c0-3c72-40f8-8ac9-def2ceeb0644 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Flavor limits 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 10:20:06 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-6d87a9c0-3c72-40f8-8ac9-def2ceeb0644 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Image limits 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 10:20:06 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-6d87a9c0-3c72-40f8-8ac9-def2ceeb0644 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Flavor pref 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 10:20:06 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-6d87a9c0-3c72-40f8-8ac9-def2ceeb0644 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Image pref 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 10:20:06 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-6d87a9c0-3c72-40f8-8ac9-def2ceeb0644 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 10:20:06 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-6d87a9c0-3c72-40f8-8ac9-def2ceeb0644 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 10:20:06 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-6d87a9c0-3c72-40f8-8ac9-def2ceeb0644 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73572) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 10:20:06 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-6d87a9c0-3c72-40f8-8ac9-def2ceeb0644 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Got 1 possible topologies {{(pid=73572) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 10:20:06 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-6d87a9c0-3c72-40f8-8ac9-def2ceeb0644 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 10:20:06 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-6d87a9c0-3c72-40f8-8ac9-def2ceeb0644 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 10:20:06 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-6d87a9c0-3c72-40f8-8ac9-def2ceeb0644 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T10:20:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1093763151',display_name='tempest-VolumesSnapshotTestJSON-instance-1093763151',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1093763151',id=27,image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFwm+NjwvlqBsOW7bfl3V2IP/iLmBVWZkppxS5mFMzUHsXvhtjpSG9D8dHVliyOjXqPtpqOOmWZQWqWtF9qI02xKqDgcgqtSbla+oOsPk3fQ6LAPix+dIcsadoNImq5NCA==',key_name='tempest-keypair-694759692',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='84e33d9ef6ec45709135edc20c8d7720',ramdisk_id='',reservation_id='r-twq9y5fa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-760064238',owner_user_name='tempest-VolumesSnapshotTestJSON-760064238-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T10:20:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='60fb7b6cd1d14b2ea2e4ab806642e230',uuid=693f562f-ae3d-4cfb-926e-9990a1a301cb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "010eed73-8a66-4648-a616-0b9e7441ab1c", "address": "fa:16:3e:f7:66:5e", "network": {"id": "146a7a16-6dfd-48bd-8c96-766bdbe89bed", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-631761752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84e33d9ef6ec45709135edc20c8d7720", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap010eed73-8a", "ovs_interfaceid": "010eed73-8a66-4648-a616-0b9e7441ab1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73572) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 10:20:06 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-6d87a9c0-3c72-40f8-8ac9-def2ceeb0644 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Converting VIF {"id": "010eed73-8a66-4648-a616-0b9e7441ab1c", "address": "fa:16:3e:f7:66:5e", "network": {"id": "146a7a16-6dfd-48bd-8c96-766bdbe89bed", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-631761752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84e33d9ef6ec45709135edc20c8d7720", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap010eed73-8a", "ovs_interfaceid": "010eed73-8a66-4648-a616-0b9e7441ab1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:20:06 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-6d87a9c0-3c72-40f8-8ac9-def2ceeb0644 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f7:66:5e,bridge_name='br-int',has_traffic_filtering=True,id=010eed73-8a66-4648-a616-0b9e7441ab1c,network=Network(146a7a16-6dfd-48bd-8c96-766bdbe89bed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap010eed73-8a') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:20:06 user nova-compute[73572]: DEBUG nova.objects.instance [None req-6d87a9c0-3c72-40f8-8ac9-def2ceeb0644 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Lazy-loading 'pci_devices' on Instance uuid 693f562f-ae3d-4cfb-926e-9990a1a301cb {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:20:06 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-6d87a9c0-3c72-40f8-8ac9-def2ceeb0644 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] [instance: 693f562f-ae3d-4cfb-926e-9990a1a301cb] End _get_guest_xml xml=<domain type="kvm">
Aug 26 10:20:06 user nova-compute[73572]:   <uuid>693f562f-ae3d-4cfb-926e-9990a1a301cb</uuid>
Aug 26 10:20:06 user nova-compute[73572]:   <name>instance-0000001b</name>
Aug 26 10:20:06 user nova-compute[73572]:   <memory>524288</memory>
Aug 26 10:20:06 user nova-compute[73572]:   <vcpu>1</vcpu>
Aug 26 10:20:06 user nova-compute[73572]:   <metadata>
Aug 26 10:20:06 user nova-compute[73572]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 10:20:06 user nova-compute[73572]:       <nova:package version="0.0.0"/>
Aug 26 10:20:06 user nova-compute[73572]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1093763151</nova:name>
Aug 26 10:20:06 user nova-compute[73572]:       <nova:creationTime>2023-08-26 10:20:06</nova:creationTime>
Aug 26 10:20:06 user nova-compute[73572]:       <nova:flavor name="m1.tiny">
Aug 26 10:20:06 user nova-compute[73572]:         <nova:memory>512</nova:memory>
Aug 26 10:20:06 user nova-compute[73572]:         <nova:disk>1</nova:disk>
Aug 26 10:20:06 user nova-compute[73572]:         <nova:swap>0</nova:swap>
Aug 26 10:20:06 user nova-compute[73572]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 10:20:06 user nova-compute[73572]:         <nova:vcpus>1</nova:vcpus>
Aug 26 10:20:06 user nova-compute[73572]:       </nova:flavor>
Aug 26 10:20:06 user nova-compute[73572]:       <nova:owner>
Aug 26 10:20:06 user nova-compute[73572]:         <nova:user uuid="60fb7b6cd1d14b2ea2e4ab806642e230">tempest-VolumesSnapshotTestJSON-760064238-project-member</nova:user>
Aug 26 10:20:06 user nova-compute[73572]:         <nova:project uuid="84e33d9ef6ec45709135edc20c8d7720">tempest-VolumesSnapshotTestJSON-760064238</nova:project>
Aug 26 10:20:06 user nova-compute[73572]:       </nova:owner>
Aug 26 10:20:06 user nova-compute[73572]:       <nova:root type="image" uuid="299da0c9-e1c4-48f0-be55-fbe20dd06bc9"/>
Aug 26 10:20:06 user nova-compute[73572]:       <nova:ports>
Aug 26 10:20:06 user nova-compute[73572]:         <nova:port uuid="010eed73-8a66-4648-a616-0b9e7441ab1c">
Aug 26 10:20:06 user nova-compute[73572]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 26 10:20:06 user nova-compute[73572]:         </nova:port>
Aug 26 10:20:06 user nova-compute[73572]:       </nova:ports>
Aug 26 10:20:06 user nova-compute[73572]:     </nova:instance>
Aug 26 10:20:06 user nova-compute[73572]:   </metadata>
Aug 26 10:20:06 user nova-compute[73572]:   <sysinfo type="smbios">
Aug 26 10:20:06 user nova-compute[73572]:     <system>
Aug 26 10:20:06 user nova-compute[73572]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 10:20:06 user nova-compute[73572]:       <entry name="product">OpenStack Nova</entry>
Aug 26 10:20:06 user nova-compute[73572]:       <entry name="version">0.0.0</entry>
Aug 26 10:20:06 user nova-compute[73572]:       <entry name="serial">693f562f-ae3d-4cfb-926e-9990a1a301cb</entry>
Aug 26 10:20:06 user nova-compute[73572]:       <entry name="uuid">693f562f-ae3d-4cfb-926e-9990a1a301cb</entry>
Aug 26 10:20:06 user nova-compute[73572]:       <entry name="family">Virtual Machine</entry>
Aug 26 10:20:06 user nova-compute[73572]:     </system>
Aug 26 10:20:06 user nova-compute[73572]:   </sysinfo>
Aug 26 10:20:06 user nova-compute[73572]:   <os>
Aug 26 10:20:06 user nova-compute[73572]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 10:20:06 user nova-compute[73572]:     <boot dev="hd"/>
Aug 26 10:20:06 user nova-compute[73572]:     <smbios mode="sysinfo"/>
Aug 26 10:20:06 user nova-compute[73572]:   </os>
Aug 26 10:20:06 user nova-compute[73572]:   <features>
Aug 26 10:20:06 user nova-compute[73572]:     <acpi/>
Aug 26 10:20:06 user nova-compute[73572]:     <apic/>
Aug 26 10:20:06 user nova-compute[73572]:     <vmcoreinfo/>
Aug 26 10:20:06 user nova-compute[73572]:   </features>
Aug 26 10:20:06 user nova-compute[73572]:   <clock offset="utc">
Aug 26 10:20:06 user nova-compute[73572]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 10:20:06 user nova-compute[73572]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 10:20:06 user nova-compute[73572]:     <timer name="hpet" present="no"/>
Aug 26 10:20:06 user nova-compute[73572]:   </clock>
Aug 26 10:20:06 user nova-compute[73572]:   <cpu mode="custom" match="exact">
Aug 26 10:20:06 user nova-compute[73572]:     <model>Nehalem</model>
Aug 26 10:20:06 user nova-compute[73572]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 10:20:06 user nova-compute[73572]:   </cpu>
Aug 26 10:20:06 user nova-compute[73572]:   <devices>
Aug 26 10:20:06 user nova-compute[73572]:     <disk type="file" device="disk">
Aug 26 10:20:06 user nova-compute[73572]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 10:20:06 user nova-compute[73572]:       <source file="/opt/stack/data/nova/instances/693f562f-ae3d-4cfb-926e-9990a1a301cb/disk"/>
Aug 26 10:20:06 user nova-compute[73572]:       <target dev="vda" bus="virtio"/>
Aug 26 10:20:06 user nova-compute[73572]:     </disk>
Aug 26 10:20:06 user nova-compute[73572]:     <interface type="ethernet">
Aug 26 10:20:06 user nova-compute[73572]:       <mac address="fa:16:3e:f7:66:5e"/>
Aug 26 10:20:06 user nova-compute[73572]:       <model type="virtio"/>
Aug 26 10:20:06 user nova-compute[73572]:       <mtu size="1442"/>
Aug 26 10:20:06 user nova-compute[73572]:       <target dev="tap010eed73-8a"/>
Aug 26 10:20:06 user nova-compute[73572]:     </interface>
Aug 26 10:20:06 user nova-compute[73572]:     <serial type="pty">
Aug 26 10:20:06 user nova-compute[73572]:       <log file="/opt/stack/data/nova/instances/693f562f-ae3d-4cfb-926e-9990a1a301cb/console.log" append="off"/>
Aug 26 10:20:06 user nova-compute[73572]:     </serial>
Aug 26 10:20:06 user nova-compute[73572]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 10:20:06 user nova-compute[73572]:     <video>
Aug 26 10:20:06 user nova-compute[73572]:       <model type="virtio"/>
Aug 26 10:20:06 user nova-compute[73572]:     </video>
Aug 26 10:20:06 user nova-compute[73572]:     <rng model="virtio">
Aug 26 10:20:06 user nova-compute[73572]:       <backend model="random">/dev/urandom</backend>
Aug 26 10:20:06 user nova-compute[73572]:     </rng>
Aug 26 10:20:06 user nova-compute[73572]:     <controller type="usb" index="0" model="none"/>
Aug 26 10:20:06 user nova-compute[73572]:     <memballoon model="virtio">
Aug 26 10:20:06 user nova-compute[73572]:       <stats period="10"/>
Aug 26 10:20:06 user nova-compute[73572]:     </memballoon>
Aug 26 10:20:06 user nova-compute[73572]:   </devices>
Aug 26 10:20:06 user nova-compute[73572]: </domain>
Aug 26 10:20:06 user nova-compute[73572]:  {{(pid=73572) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 10:20:06 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-6d87a9c0-3c72-40f8-8ac9-def2ceeb0644 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T10:20:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1093763151',display_name='tempest-VolumesSnapshotTestJSON-instance-1093763151',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1093763151',id=27,image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFwm+NjwvlqBsOW7bfl3V2IP/iLmBVWZkppxS5mFMzUHsXvhtjpSG9D8dHVliyOjXqPtpqOOmWZQWqWtF9qI02xKqDgcgqtSbla+oOsPk3fQ6LAPix+dIcsadoNImq5NCA==',key_name='tempest-keypair-694759692',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='84e33d9ef6ec45709135edc20c8d7720',ramdisk_id='',reservation_id='r-twq9y5fa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-760064238',owner_user_name='tempest-VolumesSnapshotTestJSON-760064238-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T10:20:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='60fb7b6cd1d14b2ea2e4ab806642e230',uuid=693f562f-ae3d-4cfb-926e-9990a1a301cb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "010eed73-8a66-4648-a616-0b9e7441ab1c", "address": "fa:16:3e:f7:66:5e", "network": {"id": "146a7a16-6dfd-48bd-8c96-766bdbe89bed", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-631761752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84e33d9ef6ec45709135edc20c8d7720", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap010eed73-8a", "ovs_interfaceid": "010eed73-8a66-4648-a616-0b9e7441ab1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 10:20:06 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-6d87a9c0-3c72-40f8-8ac9-def2ceeb0644 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Converting VIF {"id": "010eed73-8a66-4648-a616-0b9e7441ab1c", "address": "fa:16:3e:f7:66:5e", "network": {"id": "146a7a16-6dfd-48bd-8c96-766bdbe89bed", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-631761752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84e33d9ef6ec45709135edc20c8d7720", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap010eed73-8a", "ovs_interfaceid": "010eed73-8a66-4648-a616-0b9e7441ab1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:20:06 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-6d87a9c0-3c72-40f8-8ac9-def2ceeb0644 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f7:66:5e,bridge_name='br-int',has_traffic_filtering=True,id=010eed73-8a66-4648-a616-0b9e7441ab1c,network=Network(146a7a16-6dfd-48bd-8c96-766bdbe89bed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap010eed73-8a') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:20:06 user nova-compute[73572]: DEBUG os_vif [None req-6d87a9c0-3c72-40f8-8ac9-def2ceeb0644 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:66:5e,bridge_name='br-int',has_traffic_filtering=True,id=010eed73-8a66-4648-a616-0b9e7441ab1c,network=Network(146a7a16-6dfd-48bd-8c96-766bdbe89bed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap010eed73-8a') {{(pid=73572) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 10:20:06 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:20:06 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:20:06 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 10:20:06 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:20:06 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap010eed73-8a, may_exist=True, interface_attrs={}) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:20:06 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap010eed73-8a, col_values=(('external_ids', {'iface-id': '010eed73-8a66-4648-a616-0b9e7441ab1c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f7:66:5e', 'vm-uuid': '693f562f-ae3d-4cfb-926e-9990a1a301cb'}),), if_exists=True) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:20:06 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:20:06 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:20:06 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:20:06 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:20:06 user nova-compute[73572]: INFO os_vif [None req-6d87a9c0-3c72-40f8-8ac9-def2ceeb0644 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:66:5e,bridge_name='br-int',has_traffic_filtering=True,id=010eed73-8a66-4648-a616-0b9e7441ab1c,network=Network(146a7a16-6dfd-48bd-8c96-766bdbe89bed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap010eed73-8a')
Aug 26 10:20:06 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:20:06 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:20:06 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-6d87a9c0-3c72-40f8-8ac9-def2ceeb0644 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] No BDM found with device name vda, not building metadata. {{(pid=73572) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 10:20:06 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-6d87a9c0-3c72-40f8-8ac9-def2ceeb0644 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] No VIF found with MAC fa:16:3e:f7:66:5e, not building metadata {{(pid=73572) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 10:20:06 user nova-compute[73572]: DEBUG nova.compute.manager [req-8b64e240-0c41-4fa1-a3a7-09150659cea4 req-886e19f2-e8c5-4285-8a7d-8a2e0d32c2dd service nova] [instance: 44a737bf-3704-4193-8d24-b8d132267279] Received event network-vif-plugged-4d7425ac-5500-4d32-b0db-448d4bd29651 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:20:06 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-8b64e240-0c41-4fa1-a3a7-09150659cea4 req-886e19f2-e8c5-4285-8a7d-8a2e0d32c2dd service nova] Acquiring lock "44a737bf-3704-4193-8d24-b8d132267279-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:20:06 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-8b64e240-0c41-4fa1-a3a7-09150659cea4 req-886e19f2-e8c5-4285-8a7d-8a2e0d32c2dd service nova] Lock "44a737bf-3704-4193-8d24-b8d132267279-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:20:06 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-8b64e240-0c41-4fa1-a3a7-09150659cea4 req-886e19f2-e8c5-4285-8a7d-8a2e0d32c2dd service nova] Lock "44a737bf-3704-4193-8d24-b8d132267279-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:20:06 user nova-compute[73572]: DEBUG nova.compute.manager [req-8b64e240-0c41-4fa1-a3a7-09150659cea4 req-886e19f2-e8c5-4285-8a7d-8a2e0d32c2dd service nova] [instance: 44a737bf-3704-4193-8d24-b8d132267279] No waiting events found dispatching network-vif-plugged-4d7425ac-5500-4d32-b0db-448d4bd29651 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:20:06 user nova-compute[73572]: WARNING nova.compute.manager [req-8b64e240-0c41-4fa1-a3a7-09150659cea4 req-886e19f2-e8c5-4285-8a7d-8a2e0d32c2dd service nova] [instance: 44a737bf-3704-4193-8d24-b8d132267279] Received unexpected event network-vif-plugged-4d7425ac-5500-4d32-b0db-448d4bd29651 for instance with vm_state building and task_state spawning.
Aug 26 10:20:06 user nova-compute[73572]: DEBUG nova.network.neutron [req-7934e191-19fb-4b9d-a63d-323a9860b19e req-999d82d4-38fe-4249-b932-803e6a9b0558 service nova] [instance: 693f562f-ae3d-4cfb-926e-9990a1a301cb] Updated VIF entry in instance network info cache for port 010eed73-8a66-4648-a616-0b9e7441ab1c. {{(pid=73572) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 10:20:06 user nova-compute[73572]: DEBUG nova.network.neutron [req-7934e191-19fb-4b9d-a63d-323a9860b19e req-999d82d4-38fe-4249-b932-803e6a9b0558 service nova] [instance: 693f562f-ae3d-4cfb-926e-9990a1a301cb] Updating instance_info_cache with network_info: [{"id": "010eed73-8a66-4648-a616-0b9e7441ab1c", "address": "fa:16:3e:f7:66:5e", "network": {"id": "146a7a16-6dfd-48bd-8c96-766bdbe89bed", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-631761752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84e33d9ef6ec45709135edc20c8d7720", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap010eed73-8a", "ovs_interfaceid": "010eed73-8a66-4648-a616-0b9e7441ab1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:20:06 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-7934e191-19fb-4b9d-a63d-323a9860b19e req-999d82d4-38fe-4249-b932-803e6a9b0558 service nova] Releasing lock "refresh_cache-693f562f-ae3d-4cfb-926e-9990a1a301cb" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:20:07 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:20:07 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:20:07 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:20:07 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-2873906f-13e4-4858-b75c-73cf8f5f8ec9 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.322s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 10:20:07 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-2873906f-13e4-4858-b75c-73cf8f5f8ec9 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] <== connect_volume: return (1323ms) {'type': 'block', 'scsi_wwn': '23835633333663462', 'path': '/dev/sdc'} {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 10:20:07 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2873906f-13e4-4858-b75c-73cf8f5f8ec9 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] [instance: 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23835633333663462', 'path': '/dev/sdc'} {{(pid=73572) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 10:20:07 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:20:07 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-2873906f-13e4-4858-b75c-73cf8f5f8ec9 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T10:15:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-220365578',display_name='tempest-ServerActionsTestOtherB-server-220365578',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-220365578',id=17,image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNpUMyiGXRzsPFYrzC1k+DPeAQeFXKXREu1ci6G2S65T1Gci+/hLSOFjcdBoLqgENyI+7/uwXL8y2F/F10thQC08ST7hXeII35W/K66MHhxc0L254FUOJIzPARZXOsUESA==',key_name='tempest-keypair-2095276623',keypairs=<?>,launch_index=0,launched_at=2023-08-26T10:15:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='0d2c922711fb445aa99ae4f30b802c12',ramdisk_id='',reservation_id='r-ktz04i2y',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1806914349',owner_user_name='tempest-ServerActionsTestOtherB-1806914349-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T10:19:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0ee7e4a9f7db476eb9f16440c6b8e37e',uuid=0fe47a17-4ffb-48ce-b0f6-a9b43002bd55,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ebf9f385-e59b-4060-9bf9-a8d2006327b4", "address": "fa:16:3e:49:23:6a", "network": {"id": "7c89c22a-96d4-4e60-9c4c-b5a82a7eca55", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1976182948-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1976182948-network", "vif_mac": "fa:16:3e:49:23:6a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d2c922711fb445aa99ae4f30b802c12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebf9f385-e5", "ovs_interfaceid": "ebf9f385-e59b-4060-9bf9-a8d2006327b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73572) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 10:20:07 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-2873906f-13e4-4858-b75c-73cf8f5f8ec9 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Converting VIF {"id": "ebf9f385-e59b-4060-9bf9-a8d2006327b4", "address": "fa:16:3e:49:23:6a", "network": {"id": "7c89c22a-96d4-4e60-9c4c-b5a82a7eca55", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1976182948-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1976182948-network", "vif_mac": "fa:16:3e:49:23:6a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d2c922711fb445aa99ae4f30b802c12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebf9f385-e5", "ovs_interfaceid": "ebf9f385-e59b-4060-9bf9-a8d2006327b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:20:07 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-2873906f-13e4-4858-b75c-73cf8f5f8ec9 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:49:23:6a,bridge_name='br-int',has_traffic_filtering=True,id=ebf9f385-e59b-4060-9bf9-a8d2006327b4,network=Network(7c89c22a-96d4-4e60-9c4c-b5a82a7eca55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebf9f385-e5') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:20:07 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-2873906f-13e4-4858-b75c-73cf8f5f8ec9 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] [instance: 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55] End _get_guest_xml xml=<domain type="kvm">
Aug 26 10:20:07 user nova-compute[73572]:   <uuid>0fe47a17-4ffb-48ce-b0f6-a9b43002bd55</uuid>
Aug 26 10:20:07 user nova-compute[73572]:   <name>instance-00000011</name>
Aug 26 10:20:07 user nova-compute[73572]:   <memory>2097152</memory>
Aug 26 10:20:07 user nova-compute[73572]:   <vcpu>1</vcpu>
Aug 26 10:20:07 user nova-compute[73572]:   <metadata>
Aug 26 10:20:07 user nova-compute[73572]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 10:20:07 user nova-compute[73572]:       <nova:package version="0.0.0"/>
Aug 26 10:20:07 user nova-compute[73572]:       <nova:name>tempest-ServerActionsTestOtherB-server-220365578</nova:name>
Aug 26 10:20:07 user nova-compute[73572]:       <nova:creationTime>2023-08-26 10:20:05</nova:creationTime>
Aug 26 10:20:07 user nova-compute[73572]:       <nova:flavor name="m1.small">
Aug 26 10:20:07 user nova-compute[73572]:         <nova:memory>2048</nova:memory>
Aug 26 10:20:07 user nova-compute[73572]:         <nova:disk>20</nova:disk>
Aug 26 10:20:07 user nova-compute[73572]:         <nova:swap>0</nova:swap>
Aug 26 10:20:07 user nova-compute[73572]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 10:20:07 user nova-compute[73572]:         <nova:vcpus>1</nova:vcpus>
Aug 26 10:20:07 user nova-compute[73572]:       </nova:flavor>
Aug 26 10:20:07 user nova-compute[73572]:       <nova:owner>
Aug 26 10:20:07 user nova-compute[73572]:         <nova:user uuid="0ee7e4a9f7db476eb9f16440c6b8e37e">tempest-ServerActionsTestOtherB-1806914349-project-member</nova:user>
Aug 26 10:20:07 user nova-compute[73572]:         <nova:project uuid="0d2c922711fb445aa99ae4f30b802c12">tempest-ServerActionsTestOtherB-1806914349</nova:project>
Aug 26 10:20:07 user nova-compute[73572]:       </nova:owner>
Aug 26 10:20:07 user nova-compute[73572]:       <nova:root type="image" uuid="299da0c9-e1c4-48f0-be55-fbe20dd06bc9"/>
Aug 26 10:20:07 user nova-compute[73572]:       <nova:ports>
Aug 26 10:20:07 user nova-compute[73572]:         <nova:port uuid="ebf9f385-e59b-4060-9bf9-a8d2006327b4">
Aug 26 10:20:07 user nova-compute[73572]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 26 10:20:07 user nova-compute[73572]:         </nova:port>
Aug 26 10:20:07 user nova-compute[73572]:       </nova:ports>
Aug 26 10:20:07 user nova-compute[73572]:     </nova:instance>
Aug 26 10:20:07 user nova-compute[73572]:   </metadata>
Aug 26 10:20:07 user nova-compute[73572]:   <sysinfo type="smbios">
Aug 26 10:20:07 user nova-compute[73572]:     <system>
Aug 26 10:20:07 user nova-compute[73572]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 10:20:07 user nova-compute[73572]:       <entry name="product">OpenStack Nova</entry>
Aug 26 10:20:07 user nova-compute[73572]:       <entry name="version">0.0.0</entry>
Aug 26 10:20:07 user nova-compute[73572]:       <entry name="serial">0fe47a17-4ffb-48ce-b0f6-a9b43002bd55</entry>
Aug 26 10:20:07 user nova-compute[73572]:       <entry name="uuid">0fe47a17-4ffb-48ce-b0f6-a9b43002bd55</entry>
Aug 26 10:20:07 user nova-compute[73572]:       <entry name="family">Virtual Machine</entry>
Aug 26 10:20:07 user nova-compute[73572]:     </system>
Aug 26 10:20:07 user nova-compute[73572]:   </sysinfo>
Aug 26 10:20:07 user nova-compute[73572]:   <os>
Aug 26 10:20:07 user nova-compute[73572]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 10:20:07 user nova-compute[73572]:     <boot dev="hd"/>
Aug 26 10:20:07 user nova-compute[73572]:     <smbios mode="sysinfo"/>
Aug 26 10:20:07 user nova-compute[73572]:   </os>
Aug 26 10:20:07 user nova-compute[73572]:   <features>
Aug 26 10:20:07 user nova-compute[73572]:     <acpi/>
Aug 26 10:20:07 user nova-compute[73572]:     <apic/>
Aug 26 10:20:07 user nova-compute[73572]:     <vmcoreinfo/>
Aug 26 10:20:07 user nova-compute[73572]:   </features>
Aug 26 10:20:07 user nova-compute[73572]:   <clock offset="utc">
Aug 26 10:20:07 user nova-compute[73572]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 10:20:07 user nova-compute[73572]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 10:20:07 user nova-compute[73572]:     <timer name="hpet" present="no"/>
Aug 26 10:20:07 user nova-compute[73572]:   </clock>
Aug 26 10:20:07 user nova-compute[73572]:   <cpu mode="custom" match="exact">
Aug 26 10:20:07 user nova-compute[73572]:     <model>Nehalem</model>
Aug 26 10:20:07 user nova-compute[73572]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 10:20:07 user nova-compute[73572]:   </cpu>
Aug 26 10:20:07 user nova-compute[73572]:   <devices>
Aug 26 10:20:07 user nova-compute[73572]:     <disk type="file" device="disk">
Aug 26 10:20:07 user nova-compute[73572]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 10:20:07 user nova-compute[73572]:       <source file="/opt/stack/data/nova/instances/0fe47a17-4ffb-48ce-b0f6-a9b43002bd55/disk"/>
Aug 26 10:20:07 user nova-compute[73572]:       <target dev="vda" bus="virtio"/>
Aug 26 10:20:07 user nova-compute[73572]:     </disk>
Aug 26 10:20:07 user nova-compute[73572]:     <disk type="block" device="disk">
Aug 26 10:20:07 user nova-compute[73572]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 10:20:07 user nova-compute[73572]:       <source dev="/dev/sdc"/>
Aug 26 10:20:07 user nova-compute[73572]:       <target dev="vdb" bus="virtio"/>
Aug 26 10:20:07 user nova-compute[73572]:       <serial>5f3a153b-1b99-4297-ad26-ea58f33330b8</serial>
Aug 26 10:20:07 user nova-compute[73572]:     </disk>
Aug 26 10:20:07 user nova-compute[73572]:     <interface type="ethernet">
Aug 26 10:20:07 user nova-compute[73572]:       <mac address="fa:16:3e:49:23:6a"/>
Aug 26 10:20:07 user nova-compute[73572]:       <model type="virtio"/>
Aug 26 10:20:07 user nova-compute[73572]:       <mtu size="1442"/>
Aug 26 10:20:07 user nova-compute[73572]:       <target dev="tapebf9f385-e5"/>
Aug 26 10:20:07 user nova-compute[73572]:     </interface>
Aug 26 10:20:07 user nova-compute[73572]:     <serial type="pty">
Aug 26 10:20:07 user nova-compute[73572]:       <log file="/opt/stack/data/nova/instances/0fe47a17-4ffb-48ce-b0f6-a9b43002bd55/console.log" append="off"/>
Aug 26 10:20:07 user nova-compute[73572]:     </serial>
Aug 26 10:20:07 user nova-compute[73572]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 10:20:07 user nova-compute[73572]:     <video>
Aug 26 10:20:07 user nova-compute[73572]:       <model type="virtio"/>
Aug 26 10:20:07 user nova-compute[73572]:     </video>
Aug 26 10:20:07 user nova-compute[73572]:     <rng model="virtio">
Aug 26 10:20:07 user nova-compute[73572]:       <backend model="random">/dev/urandom</backend>
Aug 26 10:20:07 user nova-compute[73572]:     </rng>
Aug 26 10:20:07 user nova-compute[73572]:     <controller type="usb" index="0" model="none"/>
Aug 26 10:20:07 user nova-compute[73572]:     <memballoon model="virtio">
Aug 26 10:20:07 user nova-compute[73572]:       <stats period="10"/>
Aug 26 10:20:07 user nova-compute[73572]:     </memballoon>
Aug 26 10:20:07 user nova-compute[73572]:   </devices>
Aug 26 10:20:07 user nova-compute[73572]: </domain>
Aug 26 10:20:07 user nova-compute[73572]:  {{(pid=73572) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 10:20:07 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-2873906f-13e4-4858-b75c-73cf8f5f8ec9 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T10:15:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-220365578',display_name='tempest-ServerActionsTestOtherB-server-220365578',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-220365578',id=17,image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNpUMyiGXRzsPFYrzC1k+DPeAQeFXKXREu1ci6G2S65T1Gci+/hLSOFjcdBoLqgENyI+7/uwXL8y2F/F10thQC08ST7hXeII35W/K66MHhxc0L254FUOJIzPARZXOsUESA==',key_name='tempest-keypair-2095276623',keypairs=<?>,launch_index=0,launched_at=2023-08-26T10:15:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='0d2c922711fb445aa99ae4f30b802c12',ramdisk_id='',reservation_id='r-ktz04i2y',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1806914349',owner_user_name='tempest-ServerActionsTestOtherB-1806914349-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T10:19:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0ee7e4a9f7db476eb9f16440c6b8e37e',uuid=0fe47a17-4ffb-48ce-b0f6-a9b43002bd55,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ebf9f385-e59b-4060-9bf9-a8d2006327b4", "address": "fa:16:3e:49:23:6a", "network": {"id": "7c89c22a-96d4-4e60-9c4c-b5a82a7eca55", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1976182948-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1976182948-network", "vif_mac": "fa:16:3e:49:23:6a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d2c922711fb445aa99ae4f30b802c12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebf9f385-e5", "ovs_interfaceid": "ebf9f385-e59b-4060-9bf9-a8d2006327b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 10:20:07 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-2873906f-13e4-4858-b75c-73cf8f5f8ec9 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Converting VIF {"id": "ebf9f385-e59b-4060-9bf9-a8d2006327b4", "address": "fa:16:3e:49:23:6a", "network": {"id": "7c89c22a-96d4-4e60-9c4c-b5a82a7eca55", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1976182948-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1976182948-network", "vif_mac": "fa:16:3e:49:23:6a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d2c922711fb445aa99ae4f30b802c12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebf9f385-e5", "ovs_interfaceid": "ebf9f385-e59b-4060-9bf9-a8d2006327b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:20:07 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-2873906f-13e4-4858-b75c-73cf8f5f8ec9 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:49:23:6a,bridge_name='br-int',has_traffic_filtering=True,id=ebf9f385-e59b-4060-9bf9-a8d2006327b4,network=Network(7c89c22a-96d4-4e60-9c4c-b5a82a7eca55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebf9f385-e5') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:20:07 user nova-compute[73572]: DEBUG os_vif [None req-2873906f-13e4-4858-b75c-73cf8f5f8ec9 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:23:6a,bridge_name='br-int',has_traffic_filtering=True,id=ebf9f385-e59b-4060-9bf9-a8d2006327b4,network=Network(7c89c22a-96d4-4e60-9c4c-b5a82a7eca55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebf9f385-e5') {{(pid=73572) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 10:20:07 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:20:07 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:20:07 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 10:20:07 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:20:07 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:20:07 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapebf9f385-e5, may_exist=True, interface_attrs={}) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:20:07 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapebf9f385-e5, col_values=(('external_ids', {'iface-id': 'ebf9f385-e59b-4060-9bf9-a8d2006327b4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:49:23:6a', 'vm-uuid': '0fe47a17-4ffb-48ce-b0f6-a9b43002bd55'}),), if_exists=True) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:20:07 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:20:07 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:20:07 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:20:07 user nova-compute[73572]: INFO os_vif [None req-2873906f-13e4-4858-b75c-73cf8f5f8ec9 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:23:6a,bridge_name='br-int',has_traffic_filtering=True,id=ebf9f385-e59b-4060-9bf9-a8d2006327b4,network=Network(7c89c22a-96d4-4e60-9c4c-b5a82a7eca55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebf9f385-e5')
Aug 26 10:20:07 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-2873906f-13e4-4858-b75c-73cf8f5f8ec9 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] No BDM found with device name vda, not building metadata. {{(pid=73572) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 10:20:07 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-2873906f-13e4-4858-b75c-73cf8f5f8ec9 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73572) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 10:20:07 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-2873906f-13e4-4858-b75c-73cf8f5f8ec9 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] No VIF found with MAC fa:16:3e:49:23:6a, not building metadata {{(pid=73572) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 10:20:08 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-fa39d5b0-5f50-489a-8e4d-ffa55af9ad3e tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] [instance: 339517ef-c023-4f13-a8cc-d84f7176dfcd] Creating instance directory {{(pid=73572) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 10:20:08 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-fa39d5b0-5f50-489a-8e4d-ffa55af9ad3e tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] [instance: 339517ef-c023-4f13-a8cc-d84f7176dfcd] Creating image(s)
Aug 26 10:20:08 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-fa39d5b0-5f50-489a-8e4d-ffa55af9ad3e tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] [instance: 339517ef-c023-4f13-a8cc-d84f7176dfcd] Did not create local disks {{(pid=73572) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 26 10:20:08 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-fa39d5b0-5f50-489a-8e4d-ffa55af9ad3e tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] [instance: 339517ef-c023-4f13-a8cc-d84f7176dfcd] Ensure instance console log exists: /opt/stack/data/nova/instances/339517ef-c023-4f13-a8cc-d84f7176dfcd/console.log {{(pid=73572) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 10:20:08 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-fa39d5b0-5f50-489a-8e4d-ffa55af9ad3e tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:20:08 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-fa39d5b0-5f50-489a-8e4d-ffa55af9ad3e tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:20:08 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-fa39d5b0-5f50-489a-8e4d-ffa55af9ad3e tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:20:08 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-fa39d5b0-5f50-489a-8e4d-ffa55af9ad3e tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] [instance: 339517ef-c023-4f13-a8cc-d84f7176dfcd] Start _get_guest_xml network_info=[{"id": "0545369e-80c9-45cc-a9a2-330705df9241", "address": "fa:16:3e:ae:3c:b5", "network": {"id": "a9900fc6-80c0-41e3-ac1a-4fa11bda2d38", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1804146753-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.153", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b5f7c995974418c972eb33e591fab75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0545369e-80", "ovs_interfaceid": "0545369e-80c9-45cc-a9a2-330705df9241", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T10:07:33Z,direct_url=<?>,disk_format='qcow2',id=299da0c9-e1c4-48f0-be55-fbe20dd06bc9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5c995f8bbbab4368b67a253e0df3971a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T10:07:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'disk_bus': 'virtio', 'boot_index': 0, 'mount_device': '/dev/vda', 'attachment_id': 'ae7304a1-8052-49ed-a8ce-39858af5ee91', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:d94556c8-9096-4e9a-9cfc-f9d17846ed06'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LpSxZEgY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '339517ef-c023-4f13-a8cc-d84f7176dfcd', 'attached_at': '', 'detached_at': '', 'volume_id': 'd94556c8-9096-4e9a-9cfc-f9d17846ed06', 'serial': 'd94556c8-9096-4e9a-9cfc-f9d17846ed06'}, 'guest_format': None, 'device_type': 'disk', 'volume_type': None} {{(pid=73572) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 10:20:08 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-fa39d5b0-5f50-489a-8e4d-ffa55af9ad3e tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 26 10:20:08 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-fa39d5b0-5f50-489a-8e4d-ffa55af9ad3e tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 26 10:20:08 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-fa39d5b0-5f50-489a-8e4d-ffa55af9ad3e tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73572) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 10:20:08 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-fa39d5b0-5f50-489a-8e4d-ffa55af9ad3e tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] CPU controller missing on host. {{(pid=73572) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 10:20:08 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-fa39d5b0-5f50-489a-8e4d-ffa55af9ad3e tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73572) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 10:20:08 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-fa39d5b0-5f50-489a-8e4d-ffa55af9ad3e tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] CPU controller found on host. {{(pid=73572) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 10:20:08 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-fa39d5b0-5f50-489a-8e4d-ffa55af9ad3e tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73572) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 10:20:08 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-fa39d5b0-5f50-489a-8e4d-ffa55af9ad3e tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T10:07:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T10:07:33Z,direct_url=<?>,disk_format='qcow2',id=299da0c9-e1c4-48f0-be55-fbe20dd06bc9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5c995f8bbbab4368b67a253e0df3971a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T10:07:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 10:20:08 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-fa39d5b0-5f50-489a-8e4d-ffa55af9ad3e tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] Flavor limits 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 10:20:08 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-fa39d5b0-5f50-489a-8e4d-ffa55af9ad3e tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] Image limits 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 10:20:08 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-fa39d5b0-5f50-489a-8e4d-ffa55af9ad3e tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] Flavor pref 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 10:20:08 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-fa39d5b0-5f50-489a-8e4d-ffa55af9ad3e tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] Image pref 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 10:20:08 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-fa39d5b0-5f50-489a-8e4d-ffa55af9ad3e tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 10:20:08 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-fa39d5b0-5f50-489a-8e4d-ffa55af9ad3e tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 10:20:08 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-fa39d5b0-5f50-489a-8e4d-ffa55af9ad3e tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73572) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 10:20:08 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-fa39d5b0-5f50-489a-8e4d-ffa55af9ad3e tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] Got 1 possible topologies {{(pid=73572) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 10:20:08 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-fa39d5b0-5f50-489a-8e4d-ffa55af9ad3e tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 10:20:08 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-fa39d5b0-5f50-489a-8e4d-ffa55af9ad3e tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 10:20:08 user nova-compute[73572]: DEBUG nova.objects.instance [None req-fa39d5b0-5f50-489a-8e4d-ffa55af9ad3e tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] Lazy-loading 'vcpu_model' on Instance uuid 339517ef-c023-4f13-a8cc-d84f7176dfcd {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:20:08 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fa39d5b0-5f50-489a-8e4d-ffa55af9ad3e tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] [instance: 339517ef-c023-4f13-a8cc-d84f7176dfcd] Calling os-brick to attach iSCSI Volume {{(pid=73572) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 10:20:08 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa39d5b0-5f50-489a-8e4d-ffa55af9ad3e tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc89c3d6a10>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:d94556c8-9096-4e9a-9cfc-f9d17846ed06'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LpSxZEgY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 10:20:08 user nova-compute[73572]: WARNING os_brick.initiator.connectors.base [None req-fa39d5b0-5f50-489a-8e4d-ffa55af9ad3e tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 26 10:20:08 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-fa39d5b0-5f50-489a-8e4d-ffa55af9ad3e tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 10:20:08 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-fa39d5b0-5f50-489a-8e4d-ffa55af9ad3e tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 10:20:08 user nova-compute[73572]: WARNING os_brick.initiator.connectors.base [None req-fa39d5b0-5f50-489a-8e4d-ffa55af9ad3e tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 26 10:20:08 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-fa39d5b0-5f50-489a-8e4d-ffa55af9ad3e tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d94556c8-9096-4e9a-9cfc-f9d17846ed06" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 10:20:08 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-fa39d5b0-5f50-489a-8e4d-ffa55af9ad3e tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d94556c8-9096-4e9a-9cfc-f9d17846ed06" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 10:20:08 user nova-compute[73572]: INFO os_brick.initiator.connectors.iscsi [None req-fa39d5b0-5f50-489a-8e4d-ffa55af9ad3e tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 10:20:08 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d94556c8-9096-4e9a-9cfc-f9d17846ed06 -p 172.16.0.220:3260 {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:20:08 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d94556c8-9096-4e9a-9cfc-f9d17846ed06 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:20:08 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ba419d7-87b5-4109-b2a4-d37acf789328]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:20:08 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa39d5b0-5f50-489a-8e4d-ffa55af9ad3e tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 10:20:08 user nova-compute[73572]:  {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:20:08 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d94556c8-9096-4e9a-9cfc-f9d17846ed06 -p 172.16.0.220:3260 --interface default --op new {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:20:08 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d94556c8-9096-4e9a-9cfc-f9d17846ed06 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:20:08 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[0539c333-1a38-4783-8c48-921fb980bc7b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d94556c8-9096-4e9a-9cfc-f9d17846ed06] added\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:20:08 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa39d5b0-5f50-489a-8e4d-ffa55af9ad3e tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d94556c8-9096-4e9a-9cfc-f9d17846ed06] added
Aug 26 10:20:08 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:20:08 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d94556c8-9096-4e9a-9cfc-f9d17846ed06 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:20:08 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d94556c8-9096-4e9a-9cfc-f9d17846ed06 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:20:08 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[5175ff13-de4d-4a76-a54a-93eae47ecd40]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:20:08 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa39d5b0-5f50-489a-8e4d-ffa55af9ad3e tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:20:08 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d94556c8-9096-4e9a-9cfc-f9d17846ed06 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:20:08 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d94556c8-9096-4e9a-9cfc-f9d17846ed06 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:20:08 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[643dd652-0305-4511-90c3-eb6acb6fb15c]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:20:08 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa39d5b0-5f50-489a-8e4d-ffa55af9ad3e tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:20:08 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d94556c8-9096-4e9a-9cfc-f9d17846ed06 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LpSxZEgY {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:20:08 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d94556c8-9096-4e9a-9cfc-f9d17846ed06 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LpSxZEgY" returned: 0 in 0.017s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:20:08 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[a099496d-2516-419d-b9ed-157f258753db]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:20:08 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa39d5b0-5f50-489a-8e4d-ffa55af9ad3e tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LpSxZEgY'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:20:08 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d94556c8-9096-4e9a-9cfc-f9d17846ed06 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:20:08 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d94556c8-9096-4e9a-9cfc-f9d17846ed06 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:20:08 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[83ec2f5b-1c64-48b8-8b88-cef4ec31197f]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:20:08 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa39d5b0-5f50-489a-8e4d-ffa55af9ad3e tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:20:08 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:20:08 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:20:08 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[2af3d0c9-08ef-4c4b-afb8-aa0c1cc2837f]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:302c3cfe-f0ec-4b1c-b1d9-dc12d4f4ce40 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f3a153b-1b99-4297-ad26-ea58f33330b8 (non-flash)\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:20:08 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa39d5b0-5f50-489a-8e4d-ffa55af9ad3e tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)
Aug 26 10:20:08 user nova-compute[73572]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:302c3cfe-f0ec-4b1c-b1d9-dc12d4f4ce40 (non-flash)
Aug 26 10:20:08 user nova-compute[73572]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478 (non-flash)
Aug 26 10:20:08 user nova-compute[73572]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f3a153b-1b99-4297-ad26-ea58f33330b8 (non-flash)
Aug 26 10:20:08 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 10:20:08 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa39d5b0-5f50-489a-8e4d-ffa55af9ad3e tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)
Aug 26 10:20:08 user nova-compute[73572]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:302c3cfe-f0ec-4b1c-b1d9-dc12d4f4ce40 (non-flash)
Aug 26 10:20:08 user nova-compute[73572]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478 (non-flash)
Aug 26 10:20:08 user nova-compute[73572]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f3a153b-1b99-4297-ad26-ea58f33330b8 (non-flash)
Aug 26 10:20:08 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 10:20:08 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d94556c8-9096-4e9a-9cfc-f9d17846ed06 -p 172.16.0.220:3260 --login {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:20:08 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d94556c8-9096-4e9a-9cfc-f9d17846ed06 -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:20:08 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[81090c08-cbfe-49c5-b505-ec2ac800950a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d94556c8-9096-4e9a-9cfc-f9d17846ed06, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d94556c8-9096-4e9a-9cfc-f9d17846ed06, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:20:08 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa39d5b0-5f50-489a-8e4d-ffa55af9ad3e tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d94556c8-9096-4e9a-9cfc-f9d17846ed06, portal: 172.16.0.220,3260]
Aug 26 10:20:08 user nova-compute[73572]: Login to [iface: default, target: iqn.2010-10.org.openstack:d94556c8-9096-4e9a-9cfc-f9d17846ed06, portal: 172.16.0.220,3260] successful.
Aug 26 10:20:08 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:20:08 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d94556c8-9096-4e9a-9cfc-f9d17846ed06 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:20:08 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d94556c8-9096-4e9a-9cfc-f9d17846ed06 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:20:08 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dc469d7-d999-4a11-8298-2081e22434c1]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:20:08 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa39d5b0-5f50-489a-8e4d-ffa55af9ad3e tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:20:08 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:20:08 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:20:08 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[2209fe68-0326-4aad-a5b0-9af40f2337ff]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:302c3cfe-f0ec-4b1c-b1d9-dc12d4f4ce40 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f3a153b-1b99-4297-ad26-ea58f33330b8 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d94556c8-9096-4e9a-9cfc-f9d17846ed06 (non-flash)\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:20:08 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa39d5b0-5f50-489a-8e4d-ffa55af9ad3e tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)
Aug 26 10:20:08 user nova-compute[73572]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:302c3cfe-f0ec-4b1c-b1d9-dc12d4f4ce40 (non-flash)
Aug 26 10:20:08 user nova-compute[73572]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478 (non-flash)
Aug 26 10:20:08 user nova-compute[73572]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f3a153b-1b99-4297-ad26-ea58f33330b8 (non-flash)
Aug 26 10:20:08 user nova-compute[73572]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d94556c8-9096-4e9a-9cfc-f9d17846ed06 (non-flash)
Aug 26 10:20:08 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 10:20:08 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa39d5b0-5f50-489a-8e4d-ffa55af9ad3e tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)
Aug 26 10:20:08 user nova-compute[73572]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:302c3cfe-f0ec-4b1c-b1d9-dc12d4f4ce40 (non-flash)
Aug 26 10:20:08 user nova-compute[73572]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478 (non-flash)
Aug 26 10:20:08 user nova-compute[73572]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f3a153b-1b99-4297-ad26-ea58f33330b8 (non-flash)
Aug 26 10:20:08 user nova-compute[73572]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d94556c8-9096-4e9a-9cfc-f9d17846ed06 (non-flash)
Aug 26 10:20:08 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 10:20:08 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-fa39d5b0-5f50-489a-8e4d-ffa55af9ad3e tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d94556c8-9096-4e9a-9cfc-f9d17846ed06" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.300s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 10:20:08 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa39d5b0-5f50-489a-8e4d-ffa55af9ad3e tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] Connected to 172.16.0.220:3260 {{(pid=73572) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 10:20:08 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-fa39d5b0-5f50-489a-8e4d-ffa55af9ad3e tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] HCTL ('35', '-', '-', 0) found on session 28 with lun 0 {{(pid=73572) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 10:20:08 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-fa39d5b0-5f50-489a-8e4d-ffa55af9ad3e tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73572) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 10:20:08 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:20:08 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:20:08 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[03e87d56-ee3a-4533-868f-87f3e32a5aa1]: (4, ('- - 0', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:20:08 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-fa39d5b0-5f50-489a-8e4d-ffa55af9ad3e tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] Searching for a device in session 28 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73572) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 10:20:08 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa39d5b0-5f50-489a-8e4d-ffa55af9ad3e tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LpSxZEgY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73572) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 10:20:08 user nova-compute[73572]: DEBUG nova.compute.manager [req-4d0570bf-3eba-4ee8-9223-b20267adc091 req-9ff98f1f-06f8-4918-b766-64911213c244 service nova] [instance: 44a737bf-3704-4193-8d24-b8d132267279] Received event network-vif-plugged-4d7425ac-5500-4d32-b0db-448d4bd29651 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:20:08 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-4d0570bf-3eba-4ee8-9223-b20267adc091 req-9ff98f1f-06f8-4918-b766-64911213c244 service nova] Acquiring lock "44a737bf-3704-4193-8d24-b8d132267279-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:20:08 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-4d0570bf-3eba-4ee8-9223-b20267adc091 req-9ff98f1f-06f8-4918-b766-64911213c244 service nova] Lock "44a737bf-3704-4193-8d24-b8d132267279-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:20:08 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-4d0570bf-3eba-4ee8-9223-b20267adc091 req-9ff98f1f-06f8-4918-b766-64911213c244 service nova] Lock "44a737bf-3704-4193-8d24-b8d132267279-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:20:08 user nova-compute[73572]: DEBUG nova.compute.manager [req-4d0570bf-3eba-4ee8-9223-b20267adc091 req-9ff98f1f-06f8-4918-b766-64911213c244 service nova] [instance: 44a737bf-3704-4193-8d24-b8d132267279] No waiting events found dispatching network-vif-plugged-4d7425ac-5500-4d32-b0db-448d4bd29651 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:20:08 user nova-compute[73572]: WARNING nova.compute.manager [req-4d0570bf-3eba-4ee8-9223-b20267adc091 req-9ff98f1f-06f8-4918-b766-64911213c244 service nova] [instance: 44a737bf-3704-4193-8d24-b8d132267279] Received unexpected event network-vif-plugged-4d7425ac-5500-4d32-b0db-448d4bd29651 for instance with vm_state building and task_state spawning.
Aug 26 10:20:08 user nova-compute[73572]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693045193.8861217, 0dceaa35-4a13-453b-961f-831f66c35af0 => Stopped> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:20:08 user nova-compute[73572]: INFO nova.compute.manager [-] [instance: 0dceaa35-4a13-453b-961f-831f66c35af0] VM Stopped (Lifecycle Event)
Aug 26 10:20:08 user nova-compute[73572]: DEBUG nova.compute.manager [None req-b5ef5e3b-51d3-43c2-b7f8-fbe67411ac28 None None] [instance: 0dceaa35-4a13-453b-961f-831f66c35af0] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:20:08 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:20:08 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:20:08 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:20:09 user nova-compute[73572]: DEBUG nova.compute.manager [req-5601c2f8-3e21-4b14-9827-145afbaa1479 req-0833ef73-7df7-4205-831d-05c269deabf7 service nova] [instance: 693f562f-ae3d-4cfb-926e-9990a1a301cb] Received event network-vif-plugged-010eed73-8a66-4648-a616-0b9e7441ab1c {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:20:09 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-5601c2f8-3e21-4b14-9827-145afbaa1479 req-0833ef73-7df7-4205-831d-05c269deabf7 service nova] Acquiring lock "693f562f-ae3d-4cfb-926e-9990a1a301cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:20:09 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-5601c2f8-3e21-4b14-9827-145afbaa1479 req-0833ef73-7df7-4205-831d-05c269deabf7 service nova] Lock "693f562f-ae3d-4cfb-926e-9990a1a301cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:20:09 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-5601c2f8-3e21-4b14-9827-145afbaa1479 req-0833ef73-7df7-4205-831d-05c269deabf7 service nova] Lock "693f562f-ae3d-4cfb-926e-9990a1a301cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:20:09 user nova-compute[73572]: DEBUG nova.compute.manager [req-5601c2f8-3e21-4b14-9827-145afbaa1479 req-0833ef73-7df7-4205-831d-05c269deabf7 service nova] [instance: 693f562f-ae3d-4cfb-926e-9990a1a301cb] No waiting events found dispatching network-vif-plugged-010eed73-8a66-4648-a616-0b9e7441ab1c {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:20:09 user nova-compute[73572]: WARNING nova.compute.manager [req-5601c2f8-3e21-4b14-9827-145afbaa1479 req-0833ef73-7df7-4205-831d-05c269deabf7 service nova] [instance: 693f562f-ae3d-4cfb-926e-9990a1a301cb] Received unexpected event network-vif-plugged-010eed73-8a66-4648-a616-0b9e7441ab1c for instance with vm_state building and task_state spawning.
Aug 26 10:20:09 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:20:09 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:20:09 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:20:09 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:20:09 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:20:09 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:20:09 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:20:09 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:20:09 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-fa39d5b0-5f50-489a-8e4d-ffa55af9ad3e tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.343s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 10:20:09 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa39d5b0-5f50-489a-8e4d-ffa55af9ad3e tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] <== connect_volume: return (1344ms) {'type': 'block', 'scsi_wwn': '23533393162623765', 'path': '/dev/sdd'} {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 10:20:09 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fa39d5b0-5f50-489a-8e4d-ffa55af9ad3e tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] [instance: 339517ef-c023-4f13-a8cc-d84f7176dfcd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23533393162623765', 'path': '/dev/sdd'} {{(pid=73572) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 10:20:09 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-fa39d5b0-5f50-489a-8e4d-ffa55af9ad3e tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-26T10:17:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-633608799',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1130623721',id=21,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM9/VU/54cn1RTubtcb6hoKsYPJi5XFbRq9x7ny9CP4siDdaewzHcyj5+OCk5iyU32xzxXp4A9oDvslVWxMVLkr28kptlrAJWcCk28e8n8Kp7D+Tf1GW4OZmlFm8Y1MOSQ==',key_name='tempest-keypair-1829288947',keypairs=<?>,launch_index=0,launched_at=2023-08-26T10:17:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='3b5f7c995974418c972eb33e591fab75',ramdisk_id='',reservation_id='r-ol5nmpv7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-182410381',owner_user_name='tempest-ServerActionsV293TestJSON-182410381-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T10:19:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4ab4c737924c4e8da6b35cdb4051c3be',uuid=339517ef-c023-4f13-a8cc-d84f7176dfcd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0545369e-80c9-45cc-a9a2-330705df9241", "address": "fa:16:3e:ae:3c:b5", "network": {"id": "a9900fc6-80c0-41e3-ac1a-4fa11bda2d38", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1804146753-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.153", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b5f7c995974418c972eb33e591fab75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0545369e-80", "ovs_interfaceid": "0545369e-80c9-45cc-a9a2-330705df9241", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73572) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 10:20:09 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-fa39d5b0-5f50-489a-8e4d-ffa55af9ad3e tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] Converting VIF {"id": "0545369e-80c9-45cc-a9a2-330705df9241", "address": "fa:16:3e:ae:3c:b5", "network": {"id": "a9900fc6-80c0-41e3-ac1a-4fa11bda2d38", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1804146753-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.153", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b5f7c995974418c972eb33e591fab75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0545369e-80", "ovs_interfaceid": "0545369e-80c9-45cc-a9a2-330705df9241", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:20:09 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-fa39d5b0-5f50-489a-8e4d-ffa55af9ad3e tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ae:3c:b5,bridge_name='br-int',has_traffic_filtering=True,id=0545369e-80c9-45cc-a9a2-330705df9241,network=Network(a9900fc6-80c0-41e3-ac1a-4fa11bda2d38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0545369e-80') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:20:09 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-fa39d5b0-5f50-489a-8e4d-ffa55af9ad3e tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] [instance: 339517ef-c023-4f13-a8cc-d84f7176dfcd] End _get_guest_xml xml=<domain type="kvm">
Aug 26 10:20:09 user nova-compute[73572]:   <uuid>339517ef-c023-4f13-a8cc-d84f7176dfcd</uuid>
Aug 26 10:20:09 user nova-compute[73572]:   <name>instance-00000015</name>
Aug 26 10:20:09 user nova-compute[73572]:   <memory>524288</memory>
Aug 26 10:20:09 user nova-compute[73572]:   <vcpu>1</vcpu>
Aug 26 10:20:09 user nova-compute[73572]:   <metadata>
Aug 26 10:20:09 user nova-compute[73572]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 10:20:09 user nova-compute[73572]:       <nova:package version="0.0.0"/>
Aug 26 10:20:09 user nova-compute[73572]:       <nova:name>tempest-ServerActionsV293TestJSON-server-633608799</nova:name>
Aug 26 10:20:09 user nova-compute[73572]:       <nova:creationTime>2023-08-26 10:20:08</nova:creationTime>
Aug 26 10:20:09 user nova-compute[73572]:       <nova:flavor name="m1.tiny">
Aug 26 10:20:09 user nova-compute[73572]:         <nova:memory>512</nova:memory>
Aug 26 10:20:09 user nova-compute[73572]:         <nova:disk>1</nova:disk>
Aug 26 10:20:09 user nova-compute[73572]:         <nova:swap>0</nova:swap>
Aug 26 10:20:09 user nova-compute[73572]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 10:20:09 user nova-compute[73572]:         <nova:vcpus>1</nova:vcpus>
Aug 26 10:20:09 user nova-compute[73572]:       </nova:flavor>
Aug 26 10:20:09 user nova-compute[73572]:       <nova:owner>
Aug 26 10:20:09 user nova-compute[73572]:         <nova:user uuid="4ab4c737924c4e8da6b35cdb4051c3be">tempest-ServerActionsV293TestJSON-182410381-project-member</nova:user>
Aug 26 10:20:09 user nova-compute[73572]:         <nova:project uuid="3b5f7c995974418c972eb33e591fab75">tempest-ServerActionsV293TestJSON-182410381</nova:project>
Aug 26 10:20:09 user nova-compute[73572]:       </nova:owner>
Aug 26 10:20:09 user nova-compute[73572]:       <nova:ports>
Aug 26 10:20:09 user nova-compute[73572]:         <nova:port uuid="0545369e-80c9-45cc-a9a2-330705df9241">
Aug 26 10:20:09 user nova-compute[73572]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 26 10:20:09 user nova-compute[73572]:         </nova:port>
Aug 26 10:20:09 user nova-compute[73572]:       </nova:ports>
Aug 26 10:20:09 user nova-compute[73572]:     </nova:instance>
Aug 26 10:20:09 user nova-compute[73572]:   </metadata>
Aug 26 10:20:09 user nova-compute[73572]:   <sysinfo type="smbios">
Aug 26 10:20:09 user nova-compute[73572]:     <system>
Aug 26 10:20:09 user nova-compute[73572]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 10:20:09 user nova-compute[73572]:       <entry name="product">OpenStack Nova</entry>
Aug 26 10:20:09 user nova-compute[73572]:       <entry name="version">0.0.0</entry>
Aug 26 10:20:09 user nova-compute[73572]:       <entry name="serial">339517ef-c023-4f13-a8cc-d84f7176dfcd</entry>
Aug 26 10:20:09 user nova-compute[73572]:       <entry name="uuid">339517ef-c023-4f13-a8cc-d84f7176dfcd</entry>
Aug 26 10:20:09 user nova-compute[73572]:       <entry name="family">Virtual Machine</entry>
Aug 26 10:20:09 user nova-compute[73572]:     </system>
Aug 26 10:20:09 user nova-compute[73572]:   </sysinfo>
Aug 26 10:20:09 user nova-compute[73572]:   <os>
Aug 26 10:20:09 user nova-compute[73572]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 10:20:09 user nova-compute[73572]:     <boot dev="hd"/>
Aug 26 10:20:09 user nova-compute[73572]:     <smbios mode="sysinfo"/>
Aug 26 10:20:09 user nova-compute[73572]:   </os>
Aug 26 10:20:09 user nova-compute[73572]:   <features>
Aug 26 10:20:09 user nova-compute[73572]:     <acpi/>
Aug 26 10:20:09 user nova-compute[73572]:     <apic/>
Aug 26 10:20:09 user nova-compute[73572]:     <vmcoreinfo/>
Aug 26 10:20:09 user nova-compute[73572]:   </features>
Aug 26 10:20:09 user nova-compute[73572]:   <clock offset="utc">
Aug 26 10:20:09 user nova-compute[73572]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 10:20:09 user nova-compute[73572]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 10:20:09 user nova-compute[73572]:     <timer name="hpet" present="no"/>
Aug 26 10:20:09 user nova-compute[73572]:   </clock>
Aug 26 10:20:09 user nova-compute[73572]:   <cpu mode="custom" match="exact">
Aug 26 10:20:09 user nova-compute[73572]:     <model>Nehalem</model>
Aug 26 10:20:09 user nova-compute[73572]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 10:20:09 user nova-compute[73572]:   </cpu>
Aug 26 10:20:09 user nova-compute[73572]:   <devices>
Aug 26 10:20:09 user nova-compute[73572]:     <disk type="block" device="disk">
Aug 26 10:20:09 user nova-compute[73572]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 10:20:09 user nova-compute[73572]:       <source dev="/dev/sdd"/>
Aug 26 10:20:09 user nova-compute[73572]:       <target dev="vda" bus="virtio"/>
Aug 26 10:20:09 user nova-compute[73572]:       <serial>d94556c8-9096-4e9a-9cfc-f9d17846ed06</serial>
Aug 26 10:20:09 user nova-compute[73572]:     </disk>
Aug 26 10:20:09 user nova-compute[73572]:     <interface type="ethernet">
Aug 26 10:20:09 user nova-compute[73572]:       <mac address="fa:16:3e:ae:3c:b5"/>
Aug 26 10:20:09 user nova-compute[73572]:       <model type="virtio"/>
Aug 26 10:20:09 user nova-compute[73572]:       <mtu size="1442"/>
Aug 26 10:20:09 user nova-compute[73572]:       <target dev="tap0545369e-80"/>
Aug 26 10:20:09 user nova-compute[73572]:     </interface>
Aug 26 10:20:09 user nova-compute[73572]:     <serial type="pty">
Aug 26 10:20:09 user nova-compute[73572]:       <log file="/opt/stack/data/nova/instances/339517ef-c023-4f13-a8cc-d84f7176dfcd/console.log" append="off"/>
Aug 26 10:20:09 user nova-compute[73572]:     </serial>
Aug 26 10:20:09 user nova-compute[73572]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 10:20:09 user nova-compute[73572]:     <video>
Aug 26 10:20:09 user nova-compute[73572]:       <model type="virtio"/>
Aug 26 10:20:09 user nova-compute[73572]:     </video>
Aug 26 10:20:09 user nova-compute[73572]:     <rng model="virtio">
Aug 26 10:20:09 user nova-compute[73572]:       <backend model="random">/dev/urandom</backend>
Aug 26 10:20:09 user nova-compute[73572]:     </rng>
Aug 26 10:20:09 user nova-compute[73572]:     <controller type="usb" index="0" model="none"/>
Aug 26 10:20:09 user nova-compute[73572]:     <memballoon model="virtio">
Aug 26 10:20:09 user nova-compute[73572]:       <stats period="10"/>
Aug 26 10:20:09 user nova-compute[73572]:     </memballoon>
Aug 26 10:20:09 user nova-compute[73572]:   </devices>
Aug 26 10:20:09 user nova-compute[73572]: </domain>
Aug 26 10:20:09 user nova-compute[73572]:  {{(pid=73572) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 10:20:09 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-fa39d5b0-5f50-489a-8e4d-ffa55af9ad3e tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-26T10:17:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-633608799',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1130623721',id=21,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM9/VU/54cn1RTubtcb6hoKsYPJi5XFbRq9x7ny9CP4siDdaewzHcyj5+OCk5iyU32xzxXp4A9oDvslVWxMVLkr28kptlrAJWcCk28e8n8Kp7D+Tf1GW4OZmlFm8Y1MOSQ==',key_name='tempest-keypair-1829288947',keypairs=<?>,launch_index=0,launched_at=2023-08-26T10:17:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='3b5f7c995974418c972eb33e591fab75',ramdisk_id='',reservation_id='r-ol5nmpv7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-182410381',owner_user_name='tempest-ServerActionsV293TestJSON-182410381-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T10:19:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4ab4c737924c4e8da6b35cdb4051c3be',uuid=339517ef-c023-4f13-a8cc-d84f7176dfcd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0545369e-80c9-45cc-a9a2-330705df9241", "address": "fa:16:3e:ae:3c:b5", "network": {"id": "a9900fc6-80c0-41e3-ac1a-4fa11bda2d38", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1804146753-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.153", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b5f7c995974418c972eb33e591fab75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0545369e-80", "ovs_interfaceid": "0545369e-80c9-45cc-a9a2-330705df9241", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 10:20:09 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-fa39d5b0-5f50-489a-8e4d-ffa55af9ad3e tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] Converting VIF {"id": "0545369e-80c9-45cc-a9a2-330705df9241", "address": "fa:16:3e:ae:3c:b5", "network": {"id": "a9900fc6-80c0-41e3-ac1a-4fa11bda2d38", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1804146753-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.153", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b5f7c995974418c972eb33e591fab75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0545369e-80", "ovs_interfaceid": "0545369e-80c9-45cc-a9a2-330705df9241", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:20:09 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-fa39d5b0-5f50-489a-8e4d-ffa55af9ad3e tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ae:3c:b5,bridge_name='br-int',has_traffic_filtering=True,id=0545369e-80c9-45cc-a9a2-330705df9241,network=Network(a9900fc6-80c0-41e3-ac1a-4fa11bda2d38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0545369e-80') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:20:09 user nova-compute[73572]: DEBUG os_vif [None req-fa39d5b0-5f50-489a-8e4d-ffa55af9ad3e tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ae:3c:b5,bridge_name='br-int',has_traffic_filtering=True,id=0545369e-80c9-45cc-a9a2-330705df9241,network=Network(a9900fc6-80c0-41e3-ac1a-4fa11bda2d38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0545369e-80') {{(pid=73572) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 10:20:09 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:20:09 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:20:09 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 10:20:09 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:20:09 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0545369e-80, may_exist=True, interface_attrs={}) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:20:09 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0545369e-80, col_values=(('external_ids', {'iface-id': '0545369e-80c9-45cc-a9a2-330705df9241', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ae:3c:b5', 'vm-uuid': '339517ef-c023-4f13-a8cc-d84f7176dfcd'}),), if_exists=True) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:20:09 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:20:09 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:20:09 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:20:09 user nova-compute[73572]: INFO os_vif [None req-fa39d5b0-5f50-489a-8e4d-ffa55af9ad3e tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ae:3c:b5,bridge_name='br-int',has_traffic_filtering=True,id=0545369e-80c9-45cc-a9a2-330705df9241,network=Network(a9900fc6-80c0-41e3-ac1a-4fa11bda2d38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0545369e-80')
Aug 26 10:20:09 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-fa39d5b0-5f50-489a-8e4d-ffa55af9ad3e tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] No BDM found with device name vda, not building metadata. {{(pid=73572) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 10:20:09 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-fa39d5b0-5f50-489a-8e4d-ffa55af9ad3e tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] No VIF found with MAC fa:16:3e:ae:3c:b5, not building metadata {{(pid=73572) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 10:20:10 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:20:10 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:20:10 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:20:10 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:20:10 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:20:10 user nova-compute[73572]: DEBUG nova.virt.driver [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Emitting event <LifecycleEvent: 1693045210.4070055, 44a737bf-3704-4193-8d24-b8d132267279 => Resumed> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:20:10 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 44a737bf-3704-4193-8d24-b8d132267279] VM Resumed (Lifecycle Event)
Aug 26 10:20:10 user nova-compute[73572]: DEBUG nova.compute.manager [None req-becec0e0-0a58-48c8-befb-452f63b4d564 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] [instance: 44a737bf-3704-4193-8d24-b8d132267279] Instance event wait completed in 0 seconds for  {{(pid=73572) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 10:20:10 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-becec0e0-0a58-48c8-befb-452f63b4d564 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] [instance: 44a737bf-3704-4193-8d24-b8d132267279] Guest created on hypervisor {{(pid=73572) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 10:20:10 user nova-compute[73572]: INFO nova.virt.libvirt.driver [-] [instance: 44a737bf-3704-4193-8d24-b8d132267279] Instance spawned successfully.
Aug 26 10:20:10 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-becec0e0-0a58-48c8-befb-452f63b4d564 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] [instance: 44a737bf-3704-4193-8d24-b8d132267279] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 10:20:10 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 44a737bf-3704-4193-8d24-b8d132267279] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:20:10 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 44a737bf-3704-4193-8d24-b8d132267279] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73572) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 10:20:10 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-becec0e0-0a58-48c8-befb-452f63b4d564 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] [instance: 44a737bf-3704-4193-8d24-b8d132267279] Found default for hw_cdrom_bus of ide {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:20:10 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-becec0e0-0a58-48c8-befb-452f63b4d564 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] [instance: 44a737bf-3704-4193-8d24-b8d132267279] Found default for hw_disk_bus of virtio {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:20:10 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-becec0e0-0a58-48c8-befb-452f63b4d564 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] [instance: 44a737bf-3704-4193-8d24-b8d132267279] Found default for hw_input_bus of None {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:20:10 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-becec0e0-0a58-48c8-befb-452f63b4d564 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] [instance: 44a737bf-3704-4193-8d24-b8d132267279] Found default for hw_pointer_model of None {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:20:10 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-becec0e0-0a58-48c8-befb-452f63b4d564 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] [instance: 44a737bf-3704-4193-8d24-b8d132267279] Found default for hw_video_model of virtio {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:20:10 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-becec0e0-0a58-48c8-befb-452f63b4d564 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] [instance: 44a737bf-3704-4193-8d24-b8d132267279] Found default for hw_vif_model of virtio {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:20:10 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 44a737bf-3704-4193-8d24-b8d132267279] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 10:20:10 user nova-compute[73572]: DEBUG nova.virt.driver [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Emitting event <LifecycleEvent: 1693045210.4085522, 44a737bf-3704-4193-8d24-b8d132267279 => Started> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:20:10 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 44a737bf-3704-4193-8d24-b8d132267279] VM Started (Lifecycle Event)
Aug 26 10:20:10 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 44a737bf-3704-4193-8d24-b8d132267279] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:20:10 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 44a737bf-3704-4193-8d24-b8d132267279] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73572) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 10:20:10 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 44a737bf-3704-4193-8d24-b8d132267279] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 10:20:10 user nova-compute[73572]: INFO nova.compute.manager [None req-becec0e0-0a58-48c8-befb-452f63b4d564 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] [instance: 44a737bf-3704-4193-8d24-b8d132267279] Took 8.36 seconds to spawn the instance on the hypervisor.
Aug 26 10:20:10 user nova-compute[73572]: DEBUG nova.compute.manager [None req-becec0e0-0a58-48c8-befb-452f63b4d564 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] [instance: 44a737bf-3704-4193-8d24-b8d132267279] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:20:10 user nova-compute[73572]: INFO nova.compute.manager [None req-becec0e0-0a58-48c8-befb-452f63b4d564 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] [instance: 44a737bf-3704-4193-8d24-b8d132267279] Took 9.33 seconds to build instance.
Aug 26 10:20:10 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-becec0e0-0a58-48c8-befb-452f63b4d564 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Lock "44a737bf-3704-4193-8d24-b8d132267279" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.415s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:20:10 user nova-compute[73572]: DEBUG nova.compute.manager [req-7a14842d-241a-4ec8-bc8c-2ebb057d67d3 req-ff5acef9-d8d4-4a3f-b663-b462f12b4fb0 service nova] [instance: 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55] Received event network-vif-plugged-ebf9f385-e59b-4060-9bf9-a8d2006327b4 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:20:10 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-7a14842d-241a-4ec8-bc8c-2ebb057d67d3 req-ff5acef9-d8d4-4a3f-b663-b462f12b4fb0 service nova] Acquiring lock "0fe47a17-4ffb-48ce-b0f6-a9b43002bd55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:20:10 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-7a14842d-241a-4ec8-bc8c-2ebb057d67d3 req-ff5acef9-d8d4-4a3f-b663-b462f12b4fb0 service nova] Lock "0fe47a17-4ffb-48ce-b0f6-a9b43002bd55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:20:10 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-7a14842d-241a-4ec8-bc8c-2ebb057d67d3 req-ff5acef9-d8d4-4a3f-b663-b462f12b4fb0 service nova] Lock "0fe47a17-4ffb-48ce-b0f6-a9b43002bd55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:20:10 user nova-compute[73572]: DEBUG nova.compute.manager [req-7a14842d-241a-4ec8-bc8c-2ebb057d67d3 req-ff5acef9-d8d4-4a3f-b663-b462f12b4fb0 service nova] [instance: 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55] No waiting events found dispatching network-vif-plugged-ebf9f385-e59b-4060-9bf9-a8d2006327b4 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:20:10 user nova-compute[73572]: WARNING nova.compute.manager [req-7a14842d-241a-4ec8-bc8c-2ebb057d67d3 req-ff5acef9-d8d4-4a3f-b663-b462f12b4fb0 service nova] [instance: 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55] Received unexpected event network-vif-plugged-ebf9f385-e59b-4060-9bf9-a8d2006327b4 for instance with vm_state active and task_state resize_finish.
Aug 26 10:20:10 user nova-compute[73572]: DEBUG nova.compute.manager [req-7a14842d-241a-4ec8-bc8c-2ebb057d67d3 req-ff5acef9-d8d4-4a3f-b663-b462f12b4fb0 service nova] [instance: 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55] Received event network-vif-plugged-ebf9f385-e59b-4060-9bf9-a8d2006327b4 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:20:10 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-7a14842d-241a-4ec8-bc8c-2ebb057d67d3 req-ff5acef9-d8d4-4a3f-b663-b462f12b4fb0 service nova] Acquiring lock "0fe47a17-4ffb-48ce-b0f6-a9b43002bd55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:20:10 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-7a14842d-241a-4ec8-bc8c-2ebb057d67d3 req-ff5acef9-d8d4-4a3f-b663-b462f12b4fb0 service nova] Lock "0fe47a17-4ffb-48ce-b0f6-a9b43002bd55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:20:10 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-7a14842d-241a-4ec8-bc8c-2ebb057d67d3 req-ff5acef9-d8d4-4a3f-b663-b462f12b4fb0 service nova] Lock "0fe47a17-4ffb-48ce-b0f6-a9b43002bd55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:20:10 user nova-compute[73572]: DEBUG nova.compute.manager [req-7a14842d-241a-4ec8-bc8c-2ebb057d67d3 req-ff5acef9-d8d4-4a3f-b663-b462f12b4fb0 service nova] [instance: 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55] No waiting events found dispatching network-vif-plugged-ebf9f385-e59b-4060-9bf9-a8d2006327b4 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:20:10 user nova-compute[73572]: WARNING nova.compute.manager [req-7a14842d-241a-4ec8-bc8c-2ebb057d67d3 req-ff5acef9-d8d4-4a3f-b663-b462f12b4fb0 service nova] [instance: 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55] Received unexpected event network-vif-plugged-ebf9f385-e59b-4060-9bf9-a8d2006327b4 for instance with vm_state active and task_state resize_finish.
Aug 26 10:20:11 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:20:11 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:20:11 user nova-compute[73572]: DEBUG nova.compute.manager [req-7c3faeac-45b1-4e9b-bf20-a56f81308149 req-464b6659-0d7d-458f-a9e7-884763a0fa97 service nova] [instance: 693f562f-ae3d-4cfb-926e-9990a1a301cb] Received event network-vif-plugged-010eed73-8a66-4648-a616-0b9e7441ab1c {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:20:11 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-7c3faeac-45b1-4e9b-bf20-a56f81308149 req-464b6659-0d7d-458f-a9e7-884763a0fa97 service nova] Acquiring lock "693f562f-ae3d-4cfb-926e-9990a1a301cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:20:11 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-7c3faeac-45b1-4e9b-bf20-a56f81308149 req-464b6659-0d7d-458f-a9e7-884763a0fa97 service nova] Lock "693f562f-ae3d-4cfb-926e-9990a1a301cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:20:11 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-7c3faeac-45b1-4e9b-bf20-a56f81308149 req-464b6659-0d7d-458f-a9e7-884763a0fa97 service nova] Lock "693f562f-ae3d-4cfb-926e-9990a1a301cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:20:11 user nova-compute[73572]: DEBUG nova.compute.manager [req-7c3faeac-45b1-4e9b-bf20-a56f81308149 req-464b6659-0d7d-458f-a9e7-884763a0fa97 service nova] [instance: 693f562f-ae3d-4cfb-926e-9990a1a301cb] No waiting events found dispatching network-vif-plugged-010eed73-8a66-4648-a616-0b9e7441ab1c {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:20:11 user nova-compute[73572]: WARNING nova.compute.manager [req-7c3faeac-45b1-4e9b-bf20-a56f81308149 req-464b6659-0d7d-458f-a9e7-884763a0fa97 service nova] [instance: 693f562f-ae3d-4cfb-926e-9990a1a301cb] Received unexpected event network-vif-plugged-010eed73-8a66-4648-a616-0b9e7441ab1c for instance with vm_state building and task_state spawning.
Aug 26 10:20:11 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:20:11 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:20:11 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:20:11 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:20:12 user nova-compute[73572]: DEBUG nova.compute.manager [req-4b98e55c-7c65-4ea4-9b15-25876e7fc38d req-1a80c1ba-cb98-4b19-b4c7-314d447962ac service nova] [instance: 339517ef-c023-4f13-a8cc-d84f7176dfcd] Received event network-vif-plugged-0545369e-80c9-45cc-a9a2-330705df9241 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:20:12 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-4b98e55c-7c65-4ea4-9b15-25876e7fc38d req-1a80c1ba-cb98-4b19-b4c7-314d447962ac service nova] Acquiring lock "339517ef-c023-4f13-a8cc-d84f7176dfcd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:20:12 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-4b98e55c-7c65-4ea4-9b15-25876e7fc38d req-1a80c1ba-cb98-4b19-b4c7-314d447962ac service nova] Lock "339517ef-c023-4f13-a8cc-d84f7176dfcd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:20:12 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-4b98e55c-7c65-4ea4-9b15-25876e7fc38d req-1a80c1ba-cb98-4b19-b4c7-314d447962ac service nova] Lock "339517ef-c023-4f13-a8cc-d84f7176dfcd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:20:12 user nova-compute[73572]: DEBUG nova.compute.manager [req-4b98e55c-7c65-4ea4-9b15-25876e7fc38d req-1a80c1ba-cb98-4b19-b4c7-314d447962ac service nova] [instance: 339517ef-c023-4f13-a8cc-d84f7176dfcd] No waiting events found dispatching network-vif-plugged-0545369e-80c9-45cc-a9a2-330705df9241 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:20:12 user nova-compute[73572]: WARNING nova.compute.manager [req-4b98e55c-7c65-4ea4-9b15-25876e7fc38d req-1a80c1ba-cb98-4b19-b4c7-314d447962ac service nova] [instance: 339517ef-c023-4f13-a8cc-d84f7176dfcd] Received unexpected event network-vif-plugged-0545369e-80c9-45cc-a9a2-330705df9241 for instance with vm_state active and task_state rebuild_spawning.
Aug 26 10:20:12 user nova-compute[73572]: DEBUG nova.compute.manager [req-4b98e55c-7c65-4ea4-9b15-25876e7fc38d req-1a80c1ba-cb98-4b19-b4c7-314d447962ac service nova] [instance: 339517ef-c023-4f13-a8cc-d84f7176dfcd] Received event network-vif-plugged-0545369e-80c9-45cc-a9a2-330705df9241 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:20:12 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-4b98e55c-7c65-4ea4-9b15-25876e7fc38d req-1a80c1ba-cb98-4b19-b4c7-314d447962ac service nova] Acquiring lock "339517ef-c023-4f13-a8cc-d84f7176dfcd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:20:12 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-4b98e55c-7c65-4ea4-9b15-25876e7fc38d req-1a80c1ba-cb98-4b19-b4c7-314d447962ac service nova] Lock "339517ef-c023-4f13-a8cc-d84f7176dfcd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:20:12 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-4b98e55c-7c65-4ea4-9b15-25876e7fc38d req-1a80c1ba-cb98-4b19-b4c7-314d447962ac service nova] Lock "339517ef-c023-4f13-a8cc-d84f7176dfcd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:20:12 user nova-compute[73572]: DEBUG nova.compute.manager [req-4b98e55c-7c65-4ea4-9b15-25876e7fc38d req-1a80c1ba-cb98-4b19-b4c7-314d447962ac service nova] [instance: 339517ef-c023-4f13-a8cc-d84f7176dfcd] No waiting events found dispatching network-vif-plugged-0545369e-80c9-45cc-a9a2-330705df9241 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:20:12 user nova-compute[73572]: WARNING nova.compute.manager [req-4b98e55c-7c65-4ea4-9b15-25876e7fc38d req-1a80c1ba-cb98-4b19-b4c7-314d447962ac service nova] [instance: 339517ef-c023-4f13-a8cc-d84f7176dfcd] Received unexpected event network-vif-plugged-0545369e-80c9-45cc-a9a2-330705df9241 for instance with vm_state active and task_state rebuild_spawning.
Aug 26 10:20:12 user nova-compute[73572]: DEBUG nova.virt.driver [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Emitting event <LifecycleEvent: 1693045212.985425, 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55 => Resumed> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:20:12 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55] VM Resumed (Lifecycle Event)
Aug 26 10:20:12 user nova-compute[73572]: DEBUG nova.compute.manager [None req-2873906f-13e4-4858-b75c-73cf8f5f8ec9 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] [instance: 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55] Instance event wait completed in 0 seconds for  {{(pid=73572) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 10:20:12 user nova-compute[73572]: INFO nova.virt.libvirt.driver [-] [instance: 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55] Instance running successfully.
Aug 26 10:20:13 user nova-compute[73572]: DEBUG nova.virt.libvirt.guest [None req-2873906f-13e4-4858-b75c-73cf8f5f8ec9 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] [instance: 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55] Failed to set time: agent not configured {{(pid=73572) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Aug 26 10:20:13 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-2873906f-13e4-4858-b75c-73cf8f5f8ec9 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] [instance: 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55] finish_migration finished successfully. {{(pid=73572) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Aug 26 10:20:13 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:20:13 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=73572) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 10:20:13 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 26 10:20:13 user nova-compute[73572]: DEBUG nova.virt.driver [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Emitting event <LifecycleEvent: 1693045212.9867165, 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55 => Started> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:20:13 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55] VM Started (Lifecycle Event)
Aug 26 10:20:13 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:20:13 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=73572) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 10:20:13 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 26 10:20:13 user nova-compute[73572]: DEBUG nova.virt.driver [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Emitting event <LifecycleEvent: 1693045213.1615744, 693f562f-ae3d-4cfb-926e-9990a1a301cb => Resumed> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:20:13 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 693f562f-ae3d-4cfb-926e-9990a1a301cb] VM Resumed (Lifecycle Event)
Aug 26 10:20:13 user nova-compute[73572]: DEBUG nova.compute.manager [None req-6d87a9c0-3c72-40f8-8ac9-def2ceeb0644 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] [instance: 693f562f-ae3d-4cfb-926e-9990a1a301cb] Instance event wait completed in 0 seconds for  {{(pid=73572) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 10:20:13 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-6d87a9c0-3c72-40f8-8ac9-def2ceeb0644 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] [instance: 693f562f-ae3d-4cfb-926e-9990a1a301cb] Guest created on hypervisor {{(pid=73572) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 10:20:13 user nova-compute[73572]: INFO nova.virt.libvirt.driver [-] [instance: 693f562f-ae3d-4cfb-926e-9990a1a301cb] Instance spawned successfully.
Aug 26 10:20:13 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-6d87a9c0-3c72-40f8-8ac9-def2ceeb0644 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] [instance: 693f562f-ae3d-4cfb-926e-9990a1a301cb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 10:20:13 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 693f562f-ae3d-4cfb-926e-9990a1a301cb] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:20:13 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 693f562f-ae3d-4cfb-926e-9990a1a301cb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73572) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 10:20:13 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-6d87a9c0-3c72-40f8-8ac9-def2ceeb0644 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] [instance: 693f562f-ae3d-4cfb-926e-9990a1a301cb] Found default for hw_cdrom_bus of ide {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:20:13 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-6d87a9c0-3c72-40f8-8ac9-def2ceeb0644 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] [instance: 693f562f-ae3d-4cfb-926e-9990a1a301cb] Found default for hw_disk_bus of virtio {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:20:13 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-6d87a9c0-3c72-40f8-8ac9-def2ceeb0644 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] [instance: 693f562f-ae3d-4cfb-926e-9990a1a301cb] Found default for hw_input_bus of None {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:20:13 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-6d87a9c0-3c72-40f8-8ac9-def2ceeb0644 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] [instance: 693f562f-ae3d-4cfb-926e-9990a1a301cb] Found default for hw_pointer_model of None {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:20:13 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-6d87a9c0-3c72-40f8-8ac9-def2ceeb0644 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] [instance: 693f562f-ae3d-4cfb-926e-9990a1a301cb] Found default for hw_video_model of virtio {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:20:13 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-6d87a9c0-3c72-40f8-8ac9-def2ceeb0644 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] [instance: 693f562f-ae3d-4cfb-926e-9990a1a301cb] Found default for hw_vif_model of virtio {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:20:13 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 693f562f-ae3d-4cfb-926e-9990a1a301cb] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 10:20:13 user nova-compute[73572]: DEBUG nova.virt.driver [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Emitting event <LifecycleEvent: 1693045213.1661317, 693f562f-ae3d-4cfb-926e-9990a1a301cb => Started> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:20:13 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 693f562f-ae3d-4cfb-926e-9990a1a301cb] VM Started (Lifecycle Event)
Aug 26 10:20:13 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 693f562f-ae3d-4cfb-926e-9990a1a301cb] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:20:13 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 693f562f-ae3d-4cfb-926e-9990a1a301cb] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73572) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 10:20:13 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 693f562f-ae3d-4cfb-926e-9990a1a301cb] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 10:20:13 user nova-compute[73572]: INFO nova.compute.manager [None req-6d87a9c0-3c72-40f8-8ac9-def2ceeb0644 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] [instance: 693f562f-ae3d-4cfb-926e-9990a1a301cb] Took 9.50 seconds to spawn the instance on the hypervisor.
Aug 26 10:20:13 user nova-compute[73572]: DEBUG nova.compute.manager [None req-6d87a9c0-3c72-40f8-8ac9-def2ceeb0644 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] [instance: 693f562f-ae3d-4cfb-926e-9990a1a301cb] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:20:13 user nova-compute[73572]: INFO nova.compute.manager [None req-6d87a9c0-3c72-40f8-8ac9-def2ceeb0644 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] [instance: 693f562f-ae3d-4cfb-926e-9990a1a301cb] Took 10.60 seconds to build instance.
Aug 26 10:20:13 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-6d87a9c0-3c72-40f8-8ac9-def2ceeb0644 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Lock "693f562f-ae3d-4cfb-926e-9990a1a301cb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.730s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:20:13 user nova-compute[73572]: DEBUG nova.virt.driver [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Emitting event <LifecycleEvent: 1693045213.6565077, 339517ef-c023-4f13-a8cc-d84f7176dfcd => Resumed> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:20:13 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 339517ef-c023-4f13-a8cc-d84f7176dfcd] VM Resumed (Lifecycle Event)
Aug 26 10:20:13 user nova-compute[73572]: DEBUG nova.compute.manager [None req-fa39d5b0-5f50-489a-8e4d-ffa55af9ad3e tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] [instance: 339517ef-c023-4f13-a8cc-d84f7176dfcd] Instance event wait completed in 0 seconds for  {{(pid=73572) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 10:20:13 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-fa39d5b0-5f50-489a-8e4d-ffa55af9ad3e tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] [instance: 339517ef-c023-4f13-a8cc-d84f7176dfcd] Guest created on hypervisor {{(pid=73572) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 10:20:13 user nova-compute[73572]: INFO nova.virt.libvirt.driver [-] [instance: 339517ef-c023-4f13-a8cc-d84f7176dfcd] Instance spawned successfully.
Aug 26 10:20:13 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-fa39d5b0-5f50-489a-8e4d-ffa55af9ad3e tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] [instance: 339517ef-c023-4f13-a8cc-d84f7176dfcd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 10:20:13 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 339517ef-c023-4f13-a8cc-d84f7176dfcd] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:20:13 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 339517ef-c023-4f13-a8cc-d84f7176dfcd] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=73572) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 10:20:13 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-fa39d5b0-5f50-489a-8e4d-ffa55af9ad3e tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] [instance: 339517ef-c023-4f13-a8cc-d84f7176dfcd] Found default for hw_cdrom_bus of ide {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:20:13 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-fa39d5b0-5f50-489a-8e4d-ffa55af9ad3e tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] [instance: 339517ef-c023-4f13-a8cc-d84f7176dfcd] Found default for hw_disk_bus of virtio {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:20:13 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-fa39d5b0-5f50-489a-8e4d-ffa55af9ad3e tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] [instance: 339517ef-c023-4f13-a8cc-d84f7176dfcd] Found default for hw_input_bus of None {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:20:13 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-fa39d5b0-5f50-489a-8e4d-ffa55af9ad3e tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] [instance: 339517ef-c023-4f13-a8cc-d84f7176dfcd] Found default for hw_pointer_model of None {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:20:13 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-fa39d5b0-5f50-489a-8e4d-ffa55af9ad3e tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] [instance: 339517ef-c023-4f13-a8cc-d84f7176dfcd] Found default for hw_video_model of virtio {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:20:13 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-fa39d5b0-5f50-489a-8e4d-ffa55af9ad3e tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] [instance: 339517ef-c023-4f13-a8cc-d84f7176dfcd] Found default for hw_vif_model of virtio {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:20:13 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 339517ef-c023-4f13-a8cc-d84f7176dfcd] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 26 10:20:13 user nova-compute[73572]: DEBUG nova.virt.driver [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Emitting event <LifecycleEvent: 1693045213.657638, 339517ef-c023-4f13-a8cc-d84f7176dfcd => Started> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:20:13 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 339517ef-c023-4f13-a8cc-d84f7176dfcd] VM Started (Lifecycle Event)
Aug 26 10:20:13 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 339517ef-c023-4f13-a8cc-d84f7176dfcd] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:20:13 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 339517ef-c023-4f13-a8cc-d84f7176dfcd] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=73572) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 10:20:13 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 339517ef-c023-4f13-a8cc-d84f7176dfcd] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 26 10:20:13 user nova-compute[73572]: DEBUG nova.compute.manager [None req-fa39d5b0-5f50-489a-8e4d-ffa55af9ad3e tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] [instance: 339517ef-c023-4f13-a8cc-d84f7176dfcd] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:20:13 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-fa39d5b0-5f50-489a-8e4d-ffa55af9ad3e tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:20:13 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-fa39d5b0-5f50-489a-8e4d-ffa55af9ad3e tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:20:13 user nova-compute[73572]: DEBUG nova.objects.instance [None req-fa39d5b0-5f50-489a-8e4d-ffa55af9ad3e tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] [instance: 339517ef-c023-4f13-a8cc-d84f7176dfcd] Trying to apply a migration context that does not seem to be set for this instance {{(pid=73572) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1078}}
Aug 26 10:20:13 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-fa39d5b0-5f50-489a-8e4d-ffa55af9ad3e tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.089s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:20:14 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:20:14 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:20:18 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:20:18 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:20:18 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Starting heal instance info cache {{(pid=73572) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 10:20:19 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquiring lock "refresh_cache-14fab12e-52be-4fe6-8777-bc7ebf3c25f1" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:20:19 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquired lock "refresh_cache-14fab12e-52be-4fe6-8777-bc7ebf3c25f1" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:20:19 user nova-compute[73572]: DEBUG nova.network.neutron [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] [instance: 14fab12e-52be-4fe6-8777-bc7ebf3c25f1] Forcefully refreshing network info cache for instance {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 10:20:19 user nova-compute[73572]: DEBUG nova.network.neutron [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] [instance: 14fab12e-52be-4fe6-8777-bc7ebf3c25f1] Updating instance_info_cache with network_info: [{"id": "1b2121f4-88b1-4815-9329-3c9e3172a2f6", "address": "fa:16:3e:b0:35:f5", "network": {"id": "991b9dff-5173-4456-a530-b1f7eb5cfa4a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1845930297-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4636f93c5bfc4653804de097aed2882c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b2121f4-88", "ovs_interfaceid": "1b2121f4-88b1-4815-9329-3c9e3172a2f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:20:19 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Releasing lock "refresh_cache-14fab12e-52be-4fe6-8777-bc7ebf3c25f1" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:20:19 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] [instance: 14fab12e-52be-4fe6-8777-bc7ebf3c25f1] Updated the network info_cache for instance {{(pid=73572) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 10:20:19 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:20:19 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:20:19 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:20:19 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:20:19 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:20:19 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73572) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 10:20:19 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:20:19 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:20:19 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73572) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 10:20:19 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73572) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 10:20:19 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73572) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 10:20:19 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:20:19 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:20:21 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-768c9be7-c527-4a2c-9e2f-d5a33ffcdf2d tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] Acquiring lock "8302d6e7-aaf3-461c-a55e-f2e685d1800d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:20:21 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-768c9be7-c527-4a2c-9e2f-d5a33ffcdf2d tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] Lock "8302d6e7-aaf3-461c-a55e-f2e685d1800d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:20:21 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-768c9be7-c527-4a2c-9e2f-d5a33ffcdf2d tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] Acquiring lock "8302d6e7-aaf3-461c-a55e-f2e685d1800d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:20:21 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-768c9be7-c527-4a2c-9e2f-d5a33ffcdf2d tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] Lock "8302d6e7-aaf3-461c-a55e-f2e685d1800d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:20:21 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-768c9be7-c527-4a2c-9e2f-d5a33ffcdf2d tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] Lock "8302d6e7-aaf3-461c-a55e-f2e685d1800d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:20:21 user nova-compute[73572]: INFO nova.compute.manager [None req-768c9be7-c527-4a2c-9e2f-d5a33ffcdf2d tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] [instance: 8302d6e7-aaf3-461c-a55e-f2e685d1800d] Terminating instance
Aug 26 10:20:21 user nova-compute[73572]: DEBUG nova.compute.manager [None req-768c9be7-c527-4a2c-9e2f-d5a33ffcdf2d tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] [instance: 8302d6e7-aaf3-461c-a55e-f2e685d1800d] Start destroying the instance on the hypervisor. {{(pid=73572) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 10:20:21 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:20:21 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:20:21 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:20:21 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:20:21 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:20:21 user nova-compute[73572]: DEBUG nova.compute.manager [req-0cff260c-6e9d-4a67-9677-055dfced3de9 req-146f7d8e-edef-4d84-b9c5-bd0cf7cbf2c7 service nova] [instance: 8302d6e7-aaf3-461c-a55e-f2e685d1800d] Received event network-vif-unplugged-61c82fb7-2eee-4be0-a37f-669791ea6d9c {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:20:21 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-0cff260c-6e9d-4a67-9677-055dfced3de9 req-146f7d8e-edef-4d84-b9c5-bd0cf7cbf2c7 service nova] Acquiring lock "8302d6e7-aaf3-461c-a55e-f2e685d1800d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:20:21 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-0cff260c-6e9d-4a67-9677-055dfced3de9 req-146f7d8e-edef-4d84-b9c5-bd0cf7cbf2c7 service nova] Lock "8302d6e7-aaf3-461c-a55e-f2e685d1800d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:20:21 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-0cff260c-6e9d-4a67-9677-055dfced3de9 req-146f7d8e-edef-4d84-b9c5-bd0cf7cbf2c7 service nova] Lock "8302d6e7-aaf3-461c-a55e-f2e685d1800d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:20:21 user nova-compute[73572]: DEBUG nova.compute.manager [req-0cff260c-6e9d-4a67-9677-055dfced3de9 req-146f7d8e-edef-4d84-b9c5-bd0cf7cbf2c7 service nova] [instance: 8302d6e7-aaf3-461c-a55e-f2e685d1800d] No waiting events found dispatching network-vif-unplugged-61c82fb7-2eee-4be0-a37f-669791ea6d9c {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:20:21 user nova-compute[73572]: DEBUG nova.compute.manager [req-0cff260c-6e9d-4a67-9677-055dfced3de9 req-146f7d8e-edef-4d84-b9c5-bd0cf7cbf2c7 service nova] [instance: 8302d6e7-aaf3-461c-a55e-f2e685d1800d] Received event network-vif-unplugged-61c82fb7-2eee-4be0-a37f-669791ea6d9c for instance with task_state deleting. {{(pid=73572) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 10:20:22 user nova-compute[73572]: INFO nova.virt.libvirt.driver [-] [instance: 8302d6e7-aaf3-461c-a55e-f2e685d1800d] Instance destroyed successfully.
Aug 26 10:20:22 user nova-compute[73572]: DEBUG nova.objects.instance [None req-768c9be7-c527-4a2c-9e2f-d5a33ffcdf2d tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] Lazy-loading 'resources' on Instance uuid 8302d6e7-aaf3-461c-a55e-f2e685d1800d {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:20:22 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-768c9be7-c527-4a2c-9e2f-d5a33ffcdf2d tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T10:11:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-643880944',display_name='tempest-ServersNegativeTestJSON-server-643880944',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-643880944',id=3,image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T10:11:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='27e946bd18464231965d43e20f1d2201',ramdisk_id='',reservation_id='r-7dmiqx3a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1661886679',owner_user_name='tempest-ServersNegativeTestJSON-1661886679-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T10:11:36Z,user_data=None,user_id='8efee83728774e58a60714e5c72cb1f2',uuid=8302d6e7-aaf3-461c-a55e-f2e685d1800d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "61c82fb7-2eee-4be0-a37f-669791ea6d9c", "address": "fa:16:3e:6a:1a:9f", "network": {"id": "f4c05fef-baf8-4c06-876f-1bdccd5a8689", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-169805980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27e946bd18464231965d43e20f1d2201", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61c82fb7-2e", "ovs_interfaceid": "61c82fb7-2eee-4be0-a37f-669791ea6d9c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 10:20:22 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-768c9be7-c527-4a2c-9e2f-d5a33ffcdf2d tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] Converting VIF {"id": "61c82fb7-2eee-4be0-a37f-669791ea6d9c", "address": "fa:16:3e:6a:1a:9f", "network": {"id": "f4c05fef-baf8-4c06-876f-1bdccd5a8689", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-169805980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27e946bd18464231965d43e20f1d2201", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61c82fb7-2e", "ovs_interfaceid": "61c82fb7-2eee-4be0-a37f-669791ea6d9c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:20:22 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-768c9be7-c527-4a2c-9e2f-d5a33ffcdf2d tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6a:1a:9f,bridge_name='br-int',has_traffic_filtering=True,id=61c82fb7-2eee-4be0-a37f-669791ea6d9c,network=Network(f4c05fef-baf8-4c06-876f-1bdccd5a8689),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61c82fb7-2e') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:20:22 user nova-compute[73572]: DEBUG os_vif [None req-768c9be7-c527-4a2c-9e2f-d5a33ffcdf2d tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6a:1a:9f,bridge_name='br-int',has_traffic_filtering=True,id=61c82fb7-2eee-4be0-a37f-669791ea6d9c,network=Network(f4c05fef-baf8-4c06-876f-1bdccd5a8689),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61c82fb7-2e') {{(pid=73572) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 10:20:22 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:20:22 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap61c82fb7-2e, bridge=br-int, if_exists=True) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:20:22 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:20:22 user nova-compute[73572]: INFO os_vif [None req-768c9be7-c527-4a2c-9e2f-d5a33ffcdf2d tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6a:1a:9f,bridge_name='br-int',has_traffic_filtering=True,id=61c82fb7-2eee-4be0-a37f-669791ea6d9c,network=Network(f4c05fef-baf8-4c06-876f-1bdccd5a8689),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61c82fb7-2e')
Aug 26 10:20:22 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-768c9be7-c527-4a2c-9e2f-d5a33ffcdf2d tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] [instance: 8302d6e7-aaf3-461c-a55e-f2e685d1800d] Deleting instance files /opt/stack/data/nova/instances/8302d6e7-aaf3-461c-a55e-f2e685d1800d_del
Aug 26 10:20:22 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-768c9be7-c527-4a2c-9e2f-d5a33ffcdf2d tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] [instance: 8302d6e7-aaf3-461c-a55e-f2e685d1800d] Deletion of /opt/stack/data/nova/instances/8302d6e7-aaf3-461c-a55e-f2e685d1800d_del complete
Aug 26 10:20:22 user nova-compute[73572]: INFO nova.compute.manager [None req-768c9be7-c527-4a2c-9e2f-d5a33ffcdf2d tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] [instance: 8302d6e7-aaf3-461c-a55e-f2e685d1800d] Took 0.91 seconds to destroy the instance on the hypervisor.
Aug 26 10:20:22 user nova-compute[73572]: DEBUG oslo.service.loopingcall [None req-768c9be7-c527-4a2c-9e2f-d5a33ffcdf2d tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73572) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 10:20:22 user nova-compute[73572]: DEBUG nova.compute.manager [-] [instance: 8302d6e7-aaf3-461c-a55e-f2e685d1800d] Deallocating network for instance {{(pid=73572) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 10:20:22 user nova-compute[73572]: DEBUG nova.network.neutron [-] [instance: 8302d6e7-aaf3-461c-a55e-f2e685d1800d] deallocate_for_instance() {{(pid=73572) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 10:20:22 user nova-compute[73572]: DEBUG nova.network.neutron [-] [instance: 8302d6e7-aaf3-461c-a55e-f2e685d1800d] Updating instance_info_cache with network_info: [] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:20:22 user nova-compute[73572]: INFO nova.compute.manager [-] [instance: 8302d6e7-aaf3-461c-a55e-f2e685d1800d] Took 0.55 seconds to deallocate network for instance.
Aug 26 10:20:22 user nova-compute[73572]: DEBUG nova.compute.manager [req-66c160ca-c494-4b1c-b9a3-a4d41e522af3 req-b190ab21-30fa-4645-bb81-99d8a5004720 service nova] [instance: 8302d6e7-aaf3-461c-a55e-f2e685d1800d] Received event network-vif-deleted-61c82fb7-2eee-4be0-a37f-669791ea6d9c {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:20:22 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-768c9be7-c527-4a2c-9e2f-d5a33ffcdf2d tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:20:22 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-768c9be7-c527-4a2c-9e2f-d5a33ffcdf2d tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:20:22 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:20:22 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:20:22 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:20:23 user nova-compute[73572]: DEBUG nova.compute.provider_tree [None req-768c9be7-c527-4a2c-9e2f-d5a33ffcdf2d tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] Inventory has not changed in ProviderTree for provider: e2cec974-59b2-4c77-a53d-a7f4e5a30d75 {{(pid=73572) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 10:20:23 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-768c9be7-c527-4a2c-9e2f-d5a33ffcdf2d tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] Inventory has not changed for provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73572) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 10:20:23 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-768c9be7-c527-4a2c-9e2f-d5a33ffcdf2d tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.476s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:20:23 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.409s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:20:23 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:20:23 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Auditing locally available compute resources for user (node: user) {{(pid=73572) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 10:20:23 user nova-compute[73572]: INFO nova.scheduler.client.report [None req-768c9be7-c527-4a2c-9e2f-d5a33ffcdf2d tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] Deleted allocations for instance 8302d6e7-aaf3-461c-a55e-f2e685d1800d
Aug 26 10:20:23 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-768c9be7-c527-4a2c-9e2f-d5a33ffcdf2d tempest-ServersNegativeTestJSON-1661886679 tempest-ServersNegativeTestJSON-1661886679-project-member] Lock "8302d6e7-aaf3-461c-a55e-f2e685d1800d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.147s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:20:23 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c901bbcc-3d82-4550-888f-bdbb36ba052d/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:20:23 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c901bbcc-3d82-4550-888f-bdbb36ba052d/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:20:23 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c901bbcc-3d82-4550-888f-bdbb36ba052d/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:20:23 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c901bbcc-3d82-4550-888f-bdbb36ba052d/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:20:23 user nova-compute[73572]: DEBUG nova.compute.manager [req-0bdfddce-4997-48b5-9c46-26a0887156dc req-5b6f06fa-9ffd-44b8-94a4-30b91def7969 service nova] [instance: 8302d6e7-aaf3-461c-a55e-f2e685d1800d] Received event network-vif-plugged-61c82fb7-2eee-4be0-a37f-669791ea6d9c {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:20:23 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-0bdfddce-4997-48b5-9c46-26a0887156dc req-5b6f06fa-9ffd-44b8-94a4-30b91def7969 service nova] Acquiring lock "8302d6e7-aaf3-461c-a55e-f2e685d1800d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:20:23 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-0bdfddce-4997-48b5-9c46-26a0887156dc req-5b6f06fa-9ffd-44b8-94a4-30b91def7969 service nova] Lock "8302d6e7-aaf3-461c-a55e-f2e685d1800d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:20:23 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-0bdfddce-4997-48b5-9c46-26a0887156dc req-5b6f06fa-9ffd-44b8-94a4-30b91def7969 service nova] Lock "8302d6e7-aaf3-461c-a55e-f2e685d1800d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:20:23 user nova-compute[73572]: DEBUG nova.compute.manager [req-0bdfddce-4997-48b5-9c46-26a0887156dc req-5b6f06fa-9ffd-44b8-94a4-30b91def7969 service nova] [instance: 8302d6e7-aaf3-461c-a55e-f2e685d1800d] No waiting events found dispatching network-vif-plugged-61c82fb7-2eee-4be0-a37f-669791ea6d9c {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:20:23 user nova-compute[73572]: WARNING nova.compute.manager [req-0bdfddce-4997-48b5-9c46-26a0887156dc req-5b6f06fa-9ffd-44b8-94a4-30b91def7969 service nova] [instance: 8302d6e7-aaf3-461c-a55e-f2e685d1800d] Received unexpected event network-vif-plugged-61c82fb7-2eee-4be0-a37f-669791ea6d9c for instance with vm_state deleted and task_state None.
Aug 26 10:20:23 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c785b609-0068-442f-91f5-d26e888a993f/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:20:24 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c785b609-0068-442f-91f5-d26e888a993f/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:20:24 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c785b609-0068-442f-91f5-d26e888a993f/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:20:24 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c785b609-0068-442f-91f5-d26e888a993f/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:20:24 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44a737bf-3704-4193-8d24-b8d132267279/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:20:24 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44a737bf-3704-4193-8d24-b8d132267279/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:20:24 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44a737bf-3704-4193-8d24-b8d132267279/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:20:24 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44a737bf-3704-4193-8d24-b8d132267279/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:20:24 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/693f562f-ae3d-4cfb-926e-9990a1a301cb/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:20:24 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/693f562f-ae3d-4cfb-926e-9990a1a301cb/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:20:24 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/693f562f-ae3d-4cfb-926e-9990a1a301cb/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:20:25 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/693f562f-ae3d-4cfb-926e-9990a1a301cb/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:20:25 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00c47a06-2bf8-427d-bcb1-304688584511/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:20:25 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00c47a06-2bf8-427d-bcb1-304688584511/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:20:25 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00c47a06-2bf8-427d-bcb1-304688584511/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:20:25 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00c47a06-2bf8-427d-bcb1-304688584511/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:20:25 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73572) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 10:20:25 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86923c1a-89a5-4e7a-b488-8bf3a013bf83/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:20:25 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86923c1a-89a5-4e7a-b488-8bf3a013bf83/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:20:25 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86923c1a-89a5-4e7a-b488-8bf3a013bf83/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:20:25 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86923c1a-89a5-4e7a-b488-8bf3a013bf83/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:20:25 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=73572) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 10:20:25 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/682138af-ba6a-47f1-a9a5-03ae2661f54d/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:20:26 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/682138af-ba6a-47f1-a9a5-03ae2661f54d/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:20:26 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/682138af-ba6a-47f1-a9a5-03ae2661f54d/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:20:26 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/682138af-ba6a-47f1-a9a5-03ae2661f54d/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:20:26 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=73572) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 10:20:26 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73572) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 10:20:26 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2970584-8c2a-4f99-922c-d66d59489504/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:20:26 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2970584-8c2a-4f99-922c-d66d59489504/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:20:26 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2970584-8c2a-4f99-922c-d66d59489504/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:20:26 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2970584-8c2a-4f99-922c-d66d59489504/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:20:26 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2eaea7c2-a5c0-4950-b033-0012b5cec0ee/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:20:27 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2eaea7c2-a5c0-4950-b033-0012b5cec0ee/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:20:27 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2eaea7c2-a5c0-4950-b033-0012b5cec0ee/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:20:27 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:20:27 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2eaea7c2-a5c0-4950-b033-0012b5cec0ee/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:20:27 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fe47a17-4ffb-48ce-b0f6-a9b43002bd55/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:20:27 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fe47a17-4ffb-48ce-b0f6-a9b43002bd55/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:20:27 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fe47a17-4ffb-48ce-b0f6-a9b43002bd55/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:20:27 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fe47a17-4ffb-48ce-b0f6-a9b43002bd55/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:20:27 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73572) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 10:20:28 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:20:28 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:20:28 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Hypervisor/Node resource view: name=user free_ram=6795MB free_disk=25.14511489868164GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=73572) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 10:20:28 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:20:28 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:20:28 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Applying migration context for instance 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55 as it has an incoming, in-progress migration 1eeef6fc-489c-436a-9c1c-404ef89802a6. Migration status is finished {{(pid=73572) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 26 10:20:28 user nova-compute[73572]: INFO nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] [instance: 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55] Updating resource usage from migration 1eeef6fc-489c-436a-9c1c-404ef89802a6
Aug 26 10:20:28 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance c785b609-0068-442f-91f5-d26e888a993f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:20:28 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance 14fab12e-52be-4fe6-8777-bc7ebf3c25f1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:20:28 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance 00c47a06-2bf8-427d-bcb1-304688584511 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:20:28 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance d2970584-8c2a-4f99-922c-d66d59489504 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:20:28 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance 682138af-ba6a-47f1-a9a5-03ae2661f54d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:20:28 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance 339517ef-c023-4f13-a8cc-d84f7176dfcd actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:20:28 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance c901bbcc-3d82-4550-888f-bdbb36ba052d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:20:28 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance 2eaea7c2-a5c0-4950-b033-0012b5cec0ee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:20:28 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance 86923c1a-89a5-4e7a-b488-8bf3a013bf83 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:20:28 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Migration 1eeef6fc-489c-436a-9c1c-404ef89802a6 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 26 10:20:28 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:20:28 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance 44a737bf-3704-4193-8d24-b8d132267279 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:20:28 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance 693f562f-ae3d-4cfb-926e-9990a1a301cb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:20:28 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=73572) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 10:20:28 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Final resource view: name=user phys_ram=16011MB used_ram=8704MB phys_disk=40GB used_disk=30GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=73572) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 10:20:28 user nova-compute[73572]: DEBUG nova.compute.provider_tree [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Inventory has not changed in ProviderTree for provider: e2cec974-59b2-4c77-a53d-a7f4e5a30d75 {{(pid=73572) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 10:20:28 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Inventory has not changed for provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73572) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 10:20:28 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Compute_service record updated for user:user {{(pid=73572) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 10:20:28 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.689s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:20:29 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:20:32 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:20:34 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:20:37 user nova-compute[73572]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693045222.051521, 8302d6e7-aaf3-461c-a55e-f2e685d1800d => Stopped> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:20:37 user nova-compute[73572]: INFO nova.compute.manager [-] [instance: 8302d6e7-aaf3-461c-a55e-f2e685d1800d] VM Stopped (Lifecycle Event)
Aug 26 10:20:37 user nova-compute[73572]: DEBUG nova.compute.manager [None req-58889f0f-c7ac-49dd-b177-2ae329a184fa None None] [instance: 8302d6e7-aaf3-461c-a55e-f2e685d1800d] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:20:37 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:20:39 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:20:41 user nova-compute[73572]: DEBUG nova.compute.manager [req-e0c37afc-c21c-4acf-a3e5-10109e8595cf req-2413d9a1-eb28-4427-a8cd-56132fd53a2e service nova] [instance: c901bbcc-3d82-4550-888f-bdbb36ba052d] Received event network-changed-7c475446-2ad9-4502-b116-274f100e4d6c {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:20:41 user nova-compute[73572]: DEBUG nova.compute.manager [req-e0c37afc-c21c-4acf-a3e5-10109e8595cf req-2413d9a1-eb28-4427-a8cd-56132fd53a2e service nova] [instance: c901bbcc-3d82-4550-888f-bdbb36ba052d] Refreshing instance network info cache due to event network-changed-7c475446-2ad9-4502-b116-274f100e4d6c. {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 10:20:41 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-e0c37afc-c21c-4acf-a3e5-10109e8595cf req-2413d9a1-eb28-4427-a8cd-56132fd53a2e service nova] Acquiring lock "refresh_cache-c901bbcc-3d82-4550-888f-bdbb36ba052d" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:20:41 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-e0c37afc-c21c-4acf-a3e5-10109e8595cf req-2413d9a1-eb28-4427-a8cd-56132fd53a2e service nova] Acquired lock "refresh_cache-c901bbcc-3d82-4550-888f-bdbb36ba052d" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:20:41 user nova-compute[73572]: DEBUG nova.network.neutron [req-e0c37afc-c21c-4acf-a3e5-10109e8595cf req-2413d9a1-eb28-4427-a8cd-56132fd53a2e service nova] [instance: c901bbcc-3d82-4550-888f-bdbb36ba052d] Refreshing network info cache for port 7c475446-2ad9-4502-b116-274f100e4d6c {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 10:20:42 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:20:42 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-eed35489-3d02-4d85-b101-567b1b71006c tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Acquiring lock "c901bbcc-3d82-4550-888f-bdbb36ba052d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:20:42 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-eed35489-3d02-4d85-b101-567b1b71006c tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Lock "c901bbcc-3d82-4550-888f-bdbb36ba052d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:20:42 user nova-compute[73572]: DEBUG nova.objects.instance [None req-eed35489-3d02-4d85-b101-567b1b71006c tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Lazy-loading 'flavor' on Instance uuid c901bbcc-3d82-4550-888f-bdbb36ba052d {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:20:42 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-eed35489-3d02-4d85-b101-567b1b71006c tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Lock "c901bbcc-3d82-4550-888f-bdbb36ba052d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:20:42 user nova-compute[73572]: DEBUG nova.network.neutron [req-e0c37afc-c21c-4acf-a3e5-10109e8595cf req-2413d9a1-eb28-4427-a8cd-56132fd53a2e service nova] [instance: c901bbcc-3d82-4550-888f-bdbb36ba052d] Updated VIF entry in instance network info cache for port 7c475446-2ad9-4502-b116-274f100e4d6c. {{(pid=73572) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 10:20:42 user nova-compute[73572]: DEBUG nova.network.neutron [req-e0c37afc-c21c-4acf-a3e5-10109e8595cf req-2413d9a1-eb28-4427-a8cd-56132fd53a2e service nova] [instance: c901bbcc-3d82-4550-888f-bdbb36ba052d] Updating instance_info_cache with network_info: [{"id": "7c475446-2ad9-4502-b116-274f100e4d6c", "address": "fa:16:3e:b7:b1:84", "network": {"id": "e565abb6-25f8-4f92-9cca-69db36e4216a", "bridge": "br-int", "label": "tempest-TestStampPattern-1866566708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.124", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f2be8d4c6c147e98a1b5b7443b3828d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c475446-2a", "ovs_interfaceid": "7c475446-2ad9-4502-b116-274f100e4d6c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:20:42 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-e0c37afc-c21c-4acf-a3e5-10109e8595cf req-2413d9a1-eb28-4427-a8cd-56132fd53a2e service nova] Releasing lock "refresh_cache-c901bbcc-3d82-4550-888f-bdbb36ba052d" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:20:42 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-eed35489-3d02-4d85-b101-567b1b71006c tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Acquiring lock "c901bbcc-3d82-4550-888f-bdbb36ba052d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:20:42 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-eed35489-3d02-4d85-b101-567b1b71006c tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Lock "c901bbcc-3d82-4550-888f-bdbb36ba052d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:20:42 user nova-compute[73572]: INFO nova.compute.manager [None req-eed35489-3d02-4d85-b101-567b1b71006c tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] [instance: c901bbcc-3d82-4550-888f-bdbb36ba052d] Attaching volume ae53c4d0-f1af-4b58-8f15-df8b327554b9 to /dev/vdb
Aug 26 10:20:42 user nova-compute[73572]: DEBUG os_brick.utils [None req-eed35489-3d02-4d85-b101-567b1b71006c tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 10:20:42 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:20:42 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:20:42 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[9300e62f-f253-49ed-9356-4be941705739]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:de8a79ed912\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:20:42 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:20:42 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:20:42 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb501425-db62-49e9-b52a-3d3b78664e4f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:20:42 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:20:42 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:20:42 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[596b4927-8f98-4deb-9eb8-5517fdadda9a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:20:42 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[b84b8b38-cbc9-4b52-9770-a7fb4bf74362]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:20:42 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-eed35489-3d02-4d85-b101-567b1b71006c tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Running cmd (subprocess): nvme version {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:20:42 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-eed35489-3d02-4d85-b101-567b1b71006c tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] 'nvme version' failed. Not Retrying. {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 10:20:42 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.nvmeof [None req-eed35489-3d02-4d85-b101-567b1b71006c tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] nvme not present on system {{(pid=73572) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 10:20:42 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:20:42 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 10:20:42 user nova-compute[73572]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 10:20:42 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[12bd905b-ab9d-40cf-86ea-5c2ec0bd23df]: (4, '') {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:20:42 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.lightos [None req-eed35489-3d02-4d85-b101-567b1b71006c tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73572) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 10:20:42 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.lightos [None req-eed35489-3d02-4d85-b101-567b1b71006c tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73572) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 10:20:42 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.lightos [None req-eed35489-3d02-4d85-b101-567b1b71006c tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] LIGHTOS: no hostnqn found. {{(pid=73572) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 10:20:42 user nova-compute[73572]: DEBUG os_brick.utils [None req-eed35489-3d02-4d85-b101-567b1b71006c tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] <== get_connector_properties: return (148ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:de8a79ed912', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 10:20:42 user nova-compute[73572]: DEBUG nova.virt.block_device [None req-eed35489-3d02-4d85-b101-567b1b71006c tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] [instance: c901bbcc-3d82-4550-888f-bdbb36ba052d] Updating existing volume attachment record: 96fe44bc-fc57-4d85-9cd4-52534fdd34bf {{(pid=73572) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 10:20:44 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:20:46 user nova-compute[73572]: DEBUG nova.compute.manager [req-40b8e087-e9e6-44bc-8fe7-2966f8ca59b5 req-36c7ca77-0144-4f57-b409-0c9805e48925 service nova] [instance: 682138af-ba6a-47f1-a9a5-03ae2661f54d] Received event network-changed-72fe24f4-00e3-40f1-a44a-014c7669e862 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:20:46 user nova-compute[73572]: DEBUG nova.compute.manager [req-40b8e087-e9e6-44bc-8fe7-2966f8ca59b5 req-36c7ca77-0144-4f57-b409-0c9805e48925 service nova] [instance: 682138af-ba6a-47f1-a9a5-03ae2661f54d] Refreshing instance network info cache due to event network-changed-72fe24f4-00e3-40f1-a44a-014c7669e862. {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 10:20:46 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-40b8e087-e9e6-44bc-8fe7-2966f8ca59b5 req-36c7ca77-0144-4f57-b409-0c9805e48925 service nova] Acquiring lock "refresh_cache-682138af-ba6a-47f1-a9a5-03ae2661f54d" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:20:46 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-40b8e087-e9e6-44bc-8fe7-2966f8ca59b5 req-36c7ca77-0144-4f57-b409-0c9805e48925 service nova] Acquired lock "refresh_cache-682138af-ba6a-47f1-a9a5-03ae2661f54d" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:20:46 user nova-compute[73572]: DEBUG nova.network.neutron [req-40b8e087-e9e6-44bc-8fe7-2966f8ca59b5 req-36c7ca77-0144-4f57-b409-0c9805e48925 service nova] [instance: 682138af-ba6a-47f1-a9a5-03ae2661f54d] Refreshing network info cache for port 72fe24f4-00e3-40f1-a44a-014c7669e862 {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 10:20:46 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-c8274766-7547-4a10-8ad1-e0cb29aae49a tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Acquiring lock "e468b473-515f-41ad-a75c-65d4c6d575c8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:20:46 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-c8274766-7547-4a10-8ad1-e0cb29aae49a tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Lock "e468b473-515f-41ad-a75c-65d4c6d575c8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:20:46 user nova-compute[73572]: DEBUG nova.compute.manager [None req-c8274766-7547-4a10-8ad1-e0cb29aae49a tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: e468b473-515f-41ad-a75c-65d4c6d575c8] Starting instance... {{(pid=73572) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 10:20:46 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-c8274766-7547-4a10-8ad1-e0cb29aae49a tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:20:46 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-c8274766-7547-4a10-8ad1-e0cb29aae49a tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:20:46 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-c8274766-7547-4a10-8ad1-e0cb29aae49a tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73572) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 10:20:46 user nova-compute[73572]: INFO nova.compute.claims [None req-c8274766-7547-4a10-8ad1-e0cb29aae49a tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: e468b473-515f-41ad-a75c-65d4c6d575c8] Claim successful on node user
Aug 26 10:20:47 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:20:47 user nova-compute[73572]: DEBUG nova.network.neutron [req-40b8e087-e9e6-44bc-8fe7-2966f8ca59b5 req-36c7ca77-0144-4f57-b409-0c9805e48925 service nova] [instance: 682138af-ba6a-47f1-a9a5-03ae2661f54d] Updated VIF entry in instance network info cache for port 72fe24f4-00e3-40f1-a44a-014c7669e862. {{(pid=73572) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 10:20:47 user nova-compute[73572]: DEBUG nova.network.neutron [req-40b8e087-e9e6-44bc-8fe7-2966f8ca59b5 req-36c7ca77-0144-4f57-b409-0c9805e48925 service nova] [instance: 682138af-ba6a-47f1-a9a5-03ae2661f54d] Updating instance_info_cache with network_info: [{"id": "72fe24f4-00e3-40f1-a44a-014c7669e862", "address": "fa:16:3e:d2:52:c7", "network": {"id": "2a6e27c9-9bd2-4ccb-abf6-82d85524da90", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1822065121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb6ef2597eac461f959a568abd3031ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72fe24f4-00", "ovs_interfaceid": "72fe24f4-00e3-40f1-a44a-014c7669e862", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:20:47 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-40b8e087-e9e6-44bc-8fe7-2966f8ca59b5 req-36c7ca77-0144-4f57-b409-0c9805e48925 service nova] Releasing lock "refresh_cache-682138af-ba6a-47f1-a9a5-03ae2661f54d" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:20:47 user nova-compute[73572]: DEBUG nova.compute.manager [req-5fa8d3b6-169b-4a93-867f-087dec2b0b5c req-a6703ecf-a646-46f3-a2ba-4ff6d0112aac service nova] [instance: 682138af-ba6a-47f1-a9a5-03ae2661f54d] Received event network-changed-72fe24f4-00e3-40f1-a44a-014c7669e862 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:20:47 user nova-compute[73572]: DEBUG nova.compute.manager [req-5fa8d3b6-169b-4a93-867f-087dec2b0b5c req-a6703ecf-a646-46f3-a2ba-4ff6d0112aac service nova] [instance: 682138af-ba6a-47f1-a9a5-03ae2661f54d] Refreshing instance network info cache due to event network-changed-72fe24f4-00e3-40f1-a44a-014c7669e862. {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 10:20:47 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-5fa8d3b6-169b-4a93-867f-087dec2b0b5c req-a6703ecf-a646-46f3-a2ba-4ff6d0112aac service nova] Acquiring lock "refresh_cache-682138af-ba6a-47f1-a9a5-03ae2661f54d" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:20:47 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-5fa8d3b6-169b-4a93-867f-087dec2b0b5c req-a6703ecf-a646-46f3-a2ba-4ff6d0112aac service nova] Acquired lock "refresh_cache-682138af-ba6a-47f1-a9a5-03ae2661f54d" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:20:47 user nova-compute[73572]: DEBUG nova.network.neutron [req-5fa8d3b6-169b-4a93-867f-087dec2b0b5c req-a6703ecf-a646-46f3-a2ba-4ff6d0112aac service nova] [instance: 682138af-ba6a-47f1-a9a5-03ae2661f54d] Refreshing network info cache for port 72fe24f4-00e3-40f1-a44a-014c7669e862 {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 10:20:47 user nova-compute[73572]: DEBUG nova.compute.provider_tree [None req-c8274766-7547-4a10-8ad1-e0cb29aae49a tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Inventory has not changed in ProviderTree for provider: e2cec974-59b2-4c77-a53d-a7f4e5a30d75 {{(pid=73572) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 10:20:47 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-c8274766-7547-4a10-8ad1-e0cb29aae49a tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Inventory has not changed for provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73572) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 10:20:47 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-c8274766-7547-4a10-8ad1-e0cb29aae49a tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.623s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:20:47 user nova-compute[73572]: DEBUG nova.compute.manager [None req-c8274766-7547-4a10-8ad1-e0cb29aae49a tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: e468b473-515f-41ad-a75c-65d4c6d575c8] Start building networks asynchronously for instance. {{(pid=73572) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 10:20:47 user nova-compute[73572]: DEBUG nova.compute.manager [None req-c8274766-7547-4a10-8ad1-e0cb29aae49a tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: e468b473-515f-41ad-a75c-65d4c6d575c8] Allocating IP information in the background. {{(pid=73572) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 10:20:47 user nova-compute[73572]: DEBUG nova.network.neutron [None req-c8274766-7547-4a10-8ad1-e0cb29aae49a tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: e468b473-515f-41ad-a75c-65d4c6d575c8] allocate_for_instance() {{(pid=73572) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 10:20:47 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-c8274766-7547-4a10-8ad1-e0cb29aae49a tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: e468b473-515f-41ad-a75c-65d4c6d575c8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 10:20:47 user nova-compute[73572]: DEBUG nova.compute.manager [None req-c8274766-7547-4a10-8ad1-e0cb29aae49a tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: e468b473-515f-41ad-a75c-65d4c6d575c8] Start building block device mappings for instance. {{(pid=73572) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 10:20:47 user nova-compute[73572]: DEBUG nova.policy [None req-c8274766-7547-4a10-8ad1-e0cb29aae49a tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '07f3538038a14713af3bbe420f1fb03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4636f93c5bfc4653804de097aed2882c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73572) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 10:20:47 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-855e697f-e8e5-4fff-91ec-cd46534d2a03 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Acquiring lock "682138af-ba6a-47f1-a9a5-03ae2661f54d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:20:47 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-855e697f-e8e5-4fff-91ec-cd46534d2a03 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Lock "682138af-ba6a-47f1-a9a5-03ae2661f54d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:20:47 user nova-compute[73572]: INFO nova.compute.manager [None req-855e697f-e8e5-4fff-91ec-cd46534d2a03 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] [instance: 682138af-ba6a-47f1-a9a5-03ae2661f54d] Detaching volume 302c3cfe-f0ec-4b1c-b1d9-dc12d4f4ce40
Aug 26 10:20:47 user nova-compute[73572]: DEBUG nova.compute.manager [None req-c8274766-7547-4a10-8ad1-e0cb29aae49a tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: e468b473-515f-41ad-a75c-65d4c6d575c8] Start spawning the instance on the hypervisor. {{(pid=73572) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 10:20:47 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-c8274766-7547-4a10-8ad1-e0cb29aae49a tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: e468b473-515f-41ad-a75c-65d4c6d575c8] Creating instance directory {{(pid=73572) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 10:20:47 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-c8274766-7547-4a10-8ad1-e0cb29aae49a tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: e468b473-515f-41ad-a75c-65d4c6d575c8] Creating image(s)
Aug 26 10:20:47 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-c8274766-7547-4a10-8ad1-e0cb29aae49a tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Acquiring lock "/opt/stack/data/nova/instances/e468b473-515f-41ad-a75c-65d4c6d575c8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:20:47 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-c8274766-7547-4a10-8ad1-e0cb29aae49a tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Lock "/opt/stack/data/nova/instances/e468b473-515f-41ad-a75c-65d4c6d575c8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:20:47 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-c8274766-7547-4a10-8ad1-e0cb29aae49a tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Lock "/opt/stack/data/nova/instances/e468b473-515f-41ad-a75c-65d4c6d575c8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:20:47 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-c8274766-7547-4a10-8ad1-e0cb29aae49a tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:20:47 user nova-compute[73572]: INFO nova.virt.block_device [None req-855e697f-e8e5-4fff-91ec-cd46534d2a03 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] [instance: 682138af-ba6a-47f1-a9a5-03ae2661f54d] Attempting to driver detach volume 302c3cfe-f0ec-4b1c-b1d9-dc12d4f4ce40 from mountpoint /dev/vdb
Aug 26 10:20:47 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-855e697f-e8e5-4fff-91ec-cd46534d2a03 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Attempting to detach device vdb from instance 682138af-ba6a-47f1-a9a5-03ae2661f54d from the persistent domain config. {{(pid=73572) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 10:20:47 user nova-compute[73572]: DEBUG nova.virt.libvirt.guest [None req-855e697f-e8e5-4fff-91ec-cd46534d2a03 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 10:20:47 user nova-compute[73572]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 10:20:47 user nova-compute[73572]:   <source dev="/dev/sdh"/>
Aug 26 10:20:47 user nova-compute[73572]:   <target dev="vdb" bus="virtio"/>
Aug 26 10:20:47 user nova-compute[73572]:   <serial>302c3cfe-f0ec-4b1c-b1d9-dc12d4f4ce40</serial>
Aug 26 10:20:47 user nova-compute[73572]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 26 10:20:47 user nova-compute[73572]: </disk>
Aug 26 10:20:47 user nova-compute[73572]:  {{(pid=73572) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 10:20:47 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-855e697f-e8e5-4fff-91ec-cd46534d2a03 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Successfully detached device vdb from instance 682138af-ba6a-47f1-a9a5-03ae2661f54d from the persistent domain config.
Aug 26 10:20:47 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-855e697f-e8e5-4fff-91ec-cd46534d2a03 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 682138af-ba6a-47f1-a9a5-03ae2661f54d from the live domain config. {{(pid=73572) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 10:20:47 user nova-compute[73572]: DEBUG nova.virt.libvirt.guest [None req-855e697f-e8e5-4fff-91ec-cd46534d2a03 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 10:20:47 user nova-compute[73572]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 10:20:47 user nova-compute[73572]:   <source dev="/dev/sdh"/>
Aug 26 10:20:47 user nova-compute[73572]:   <target dev="vdb" bus="virtio"/>
Aug 26 10:20:47 user nova-compute[73572]:   <serial>302c3cfe-f0ec-4b1c-b1d9-dc12d4f4ce40</serial>
Aug 26 10:20:47 user nova-compute[73572]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 26 10:20:47 user nova-compute[73572]: </disk>
Aug 26 10:20:47 user nova-compute[73572]:  {{(pid=73572) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 10:20:47 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-c8274766-7547-4a10-8ad1-e0cb29aae49a tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json" returned: 0 in 0.210s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:20:47 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-c8274766-7547-4a10-8ad1-e0cb29aae49a tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Acquiring lock "2099350d6f3bcd0de9471c73862d4fe75b049801" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:20:47 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-c8274766-7547-4a10-8ad1-e0cb29aae49a tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Lock "2099350d6f3bcd0de9471c73862d4fe75b049801" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:20:47 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-c8274766-7547-4a10-8ad1-e0cb29aae49a tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:20:48 user nova-compute[73572]: DEBUG nova.network.neutron [req-5fa8d3b6-169b-4a93-867f-087dec2b0b5c req-a6703ecf-a646-46f3-a2ba-4ff6d0112aac service nova] [instance: 682138af-ba6a-47f1-a9a5-03ae2661f54d] Updated VIF entry in instance network info cache for port 72fe24f4-00e3-40f1-a44a-014c7669e862. {{(pid=73572) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 10:20:48 user nova-compute[73572]: DEBUG nova.network.neutron [req-5fa8d3b6-169b-4a93-867f-087dec2b0b5c req-a6703ecf-a646-46f3-a2ba-4ff6d0112aac service nova] [instance: 682138af-ba6a-47f1-a9a5-03ae2661f54d] Updating instance_info_cache with network_info: [{"id": "72fe24f4-00e3-40f1-a44a-014c7669e862", "address": "fa:16:3e:d2:52:c7", "network": {"id": "2a6e27c9-9bd2-4ccb-abf6-82d85524da90", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1822065121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb6ef2597eac461f959a568abd3031ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72fe24f4-00", "ovs_interfaceid": "72fe24f4-00e3-40f1-a44a-014c7669e862", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:20:48 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-5fa8d3b6-169b-4a93-867f-087dec2b0b5c req-a6703ecf-a646-46f3-a2ba-4ff6d0112aac service nova] Releasing lock "refresh_cache-682138af-ba6a-47f1-a9a5-03ae2661f54d" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:20:48 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-c8274766-7547-4a10-8ad1-e0cb29aae49a tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json" returned: 0 in 0.218s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:20:48 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-c8274766-7547-4a10-8ad1-e0cb29aae49a tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801,backing_fmt=raw /opt/stack/data/nova/instances/e468b473-515f-41ad-a75c-65d4c6d575c8/disk 1073741824 {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:20:48 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-c8274766-7547-4a10-8ad1-e0cb29aae49a tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801,backing_fmt=raw /opt/stack/data/nova/instances/e468b473-515f-41ad-a75c-65d4c6d575c8/disk 1073741824" returned: 0 in 0.060s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:20:48 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-c8274766-7547-4a10-8ad1-e0cb29aae49a tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Lock "2099350d6f3bcd0de9471c73862d4fe75b049801" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.285s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:20:48 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-c8274766-7547-4a10-8ad1-e0cb29aae49a tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:20:48 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Received event <DeviceRemovedEvent: 1693045248.4499593, 682138af-ba6a-47f1-a9a5-03ae2661f54d => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73572) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 10:20:48 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-855e697f-e8e5-4fff-91ec-cd46534d2a03 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 682138af-ba6a-47f1-a9a5-03ae2661f54d {{(pid=73572) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 10:20:48 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-855e697f-e8e5-4fff-91ec-cd46534d2a03 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Successfully detached device vdb from instance 682138af-ba6a-47f1-a9a5-03ae2661f54d from the live domain config.
Aug 26 10:20:48 user nova-compute[73572]: DEBUG nova.network.neutron [None req-c8274766-7547-4a10-8ad1-e0cb29aae49a tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: e468b473-515f-41ad-a75c-65d4c6d575c8] Successfully created port: fa77d8f8-b250-421f-a410-34f61a42bd83 {{(pid=73572) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 10:20:48 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-c8274766-7547-4a10-8ad1-e0cb29aae49a tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json" returned: 0 in 0.208s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:20:48 user nova-compute[73572]: DEBUG nova.virt.disk.api [None req-c8274766-7547-4a10-8ad1-e0cb29aae49a tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e468b473-515f-41ad-a75c-65d4c6d575c8/disk. size=1073741824 {{(pid=73572) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 10:20:48 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-c8274766-7547-4a10-8ad1-e0cb29aae49a tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e468b473-515f-41ad-a75c-65d4c6d575c8/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:20:48 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-855e697f-e8e5-4fff-91ec-cd46534d2a03 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] [instance: 682138af-ba6a-47f1-a9a5-03ae2661f54d] calling os-brick to detach iSCSI Volume {{(pid=73572) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 10:20:48 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-855e697f-e8e5-4fff-91ec-cd46534d2a03 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc89c3d6a10>, {'target_iqns': ['iqn.2010-10.org.openstack:302c3cfe-f0ec-4b1c-b1d9-dc12d4f4ce40'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UwbOMKoP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 10:20:48 user nova-compute[73572]: WARNING os_brick.initiator.connectors.base [None req-855e697f-e8e5-4fff-91ec-cd46534d2a03 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 10:20:48 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-855e697f-e8e5-4fff-91ec-cd46534d2a03 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 10:20:48 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-855e697f-e8e5-4fff-91ec-cd46534d2a03 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 10:20:48 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-855e697f-e8e5-4fff-91ec-cd46534d2a03 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:302c3cfe-f0ec-4b1c-b1d9-dc12d4f4ce40', 0)] {{(pid=73572) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 10:20:48 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:20:48 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:20:48 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3b59338-8c8d-405a-a8a8-1cb7aa803eed]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:302c3cfe-f0ec-4b1c-b1d9-dc12d4f4ce40\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5f3a153b-1b99-4297-ad26-ea58f33330b8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d94556c8-9096-4e9a-9cfc-f9d17846ed06\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:20:48 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:20:48 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:20:48 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[db0fb0a4-94fa-4df6-aeab-17a3a737d01d]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:302c3cfe-f0ec-4b1c-b1d9-dc12d4f4ce40 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f3a153b-1b99-4297-ad26-ea58f33330b8 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d94556c8-9096-4e9a-9cfc-f9d17846ed06 (non-flash)\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:20:48 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-855e697f-e8e5-4fff-91ec-cd46534d2a03 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)
Aug 26 10:20:48 user nova-compute[73572]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:302c3cfe-f0ec-4b1c-b1d9-dc12d4f4ce40 (non-flash)
Aug 26 10:20:48 user nova-compute[73572]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478 (non-flash)
Aug 26 10:20:48 user nova-compute[73572]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f3a153b-1b99-4297-ad26-ea58f33330b8 (non-flash)
Aug 26 10:20:48 user nova-compute[73572]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d94556c8-9096-4e9a-9cfc-f9d17846ed06 (non-flash)
Aug 26 10:20:48 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 10:20:48 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-855e697f-e8e5-4fff-91ec-cd46534d2a03 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)
Aug 26 10:20:48 user nova-compute[73572]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:302c3cfe-f0ec-4b1c-b1d9-dc12d4f4ce40 (non-flash)
Aug 26 10:20:48 user nova-compute[73572]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478 (non-flash)
Aug 26 10:20:48 user nova-compute[73572]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f3a153b-1b99-4297-ad26-ea58f33330b8 (non-flash)
Aug 26 10:20:48 user nova-compute[73572]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d94556c8-9096-4e9a-9cfc-f9d17846ed06 (non-flash)
Aug 26 10:20:48 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 10:20:48 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-855e697f-e8e5-4fff-91ec-cd46534d2a03 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc89c48d1b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:302c3cfe-f0ec-4b1c-b1d9-dc12d4f4ce40'): ({'sdh'}, set())}) {{(pid=73572) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 10:20:48 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-855e697f-e8e5-4fff-91ec-cd46534d2a03 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Removing single pathed devices sdh {{(pid=73572) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 10:20:48 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:20:48 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:20:48 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7254ffe-e9ee-4d2f-8af0-db9b148c6c0a]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:20:48 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:20:48 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.045s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:20:48 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe260d54-bc61-40f4-996c-f35cf4d94e81]: (4, ('ok\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:20:48 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-855e697f-e8e5-4fff-91ec-cd46534d2a03 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Flushing IO for device /dev/sdh {{(pid=73572) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 10:20:48 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:20:48 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.023s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:20:48 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1e201ed-f69e-4957-a2b7-e4179fdf4028]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:20:48 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-855e697f-e8e5-4fff-91ec-cd46534d2a03 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=73572) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 10:20:48 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:20:48 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-c8274766-7547-4a10-8ad1-e0cb29aae49a tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e468b473-515f-41ad-a75c-65d4c6d575c8/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:20:48 user nova-compute[73572]: DEBUG nova.virt.disk.api [None req-c8274766-7547-4a10-8ad1-e0cb29aae49a tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Cannot resize image /opt/stack/data/nova/instances/e468b473-515f-41ad-a75c-65d4c6d575c8/disk to a smaller size. {{(pid=73572) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 10:20:48 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-c8274766-7547-4a10-8ad1-e0cb29aae49a tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: e468b473-515f-41ad-a75c-65d4c6d575c8] Created local disks {{(pid=73572) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 10:20:48 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-c8274766-7547-4a10-8ad1-e0cb29aae49a tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: e468b473-515f-41ad-a75c-65d4c6d575c8] Ensure instance console log exists: /opt/stack/data/nova/instances/e468b473-515f-41ad-a75c-65d4c6d575c8/console.log {{(pid=73572) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 10:20:48 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-c8274766-7547-4a10-8ad1-e0cb29aae49a tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:20:48 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-c8274766-7547-4a10-8ad1-e0cb29aae49a tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:20:48 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-c8274766-7547-4a10-8ad1-e0cb29aae49a tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:20:48 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.046s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:20:48 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d6327ea-41dd-40e0-b22e-e1d878a35d46]: (4, ('1', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:20:48 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-855e697f-e8e5-4fff-91ec-cd46534d2a03 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=73572) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 10:20:48 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-855e697f-e8e5-4fff-91ec-cd46534d2a03 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] SCSI volumes sdh have been removed. {{(pid=73572) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 10:20:48 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-855e697f-e8e5-4fff-91ec-cd46534d2a03 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:302c3cfe-f0ec-4b1c-b1d9-dc12d4f4ce40')] {{(pid=73572) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 10:20:48 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:302c3cfe-f0ec-4b1c-b1d9-dc12d4f4ce40 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:20:48 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:302c3cfe-f0ec-4b1c-b1d9-dc12d4f4ce40 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:20:48 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ba4616f-6f3c-4423-bd85-0560a3a713a8]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:20:48 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-855e697f-e8e5-4fff-91ec-cd46534d2a03 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:20:48 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:302c3cfe-f0ec-4b1c-b1d9-dc12d4f4ce40 -p 172.16.0.220:3260 --logout {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:20:48 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:302c3cfe-f0ec-4b1c-b1d9-dc12d4f4ce40 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:20:48 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[35b4ddcd-1269-4ed5-828c-40a453eef7ce]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:302c3cfe-f0ec-4b1c-b1d9-dc12d4f4ce40, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:302c3cfe-f0ec-4b1c-b1d9-dc12d4f4ce40, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:20:48 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-855e697f-e8e5-4fff-91ec-cd46534d2a03 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:302c3cfe-f0ec-4b1c-b1d9-dc12d4f4ce40, portal: 172.16.0.220,3260]
Aug 26 10:20:48 user nova-compute[73572]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:302c3cfe-f0ec-4b1c-b1d9-dc12d4f4ce40, portal: 172.16.0.220,3260] successful.
Aug 26 10:20:48 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:20:48 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:302c3cfe-f0ec-4b1c-b1d9-dc12d4f4ce40 -p 172.16.0.220:3260 --op delete {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:20:48 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:302c3cfe-f0ec-4b1c-b1d9-dc12d4f4ce40 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:20:48 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[13e140ad-4839-41ee-921e-9a708700cf76]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:20:48 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-855e697f-e8e5-4fff-91ec-cd46534d2a03 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:20:48 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-855e697f-e8e5-4fff-91ec-cd46534d2a03 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.362s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 10:20:48 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-855e697f-e8e5-4fff-91ec-cd46534d2a03 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] <== disconnect_volume: return (366ms) None {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 10:20:48 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-855e697f-e8e5-4fff-91ec-cd46534d2a03 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] [instance: 682138af-ba6a-47f1-a9a5-03ae2661f54d] Disconnected iSCSI Volume {{(pid=73572) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 10:20:49 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:20:49 user nova-compute[73572]: DEBUG nova.objects.instance [None req-855e697f-e8e5-4fff-91ec-cd46534d2a03 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Lazy-loading 'flavor' on Instance uuid 682138af-ba6a-47f1-a9a5-03ae2661f54d {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:20:49 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-855e697f-e8e5-4fff-91ec-cd46534d2a03 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Lock "682138af-ba6a-47f1-a9a5-03ae2661f54d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.239s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:20:49 user nova-compute[73572]: DEBUG nova.network.neutron [None req-c8274766-7547-4a10-8ad1-e0cb29aae49a tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: e468b473-515f-41ad-a75c-65d4c6d575c8] Successfully updated port: fa77d8f8-b250-421f-a410-34f61a42bd83 {{(pid=73572) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 10:20:50 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-c8274766-7547-4a10-8ad1-e0cb29aae49a tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Acquiring lock "refresh_cache-e468b473-515f-41ad-a75c-65d4c6d575c8" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:20:50 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-c8274766-7547-4a10-8ad1-e0cb29aae49a tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Acquired lock "refresh_cache-e468b473-515f-41ad-a75c-65d4c6d575c8" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:20:50 user nova-compute[73572]: DEBUG nova.network.neutron [None req-c8274766-7547-4a10-8ad1-e0cb29aae49a tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: e468b473-515f-41ad-a75c-65d4c6d575c8] Building network info cache for instance {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 10:20:50 user nova-compute[73572]: DEBUG nova.compute.manager [req-41c7dda3-533a-4d56-a6c3-e70fb354bba7 req-8576e4e2-48c2-41b8-9141-5e899e84343b service nova] [instance: e468b473-515f-41ad-a75c-65d4c6d575c8] Received event network-changed-fa77d8f8-b250-421f-a410-34f61a42bd83 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:20:50 user nova-compute[73572]: DEBUG nova.compute.manager [req-41c7dda3-533a-4d56-a6c3-e70fb354bba7 req-8576e4e2-48c2-41b8-9141-5e899e84343b service nova] [instance: e468b473-515f-41ad-a75c-65d4c6d575c8] Refreshing instance network info cache due to event network-changed-fa77d8f8-b250-421f-a410-34f61a42bd83. {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 10:20:50 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-41c7dda3-533a-4d56-a6c3-e70fb354bba7 req-8576e4e2-48c2-41b8-9141-5e899e84343b service nova] Acquiring lock "refresh_cache-e468b473-515f-41ad-a75c-65d4c6d575c8" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:20:50 user nova-compute[73572]: DEBUG nova.network.neutron [None req-c8274766-7547-4a10-8ad1-e0cb29aae49a tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: e468b473-515f-41ad-a75c-65d4c6d575c8] Instance cache missing network info. {{(pid=73572) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 10:20:50 user nova-compute[73572]: DEBUG nova.network.neutron [None req-c8274766-7547-4a10-8ad1-e0cb29aae49a tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: e468b473-515f-41ad-a75c-65d4c6d575c8] Updating instance_info_cache with network_info: [{"id": "fa77d8f8-b250-421f-a410-34f61a42bd83", "address": "fa:16:3e:29:89:56", "network": {"id": "991b9dff-5173-4456-a530-b1f7eb5cfa4a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1845930297-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4636f93c5bfc4653804de097aed2882c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa77d8f8-b2", "ovs_interfaceid": "fa77d8f8-b250-421f-a410-34f61a42bd83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:20:50 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-c8274766-7547-4a10-8ad1-e0cb29aae49a tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Releasing lock "refresh_cache-e468b473-515f-41ad-a75c-65d4c6d575c8" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:20:50 user nova-compute[73572]: DEBUG nova.compute.manager [None req-c8274766-7547-4a10-8ad1-e0cb29aae49a tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: e468b473-515f-41ad-a75c-65d4c6d575c8] Instance network_info: |[{"id": "fa77d8f8-b250-421f-a410-34f61a42bd83", "address": "fa:16:3e:29:89:56", "network": {"id": "991b9dff-5173-4456-a530-b1f7eb5cfa4a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1845930297-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4636f93c5bfc4653804de097aed2882c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa77d8f8-b2", "ovs_interfaceid": "fa77d8f8-b250-421f-a410-34f61a42bd83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73572) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 10:20:50 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-41c7dda3-533a-4d56-a6c3-e70fb354bba7 req-8576e4e2-48c2-41b8-9141-5e899e84343b service nova] Acquired lock "refresh_cache-e468b473-515f-41ad-a75c-65d4c6d575c8" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:20:50 user nova-compute[73572]: DEBUG nova.network.neutron [req-41c7dda3-533a-4d56-a6c3-e70fb354bba7 req-8576e4e2-48c2-41b8-9141-5e899e84343b service nova] [instance: e468b473-515f-41ad-a75c-65d4c6d575c8] Refreshing network info cache for port fa77d8f8-b250-421f-a410-34f61a42bd83 {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 10:20:50 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-c8274766-7547-4a10-8ad1-e0cb29aae49a tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: e468b473-515f-41ad-a75c-65d4c6d575c8] Start _get_guest_xml network_info=[{"id": "fa77d8f8-b250-421f-a410-34f61a42bd83", "address": "fa:16:3e:29:89:56", "network": {"id": "991b9dff-5173-4456-a530-b1f7eb5cfa4a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1845930297-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4636f93c5bfc4653804de097aed2882c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa77d8f8-b2", "ovs_interfaceid": "fa77d8f8-b250-421f-a410-34f61a42bd83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T10:07:33Z,direct_url=<?>,disk_format='qcow2',id=299da0c9-e1c4-48f0-be55-fbe20dd06bc9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5c995f8bbbab4368b67a253e0df3971a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T10:07:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'guest_format': None, 'size': 0, 'encryption_format': None, 'device_type': 'disk', 'image_id': '299da0c9-e1c4-48f0-be55-fbe20dd06bc9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73572) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 10:20:50 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-c8274766-7547-4a10-8ad1-e0cb29aae49a tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:20:50 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-c8274766-7547-4a10-8ad1-e0cb29aae49a tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:20:50 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-c8274766-7547-4a10-8ad1-e0cb29aae49a tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73572) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 10:20:50 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-c8274766-7547-4a10-8ad1-e0cb29aae49a tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] CPU controller missing on host. {{(pid=73572) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 10:20:50 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-c8274766-7547-4a10-8ad1-e0cb29aae49a tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73572) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 10:20:50 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-c8274766-7547-4a10-8ad1-e0cb29aae49a tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] CPU controller found on host. {{(pid=73572) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 10:20:50 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-c8274766-7547-4a10-8ad1-e0cb29aae49a tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73572) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 10:20:50 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-c8274766-7547-4a10-8ad1-e0cb29aae49a tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T10:07:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T10:07:33Z,direct_url=<?>,disk_format='qcow2',id=299da0c9-e1c4-48f0-be55-fbe20dd06bc9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5c995f8bbbab4368b67a253e0df3971a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T10:07:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 10:20:50 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-c8274766-7547-4a10-8ad1-e0cb29aae49a tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Flavor limits 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 10:20:50 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-c8274766-7547-4a10-8ad1-e0cb29aae49a tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Image limits 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 10:20:50 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-c8274766-7547-4a10-8ad1-e0cb29aae49a tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Flavor pref 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 10:20:50 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-c8274766-7547-4a10-8ad1-e0cb29aae49a tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Image pref 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 10:20:50 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-c8274766-7547-4a10-8ad1-e0cb29aae49a tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 10:20:50 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-c8274766-7547-4a10-8ad1-e0cb29aae49a tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 10:20:50 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-c8274766-7547-4a10-8ad1-e0cb29aae49a tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73572) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 10:20:50 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-c8274766-7547-4a10-8ad1-e0cb29aae49a tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Got 1 possible topologies {{(pid=73572) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 10:20:50 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-c8274766-7547-4a10-8ad1-e0cb29aae49a tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 10:20:50 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-c8274766-7547-4a10-8ad1-e0cb29aae49a tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 10:20:50 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-c8274766-7547-4a10-8ad1-e0cb29aae49a tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T10:20:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-33222',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-33222',id=28,image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4636f93c5bfc4653804de097aed2882c',ramdisk_id='',reservation_id='r-256xrr5s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-665602868',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T10:20:48Z,user_data=None,user_id='07f3538038a14713af3bbe420f1fb03a',uuid=e468b473-515f-41ad-a75c-65d4c6d575c8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fa77d8f8-b250-421f-a410-34f61a42bd83", "address": "fa:16:3e:29:89:56", "network": {"id": "991b9dff-5173-4456-a530-b1f7eb5cfa4a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1845930297-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4636f93c5bfc4653804de097aed2882c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa77d8f8-b2", "ovs_interfaceid": "fa77d8f8-b250-421f-a410-34f61a42bd83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73572) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 10:20:50 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-c8274766-7547-4a10-8ad1-e0cb29aae49a tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Converting VIF {"id": "fa77d8f8-b250-421f-a410-34f61a42bd83", "address": "fa:16:3e:29:89:56", "network": {"id": "991b9dff-5173-4456-a530-b1f7eb5cfa4a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1845930297-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4636f93c5bfc4653804de097aed2882c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa77d8f8-b2", "ovs_interfaceid": "fa77d8f8-b250-421f-a410-34f61a42bd83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:20:50 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-c8274766-7547-4a10-8ad1-e0cb29aae49a tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:89:56,bridge_name='br-int',has_traffic_filtering=True,id=fa77d8f8-b250-421f-a410-34f61a42bd83,network=Network(991b9dff-5173-4456-a530-b1f7eb5cfa4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa77d8f8-b2') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:20:50 user nova-compute[73572]: DEBUG nova.objects.instance [None req-c8274766-7547-4a10-8ad1-e0cb29aae49a tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Lazy-loading 'pci_devices' on Instance uuid e468b473-515f-41ad-a75c-65d4c6d575c8 {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:20:50 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-c8274766-7547-4a10-8ad1-e0cb29aae49a tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: e468b473-515f-41ad-a75c-65d4c6d575c8] End _get_guest_xml xml=<domain type="kvm">
Aug 26 10:20:50 user nova-compute[73572]:   <uuid>e468b473-515f-41ad-a75c-65d4c6d575c8</uuid>
Aug 26 10:20:50 user nova-compute[73572]:   <name>instance-0000001c</name>
Aug 26 10:20:50 user nova-compute[73572]:   <memory>524288</memory>
Aug 26 10:20:50 user nova-compute[73572]:   <vcpu>1</vcpu>
Aug 26 10:20:50 user nova-compute[73572]:   <metadata>
Aug 26 10:20:50 user nova-compute[73572]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 10:20:50 user nova-compute[73572]:       <nova:package version="0.0.0"/>
Aug 26 10:20:50 user nova-compute[73572]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-33222</nova:name>
Aug 26 10:20:50 user nova-compute[73572]:       <nova:creationTime>2023-08-26 10:20:50</nova:creationTime>
Aug 26 10:20:50 user nova-compute[73572]:       <nova:flavor name="m1.tiny">
Aug 26 10:20:50 user nova-compute[73572]:         <nova:memory>512</nova:memory>
Aug 26 10:20:50 user nova-compute[73572]:         <nova:disk>1</nova:disk>
Aug 26 10:20:50 user nova-compute[73572]:         <nova:swap>0</nova:swap>
Aug 26 10:20:50 user nova-compute[73572]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 10:20:50 user nova-compute[73572]:         <nova:vcpus>1</nova:vcpus>
Aug 26 10:20:50 user nova-compute[73572]:       </nova:flavor>
Aug 26 10:20:50 user nova-compute[73572]:       <nova:owner>
Aug 26 10:20:50 user nova-compute[73572]:         <nova:user uuid="07f3538038a14713af3bbe420f1fb03a">tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member</nova:user>
Aug 26 10:20:50 user nova-compute[73572]:         <nova:project uuid="4636f93c5bfc4653804de097aed2882c">tempest-ServerBootFromVolumeStableRescueTest-665602868</nova:project>
Aug 26 10:20:50 user nova-compute[73572]:       </nova:owner>
Aug 26 10:20:50 user nova-compute[73572]:       <nova:root type="image" uuid="299da0c9-e1c4-48f0-be55-fbe20dd06bc9"/>
Aug 26 10:20:50 user nova-compute[73572]:       <nova:ports>
Aug 26 10:20:50 user nova-compute[73572]:         <nova:port uuid="fa77d8f8-b250-421f-a410-34f61a42bd83">
Aug 26 10:20:50 user nova-compute[73572]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 26 10:20:50 user nova-compute[73572]:         </nova:port>
Aug 26 10:20:50 user nova-compute[73572]:       </nova:ports>
Aug 26 10:20:50 user nova-compute[73572]:     </nova:instance>
Aug 26 10:20:50 user nova-compute[73572]:   </metadata>
Aug 26 10:20:50 user nova-compute[73572]:   <sysinfo type="smbios">
Aug 26 10:20:50 user nova-compute[73572]:     <system>
Aug 26 10:20:50 user nova-compute[73572]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 10:20:50 user nova-compute[73572]:       <entry name="product">OpenStack Nova</entry>
Aug 26 10:20:50 user nova-compute[73572]:       <entry name="version">0.0.0</entry>
Aug 26 10:20:50 user nova-compute[73572]:       <entry name="serial">e468b473-515f-41ad-a75c-65d4c6d575c8</entry>
Aug 26 10:20:50 user nova-compute[73572]:       <entry name="uuid">e468b473-515f-41ad-a75c-65d4c6d575c8</entry>
Aug 26 10:20:50 user nova-compute[73572]:       <entry name="family">Virtual Machine</entry>
Aug 26 10:20:50 user nova-compute[73572]:     </system>
Aug 26 10:20:50 user nova-compute[73572]:   </sysinfo>
Aug 26 10:20:50 user nova-compute[73572]:   <os>
Aug 26 10:20:50 user nova-compute[73572]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 10:20:50 user nova-compute[73572]:     <boot dev="hd"/>
Aug 26 10:20:50 user nova-compute[73572]:     <smbios mode="sysinfo"/>
Aug 26 10:20:50 user nova-compute[73572]:   </os>
Aug 26 10:20:50 user nova-compute[73572]:   <features>
Aug 26 10:20:50 user nova-compute[73572]:     <acpi/>
Aug 26 10:20:50 user nova-compute[73572]:     <apic/>
Aug 26 10:20:50 user nova-compute[73572]:     <vmcoreinfo/>
Aug 26 10:20:50 user nova-compute[73572]:   </features>
Aug 26 10:20:50 user nova-compute[73572]:   <clock offset="utc">
Aug 26 10:20:50 user nova-compute[73572]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 10:20:50 user nova-compute[73572]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 10:20:50 user nova-compute[73572]:     <timer name="hpet" present="no"/>
Aug 26 10:20:50 user nova-compute[73572]:   </clock>
Aug 26 10:20:50 user nova-compute[73572]:   <cpu mode="custom" match="exact">
Aug 26 10:20:50 user nova-compute[73572]:     <model>Nehalem</model>
Aug 26 10:20:50 user nova-compute[73572]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 10:20:50 user nova-compute[73572]:   </cpu>
Aug 26 10:20:50 user nova-compute[73572]:   <devices>
Aug 26 10:20:50 user nova-compute[73572]:     <disk type="file" device="disk">
Aug 26 10:20:50 user nova-compute[73572]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 10:20:50 user nova-compute[73572]:       <source file="/opt/stack/data/nova/instances/e468b473-515f-41ad-a75c-65d4c6d575c8/disk"/>
Aug 26 10:20:50 user nova-compute[73572]:       <target dev="vda" bus="virtio"/>
Aug 26 10:20:50 user nova-compute[73572]:     </disk>
Aug 26 10:20:50 user nova-compute[73572]:     <interface type="ethernet">
Aug 26 10:20:50 user nova-compute[73572]:       <mac address="fa:16:3e:29:89:56"/>
Aug 26 10:20:50 user nova-compute[73572]:       <model type="virtio"/>
Aug 26 10:20:50 user nova-compute[73572]:       <mtu size="1442"/>
Aug 26 10:20:50 user nova-compute[73572]:       <target dev="tapfa77d8f8-b2"/>
Aug 26 10:20:50 user nova-compute[73572]:     </interface>
Aug 26 10:20:50 user nova-compute[73572]:     <serial type="pty">
Aug 26 10:20:50 user nova-compute[73572]:       <log file="/opt/stack/data/nova/instances/e468b473-515f-41ad-a75c-65d4c6d575c8/console.log" append="off"/>
Aug 26 10:20:50 user nova-compute[73572]:     </serial>
Aug 26 10:20:50 user nova-compute[73572]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 10:20:50 user nova-compute[73572]:     <video>
Aug 26 10:20:50 user nova-compute[73572]:       <model type="virtio"/>
Aug 26 10:20:50 user nova-compute[73572]:     </video>
Aug 26 10:20:50 user nova-compute[73572]:     <rng model="virtio">
Aug 26 10:20:50 user nova-compute[73572]:       <backend model="random">/dev/urandom</backend>
Aug 26 10:20:50 user nova-compute[73572]:     </rng>
Aug 26 10:20:50 user nova-compute[73572]:     <controller type="usb" index="0" model="none"/>
Aug 26 10:20:50 user nova-compute[73572]:     <memballoon model="virtio">
Aug 26 10:20:50 user nova-compute[73572]:       <stats period="10"/>
Aug 26 10:20:50 user nova-compute[73572]:     </memballoon>
Aug 26 10:20:50 user nova-compute[73572]:   </devices>
Aug 26 10:20:50 user nova-compute[73572]: </domain>
Aug 26 10:20:50 user nova-compute[73572]:  {{(pid=73572) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 10:20:50 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-c8274766-7547-4a10-8ad1-e0cb29aae49a tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T10:20:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-33222',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-33222',id=28,image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4636f93c5bfc4653804de097aed2882c',ramdisk_id='',reservation_id='r-256xrr5s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-665602868',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T10:20:48Z,user_data=None,user_id='07f3538038a14713af3bbe420f1fb03a',uuid=e468b473-515f-41ad-a75c-65d4c6d575c8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fa77d8f8-b250-421f-a410-34f61a42bd83", "address": "fa:16:3e:29:89:56", "network": {"id": "991b9dff-5173-4456-a530-b1f7eb5cfa4a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1845930297-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4636f93c5bfc4653804de097aed2882c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa77d8f8-b2", "ovs_interfaceid": "fa77d8f8-b250-421f-a410-34f61a42bd83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 10:20:50 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-c8274766-7547-4a10-8ad1-e0cb29aae49a tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Converting VIF {"id": "fa77d8f8-b250-421f-a410-34f61a42bd83", "address": "fa:16:3e:29:89:56", "network": {"id": "991b9dff-5173-4456-a530-b1f7eb5cfa4a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1845930297-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4636f93c5bfc4653804de097aed2882c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa77d8f8-b2", "ovs_interfaceid": "fa77d8f8-b250-421f-a410-34f61a42bd83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:20:50 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-c8274766-7547-4a10-8ad1-e0cb29aae49a tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:89:56,bridge_name='br-int',has_traffic_filtering=True,id=fa77d8f8-b250-421f-a410-34f61a42bd83,network=Network(991b9dff-5173-4456-a530-b1f7eb5cfa4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa77d8f8-b2') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:20:50 user nova-compute[73572]: DEBUG os_vif [None req-c8274766-7547-4a10-8ad1-e0cb29aae49a tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:89:56,bridge_name='br-int',has_traffic_filtering=True,id=fa77d8f8-b250-421f-a410-34f61a42bd83,network=Network(991b9dff-5173-4456-a530-b1f7eb5cfa4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa77d8f8-b2') {{(pid=73572) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 10:20:50 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:20:50 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:20:50 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 10:20:50 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:20:50 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfa77d8f8-b2, may_exist=True, interface_attrs={}) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:20:50 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapfa77d8f8-b2, col_values=(('external_ids', {'iface-id': 'fa77d8f8-b250-421f-a410-34f61a42bd83', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:29:89:56', 'vm-uuid': 'e468b473-515f-41ad-a75c-65d4c6d575c8'}),), if_exists=True) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:20:50 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:20:50 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:20:50 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:20:50 user nova-compute[73572]: INFO os_vif [None req-c8274766-7547-4a10-8ad1-e0cb29aae49a tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:89:56,bridge_name='br-int',has_traffic_filtering=True,id=fa77d8f8-b250-421f-a410-34f61a42bd83,network=Network(991b9dff-5173-4456-a530-b1f7eb5cfa4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa77d8f8-b2')
Aug 26 10:20:50 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-c8274766-7547-4a10-8ad1-e0cb29aae49a tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] No BDM found with device name vda, not building metadata. {{(pid=73572) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 10:20:50 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-c8274766-7547-4a10-8ad1-e0cb29aae49a tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] No VIF found with MAC fa:16:3e:29:89:56, not building metadata {{(pid=73572) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 10:20:50 user nova-compute[73572]: DEBUG nova.network.neutron [req-41c7dda3-533a-4d56-a6c3-e70fb354bba7 req-8576e4e2-48c2-41b8-9141-5e899e84343b service nova] [instance: e468b473-515f-41ad-a75c-65d4c6d575c8] Updated VIF entry in instance network info cache for port fa77d8f8-b250-421f-a410-34f61a42bd83. {{(pid=73572) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 10:20:50 user nova-compute[73572]: DEBUG nova.network.neutron [req-41c7dda3-533a-4d56-a6c3-e70fb354bba7 req-8576e4e2-48c2-41b8-9141-5e899e84343b service nova] [instance: e468b473-515f-41ad-a75c-65d4c6d575c8] Updating instance_info_cache with network_info: [{"id": "fa77d8f8-b250-421f-a410-34f61a42bd83", "address": "fa:16:3e:29:89:56", "network": {"id": "991b9dff-5173-4456-a530-b1f7eb5cfa4a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1845930297-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4636f93c5bfc4653804de097aed2882c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa77d8f8-b2", "ovs_interfaceid": "fa77d8f8-b250-421f-a410-34f61a42bd83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:20:51 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-41c7dda3-533a-4d56-a6c3-e70fb354bba7 req-8576e4e2-48c2-41b8-9141-5e899e84343b service nova] Releasing lock "refresh_cache-e468b473-515f-41ad-a75c-65d4c6d575c8" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:20:52 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:20:52 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:20:52 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:20:52 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:20:52 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:20:52 user nova-compute[73572]: DEBUG nova.compute.manager [req-b1ec079a-659f-4d80-913f-c087ec8b2cbe req-01bfaadd-65de-489b-b2e6-e4a60b774b36 service nova] [instance: e468b473-515f-41ad-a75c-65d4c6d575c8] Received event network-vif-plugged-fa77d8f8-b250-421f-a410-34f61a42bd83 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:20:52 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-b1ec079a-659f-4d80-913f-c087ec8b2cbe req-01bfaadd-65de-489b-b2e6-e4a60b774b36 service nova] Acquiring lock "e468b473-515f-41ad-a75c-65d4c6d575c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:20:52 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-b1ec079a-659f-4d80-913f-c087ec8b2cbe req-01bfaadd-65de-489b-b2e6-e4a60b774b36 service nova] Lock "e468b473-515f-41ad-a75c-65d4c6d575c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:20:52 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-b1ec079a-659f-4d80-913f-c087ec8b2cbe req-01bfaadd-65de-489b-b2e6-e4a60b774b36 service nova] Lock "e468b473-515f-41ad-a75c-65d4c6d575c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:20:52 user nova-compute[73572]: DEBUG nova.compute.manager [req-b1ec079a-659f-4d80-913f-c087ec8b2cbe req-01bfaadd-65de-489b-b2e6-e4a60b774b36 service nova] [instance: e468b473-515f-41ad-a75c-65d4c6d575c8] No waiting events found dispatching network-vif-plugged-fa77d8f8-b250-421f-a410-34f61a42bd83 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:20:52 user nova-compute[73572]: WARNING nova.compute.manager [req-b1ec079a-659f-4d80-913f-c087ec8b2cbe req-01bfaadd-65de-489b-b2e6-e4a60b774b36 service nova] [instance: e468b473-515f-41ad-a75c-65d4c6d575c8] Received unexpected event network-vif-plugged-fa77d8f8-b250-421f-a410-34f61a42bd83 for instance with vm_state building and task_state spawning.
Aug 26 10:20:53 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:20:54 user nova-compute[73572]: DEBUG nova.virt.driver [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Emitting event <LifecycleEvent: 1693045254.3060136, e468b473-515f-41ad-a75c-65d4c6d575c8 => Resumed> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:20:54 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: e468b473-515f-41ad-a75c-65d4c6d575c8] VM Resumed (Lifecycle Event)
Aug 26 10:20:54 user nova-compute[73572]: DEBUG nova.compute.manager [None req-c8274766-7547-4a10-8ad1-e0cb29aae49a tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: e468b473-515f-41ad-a75c-65d4c6d575c8] Instance event wait completed in 0 seconds for  {{(pid=73572) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 10:20:54 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-c8274766-7547-4a10-8ad1-e0cb29aae49a tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: e468b473-515f-41ad-a75c-65d4c6d575c8] Guest created on hypervisor {{(pid=73572) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 10:20:54 user nova-compute[73572]: INFO nova.virt.libvirt.driver [-] [instance: e468b473-515f-41ad-a75c-65d4c6d575c8] Instance spawned successfully.
Aug 26 10:20:54 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-c8274766-7547-4a10-8ad1-e0cb29aae49a tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: e468b473-515f-41ad-a75c-65d4c6d575c8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 10:20:54 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: e468b473-515f-41ad-a75c-65d4c6d575c8] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:20:54 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: e468b473-515f-41ad-a75c-65d4c6d575c8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73572) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 10:20:54 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-c8274766-7547-4a10-8ad1-e0cb29aae49a tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: e468b473-515f-41ad-a75c-65d4c6d575c8] Found default for hw_cdrom_bus of ide {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:20:54 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-c8274766-7547-4a10-8ad1-e0cb29aae49a tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: e468b473-515f-41ad-a75c-65d4c6d575c8] Found default for hw_disk_bus of virtio {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:20:54 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-c8274766-7547-4a10-8ad1-e0cb29aae49a tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: e468b473-515f-41ad-a75c-65d4c6d575c8] Found default for hw_input_bus of None {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:20:54 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-c8274766-7547-4a10-8ad1-e0cb29aae49a tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: e468b473-515f-41ad-a75c-65d4c6d575c8] Found default for hw_pointer_model of None {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:20:54 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-c8274766-7547-4a10-8ad1-e0cb29aae49a tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: e468b473-515f-41ad-a75c-65d4c6d575c8] Found default for hw_video_model of virtio {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:20:54 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-c8274766-7547-4a10-8ad1-e0cb29aae49a tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: e468b473-515f-41ad-a75c-65d4c6d575c8] Found default for hw_vif_model of virtio {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:20:54 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: e468b473-515f-41ad-a75c-65d4c6d575c8] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 10:20:54 user nova-compute[73572]: DEBUG nova.virt.driver [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Emitting event <LifecycleEvent: 1693045254.30788, e468b473-515f-41ad-a75c-65d4c6d575c8 => Started> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:20:54 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: e468b473-515f-41ad-a75c-65d4c6d575c8] VM Started (Lifecycle Event)
Aug 26 10:20:54 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: e468b473-515f-41ad-a75c-65d4c6d575c8] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:20:54 user nova-compute[73572]: DEBUG nova.compute.manager [req-7390cd5e-52bb-4340-9d0a-7a57f8ba3ddd req-a4d85c25-3273-49df-bc19-0acb386ee2fa service nova] [instance: e468b473-515f-41ad-a75c-65d4c6d575c8] Received event network-vif-plugged-fa77d8f8-b250-421f-a410-34f61a42bd83 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:20:54 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-7390cd5e-52bb-4340-9d0a-7a57f8ba3ddd req-a4d85c25-3273-49df-bc19-0acb386ee2fa service nova] Acquiring lock "e468b473-515f-41ad-a75c-65d4c6d575c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:20:54 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-7390cd5e-52bb-4340-9d0a-7a57f8ba3ddd req-a4d85c25-3273-49df-bc19-0acb386ee2fa service nova] Lock "e468b473-515f-41ad-a75c-65d4c6d575c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:20:54 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-7390cd5e-52bb-4340-9d0a-7a57f8ba3ddd req-a4d85c25-3273-49df-bc19-0acb386ee2fa service nova] Lock "e468b473-515f-41ad-a75c-65d4c6d575c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:20:54 user nova-compute[73572]: DEBUG nova.compute.manager [req-7390cd5e-52bb-4340-9d0a-7a57f8ba3ddd req-a4d85c25-3273-49df-bc19-0acb386ee2fa service nova] [instance: e468b473-515f-41ad-a75c-65d4c6d575c8] No waiting events found dispatching network-vif-plugged-fa77d8f8-b250-421f-a410-34f61a42bd83 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:20:54 user nova-compute[73572]: WARNING nova.compute.manager [req-7390cd5e-52bb-4340-9d0a-7a57f8ba3ddd req-a4d85c25-3273-49df-bc19-0acb386ee2fa service nova] [instance: e468b473-515f-41ad-a75c-65d4c6d575c8] Received unexpected event network-vif-plugged-fa77d8f8-b250-421f-a410-34f61a42bd83 for instance with vm_state building and task_state spawning.
Aug 26 10:20:54 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: e468b473-515f-41ad-a75c-65d4c6d575c8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73572) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 10:20:54 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: e468b473-515f-41ad-a75c-65d4c6d575c8] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 10:20:54 user nova-compute[73572]: INFO nova.compute.manager [None req-c8274766-7547-4a10-8ad1-e0cb29aae49a tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: e468b473-515f-41ad-a75c-65d4c6d575c8] Took 6.71 seconds to spawn the instance on the hypervisor.
Aug 26 10:20:54 user nova-compute[73572]: DEBUG nova.compute.manager [None req-c8274766-7547-4a10-8ad1-e0cb29aae49a tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: e468b473-515f-41ad-a75c-65d4c6d575c8] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:20:54 user nova-compute[73572]: INFO nova.compute.manager [None req-c8274766-7547-4a10-8ad1-e0cb29aae49a tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: e468b473-515f-41ad-a75c-65d4c6d575c8] Took 7.73 seconds to build instance.
Aug 26 10:20:54 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-c8274766-7547-4a10-8ad1-e0cb29aae49a tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Lock "e468b473-515f-41ad-a75c-65d4c6d575c8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.897s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:20:54 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:20:55 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:20:55 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eed35489-3d02-4d85-b101-567b1b71006c tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] [instance: c901bbcc-3d82-4550-888f-bdbb36ba052d] Calling os-brick to attach iSCSI Volume {{(pid=73572) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 10:20:55 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-eed35489-3d02-4d85-b101-567b1b71006c tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc89c3d6a10>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:ae53c4d0-f1af-4b58-8f15-df8b327554b9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vTCKMxoq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 10:20:55 user nova-compute[73572]: WARNING os_brick.initiator.connectors.base [None req-eed35489-3d02-4d85-b101-567b1b71006c tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 10:20:55 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-eed35489-3d02-4d85-b101-567b1b71006c tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 10:20:55 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-eed35489-3d02-4d85-b101-567b1b71006c tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 10:20:55 user nova-compute[73572]: WARNING os_brick.initiator.connectors.base [None req-eed35489-3d02-4d85-b101-567b1b71006c tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 10:20:55 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-eed35489-3d02-4d85-b101-567b1b71006c tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ae53c4d0-f1af-4b58-8f15-df8b327554b9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 10:20:55 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-eed35489-3d02-4d85-b101-567b1b71006c tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ae53c4d0-f1af-4b58-8f15-df8b327554b9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 10:20:55 user nova-compute[73572]: INFO os_brick.initiator.connectors.iscsi [None req-eed35489-3d02-4d85-b101-567b1b71006c tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 10:20:55 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae53c4d0-f1af-4b58-8f15-df8b327554b9 -p 172.16.0.220:3260 {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:20:55 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae53c4d0-f1af-4b58-8f15-df8b327554b9 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:20:55 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[d608f0a1-c244-4081-aec7-bd5baa6ac20d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:20:55 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-eed35489-3d02-4d85-b101-567b1b71006c tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 10:20:55 user nova-compute[73572]:  {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:20:55 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae53c4d0-f1af-4b58-8f15-df8b327554b9 -p 172.16.0.220:3260 --interface default --op new {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:20:55 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae53c4d0-f1af-4b58-8f15-df8b327554b9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:20:55 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e296815-58cc-46c7-8e38-aec30df0077d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ae53c4d0-f1af-4b58-8f15-df8b327554b9] added\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:20:55 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-eed35489-3d02-4d85-b101-567b1b71006c tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ae53c4d0-f1af-4b58-8f15-df8b327554b9] added
Aug 26 10:20:55 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:20:55 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae53c4d0-f1af-4b58-8f15-df8b327554b9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:20:55 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae53c4d0-f1af-4b58-8f15-df8b327554b9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:20:55 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd3fdb62-0ef2-4daa-b197-3c99ada5eb81]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:20:55 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-eed35489-3d02-4d85-b101-567b1b71006c tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:20:55 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae53c4d0-f1af-4b58-8f15-df8b327554b9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:20:55 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae53c4d0-f1af-4b58-8f15-df8b327554b9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:20:55 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[24e2ad45-2974-475d-9a63-0f3a5a2e87b3]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:20:55 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-eed35489-3d02-4d85-b101-567b1b71006c tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:20:55 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae53c4d0-f1af-4b58-8f15-df8b327554b9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vTCKMxoq {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:20:55 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae53c4d0-f1af-4b58-8f15-df8b327554b9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vTCKMxoq" returned: 0 in 0.020s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:20:55 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[cda10207-f4a0-49c5-acfb-4c815d622367]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:20:55 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-eed35489-3d02-4d85-b101-567b1b71006c tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vTCKMxoq'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:20:55 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae53c4d0-f1af-4b58-8f15-df8b327554b9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:20:55 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae53c4d0-f1af-4b58-8f15-df8b327554b9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:20:55 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca29434e-4888-4e2a-8c1e-fb95f5b9c269]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:20:55 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-eed35489-3d02-4d85-b101-567b1b71006c tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:20:55 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:20:55 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:20:55 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[a242073a-3d24-4dc2-8abe-bca36fe29801]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f3a153b-1b99-4297-ad26-ea58f33330b8 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d94556c8-9096-4e9a-9cfc-f9d17846ed06 (non-flash)\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:20:55 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-eed35489-3d02-4d85-b101-567b1b71006c tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)
Aug 26 10:20:55 user nova-compute[73572]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478 (non-flash)
Aug 26 10:20:55 user nova-compute[73572]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f3a153b-1b99-4297-ad26-ea58f33330b8 (non-flash)
Aug 26 10:20:55 user nova-compute[73572]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d94556c8-9096-4e9a-9cfc-f9d17846ed06 (non-flash)
Aug 26 10:20:55 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 10:20:55 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-eed35489-3d02-4d85-b101-567b1b71006c tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)
Aug 26 10:20:55 user nova-compute[73572]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478 (non-flash)
Aug 26 10:20:55 user nova-compute[73572]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f3a153b-1b99-4297-ad26-ea58f33330b8 (non-flash)
Aug 26 10:20:55 user nova-compute[73572]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d94556c8-9096-4e9a-9cfc-f9d17846ed06 (non-flash)
Aug 26 10:20:55 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 10:20:55 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae53c4d0-f1af-4b58-8f15-df8b327554b9 -p 172.16.0.220:3260 --login {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:20:55 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae53c4d0-f1af-4b58-8f15-df8b327554b9 -p 172.16.0.220:3260 --login" returned: 0 in 0.084s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:20:55 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[e96df382-4d35-40d4-8ea3-36b6c0b24276]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ae53c4d0-f1af-4b58-8f15-df8b327554b9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ae53c4d0-f1af-4b58-8f15-df8b327554b9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:20:55 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-eed35489-3d02-4d85-b101-567b1b71006c tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ae53c4d0-f1af-4b58-8f15-df8b327554b9, portal: 172.16.0.220,3260]
Aug 26 10:20:55 user nova-compute[73572]: Login to [iface: default, target: iqn.2010-10.org.openstack:ae53c4d0-f1af-4b58-8f15-df8b327554b9, portal: 172.16.0.220,3260] successful.
Aug 26 10:20:55 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:20:55 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae53c4d0-f1af-4b58-8f15-df8b327554b9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:20:56 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae53c4d0-f1af-4b58-8f15-df8b327554b9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:20:56 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6c58fe8-5c0c-46fb-84e7-a9506662f130]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:20:56 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-eed35489-3d02-4d85-b101-567b1b71006c tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:20:56 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:20:56 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:20:56 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3ff5942-cb4e-436d-b9ed-bda78642092b]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f3a153b-1b99-4297-ad26-ea58f33330b8 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d94556c8-9096-4e9a-9cfc-f9d17846ed06 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae53c4d0-f1af-4b58-8f15-df8b327554b9 (non-flash)\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:20:56 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-eed35489-3d02-4d85-b101-567b1b71006c tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)
Aug 26 10:20:56 user nova-compute[73572]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478 (non-flash)
Aug 26 10:20:56 user nova-compute[73572]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f3a153b-1b99-4297-ad26-ea58f33330b8 (non-flash)
Aug 26 10:20:56 user nova-compute[73572]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d94556c8-9096-4e9a-9cfc-f9d17846ed06 (non-flash)
Aug 26 10:20:56 user nova-compute[73572]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae53c4d0-f1af-4b58-8f15-df8b327554b9 (non-flash)
Aug 26 10:20:56 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 10:20:56 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-eed35489-3d02-4d85-b101-567b1b71006c tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)
Aug 26 10:20:56 user nova-compute[73572]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478 (non-flash)
Aug 26 10:20:56 user nova-compute[73572]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f3a153b-1b99-4297-ad26-ea58f33330b8 (non-flash)
Aug 26 10:20:56 user nova-compute[73572]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d94556c8-9096-4e9a-9cfc-f9d17846ed06 (non-flash)
Aug 26 10:20:56 user nova-compute[73572]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae53c4d0-f1af-4b58-8f15-df8b327554b9 (non-flash)
Aug 26 10:20:56 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 10:20:56 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-eed35489-3d02-4d85-b101-567b1b71006c tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ae53c4d0-f1af-4b58-8f15-df8b327554b9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.369s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 10:20:56 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-eed35489-3d02-4d85-b101-567b1b71006c tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Connected to 172.16.0.220:3260 {{(pid=73572) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 10:20:56 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-eed35489-3d02-4d85-b101-567b1b71006c tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] HCTL ('36', '-', '-', 0) found on session 29 with lun 0 {{(pid=73572) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 10:20:56 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-eed35489-3d02-4d85-b101-567b1b71006c tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73572) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 10:20:56 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:20:56 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.019s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:20:56 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cb91527-40a4-4eee-b132-d75a3e152026]: (4, ('- - 0', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:20:56 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-eed35489-3d02-4d85-b101-567b1b71006c tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Searching for a device in session 29 and hctl ['36', '*', '*', 0] yield: None {{(pid=73572) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 10:20:57 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-eed35489-3d02-4d85-b101-567b1b71006c tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Searching for a device in session 29 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73572) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 10:20:57 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-eed35489-3d02-4d85-b101-567b1b71006c tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vTCKMxoq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73572) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 10:20:57 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-eed35489-3d02-4d85-b101-567b1b71006c tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.402s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 10:20:57 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-eed35489-3d02-4d85-b101-567b1b71006c tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] <== connect_volume: return (1403ms) {'type': 'block', 'scsi_wwn': '23533623162643231', 'path': '/dev/sde'} {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 10:20:57 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eed35489-3d02-4d85-b101-567b1b71006c tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] [instance: c901bbcc-3d82-4550-888f-bdbb36ba052d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23533623162643231', 'path': '/dev/sde'} {{(pid=73572) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 10:20:57 user nova-compute[73572]: DEBUG nova.objects.instance [None req-eed35489-3d02-4d85-b101-567b1b71006c tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Lazy-loading 'flavor' on Instance uuid c901bbcc-3d82-4550-888f-bdbb36ba052d {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:20:57 user nova-compute[73572]: DEBUG nova.virt.libvirt.guest [None req-eed35489-3d02-4d85-b101-567b1b71006c tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 10:20:57 user nova-compute[73572]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 10:20:57 user nova-compute[73572]:   <source dev="/dev/sde"/>
Aug 26 10:20:57 user nova-compute[73572]:   <target dev="vdb" bus="virtio"/>
Aug 26 10:20:57 user nova-compute[73572]:   <serial>ae53c4d0-f1af-4b58-8f15-df8b327554b9</serial>
Aug 26 10:20:57 user nova-compute[73572]: </disk>
Aug 26 10:20:57 user nova-compute[73572]:  {{(pid=73572) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 10:20:57 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-eed35489-3d02-4d85-b101-567b1b71006c tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] No BDM found with device name vda, not building metadata. {{(pid=73572) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 10:20:57 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-eed35489-3d02-4d85-b101-567b1b71006c tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73572) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 10:20:57 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-eed35489-3d02-4d85-b101-567b1b71006c tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] No VIF found with MAC fa:16:3e:b7:b1:84, not building metadata {{(pid=73572) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 10:20:57 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-eed35489-3d02-4d85-b101-567b1b71006c tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Lock "c901bbcc-3d82-4550-888f-bdbb36ba052d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 15.242s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:20:58 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:20:58 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:20:59 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:21:00 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-6011e6df-bc0f-49e3-bf21-f1283d43a84c tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Acquiring lock "c901bbcc-3d82-4550-888f-bdbb36ba052d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:21:00 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-6011e6df-bc0f-49e3-bf21-f1283d43a84c tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Lock "c901bbcc-3d82-4550-888f-bdbb36ba052d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:21:00 user nova-compute[73572]: INFO nova.compute.manager [None req-6011e6df-bc0f-49e3-bf21-f1283d43a84c tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] [instance: c901bbcc-3d82-4550-888f-bdbb36ba052d] Detaching volume ae53c4d0-f1af-4b58-8f15-df8b327554b9
Aug 26 10:21:00 user nova-compute[73572]: INFO nova.virt.block_device [None req-6011e6df-bc0f-49e3-bf21-f1283d43a84c tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] [instance: c901bbcc-3d82-4550-888f-bdbb36ba052d] Attempting to driver detach volume ae53c4d0-f1af-4b58-8f15-df8b327554b9 from mountpoint /dev/vdb
Aug 26 10:21:00 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-6011e6df-bc0f-49e3-bf21-f1283d43a84c tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Attempting to detach device vdb from instance c901bbcc-3d82-4550-888f-bdbb36ba052d from the persistent domain config. {{(pid=73572) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 10:21:00 user nova-compute[73572]: DEBUG nova.virt.libvirt.guest [None req-6011e6df-bc0f-49e3-bf21-f1283d43a84c tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 10:21:00 user nova-compute[73572]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 10:21:00 user nova-compute[73572]:   <source dev="/dev/sde"/>
Aug 26 10:21:00 user nova-compute[73572]:   <target dev="vdb" bus="virtio"/>
Aug 26 10:21:00 user nova-compute[73572]:   <serial>ae53c4d0-f1af-4b58-8f15-df8b327554b9</serial>
Aug 26 10:21:00 user nova-compute[73572]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 10:21:00 user nova-compute[73572]: </disk>
Aug 26 10:21:00 user nova-compute[73572]:  {{(pid=73572) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 10:21:00 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-6011e6df-bc0f-49e3-bf21-f1283d43a84c tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Successfully detached device vdb from instance c901bbcc-3d82-4550-888f-bdbb36ba052d from the persistent domain config.
Aug 26 10:21:00 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-6011e6df-bc0f-49e3-bf21-f1283d43a84c tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c901bbcc-3d82-4550-888f-bdbb36ba052d from the live domain config. {{(pid=73572) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 10:21:00 user nova-compute[73572]: DEBUG nova.virt.libvirt.guest [None req-6011e6df-bc0f-49e3-bf21-f1283d43a84c tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 10:21:00 user nova-compute[73572]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 10:21:00 user nova-compute[73572]:   <source dev="/dev/sde"/>
Aug 26 10:21:00 user nova-compute[73572]:   <target dev="vdb" bus="virtio"/>
Aug 26 10:21:00 user nova-compute[73572]:   <serial>ae53c4d0-f1af-4b58-8f15-df8b327554b9</serial>
Aug 26 10:21:00 user nova-compute[73572]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 10:21:00 user nova-compute[73572]: </disk>
Aug 26 10:21:00 user nova-compute[73572]:  {{(pid=73572) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 10:21:00 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:21:00 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Received event <DeviceRemovedEvent: 1693045260.9761019, c901bbcc-3d82-4550-888f-bdbb36ba052d => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73572) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 10:21:00 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-6011e6df-bc0f-49e3-bf21-f1283d43a84c tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c901bbcc-3d82-4550-888f-bdbb36ba052d {{(pid=73572) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 10:21:00 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-6011e6df-bc0f-49e3-bf21-f1283d43a84c tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Successfully detached device vdb from instance c901bbcc-3d82-4550-888f-bdbb36ba052d from the live domain config.
Aug 26 10:21:00 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6011e6df-bc0f-49e3-bf21-f1283d43a84c tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] [instance: c901bbcc-3d82-4550-888f-bdbb36ba052d] calling os-brick to detach iSCSI Volume {{(pid=73572) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 10:21:00 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-6011e6df-bc0f-49e3-bf21-f1283d43a84c tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc89c3d6a10>, {'target_iqns': ['iqn.2010-10.org.openstack:ae53c4d0-f1af-4b58-8f15-df8b327554b9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vTCKMxoq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 10:21:00 user nova-compute[73572]: WARNING os_brick.initiator.connectors.base [None req-6011e6df-bc0f-49e3-bf21-f1283d43a84c tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 10:21:00 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-6011e6df-bc0f-49e3-bf21-f1283d43a84c tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 10:21:00 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-6011e6df-bc0f-49e3-bf21-f1283d43a84c tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 10:21:00 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-6011e6df-bc0f-49e3-bf21-f1283d43a84c tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ae53c4d0-f1af-4b58-8f15-df8b327554b9', 0)] {{(pid=73572) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 10:21:00 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:21:01 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.028s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:21:01 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[0781046e-f715-4c3f-93b4-d610ef4e1320]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5f3a153b-1b99-4297-ad26-ea58f33330b8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ae53c4d0-f1af-4b58-8f15-df8b327554b9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d94556c8-9096-4e9a-9cfc-f9d17846ed06\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:21:01 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:21:01 user nova-compute[73572]: INFO nova.compute.manager [None req-d4ad561c-c2b2-4fa2-96ed-b472d9a5298f tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] [instance: 86923c1a-89a5-4e7a-b488-8bf3a013bf83] Rescuing
Aug 26 10:21:01 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-d4ad561c-c2b2-4fa2-96ed-b472d9a5298f tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Acquiring lock "refresh_cache-86923c1a-89a5-4e7a-b488-8bf3a013bf83" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:21:01 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-d4ad561c-c2b2-4fa2-96ed-b472d9a5298f tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Acquired lock "refresh_cache-86923c1a-89a5-4e7a-b488-8bf3a013bf83" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:21:01 user nova-compute[73572]: DEBUG nova.network.neutron [None req-d4ad561c-c2b2-4fa2-96ed-b472d9a5298f tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] [instance: 86923c1a-89a5-4e7a-b488-8bf3a013bf83] Building network info cache for instance {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 10:21:01 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.043s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:21:01 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce343351-57aa-4b8e-b71c-0ab07df074d0]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f3a153b-1b99-4297-ad26-ea58f33330b8 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d94556c8-9096-4e9a-9cfc-f9d17846ed06 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae53c4d0-f1af-4b58-8f15-df8b327554b9 (non-flash)\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:21:01 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-6011e6df-bc0f-49e3-bf21-f1283d43a84c tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)
Aug 26 10:21:01 user nova-compute[73572]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478 (non-flash)
Aug 26 10:21:01 user nova-compute[73572]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f3a153b-1b99-4297-ad26-ea58f33330b8 (non-flash)
Aug 26 10:21:01 user nova-compute[73572]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d94556c8-9096-4e9a-9cfc-f9d17846ed06 (non-flash)
Aug 26 10:21:01 user nova-compute[73572]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae53c4d0-f1af-4b58-8f15-df8b327554b9 (non-flash)
Aug 26 10:21:01 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 10:21:01 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-6011e6df-bc0f-49e3-bf21-f1283d43a84c tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)
Aug 26 10:21:01 user nova-compute[73572]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478 (non-flash)
Aug 26 10:21:01 user nova-compute[73572]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f3a153b-1b99-4297-ad26-ea58f33330b8 (non-flash)
Aug 26 10:21:01 user nova-compute[73572]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d94556c8-9096-4e9a-9cfc-f9d17846ed06 (non-flash)
Aug 26 10:21:01 user nova-compute[73572]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae53c4d0-f1af-4b58-8f15-df8b327554b9 (non-flash)
Aug 26 10:21:01 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 10:21:01 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-6011e6df-bc0f-49e3-bf21-f1283d43a84c tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc878bacc10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ae53c4d0-f1af-4b58-8f15-df8b327554b9'): ({'sde'}, set())}) {{(pid=73572) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 10:21:01 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-6011e6df-bc0f-49e3-bf21-f1283d43a84c tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Removing single pathed devices sde {{(pid=73572) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 10:21:01 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:21:01 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.048s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:21:01 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[46054420-5285-454a-97f6-ae7f3b856be3]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:21:01 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:21:01 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.028s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:21:01 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[9950438b-6923-4771-af02-866e84e448c8]: (4, ('ok\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:21:01 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-6011e6df-bc0f-49e3-bf21-f1283d43a84c tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Flushing IO for device /dev/sde {{(pid=73572) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 10:21:01 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:21:01 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.021s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:21:01 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[99d2f46f-6ba3-4229-aba9-a75822d8aec3]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:21:01 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-6011e6df-bc0f-49e3-bf21-f1283d43a84c tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73572) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 10:21:01 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:21:01 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.060s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:21:01 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4c89828-786e-4dbd-bae7-e3ee37571d78]: (4, ('1', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:21:01 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-6011e6df-bc0f-49e3-bf21-f1283d43a84c tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73572) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 10:21:01 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-6011e6df-bc0f-49e3-bf21-f1283d43a84c tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] SCSI volumes sde have been removed. {{(pid=73572) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 10:21:01 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-6011e6df-bc0f-49e3-bf21-f1283d43a84c tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ae53c4d0-f1af-4b58-8f15-df8b327554b9')] {{(pid=73572) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 10:21:01 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae53c4d0-f1af-4b58-8f15-df8b327554b9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:21:01 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae53c4d0-f1af-4b58-8f15-df8b327554b9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:21:01 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fc4c6de-2864-4048-9405-51294a323da8]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:21:01 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-6011e6df-bc0f-49e3-bf21-f1283d43a84c tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:21:01 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae53c4d0-f1af-4b58-8f15-df8b327554b9 -p 172.16.0.220:3260 --logout {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:21:01 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae53c4d0-f1af-4b58-8f15-df8b327554b9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:21:01 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef709811-23a4-46f8-be93-f714369bf9b6]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:ae53c4d0-f1af-4b58-8f15-df8b327554b9, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:ae53c4d0-f1af-4b58-8f15-df8b327554b9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:21:01 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-6011e6df-bc0f-49e3-bf21-f1283d43a84c tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:ae53c4d0-f1af-4b58-8f15-df8b327554b9, portal: 172.16.0.220,3260]
Aug 26 10:21:01 user nova-compute[73572]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:ae53c4d0-f1af-4b58-8f15-df8b327554b9, portal: 172.16.0.220,3260] successful.
Aug 26 10:21:01 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:21:01 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae53c4d0-f1af-4b58-8f15-df8b327554b9 -p 172.16.0.220:3260 --op delete {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:21:01 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae53c4d0-f1af-4b58-8f15-df8b327554b9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.042s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:21:01 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2b83bb3-083e-4596-a72b-a0b2da1af4c9]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:21:01 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-6011e6df-bc0f-49e3-bf21-f1283d43a84c tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:21:01 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-6011e6df-bc0f-49e3-bf21-f1283d43a84c tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.431s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 10:21:01 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-6011e6df-bc0f-49e3-bf21-f1283d43a84c tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] <== disconnect_volume: return (432ms) None {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 10:21:01 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6011e6df-bc0f-49e3-bf21-f1283d43a84c tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] [instance: c901bbcc-3d82-4550-888f-bdbb36ba052d] Disconnected iSCSI Volume {{(pid=73572) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 10:21:01 user nova-compute[73572]: DEBUG nova.network.neutron [None req-d4ad561c-c2b2-4fa2-96ed-b472d9a5298f tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] [instance: 86923c1a-89a5-4e7a-b488-8bf3a013bf83] Updating instance_info_cache with network_info: [{"id": "db682944-8949-4bf9-b9d5-2213f0d507bc", "address": "fa:16:3e:7d:b9:15", "network": {"id": "757e71b4-5177-45a5-8ef5-9b27f42092f1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1765327616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1bff48d66894950ac6690e1fd0e79b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb682944-89", "ovs_interfaceid": "db682944-8949-4bf9-b9d5-2213f0d507bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:21:01 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-d4ad561c-c2b2-4fa2-96ed-b472d9a5298f tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Releasing lock "refresh_cache-86923c1a-89a5-4e7a-b488-8bf3a013bf83" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:21:02 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:21:02 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:21:02 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:21:02 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:21:02 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:21:02 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:21:02 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:21:02 user nova-compute[73572]: DEBUG nova.objects.instance [None req-6011e6df-bc0f-49e3-bf21-f1283d43a84c tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Lazy-loading 'flavor' on Instance uuid c901bbcc-3d82-4550-888f-bdbb36ba052d {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:21:02 user nova-compute[73572]: INFO nova.virt.libvirt.driver [-] [instance: 86923c1a-89a5-4e7a-b488-8bf3a013bf83] Instance destroyed successfully.
Aug 26 10:21:02 user nova-compute[73572]: DEBUG nova.compute.manager [req-deb27c81-71b8-47cb-b6ec-717eef2eb5e8 req-3e71b18b-c095-4f7e-b0c0-6e08fe97ca6e service nova] [instance: 86923c1a-89a5-4e7a-b488-8bf3a013bf83] Received event network-vif-unplugged-db682944-8949-4bf9-b9d5-2213f0d507bc {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:21:02 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-deb27c81-71b8-47cb-b6ec-717eef2eb5e8 req-3e71b18b-c095-4f7e-b0c0-6e08fe97ca6e service nova] Acquiring lock "86923c1a-89a5-4e7a-b488-8bf3a013bf83-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:21:02 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-deb27c81-71b8-47cb-b6ec-717eef2eb5e8 req-3e71b18b-c095-4f7e-b0c0-6e08fe97ca6e service nova] Lock "86923c1a-89a5-4e7a-b488-8bf3a013bf83-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:21:02 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-deb27c81-71b8-47cb-b6ec-717eef2eb5e8 req-3e71b18b-c095-4f7e-b0c0-6e08fe97ca6e service nova] Lock "86923c1a-89a5-4e7a-b488-8bf3a013bf83-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:21:02 user nova-compute[73572]: DEBUG nova.compute.manager [req-deb27c81-71b8-47cb-b6ec-717eef2eb5e8 req-3e71b18b-c095-4f7e-b0c0-6e08fe97ca6e service nova] [instance: 86923c1a-89a5-4e7a-b488-8bf3a013bf83] No waiting events found dispatching network-vif-unplugged-db682944-8949-4bf9-b9d5-2213f0d507bc {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:21:02 user nova-compute[73572]: WARNING nova.compute.manager [req-deb27c81-71b8-47cb-b6ec-717eef2eb5e8 req-3e71b18b-c095-4f7e-b0c0-6e08fe97ca6e service nova] [instance: 86923c1a-89a5-4e7a-b488-8bf3a013bf83] Received unexpected event network-vif-unplugged-db682944-8949-4bf9-b9d5-2213f0d507bc for instance with vm_state active and task_state rescuing.
Aug 26 10:21:02 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-d4ad561c-c2b2-4fa2-96ed-b472d9a5298f tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] [instance: 86923c1a-89a5-4e7a-b488-8bf3a013bf83] Attempting rescue
Aug 26 10:21:02 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-d4ad561c-c2b2-4fa2-96ed-b472d9a5298f tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=73572) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 26 10:21:02 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-d4ad561c-c2b2-4fa2-96ed-b472d9a5298f tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] [instance: 86923c1a-89a5-4e7a-b488-8bf3a013bf83] Instance directory exists: not creating {{(pid=73572) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 26 10:21:02 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-d4ad561c-c2b2-4fa2-96ed-b472d9a5298f tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] [instance: 86923c1a-89a5-4e7a-b488-8bf3a013bf83] Creating image(s)
Aug 26 10:21:02 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-d4ad561c-c2b2-4fa2-96ed-b472d9a5298f tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Acquiring lock "/opt/stack/data/nova/instances/86923c1a-89a5-4e7a-b488-8bf3a013bf83/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:21:02 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-d4ad561c-c2b2-4fa2-96ed-b472d9a5298f tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Lock "/opt/stack/data/nova/instances/86923c1a-89a5-4e7a-b488-8bf3a013bf83/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:21:02 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-d4ad561c-c2b2-4fa2-96ed-b472d9a5298f tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Lock "/opt/stack/data/nova/instances/86923c1a-89a5-4e7a-b488-8bf3a013bf83/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:21:02 user nova-compute[73572]: DEBUG nova.objects.instance [None req-d4ad561c-c2b2-4fa2-96ed-b472d9a5298f tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Lazy-loading 'trusted_certs' on Instance uuid 86923c1a-89a5-4e7a-b488-8bf3a013bf83 {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:21:02 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-6011e6df-bc0f-49e3-bf21-f1283d43a84c tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Lock "c901bbcc-3d82-4550-888f-bdbb36ba052d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.374s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:21:02 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-d4ad561c-c2b2-4fa2-96ed-b472d9a5298f tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Acquiring lock "2099350d6f3bcd0de9471c73862d4fe75b049801" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:21:02 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-d4ad561c-c2b2-4fa2-96ed-b472d9a5298f tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Lock "2099350d6f3bcd0de9471c73862d4fe75b049801" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:21:02 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-d4ad561c-c2b2-4fa2-96ed-b472d9a5298f tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:21:02 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-d4ad561c-c2b2-4fa2-96ed-b472d9a5298f tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json" returned: 0 in 0.185s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:21:02 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-d4ad561c-c2b2-4fa2-96ed-b472d9a5298f tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801,backing_fmt=raw /opt/stack/data/nova/instances/86923c1a-89a5-4e7a-b488-8bf3a013bf83/disk.rescue {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:21:03 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-d4ad561c-c2b2-4fa2-96ed-b472d9a5298f tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801,backing_fmt=raw /opt/stack/data/nova/instances/86923c1a-89a5-4e7a-b488-8bf3a013bf83/disk.rescue" returned: 0 in 0.052s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:21:03 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-d4ad561c-c2b2-4fa2-96ed-b472d9a5298f tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Lock "2099350d6f3bcd0de9471c73862d4fe75b049801" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.247s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:21:03 user nova-compute[73572]: DEBUG nova.objects.instance [None req-d4ad561c-c2b2-4fa2-96ed-b472d9a5298f tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Lazy-loading 'migration_context' on Instance uuid 86923c1a-89a5-4e7a-b488-8bf3a013bf83 {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:21:03 user nova-compute[73572]: DEBUG nova.objects.base [None req-d4ad561c-c2b2-4fa2-96ed-b472d9a5298f tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Object Instance<86923c1a-89a5-4e7a-b488-8bf3a013bf83> lazy-loaded attributes: trusted_certs,migration_context {{(pid=73572) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 10:21:03 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-d4ad561c-c2b2-4fa2-96ed-b472d9a5298f tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] [instance: 86923c1a-89a5-4e7a-b488-8bf3a013bf83] Created local disks {{(pid=73572) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 10:21:03 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-d4ad561c-c2b2-4fa2-96ed-b472d9a5298f tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] [instance: 86923c1a-89a5-4e7a-b488-8bf3a013bf83] Start _get_guest_xml network_info=[{"id": "db682944-8949-4bf9-b9d5-2213f0d507bc", "address": "fa:16:3e:7d:b9:15", "network": {"id": "757e71b4-5177-45a5-8ef5-9b27f42092f1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1765327616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1765327616-network", "vif_mac": "fa:16:3e:7d:b9:15"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1bff48d66894950ac6690e1fd0e79b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb682944-89", "ovs_interfaceid": "db682944-8949-4bf9-b9d5-2213f0d507bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T10:07:33Z,direct_url=<?>,disk_format='qcow2',id=299da0c9-e1c4-48f0-be55-fbe20dd06bc9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5c995f8bbbab4368b67a253e0df3971a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T10:07:34Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '299da0c9-e1c4-48f0-be55-fbe20dd06bc9', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=73572) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 10:21:03 user nova-compute[73572]: DEBUG nova.objects.instance [None req-d4ad561c-c2b2-4fa2-96ed-b472d9a5298f tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Lazy-loading 'resources' on Instance uuid 86923c1a-89a5-4e7a-b488-8bf3a013bf83 {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:21:03 user nova-compute[73572]: DEBUG nova.objects.base [None req-d4ad561c-c2b2-4fa2-96ed-b472d9a5298f tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Object Instance<86923c1a-89a5-4e7a-b488-8bf3a013bf83> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=73572) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 10:21:03 user nova-compute[73572]: DEBUG nova.objects.instance [None req-d4ad561c-c2b2-4fa2-96ed-b472d9a5298f tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Lazy-loading 'numa_topology' on Instance uuid 86923c1a-89a5-4e7a-b488-8bf3a013bf83 {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:21:03 user nova-compute[73572]: DEBUG nova.objects.base [None req-d4ad561c-c2b2-4fa2-96ed-b472d9a5298f tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Object Instance<86923c1a-89a5-4e7a-b488-8bf3a013bf83> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=73572) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 10:21:03 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-d4ad561c-c2b2-4fa2-96ed-b472d9a5298f tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:21:03 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-d4ad561c-c2b2-4fa2-96ed-b472d9a5298f tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:21:03 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-d4ad561c-c2b2-4fa2-96ed-b472d9a5298f tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73572) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 10:21:03 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-d4ad561c-c2b2-4fa2-96ed-b472d9a5298f tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] CPU controller missing on host. {{(pid=73572) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 10:21:03 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-d4ad561c-c2b2-4fa2-96ed-b472d9a5298f tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73572) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 10:21:03 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-d4ad561c-c2b2-4fa2-96ed-b472d9a5298f tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] CPU controller found on host. {{(pid=73572) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 10:21:03 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-d4ad561c-c2b2-4fa2-96ed-b472d9a5298f tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73572) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 10:21:03 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-d4ad561c-c2b2-4fa2-96ed-b472d9a5298f tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T10:07:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T10:07:33Z,direct_url=<?>,disk_format='qcow2',id=299da0c9-e1c4-48f0-be55-fbe20dd06bc9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5c995f8bbbab4368b67a253e0df3971a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T10:07:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 10:21:03 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-d4ad561c-c2b2-4fa2-96ed-b472d9a5298f tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Flavor limits 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 10:21:03 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-d4ad561c-c2b2-4fa2-96ed-b472d9a5298f tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Image limits 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 10:21:03 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-d4ad561c-c2b2-4fa2-96ed-b472d9a5298f tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Flavor pref 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 10:21:03 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-d4ad561c-c2b2-4fa2-96ed-b472d9a5298f tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Image pref 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 10:21:03 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-d4ad561c-c2b2-4fa2-96ed-b472d9a5298f tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 10:21:03 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-d4ad561c-c2b2-4fa2-96ed-b472d9a5298f tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 10:21:03 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-d4ad561c-c2b2-4fa2-96ed-b472d9a5298f tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73572) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 10:21:03 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-d4ad561c-c2b2-4fa2-96ed-b472d9a5298f tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Got 1 possible topologies {{(pid=73572) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 10:21:03 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-d4ad561c-c2b2-4fa2-96ed-b472d9a5298f tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 10:21:03 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-d4ad561c-c2b2-4fa2-96ed-b472d9a5298f tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 10:21:03 user nova-compute[73572]: DEBUG nova.objects.instance [None req-d4ad561c-c2b2-4fa2-96ed-b472d9a5298f tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Lazy-loading 'vcpu_model' on Instance uuid 86923c1a-89a5-4e7a-b488-8bf3a013bf83 {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:21:03 user nova-compute[73572]: DEBUG nova.objects.base [None req-d4ad561c-c2b2-4fa2-96ed-b472d9a5298f tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Object Instance<86923c1a-89a5-4e7a-b488-8bf3a013bf83> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=73572) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 10:21:03 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-d4ad561c-c2b2-4fa2-96ed-b472d9a5298f tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T10:19:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1567915986',display_name='tempest-ServerRescueNegativeTestJSON-server-1567915986',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1567915986',id=25,image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T10:19:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c1bff48d66894950ac6690e1fd0e79b9',ramdisk_id='',reservation_id='r-btw4ruhw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1710547876',owner_user_name='tempest-ServerRescueNegativeTestJSON-1710547876-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T10:19:20Z,user_data=None,user_id='099462c61dcc4816b17d2d0155823873',uuid=86923c1a-89a5-4e7a-b488-8bf3a013bf83,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "db682944-8949-4bf9-b9d5-2213f0d507bc", "address": "fa:16:3e:7d:b9:15", "network": {"id": "757e71b4-5177-45a5-8ef5-9b27f42092f1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1765327616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1765327616-network", "vif_mac": "fa:16:3e:7d:b9:15"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1bff48d66894950ac6690e1fd0e79b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb682944-89", "ovs_interfaceid": "db682944-8949-4bf9-b9d5-2213f0d507bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73572) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 10:21:03 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-d4ad561c-c2b2-4fa2-96ed-b472d9a5298f tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Converting VIF {"id": "db682944-8949-4bf9-b9d5-2213f0d507bc", "address": "fa:16:3e:7d:b9:15", "network": {"id": "757e71b4-5177-45a5-8ef5-9b27f42092f1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1765327616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1765327616-network", "vif_mac": "fa:16:3e:7d:b9:15"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1bff48d66894950ac6690e1fd0e79b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb682944-89", "ovs_interfaceid": "db682944-8949-4bf9-b9d5-2213f0d507bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:21:03 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-d4ad561c-c2b2-4fa2-96ed-b472d9a5298f tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7d:b9:15,bridge_name='br-int',has_traffic_filtering=True,id=db682944-8949-4bf9-b9d5-2213f0d507bc,network=Network(757e71b4-5177-45a5-8ef5-9b27f42092f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb682944-89') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:21:03 user nova-compute[73572]: DEBUG nova.objects.instance [None req-d4ad561c-c2b2-4fa2-96ed-b472d9a5298f tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Lazy-loading 'pci_devices' on Instance uuid 86923c1a-89a5-4e7a-b488-8bf3a013bf83 {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:21:03 user nova-compute[73572]: DEBUG nova.objects.base [None req-d4ad561c-c2b2-4fa2-96ed-b472d9a5298f tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Object Instance<86923c1a-89a5-4e7a-b488-8bf3a013bf83> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=73572) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 10:21:03 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-d4ad561c-c2b2-4fa2-96ed-b472d9a5298f tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] [instance: 86923c1a-89a5-4e7a-b488-8bf3a013bf83] End _get_guest_xml xml=<domain type="kvm">
Aug 26 10:21:03 user nova-compute[73572]:   <uuid>86923c1a-89a5-4e7a-b488-8bf3a013bf83</uuid>
Aug 26 10:21:03 user nova-compute[73572]:   <name>instance-00000019</name>
Aug 26 10:21:03 user nova-compute[73572]:   <memory>524288</memory>
Aug 26 10:21:03 user nova-compute[73572]:   <vcpu>1</vcpu>
Aug 26 10:21:03 user nova-compute[73572]:   <metadata>
Aug 26 10:21:03 user nova-compute[73572]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 10:21:03 user nova-compute[73572]:       <nova:package version="0.0.0"/>
Aug 26 10:21:03 user nova-compute[73572]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1567915986</nova:name>
Aug 26 10:21:03 user nova-compute[73572]:       <nova:creationTime>2023-08-26 10:21:03</nova:creationTime>
Aug 26 10:21:03 user nova-compute[73572]:       <nova:flavor name="m1.tiny">
Aug 26 10:21:03 user nova-compute[73572]:         <nova:memory>512</nova:memory>
Aug 26 10:21:03 user nova-compute[73572]:         <nova:disk>1</nova:disk>
Aug 26 10:21:03 user nova-compute[73572]:         <nova:swap>0</nova:swap>
Aug 26 10:21:03 user nova-compute[73572]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 10:21:03 user nova-compute[73572]:         <nova:vcpus>1</nova:vcpus>
Aug 26 10:21:03 user nova-compute[73572]:       </nova:flavor>
Aug 26 10:21:03 user nova-compute[73572]:       <nova:owner>
Aug 26 10:21:03 user nova-compute[73572]:         <nova:user uuid="099462c61dcc4816b17d2d0155823873">tempest-ServerRescueNegativeTestJSON-1710547876-project-member</nova:user>
Aug 26 10:21:03 user nova-compute[73572]:         <nova:project uuid="c1bff48d66894950ac6690e1fd0e79b9">tempest-ServerRescueNegativeTestJSON-1710547876</nova:project>
Aug 26 10:21:03 user nova-compute[73572]:       </nova:owner>
Aug 26 10:21:03 user nova-compute[73572]:       <nova:root type="image" uuid="299da0c9-e1c4-48f0-be55-fbe20dd06bc9"/>
Aug 26 10:21:03 user nova-compute[73572]:       <nova:ports>
Aug 26 10:21:03 user nova-compute[73572]:         <nova:port uuid="db682944-8949-4bf9-b9d5-2213f0d507bc">
Aug 26 10:21:03 user nova-compute[73572]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 26 10:21:03 user nova-compute[73572]:         </nova:port>
Aug 26 10:21:03 user nova-compute[73572]:       </nova:ports>
Aug 26 10:21:03 user nova-compute[73572]:     </nova:instance>
Aug 26 10:21:03 user nova-compute[73572]:   </metadata>
Aug 26 10:21:03 user nova-compute[73572]:   <sysinfo type="smbios">
Aug 26 10:21:03 user nova-compute[73572]:     <system>
Aug 26 10:21:03 user nova-compute[73572]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 10:21:03 user nova-compute[73572]:       <entry name="product">OpenStack Nova</entry>
Aug 26 10:21:03 user nova-compute[73572]:       <entry name="version">0.0.0</entry>
Aug 26 10:21:03 user nova-compute[73572]:       <entry name="serial">86923c1a-89a5-4e7a-b488-8bf3a013bf83</entry>
Aug 26 10:21:03 user nova-compute[73572]:       <entry name="uuid">86923c1a-89a5-4e7a-b488-8bf3a013bf83</entry>
Aug 26 10:21:03 user nova-compute[73572]:       <entry name="family">Virtual Machine</entry>
Aug 26 10:21:03 user nova-compute[73572]:     </system>
Aug 26 10:21:03 user nova-compute[73572]:   </sysinfo>
Aug 26 10:21:03 user nova-compute[73572]:   <os>
Aug 26 10:21:03 user nova-compute[73572]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 10:21:03 user nova-compute[73572]:     <smbios mode="sysinfo"/>
Aug 26 10:21:03 user nova-compute[73572]:   </os>
Aug 26 10:21:03 user nova-compute[73572]:   <features>
Aug 26 10:21:03 user nova-compute[73572]:     <acpi/>
Aug 26 10:21:03 user nova-compute[73572]:     <apic/>
Aug 26 10:21:03 user nova-compute[73572]:     <vmcoreinfo/>
Aug 26 10:21:03 user nova-compute[73572]:   </features>
Aug 26 10:21:03 user nova-compute[73572]:   <clock offset="utc">
Aug 26 10:21:03 user nova-compute[73572]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 10:21:03 user nova-compute[73572]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 10:21:03 user nova-compute[73572]:     <timer name="hpet" present="no"/>
Aug 26 10:21:03 user nova-compute[73572]:   </clock>
Aug 26 10:21:03 user nova-compute[73572]:   <cpu mode="custom" match="exact">
Aug 26 10:21:03 user nova-compute[73572]:     <model>Nehalem</model>
Aug 26 10:21:03 user nova-compute[73572]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 10:21:03 user nova-compute[73572]:   </cpu>
Aug 26 10:21:03 user nova-compute[73572]:   <devices>
Aug 26 10:21:03 user nova-compute[73572]:     <disk type="file" device="disk">
Aug 26 10:21:03 user nova-compute[73572]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 10:21:03 user nova-compute[73572]:       <source file="/opt/stack/data/nova/instances/86923c1a-89a5-4e7a-b488-8bf3a013bf83/disk.rescue"/>
Aug 26 10:21:03 user nova-compute[73572]:       <target dev="vda" bus="virtio"/>
Aug 26 10:21:03 user nova-compute[73572]:     </disk>
Aug 26 10:21:03 user nova-compute[73572]:     <disk type="file" device="disk">
Aug 26 10:21:03 user nova-compute[73572]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 10:21:03 user nova-compute[73572]:       <source file="/opt/stack/data/nova/instances/86923c1a-89a5-4e7a-b488-8bf3a013bf83/disk"/>
Aug 26 10:21:03 user nova-compute[73572]:       <target dev="vdb" bus="virtio"/>
Aug 26 10:21:03 user nova-compute[73572]:     </disk>
Aug 26 10:21:03 user nova-compute[73572]:     <interface type="ethernet">
Aug 26 10:21:03 user nova-compute[73572]:       <mac address="fa:16:3e:7d:b9:15"/>
Aug 26 10:21:03 user nova-compute[73572]:       <model type="virtio"/>
Aug 26 10:21:03 user nova-compute[73572]:       <mtu size="1442"/>
Aug 26 10:21:03 user nova-compute[73572]:       <target dev="tapdb682944-89"/>
Aug 26 10:21:03 user nova-compute[73572]:     </interface>
Aug 26 10:21:03 user nova-compute[73572]:     <serial type="pty">
Aug 26 10:21:03 user nova-compute[73572]:       <log file="/opt/stack/data/nova/instances/86923c1a-89a5-4e7a-b488-8bf3a013bf83/console.log" append="off"/>
Aug 26 10:21:03 user nova-compute[73572]:     </serial>
Aug 26 10:21:03 user nova-compute[73572]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 10:21:03 user nova-compute[73572]:     <video>
Aug 26 10:21:03 user nova-compute[73572]:       <model type="virtio"/>
Aug 26 10:21:03 user nova-compute[73572]:     </video>
Aug 26 10:21:03 user nova-compute[73572]:     <rng model="virtio">
Aug 26 10:21:03 user nova-compute[73572]:       <backend model="random">/dev/urandom</backend>
Aug 26 10:21:03 user nova-compute[73572]:     </rng>
Aug 26 10:21:03 user nova-compute[73572]:     <controller type="usb" index="0" model="none"/>
Aug 26 10:21:03 user nova-compute[73572]:     <memballoon model="virtio">
Aug 26 10:21:03 user nova-compute[73572]:       <stats period="10"/>
Aug 26 10:21:03 user nova-compute[73572]:     </memballoon>
Aug 26 10:21:03 user nova-compute[73572]:   </devices>
Aug 26 10:21:03 user nova-compute[73572]: </domain>
Aug 26 10:21:03 user nova-compute[73572]:  {{(pid=73572) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 10:21:03 user nova-compute[73572]: INFO nova.virt.libvirt.driver [-] [instance: 86923c1a-89a5-4e7a-b488-8bf3a013bf83] Instance destroyed successfully.
Aug 26 10:21:03 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-d4ad561c-c2b2-4fa2-96ed-b472d9a5298f tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] No BDM found with device name vda, not building metadata. {{(pid=73572) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 10:21:03 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-d4ad561c-c2b2-4fa2-96ed-b472d9a5298f tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73572) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 10:21:03 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-d4ad561c-c2b2-4fa2-96ed-b472d9a5298f tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] No VIF found with MAC fa:16:3e:7d:b9:15, not building metadata {{(pid=73572) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 10:21:04 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:21:04 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:21:04 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:21:04 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:21:05 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:21:05 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:21:05 user nova-compute[73572]: DEBUG nova.compute.manager [req-eb03642d-d2ff-4f41-962f-851e89ebce28 req-df5f85a9-0646-457a-945a-b790f0da3846 service nova] [instance: 86923c1a-89a5-4e7a-b488-8bf3a013bf83] Received event network-vif-plugged-db682944-8949-4bf9-b9d5-2213f0d507bc {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:21:05 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-eb03642d-d2ff-4f41-962f-851e89ebce28 req-df5f85a9-0646-457a-945a-b790f0da3846 service nova] Acquiring lock "86923c1a-89a5-4e7a-b488-8bf3a013bf83-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:21:05 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-eb03642d-d2ff-4f41-962f-851e89ebce28 req-df5f85a9-0646-457a-945a-b790f0da3846 service nova] Lock "86923c1a-89a5-4e7a-b488-8bf3a013bf83-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:21:05 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-eb03642d-d2ff-4f41-962f-851e89ebce28 req-df5f85a9-0646-457a-945a-b790f0da3846 service nova] Lock "86923c1a-89a5-4e7a-b488-8bf3a013bf83-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:21:05 user nova-compute[73572]: DEBUG nova.compute.manager [req-eb03642d-d2ff-4f41-962f-851e89ebce28 req-df5f85a9-0646-457a-945a-b790f0da3846 service nova] [instance: 86923c1a-89a5-4e7a-b488-8bf3a013bf83] No waiting events found dispatching network-vif-plugged-db682944-8949-4bf9-b9d5-2213f0d507bc {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:21:05 user nova-compute[73572]: WARNING nova.compute.manager [req-eb03642d-d2ff-4f41-962f-851e89ebce28 req-df5f85a9-0646-457a-945a-b790f0da3846 service nova] [instance: 86923c1a-89a5-4e7a-b488-8bf3a013bf83] Received unexpected event network-vif-plugged-db682944-8949-4bf9-b9d5-2213f0d507bc for instance with vm_state active and task_state rescuing.
Aug 26 10:21:05 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:21:06 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:21:06 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Removed pending event for 86923c1a-89a5-4e7a-b488-8bf3a013bf83 due to event {{(pid=73572) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 26 10:21:06 user nova-compute[73572]: DEBUG nova.virt.driver [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Emitting event <LifecycleEvent: 1693045266.979433, 86923c1a-89a5-4e7a-b488-8bf3a013bf83 => Resumed> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:21:06 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 86923c1a-89a5-4e7a-b488-8bf3a013bf83] VM Resumed (Lifecycle Event)
Aug 26 10:21:07 user nova-compute[73572]: DEBUG nova.compute.manager [None req-d4ad561c-c2b2-4fa2-96ed-b472d9a5298f tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] [instance: 86923c1a-89a5-4e7a-b488-8bf3a013bf83] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:21:07 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 86923c1a-89a5-4e7a-b488-8bf3a013bf83] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:21:07 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 86923c1a-89a5-4e7a-b488-8bf3a013bf83] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73572) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 10:21:07 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 86923c1a-89a5-4e7a-b488-8bf3a013bf83] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 26 10:21:07 user nova-compute[73572]: DEBUG nova.virt.driver [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Emitting event <LifecycleEvent: 1693045266.9900107, 86923c1a-89a5-4e7a-b488-8bf3a013bf83 => Started> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:21:07 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 86923c1a-89a5-4e7a-b488-8bf3a013bf83] VM Started (Lifecycle Event)
Aug 26 10:21:07 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 86923c1a-89a5-4e7a-b488-8bf3a013bf83] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:21:07 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 86923c1a-89a5-4e7a-b488-8bf3a013bf83] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73572) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 10:21:07 user nova-compute[73572]: DEBUG nova.compute.manager [req-8b0c042b-bd06-45df-9f63-038d63e37491 req-2784d4bd-2838-4abb-ba04-8b61ddb43232 service nova] [instance: 86923c1a-89a5-4e7a-b488-8bf3a013bf83] Received event network-vif-plugged-db682944-8949-4bf9-b9d5-2213f0d507bc {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:21:07 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-8b0c042b-bd06-45df-9f63-038d63e37491 req-2784d4bd-2838-4abb-ba04-8b61ddb43232 service nova] Acquiring lock "86923c1a-89a5-4e7a-b488-8bf3a013bf83-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:21:07 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-8b0c042b-bd06-45df-9f63-038d63e37491 req-2784d4bd-2838-4abb-ba04-8b61ddb43232 service nova] Lock "86923c1a-89a5-4e7a-b488-8bf3a013bf83-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:21:07 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-8b0c042b-bd06-45df-9f63-038d63e37491 req-2784d4bd-2838-4abb-ba04-8b61ddb43232 service nova] Lock "86923c1a-89a5-4e7a-b488-8bf3a013bf83-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:21:07 user nova-compute[73572]: DEBUG nova.compute.manager [req-8b0c042b-bd06-45df-9f63-038d63e37491 req-2784d4bd-2838-4abb-ba04-8b61ddb43232 service nova] [instance: 86923c1a-89a5-4e7a-b488-8bf3a013bf83] No waiting events found dispatching network-vif-plugged-db682944-8949-4bf9-b9d5-2213f0d507bc {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:21:07 user nova-compute[73572]: WARNING nova.compute.manager [req-8b0c042b-bd06-45df-9f63-038d63e37491 req-2784d4bd-2838-4abb-ba04-8b61ddb43232 service nova] [instance: 86923c1a-89a5-4e7a-b488-8bf3a013bf83] Received unexpected event network-vif-plugged-db682944-8949-4bf9-b9d5-2213f0d507bc for instance with vm_state rescued and task_state None.
Aug 26 10:21:07 user nova-compute[73572]: DEBUG nova.compute.manager [req-8b0c042b-bd06-45df-9f63-038d63e37491 req-2784d4bd-2838-4abb-ba04-8b61ddb43232 service nova] [instance: 86923c1a-89a5-4e7a-b488-8bf3a013bf83] Received event network-vif-plugged-db682944-8949-4bf9-b9d5-2213f0d507bc {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:21:07 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-8b0c042b-bd06-45df-9f63-038d63e37491 req-2784d4bd-2838-4abb-ba04-8b61ddb43232 service nova] Acquiring lock "86923c1a-89a5-4e7a-b488-8bf3a013bf83-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:21:07 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-8b0c042b-bd06-45df-9f63-038d63e37491 req-2784d4bd-2838-4abb-ba04-8b61ddb43232 service nova] Lock "86923c1a-89a5-4e7a-b488-8bf3a013bf83-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:21:07 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-8b0c042b-bd06-45df-9f63-038d63e37491 req-2784d4bd-2838-4abb-ba04-8b61ddb43232 service nova] Lock "86923c1a-89a5-4e7a-b488-8bf3a013bf83-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:21:07 user nova-compute[73572]: DEBUG nova.compute.manager [req-8b0c042b-bd06-45df-9f63-038d63e37491 req-2784d4bd-2838-4abb-ba04-8b61ddb43232 service nova] [instance: 86923c1a-89a5-4e7a-b488-8bf3a013bf83] No waiting events found dispatching network-vif-plugged-db682944-8949-4bf9-b9d5-2213f0d507bc {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:21:07 user nova-compute[73572]: WARNING nova.compute.manager [req-8b0c042b-bd06-45df-9f63-038d63e37491 req-2784d4bd-2838-4abb-ba04-8b61ddb43232 service nova] [instance: 86923c1a-89a5-4e7a-b488-8bf3a013bf83] Received unexpected event network-vif-plugged-db682944-8949-4bf9-b9d5-2213f0d507bc for instance with vm_state rescued and task_state None.
Aug 26 10:21:07 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-41f5d370-69f2-4c74-8c40-ed19b54feb42 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Acquiring lock "00c47a06-2bf8-427d-bcb1-304688584511" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:21:07 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-41f5d370-69f2-4c74-8c40-ed19b54feb42 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Lock "00c47a06-2bf8-427d-bcb1-304688584511" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:21:07 user nova-compute[73572]: INFO nova.compute.manager [None req-41f5d370-69f2-4c74-8c40-ed19b54feb42 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] [instance: 00c47a06-2bf8-427d-bcb1-304688584511] Detaching volume fceee937-cad2-4ce8-8a00-49b3ffab9478
Aug 26 10:21:07 user nova-compute[73572]: INFO nova.virt.block_device [None req-41f5d370-69f2-4c74-8c40-ed19b54feb42 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] [instance: 00c47a06-2bf8-427d-bcb1-304688584511] Attempting to driver detach volume fceee937-cad2-4ce8-8a00-49b3ffab9478 from mountpoint /dev/vdb
Aug 26 10:21:08 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-41f5d370-69f2-4c74-8c40-ed19b54feb42 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Attempting to detach device vdb from instance 00c47a06-2bf8-427d-bcb1-304688584511 from the persistent domain config. {{(pid=73572) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 10:21:08 user nova-compute[73572]: DEBUG nova.virt.libvirt.guest [None req-41f5d370-69f2-4c74-8c40-ed19b54feb42 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 10:21:08 user nova-compute[73572]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 10:21:08 user nova-compute[73572]:   <source dev="/dev/sdb"/>
Aug 26 10:21:08 user nova-compute[73572]:   <target dev="vdb" bus="virtio"/>
Aug 26 10:21:08 user nova-compute[73572]:   <serial>fceee937-cad2-4ce8-8a00-49b3ffab9478</serial>
Aug 26 10:21:08 user nova-compute[73572]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 26 10:21:08 user nova-compute[73572]: </disk>
Aug 26 10:21:08 user nova-compute[73572]:  {{(pid=73572) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 10:21:08 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-41f5d370-69f2-4c74-8c40-ed19b54feb42 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Successfully detached device vdb from instance 00c47a06-2bf8-427d-bcb1-304688584511 from the persistent domain config.
Aug 26 10:21:08 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-41f5d370-69f2-4c74-8c40-ed19b54feb42 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 00c47a06-2bf8-427d-bcb1-304688584511 from the live domain config. {{(pid=73572) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 10:21:08 user nova-compute[73572]: DEBUG nova.virt.libvirt.guest [None req-41f5d370-69f2-4c74-8c40-ed19b54feb42 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 10:21:08 user nova-compute[73572]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 10:21:08 user nova-compute[73572]:   <source dev="/dev/sdb"/>
Aug 26 10:21:08 user nova-compute[73572]:   <target dev="vdb" bus="virtio"/>
Aug 26 10:21:08 user nova-compute[73572]:   <serial>fceee937-cad2-4ce8-8a00-49b3ffab9478</serial>
Aug 26 10:21:08 user nova-compute[73572]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 26 10:21:08 user nova-compute[73572]: </disk>
Aug 26 10:21:08 user nova-compute[73572]:  {{(pid=73572) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 10:21:08 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Received event <DeviceRemovedEvent: 1693045268.5528204, 00c47a06-2bf8-427d-bcb1-304688584511 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73572) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 10:21:08 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-41f5d370-69f2-4c74-8c40-ed19b54feb42 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 00c47a06-2bf8-427d-bcb1-304688584511 {{(pid=73572) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 10:21:08 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-41f5d370-69f2-4c74-8c40-ed19b54feb42 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Successfully detached device vdb from instance 00c47a06-2bf8-427d-bcb1-304688584511 from the live domain config.
Aug 26 10:21:08 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-41f5d370-69f2-4c74-8c40-ed19b54feb42 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] [instance: 00c47a06-2bf8-427d-bcb1-304688584511] calling os-brick to detach iSCSI Volume {{(pid=73572) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 10:21:08 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-41f5d370-69f2-4c74-8c40-ed19b54feb42 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc89c3d6a10>, {'target_iqns': ['iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bpfqgBQW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 10:21:08 user nova-compute[73572]: WARNING os_brick.initiator.connectors.base [None req-41f5d370-69f2-4c74-8c40-ed19b54feb42 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 10:21:08 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-41f5d370-69f2-4c74-8c40-ed19b54feb42 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 10:21:08 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-41f5d370-69f2-4c74-8c40-ed19b54feb42 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 10:21:08 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-41f5d370-69f2-4c74-8c40-ed19b54feb42 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478', 0)] {{(pid=73572) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 10:21:08 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:21:08 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:21:08 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[83a039c7-96e7-4360-a47a-b320faed423f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5f3a153b-1b99-4297-ad26-ea58f33330b8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d94556c8-9096-4e9a-9cfc-f9d17846ed06\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:21:08 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:21:08 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:21:08 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[924da873-117a-48b1-bee7-53dcacc40b74]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f3a153b-1b99-4297-ad26-ea58f33330b8 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d94556c8-9096-4e9a-9cfc-f9d17846ed06 (non-flash)\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:21:08 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-41f5d370-69f2-4c74-8c40-ed19b54feb42 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)
Aug 26 10:21:08 user nova-compute[73572]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478 (non-flash)
Aug 26 10:21:08 user nova-compute[73572]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f3a153b-1b99-4297-ad26-ea58f33330b8 (non-flash)
Aug 26 10:21:08 user nova-compute[73572]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d94556c8-9096-4e9a-9cfc-f9d17846ed06 (non-flash)
Aug 26 10:21:08 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 10:21:08 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-41f5d370-69f2-4c74-8c40-ed19b54feb42 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)
Aug 26 10:21:08 user nova-compute[73572]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478 (non-flash)
Aug 26 10:21:08 user nova-compute[73572]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f3a153b-1b99-4297-ad26-ea58f33330b8 (non-flash)
Aug 26 10:21:08 user nova-compute[73572]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d94556c8-9096-4e9a-9cfc-f9d17846ed06 (non-flash)
Aug 26 10:21:08 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 10:21:08 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-41f5d370-69f2-4c74-8c40-ed19b54feb42 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc878c99090>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478'): ({'sdb'}, set())}) {{(pid=73572) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 10:21:08 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-41f5d370-69f2-4c74-8c40-ed19b54feb42 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Removing single pathed devices sdb {{(pid=73572) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 10:21:08 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:21:08 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:21:08 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2b3cbc5-0621-4ca6-933c-12a6f522bc7c]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:21:08 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:21:08 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:21:08 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[11a77a2d-55ba-4953-b0e2-74133b6f0e60]: (4, ('ok\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:21:08 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-41f5d370-69f2-4c74-8c40-ed19b54feb42 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Flushing IO for device /dev/sdb {{(pid=73572) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 10:21:08 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:21:08 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:21:08 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a74160b-7c6c-4df3-b4ad-291e245b9aeb]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:21:08 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-41f5d370-69f2-4c74-8c40-ed19b54feb42 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73572) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 10:21:08 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:21:08 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.055s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:21:08 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ff05d54-7ebb-4d56-a9f1-f0304dd0912f]: (4, ('1', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:21:08 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-41f5d370-69f2-4c74-8c40-ed19b54feb42 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73572) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 10:21:08 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-41f5d370-69f2-4c74-8c40-ed19b54feb42 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] SCSI volumes sdb have been removed. {{(pid=73572) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 10:21:08 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-41f5d370-69f2-4c74-8c40-ed19b54feb42 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478')] {{(pid=73572) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 10:21:08 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:21:08 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:21:08 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e139997-6139-4cee-90d2-2772c6d60af5]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:21:08 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-41f5d370-69f2-4c74-8c40-ed19b54feb42 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:21:08 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478 -p 172.16.0.220:3260 --logout {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:21:08 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:21:08 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[cba3c8ad-c29c-4383-96a3-a4c413d6fdce]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:21:08 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-41f5d370-69f2-4c74-8c40-ed19b54feb42 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478, portal: 172.16.0.220,3260]
Aug 26 10:21:08 user nova-compute[73572]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478, portal: 172.16.0.220,3260] successful.
Aug 26 10:21:08 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:21:08 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478 -p 172.16.0.220:3260 --op delete {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:21:08 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fceee937-cad2-4ce8-8a00-49b3ffab9478 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:21:08 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ecb3e24-dc04-42af-95e5-c92f6c25e58c]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:21:08 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-41f5d370-69f2-4c74-8c40-ed19b54feb42 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:21:08 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-41f5d370-69f2-4c74-8c40-ed19b54feb42 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.345s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 10:21:08 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-41f5d370-69f2-4c74-8c40-ed19b54feb42 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] <== disconnect_volume: return (347ms) None {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 10:21:08 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-41f5d370-69f2-4c74-8c40-ed19b54feb42 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] [instance: 00c47a06-2bf8-427d-bcb1-304688584511] Disconnected iSCSI Volume {{(pid=73572) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 10:21:09 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:21:09 user nova-compute[73572]: DEBUG nova.objects.instance [None req-41f5d370-69f2-4c74-8c40-ed19b54feb42 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Lazy-loading 'flavor' on Instance uuid 00c47a06-2bf8-427d-bcb1-304688584511 {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:21:09 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-41f5d370-69f2-4c74-8c40-ed19b54feb42 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Lock "00c47a06-2bf8-427d-bcb1-304688584511" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.962s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:21:10 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-1c61e0fa-3991-4774-bf89-5fa640d89ef5 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Acquiring lock "00c47a06-2bf8-427d-bcb1-304688584511" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:21:10 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-1c61e0fa-3991-4774-bf89-5fa640d89ef5 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Lock "00c47a06-2bf8-427d-bcb1-304688584511" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:21:10 user nova-compute[73572]: DEBUG nova.compute.manager [None req-1c61e0fa-3991-4774-bf89-5fa640d89ef5 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] [instance: 00c47a06-2bf8-427d-bcb1-304688584511] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:21:10 user nova-compute[73572]: DEBUG nova.compute.manager [None req-1c61e0fa-3991-4774-bf89-5fa640d89ef5 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] [instance: 00c47a06-2bf8-427d-bcb1-304688584511] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=73572) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3342}}
Aug 26 10:21:10 user nova-compute[73572]: DEBUG nova.objects.instance [None req-1c61e0fa-3991-4774-bf89-5fa640d89ef5 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Lazy-loading 'flavor' on Instance uuid 00c47a06-2bf8-427d-bcb1-304688584511 {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:21:10 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:21:10 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:21:10 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:21:10 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:21:10 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:21:10 user nova-compute[73572]: DEBUG nova.compute.manager [req-94a3fef9-f147-4089-a2d0-b4c9d68ea893 req-54908810-790c-49bb-9290-be11f235495e service nova] [instance: 00c47a06-2bf8-427d-bcb1-304688584511] Received event network-vif-unplugged-d18bfeb9-ad63-41d9-8d66-56df3d3306d8 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:21:10 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-94a3fef9-f147-4089-a2d0-b4c9d68ea893 req-54908810-790c-49bb-9290-be11f235495e service nova] Acquiring lock "00c47a06-2bf8-427d-bcb1-304688584511-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:21:10 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-94a3fef9-f147-4089-a2d0-b4c9d68ea893 req-54908810-790c-49bb-9290-be11f235495e service nova] Lock "00c47a06-2bf8-427d-bcb1-304688584511-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:21:10 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-94a3fef9-f147-4089-a2d0-b4c9d68ea893 req-54908810-790c-49bb-9290-be11f235495e service nova] Lock "00c47a06-2bf8-427d-bcb1-304688584511-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:21:10 user nova-compute[73572]: DEBUG nova.compute.manager [req-94a3fef9-f147-4089-a2d0-b4c9d68ea893 req-54908810-790c-49bb-9290-be11f235495e service nova] [instance: 00c47a06-2bf8-427d-bcb1-304688584511] No waiting events found dispatching network-vif-unplugged-d18bfeb9-ad63-41d9-8d66-56df3d3306d8 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:21:10 user nova-compute[73572]: WARNING nova.compute.manager [req-94a3fef9-f147-4089-a2d0-b4c9d68ea893 req-54908810-790c-49bb-9290-be11f235495e service nova] [instance: 00c47a06-2bf8-427d-bcb1-304688584511] Received unexpected event network-vif-unplugged-d18bfeb9-ad63-41d9-8d66-56df3d3306d8 for instance with vm_state active and task_state powering-off.
Aug 26 10:21:11 user nova-compute[73572]: INFO nova.virt.libvirt.driver [-] [instance: 00c47a06-2bf8-427d-bcb1-304688584511] Instance destroyed successfully.
Aug 26 10:21:11 user nova-compute[73572]: DEBUG nova.compute.manager [None req-1c61e0fa-3991-4774-bf89-5fa640d89ef5 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] [instance: 00c47a06-2bf8-427d-bcb1-304688584511] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:21:11 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-1c61e0fa-3991-4774-bf89-5fa640d89ef5 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Lock "00c47a06-2bf8-427d-bcb1-304688584511" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.928s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:21:11 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:21:13 user nova-compute[73572]: DEBUG nova.compute.manager [req-c5419a29-9353-48b3-89ff-2c8657150648 req-3641551b-9f99-42e0-8a59-5d7ce06ccb3b service nova] [instance: 00c47a06-2bf8-427d-bcb1-304688584511] Received event network-vif-plugged-d18bfeb9-ad63-41d9-8d66-56df3d3306d8 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:21:13 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-c5419a29-9353-48b3-89ff-2c8657150648 req-3641551b-9f99-42e0-8a59-5d7ce06ccb3b service nova] Acquiring lock "00c47a06-2bf8-427d-bcb1-304688584511-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:21:13 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-c5419a29-9353-48b3-89ff-2c8657150648 req-3641551b-9f99-42e0-8a59-5d7ce06ccb3b service nova] Lock "00c47a06-2bf8-427d-bcb1-304688584511-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:21:13 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-c5419a29-9353-48b3-89ff-2c8657150648 req-3641551b-9f99-42e0-8a59-5d7ce06ccb3b service nova] Lock "00c47a06-2bf8-427d-bcb1-304688584511-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:21:13 user nova-compute[73572]: DEBUG nova.compute.manager [req-c5419a29-9353-48b3-89ff-2c8657150648 req-3641551b-9f99-42e0-8a59-5d7ce06ccb3b service nova] [instance: 00c47a06-2bf8-427d-bcb1-304688584511] No waiting events found dispatching network-vif-plugged-d18bfeb9-ad63-41d9-8d66-56df3d3306d8 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:21:13 user nova-compute[73572]: WARNING nova.compute.manager [req-c5419a29-9353-48b3-89ff-2c8657150648 req-3641551b-9f99-42e0-8a59-5d7ce06ccb3b service nova] [instance: 00c47a06-2bf8-427d-bcb1-304688584511] Received unexpected event network-vif-plugged-d18bfeb9-ad63-41d9-8d66-56df3d3306d8 for instance with vm_state stopped and task_state None.
Aug 26 10:21:14 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:21:14 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-d2ec8117-c915-4c02-9694-f190b2aa7e79 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Acquiring lock "68613b1e-c45c-4fd9-834c-3630ed0f456a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:21:14 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-d2ec8117-c915-4c02-9694-f190b2aa7e79 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Lock "68613b1e-c45c-4fd9-834c-3630ed0f456a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:21:14 user nova-compute[73572]: DEBUG nova.compute.manager [None req-d2ec8117-c915-4c02-9694-f190b2aa7e79 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] [instance: 68613b1e-c45c-4fd9-834c-3630ed0f456a] Starting instance... {{(pid=73572) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 10:21:14 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-d2ec8117-c915-4c02-9694-f190b2aa7e79 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:21:14 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-d2ec8117-c915-4c02-9694-f190b2aa7e79 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:21:14 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-d2ec8117-c915-4c02-9694-f190b2aa7e79 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73572) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 10:21:14 user nova-compute[73572]: INFO nova.compute.claims [None req-d2ec8117-c915-4c02-9694-f190b2aa7e79 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] [instance: 68613b1e-c45c-4fd9-834c-3630ed0f456a] Claim successful on node user
Aug 26 10:21:15 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:21:15 user nova-compute[73572]: DEBUG nova.compute.provider_tree [None req-d2ec8117-c915-4c02-9694-f190b2aa7e79 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Inventory has not changed in ProviderTree for provider: e2cec974-59b2-4c77-a53d-a7f4e5a30d75 {{(pid=73572) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 10:21:15 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-d2ec8117-c915-4c02-9694-f190b2aa7e79 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Inventory has not changed for provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73572) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 10:21:15 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-d2ec8117-c915-4c02-9694-f190b2aa7e79 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.535s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:21:15 user nova-compute[73572]: DEBUG nova.compute.manager [None req-d2ec8117-c915-4c02-9694-f190b2aa7e79 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] [instance: 68613b1e-c45c-4fd9-834c-3630ed0f456a] Start building networks asynchronously for instance. {{(pid=73572) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 10:21:15 user nova-compute[73572]: DEBUG nova.compute.manager [None req-d2ec8117-c915-4c02-9694-f190b2aa7e79 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] [instance: 68613b1e-c45c-4fd9-834c-3630ed0f456a] Allocating IP information in the background. {{(pid=73572) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 10:21:15 user nova-compute[73572]: DEBUG nova.network.neutron [None req-d2ec8117-c915-4c02-9694-f190b2aa7e79 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] [instance: 68613b1e-c45c-4fd9-834c-3630ed0f456a] allocate_for_instance() {{(pid=73572) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 10:21:15 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:21:15 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-d2ec8117-c915-4c02-9694-f190b2aa7e79 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] [instance: 68613b1e-c45c-4fd9-834c-3630ed0f456a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 10:21:15 user nova-compute[73572]: DEBUG nova.compute.manager [None req-d2ec8117-c915-4c02-9694-f190b2aa7e79 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] [instance: 68613b1e-c45c-4fd9-834c-3630ed0f456a] Start building block device mappings for instance. {{(pid=73572) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 10:21:15 user nova-compute[73572]: DEBUG nova.policy [None req-d2ec8117-c915-4c02-9694-f190b2aa7e79 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '61b6124f6f6e44c5b2fd0202a15da019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7935bccc360b46b589fd57d53f334595', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73572) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 10:21:15 user nova-compute[73572]: DEBUG nova.compute.manager [None req-d2ec8117-c915-4c02-9694-f190b2aa7e79 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] [instance: 68613b1e-c45c-4fd9-834c-3630ed0f456a] Start spawning the instance on the hypervisor. {{(pid=73572) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 10:21:15 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-d2ec8117-c915-4c02-9694-f190b2aa7e79 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] [instance: 68613b1e-c45c-4fd9-834c-3630ed0f456a] Creating instance directory {{(pid=73572) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 10:21:15 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-d2ec8117-c915-4c02-9694-f190b2aa7e79 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] [instance: 68613b1e-c45c-4fd9-834c-3630ed0f456a] Creating image(s)
Aug 26 10:21:15 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-d2ec8117-c915-4c02-9694-f190b2aa7e79 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Acquiring lock "/opt/stack/data/nova/instances/68613b1e-c45c-4fd9-834c-3630ed0f456a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:21:15 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-d2ec8117-c915-4c02-9694-f190b2aa7e79 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Lock "/opt/stack/data/nova/instances/68613b1e-c45c-4fd9-834c-3630ed0f456a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:21:15 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-d2ec8117-c915-4c02-9694-f190b2aa7e79 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Lock "/opt/stack/data/nova/instances/68613b1e-c45c-4fd9-834c-3630ed0f456a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:21:15 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-d2ec8117-c915-4c02-9694-f190b2aa7e79 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:21:15 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:21:15 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:21:15 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Starting heal instance info cache {{(pid=73572) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 10:21:15 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquiring lock "refresh_cache-00c47a06-2bf8-427d-bcb1-304688584511" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:21:15 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquired lock "refresh_cache-00c47a06-2bf8-427d-bcb1-304688584511" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:21:15 user nova-compute[73572]: DEBUG nova.network.neutron [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] [instance: 00c47a06-2bf8-427d-bcb1-304688584511] Forcefully refreshing network info cache for instance {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 10:21:16 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-d2ec8117-c915-4c02-9694-f190b2aa7e79 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json" returned: 0 in 0.244s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:21:16 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-d2ec8117-c915-4c02-9694-f190b2aa7e79 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Acquiring lock "2099350d6f3bcd0de9471c73862d4fe75b049801" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:21:16 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-d2ec8117-c915-4c02-9694-f190b2aa7e79 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Lock "2099350d6f3bcd0de9471c73862d4fe75b049801" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:21:16 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-d2ec8117-c915-4c02-9694-f190b2aa7e79 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:21:16 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-d2ec8117-c915-4c02-9694-f190b2aa7e79 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json" returned: 0 in 0.197s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:21:16 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-d2ec8117-c915-4c02-9694-f190b2aa7e79 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801,backing_fmt=raw /opt/stack/data/nova/instances/68613b1e-c45c-4fd9-834c-3630ed0f456a/disk 1073741824 {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:21:16 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-d2ec8117-c915-4c02-9694-f190b2aa7e79 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801,backing_fmt=raw /opt/stack/data/nova/instances/68613b1e-c45c-4fd9-834c-3630ed0f456a/disk 1073741824" returned: 0 in 0.057s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:21:16 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-d2ec8117-c915-4c02-9694-f190b2aa7e79 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Lock "2099350d6f3bcd0de9471c73862d4fe75b049801" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.263s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:21:16 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-d2ec8117-c915-4c02-9694-f190b2aa7e79 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:21:16 user nova-compute[73572]: DEBUG nova.network.neutron [None req-d2ec8117-c915-4c02-9694-f190b2aa7e79 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] [instance: 68613b1e-c45c-4fd9-834c-3630ed0f456a] Successfully created port: aa5ef0b6-0379-4e59-a2c7-e7f1ecd3c7cb {{(pid=73572) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 10:21:16 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-d2ec8117-c915-4c02-9694-f190b2aa7e79 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json" returned: 0 in 0.205s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:21:16 user nova-compute[73572]: DEBUG nova.virt.disk.api [None req-d2ec8117-c915-4c02-9694-f190b2aa7e79 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Checking if we can resize image /opt/stack/data/nova/instances/68613b1e-c45c-4fd9-834c-3630ed0f456a/disk. size=1073741824 {{(pid=73572) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 10:21:16 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-d2ec8117-c915-4c02-9694-f190b2aa7e79 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68613b1e-c45c-4fd9-834c-3630ed0f456a/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:21:16 user nova-compute[73572]: DEBUG nova.network.neutron [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] [instance: 00c47a06-2bf8-427d-bcb1-304688584511] Updating instance_info_cache with network_info: [{"id": "d18bfeb9-ad63-41d9-8d66-56df3d3306d8", "address": "fa:16:3e:a2:f2:f4", "network": {"id": "81543fb3-a8fe-4e9c-8180-c65fa4dcc9e1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-469390371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "084df935eab842e58bad79afad7090f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd18bfeb9-ad", "ovs_interfaceid": "d18bfeb9-ad63-41d9-8d66-56df3d3306d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:21:16 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Releasing lock "refresh_cache-00c47a06-2bf8-427d-bcb1-304688584511" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:21:16 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] [instance: 00c47a06-2bf8-427d-bcb1-304688584511] Updated the network info_cache for instance {{(pid=73572) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 10:21:16 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:21:16 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:21:16 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:21:16 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73572) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 10:21:16 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-d2ec8117-c915-4c02-9694-f190b2aa7e79 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68613b1e-c45c-4fd9-834c-3630ed0f456a/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:21:16 user nova-compute[73572]: DEBUG nova.virt.disk.api [None req-d2ec8117-c915-4c02-9694-f190b2aa7e79 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Cannot resize image /opt/stack/data/nova/instances/68613b1e-c45c-4fd9-834c-3630ed0f456a/disk to a smaller size. {{(pid=73572) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 10:21:16 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-d2ec8117-c915-4c02-9694-f190b2aa7e79 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] [instance: 68613b1e-c45c-4fd9-834c-3630ed0f456a] Created local disks {{(pid=73572) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 10:21:16 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-d2ec8117-c915-4c02-9694-f190b2aa7e79 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] [instance: 68613b1e-c45c-4fd9-834c-3630ed0f456a] Ensure instance console log exists: /opt/stack/data/nova/instances/68613b1e-c45c-4fd9-834c-3630ed0f456a/console.log {{(pid=73572) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 10:21:16 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-d2ec8117-c915-4c02-9694-f190b2aa7e79 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:21:16 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-d2ec8117-c915-4c02-9694-f190b2aa7e79 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:21:16 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-d2ec8117-c915-4c02-9694-f190b2aa7e79 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:21:16 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:21:16 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:21:17 user nova-compute[73572]: DEBUG nova.network.neutron [None req-d2ec8117-c915-4c02-9694-f190b2aa7e79 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] [instance: 68613b1e-c45c-4fd9-834c-3630ed0f456a] Successfully updated port: aa5ef0b6-0379-4e59-a2c7-e7f1ecd3c7cb {{(pid=73572) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 10:21:17 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-d2ec8117-c915-4c02-9694-f190b2aa7e79 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Acquiring lock "refresh_cache-68613b1e-c45c-4fd9-834c-3630ed0f456a" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:21:17 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-d2ec8117-c915-4c02-9694-f190b2aa7e79 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Acquired lock "refresh_cache-68613b1e-c45c-4fd9-834c-3630ed0f456a" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:21:17 user nova-compute[73572]: DEBUG nova.network.neutron [None req-d2ec8117-c915-4c02-9694-f190b2aa7e79 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] [instance: 68613b1e-c45c-4fd9-834c-3630ed0f456a] Building network info cache for instance {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 10:21:17 user nova-compute[73572]: DEBUG nova.compute.manager [req-4071eaf0-289b-4b4c-8bf9-503cbeaa63e8 req-5cb91425-3e75-4b3c-b53a-392b74422b61 service nova] [instance: 68613b1e-c45c-4fd9-834c-3630ed0f456a] Received event network-changed-aa5ef0b6-0379-4e59-a2c7-e7f1ecd3c7cb {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:21:17 user nova-compute[73572]: DEBUG nova.compute.manager [req-4071eaf0-289b-4b4c-8bf9-503cbeaa63e8 req-5cb91425-3e75-4b3c-b53a-392b74422b61 service nova] [instance: 68613b1e-c45c-4fd9-834c-3630ed0f456a] Refreshing instance network info cache due to event network-changed-aa5ef0b6-0379-4e59-a2c7-e7f1ecd3c7cb. {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 10:21:17 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-4071eaf0-289b-4b4c-8bf9-503cbeaa63e8 req-5cb91425-3e75-4b3c-b53a-392b74422b61 service nova] Acquiring lock "refresh_cache-68613b1e-c45c-4fd9-834c-3630ed0f456a" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:21:17 user nova-compute[73572]: DEBUG nova.network.neutron [None req-d2ec8117-c915-4c02-9694-f190b2aa7e79 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] [instance: 68613b1e-c45c-4fd9-834c-3630ed0f456a] Instance cache missing network info. {{(pid=73572) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 10:21:17 user nova-compute[73572]: DEBUG nova.network.neutron [None req-d2ec8117-c915-4c02-9694-f190b2aa7e79 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] [instance: 68613b1e-c45c-4fd9-834c-3630ed0f456a] Updating instance_info_cache with network_info: [{"id": "aa5ef0b6-0379-4e59-a2c7-e7f1ecd3c7cb", "address": "fa:16:3e:30:8b:7a", "network": {"id": "43215883-3d00-4be7-8c40-bdaf3f01bef9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1088544153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7935bccc360b46b589fd57d53f334595", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa5ef0b6-03", "ovs_interfaceid": "aa5ef0b6-0379-4e59-a2c7-e7f1ecd3c7cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:21:17 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-d2ec8117-c915-4c02-9694-f190b2aa7e79 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Releasing lock "refresh_cache-68613b1e-c45c-4fd9-834c-3630ed0f456a" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:21:17 user nova-compute[73572]: DEBUG nova.compute.manager [None req-d2ec8117-c915-4c02-9694-f190b2aa7e79 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] [instance: 68613b1e-c45c-4fd9-834c-3630ed0f456a] Instance network_info: |[{"id": "aa5ef0b6-0379-4e59-a2c7-e7f1ecd3c7cb", "address": "fa:16:3e:30:8b:7a", "network": {"id": "43215883-3d00-4be7-8c40-bdaf3f01bef9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1088544153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7935bccc360b46b589fd57d53f334595", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa5ef0b6-03", "ovs_interfaceid": "aa5ef0b6-0379-4e59-a2c7-e7f1ecd3c7cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73572) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 10:21:17 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-4071eaf0-289b-4b4c-8bf9-503cbeaa63e8 req-5cb91425-3e75-4b3c-b53a-392b74422b61 service nova] Acquired lock "refresh_cache-68613b1e-c45c-4fd9-834c-3630ed0f456a" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:21:17 user nova-compute[73572]: DEBUG nova.network.neutron [req-4071eaf0-289b-4b4c-8bf9-503cbeaa63e8 req-5cb91425-3e75-4b3c-b53a-392b74422b61 service nova] [instance: 68613b1e-c45c-4fd9-834c-3630ed0f456a] Refreshing network info cache for port aa5ef0b6-0379-4e59-a2c7-e7f1ecd3c7cb {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 10:21:17 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-d2ec8117-c915-4c02-9694-f190b2aa7e79 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] [instance: 68613b1e-c45c-4fd9-834c-3630ed0f456a] Start _get_guest_xml network_info=[{"id": "aa5ef0b6-0379-4e59-a2c7-e7f1ecd3c7cb", "address": "fa:16:3e:30:8b:7a", "network": {"id": "43215883-3d00-4be7-8c40-bdaf3f01bef9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1088544153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7935bccc360b46b589fd57d53f334595", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa5ef0b6-03", "ovs_interfaceid": "aa5ef0b6-0379-4e59-a2c7-e7f1ecd3c7cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T10:07:33Z,direct_url=<?>,disk_format='qcow2',id=299da0c9-e1c4-48f0-be55-fbe20dd06bc9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5c995f8bbbab4368b67a253e0df3971a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T10:07:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'guest_format': None, 'size': 0, 'encryption_format': None, 'device_type': 'disk', 'image_id': '299da0c9-e1c4-48f0-be55-fbe20dd06bc9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73572) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 10:21:17 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-d2ec8117-c915-4c02-9694-f190b2aa7e79 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:21:17 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-d2ec8117-c915-4c02-9694-f190b2aa7e79 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:21:17 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-d2ec8117-c915-4c02-9694-f190b2aa7e79 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73572) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 10:21:17 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-d2ec8117-c915-4c02-9694-f190b2aa7e79 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] CPU controller missing on host. {{(pid=73572) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 10:21:17 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-d2ec8117-c915-4c02-9694-f190b2aa7e79 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73572) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 10:21:17 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-d2ec8117-c915-4c02-9694-f190b2aa7e79 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] CPU controller found on host. {{(pid=73572) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 10:21:17 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-d2ec8117-c915-4c02-9694-f190b2aa7e79 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73572) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 10:21:17 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-d2ec8117-c915-4c02-9694-f190b2aa7e79 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T10:07:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T10:07:33Z,direct_url=<?>,disk_format='qcow2',id=299da0c9-e1c4-48f0-be55-fbe20dd06bc9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5c995f8bbbab4368b67a253e0df3971a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T10:07:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 10:21:17 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-d2ec8117-c915-4c02-9694-f190b2aa7e79 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Flavor limits 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 10:21:17 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-d2ec8117-c915-4c02-9694-f190b2aa7e79 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Image limits 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 10:21:17 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-d2ec8117-c915-4c02-9694-f190b2aa7e79 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Flavor pref 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 10:21:17 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-d2ec8117-c915-4c02-9694-f190b2aa7e79 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Image pref 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 10:21:17 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-d2ec8117-c915-4c02-9694-f190b2aa7e79 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 10:21:17 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-d2ec8117-c915-4c02-9694-f190b2aa7e79 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 10:21:17 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-d2ec8117-c915-4c02-9694-f190b2aa7e79 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73572) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 10:21:17 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-d2ec8117-c915-4c02-9694-f190b2aa7e79 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Got 1 possible topologies {{(pid=73572) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 10:21:17 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-d2ec8117-c915-4c02-9694-f190b2aa7e79 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 10:21:17 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-d2ec8117-c915-4c02-9694-f190b2aa7e79 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 10:21:17 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-d2ec8117-c915-4c02-9694-f190b2aa7e79 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T10:21:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-268136854',display_name='tempest-ServerActionsTestOtherA-server-268136854',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-268136854',id=29,image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAGb4Psy4ujnztu6TKM5Yp0ao9Inx8XINL8TB7yqpPrX8pvyhV645/PRion/tWXE5RcABz76j3Pw1BeejHEQh0n16o5OpRaXWd84Wj12hPmfoj80ST4I1EIx+wC0wImDFQ==',key_name='tempest-keypair-598298583',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7935bccc360b46b589fd57d53f334595',ramdisk_id='',reservation_id='r-3skv5tuf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-203628695',owner_user_name='tempest-ServerActionsTestOtherA-203628695-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T10:21:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='61b6124f6f6e44c5b2fd0202a15da019',uuid=68613b1e-c45c-4fd9-834c-3630ed0f456a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "aa5ef0b6-0379-4e59-a2c7-e7f1ecd3c7cb", "address": "fa:16:3e:30:8b:7a", "network": {"id": "43215883-3d00-4be7-8c40-bdaf3f01bef9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1088544153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7935bccc360b46b589fd57d53f334595", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa5ef0b6-03", "ovs_interfaceid": "aa5ef0b6-0379-4e59-a2c7-e7f1ecd3c7cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73572) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 10:21:17 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-d2ec8117-c915-4c02-9694-f190b2aa7e79 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Converting VIF {"id": "aa5ef0b6-0379-4e59-a2c7-e7f1ecd3c7cb", "address": "fa:16:3e:30:8b:7a", "network": {"id": "43215883-3d00-4be7-8c40-bdaf3f01bef9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1088544153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7935bccc360b46b589fd57d53f334595", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa5ef0b6-03", "ovs_interfaceid": "aa5ef0b6-0379-4e59-a2c7-e7f1ecd3c7cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:21:17 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-d2ec8117-c915-4c02-9694-f190b2aa7e79 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:8b:7a,bridge_name='br-int',has_traffic_filtering=True,id=aa5ef0b6-0379-4e59-a2c7-e7f1ecd3c7cb,network=Network(43215883-3d00-4be7-8c40-bdaf3f01bef9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa5ef0b6-03') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:21:17 user nova-compute[73572]: DEBUG nova.objects.instance [None req-d2ec8117-c915-4c02-9694-f190b2aa7e79 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Lazy-loading 'pci_devices' on Instance uuid 68613b1e-c45c-4fd9-834c-3630ed0f456a {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:21:18 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-d2ec8117-c915-4c02-9694-f190b2aa7e79 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] [instance: 68613b1e-c45c-4fd9-834c-3630ed0f456a] End _get_guest_xml xml=<domain type="kvm">
Aug 26 10:21:18 user nova-compute[73572]:   <uuid>68613b1e-c45c-4fd9-834c-3630ed0f456a</uuid>
Aug 26 10:21:18 user nova-compute[73572]:   <name>instance-0000001d</name>
Aug 26 10:21:18 user nova-compute[73572]:   <memory>524288</memory>
Aug 26 10:21:18 user nova-compute[73572]:   <vcpu>1</vcpu>
Aug 26 10:21:18 user nova-compute[73572]:   <metadata>
Aug 26 10:21:18 user nova-compute[73572]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 10:21:18 user nova-compute[73572]:       <nova:package version="0.0.0"/>
Aug 26 10:21:18 user nova-compute[73572]:       <nova:name>tempest-ServerActionsTestOtherA-server-268136854</nova:name>
Aug 26 10:21:18 user nova-compute[73572]:       <nova:creationTime>2023-08-26 10:21:17</nova:creationTime>
Aug 26 10:21:18 user nova-compute[73572]:       <nova:flavor name="m1.tiny">
Aug 26 10:21:18 user nova-compute[73572]:         <nova:memory>512</nova:memory>
Aug 26 10:21:18 user nova-compute[73572]:         <nova:disk>1</nova:disk>
Aug 26 10:21:18 user nova-compute[73572]:         <nova:swap>0</nova:swap>
Aug 26 10:21:18 user nova-compute[73572]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 10:21:18 user nova-compute[73572]:         <nova:vcpus>1</nova:vcpus>
Aug 26 10:21:18 user nova-compute[73572]:       </nova:flavor>
Aug 26 10:21:18 user nova-compute[73572]:       <nova:owner>
Aug 26 10:21:18 user nova-compute[73572]:         <nova:user uuid="61b6124f6f6e44c5b2fd0202a15da019">tempest-ServerActionsTestOtherA-203628695-project-member</nova:user>
Aug 26 10:21:18 user nova-compute[73572]:         <nova:project uuid="7935bccc360b46b589fd57d53f334595">tempest-ServerActionsTestOtherA-203628695</nova:project>
Aug 26 10:21:18 user nova-compute[73572]:       </nova:owner>
Aug 26 10:21:18 user nova-compute[73572]:       <nova:root type="image" uuid="299da0c9-e1c4-48f0-be55-fbe20dd06bc9"/>
Aug 26 10:21:18 user nova-compute[73572]:       <nova:ports>
Aug 26 10:21:18 user nova-compute[73572]:         <nova:port uuid="aa5ef0b6-0379-4e59-a2c7-e7f1ecd3c7cb">
Aug 26 10:21:18 user nova-compute[73572]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 26 10:21:18 user nova-compute[73572]:         </nova:port>
Aug 26 10:21:18 user nova-compute[73572]:       </nova:ports>
Aug 26 10:21:18 user nova-compute[73572]:     </nova:instance>
Aug 26 10:21:18 user nova-compute[73572]:   </metadata>
Aug 26 10:21:18 user nova-compute[73572]:   <sysinfo type="smbios">
Aug 26 10:21:18 user nova-compute[73572]:     <system>
Aug 26 10:21:18 user nova-compute[73572]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 10:21:18 user nova-compute[73572]:       <entry name="product">OpenStack Nova</entry>
Aug 26 10:21:18 user nova-compute[73572]:       <entry name="version">0.0.0</entry>
Aug 26 10:21:18 user nova-compute[73572]:       <entry name="serial">68613b1e-c45c-4fd9-834c-3630ed0f456a</entry>
Aug 26 10:21:18 user nova-compute[73572]:       <entry name="uuid">68613b1e-c45c-4fd9-834c-3630ed0f456a</entry>
Aug 26 10:21:18 user nova-compute[73572]:       <entry name="family">Virtual Machine</entry>
Aug 26 10:21:18 user nova-compute[73572]:     </system>
Aug 26 10:21:18 user nova-compute[73572]:   </sysinfo>
Aug 26 10:21:18 user nova-compute[73572]:   <os>
Aug 26 10:21:18 user nova-compute[73572]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 10:21:18 user nova-compute[73572]:     <boot dev="hd"/>
Aug 26 10:21:18 user nova-compute[73572]:     <smbios mode="sysinfo"/>
Aug 26 10:21:18 user nova-compute[73572]:   </os>
Aug 26 10:21:18 user nova-compute[73572]:   <features>
Aug 26 10:21:18 user nova-compute[73572]:     <acpi/>
Aug 26 10:21:18 user nova-compute[73572]:     <apic/>
Aug 26 10:21:18 user nova-compute[73572]:     <vmcoreinfo/>
Aug 26 10:21:18 user nova-compute[73572]:   </features>
Aug 26 10:21:18 user nova-compute[73572]:   <clock offset="utc">
Aug 26 10:21:18 user nova-compute[73572]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 10:21:18 user nova-compute[73572]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 10:21:18 user nova-compute[73572]:     <timer name="hpet" present="no"/>
Aug 26 10:21:18 user nova-compute[73572]:   </clock>
Aug 26 10:21:18 user nova-compute[73572]:   <cpu mode="custom" match="exact">
Aug 26 10:21:18 user nova-compute[73572]:     <model>Nehalem</model>
Aug 26 10:21:18 user nova-compute[73572]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 10:21:18 user nova-compute[73572]:   </cpu>
Aug 26 10:21:18 user nova-compute[73572]:   <devices>
Aug 26 10:21:18 user nova-compute[73572]:     <disk type="file" device="disk">
Aug 26 10:21:18 user nova-compute[73572]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 10:21:18 user nova-compute[73572]:       <source file="/opt/stack/data/nova/instances/68613b1e-c45c-4fd9-834c-3630ed0f456a/disk"/>
Aug 26 10:21:18 user nova-compute[73572]:       <target dev="vda" bus="virtio"/>
Aug 26 10:21:18 user nova-compute[73572]:     </disk>
Aug 26 10:21:18 user nova-compute[73572]:     <interface type="ethernet">
Aug 26 10:21:18 user nova-compute[73572]:       <mac address="fa:16:3e:30:8b:7a"/>
Aug 26 10:21:18 user nova-compute[73572]:       <model type="virtio"/>
Aug 26 10:21:18 user nova-compute[73572]:       <mtu size="1442"/>
Aug 26 10:21:18 user nova-compute[73572]:       <target dev="tapaa5ef0b6-03"/>
Aug 26 10:21:18 user nova-compute[73572]:     </interface>
Aug 26 10:21:18 user nova-compute[73572]:     <serial type="pty">
Aug 26 10:21:18 user nova-compute[73572]:       <log file="/opt/stack/data/nova/instances/68613b1e-c45c-4fd9-834c-3630ed0f456a/console.log" append="off"/>
Aug 26 10:21:18 user nova-compute[73572]:     </serial>
Aug 26 10:21:18 user nova-compute[73572]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 10:21:18 user nova-compute[73572]:     <video>
Aug 26 10:21:18 user nova-compute[73572]:       <model type="virtio"/>
Aug 26 10:21:18 user nova-compute[73572]:     </video>
Aug 26 10:21:18 user nova-compute[73572]:     <rng model="virtio">
Aug 26 10:21:18 user nova-compute[73572]:       <backend model="random">/dev/urandom</backend>
Aug 26 10:21:18 user nova-compute[73572]:     </rng>
Aug 26 10:21:18 user nova-compute[73572]:     <controller type="usb" index="0" model="none"/>
Aug 26 10:21:18 user nova-compute[73572]:     <memballoon model="virtio">
Aug 26 10:21:18 user nova-compute[73572]:       <stats period="10"/>
Aug 26 10:21:18 user nova-compute[73572]:     </memballoon>
Aug 26 10:21:18 user nova-compute[73572]:   </devices>
Aug 26 10:21:18 user nova-compute[73572]: </domain>
Aug 26 10:21:18 user nova-compute[73572]:  {{(pid=73572) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 10:21:18 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-d2ec8117-c915-4c02-9694-f190b2aa7e79 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T10:21:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-268136854',display_name='tempest-ServerActionsTestOtherA-server-268136854',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-268136854',id=29,image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAGb4Psy4ujnztu6TKM5Yp0ao9Inx8XINL8TB7yqpPrX8pvyhV645/PRion/tWXE5RcABz76j3Pw1BeejHEQh0n16o5OpRaXWd84Wj12hPmfoj80ST4I1EIx+wC0wImDFQ==',key_name='tempest-keypair-598298583',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7935bccc360b46b589fd57d53f334595',ramdisk_id='',reservation_id='r-3skv5tuf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-203628695',owner_user_name='tempest-ServerActionsTestOtherA-203628695-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T10:21:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='61b6124f6f6e44c5b2fd0202a15da019',uuid=68613b1e-c45c-4fd9-834c-3630ed0f456a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "aa5ef0b6-0379-4e59-a2c7-e7f1ecd3c7cb", "address": "fa:16:3e:30:8b:7a", "network": {"id": "43215883-3d00-4be7-8c40-bdaf3f01bef9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1088544153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7935bccc360b46b589fd57d53f334595", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa5ef0b6-03", "ovs_interfaceid": "aa5ef0b6-0379-4e59-a2c7-e7f1ecd3c7cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 10:21:18 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-d2ec8117-c915-4c02-9694-f190b2aa7e79 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Converting VIF {"id": "aa5ef0b6-0379-4e59-a2c7-e7f1ecd3c7cb", "address": "fa:16:3e:30:8b:7a", "network": {"id": "43215883-3d00-4be7-8c40-bdaf3f01bef9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1088544153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7935bccc360b46b589fd57d53f334595", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa5ef0b6-03", "ovs_interfaceid": "aa5ef0b6-0379-4e59-a2c7-e7f1ecd3c7cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:21:18 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-d2ec8117-c915-4c02-9694-f190b2aa7e79 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:8b:7a,bridge_name='br-int',has_traffic_filtering=True,id=aa5ef0b6-0379-4e59-a2c7-e7f1ecd3c7cb,network=Network(43215883-3d00-4be7-8c40-bdaf3f01bef9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa5ef0b6-03') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:21:18 user nova-compute[73572]: DEBUG os_vif [None req-d2ec8117-c915-4c02-9694-f190b2aa7e79 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:8b:7a,bridge_name='br-int',has_traffic_filtering=True,id=aa5ef0b6-0379-4e59-a2c7-e7f1ecd3c7cb,network=Network(43215883-3d00-4be7-8c40-bdaf3f01bef9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa5ef0b6-03') {{(pid=73572) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 10:21:18 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:21:18 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:21:18 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 10:21:18 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:21:18 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapaa5ef0b6-03, may_exist=True, interface_attrs={}) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:21:18 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapaa5ef0b6-03, col_values=(('external_ids', {'iface-id': 'aa5ef0b6-0379-4e59-a2c7-e7f1ecd3c7cb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:30:8b:7a', 'vm-uuid': '68613b1e-c45c-4fd9-834c-3630ed0f456a'}),), if_exists=True) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:21:18 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:21:18 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:21:18 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:21:18 user nova-compute[73572]: INFO os_vif [None req-d2ec8117-c915-4c02-9694-f190b2aa7e79 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:8b:7a,bridge_name='br-int',has_traffic_filtering=True,id=aa5ef0b6-0379-4e59-a2c7-e7f1ecd3c7cb,network=Network(43215883-3d00-4be7-8c40-bdaf3f01bef9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa5ef0b6-03')
Aug 26 10:21:18 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-d2ec8117-c915-4c02-9694-f190b2aa7e79 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] No BDM found with device name vda, not building metadata. {{(pid=73572) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 10:21:18 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-d2ec8117-c915-4c02-9694-f190b2aa7e79 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] No VIF found with MAC fa:16:3e:30:8b:7a, not building metadata {{(pid=73572) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 10:21:18 user nova-compute[73572]: DEBUG nova.network.neutron [req-4071eaf0-289b-4b4c-8bf9-503cbeaa63e8 req-5cb91425-3e75-4b3c-b53a-392b74422b61 service nova] [instance: 68613b1e-c45c-4fd9-834c-3630ed0f456a] Updated VIF entry in instance network info cache for port aa5ef0b6-0379-4e59-a2c7-e7f1ecd3c7cb. {{(pid=73572) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 10:21:18 user nova-compute[73572]: DEBUG nova.network.neutron [req-4071eaf0-289b-4b4c-8bf9-503cbeaa63e8 req-5cb91425-3e75-4b3c-b53a-392b74422b61 service nova] [instance: 68613b1e-c45c-4fd9-834c-3630ed0f456a] Updating instance_info_cache with network_info: [{"id": "aa5ef0b6-0379-4e59-a2c7-e7f1ecd3c7cb", "address": "fa:16:3e:30:8b:7a", "network": {"id": "43215883-3d00-4be7-8c40-bdaf3f01bef9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1088544153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7935bccc360b46b589fd57d53f334595", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa5ef0b6-03", "ovs_interfaceid": "aa5ef0b6-0379-4e59-a2c7-e7f1ecd3c7cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:21:18 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-4071eaf0-289b-4b4c-8bf9-503cbeaa63e8 req-5cb91425-3e75-4b3c-b53a-392b74422b61 service nova] Releasing lock "refresh_cache-68613b1e-c45c-4fd9-834c-3630ed0f456a" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:21:18 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-f77e6e54-70b7-4c4a-945c-7269557762ef tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] Acquiring lock "339517ef-c023-4f13-a8cc-d84f7176dfcd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:21:18 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-f77e6e54-70b7-4c4a-945c-7269557762ef tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] Lock "339517ef-c023-4f13-a8cc-d84f7176dfcd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:21:18 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-f77e6e54-70b7-4c4a-945c-7269557762ef tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] Acquiring lock "339517ef-c023-4f13-a8cc-d84f7176dfcd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:21:18 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-f77e6e54-70b7-4c4a-945c-7269557762ef tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] Lock "339517ef-c023-4f13-a8cc-d84f7176dfcd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:21:18 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-f77e6e54-70b7-4c4a-945c-7269557762ef tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] Lock "339517ef-c023-4f13-a8cc-d84f7176dfcd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:21:18 user nova-compute[73572]: INFO nova.compute.manager [None req-f77e6e54-70b7-4c4a-945c-7269557762ef tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] [instance: 339517ef-c023-4f13-a8cc-d84f7176dfcd] Terminating instance
Aug 26 10:21:18 user nova-compute[73572]: DEBUG nova.compute.manager [None req-f77e6e54-70b7-4c4a-945c-7269557762ef tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] [instance: 339517ef-c023-4f13-a8cc-d84f7176dfcd] Start destroying the instance on the hypervisor. {{(pid=73572) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 10:21:18 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:21:18 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:21:18 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:21:18 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:21:18 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:21:18 user nova-compute[73572]: DEBUG nova.compute.manager [req-5134641f-ff4f-4c1f-9556-e997671f4f3a req-67a15201-9b45-4552-9d58-a4dd9b1e67e6 service nova] [instance: 339517ef-c023-4f13-a8cc-d84f7176dfcd] Received event network-vif-unplugged-0545369e-80c9-45cc-a9a2-330705df9241 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:21:18 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-5134641f-ff4f-4c1f-9556-e997671f4f3a req-67a15201-9b45-4552-9d58-a4dd9b1e67e6 service nova] Acquiring lock "339517ef-c023-4f13-a8cc-d84f7176dfcd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:21:18 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-5134641f-ff4f-4c1f-9556-e997671f4f3a req-67a15201-9b45-4552-9d58-a4dd9b1e67e6 service nova] Lock "339517ef-c023-4f13-a8cc-d84f7176dfcd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:21:18 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-5134641f-ff4f-4c1f-9556-e997671f4f3a req-67a15201-9b45-4552-9d58-a4dd9b1e67e6 service nova] Lock "339517ef-c023-4f13-a8cc-d84f7176dfcd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:21:18 user nova-compute[73572]: DEBUG nova.compute.manager [req-5134641f-ff4f-4c1f-9556-e997671f4f3a req-67a15201-9b45-4552-9d58-a4dd9b1e67e6 service nova] [instance: 339517ef-c023-4f13-a8cc-d84f7176dfcd] No waiting events found dispatching network-vif-unplugged-0545369e-80c9-45cc-a9a2-330705df9241 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:21:18 user nova-compute[73572]: DEBUG nova.compute.manager [req-5134641f-ff4f-4c1f-9556-e997671f4f3a req-67a15201-9b45-4552-9d58-a4dd9b1e67e6 service nova] [instance: 339517ef-c023-4f13-a8cc-d84f7176dfcd] Received event network-vif-unplugged-0545369e-80c9-45cc-a9a2-330705df9241 for instance with task_state deleting. {{(pid=73572) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 10:21:19 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:21:19 user nova-compute[73572]: INFO nova.virt.libvirt.driver [-] [instance: 339517ef-c023-4f13-a8cc-d84f7176dfcd] Instance destroyed successfully.
Aug 26 10:21:19 user nova-compute[73572]: DEBUG nova.objects.instance [None req-f77e6e54-70b7-4c4a-945c-7269557762ef tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] Lazy-loading 'resources' on Instance uuid 339517ef-c023-4f13-a8cc-d84f7176dfcd {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:21:19 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-f77e6e54-70b7-4c4a-945c-7269557762ef tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-26T10:17:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-633608799',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1130623721',id=21,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM9/VU/54cn1RTubtcb6hoKsYPJi5XFbRq9x7ny9CP4siDdaewzHcyj5+OCk5iyU32xzxXp4A9oDvslVWxMVLkr28kptlrAJWcCk28e8n8Kp7D+Tf1GW4OZmlFm8Y1MOSQ==',key_name='tempest-keypair-1829288947',keypairs=<?>,launch_index=0,launched_at=2023-08-26T10:20:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3b5f7c995974418c972eb33e591fab75',ramdisk_id='',reservation_id='r-ol5nmpv7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-182410381',owner_user_name='tempest-ServerActionsV293TestJSON-182410381-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T10:20:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4ab4c737924c4e8da6b35cdb4051c3be',uuid=339517ef-c023-4f13-a8cc-d84f7176dfcd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0545369e-80c9-45cc-a9a2-330705df9241", "address": "fa:16:3e:ae:3c:b5", "network": {"id": "a9900fc6-80c0-41e3-ac1a-4fa11bda2d38", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1804146753-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.153", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b5f7c995974418c972eb33e591fab75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0545369e-80", "ovs_interfaceid": "0545369e-80c9-45cc-a9a2-330705df9241", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 10:21:19 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-f77e6e54-70b7-4c4a-945c-7269557762ef tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] Converting VIF {"id": "0545369e-80c9-45cc-a9a2-330705df9241", "address": "fa:16:3e:ae:3c:b5", "network": {"id": "a9900fc6-80c0-41e3-ac1a-4fa11bda2d38", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1804146753-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.153", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b5f7c995974418c972eb33e591fab75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0545369e-80", "ovs_interfaceid": "0545369e-80c9-45cc-a9a2-330705df9241", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:21:19 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-f77e6e54-70b7-4c4a-945c-7269557762ef tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ae:3c:b5,bridge_name='br-int',has_traffic_filtering=True,id=0545369e-80c9-45cc-a9a2-330705df9241,network=Network(a9900fc6-80c0-41e3-ac1a-4fa11bda2d38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0545369e-80') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:21:19 user nova-compute[73572]: DEBUG os_vif [None req-f77e6e54-70b7-4c4a-945c-7269557762ef tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ae:3c:b5,bridge_name='br-int',has_traffic_filtering=True,id=0545369e-80c9-45cc-a9a2-330705df9241,network=Network(a9900fc6-80c0-41e3-ac1a-4fa11bda2d38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0545369e-80') {{(pid=73572) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 10:21:19 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:21:19 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:21:19 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0545369e-80, bridge=br-int, if_exists=True) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:21:19 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:21:19 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:21:19 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:21:19 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:21:19 user nova-compute[73572]: INFO os_vif [None req-f77e6e54-70b7-4c4a-945c-7269557762ef tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ae:3c:b5,bridge_name='br-int',has_traffic_filtering=True,id=0545369e-80c9-45cc-a9a2-330705df9241,network=Network(a9900fc6-80c0-41e3-ac1a-4fa11bda2d38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0545369e-80')
Aug 26 10:21:19 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:21:19 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f77e6e54-70b7-4c4a-945c-7269557762ef tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] [instance: 339517ef-c023-4f13-a8cc-d84f7176dfcd] calling os-brick to detach iSCSI Volume {{(pid=73572) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 10:21:20 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-f77e6e54-70b7-4c4a-945c-7269557762ef tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc89c3d6a10>, {'target_iqns': ['iqn.2010-10.org.openstack:d94556c8-9096-4e9a-9cfc-f9d17846ed06'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LpSxZEgY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 10:21:20 user nova-compute[73572]: WARNING os_brick.initiator.connectors.base [None req-f77e6e54-70b7-4c4a-945c-7269557762ef tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 10:21:20 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-f77e6e54-70b7-4c4a-945c-7269557762ef tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 10:21:20 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-f77e6e54-70b7-4c4a-945c-7269557762ef tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 10:21:20 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-f77e6e54-70b7-4c4a-945c-7269557762ef tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d94556c8-9096-4e9a-9cfc-f9d17846ed06', 0)] {{(pid=73572) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 10:21:20 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:21:20 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:21:20 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[1163741d-5cfb-4cbf-85f4-123c84050708]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5f3a153b-1b99-4297-ad26-ea58f33330b8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d94556c8-9096-4e9a-9cfc-f9d17846ed06\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:21:20 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:21:20 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:21:20 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[fda86a79-66c0-4407-976c-d92fa315f6a8]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f3a153b-1b99-4297-ad26-ea58f33330b8 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d94556c8-9096-4e9a-9cfc-f9d17846ed06 (non-flash)\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:21:20 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-f77e6e54-70b7-4c4a-945c-7269557762ef tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)
Aug 26 10:21:20 user nova-compute[73572]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f3a153b-1b99-4297-ad26-ea58f33330b8 (non-flash)
Aug 26 10:21:20 user nova-compute[73572]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d94556c8-9096-4e9a-9cfc-f9d17846ed06 (non-flash)
Aug 26 10:21:20 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 10:21:20 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-f77e6e54-70b7-4c4a-945c-7269557762ef tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)
Aug 26 10:21:20 user nova-compute[73572]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f3a153b-1b99-4297-ad26-ea58f33330b8 (non-flash)
Aug 26 10:21:20 user nova-compute[73572]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d94556c8-9096-4e9a-9cfc-f9d17846ed06 (non-flash)
Aug 26 10:21:20 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 10:21:20 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-f77e6e54-70b7-4c4a-945c-7269557762ef tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc878c9a830>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d94556c8-9096-4e9a-9cfc-f9d17846ed06'): ({'sdd'}, set())}) {{(pid=73572) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 10:21:20 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-f77e6e54-70b7-4c4a-945c-7269557762ef tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] Removing single pathed devices sdd {{(pid=73572) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 10:21:20 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:21:20 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:21:20 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd5a0205-71f9-4fb4-8fa7-11cd96763ada]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:21:20 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:21:20 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:21:20 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c1058de-29b7-4b6f-9086-f31d20c38a76]: (4, ('ok\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:21:20 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-f77e6e54-70b7-4c4a-945c-7269557762ef tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] Flushing IO for device /dev/sdd {{(pid=73572) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 10:21:20 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:21:20 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.017s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:21:20 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a03d5d4-8503-4881-a2db-b4da83a57307]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:21:20 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-f77e6e54-70b7-4c4a-945c-7269557762ef tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73572) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 10:21:20 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:21:20 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.121s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:21:20 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[dda70c03-b949-4f6e-9fbb-014755b2394a]: (4, ('1', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:21:20 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-f77e6e54-70b7-4c4a-945c-7269557762ef tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73572) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 10:21:20 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-f77e6e54-70b7-4c4a-945c-7269557762ef tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] SCSI volumes sdd have been removed. {{(pid=73572) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 10:21:20 user nova-compute[73572]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOe525c950-5391bb7e2140faef', '/dev/disk/by-id/scsi-23533393162623765', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_e525c950') {{(pid=84543) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 26 10:21:20 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaa4abfa-6322-44f0-a376-8d049b866aa7]: (4, None) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:21:20 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-f77e6e54-70b7-4c4a-945c-7269557762ef tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d94556c8-9096-4e9a-9cfc-f9d17846ed06')] {{(pid=73572) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 10:21:20 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d94556c8-9096-4e9a-9cfc-f9d17846ed06 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:21:20 user nova-compute[73572]: DEBUG nova.compute.manager [req-2190b1ce-fa4c-4b75-ba6a-a24287393fc1 req-7b715426-d17f-483a-a8fe-4ccd71df01b7 service nova] [instance: 68613b1e-c45c-4fd9-834c-3630ed0f456a] Received event network-vif-plugged-aa5ef0b6-0379-4e59-a2c7-e7f1ecd3c7cb {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:21:20 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-2190b1ce-fa4c-4b75-ba6a-a24287393fc1 req-7b715426-d17f-483a-a8fe-4ccd71df01b7 service nova] Acquiring lock "68613b1e-c45c-4fd9-834c-3630ed0f456a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:21:20 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-2190b1ce-fa4c-4b75-ba6a-a24287393fc1 req-7b715426-d17f-483a-a8fe-4ccd71df01b7 service nova] Lock "68613b1e-c45c-4fd9-834c-3630ed0f456a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:21:20 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-2190b1ce-fa4c-4b75-ba6a-a24287393fc1 req-7b715426-d17f-483a-a8fe-4ccd71df01b7 service nova] Lock "68613b1e-c45c-4fd9-834c-3630ed0f456a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:21:20 user nova-compute[73572]: DEBUG nova.compute.manager [req-2190b1ce-fa4c-4b75-ba6a-a24287393fc1 req-7b715426-d17f-483a-a8fe-4ccd71df01b7 service nova] [instance: 68613b1e-c45c-4fd9-834c-3630ed0f456a] No waiting events found dispatching network-vif-plugged-aa5ef0b6-0379-4e59-a2c7-e7f1ecd3c7cb {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:21:20 user nova-compute[73572]: WARNING nova.compute.manager [req-2190b1ce-fa4c-4b75-ba6a-a24287393fc1 req-7b715426-d17f-483a-a8fe-4ccd71df01b7 service nova] [instance: 68613b1e-c45c-4fd9-834c-3630ed0f456a] Received unexpected event network-vif-plugged-aa5ef0b6-0379-4e59-a2c7-e7f1ecd3c7cb for instance with vm_state building and task_state spawning.
Aug 26 10:21:20 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d94556c8-9096-4e9a-9cfc-f9d17846ed06 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:21:20 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[497fcc47-4bcf-40c5-ba9d-fa37cac64051]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:21:20 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-f77e6e54-70b7-4c4a-945c-7269557762ef tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:21:20 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d94556c8-9096-4e9a-9cfc-f9d17846ed06 -p 172.16.0.220:3260 --logout {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:21:20 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d94556c8-9096-4e9a-9cfc-f9d17846ed06 -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:21:20 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[be2a977b-df49-4e8a-9ac4-2dac60c554c1]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:d94556c8-9096-4e9a-9cfc-f9d17846ed06, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:d94556c8-9096-4e9a-9cfc-f9d17846ed06, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:21:20 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-f77e6e54-70b7-4c4a-945c-7269557762ef tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:d94556c8-9096-4e9a-9cfc-f9d17846ed06, portal: 172.16.0.220,3260]
Aug 26 10:21:20 user nova-compute[73572]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:d94556c8-9096-4e9a-9cfc-f9d17846ed06, portal: 172.16.0.220,3260] successful.
Aug 26 10:21:20 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:21:20 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d94556c8-9096-4e9a-9cfc-f9d17846ed06 -p 172.16.0.220:3260 --op delete {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:21:20 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d94556c8-9096-4e9a-9cfc-f9d17846ed06 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:21:20 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[e99c16c3-2081-44c2-8ec1-7cb02f8db896]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:21:20 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-f77e6e54-70b7-4c4a-945c-7269557762ef tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:21:20 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-f77e6e54-70b7-4c4a-945c-7269557762ef tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.432s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 10:21:20 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-f77e6e54-70b7-4c4a-945c-7269557762ef tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] <== disconnect_volume: return (434ms) None {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 10:21:20 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f77e6e54-70b7-4c4a-945c-7269557762ef tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] [instance: 339517ef-c023-4f13-a8cc-d84f7176dfcd] Disconnected iSCSI Volume {{(pid=73572) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 10:21:20 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-f77e6e54-70b7-4c4a-945c-7269557762ef tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] [instance: 339517ef-c023-4f13-a8cc-d84f7176dfcd] Deleting instance files /opt/stack/data/nova/instances/339517ef-c023-4f13-a8cc-d84f7176dfcd_del
Aug 26 10:21:20 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-f77e6e54-70b7-4c4a-945c-7269557762ef tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] [instance: 339517ef-c023-4f13-a8cc-d84f7176dfcd] Deletion of /opt/stack/data/nova/instances/339517ef-c023-4f13-a8cc-d84f7176dfcd_del complete
Aug 26 10:21:20 user nova-compute[73572]: INFO nova.compute.manager [None req-f77e6e54-70b7-4c4a-945c-7269557762ef tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] [instance: 339517ef-c023-4f13-a8cc-d84f7176dfcd] Took 1.88 seconds to destroy the instance on the hypervisor.
Aug 26 10:21:20 user nova-compute[73572]: DEBUG oslo.service.loopingcall [None req-f77e6e54-70b7-4c4a-945c-7269557762ef tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73572) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 10:21:20 user nova-compute[73572]: DEBUG nova.compute.manager [-] [instance: 339517ef-c023-4f13-a8cc-d84f7176dfcd] Deallocating network for instance {{(pid=73572) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 10:21:20 user nova-compute[73572]: DEBUG nova.network.neutron [-] [instance: 339517ef-c023-4f13-a8cc-d84f7176dfcd] deallocate_for_instance() {{(pid=73572) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 10:21:20 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:21:20 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:21:21 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:21:21 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:21:21 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:21:21 user nova-compute[73572]: DEBUG nova.compute.manager [req-847a69d9-4f82-4d79-9b5d-f9982a9ed5f3 req-4d631ab2-203b-49a0-8037-b13b9409d619 service nova] [instance: 339517ef-c023-4f13-a8cc-d84f7176dfcd] Received event network-vif-plugged-0545369e-80c9-45cc-a9a2-330705df9241 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:21:21 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-847a69d9-4f82-4d79-9b5d-f9982a9ed5f3 req-4d631ab2-203b-49a0-8037-b13b9409d619 service nova] Acquiring lock "339517ef-c023-4f13-a8cc-d84f7176dfcd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:21:21 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-847a69d9-4f82-4d79-9b5d-f9982a9ed5f3 req-4d631ab2-203b-49a0-8037-b13b9409d619 service nova] Lock "339517ef-c023-4f13-a8cc-d84f7176dfcd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:21:21 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-847a69d9-4f82-4d79-9b5d-f9982a9ed5f3 req-4d631ab2-203b-49a0-8037-b13b9409d619 service nova] Lock "339517ef-c023-4f13-a8cc-d84f7176dfcd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:21:21 user nova-compute[73572]: DEBUG nova.compute.manager [req-847a69d9-4f82-4d79-9b5d-f9982a9ed5f3 req-4d631ab2-203b-49a0-8037-b13b9409d619 service nova] [instance: 339517ef-c023-4f13-a8cc-d84f7176dfcd] No waiting events found dispatching network-vif-plugged-0545369e-80c9-45cc-a9a2-330705df9241 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:21:21 user nova-compute[73572]: WARNING nova.compute.manager [req-847a69d9-4f82-4d79-9b5d-f9982a9ed5f3 req-4d631ab2-203b-49a0-8037-b13b9409d619 service nova] [instance: 339517ef-c023-4f13-a8cc-d84f7176dfcd] Received unexpected event network-vif-plugged-0545369e-80c9-45cc-a9a2-330705df9241 for instance with vm_state active and task_state deleting.
Aug 26 10:21:21 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:21:21 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:21:22 user nova-compute[73572]: DEBUG nova.network.neutron [-] [instance: 339517ef-c023-4f13-a8cc-d84f7176dfcd] Updating instance_info_cache with network_info: [] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:21:22 user nova-compute[73572]: INFO nova.compute.manager [-] [instance: 339517ef-c023-4f13-a8cc-d84f7176dfcd] Took 1.64 seconds to deallocate network for instance.
Aug 26 10:21:22 user nova-compute[73572]: DEBUG nova.virt.driver [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Emitting event <LifecycleEvent: 1693045282.320076, 68613b1e-c45c-4fd9-834c-3630ed0f456a => Resumed> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:21:22 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 68613b1e-c45c-4fd9-834c-3630ed0f456a] VM Resumed (Lifecycle Event)
Aug 26 10:21:22 user nova-compute[73572]: DEBUG nova.compute.manager [None req-d2ec8117-c915-4c02-9694-f190b2aa7e79 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] [instance: 68613b1e-c45c-4fd9-834c-3630ed0f456a] Instance event wait completed in 0 seconds for  {{(pid=73572) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 10:21:22 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-d2ec8117-c915-4c02-9694-f190b2aa7e79 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] [instance: 68613b1e-c45c-4fd9-834c-3630ed0f456a] Guest created on hypervisor {{(pid=73572) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 10:21:22 user nova-compute[73572]: INFO nova.virt.libvirt.driver [-] [instance: 68613b1e-c45c-4fd9-834c-3630ed0f456a] Instance spawned successfully.
Aug 26 10:21:22 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-d2ec8117-c915-4c02-9694-f190b2aa7e79 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] [instance: 68613b1e-c45c-4fd9-834c-3630ed0f456a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 10:21:22 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 68613b1e-c45c-4fd9-834c-3630ed0f456a] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:21:22 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 68613b1e-c45c-4fd9-834c-3630ed0f456a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73572) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 10:21:22 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-d2ec8117-c915-4c02-9694-f190b2aa7e79 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] [instance: 68613b1e-c45c-4fd9-834c-3630ed0f456a] Found default for hw_cdrom_bus of ide {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:21:22 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-d2ec8117-c915-4c02-9694-f190b2aa7e79 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] [instance: 68613b1e-c45c-4fd9-834c-3630ed0f456a] Found default for hw_disk_bus of virtio {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:21:22 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-d2ec8117-c915-4c02-9694-f190b2aa7e79 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] [instance: 68613b1e-c45c-4fd9-834c-3630ed0f456a] Found default for hw_input_bus of None {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:21:22 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-d2ec8117-c915-4c02-9694-f190b2aa7e79 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] [instance: 68613b1e-c45c-4fd9-834c-3630ed0f456a] Found default for hw_pointer_model of None {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:21:22 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-d2ec8117-c915-4c02-9694-f190b2aa7e79 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] [instance: 68613b1e-c45c-4fd9-834c-3630ed0f456a] Found default for hw_video_model of virtio {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:21:22 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-d2ec8117-c915-4c02-9694-f190b2aa7e79 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] [instance: 68613b1e-c45c-4fd9-834c-3630ed0f456a] Found default for hw_vif_model of virtio {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:21:22 user nova-compute[73572]: DEBUG nova.compute.manager [req-f6ae2d82-99c2-4e60-8b46-2383598e6e70 req-65895ee0-56f0-4f2c-a9d3-2466cafa6b82 service nova] [instance: 68613b1e-c45c-4fd9-834c-3630ed0f456a] Received event network-vif-plugged-aa5ef0b6-0379-4e59-a2c7-e7f1ecd3c7cb {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:21:22 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-f6ae2d82-99c2-4e60-8b46-2383598e6e70 req-65895ee0-56f0-4f2c-a9d3-2466cafa6b82 service nova] Acquiring lock "68613b1e-c45c-4fd9-834c-3630ed0f456a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:21:22 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-f6ae2d82-99c2-4e60-8b46-2383598e6e70 req-65895ee0-56f0-4f2c-a9d3-2466cafa6b82 service nova] Lock "68613b1e-c45c-4fd9-834c-3630ed0f456a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:21:22 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-f6ae2d82-99c2-4e60-8b46-2383598e6e70 req-65895ee0-56f0-4f2c-a9d3-2466cafa6b82 service nova] Lock "68613b1e-c45c-4fd9-834c-3630ed0f456a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:21:22 user nova-compute[73572]: DEBUG nova.compute.manager [req-f6ae2d82-99c2-4e60-8b46-2383598e6e70 req-65895ee0-56f0-4f2c-a9d3-2466cafa6b82 service nova] [instance: 68613b1e-c45c-4fd9-834c-3630ed0f456a] No waiting events found dispatching network-vif-plugged-aa5ef0b6-0379-4e59-a2c7-e7f1ecd3c7cb {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:21:22 user nova-compute[73572]: WARNING nova.compute.manager [req-f6ae2d82-99c2-4e60-8b46-2383598e6e70 req-65895ee0-56f0-4f2c-a9d3-2466cafa6b82 service nova] [instance: 68613b1e-c45c-4fd9-834c-3630ed0f456a] Received unexpected event network-vif-plugged-aa5ef0b6-0379-4e59-a2c7-e7f1ecd3c7cb for instance with vm_state building and task_state spawning.
Aug 26 10:21:22 user nova-compute[73572]: DEBUG nova.compute.manager [req-f6ae2d82-99c2-4e60-8b46-2383598e6e70 req-65895ee0-56f0-4f2c-a9d3-2466cafa6b82 service nova] [instance: 339517ef-c023-4f13-a8cc-d84f7176dfcd] Received event network-vif-deleted-0545369e-80c9-45cc-a9a2-330705df9241 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:21:22 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 68613b1e-c45c-4fd9-834c-3630ed0f456a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 10:21:22 user nova-compute[73572]: DEBUG nova.virt.driver [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Emitting event <LifecycleEvent: 1693045282.3205903, 68613b1e-c45c-4fd9-834c-3630ed0f456a => Started> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:21:22 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 68613b1e-c45c-4fd9-834c-3630ed0f456a] VM Started (Lifecycle Event)
Aug 26 10:21:22 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 68613b1e-c45c-4fd9-834c-3630ed0f456a] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:21:22 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 68613b1e-c45c-4fd9-834c-3630ed0f456a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73572) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 10:21:22 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 68613b1e-c45c-4fd9-834c-3630ed0f456a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 10:21:22 user nova-compute[73572]: INFO nova.compute.manager [None req-d2ec8117-c915-4c02-9694-f190b2aa7e79 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] [instance: 68613b1e-c45c-4fd9-834c-3630ed0f456a] Took 6.66 seconds to spawn the instance on the hypervisor.
Aug 26 10:21:22 user nova-compute[73572]: DEBUG nova.compute.manager [None req-d2ec8117-c915-4c02-9694-f190b2aa7e79 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] [instance: 68613b1e-c45c-4fd9-834c-3630ed0f456a] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:21:22 user nova-compute[73572]: INFO nova.compute.manager [None req-d2ec8117-c915-4c02-9694-f190b2aa7e79 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] [instance: 68613b1e-c45c-4fd9-834c-3630ed0f456a] Took 7.60 seconds to build instance.
Aug 26 10:21:22 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-d2ec8117-c915-4c02-9694-f190b2aa7e79 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Lock "68613b1e-c45c-4fd9-834c-3630ed0f456a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.746s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:21:22 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:21:23 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:21:23 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:21:23 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:21:23 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Auditing locally available compute resources for user (node: user) {{(pid=73572) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 10:21:23 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c901bbcc-3d82-4550-888f-bdbb36ba052d/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:21:23 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c901bbcc-3d82-4550-888f-bdbb36ba052d/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:21:23 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c901bbcc-3d82-4550-888f-bdbb36ba052d/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:21:23 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c901bbcc-3d82-4550-888f-bdbb36ba052d/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:21:23 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c785b609-0068-442f-91f5-d26e888a993f/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:21:24 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c785b609-0068-442f-91f5-d26e888a993f/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:21:24 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c785b609-0068-442f-91f5-d26e888a993f/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:21:24 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c785b609-0068-442f-91f5-d26e888a993f/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:21:24 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e468b473-515f-41ad-a75c-65d4c6d575c8/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:21:24 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e468b473-515f-41ad-a75c-65d4c6d575c8/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:21:24 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e468b473-515f-41ad-a75c-65d4c6d575c8/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:21:24 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e468b473-515f-41ad-a75c-65d4c6d575c8/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:21:24 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44a737bf-3704-4193-8d24-b8d132267279/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:21:24 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:21:24 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44a737bf-3704-4193-8d24-b8d132267279/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:21:24 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44a737bf-3704-4193-8d24-b8d132267279/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:21:24 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:21:25 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44a737bf-3704-4193-8d24-b8d132267279/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:21:25 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/693f562f-ae3d-4cfb-926e-9990a1a301cb/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:21:25 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/693f562f-ae3d-4cfb-926e-9990a1a301cb/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:21:25 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/693f562f-ae3d-4cfb-926e-9990a1a301cb/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:21:25 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/693f562f-ae3d-4cfb-926e-9990a1a301cb/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:21:25 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00c47a06-2bf8-427d-bcb1-304688584511/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:21:25 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00c47a06-2bf8-427d-bcb1-304688584511/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:21:25 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00c47a06-2bf8-427d-bcb1-304688584511/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:21:25 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00c47a06-2bf8-427d-bcb1-304688584511/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:21:25 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86923c1a-89a5-4e7a-b488-8bf3a013bf83/disk.rescue --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:21:25 user nova-compute[73572]: INFO nova.compute.manager [None req-f77e6e54-70b7-4c4a-945c-7269557762ef tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] [instance: 339517ef-c023-4f13-a8cc-d84f7176dfcd] Took 3.70 seconds to detach 1 volumes for instance.
Aug 26 10:21:25 user nova-compute[73572]: DEBUG nova.compute.manager [None req-f77e6e54-70b7-4c4a-945c-7269557762ef tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] [instance: 339517ef-c023-4f13-a8cc-d84f7176dfcd] Deleting volume: d94556c8-9096-4e9a-9cfc-f9d17846ed06 {{(pid=73572) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 26 10:21:26 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-f77e6e54-70b7-4c4a-945c-7269557762ef tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:21:26 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-f77e6e54-70b7-4c4a-945c-7269557762ef tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:21:26 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86923c1a-89a5-4e7a-b488-8bf3a013bf83/disk.rescue --force-share --output=json" returned: 0 in 0.196s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:21:26 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86923c1a-89a5-4e7a-b488-8bf3a013bf83/disk.rescue --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:21:26 user nova-compute[73572]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693045271.1644938, 00c47a06-2bf8-427d-bcb1-304688584511 => Stopped> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:21:26 user nova-compute[73572]: INFO nova.compute.manager [-] [instance: 00c47a06-2bf8-427d-bcb1-304688584511] VM Stopped (Lifecycle Event)
Aug 26 10:21:26 user nova-compute[73572]: DEBUG nova.compute.manager [None req-295cd54d-563f-4108-a3cf-43cd984c76f5 None None] [instance: 00c47a06-2bf8-427d-bcb1-304688584511] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:21:26 user nova-compute[73572]: DEBUG nova.compute.manager [None req-295cd54d-563f-4108-a3cf-43cd984c76f5 None None] [instance: 00c47a06-2bf8-427d-bcb1-304688584511] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=73572) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 10:21:26 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86923c1a-89a5-4e7a-b488-8bf3a013bf83/disk.rescue --force-share --output=json" returned: 0 in 0.212s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:21:26 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86923c1a-89a5-4e7a-b488-8bf3a013bf83/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:21:26 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86923c1a-89a5-4e7a-b488-8bf3a013bf83/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:21:26 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86923c1a-89a5-4e7a-b488-8bf3a013bf83/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:21:26 user nova-compute[73572]: DEBUG nova.compute.provider_tree [None req-f77e6e54-70b7-4c4a-945c-7269557762ef tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] Inventory has not changed in ProviderTree for provider: e2cec974-59b2-4c77-a53d-a7f4e5a30d75 {{(pid=73572) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 10:21:26 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-f77e6e54-70b7-4c4a-945c-7269557762ef tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] Inventory has not changed for provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73572) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 10:21:26 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-f77e6e54-70b7-4c4a-945c-7269557762ef tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.577s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:21:26 user nova-compute[73572]: INFO nova.scheduler.client.report [None req-f77e6e54-70b7-4c4a-945c-7269557762ef tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] Deleted allocations for instance 339517ef-c023-4f13-a8cc-d84f7176dfcd
Aug 26 10:21:26 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86923c1a-89a5-4e7a-b488-8bf3a013bf83/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:21:26 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=73572) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 10:21:26 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68613b1e-c45c-4fd9-834c-3630ed0f456a/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:21:26 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-f77e6e54-70b7-4c4a-945c-7269557762ef tempest-ServerActionsV293TestJSON-182410381 tempest-ServerActionsV293TestJSON-182410381-project-member] Lock "339517ef-c023-4f13-a8cc-d84f7176dfcd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 8.105s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:21:26 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68613b1e-c45c-4fd9-834c-3630ed0f456a/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:21:26 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68613b1e-c45c-4fd9-834c-3630ed0f456a/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:21:27 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68613b1e-c45c-4fd9-834c-3630ed0f456a/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:21:27 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/682138af-ba6a-47f1-a9a5-03ae2661f54d/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:21:27 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/682138af-ba6a-47f1-a9a5-03ae2661f54d/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:21:27 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/682138af-ba6a-47f1-a9a5-03ae2661f54d/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:21:27 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/682138af-ba6a-47f1-a9a5-03ae2661f54d/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:21:27 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2970584-8c2a-4f99-922c-d66d59489504/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:21:27 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2970584-8c2a-4f99-922c-d66d59489504/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:21:27 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2970584-8c2a-4f99-922c-d66d59489504/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:21:27 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2970584-8c2a-4f99-922c-d66d59489504/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:21:27 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2eaea7c2-a5c0-4950-b033-0012b5cec0ee/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:21:28 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2eaea7c2-a5c0-4950-b033-0012b5cec0ee/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:21:28 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2eaea7c2-a5c0-4950-b033-0012b5cec0ee/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:21:28 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2eaea7c2-a5c0-4950-b033-0012b5cec0ee/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:21:28 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fe47a17-4ffb-48ce-b0f6-a9b43002bd55/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:21:28 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fe47a17-4ffb-48ce-b0f6-a9b43002bd55/disk --force-share --output=json" returned: 0 in 0.302s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:21:28 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fe47a17-4ffb-48ce-b0f6-a9b43002bd55/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:21:28 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fe47a17-4ffb-48ce-b0f6-a9b43002bd55/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:21:28 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73572) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 10:21:29 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:21:29 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:21:29 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Hypervisor/Node resource view: name=user free_ram=6828MB free_disk=25.04497528076172GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=73572) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 10:21:29 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:21:29 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:21:29 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Applying migration context for instance 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55 as it has an incoming, in-progress migration 1eeef6fc-489c-436a-9c1c-404ef89802a6. Migration status is finished {{(pid=73572) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 26 10:21:29 user nova-compute[73572]: INFO nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] [instance: 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55] Updating resource usage from migration 1eeef6fc-489c-436a-9c1c-404ef89802a6
Aug 26 10:21:29 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance c785b609-0068-442f-91f5-d26e888a993f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:21:29 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance 14fab12e-52be-4fe6-8777-bc7ebf3c25f1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:21:29 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance 00c47a06-2bf8-427d-bcb1-304688584511 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:21:29 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance d2970584-8c2a-4f99-922c-d66d59489504 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:21:29 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance 682138af-ba6a-47f1-a9a5-03ae2661f54d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:21:29 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance c901bbcc-3d82-4550-888f-bdbb36ba052d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:21:29 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance 2eaea7c2-a5c0-4950-b033-0012b5cec0ee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:21:29 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance 86923c1a-89a5-4e7a-b488-8bf3a013bf83 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:21:29 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Migration 1eeef6fc-489c-436a-9c1c-404ef89802a6 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 26 10:21:29 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:21:29 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance 44a737bf-3704-4193-8d24-b8d132267279 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:21:29 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance 693f562f-ae3d-4cfb-926e-9990a1a301cb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:21:29 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance e468b473-515f-41ad-a75c-65d4c6d575c8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:21:29 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance 68613b1e-c45c-4fd9-834c-3630ed0f456a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:21:29 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=73572) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 10:21:29 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Final resource view: name=user phys_ram=16011MB used_ram=9216MB phys_disk=40GB used_disk=32GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=73572) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 10:21:29 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:21:29 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:21:29 user nova-compute[73572]: DEBUG nova.compute.provider_tree [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Inventory has not changed in ProviderTree for provider: e2cec974-59b2-4c77-a53d-a7f4e5a30d75 {{(pid=73572) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 10:21:29 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:21:29 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Inventory has not changed for provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73572) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 10:21:29 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Compute_service record updated for user:user {{(pid=73572) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 10:21:29 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.626s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:21:34 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:21:34 user nova-compute[73572]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693045279.8744252, 339517ef-c023-4f13-a8cc-d84f7176dfcd => Stopped> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:21:34 user nova-compute[73572]: INFO nova.compute.manager [-] [instance: 339517ef-c023-4f13-a8cc-d84f7176dfcd] VM Stopped (Lifecycle Event)
Aug 26 10:21:34 user nova-compute[73572]: DEBUG nova.compute.manager [None req-a6250c94-2371-44e3-be92-788398227359 None None] [instance: 339517ef-c023-4f13-a8cc-d84f7176dfcd] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:21:34 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:21:35 user nova-compute[73572]: DEBUG nova.network.neutron [None req-7952a984-74a5-4442-be11-6535c8a2541d tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] [instance: 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55] Port ebf9f385-e59b-4060-9bf9-a8d2006327b4 binding to destination host user is already ACTIVE {{(pid=73572) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 26 10:21:35 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-7952a984-74a5-4442-be11-6535c8a2541d tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Acquiring lock "refresh_cache-0fe47a17-4ffb-48ce-b0f6-a9b43002bd55" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:21:35 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-7952a984-74a5-4442-be11-6535c8a2541d tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Acquired lock "refresh_cache-0fe47a17-4ffb-48ce-b0f6-a9b43002bd55" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:21:35 user nova-compute[73572]: DEBUG nova.network.neutron [None req-7952a984-74a5-4442-be11-6535c8a2541d tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] [instance: 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55] Building network info cache for instance {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 10:21:36 user nova-compute[73572]: DEBUG nova.network.neutron [None req-7952a984-74a5-4442-be11-6535c8a2541d tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] [instance: 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55] Updating instance_info_cache with network_info: [{"id": "ebf9f385-e59b-4060-9bf9-a8d2006327b4", "address": "fa:16:3e:49:23:6a", "network": {"id": "7c89c22a-96d4-4e60-9c4c-b5a82a7eca55", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1976182948-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d2c922711fb445aa99ae4f30b802c12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebf9f385-e5", "ovs_interfaceid": "ebf9f385-e59b-4060-9bf9-a8d2006327b4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:21:36 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-7952a984-74a5-4442-be11-6535c8a2541d tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Releasing lock "refresh_cache-0fe47a17-4ffb-48ce-b0f6-a9b43002bd55" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:21:36 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-7952a984-74a5-4442-be11-6535c8a2541d tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] [instance: 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55] Creating tmpfile /opt/stack/data/nova/instances/0fe47a17-4ffb-48ce-b0f6-a9b43002bd55/tmp6dzq_kvt to verify with other compute node that the instance is on the same shared storage. {{(pid=73572) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9622}}
Aug 26 10:21:36 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:21:36 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:21:36 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:21:36 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:21:37 user nova-compute[73572]: INFO nova.virt.libvirt.driver [-] [instance: 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55] Instance destroyed successfully.
Aug 26 10:21:37 user nova-compute[73572]: DEBUG nova.objects.instance [None req-7952a984-74a5-4442-be11-6535c8a2541d tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Lazy-loading 'resources' on Instance uuid 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55 {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:21:37 user nova-compute[73572]: DEBUG nova.compute.manager [req-c31d0a38-8ff1-48d6-b373-65d8c08e1757 req-ad2fdb56-595a-4457-a8f2-640311f88251 service nova] [instance: 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55] Received event network-vif-unplugged-ebf9f385-e59b-4060-9bf9-a8d2006327b4 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:21:37 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-c31d0a38-8ff1-48d6-b373-65d8c08e1757 req-ad2fdb56-595a-4457-a8f2-640311f88251 service nova] Acquiring lock "0fe47a17-4ffb-48ce-b0f6-a9b43002bd55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:21:37 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-c31d0a38-8ff1-48d6-b373-65d8c08e1757 req-ad2fdb56-595a-4457-a8f2-640311f88251 service nova] Lock "0fe47a17-4ffb-48ce-b0f6-a9b43002bd55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:21:37 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-c31d0a38-8ff1-48d6-b373-65d8c08e1757 req-ad2fdb56-595a-4457-a8f2-640311f88251 service nova] Lock "0fe47a17-4ffb-48ce-b0f6-a9b43002bd55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:21:37 user nova-compute[73572]: DEBUG nova.compute.manager [req-c31d0a38-8ff1-48d6-b373-65d8c08e1757 req-ad2fdb56-595a-4457-a8f2-640311f88251 service nova] [instance: 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55] No waiting events found dispatching network-vif-unplugged-ebf9f385-e59b-4060-9bf9-a8d2006327b4 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:21:37 user nova-compute[73572]: WARNING nova.compute.manager [req-c31d0a38-8ff1-48d6-b373-65d8c08e1757 req-ad2fdb56-595a-4457-a8f2-640311f88251 service nova] [instance: 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55] Received unexpected event network-vif-unplugged-ebf9f385-e59b-4060-9bf9-a8d2006327b4 for instance with vm_state resized and task_state resize_reverting.
Aug 26 10:21:37 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-7952a984-74a5-4442-be11-6535c8a2541d tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T10:15:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-220365578',display_name='tempest-ServerActionsTestOtherB-server-220365578',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-220365578',id=17,image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNpUMyiGXRzsPFYrzC1k+DPeAQeFXKXREu1ci6G2S65T1Gci+/hLSOFjcdBoLqgENyI+7/uwXL8y2F/F10thQC08ST7hXeII35W/K66MHhxc0L254FUOJIzPARZXOsUESA==',key_name='tempest-keypair-2095276623',keypairs=<?>,launch_index=0,launched_at=2023-08-26T10:20:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0d2c922711fb445aa99ae4f30b802c12',ramdisk_id='',reservation_id='r-ktz04i2y',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1806914349',owner_user_name='tempest-ServerActionsTestOtherB-1806914349-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T10:20:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0ee7e4a9f7db476eb9f16440c6b8e37e',uuid=0fe47a17-4ffb-48ce-b0f6-a9b43002bd55,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "ebf9f385-e59b-4060-9bf9-a8d2006327b4", "address": "fa:16:3e:49:23:6a", "network": {"id": "7c89c22a-96d4-4e60-9c4c-b5a82a7eca55", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1976182948-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d2c922711fb445aa99ae4f30b802c12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebf9f385-e5", "ovs_interfaceid": "ebf9f385-e59b-4060-9bf9-a8d2006327b4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 10:21:37 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-7952a984-74a5-4442-be11-6535c8a2541d tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Converting VIF {"id": "ebf9f385-e59b-4060-9bf9-a8d2006327b4", "address": "fa:16:3e:49:23:6a", "network": {"id": "7c89c22a-96d4-4e60-9c4c-b5a82a7eca55", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1976182948-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d2c922711fb445aa99ae4f30b802c12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebf9f385-e5", "ovs_interfaceid": "ebf9f385-e59b-4060-9bf9-a8d2006327b4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:21:37 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-7952a984-74a5-4442-be11-6535c8a2541d tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:49:23:6a,bridge_name='br-int',has_traffic_filtering=True,id=ebf9f385-e59b-4060-9bf9-a8d2006327b4,network=Network(7c89c22a-96d4-4e60-9c4c-b5a82a7eca55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebf9f385-e5') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:21:37 user nova-compute[73572]: DEBUG os_vif [None req-7952a984-74a5-4442-be11-6535c8a2541d tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:49:23:6a,bridge_name='br-int',has_traffic_filtering=True,id=ebf9f385-e59b-4060-9bf9-a8d2006327b4,network=Network(7c89c22a-96d4-4e60-9c4c-b5a82a7eca55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebf9f385-e5') {{(pid=73572) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 10:21:37 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:21:37 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapebf9f385-e5, bridge=br-int, if_exists=True) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:21:37 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:21:37 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:21:37 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:21:37 user nova-compute[73572]: INFO os_vif [None req-7952a984-74a5-4442-be11-6535c8a2541d tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:49:23:6a,bridge_name='br-int',has_traffic_filtering=True,id=ebf9f385-e59b-4060-9bf9-a8d2006327b4,network=Network(7c89c22a-96d4-4e60-9c4c-b5a82a7eca55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebf9f385-e5')
Aug 26 10:21:37 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7952a984-74a5-4442-be11-6535c8a2541d tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] [instance: 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55] calling os-brick to detach iSCSI Volume {{(pid=73572) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 10:21:37 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-7952a984-74a5-4442-be11-6535c8a2541d tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc89c3d6a10>, {'target_iqns': ['iqn.2010-10.org.openstack:5f3a153b-1b99-4297-ad26-ea58f33330b8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qjvgYBLw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 10:21:37 user nova-compute[73572]: WARNING os_brick.initiator.connectors.base [None req-7952a984-74a5-4442-be11-6535c8a2541d tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 10:21:37 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-7952a984-74a5-4442-be11-6535c8a2541d tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 10:21:37 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-7952a984-74a5-4442-be11-6535c8a2541d tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 10:21:37 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-7952a984-74a5-4442-be11-6535c8a2541d tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5f3a153b-1b99-4297-ad26-ea58f33330b8', 0)] {{(pid=73572) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 10:21:37 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:21:37 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:21:37 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[20f9315f-21b4-47cc-bf3c-d227db842d30]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5f3a153b-1b99-4297-ad26-ea58f33330b8\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:21:37 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:21:37 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:21:37 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba5bc4e4-65a9-48fe-b5eb-ce66cae9c373]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f3a153b-1b99-4297-ad26-ea58f33330b8 (non-flash)\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:21:37 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-7952a984-74a5-4442-be11-6535c8a2541d tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)
Aug 26 10:21:37 user nova-compute[73572]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f3a153b-1b99-4297-ad26-ea58f33330b8 (non-flash)
Aug 26 10:21:37 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 10:21:37 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-7952a984-74a5-4442-be11-6535c8a2541d tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)
Aug 26 10:21:37 user nova-compute[73572]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f3a153b-1b99-4297-ad26-ea58f33330b8 (non-flash)
Aug 26 10:21:37 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 10:21:37 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-7952a984-74a5-4442-be11-6535c8a2541d tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc878bae9e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5f3a153b-1b99-4297-ad26-ea58f33330b8'): ({'sdc'}, set())}) {{(pid=73572) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 10:21:37 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-7952a984-74a5-4442-be11-6535c8a2541d tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Removing single pathed devices sdc {{(pid=73572) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 10:21:37 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:21:37 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:21:37 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[ede6b391-8439-435c-ab17-7c251785ff42]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:21:37 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:21:37 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.034s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:21:37 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbfd55ca-5b0f-4cb4-bab3-f6fe975d927b]: (4, ('ok\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:21:37 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-7952a984-74a5-4442-be11-6535c8a2541d tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Flushing IO for device /dev/sdc {{(pid=73572) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 10:21:37 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:21:37 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:21:37 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[63d12be4-906e-46e7-8a41-db6313d27e88]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:21:37 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-7952a984-74a5-4442-be11-6535c8a2541d tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73572) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 10:21:37 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:21:37 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.036s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:21:37 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[45482928-65a8-4e9d-9c7a-f5c0b0af2e67]: (4, ('1', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:21:37 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-7952a984-74a5-4442-be11-6535c8a2541d tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73572) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 10:21:37 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-7952a984-74a5-4442-be11-6535c8a2541d tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] SCSI volumes sdc have been removed. {{(pid=73572) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 10:21:37 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-7952a984-74a5-4442-be11-6535c8a2541d tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5f3a153b-1b99-4297-ad26-ea58f33330b8')] {{(pid=73572) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 10:21:37 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f3a153b-1b99-4297-ad26-ea58f33330b8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:21:37 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f3a153b-1b99-4297-ad26-ea58f33330b8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:21:37 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[1065949b-3804-4d77-b407-06fa4d4cdb60]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:21:37 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-7952a984-74a5-4442-be11-6535c8a2541d tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:21:37 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f3a153b-1b99-4297-ad26-ea58f33330b8 -p 172.16.0.220:3260 --logout {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:21:37 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f3a153b-1b99-4297-ad26-ea58f33330b8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:21:37 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[26660550-ecb3-4f9c-9ea5-cf3240a2170f]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:5f3a153b-1b99-4297-ad26-ea58f33330b8, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:5f3a153b-1b99-4297-ad26-ea58f33330b8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:21:37 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-7952a984-74a5-4442-be11-6535c8a2541d tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:5f3a153b-1b99-4297-ad26-ea58f33330b8, portal: 172.16.0.220,3260]
Aug 26 10:21:37 user nova-compute[73572]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:5f3a153b-1b99-4297-ad26-ea58f33330b8, portal: 172.16.0.220,3260] successful.
Aug 26 10:21:37 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:21:37 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f3a153b-1b99-4297-ad26-ea58f33330b8 -p 172.16.0.220:3260 --op delete {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:21:37 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f3a153b-1b99-4297-ad26-ea58f33330b8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:21:37 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2bb53f6-50ce-49d4-b205-410d07d10f33]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:21:37 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-7952a984-74a5-4442-be11-6535c8a2541d tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:21:37 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-7952a984-74a5-4442-be11-6535c8a2541d tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.304s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 10:21:37 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-7952a984-74a5-4442-be11-6535c8a2541d tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] <== disconnect_volume: return (306ms) None {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 10:21:37 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7952a984-74a5-4442-be11-6535c8a2541d tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] [instance: 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55] Disconnected iSCSI Volume {{(pid=73572) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 10:21:39 user nova-compute[73572]: DEBUG nova.compute.manager [req-0a16c647-32f9-47ae-a420-aefc3563cf8c req-a712b1e6-239c-4921-a765-0e1d020c7199 service nova] [instance: 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55] Received event network-vif-plugged-ebf9f385-e59b-4060-9bf9-a8d2006327b4 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:21:39 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-0a16c647-32f9-47ae-a420-aefc3563cf8c req-a712b1e6-239c-4921-a765-0e1d020c7199 service nova] Acquiring lock "0fe47a17-4ffb-48ce-b0f6-a9b43002bd55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:21:39 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-0a16c647-32f9-47ae-a420-aefc3563cf8c req-a712b1e6-239c-4921-a765-0e1d020c7199 service nova] Lock "0fe47a17-4ffb-48ce-b0f6-a9b43002bd55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:21:39 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-0a16c647-32f9-47ae-a420-aefc3563cf8c req-a712b1e6-239c-4921-a765-0e1d020c7199 service nova] Lock "0fe47a17-4ffb-48ce-b0f6-a9b43002bd55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:21:39 user nova-compute[73572]: DEBUG nova.compute.manager [req-0a16c647-32f9-47ae-a420-aefc3563cf8c req-a712b1e6-239c-4921-a765-0e1d020c7199 service nova] [instance: 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55] No waiting events found dispatching network-vif-plugged-ebf9f385-e59b-4060-9bf9-a8d2006327b4 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:21:39 user nova-compute[73572]: WARNING nova.compute.manager [req-0a16c647-32f9-47ae-a420-aefc3563cf8c req-a712b1e6-239c-4921-a765-0e1d020c7199 service nova] [instance: 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55] Received unexpected event network-vif-plugged-ebf9f385-e59b-4060-9bf9-a8d2006327b4 for instance with vm_state resized and task_state resize_reverting.
Aug 26 10:21:39 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:21:41 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-7952a984-74a5-4442-be11-6535c8a2541d tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:21:41 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-7952a984-74a5-4442-be11-6535c8a2541d tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:21:41 user nova-compute[73572]: DEBUG nova.objects.instance [None req-7952a984-74a5-4442-be11-6535c8a2541d tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Lazy-loading 'migration_context' on Instance uuid 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55 {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:21:41 user nova-compute[73572]: DEBUG nova.objects.base [None req-7952a984-74a5-4442-be11-6535c8a2541d tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Object Instance<0fe47a17-4ffb-48ce-b0f6-a9b43002bd55> lazy-loaded attributes: resources,migration_context {{(pid=73572) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 10:21:41 user nova-compute[73572]: DEBUG nova.compute.provider_tree [None req-7952a984-74a5-4442-be11-6535c8a2541d tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Inventory has not changed in ProviderTree for provider: e2cec974-59b2-4c77-a53d-a7f4e5a30d75 {{(pid=73572) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 10:21:41 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-7952a984-74a5-4442-be11-6535c8a2541d tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Inventory has not changed for provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73572) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 10:21:42 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-7952a984-74a5-4442-be11-6535c8a2541d tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.502s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:21:42 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:21:42 user nova-compute[73572]: INFO nova.compute.manager [None req-7952a984-74a5-4442-be11-6535c8a2541d tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] [instance: 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55] Swapping old allocation on dict_keys(['e2cec974-59b2-4c77-a53d-a7f4e5a30d75']) held by migration 1eeef6fc-489c-436a-9c1c-404ef89802a6 for instance
Aug 26 10:21:42 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-7952a984-74a5-4442-be11-6535c8a2541d tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Overwriting current allocation {'allocations': {'e2cec974-59b2-4c77-a53d-a7f4e5a30d75': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 33}}, 'project_id': '0d2c922711fb445aa99ae4f30b802c12', 'user_id': '0ee7e4a9f7db476eb9f16440c6b8e37e', 'consumer_generation': 1} on consumer 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55 {{(pid=73572) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Aug 26 10:21:42 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-7952a984-74a5-4442-be11-6535c8a2541d tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Acquiring lock "refresh_cache-0fe47a17-4ffb-48ce-b0f6-a9b43002bd55" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:21:42 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-7952a984-74a5-4442-be11-6535c8a2541d tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Acquired lock "refresh_cache-0fe47a17-4ffb-48ce-b0f6-a9b43002bd55" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:21:42 user nova-compute[73572]: DEBUG nova.network.neutron [None req-7952a984-74a5-4442-be11-6535c8a2541d tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] [instance: 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55] Building network info cache for instance {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 10:21:43 user nova-compute[73572]: DEBUG nova.network.neutron [None req-7952a984-74a5-4442-be11-6535c8a2541d tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] [instance: 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55] Updating instance_info_cache with network_info: [{"id": "ebf9f385-e59b-4060-9bf9-a8d2006327b4", "address": "fa:16:3e:49:23:6a", "network": {"id": "7c89c22a-96d4-4e60-9c4c-b5a82a7eca55", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1976182948-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d2c922711fb445aa99ae4f30b802c12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebf9f385-e5", "ovs_interfaceid": "ebf9f385-e59b-4060-9bf9-a8d2006327b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:21:43 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-7952a984-74a5-4442-be11-6535c8a2541d tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Releasing lock "refresh_cache-0fe47a17-4ffb-48ce-b0f6-a9b43002bd55" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:21:43 user nova-compute[73572]: DEBUG os_brick.utils [None req-7952a984-74a5-4442-be11-6535c8a2541d tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 10:21:43 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:21:43 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:21:43 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[58cc7174-3c63-44c8-8822-cb8a65fae86e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:de8a79ed912\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:21:43 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:21:43 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:21:43 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[7361553e-a194-4810-bf7c-607b406b0d4f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:21:43 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:21:43 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:21:43 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f81bf77-4535-484c-95a1-02baa4984ede]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:21:43 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcfa465b-6729-4b60-ac1d-65cb137ceb6a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:21:43 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-7952a984-74a5-4442-be11-6535c8a2541d tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Running cmd (subprocess): nvme version {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:21:43 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-7952a984-74a5-4442-be11-6535c8a2541d tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] 'nvme version' failed. Not Retrying. {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 10:21:43 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7952a984-74a5-4442-be11-6535c8a2541d tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] nvme not present on system {{(pid=73572) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 10:21:43 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:21:43 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 10:21:43 user nova-compute[73572]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 10:21:43 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c996fbc-29f5-4c7d-a160-487c9a163c38]: (4, '') {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:21:43 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.lightos [None req-7952a984-74a5-4442-be11-6535c8a2541d tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73572) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 10:21:43 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.lightos [None req-7952a984-74a5-4442-be11-6535c8a2541d tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73572) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 10:21:43 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.lightos [None req-7952a984-74a5-4442-be11-6535c8a2541d tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] LIGHTOS: no hostnqn found. {{(pid=73572) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 10:21:43 user nova-compute[73572]: DEBUG os_brick.utils [None req-7952a984-74a5-4442-be11-6535c8a2541d tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:de8a79ed912', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 10:21:44 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:21:45 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-75ed7a19-e7bc-4f43-96f0-7e071c7d8d21 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Acquiring lock "682138af-ba6a-47f1-a9a5-03ae2661f54d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:21:45 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-75ed7a19-e7bc-4f43-96f0-7e071c7d8d21 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Lock "682138af-ba6a-47f1-a9a5-03ae2661f54d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:21:45 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-75ed7a19-e7bc-4f43-96f0-7e071c7d8d21 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Acquiring lock "682138af-ba6a-47f1-a9a5-03ae2661f54d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:21:45 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-75ed7a19-e7bc-4f43-96f0-7e071c7d8d21 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Lock "682138af-ba6a-47f1-a9a5-03ae2661f54d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:21:45 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-75ed7a19-e7bc-4f43-96f0-7e071c7d8d21 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Lock "682138af-ba6a-47f1-a9a5-03ae2661f54d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:21:45 user nova-compute[73572]: INFO nova.compute.manager [None req-75ed7a19-e7bc-4f43-96f0-7e071c7d8d21 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] [instance: 682138af-ba6a-47f1-a9a5-03ae2661f54d] Terminating instance
Aug 26 10:21:45 user nova-compute[73572]: DEBUG nova.compute.manager [None req-75ed7a19-e7bc-4f43-96f0-7e071c7d8d21 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] [instance: 682138af-ba6a-47f1-a9a5-03ae2661f54d] Start destroying the instance on the hypervisor. {{(pid=73572) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 10:21:45 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:21:46 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:21:46 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:21:46 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:21:46 user nova-compute[73572]: DEBUG nova.compute.manager [req-7327e14e-bd6f-4b4e-a943-4605703b9b9a req-ff380f51-020d-470b-bd08-58bf67d1f825 service nova] [instance: 682138af-ba6a-47f1-a9a5-03ae2661f54d] Received event network-vif-unplugged-72fe24f4-00e3-40f1-a44a-014c7669e862 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:21:46 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-7327e14e-bd6f-4b4e-a943-4605703b9b9a req-ff380f51-020d-470b-bd08-58bf67d1f825 service nova] Acquiring lock "682138af-ba6a-47f1-a9a5-03ae2661f54d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:21:46 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-7327e14e-bd6f-4b4e-a943-4605703b9b9a req-ff380f51-020d-470b-bd08-58bf67d1f825 service nova] Lock "682138af-ba6a-47f1-a9a5-03ae2661f54d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:21:46 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-7327e14e-bd6f-4b4e-a943-4605703b9b9a req-ff380f51-020d-470b-bd08-58bf67d1f825 service nova] Lock "682138af-ba6a-47f1-a9a5-03ae2661f54d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:21:46 user nova-compute[73572]: DEBUG nova.compute.manager [req-7327e14e-bd6f-4b4e-a943-4605703b9b9a req-ff380f51-020d-470b-bd08-58bf67d1f825 service nova] [instance: 682138af-ba6a-47f1-a9a5-03ae2661f54d] No waiting events found dispatching network-vif-unplugged-72fe24f4-00e3-40f1-a44a-014c7669e862 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:21:46 user nova-compute[73572]: DEBUG nova.compute.manager [req-7327e14e-bd6f-4b4e-a943-4605703b9b9a req-ff380f51-020d-470b-bd08-58bf67d1f825 service nova] [instance: 682138af-ba6a-47f1-a9a5-03ae2661f54d] Received event network-vif-unplugged-72fe24f4-00e3-40f1-a44a-014c7669e862 for instance with task_state deleting. {{(pid=73572) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 10:21:46 user nova-compute[73572]: INFO nova.virt.libvirt.driver [-] [instance: 682138af-ba6a-47f1-a9a5-03ae2661f54d] Instance destroyed successfully.
Aug 26 10:21:46 user nova-compute[73572]: DEBUG nova.objects.instance [None req-75ed7a19-e7bc-4f43-96f0-7e071c7d8d21 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Lazy-loading 'resources' on Instance uuid 682138af-ba6a-47f1-a9a5-03ae2661f54d {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:21:46 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-75ed7a19-e7bc-4f43-96f0-7e071c7d8d21 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T10:16:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-599563112',display_name='tempest-TestMinimumBasicScenario-server-599563112',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-599563112',id=19,image_ref='bd4d7dcc-4b94-4755-8f4d-82a35910708b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAPaLciMuuXDmK5UDnc9dDAL0q42nrYLkWq/GzkjjE2uLKRfJ9mMrCN1hVlbNdhdzgF+EEXM/a0Wtl8GXTyBJxG1WbLNcxpzQzC0r1tfMhaC51ige81Z2TsBef7Q/w6+Iw==',key_name='tempest-TestMinimumBasicScenario-908269596',keypairs=<?>,launch_index=0,launched_at=2023-08-26T10:16:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='eb6ef2597eac461f959a568abd3031ca',ramdisk_id='',reservation_id='r-gemevwm3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bd4d7dcc-4b94-4755-8f4d-82a35910708b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1705958769',owner_user_name='tempest-TestMinimumBasicScenario-1705958769-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T10:19:05Z,user_data=None,user_id='a354eb6764fd4c95a53b8962544bc49b',uuid=682138af-ba6a-47f1-a9a5-03ae2661f54d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "72fe24f4-00e3-40f1-a44a-014c7669e862", "address": "fa:16:3e:d2:52:c7", "network": {"id": "2a6e27c9-9bd2-4ccb-abf6-82d85524da90", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1822065121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb6ef2597eac461f959a568abd3031ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72fe24f4-00", "ovs_interfaceid": "72fe24f4-00e3-40f1-a44a-014c7669e862", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 10:21:46 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-75ed7a19-e7bc-4f43-96f0-7e071c7d8d21 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Converting VIF {"id": "72fe24f4-00e3-40f1-a44a-014c7669e862", "address": "fa:16:3e:d2:52:c7", "network": {"id": "2a6e27c9-9bd2-4ccb-abf6-82d85524da90", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1822065121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb6ef2597eac461f959a568abd3031ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72fe24f4-00", "ovs_interfaceid": "72fe24f4-00e3-40f1-a44a-014c7669e862", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:21:46 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-75ed7a19-e7bc-4f43-96f0-7e071c7d8d21 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d2:52:c7,bridge_name='br-int',has_traffic_filtering=True,id=72fe24f4-00e3-40f1-a44a-014c7669e862,network=Network(2a6e27c9-9bd2-4ccb-abf6-82d85524da90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72fe24f4-00') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:21:46 user nova-compute[73572]: DEBUG os_vif [None req-75ed7a19-e7bc-4f43-96f0-7e071c7d8d21 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d2:52:c7,bridge_name='br-int',has_traffic_filtering=True,id=72fe24f4-00e3-40f1-a44a-014c7669e862,network=Network(2a6e27c9-9bd2-4ccb-abf6-82d85524da90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72fe24f4-00') {{(pid=73572) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 10:21:46 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:21:46 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap72fe24f4-00, bridge=br-int, if_exists=True) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:21:46 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:21:46 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:21:46 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:21:46 user nova-compute[73572]: INFO os_vif [None req-75ed7a19-e7bc-4f43-96f0-7e071c7d8d21 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d2:52:c7,bridge_name='br-int',has_traffic_filtering=True,id=72fe24f4-00e3-40f1-a44a-014c7669e862,network=Network(2a6e27c9-9bd2-4ccb-abf6-82d85524da90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72fe24f4-00')
Aug 26 10:21:46 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-75ed7a19-e7bc-4f43-96f0-7e071c7d8d21 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] [instance: 682138af-ba6a-47f1-a9a5-03ae2661f54d] Deleting instance files /opt/stack/data/nova/instances/682138af-ba6a-47f1-a9a5-03ae2661f54d_del
Aug 26 10:21:46 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-75ed7a19-e7bc-4f43-96f0-7e071c7d8d21 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] [instance: 682138af-ba6a-47f1-a9a5-03ae2661f54d] Deletion of /opt/stack/data/nova/instances/682138af-ba6a-47f1-a9a5-03ae2661f54d_del complete
Aug 26 10:21:46 user nova-compute[73572]: INFO nova.compute.manager [None req-75ed7a19-e7bc-4f43-96f0-7e071c7d8d21 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] [instance: 682138af-ba6a-47f1-a9a5-03ae2661f54d] Took 0.90 seconds to destroy the instance on the hypervisor.
Aug 26 10:21:46 user nova-compute[73572]: DEBUG oslo.service.loopingcall [None req-75ed7a19-e7bc-4f43-96f0-7e071c7d8d21 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73572) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 10:21:46 user nova-compute[73572]: DEBUG nova.compute.manager [-] [instance: 682138af-ba6a-47f1-a9a5-03ae2661f54d] Deallocating network for instance {{(pid=73572) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 10:21:46 user nova-compute[73572]: DEBUG nova.network.neutron [-] [instance: 682138af-ba6a-47f1-a9a5-03ae2661f54d] deallocate_for_instance() {{(pid=73572) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 10:21:47 user nova-compute[73572]: DEBUG nova.network.neutron [-] [instance: 682138af-ba6a-47f1-a9a5-03ae2661f54d] Updating instance_info_cache with network_info: [] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:21:47 user nova-compute[73572]: INFO nova.compute.manager [-] [instance: 682138af-ba6a-47f1-a9a5-03ae2661f54d] Took 0.57 seconds to deallocate network for instance.
Aug 26 10:21:47 user nova-compute[73572]: DEBUG nova.compute.manager [req-aa4632ef-9d6a-44b0-b6e2-af782937d4a0 req-bbef6523-a6a6-474d-b0a6-0b6028855de5 service nova] [instance: 682138af-ba6a-47f1-a9a5-03ae2661f54d] Received event network-vif-deleted-72fe24f4-00e3-40f1-a44a-014c7669e862 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:21:47 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-75ed7a19-e7bc-4f43-96f0-7e071c7d8d21 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:21:47 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-75ed7a19-e7bc-4f43-96f0-7e071c7d8d21 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:21:48 user nova-compute[73572]: DEBUG nova.compute.provider_tree [None req-75ed7a19-e7bc-4f43-96f0-7e071c7d8d21 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Inventory has not changed in ProviderTree for provider: e2cec974-59b2-4c77-a53d-a7f4e5a30d75 {{(pid=73572) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 10:21:48 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-75ed7a19-e7bc-4f43-96f0-7e071c7d8d21 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Inventory has not changed for provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73572) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 10:21:48 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-75ed7a19-e7bc-4f43-96f0-7e071c7d8d21 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.424s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:21:48 user nova-compute[73572]: INFO nova.scheduler.client.report [None req-75ed7a19-e7bc-4f43-96f0-7e071c7d8d21 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Deleted allocations for instance 682138af-ba6a-47f1-a9a5-03ae2661f54d
Aug 26 10:21:48 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-75ed7a19-e7bc-4f43-96f0-7e071c7d8d21 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Lock "682138af-ba6a-47f1-a9a5-03ae2661f54d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.328s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:21:48 user nova-compute[73572]: DEBUG nova.compute.manager [req-19615d19-fa7f-4f28-90a1-ff44b5f22c96 req-cef419ba-0e60-4153-aa56-8d78faca7f3d service nova] [instance: 682138af-ba6a-47f1-a9a5-03ae2661f54d] Received event network-vif-plugged-72fe24f4-00e3-40f1-a44a-014c7669e862 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:21:48 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-19615d19-fa7f-4f28-90a1-ff44b5f22c96 req-cef419ba-0e60-4153-aa56-8d78faca7f3d service nova] Acquiring lock "682138af-ba6a-47f1-a9a5-03ae2661f54d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:21:48 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-19615d19-fa7f-4f28-90a1-ff44b5f22c96 req-cef419ba-0e60-4153-aa56-8d78faca7f3d service nova] Lock "682138af-ba6a-47f1-a9a5-03ae2661f54d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:21:48 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-19615d19-fa7f-4f28-90a1-ff44b5f22c96 req-cef419ba-0e60-4153-aa56-8d78faca7f3d service nova] Lock "682138af-ba6a-47f1-a9a5-03ae2661f54d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:21:48 user nova-compute[73572]: DEBUG nova.compute.manager [req-19615d19-fa7f-4f28-90a1-ff44b5f22c96 req-cef419ba-0e60-4153-aa56-8d78faca7f3d service nova] [instance: 682138af-ba6a-47f1-a9a5-03ae2661f54d] No waiting events found dispatching network-vif-plugged-72fe24f4-00e3-40f1-a44a-014c7669e862 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:21:48 user nova-compute[73572]: WARNING nova.compute.manager [req-19615d19-fa7f-4f28-90a1-ff44b5f22c96 req-cef419ba-0e60-4153-aa56-8d78faca7f3d service nova] [instance: 682138af-ba6a-47f1-a9a5-03ae2661f54d] Received unexpected event network-vif-plugged-72fe24f4-00e3-40f1-a44a-014c7669e862 for instance with vm_state deleted and task_state None.
Aug 26 10:21:49 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:21:51 user nova-compute[73572]: DEBUG nova.compute.manager [req-d727eeed-e8a7-41d0-af2e-76b1adb8e3e4 req-a692f70b-bf24-4e60-acbe-1b72bd9438e3 service nova] [instance: c901bbcc-3d82-4550-888f-bdbb36ba052d] Received event network-changed-7c475446-2ad9-4502-b116-274f100e4d6c {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:21:51 user nova-compute[73572]: DEBUG nova.compute.manager [req-d727eeed-e8a7-41d0-af2e-76b1adb8e3e4 req-a692f70b-bf24-4e60-acbe-1b72bd9438e3 service nova] [instance: c901bbcc-3d82-4550-888f-bdbb36ba052d] Refreshing instance network info cache due to event network-changed-7c475446-2ad9-4502-b116-274f100e4d6c. {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 10:21:51 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-d727eeed-e8a7-41d0-af2e-76b1adb8e3e4 req-a692f70b-bf24-4e60-acbe-1b72bd9438e3 service nova] Acquiring lock "refresh_cache-c901bbcc-3d82-4550-888f-bdbb36ba052d" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:21:51 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-d727eeed-e8a7-41d0-af2e-76b1adb8e3e4 req-a692f70b-bf24-4e60-acbe-1b72bd9438e3 service nova] Acquired lock "refresh_cache-c901bbcc-3d82-4550-888f-bdbb36ba052d" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:21:51 user nova-compute[73572]: DEBUG nova.network.neutron [req-d727eeed-e8a7-41d0-af2e-76b1adb8e3e4 req-a692f70b-bf24-4e60-acbe-1b72bd9438e3 service nova] [instance: c901bbcc-3d82-4550-888f-bdbb36ba052d] Refreshing network info cache for port 7c475446-2ad9-4502-b116-274f100e4d6c {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 10:21:51 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-f253e5ad-3289-4f3c-aa69-ac9cc44355a5 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Acquiring lock "c901bbcc-3d82-4550-888f-bdbb36ba052d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:21:51 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-f253e5ad-3289-4f3c-aa69-ac9cc44355a5 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Lock "c901bbcc-3d82-4550-888f-bdbb36ba052d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:21:51 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-f253e5ad-3289-4f3c-aa69-ac9cc44355a5 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Acquiring lock "c901bbcc-3d82-4550-888f-bdbb36ba052d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:21:51 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-f253e5ad-3289-4f3c-aa69-ac9cc44355a5 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Lock "c901bbcc-3d82-4550-888f-bdbb36ba052d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:21:51 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-f253e5ad-3289-4f3c-aa69-ac9cc44355a5 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Lock "c901bbcc-3d82-4550-888f-bdbb36ba052d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:21:51 user nova-compute[73572]: INFO nova.compute.manager [None req-f253e5ad-3289-4f3c-aa69-ac9cc44355a5 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] [instance: c901bbcc-3d82-4550-888f-bdbb36ba052d] Terminating instance
Aug 26 10:21:51 user nova-compute[73572]: DEBUG nova.compute.manager [None req-f253e5ad-3289-4f3c-aa69-ac9cc44355a5 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] [instance: c901bbcc-3d82-4550-888f-bdbb36ba052d] Start destroying the instance on the hypervisor. {{(pid=73572) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 10:21:51 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:21:51 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:21:51 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:21:51 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:21:51 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:21:52 user nova-compute[73572]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693045297.048261, 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55 => Stopped> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:21:52 user nova-compute[73572]: INFO nova.compute.manager [-] [instance: 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55] VM Stopped (Lifecycle Event)
Aug 26 10:21:52 user nova-compute[73572]: DEBUG nova.compute.manager [None req-a0dc7f7d-a7a0-443c-9881-dc5e47e0a823 None None] [instance: 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:21:52 user nova-compute[73572]: DEBUG nova.compute.manager [req-2da4deeb-dab3-4516-9c29-4404185f0c57 req-cd0a2486-46b2-457e-8593-291d52338403 service nova] [instance: c901bbcc-3d82-4550-888f-bdbb36ba052d] Received event network-vif-unplugged-7c475446-2ad9-4502-b116-274f100e4d6c {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:21:52 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-2da4deeb-dab3-4516-9c29-4404185f0c57 req-cd0a2486-46b2-457e-8593-291d52338403 service nova] Acquiring lock "c901bbcc-3d82-4550-888f-bdbb36ba052d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:21:52 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-2da4deeb-dab3-4516-9c29-4404185f0c57 req-cd0a2486-46b2-457e-8593-291d52338403 service nova] Lock "c901bbcc-3d82-4550-888f-bdbb36ba052d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:21:52 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-2da4deeb-dab3-4516-9c29-4404185f0c57 req-cd0a2486-46b2-457e-8593-291d52338403 service nova] Lock "c901bbcc-3d82-4550-888f-bdbb36ba052d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:21:52 user nova-compute[73572]: DEBUG nova.compute.manager [req-2da4deeb-dab3-4516-9c29-4404185f0c57 req-cd0a2486-46b2-457e-8593-291d52338403 service nova] [instance: c901bbcc-3d82-4550-888f-bdbb36ba052d] No waiting events found dispatching network-vif-unplugged-7c475446-2ad9-4502-b116-274f100e4d6c {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:21:52 user nova-compute[73572]: DEBUG nova.compute.manager [req-2da4deeb-dab3-4516-9c29-4404185f0c57 req-cd0a2486-46b2-457e-8593-291d52338403 service nova] [instance: c901bbcc-3d82-4550-888f-bdbb36ba052d] Received event network-vif-unplugged-7c475446-2ad9-4502-b116-274f100e4d6c for instance with task_state deleting. {{(pid=73572) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 10:21:52 user nova-compute[73572]: DEBUG nova.network.neutron [req-d727eeed-e8a7-41d0-af2e-76b1adb8e3e4 req-a692f70b-bf24-4e60-acbe-1b72bd9438e3 service nova] [instance: c901bbcc-3d82-4550-888f-bdbb36ba052d] Updated VIF entry in instance network info cache for port 7c475446-2ad9-4502-b116-274f100e4d6c. {{(pid=73572) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 10:21:52 user nova-compute[73572]: DEBUG nova.network.neutron [req-d727eeed-e8a7-41d0-af2e-76b1adb8e3e4 req-a692f70b-bf24-4e60-acbe-1b72bd9438e3 service nova] [instance: c901bbcc-3d82-4550-888f-bdbb36ba052d] Updating instance_info_cache with network_info: [{"id": "7c475446-2ad9-4502-b116-274f100e4d6c", "address": "fa:16:3e:b7:b1:84", "network": {"id": "e565abb6-25f8-4f92-9cca-69db36e4216a", "bridge": "br-int", "label": "tempest-TestStampPattern-1866566708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f2be8d4c6c147e98a1b5b7443b3828d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c475446-2a", "ovs_interfaceid": "7c475446-2ad9-4502-b116-274f100e4d6c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:21:52 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-d727eeed-e8a7-41d0-af2e-76b1adb8e3e4 req-a692f70b-bf24-4e60-acbe-1b72bd9438e3 service nova] Releasing lock "refresh_cache-c901bbcc-3d82-4550-888f-bdbb36ba052d" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:21:52 user nova-compute[73572]: INFO nova.virt.libvirt.driver [-] [instance: c901bbcc-3d82-4550-888f-bdbb36ba052d] Instance destroyed successfully.
Aug 26 10:21:52 user nova-compute[73572]: DEBUG nova.objects.instance [None req-f253e5ad-3289-4f3c-aa69-ac9cc44355a5 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Lazy-loading 'resources' on Instance uuid c901bbcc-3d82-4550-888f-bdbb36ba052d {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:21:52 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-f253e5ad-3289-4f3c-aa69-ac9cc44355a5 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T10:18:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1903954468',display_name='tempest-TestStampPattern-server-1903954468',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1903954468',id=23,image_ref='5de36e71-6ad1-4ec6-9f56-b5630d53cad7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP9vHc9cYvgcHQg/aK0omfrRC7E/+64q6slnxR+kteK1TJpzyHka+ebCIfWJOJFiXL5L634G/nkiqr1k6bVjV80fgSFGxhy9wnZsw6PuJmiL2f9/rm8j19mT+daCzhQYQw==',key_name='tempest-TestStampPattern-1944573374',keypairs=<?>,launch_index=0,launched_at=2023-08-26T10:19:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6f2be8d4c6c147e98a1b5b7443b3828d',ramdisk_id='',reservation_id='r-cdmcv9nm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='d2970584-8c2a-4f99-922c-d66d59489504',image_min_disk='1',image_min_ram='0',image_owner_id='6f2be8d4c6c147e98a1b5b7443b3828d',image_owner_project_name='tempest-TestStampPattern-478976113',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-478976113-project-member',image_user_id='b990faa34b924d29bf7c0490aaf07644',owner_project_name='tempest-TestStampPattern-478976113',owner_user_name='tempest-TestStampPattern-478976113-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T10:19:03Z,user_data=None,user_id='b990faa34b924d29bf7c0490aaf07644',uuid=c901bbcc-3d82-4550-888f-bdbb36ba052d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7c475446-2ad9-4502-b116-274f100e4d6c", "address": "fa:16:3e:b7:b1:84", "network": {"id": "e565abb6-25f8-4f92-9cca-69db36e4216a", "bridge": "br-int", "label": "tempest-TestStampPattern-1866566708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.124", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f2be8d4c6c147e98a1b5b7443b3828d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c475446-2a", "ovs_interfaceid": "7c475446-2ad9-4502-b116-274f100e4d6c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 10:21:52 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-f253e5ad-3289-4f3c-aa69-ac9cc44355a5 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Converting VIF {"id": "7c475446-2ad9-4502-b116-274f100e4d6c", "address": "fa:16:3e:b7:b1:84", "network": {"id": "e565abb6-25f8-4f92-9cca-69db36e4216a", "bridge": "br-int", "label": "tempest-TestStampPattern-1866566708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.124", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f2be8d4c6c147e98a1b5b7443b3828d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c475446-2a", "ovs_interfaceid": "7c475446-2ad9-4502-b116-274f100e4d6c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:21:52 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-f253e5ad-3289-4f3c-aa69-ac9cc44355a5 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b7:b1:84,bridge_name='br-int',has_traffic_filtering=True,id=7c475446-2ad9-4502-b116-274f100e4d6c,network=Network(e565abb6-25f8-4f92-9cca-69db36e4216a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c475446-2a') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:21:52 user nova-compute[73572]: DEBUG os_vif [None req-f253e5ad-3289-4f3c-aa69-ac9cc44355a5 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b7:b1:84,bridge_name='br-int',has_traffic_filtering=True,id=7c475446-2ad9-4502-b116-274f100e4d6c,network=Network(e565abb6-25f8-4f92-9cca-69db36e4216a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c475446-2a') {{(pid=73572) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 10:21:52 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:21:52 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7c475446-2a, bridge=br-int, if_exists=True) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:21:52 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:21:52 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:21:52 user nova-compute[73572]: INFO os_vif [None req-f253e5ad-3289-4f3c-aa69-ac9cc44355a5 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b7:b1:84,bridge_name='br-int',has_traffic_filtering=True,id=7c475446-2ad9-4502-b116-274f100e4d6c,network=Network(e565abb6-25f8-4f92-9cca-69db36e4216a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c475446-2a')
Aug 26 10:21:52 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-f253e5ad-3289-4f3c-aa69-ac9cc44355a5 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] [instance: c901bbcc-3d82-4550-888f-bdbb36ba052d] Deleting instance files /opt/stack/data/nova/instances/c901bbcc-3d82-4550-888f-bdbb36ba052d_del
Aug 26 10:21:52 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-f253e5ad-3289-4f3c-aa69-ac9cc44355a5 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] [instance: c901bbcc-3d82-4550-888f-bdbb36ba052d] Deletion of /opt/stack/data/nova/instances/c901bbcc-3d82-4550-888f-bdbb36ba052d_del complete
Aug 26 10:21:52 user nova-compute[73572]: INFO nova.compute.manager [None req-f253e5ad-3289-4f3c-aa69-ac9cc44355a5 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] [instance: c901bbcc-3d82-4550-888f-bdbb36ba052d] Took 1.02 seconds to destroy the instance on the hypervisor.
Aug 26 10:21:52 user nova-compute[73572]: DEBUG oslo.service.loopingcall [None req-f253e5ad-3289-4f3c-aa69-ac9cc44355a5 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73572) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 10:21:52 user nova-compute[73572]: DEBUG nova.compute.manager [-] [instance: c901bbcc-3d82-4550-888f-bdbb36ba052d] Deallocating network for instance {{(pid=73572) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 10:21:52 user nova-compute[73572]: DEBUG nova.network.neutron [-] [instance: c901bbcc-3d82-4550-888f-bdbb36ba052d] deallocate_for_instance() {{(pid=73572) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 10:21:53 user nova-compute[73572]: DEBUG nova.network.neutron [-] [instance: c901bbcc-3d82-4550-888f-bdbb36ba052d] Updating instance_info_cache with network_info: [] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:21:53 user nova-compute[73572]: INFO nova.compute.manager [-] [instance: c901bbcc-3d82-4550-888f-bdbb36ba052d] Took 0.58 seconds to deallocate network for instance.
Aug 26 10:21:53 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-f253e5ad-3289-4f3c-aa69-ac9cc44355a5 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:21:53 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-f253e5ad-3289-4f3c-aa69-ac9cc44355a5 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:21:53 user nova-compute[73572]: DEBUG nova.compute.manager [req-b364da0c-ad62-4dd8-afa0-53bfe49d59e3 req-31910dd2-8f22-402b-8a02-3f2b61f5d4fb service nova] [instance: 44a737bf-3704-4193-8d24-b8d132267279] Received event network-changed-4d7425ac-5500-4d32-b0db-448d4bd29651 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:21:53 user nova-compute[73572]: DEBUG nova.compute.manager [req-b364da0c-ad62-4dd8-afa0-53bfe49d59e3 req-31910dd2-8f22-402b-8a02-3f2b61f5d4fb service nova] [instance: 44a737bf-3704-4193-8d24-b8d132267279] Refreshing instance network info cache due to event network-changed-4d7425ac-5500-4d32-b0db-448d4bd29651. {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 10:21:53 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-b364da0c-ad62-4dd8-afa0-53bfe49d59e3 req-31910dd2-8f22-402b-8a02-3f2b61f5d4fb service nova] Acquiring lock "refresh_cache-44a737bf-3704-4193-8d24-b8d132267279" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:21:53 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-b364da0c-ad62-4dd8-afa0-53bfe49d59e3 req-31910dd2-8f22-402b-8a02-3f2b61f5d4fb service nova] Acquired lock "refresh_cache-44a737bf-3704-4193-8d24-b8d132267279" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:21:53 user nova-compute[73572]: DEBUG nova.network.neutron [req-b364da0c-ad62-4dd8-afa0-53bfe49d59e3 req-31910dd2-8f22-402b-8a02-3f2b61f5d4fb service nova] [instance: 44a737bf-3704-4193-8d24-b8d132267279] Refreshing network info cache for port 4d7425ac-5500-4d32-b0db-448d4bd29651 {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 10:21:53 user nova-compute[73572]: DEBUG nova.compute.provider_tree [None req-f253e5ad-3289-4f3c-aa69-ac9cc44355a5 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Inventory has not changed in ProviderTree for provider: e2cec974-59b2-4c77-a53d-a7f4e5a30d75 {{(pid=73572) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 10:21:53 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-f253e5ad-3289-4f3c-aa69-ac9cc44355a5 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Inventory has not changed for provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73572) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 10:21:53 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-f253e5ad-3289-4f3c-aa69-ac9cc44355a5 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.601s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:21:53 user nova-compute[73572]: INFO nova.scheduler.client.report [None req-f253e5ad-3289-4f3c-aa69-ac9cc44355a5 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Deleted allocations for instance c901bbcc-3d82-4550-888f-bdbb36ba052d
Aug 26 10:21:53 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-f253e5ad-3289-4f3c-aa69-ac9cc44355a5 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Lock "c901bbcc-3d82-4550-888f-bdbb36ba052d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.490s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:21:53 user nova-compute[73572]: DEBUG nova.network.neutron [req-b364da0c-ad62-4dd8-afa0-53bfe49d59e3 req-31910dd2-8f22-402b-8a02-3f2b61f5d4fb service nova] [instance: 44a737bf-3704-4193-8d24-b8d132267279] Updated VIF entry in instance network info cache for port 4d7425ac-5500-4d32-b0db-448d4bd29651. {{(pid=73572) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 10:21:53 user nova-compute[73572]: DEBUG nova.network.neutron [req-b364da0c-ad62-4dd8-afa0-53bfe49d59e3 req-31910dd2-8f22-402b-8a02-3f2b61f5d4fb service nova] [instance: 44a737bf-3704-4193-8d24-b8d132267279] Updating instance_info_cache with network_info: [{"id": "4d7425ac-5500-4d32-b0db-448d4bd29651", "address": "fa:16:3e:6a:ad:a7", "network": {"id": "880aa066-8f77-469b-a0c4-e4e94ae31e1a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-313654920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47abd6293c07465389c379e3b5061164", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d7425ac-55", "ovs_interfaceid": "4d7425ac-5500-4d32-b0db-448d4bd29651", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:21:54 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-b364da0c-ad62-4dd8-afa0-53bfe49d59e3 req-31910dd2-8f22-402b-8a02-3f2b61f5d4fb service nova] Releasing lock "refresh_cache-44a737bf-3704-4193-8d24-b8d132267279" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:21:54 user nova-compute[73572]: DEBUG nova.compute.manager [req-4b6f71e7-4c53-4fee-8948-b56f24389347 req-c59fb28b-7590-4cae-b17d-b3ae88a5c438 service nova] [instance: c901bbcc-3d82-4550-888f-bdbb36ba052d] Received event network-vif-plugged-7c475446-2ad9-4502-b116-274f100e4d6c {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:21:54 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-4b6f71e7-4c53-4fee-8948-b56f24389347 req-c59fb28b-7590-4cae-b17d-b3ae88a5c438 service nova] Acquiring lock "c901bbcc-3d82-4550-888f-bdbb36ba052d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:21:54 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-4b6f71e7-4c53-4fee-8948-b56f24389347 req-c59fb28b-7590-4cae-b17d-b3ae88a5c438 service nova] Lock "c901bbcc-3d82-4550-888f-bdbb36ba052d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:21:54 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-4b6f71e7-4c53-4fee-8948-b56f24389347 req-c59fb28b-7590-4cae-b17d-b3ae88a5c438 service nova] Lock "c901bbcc-3d82-4550-888f-bdbb36ba052d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:21:54 user nova-compute[73572]: DEBUG nova.compute.manager [req-4b6f71e7-4c53-4fee-8948-b56f24389347 req-c59fb28b-7590-4cae-b17d-b3ae88a5c438 service nova] [instance: c901bbcc-3d82-4550-888f-bdbb36ba052d] No waiting events found dispatching network-vif-plugged-7c475446-2ad9-4502-b116-274f100e4d6c {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:21:54 user nova-compute[73572]: WARNING nova.compute.manager [req-4b6f71e7-4c53-4fee-8948-b56f24389347 req-c59fb28b-7590-4cae-b17d-b3ae88a5c438 service nova] [instance: c901bbcc-3d82-4550-888f-bdbb36ba052d] Received unexpected event network-vif-plugged-7c475446-2ad9-4502-b116-274f100e4d6c for instance with vm_state deleted and task_state None.
Aug 26 10:21:54 user nova-compute[73572]: DEBUG nova.compute.manager [req-4b6f71e7-4c53-4fee-8948-b56f24389347 req-c59fb28b-7590-4cae-b17d-b3ae88a5c438 service nova] [instance: c901bbcc-3d82-4550-888f-bdbb36ba052d] Received event network-vif-deleted-7c475446-2ad9-4502-b116-274f100e4d6c {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:21:54 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:21:55 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-5e62dd4c-5ec8-426f-9490-850fe7f1abae tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Acquiring lock "693f562f-ae3d-4cfb-926e-9990a1a301cb" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:21:55 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-5e62dd4c-5ec8-426f-9490-850fe7f1abae tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Lock "693f562f-ae3d-4cfb-926e-9990a1a301cb" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:21:55 user nova-compute[73572]: DEBUG nova.objects.instance [None req-5e62dd4c-5ec8-426f-9490-850fe7f1abae tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Lazy-loading 'flavor' on Instance uuid 693f562f-ae3d-4cfb-926e-9990a1a301cb {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:21:55 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-5e62dd4c-5ec8-426f-9490-850fe7f1abae tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] [instance: 693f562f-ae3d-4cfb-926e-9990a1a301cb] Ignoring supplied device name: /dev/vdb
Aug 26 10:21:55 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-5e62dd4c-5ec8-426f-9490-850fe7f1abae tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Lock "693f562f-ae3d-4cfb-926e-9990a1a301cb" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.065s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:21:55 user nova-compute[73572]: DEBUG nova.compute.manager [req-ba5761ac-bd18-4bb1-a3cd-63202f43940e req-2dbe93a6-cbb5-4799-84b3-6c446a56e01e service nova] [instance: 693f562f-ae3d-4cfb-926e-9990a1a301cb] Received event network-changed-010eed73-8a66-4648-a616-0b9e7441ab1c {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:21:55 user nova-compute[73572]: DEBUG nova.compute.manager [req-ba5761ac-bd18-4bb1-a3cd-63202f43940e req-2dbe93a6-cbb5-4799-84b3-6c446a56e01e service nova] [instance: 693f562f-ae3d-4cfb-926e-9990a1a301cb] Refreshing instance network info cache due to event network-changed-010eed73-8a66-4648-a616-0b9e7441ab1c. {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 10:21:55 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-ba5761ac-bd18-4bb1-a3cd-63202f43940e req-2dbe93a6-cbb5-4799-84b3-6c446a56e01e service nova] Acquiring lock "refresh_cache-693f562f-ae3d-4cfb-926e-9990a1a301cb" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:21:55 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-ba5761ac-bd18-4bb1-a3cd-63202f43940e req-2dbe93a6-cbb5-4799-84b3-6c446a56e01e service nova] Acquired lock "refresh_cache-693f562f-ae3d-4cfb-926e-9990a1a301cb" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:21:55 user nova-compute[73572]: DEBUG nova.network.neutron [req-ba5761ac-bd18-4bb1-a3cd-63202f43940e req-2dbe93a6-cbb5-4799-84b3-6c446a56e01e service nova] [instance: 693f562f-ae3d-4cfb-926e-9990a1a301cb] Refreshing network info cache for port 010eed73-8a66-4648-a616-0b9e7441ab1c {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 10:21:55 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-5e62dd4c-5ec8-426f-9490-850fe7f1abae tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Acquiring lock "693f562f-ae3d-4cfb-926e-9990a1a301cb" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:21:55 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-5e62dd4c-5ec8-426f-9490-850fe7f1abae tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Lock "693f562f-ae3d-4cfb-926e-9990a1a301cb" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:21:55 user nova-compute[73572]: INFO nova.compute.manager [None req-5e62dd4c-5ec8-426f-9490-850fe7f1abae tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] [instance: 693f562f-ae3d-4cfb-926e-9990a1a301cb] Attaching volume cfba6f7b-c2ae-436e-8d48-681432c17790 to /dev/vdb
Aug 26 10:21:55 user nova-compute[73572]: DEBUG os_brick.utils [None req-5e62dd4c-5ec8-426f-9490-850fe7f1abae tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 10:21:55 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:21:55 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:21:55 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[19dfa483-5a99-46af-bb15-e46ac7851fe8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:de8a79ed912\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:21:55 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:21:55 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:21:55 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e7516fb-4387-4dc0-b921-db7f39ef52b7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:21:55 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:21:55 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:21:55 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[2727c5bf-45e6-40a7-b5ae-0aba405702fb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:21:55 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[471af3ca-b686-4f19-aae1-a8f8b19e8337]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:21:55 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-5e62dd4c-5ec8-426f-9490-850fe7f1abae tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Running cmd (subprocess): nvme version {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:21:55 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-5e62dd4c-5ec8-426f-9490-850fe7f1abae tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] 'nvme version' failed. Not Retrying. {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 10:21:55 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5e62dd4c-5ec8-426f-9490-850fe7f1abae tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] nvme not present on system {{(pid=73572) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 10:21:55 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:21:55 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 10:21:55 user nova-compute[73572]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 10:21:55 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad582e6b-19c5-4d26-93f4-f246d16f4b8c]: (4, '') {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:21:55 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.lightos [None req-5e62dd4c-5ec8-426f-9490-850fe7f1abae tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73572) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 10:21:55 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.lightos [None req-5e62dd4c-5ec8-426f-9490-850fe7f1abae tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73572) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 10:21:55 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.lightos [None req-5e62dd4c-5ec8-426f-9490-850fe7f1abae tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] LIGHTOS: no hostnqn found. {{(pid=73572) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 10:21:55 user nova-compute[73572]: DEBUG os_brick.utils [None req-5e62dd4c-5ec8-426f-9490-850fe7f1abae tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:de8a79ed912', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 10:21:55 user nova-compute[73572]: DEBUG nova.virt.block_device [None req-5e62dd4c-5ec8-426f-9490-850fe7f1abae tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] [instance: 693f562f-ae3d-4cfb-926e-9990a1a301cb] Updating existing volume attachment record: da987c18-3c55-486c-9e27-fb6e69f2f2c7 {{(pid=73572) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 10:21:55 user nova-compute[73572]: DEBUG nova.network.neutron [req-ba5761ac-bd18-4bb1-a3cd-63202f43940e req-2dbe93a6-cbb5-4799-84b3-6c446a56e01e service nova] [instance: 693f562f-ae3d-4cfb-926e-9990a1a301cb] Updated VIF entry in instance network info cache for port 010eed73-8a66-4648-a616-0b9e7441ab1c. {{(pid=73572) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 10:21:55 user nova-compute[73572]: DEBUG nova.network.neutron [req-ba5761ac-bd18-4bb1-a3cd-63202f43940e req-2dbe93a6-cbb5-4799-84b3-6c446a56e01e service nova] [instance: 693f562f-ae3d-4cfb-926e-9990a1a301cb] Updating instance_info_cache with network_info: [{"id": "010eed73-8a66-4648-a616-0b9e7441ab1c", "address": "fa:16:3e:f7:66:5e", "network": {"id": "146a7a16-6dfd-48bd-8c96-766bdbe89bed", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-631761752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84e33d9ef6ec45709135edc20c8d7720", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap010eed73-8a", "ovs_interfaceid": "010eed73-8a66-4648-a616-0b9e7441ab1c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:21:55 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-ba5761ac-bd18-4bb1-a3cd-63202f43940e req-2dbe93a6-cbb5-4799-84b3-6c446a56e01e service nova] Releasing lock "refresh_cache-693f562f-ae3d-4cfb-926e-9990a1a301cb" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:21:57 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:21:58 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-7952a984-74a5-4442-be11-6535c8a2541d tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] [instance: 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55] Starting finish_revert_migration {{(pid=73572) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11819}}
Aug 26 10:21:58 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-7952a984-74a5-4442-be11-6535c8a2541d tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] [instance: 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55] Start _get_guest_xml network_info=[{"id": "ebf9f385-e59b-4060-9bf9-a8d2006327b4", "address": "fa:16:3e:49:23:6a", "network": {"id": "7c89c22a-96d4-4e60-9c4c-b5a82a7eca55", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1976182948-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d2c922711fb445aa99ae4f30b802c12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebf9f385-e5", "ovs_interfaceid": "ebf9f385-e59b-4060-9bf9-a8d2006327b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=299da0c9-e1c4-48f0-be55-fbe20dd06bc9,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'guest_format': None, 'size': 0, 'encryption_format': None, 'device_type': 'disk', 'image_id': '299da0c9-e1c4-48f0-be55-fbe20dd06bc9'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'disk_bus': 'virtio', 'boot_index': None, 'mount_device': '/dev/vdb', 'attachment_id': '2edd09b3-bb1e-400d-964a-4b8e6ff98b22', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:5f3a153b-1b99-4297-ad26-ea58f33330b8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qjvgYBLw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '0fe47a17-4ffb-48ce-b0f6-a9b43002bd55', 'attached_at': '2023-08-26T10:21:58.000000', 'detached_at': '', 'volume_id': '5f3a153b-1b99-4297-ad26-ea58f33330b8', 'serial': '5f3a153b-1b99-4297-ad26-ea58f33330b8'}, 'guest_format': None, 'device_type': 'disk', 'volume_type': None} {{(pid=73572) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 10:21:58 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-7952a984-74a5-4442-be11-6535c8a2541d tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:21:58 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-7952a984-74a5-4442-be11-6535c8a2541d tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:21:58 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-7952a984-74a5-4442-be11-6535c8a2541d tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73572) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 10:21:58 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-7952a984-74a5-4442-be11-6535c8a2541d tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] CPU controller missing on host. {{(pid=73572) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 10:21:58 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-7952a984-74a5-4442-be11-6535c8a2541d tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73572) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 10:21:58 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-7952a984-74a5-4442-be11-6535c8a2541d tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] CPU controller found on host. {{(pid=73572) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 10:21:58 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-7952a984-74a5-4442-be11-6535c8a2541d tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73572) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 10:21:58 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-7952a984-74a5-4442-be11-6535c8a2541d tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T10:07:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=299da0c9-e1c4-48f0-be55-fbe20dd06bc9,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 10:21:58 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-7952a984-74a5-4442-be11-6535c8a2541d tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Flavor limits 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 10:21:58 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-7952a984-74a5-4442-be11-6535c8a2541d tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Image limits 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 10:21:58 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-7952a984-74a5-4442-be11-6535c8a2541d tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Flavor pref 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 10:21:58 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-7952a984-74a5-4442-be11-6535c8a2541d tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Image pref 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 10:21:58 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-7952a984-74a5-4442-be11-6535c8a2541d tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 10:21:58 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-7952a984-74a5-4442-be11-6535c8a2541d tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 10:21:58 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-7952a984-74a5-4442-be11-6535c8a2541d tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73572) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 10:21:58 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-7952a984-74a5-4442-be11-6535c8a2541d tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Got 1 possible topologies {{(pid=73572) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 10:21:58 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-7952a984-74a5-4442-be11-6535c8a2541d tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 10:21:58 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-7952a984-74a5-4442-be11-6535c8a2541d tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 10:21:58 user nova-compute[73572]: DEBUG nova.objects.instance [None req-7952a984-74a5-4442-be11-6535c8a2541d tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Lazy-loading 'vcpu_model' on Instance uuid 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55 {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:21:58 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7952a984-74a5-4442-be11-6535c8a2541d tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] [instance: 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55] Calling os-brick to attach iSCSI Volume {{(pid=73572) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 10:21:58 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-7952a984-74a5-4442-be11-6535c8a2541d tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc89c3d6a10>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:5f3a153b-1b99-4297-ad26-ea58f33330b8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qjvgYBLw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 10:21:58 user nova-compute[73572]: WARNING os_brick.initiator.connectors.base [None req-7952a984-74a5-4442-be11-6535c8a2541d tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 10:21:58 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-7952a984-74a5-4442-be11-6535c8a2541d tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 10:21:58 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-7952a984-74a5-4442-be11-6535c8a2541d tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 10:21:58 user nova-compute[73572]: WARNING os_brick.initiator.connectors.base [None req-7952a984-74a5-4442-be11-6535c8a2541d tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 10:21:58 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-7952a984-74a5-4442-be11-6535c8a2541d tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5f3a153b-1b99-4297-ad26-ea58f33330b8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 10:21:58 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-7952a984-74a5-4442-be11-6535c8a2541d tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5f3a153b-1b99-4297-ad26-ea58f33330b8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 10:21:58 user nova-compute[73572]: INFO os_brick.initiator.connectors.iscsi [None req-7952a984-74a5-4442-be11-6535c8a2541d tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 10:21:58 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f3a153b-1b99-4297-ad26-ea58f33330b8 -p 172.16.0.220:3260 {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:21:58 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f3a153b-1b99-4297-ad26-ea58f33330b8 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:21:58 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bded5c7-a6ce-4ca9-b253-1e60be9574e1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:21:58 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-7952a984-74a5-4442-be11-6535c8a2541d tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 10:21:58 user nova-compute[73572]:  {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:21:58 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f3a153b-1b99-4297-ad26-ea58f33330b8 -p 172.16.0.220:3260 --interface default --op new {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:21:58 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f3a153b-1b99-4297-ad26-ea58f33330b8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:21:58 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[1734874c-027f-40a3-9fc2-5b10a32e4253]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5f3a153b-1b99-4297-ad26-ea58f33330b8] added\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:21:58 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-7952a984-74a5-4442-be11-6535c8a2541d tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5f3a153b-1b99-4297-ad26-ea58f33330b8] added
Aug 26 10:21:58 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:21:58 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f3a153b-1b99-4297-ad26-ea58f33330b8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:21:58 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f3a153b-1b99-4297-ad26-ea58f33330b8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:21:58 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[2230c08b-d06d-4ade-97fe-c42a37f644ce]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:21:58 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-7952a984-74a5-4442-be11-6535c8a2541d tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:21:58 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f3a153b-1b99-4297-ad26-ea58f33330b8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:21:58 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f3a153b-1b99-4297-ad26-ea58f33330b8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:21:58 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eb4c615-1798-4926-bf2a-f7d49f2881ba]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:21:58 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-7952a984-74a5-4442-be11-6535c8a2541d tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:21:58 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f3a153b-1b99-4297-ad26-ea58f33330b8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qjvgYBLw {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:21:58 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f3a153b-1b99-4297-ad26-ea58f33330b8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qjvgYBLw" returned: 0 in 0.023s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:21:58 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[516d8273-d31a-4c31-a8b1-ca0912f110d7]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:21:58 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-7952a984-74a5-4442-be11-6535c8a2541d tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qjvgYBLw'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:21:58 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f3a153b-1b99-4297-ad26-ea58f33330b8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:21:58 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f3a153b-1b99-4297-ad26-ea58f33330b8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:21:58 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fa18502-8274-40b7-96d7-7cfad52b0dda]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:21:58 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-7952a984-74a5-4442-be11-6535c8a2541d tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:21:58 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:21:58 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:21:58 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[84fcfd78-611e-4979-b66e-25edca637e60]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:21:58 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-7952a984-74a5-4442-be11-6535c8a2541d tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)
Aug 26 10:21:58 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 10:21:58 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-7952a984-74a5-4442-be11-6535c8a2541d tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)
Aug 26 10:21:58 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 10:21:58 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f3a153b-1b99-4297-ad26-ea58f33330b8 -p 172.16.0.220:3260 --login {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:21:58 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f3a153b-1b99-4297-ad26-ea58f33330b8 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:21:58 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[902d4566-4fa3-4401-bdcf-8995bcb41fff]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5f3a153b-1b99-4297-ad26-ea58f33330b8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5f3a153b-1b99-4297-ad26-ea58f33330b8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:21:58 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-7952a984-74a5-4442-be11-6535c8a2541d tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5f3a153b-1b99-4297-ad26-ea58f33330b8, portal: 172.16.0.220,3260]
Aug 26 10:21:58 user nova-compute[73572]: Login to [iface: default, target: iqn.2010-10.org.openstack:5f3a153b-1b99-4297-ad26-ea58f33330b8, portal: 172.16.0.220,3260] successful.
Aug 26 10:21:58 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:21:58 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f3a153b-1b99-4297-ad26-ea58f33330b8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:21:58 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f3a153b-1b99-4297-ad26-ea58f33330b8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:21:58 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[9263f438-2f21-4181-b44f-e3cb9a8fc4e3]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:21:58 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-7952a984-74a5-4442-be11-6535c8a2541d tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:21:58 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:21:58 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:21:58 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cf3932e-09b9-464e-a020-88968a358447]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f3a153b-1b99-4297-ad26-ea58f33330b8 (non-flash)\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:21:58 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-7952a984-74a5-4442-be11-6535c8a2541d tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)
Aug 26 10:21:58 user nova-compute[73572]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f3a153b-1b99-4297-ad26-ea58f33330b8 (non-flash)
Aug 26 10:21:58 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 10:21:58 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-7952a984-74a5-4442-be11-6535c8a2541d tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)
Aug 26 10:21:58 user nova-compute[73572]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f3a153b-1b99-4297-ad26-ea58f33330b8 (non-flash)
Aug 26 10:21:58 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 10:21:58 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-7952a984-74a5-4442-be11-6535c8a2541d tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5f3a153b-1b99-4297-ad26-ea58f33330b8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.292s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 10:21:58 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-7952a984-74a5-4442-be11-6535c8a2541d tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Connected to 172.16.0.220:3260 {{(pid=73572) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 10:21:58 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-7952a984-74a5-4442-be11-6535c8a2541d tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] HCTL ('33', '-', '-', 0) found on session 30 with lun 0 {{(pid=73572) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 10:21:58 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-7952a984-74a5-4442-be11-6535c8a2541d tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73572) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 10:21:58 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:21:58 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:21:58 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab03a0c6-d7ed-4e60-b1dd-b7cc6fef4080]: (4, ('- - 0', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:21:58 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-7952a984-74a5-4442-be11-6535c8a2541d tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Searching for a device in session 30 and hctl ['33', '*', '*', 0] yield: None {{(pid=73572) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 10:21:59 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-520dbf22-91b6-44e5-ad0b-4c333d107fb2 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Acquiring lock "44a737bf-3704-4193-8d24-b8d132267279" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:21:59 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-520dbf22-91b6-44e5-ad0b-4c333d107fb2 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Lock "44a737bf-3704-4193-8d24-b8d132267279" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:21:59 user nova-compute[73572]: DEBUG nova.objects.instance [None req-520dbf22-91b6-44e5-ad0b-4c333d107fb2 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Lazy-loading 'flavor' on Instance uuid 44a737bf-3704-4193-8d24-b8d132267279 {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:21:59 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-520dbf22-91b6-44e5-ad0b-4c333d107fb2 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Lock "44a737bf-3704-4193-8d24-b8d132267279" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:21:59 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-520dbf22-91b6-44e5-ad0b-4c333d107fb2 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Acquiring lock "44a737bf-3704-4193-8d24-b8d132267279" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:21:59 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-520dbf22-91b6-44e5-ad0b-4c333d107fb2 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Lock "44a737bf-3704-4193-8d24-b8d132267279" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:21:59 user nova-compute[73572]: INFO nova.compute.manager [None req-520dbf22-91b6-44e5-ad0b-4c333d107fb2 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] [instance: 44a737bf-3704-4193-8d24-b8d132267279] Attaching volume 19c2d1dd-dfb9-4ac0-8341-35f96b7ade56 to /dev/vdb
Aug 26 10:21:59 user nova-compute[73572]: DEBUG os_brick.utils [None req-520dbf22-91b6-44e5-ad0b-4c333d107fb2 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 10:21:59 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:21:59 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:21:59 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[7254ec2c-ad20-49ff-8147-399920576763]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:de8a79ed912\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:21:59 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:21:59 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.025s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:21:59 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[abb295cf-3761-4827-8250-a4a38731fe54]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:21:59 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:21:59 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:21:59 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7d74d97-c892-484d-ba6b-4aebf279560b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:21:59 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[23f4303a-3ab2-436d-9a48-68a2be4a330e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:21:59 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-520dbf22-91b6-44e5-ad0b-4c333d107fb2 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Running cmd (subprocess): nvme version {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:21:59 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-520dbf22-91b6-44e5-ad0b-4c333d107fb2 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] 'nvme version' failed. Not Retrying. {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 10:21:59 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.nvmeof [None req-520dbf22-91b6-44e5-ad0b-4c333d107fb2 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] nvme not present on system {{(pid=73572) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 10:21:59 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:21:59 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 10:21:59 user nova-compute[73572]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 10:21:59 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb11bdc9-c185-4413-b980-cb70a27b797c]: (4, '') {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:21:59 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.lightos [None req-520dbf22-91b6-44e5-ad0b-4c333d107fb2 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73572) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 10:21:59 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.lightos [None req-520dbf22-91b6-44e5-ad0b-4c333d107fb2 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73572) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 10:21:59 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.lightos [None req-520dbf22-91b6-44e5-ad0b-4c333d107fb2 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] LIGHTOS: no hostnqn found. {{(pid=73572) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 10:21:59 user nova-compute[73572]: DEBUG os_brick.utils [None req-520dbf22-91b6-44e5-ad0b-4c333d107fb2 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:de8a79ed912', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 10:21:59 user nova-compute[73572]: DEBUG nova.virt.block_device [None req-520dbf22-91b6-44e5-ad0b-4c333d107fb2 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] [instance: 44a737bf-3704-4193-8d24-b8d132267279] Updating existing volume attachment record: 896e8cc9-7079-4c8e-a08c-e407dd251770 {{(pid=73572) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 10:21:59 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-7952a984-74a5-4442-be11-6535c8a2541d tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Searching for a device in session 30 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73572) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 10:21:59 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-7952a984-74a5-4442-be11-6535c8a2541d tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qjvgYBLw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73572) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 10:21:59 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-7952a984-74a5-4442-be11-6535c8a2541d tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.325s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 10:21:59 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-7952a984-74a5-4442-be11-6535c8a2541d tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] <== connect_volume: return (1327ms) {'type': 'block', 'scsi_wwn': '23835633333663462', 'path': '/dev/sdb'} {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 10:21:59 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7952a984-74a5-4442-be11-6535c8a2541d tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] [instance: 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23835633333663462', 'path': '/dev/sdb'} {{(pid=73572) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 10:21:59 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:22:00 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-7952a984-74a5-4442-be11-6535c8a2541d tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T10:15:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-220365578',display_name='tempest-ServerActionsTestOtherB-server-220365578',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-220365578',id=17,image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNpUMyiGXRzsPFYrzC1k+DPeAQeFXKXREu1ci6G2S65T1Gci+/hLSOFjcdBoLqgENyI+7/uwXL8y2F/F10thQC08ST7hXeII35W/K66MHhxc0L254FUOJIzPARZXOsUESA==',key_name='tempest-keypair-2095276623',keypairs=<?>,launch_index=0,launched_at=2023-08-26T10:20:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='0d2c922711fb445aa99ae4f30b802c12',ramdisk_id='',reservation_id='r-ktz04i2y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1806914349',owner_user_name='tempest-ServerActionsTestOtherB-1806914349-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T10:21:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0ee7e4a9f7db476eb9f16440c6b8e37e',uuid=0fe47a17-4ffb-48ce-b0f6-a9b43002bd55,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "ebf9f385-e59b-4060-9bf9-a8d2006327b4", "address": "fa:16:3e:49:23:6a", "network": {"id": "7c89c22a-96d4-4e60-9c4c-b5a82a7eca55", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1976182948-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d2c922711fb445aa99ae4f30b802c12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebf9f385-e5", "ovs_interfaceid": "ebf9f385-e59b-4060-9bf9-a8d2006327b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73572) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 10:22:00 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-7952a984-74a5-4442-be11-6535c8a2541d tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Converting VIF {"id": "ebf9f385-e59b-4060-9bf9-a8d2006327b4", "address": "fa:16:3e:49:23:6a", "network": {"id": "7c89c22a-96d4-4e60-9c4c-b5a82a7eca55", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1976182948-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d2c922711fb445aa99ae4f30b802c12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebf9f385-e5", "ovs_interfaceid": "ebf9f385-e59b-4060-9bf9-a8d2006327b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:22:00 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-7952a984-74a5-4442-be11-6535c8a2541d tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:49:23:6a,bridge_name='br-int',has_traffic_filtering=True,id=ebf9f385-e59b-4060-9bf9-a8d2006327b4,network=Network(7c89c22a-96d4-4e60-9c4c-b5a82a7eca55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebf9f385-e5') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:22:00 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-7952a984-74a5-4442-be11-6535c8a2541d tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] [instance: 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55] End _get_guest_xml xml=<domain type="kvm">
Aug 26 10:22:00 user nova-compute[73572]:   <uuid>0fe47a17-4ffb-48ce-b0f6-a9b43002bd55</uuid>
Aug 26 10:22:00 user nova-compute[73572]:   <name>instance-00000011</name>
Aug 26 10:22:00 user nova-compute[73572]:   <memory>524288</memory>
Aug 26 10:22:00 user nova-compute[73572]:   <vcpu>1</vcpu>
Aug 26 10:22:00 user nova-compute[73572]:   <metadata>
Aug 26 10:22:00 user nova-compute[73572]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 10:22:00 user nova-compute[73572]:       <nova:package version="0.0.0"/>
Aug 26 10:22:00 user nova-compute[73572]:       <nova:name>tempest-ServerActionsTestOtherB-server-220365578</nova:name>
Aug 26 10:22:00 user nova-compute[73572]:       <nova:creationTime>2023-08-26 10:21:58</nova:creationTime>
Aug 26 10:22:00 user nova-compute[73572]:       <nova:flavor name="m1.tiny">
Aug 26 10:22:00 user nova-compute[73572]:         <nova:memory>512</nova:memory>
Aug 26 10:22:00 user nova-compute[73572]:         <nova:disk>1</nova:disk>
Aug 26 10:22:00 user nova-compute[73572]:         <nova:swap>0</nova:swap>
Aug 26 10:22:00 user nova-compute[73572]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 10:22:00 user nova-compute[73572]:         <nova:vcpus>1</nova:vcpus>
Aug 26 10:22:00 user nova-compute[73572]:       </nova:flavor>
Aug 26 10:22:00 user nova-compute[73572]:       <nova:owner>
Aug 26 10:22:00 user nova-compute[73572]:         <nova:user uuid="0ee7e4a9f7db476eb9f16440c6b8e37e">tempest-ServerActionsTestOtherB-1806914349-project-member</nova:user>
Aug 26 10:22:00 user nova-compute[73572]:         <nova:project uuid="0d2c922711fb445aa99ae4f30b802c12">tempest-ServerActionsTestOtherB-1806914349</nova:project>
Aug 26 10:22:00 user nova-compute[73572]:       </nova:owner>
Aug 26 10:22:00 user nova-compute[73572]:       <nova:root type="image" uuid="299da0c9-e1c4-48f0-be55-fbe20dd06bc9"/>
Aug 26 10:22:00 user nova-compute[73572]:       <nova:ports>
Aug 26 10:22:00 user nova-compute[73572]:         <nova:port uuid="ebf9f385-e59b-4060-9bf9-a8d2006327b4">
Aug 26 10:22:00 user nova-compute[73572]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 26 10:22:00 user nova-compute[73572]:         </nova:port>
Aug 26 10:22:00 user nova-compute[73572]:       </nova:ports>
Aug 26 10:22:00 user nova-compute[73572]:     </nova:instance>
Aug 26 10:22:00 user nova-compute[73572]:   </metadata>
Aug 26 10:22:00 user nova-compute[73572]:   <sysinfo type="smbios">
Aug 26 10:22:00 user nova-compute[73572]:     <system>
Aug 26 10:22:00 user nova-compute[73572]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 10:22:00 user nova-compute[73572]:       <entry name="product">OpenStack Nova</entry>
Aug 26 10:22:00 user nova-compute[73572]:       <entry name="version">0.0.0</entry>
Aug 26 10:22:00 user nova-compute[73572]:       <entry name="serial">0fe47a17-4ffb-48ce-b0f6-a9b43002bd55</entry>
Aug 26 10:22:00 user nova-compute[73572]:       <entry name="uuid">0fe47a17-4ffb-48ce-b0f6-a9b43002bd55</entry>
Aug 26 10:22:00 user nova-compute[73572]:       <entry name="family">Virtual Machine</entry>
Aug 26 10:22:00 user nova-compute[73572]:     </system>
Aug 26 10:22:00 user nova-compute[73572]:   </sysinfo>
Aug 26 10:22:00 user nova-compute[73572]:   <os>
Aug 26 10:22:00 user nova-compute[73572]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 10:22:00 user nova-compute[73572]:     <boot dev="hd"/>
Aug 26 10:22:00 user nova-compute[73572]:     <smbios mode="sysinfo"/>
Aug 26 10:22:00 user nova-compute[73572]:   </os>
Aug 26 10:22:00 user nova-compute[73572]:   <features>
Aug 26 10:22:00 user nova-compute[73572]:     <acpi/>
Aug 26 10:22:00 user nova-compute[73572]:     <apic/>
Aug 26 10:22:00 user nova-compute[73572]:     <vmcoreinfo/>
Aug 26 10:22:00 user nova-compute[73572]:   </features>
Aug 26 10:22:00 user nova-compute[73572]:   <clock offset="utc">
Aug 26 10:22:00 user nova-compute[73572]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 10:22:00 user nova-compute[73572]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 10:22:00 user nova-compute[73572]:     <timer name="hpet" present="no"/>
Aug 26 10:22:00 user nova-compute[73572]:   </clock>
Aug 26 10:22:00 user nova-compute[73572]:   <cpu mode="custom" match="exact">
Aug 26 10:22:00 user nova-compute[73572]:     <model>Nehalem</model>
Aug 26 10:22:00 user nova-compute[73572]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 10:22:00 user nova-compute[73572]:   </cpu>
Aug 26 10:22:00 user nova-compute[73572]:   <devices>
Aug 26 10:22:00 user nova-compute[73572]:     <disk type="file" device="disk">
Aug 26 10:22:00 user nova-compute[73572]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 10:22:00 user nova-compute[73572]:       <source file="/opt/stack/data/nova/instances/0fe47a17-4ffb-48ce-b0f6-a9b43002bd55/disk"/>
Aug 26 10:22:00 user nova-compute[73572]:       <target dev="vda" bus="virtio"/>
Aug 26 10:22:00 user nova-compute[73572]:     </disk>
Aug 26 10:22:00 user nova-compute[73572]:     <disk type="block" device="disk">
Aug 26 10:22:00 user nova-compute[73572]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 10:22:00 user nova-compute[73572]:       <source dev="/dev/sdb"/>
Aug 26 10:22:00 user nova-compute[73572]:       <target dev="vdb" bus="virtio"/>
Aug 26 10:22:00 user nova-compute[73572]:       <serial>5f3a153b-1b99-4297-ad26-ea58f33330b8</serial>
Aug 26 10:22:00 user nova-compute[73572]:     </disk>
Aug 26 10:22:00 user nova-compute[73572]:     <interface type="ethernet">
Aug 26 10:22:00 user nova-compute[73572]:       <mac address="fa:16:3e:49:23:6a"/>
Aug 26 10:22:00 user nova-compute[73572]:       <model type="virtio"/>
Aug 26 10:22:00 user nova-compute[73572]:       <mtu size="1442"/>
Aug 26 10:22:00 user nova-compute[73572]:       <target dev="tapebf9f385-e5"/>
Aug 26 10:22:00 user nova-compute[73572]:     </interface>
Aug 26 10:22:00 user nova-compute[73572]:     <serial type="pty">
Aug 26 10:22:00 user nova-compute[73572]:       <log file="/opt/stack/data/nova/instances/0fe47a17-4ffb-48ce-b0f6-a9b43002bd55/console.log" append="off"/>
Aug 26 10:22:00 user nova-compute[73572]:     </serial>
Aug 26 10:22:00 user nova-compute[73572]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 10:22:00 user nova-compute[73572]:     <video>
Aug 26 10:22:00 user nova-compute[73572]:       <model type="virtio"/>
Aug 26 10:22:00 user nova-compute[73572]:     </video>
Aug 26 10:22:00 user nova-compute[73572]:     <rng model="virtio">
Aug 26 10:22:00 user nova-compute[73572]:       <backend model="random">/dev/urandom</backend>
Aug 26 10:22:00 user nova-compute[73572]:     </rng>
Aug 26 10:22:00 user nova-compute[73572]:     <controller type="usb" index="0" model="none"/>
Aug 26 10:22:00 user nova-compute[73572]:     <memballoon model="virtio">
Aug 26 10:22:00 user nova-compute[73572]:       <stats period="10"/>
Aug 26 10:22:00 user nova-compute[73572]:     </memballoon>
Aug 26 10:22:00 user nova-compute[73572]:   </devices>
Aug 26 10:22:00 user nova-compute[73572]: </domain>
Aug 26 10:22:00 user nova-compute[73572]:  {{(pid=73572) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 10:22:00 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-7952a984-74a5-4442-be11-6535c8a2541d tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T10:15:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-220365578',display_name='tempest-ServerActionsTestOtherB-server-220365578',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-220365578',id=17,image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNpUMyiGXRzsPFYrzC1k+DPeAQeFXKXREu1ci6G2S65T1Gci+/hLSOFjcdBoLqgENyI+7/uwXL8y2F/F10thQC08ST7hXeII35W/K66MHhxc0L254FUOJIzPARZXOsUESA==',key_name='tempest-keypair-2095276623',keypairs=<?>,launch_index=0,launched_at=2023-08-26T10:20:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='0d2c922711fb445aa99ae4f30b802c12',ramdisk_id='',reservation_id='r-ktz04i2y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1806914349',owner_user_name='tempest-ServerActionsTestOtherB-1806914349-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T10:21:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0ee7e4a9f7db476eb9f16440c6b8e37e',uuid=0fe47a17-4ffb-48ce-b0f6-a9b43002bd55,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "ebf9f385-e59b-4060-9bf9-a8d2006327b4", "address": "fa:16:3e:49:23:6a", "network": {"id": "7c89c22a-96d4-4e60-9c4c-b5a82a7eca55", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1976182948-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d2c922711fb445aa99ae4f30b802c12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebf9f385-e5", "ovs_interfaceid": "ebf9f385-e59b-4060-9bf9-a8d2006327b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 10:22:00 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-7952a984-74a5-4442-be11-6535c8a2541d tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Converting VIF {"id": "ebf9f385-e59b-4060-9bf9-a8d2006327b4", "address": "fa:16:3e:49:23:6a", "network": {"id": "7c89c22a-96d4-4e60-9c4c-b5a82a7eca55", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1976182948-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d2c922711fb445aa99ae4f30b802c12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebf9f385-e5", "ovs_interfaceid": "ebf9f385-e59b-4060-9bf9-a8d2006327b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:22:00 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-7952a984-74a5-4442-be11-6535c8a2541d tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:49:23:6a,bridge_name='br-int',has_traffic_filtering=True,id=ebf9f385-e59b-4060-9bf9-a8d2006327b4,network=Network(7c89c22a-96d4-4e60-9c4c-b5a82a7eca55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebf9f385-e5') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:22:00 user nova-compute[73572]: DEBUG os_vif [None req-7952a984-74a5-4442-be11-6535c8a2541d tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:23:6a,bridge_name='br-int',has_traffic_filtering=True,id=ebf9f385-e59b-4060-9bf9-a8d2006327b4,network=Network(7c89c22a-96d4-4e60-9c4c-b5a82a7eca55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebf9f385-e5') {{(pid=73572) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 10:22:00 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:22:00 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:22:00 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 10:22:00 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:22:00 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapebf9f385-e5, may_exist=True, interface_attrs={}) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:22:00 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapebf9f385-e5, col_values=(('external_ids', {'iface-id': 'ebf9f385-e59b-4060-9bf9-a8d2006327b4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:49:23:6a', 'vm-uuid': '0fe47a17-4ffb-48ce-b0f6-a9b43002bd55'}),), if_exists=True) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:22:00 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:22:00 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:22:00 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:22:00 user nova-compute[73572]: INFO os_vif [None req-7952a984-74a5-4442-be11-6535c8a2541d tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:23:6a,bridge_name='br-int',has_traffic_filtering=True,id=ebf9f385-e59b-4060-9bf9-a8d2006327b4,network=Network(7c89c22a-96d4-4e60-9c4c-b5a82a7eca55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebf9f385-e5')
Aug 26 10:22:01 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:22:01 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:22:01 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:22:01 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:22:01 user nova-compute[73572]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693045306.6924071, 682138af-ba6a-47f1-a9a5-03ae2661f54d => Stopped> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:22:01 user nova-compute[73572]: INFO nova.compute.manager [-] [instance: 682138af-ba6a-47f1-a9a5-03ae2661f54d] VM Stopped (Lifecycle Event)
Aug 26 10:22:01 user nova-compute[73572]: DEBUG nova.compute.manager [None req-86475e1d-c853-4d68-9ce0-22c36152e013 None None] [instance: 682138af-ba6a-47f1-a9a5-03ae2661f54d] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:22:02 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:22:02 user nova-compute[73572]: DEBUG nova.compute.manager [req-5be19b4a-b855-4515-a833-c07f6303514a req-107a275c-a4c5-42d4-98ff-d5159481acc9 service nova] [instance: 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55] Received event network-vif-plugged-ebf9f385-e59b-4060-9bf9-a8d2006327b4 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:22:02 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-5be19b4a-b855-4515-a833-c07f6303514a req-107a275c-a4c5-42d4-98ff-d5159481acc9 service nova] Acquiring lock "0fe47a17-4ffb-48ce-b0f6-a9b43002bd55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:22:02 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-5be19b4a-b855-4515-a833-c07f6303514a req-107a275c-a4c5-42d4-98ff-d5159481acc9 service nova] Lock "0fe47a17-4ffb-48ce-b0f6-a9b43002bd55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:22:02 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-5be19b4a-b855-4515-a833-c07f6303514a req-107a275c-a4c5-42d4-98ff-d5159481acc9 service nova] Lock "0fe47a17-4ffb-48ce-b0f6-a9b43002bd55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:22:02 user nova-compute[73572]: DEBUG nova.compute.manager [req-5be19b4a-b855-4515-a833-c07f6303514a req-107a275c-a4c5-42d4-98ff-d5159481acc9 service nova] [instance: 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55] No waiting events found dispatching network-vif-plugged-ebf9f385-e59b-4060-9bf9-a8d2006327b4 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:22:02 user nova-compute[73572]: WARNING nova.compute.manager [req-5be19b4a-b855-4515-a833-c07f6303514a req-107a275c-a4c5-42d4-98ff-d5159481acc9 service nova] [instance: 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55] Received unexpected event network-vif-plugged-ebf9f385-e59b-4060-9bf9-a8d2006327b4 for instance with vm_state resized and task_state resize_reverting.
Aug 26 10:22:02 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:22:02 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:22:02 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:22:04 user nova-compute[73572]: DEBUG nova.virt.driver [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Emitting event <LifecycleEvent: 1693045324.2740455, 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55 => Resumed> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:22:04 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55] VM Resumed (Lifecycle Event)
Aug 26 10:22:04 user nova-compute[73572]: DEBUG nova.compute.manager [None req-7952a984-74a5-4442-be11-6535c8a2541d tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] [instance: 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55] Instance event wait completed in 0 seconds for  {{(pid=73572) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 10:22:04 user nova-compute[73572]: INFO nova.virt.libvirt.driver [-] [instance: 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55] Instance running successfully.
Aug 26 10:22:04 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-7952a984-74a5-4442-be11-6535c8a2541d tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] [instance: 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55] finish_revert_migration finished successfully. {{(pid=73572) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11863}}
Aug 26 10:22:04 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:22:04 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=73572) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 10:22:04 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Aug 26 10:22:04 user nova-compute[73572]: DEBUG nova.virt.driver [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Emitting event <LifecycleEvent: 1693045324.2753935, 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55 => Started> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:22:04 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55] VM Started (Lifecycle Event)
Aug 26 10:22:04 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:22:04 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=73572) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 10:22:04 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Aug 26 10:22:04 user nova-compute[73572]: DEBUG nova.compute.manager [req-c3d0d34f-9fbc-4204-87a3-7ca71c4c530e req-b8efcfc2-0296-4cde-b11b-a872c8794fed service nova] [instance: 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55] Received event network-vif-plugged-ebf9f385-e59b-4060-9bf9-a8d2006327b4 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:22:04 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-c3d0d34f-9fbc-4204-87a3-7ca71c4c530e req-b8efcfc2-0296-4cde-b11b-a872c8794fed service nova] Acquiring lock "0fe47a17-4ffb-48ce-b0f6-a9b43002bd55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:22:04 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-c3d0d34f-9fbc-4204-87a3-7ca71c4c530e req-b8efcfc2-0296-4cde-b11b-a872c8794fed service nova] Lock "0fe47a17-4ffb-48ce-b0f6-a9b43002bd55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:22:04 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-c3d0d34f-9fbc-4204-87a3-7ca71c4c530e req-b8efcfc2-0296-4cde-b11b-a872c8794fed service nova] Lock "0fe47a17-4ffb-48ce-b0f6-a9b43002bd55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:22:04 user nova-compute[73572]: DEBUG nova.compute.manager [req-c3d0d34f-9fbc-4204-87a3-7ca71c4c530e req-b8efcfc2-0296-4cde-b11b-a872c8794fed service nova] [instance: 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55] No waiting events found dispatching network-vif-plugged-ebf9f385-e59b-4060-9bf9-a8d2006327b4 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:22:04 user nova-compute[73572]: WARNING nova.compute.manager [req-c3d0d34f-9fbc-4204-87a3-7ca71c4c530e req-b8efcfc2-0296-4cde-b11b-a872c8794fed service nova] [instance: 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55] Received unexpected event network-vif-plugged-ebf9f385-e59b-4060-9bf9-a8d2006327b4 for instance with vm_state resized and task_state resize_reverting.
Aug 26 10:22:04 user nova-compute[73572]: INFO nova.compute.manager [None req-7952a984-74a5-4442-be11-6535c8a2541d tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] [instance: 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55] Updating instance to original state: 'active'
Aug 26 10:22:04 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:22:05 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:22:07 user nova-compute[73572]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693045312.3474925, c901bbcc-3d82-4550-888f-bdbb36ba052d => Stopped> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:22:07 user nova-compute[73572]: INFO nova.compute.manager [-] [instance: c901bbcc-3d82-4550-888f-bdbb36ba052d] VM Stopped (Lifecycle Event)
Aug 26 10:22:07 user nova-compute[73572]: DEBUG nova.compute.manager [None req-03221938-23ac-4bc2-b6bf-b71e4d44829d None None] [instance: c901bbcc-3d82-4550-888f-bdbb36ba052d] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:22:08 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e62dd4c-5ec8-426f-9490-850fe7f1abae tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] [instance: 693f562f-ae3d-4cfb-926e-9990a1a301cb] Calling os-brick to attach iSCSI Volume {{(pid=73572) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 10:22:08 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e62dd4c-5ec8-426f-9490-850fe7f1abae tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc89c3d6a10>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:cfba6f7b-c2ae-436e-8d48-681432c17790'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VmAriJSx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 10:22:08 user nova-compute[73572]: WARNING os_brick.initiator.connectors.base [None req-5e62dd4c-5ec8-426f-9490-850fe7f1abae tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 10:22:08 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-5e62dd4c-5ec8-426f-9490-850fe7f1abae tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 10:22:08 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-5e62dd4c-5ec8-426f-9490-850fe7f1abae tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 10:22:08 user nova-compute[73572]: WARNING os_brick.initiator.connectors.base [None req-5e62dd4c-5ec8-426f-9490-850fe7f1abae tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 10:22:08 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-5e62dd4c-5ec8-426f-9490-850fe7f1abae tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cfba6f7b-c2ae-436e-8d48-681432c17790" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 10:22:08 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-5e62dd4c-5ec8-426f-9490-850fe7f1abae tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cfba6f7b-c2ae-436e-8d48-681432c17790" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 10:22:08 user nova-compute[73572]: INFO os_brick.initiator.connectors.iscsi [None req-5e62dd4c-5ec8-426f-9490-850fe7f1abae tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 10:22:08 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfba6f7b-c2ae-436e-8d48-681432c17790 -p 172.16.0.220:3260 {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:22:08 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfba6f7b-c2ae-436e-8d48-681432c17790 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:22:08 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9f88585-77fa-4e1e-b977-845593f18e56]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:22:08 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e62dd4c-5ec8-426f-9490-850fe7f1abae tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 10:22:08 user nova-compute[73572]:  {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:22:08 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfba6f7b-c2ae-436e-8d48-681432c17790 -p 172.16.0.220:3260 --interface default --op new {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:22:08 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfba6f7b-c2ae-436e-8d48-681432c17790 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:22:08 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bc31ff8-df29-440b-9102-bfd92f9ee943]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cfba6f7b-c2ae-436e-8d48-681432c17790] added\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:22:08 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e62dd4c-5ec8-426f-9490-850fe7f1abae tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cfba6f7b-c2ae-436e-8d48-681432c17790] added
Aug 26 10:22:08 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:22:08 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfba6f7b-c2ae-436e-8d48-681432c17790 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:22:08 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfba6f7b-c2ae-436e-8d48-681432c17790 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:22:08 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e086d33-e20a-4e1c-a1ce-5cb3d2398968]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:22:08 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e62dd4c-5ec8-426f-9490-850fe7f1abae tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:22:08 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfba6f7b-c2ae-436e-8d48-681432c17790 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:22:08 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfba6f7b-c2ae-436e-8d48-681432c17790 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:22:08 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[d833a416-d276-4c7b-9321-77f515daaba2]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:22:08 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e62dd4c-5ec8-426f-9490-850fe7f1abae tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:22:08 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfba6f7b-c2ae-436e-8d48-681432c17790 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VmAriJSx {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:22:08 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfba6f7b-c2ae-436e-8d48-681432c17790 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VmAriJSx" returned: 0 in 0.021s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:22:08 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cc5af5d-a1a9-45d1-84a3-299b029d5cf3]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:22:08 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e62dd4c-5ec8-426f-9490-850fe7f1abae tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VmAriJSx'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:22:08 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfba6f7b-c2ae-436e-8d48-681432c17790 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:22:08 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfba6f7b-c2ae-436e-8d48-681432c17790 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:22:08 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[1617f0a3-f4c9-42fd-965c-4b37e7f45117]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:22:08 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e62dd4c-5ec8-426f-9490-850fe7f1abae tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:22:08 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:22:08 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:22:08 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[a08c7943-c065-4711-8e4c-6163c0c36ed7]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f3a153b-1b99-4297-ad26-ea58f33330b8 (non-flash)\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:22:08 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e62dd4c-5ec8-426f-9490-850fe7f1abae tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)
Aug 26 10:22:08 user nova-compute[73572]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f3a153b-1b99-4297-ad26-ea58f33330b8 (non-flash)
Aug 26 10:22:08 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 10:22:08 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e62dd4c-5ec8-426f-9490-850fe7f1abae tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)
Aug 26 10:22:08 user nova-compute[73572]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f3a153b-1b99-4297-ad26-ea58f33330b8 (non-flash)
Aug 26 10:22:08 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 10:22:08 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfba6f7b-c2ae-436e-8d48-681432c17790 -p 172.16.0.220:3260 --login {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:22:08 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfba6f7b-c2ae-436e-8d48-681432c17790 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:22:08 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[85092e08-8549-4265-b01a-846c61441603]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cfba6f7b-c2ae-436e-8d48-681432c17790, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cfba6f7b-c2ae-436e-8d48-681432c17790, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:22:08 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e62dd4c-5ec8-426f-9490-850fe7f1abae tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cfba6f7b-c2ae-436e-8d48-681432c17790, portal: 172.16.0.220,3260]
Aug 26 10:22:08 user nova-compute[73572]: Login to [iface: default, target: iqn.2010-10.org.openstack:cfba6f7b-c2ae-436e-8d48-681432c17790, portal: 172.16.0.220,3260] successful.
Aug 26 10:22:08 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:22:08 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfba6f7b-c2ae-436e-8d48-681432c17790 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:22:08 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfba6f7b-c2ae-436e-8d48-681432c17790 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:22:08 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c15869b-154d-45a1-b967-649bb2944b6f]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:22:08 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e62dd4c-5ec8-426f-9490-850fe7f1abae tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:22:08 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:22:08 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:22:08 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73572) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 26 10:22:08 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:22:08 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[90444385-27e3-45c2-8e82-a838472bf9b5]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f3a153b-1b99-4297-ad26-ea58f33330b8 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfba6f7b-c2ae-436e-8d48-681432c17790 (non-flash)\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:22:08 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e62dd4c-5ec8-426f-9490-850fe7f1abae tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)
Aug 26 10:22:08 user nova-compute[73572]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f3a153b-1b99-4297-ad26-ea58f33330b8 (non-flash)
Aug 26 10:22:08 user nova-compute[73572]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfba6f7b-c2ae-436e-8d48-681432c17790 (non-flash)
Aug 26 10:22:08 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 10:22:08 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e62dd4c-5ec8-426f-9490-850fe7f1abae tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)
Aug 26 10:22:08 user nova-compute[73572]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f3a153b-1b99-4297-ad26-ea58f33330b8 (non-flash)
Aug 26 10:22:08 user nova-compute[73572]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfba6f7b-c2ae-436e-8d48-681432c17790 (non-flash)
Aug 26 10:22:08 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 10:22:08 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-5e62dd4c-5ec8-426f-9490-850fe7f1abae tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cfba6f7b-c2ae-436e-8d48-681432c17790" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.307s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 10:22:08 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e62dd4c-5ec8-426f-9490-850fe7f1abae tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Connected to 172.16.0.220:3260 {{(pid=73572) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 10:22:08 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-5e62dd4c-5ec8-426f-9490-850fe7f1abae tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] HCTL ('34', '-', '-', 0) found on session 31 with lun 0 {{(pid=73572) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 10:22:08 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-5e62dd4c-5ec8-426f-9490-850fe7f1abae tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73572) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 10:22:08 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:22:08 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.021s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:22:08 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[98431ad4-841b-4e45-8a26-e0d0e0fe2f38]: (4, ('- - 0', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:22:08 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-5e62dd4c-5ec8-426f-9490-850fe7f1abae tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Searching for a device in session 31 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73572) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 10:22:08 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e62dd4c-5ec8-426f-9490-850fe7f1abae tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VmAriJSx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73572) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 10:22:09 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-5e62dd4c-5ec8-426f-9490-850fe7f1abae tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.342s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 10:22:09 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e62dd4c-5ec8-426f-9490-850fe7f1abae tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] <== connect_volume: return (1344ms) {'type': 'block', 'scsi_wwn': '23633616633633765', 'path': '/dev/sdc'} {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 10:22:09 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e62dd4c-5ec8-426f-9490-850fe7f1abae tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] [instance: 693f562f-ae3d-4cfb-926e-9990a1a301cb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23633616633633765', 'path': '/dev/sdc'} {{(pid=73572) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 10:22:09 user nova-compute[73572]: DEBUG nova.objects.instance [None req-5e62dd4c-5ec8-426f-9490-850fe7f1abae tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Lazy-loading 'flavor' on Instance uuid 693f562f-ae3d-4cfb-926e-9990a1a301cb {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:22:09 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:22:10 user nova-compute[73572]: DEBUG nova.virt.libvirt.guest [None req-5e62dd4c-5ec8-426f-9490-850fe7f1abae tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 10:22:10 user nova-compute[73572]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 10:22:10 user nova-compute[73572]:   <source dev="/dev/sdc"/>
Aug 26 10:22:10 user nova-compute[73572]:   <target dev="vdb" bus="virtio"/>
Aug 26 10:22:10 user nova-compute[73572]:   <serial>cfba6f7b-c2ae-436e-8d48-681432c17790</serial>
Aug 26 10:22:10 user nova-compute[73572]: </disk>
Aug 26 10:22:10 user nova-compute[73572]:  {{(pid=73572) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 10:22:10 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:22:10 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-5e62dd4c-5ec8-426f-9490-850fe7f1abae tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] No BDM found with device name vda, not building metadata. {{(pid=73572) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 10:22:10 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-5e62dd4c-5ec8-426f-9490-850fe7f1abae tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73572) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 10:22:10 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-5e62dd4c-5ec8-426f-9490-850fe7f1abae tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] No VIF found with MAC fa:16:3e:f7:66:5e, not building metadata {{(pid=73572) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 10:22:10 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-5e62dd4c-5ec8-426f-9490-850fe7f1abae tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Lock "693f562f-ae3d-4cfb-926e-9990a1a301cb" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 15.305s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:22:10 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:22:10 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Starting heal instance info cache {{(pid=73572) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 10:22:10 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquiring lock "refresh_cache-d2970584-8c2a-4f99-922c-d66d59489504" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:22:10 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquired lock "refresh_cache-d2970584-8c2a-4f99-922c-d66d59489504" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:22:10 user nova-compute[73572]: DEBUG nova.network.neutron [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] [instance: d2970584-8c2a-4f99-922c-d66d59489504] Forcefully refreshing network info cache for instance {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 10:22:11 user nova-compute[73572]: DEBUG nova.network.neutron [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] [instance: d2970584-8c2a-4f99-922c-d66d59489504] Updating instance_info_cache with network_info: [{"id": "754f85e2-09b3-418b-9c3f-452c88756d3a", "address": "fa:16:3e:d6:92:13", "network": {"id": "e565abb6-25f8-4f92-9cca-69db36e4216a", "bridge": "br-int", "label": "tempest-TestStampPattern-1866566708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f2be8d4c6c147e98a1b5b7443b3828d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap754f85e2-09", "ovs_interfaceid": "754f85e2-09b3-418b-9c3f-452c88756d3a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:22:12 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Releasing lock "refresh_cache-d2970584-8c2a-4f99-922c-d66d59489504" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:22:12 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] [instance: d2970584-8c2a-4f99-922c-d66d59489504] Updated the network info_cache for instance {{(pid=73572) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 10:22:13 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:22:13 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:22:13 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:22:13 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73572) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 10:22:15 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:22:15 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:22:16 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-520dbf22-91b6-44e5-ad0b-4c333d107fb2 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] [instance: 44a737bf-3704-4193-8d24-b8d132267279] Calling os-brick to attach iSCSI Volume {{(pid=73572) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 10:22:16 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-520dbf22-91b6-44e5-ad0b-4c333d107fb2 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc89c3d6a10>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:19c2d1dd-dfb9-4ac0-8341-35f96b7ade56'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AjXYIwZy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 10:22:16 user nova-compute[73572]: WARNING os_brick.initiator.connectors.base [None req-520dbf22-91b6-44e5-ad0b-4c333d107fb2 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 10:22:16 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-520dbf22-91b6-44e5-ad0b-4c333d107fb2 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 10:22:16 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-520dbf22-91b6-44e5-ad0b-4c333d107fb2 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 10:22:16 user nova-compute[73572]: WARNING os_brick.initiator.connectors.base [None req-520dbf22-91b6-44e5-ad0b-4c333d107fb2 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 10:22:16 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-520dbf22-91b6-44e5-ad0b-4c333d107fb2 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:19c2d1dd-dfb9-4ac0-8341-35f96b7ade56" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 10:22:16 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-520dbf22-91b6-44e5-ad0b-4c333d107fb2 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:19c2d1dd-dfb9-4ac0-8341-35f96b7ade56" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 10:22:16 user nova-compute[73572]: INFO os_brick.initiator.connectors.iscsi [None req-520dbf22-91b6-44e5-ad0b-4c333d107fb2 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 10:22:16 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19c2d1dd-dfb9-4ac0-8341-35f96b7ade56 -p 172.16.0.220:3260 {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:22:16 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19c2d1dd-dfb9-4ac0-8341-35f96b7ade56 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:22:16 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c0a0326-2d75-410e-ab1a-797ad8bf36e4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:22:16 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-520dbf22-91b6-44e5-ad0b-4c333d107fb2 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 10:22:16 user nova-compute[73572]:  {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:22:16 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19c2d1dd-dfb9-4ac0-8341-35f96b7ade56 -p 172.16.0.220:3260 --interface default --op new {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:22:16 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19c2d1dd-dfb9-4ac0-8341-35f96b7ade56 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:22:16 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[80383162-1cae-4116-9c81-1cbc01066e39]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:19c2d1dd-dfb9-4ac0-8341-35f96b7ade56] added\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:22:16 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-520dbf22-91b6-44e5-ad0b-4c333d107fb2 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:19c2d1dd-dfb9-4ac0-8341-35f96b7ade56] added
Aug 26 10:22:16 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:22:16 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19c2d1dd-dfb9-4ac0-8341-35f96b7ade56 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:22:16 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19c2d1dd-dfb9-4ac0-8341-35f96b7ade56 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:22:16 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c3f4076-144e-49d9-b4f8-53a8b9cb6269]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:22:16 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-520dbf22-91b6-44e5-ad0b-4c333d107fb2 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:22:16 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19c2d1dd-dfb9-4ac0-8341-35f96b7ade56 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:22:16 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19c2d1dd-dfb9-4ac0-8341-35f96b7ade56 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:22:16 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1c16507-f06c-4dff-8c51-609116468e48]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:22:16 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-520dbf22-91b6-44e5-ad0b-4c333d107fb2 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:22:16 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19c2d1dd-dfb9-4ac0-8341-35f96b7ade56 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AjXYIwZy {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:22:16 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19c2d1dd-dfb9-4ac0-8341-35f96b7ade56 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AjXYIwZy" returned: 0 in 0.021s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:22:16 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cedbbf6-9612-49ef-9a2f-7303913d1e60]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:22:16 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-520dbf22-91b6-44e5-ad0b-4c333d107fb2 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AjXYIwZy'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:22:16 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19c2d1dd-dfb9-4ac0-8341-35f96b7ade56 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:22:16 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19c2d1dd-dfb9-4ac0-8341-35f96b7ade56 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:22:16 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d19498f-a2d5-4bde-b6a9-5237a79b5f83]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:22:16 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-520dbf22-91b6-44e5-ad0b-4c333d107fb2 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:22:16 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:22:16 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:22:16 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:22:16 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb19f2f9-904e-4004-bb4b-1c313c01c72c]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f3a153b-1b99-4297-ad26-ea58f33330b8 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfba6f7b-c2ae-436e-8d48-681432c17790 (non-flash)\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:22:16 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-520dbf22-91b6-44e5-ad0b-4c333d107fb2 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)
Aug 26 10:22:16 user nova-compute[73572]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f3a153b-1b99-4297-ad26-ea58f33330b8 (non-flash)
Aug 26 10:22:16 user nova-compute[73572]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfba6f7b-c2ae-436e-8d48-681432c17790 (non-flash)
Aug 26 10:22:16 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 10:22:16 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-520dbf22-91b6-44e5-ad0b-4c333d107fb2 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)
Aug 26 10:22:16 user nova-compute[73572]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f3a153b-1b99-4297-ad26-ea58f33330b8 (non-flash)
Aug 26 10:22:16 user nova-compute[73572]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfba6f7b-c2ae-436e-8d48-681432c17790 (non-flash)
Aug 26 10:22:16 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 10:22:16 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19c2d1dd-dfb9-4ac0-8341-35f96b7ade56 -p 172.16.0.220:3260 --login {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:22:16 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19c2d1dd-dfb9-4ac0-8341-35f96b7ade56 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:22:16 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[3358e5c8-69ce-4e40-ab4b-d6a32f85eeef]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:19c2d1dd-dfb9-4ac0-8341-35f96b7ade56, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:19c2d1dd-dfb9-4ac0-8341-35f96b7ade56, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:22:16 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-520dbf22-91b6-44e5-ad0b-4c333d107fb2 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:19c2d1dd-dfb9-4ac0-8341-35f96b7ade56, portal: 172.16.0.220,3260]
Aug 26 10:22:16 user nova-compute[73572]: Login to [iface: default, target: iqn.2010-10.org.openstack:19c2d1dd-dfb9-4ac0-8341-35f96b7ade56, portal: 172.16.0.220,3260] successful.
Aug 26 10:22:16 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:22:16 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19c2d1dd-dfb9-4ac0-8341-35f96b7ade56 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:22:16 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19c2d1dd-dfb9-4ac0-8341-35f96b7ade56 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:22:16 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[68fc9946-0025-42d6-815a-0cdd5763de3c]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:22:16 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-520dbf22-91b6-44e5-ad0b-4c333d107fb2 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:22:16 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:22:16 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:22:16 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[25ef31c4-f7e1-4542-945f-6c487a6b932d]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f3a153b-1b99-4297-ad26-ea58f33330b8 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfba6f7b-c2ae-436e-8d48-681432c17790 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19c2d1dd-dfb9-4ac0-8341-35f96b7ade56 (non-flash)\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:22:16 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-520dbf22-91b6-44e5-ad0b-4c333d107fb2 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)
Aug 26 10:22:16 user nova-compute[73572]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f3a153b-1b99-4297-ad26-ea58f33330b8 (non-flash)
Aug 26 10:22:16 user nova-compute[73572]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfba6f7b-c2ae-436e-8d48-681432c17790 (non-flash)
Aug 26 10:22:16 user nova-compute[73572]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19c2d1dd-dfb9-4ac0-8341-35f96b7ade56 (non-flash)
Aug 26 10:22:16 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 10:22:16 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-520dbf22-91b6-44e5-ad0b-4c333d107fb2 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)
Aug 26 10:22:16 user nova-compute[73572]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f3a153b-1b99-4297-ad26-ea58f33330b8 (non-flash)
Aug 26 10:22:16 user nova-compute[73572]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfba6f7b-c2ae-436e-8d48-681432c17790 (non-flash)
Aug 26 10:22:16 user nova-compute[73572]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19c2d1dd-dfb9-4ac0-8341-35f96b7ade56 (non-flash)
Aug 26 10:22:16 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 10:22:16 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-520dbf22-91b6-44e5-ad0b-4c333d107fb2 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:19c2d1dd-dfb9-4ac0-8341-35f96b7ade56" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.327s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 10:22:16 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-520dbf22-91b6-44e5-ad0b-4c333d107fb2 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Connected to 172.16.0.220:3260 {{(pid=73572) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 10:22:16 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-520dbf22-91b6-44e5-ad0b-4c333d107fb2 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] HCTL ('35', '-', '-', 0) found on session 32 with lun 0 {{(pid=73572) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 10:22:16 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-520dbf22-91b6-44e5-ad0b-4c333d107fb2 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73572) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 10:22:16 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:22:16 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.020s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:22:16 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[67ed0c8b-f796-4b0f-a39b-26e32dd72b9a]: (4, ('- - 0', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:22:16 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-520dbf22-91b6-44e5-ad0b-4c333d107fb2 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Searching for a device in session 32 and hctl ['35', '*', '*', 0] yield: None {{(pid=73572) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 10:22:17 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-520dbf22-91b6-44e5-ad0b-4c333d107fb2 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Searching for a device in session 32 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73572) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 10:22:17 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-520dbf22-91b6-44e5-ad0b-4c333d107fb2 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AjXYIwZy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73572) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 10:22:17 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-520dbf22-91b6-44e5-ad0b-4c333d107fb2 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.361s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 10:22:17 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-520dbf22-91b6-44e5-ad0b-4c333d107fb2 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] <== connect_volume: return (1363ms) {'type': 'block', 'scsi_wwn': '23130393130373264', 'path': '/dev/sdd'} {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 10:22:17 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-520dbf22-91b6-44e5-ad0b-4c333d107fb2 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] [instance: 44a737bf-3704-4193-8d24-b8d132267279] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23130393130373264', 'path': '/dev/sdd'} {{(pid=73572) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 10:22:17 user nova-compute[73572]: DEBUG nova.objects.instance [None req-520dbf22-91b6-44e5-ad0b-4c333d107fb2 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Lazy-loading 'flavor' on Instance uuid 44a737bf-3704-4193-8d24-b8d132267279 {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:22:18 user nova-compute[73572]: DEBUG nova.virt.libvirt.guest [None req-520dbf22-91b6-44e5-ad0b-4c333d107fb2 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 10:22:18 user nova-compute[73572]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 10:22:18 user nova-compute[73572]:   <source dev="/dev/sdd"/>
Aug 26 10:22:18 user nova-compute[73572]:   <target dev="vdb" bus="virtio"/>
Aug 26 10:22:18 user nova-compute[73572]:   <serial>19c2d1dd-dfb9-4ac0-8341-35f96b7ade56</serial>
Aug 26 10:22:18 user nova-compute[73572]: </disk>
Aug 26 10:22:18 user nova-compute[73572]:  {{(pid=73572) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 10:22:18 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-520dbf22-91b6-44e5-ad0b-4c333d107fb2 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] No BDM found with device name vda, not building metadata. {{(pid=73572) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 10:22:18 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-520dbf22-91b6-44e5-ad0b-4c333d107fb2 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73572) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 10:22:18 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-520dbf22-91b6-44e5-ad0b-4c333d107fb2 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] No VIF found with MAC fa:16:3e:6a:ad:a7, not building metadata {{(pid=73572) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 10:22:18 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-520dbf22-91b6-44e5-ad0b-4c333d107fb2 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Lock "44a737bf-3704-4193-8d24-b8d132267279" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 19.204s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:22:18 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:22:19 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:22:20 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:22:21 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:22:22 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-d13c54a2-f011-439f-a464-c1379db44655 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Acquiring lock "1bc7408c-28d0-4735-95ef-3a03dc7a86ba" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:22:22 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-d13c54a2-f011-439f-a464-c1379db44655 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Lock "1bc7408c-28d0-4735-95ef-3a03dc7a86ba" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:22:22 user nova-compute[73572]: DEBUG nova.compute.manager [None req-d13c54a2-f011-439f-a464-c1379db44655 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] [instance: 1bc7408c-28d0-4735-95ef-3a03dc7a86ba] Starting instance... {{(pid=73572) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 10:22:22 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-d13c54a2-f011-439f-a464-c1379db44655 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:22:22 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-d13c54a2-f011-439f-a464-c1379db44655 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:22:22 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-d13c54a2-f011-439f-a464-c1379db44655 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73572) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 10:22:22 user nova-compute[73572]: INFO nova.compute.claims [None req-d13c54a2-f011-439f-a464-c1379db44655 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] [instance: 1bc7408c-28d0-4735-95ef-3a03dc7a86ba] Claim successful on node user
Aug 26 10:22:22 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:22:22 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:22:22 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:22:22 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:22:23 user nova-compute[73572]: DEBUG nova.compute.provider_tree [None req-d13c54a2-f011-439f-a464-c1379db44655 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Inventory has not changed in ProviderTree for provider: e2cec974-59b2-4c77-a53d-a7f4e5a30d75 {{(pid=73572) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 10:22:23 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-d13c54a2-f011-439f-a464-c1379db44655 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Inventory has not changed for provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73572) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 10:22:23 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-d13c54a2-f011-439f-a464-c1379db44655 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.519s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:22:23 user nova-compute[73572]: DEBUG nova.compute.manager [None req-d13c54a2-f011-439f-a464-c1379db44655 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] [instance: 1bc7408c-28d0-4735-95ef-3a03dc7a86ba] Start building networks asynchronously for instance. {{(pid=73572) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 10:22:23 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.253s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:22:23 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:22:23 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Auditing locally available compute resources for user (node: user) {{(pid=73572) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 10:22:23 user nova-compute[73572]: DEBUG nova.compute.manager [None req-d13c54a2-f011-439f-a464-c1379db44655 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] [instance: 1bc7408c-28d0-4735-95ef-3a03dc7a86ba] Allocating IP information in the background. {{(pid=73572) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 10:22:23 user nova-compute[73572]: DEBUG nova.network.neutron [None req-d13c54a2-f011-439f-a464-c1379db44655 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] [instance: 1bc7408c-28d0-4735-95ef-3a03dc7a86ba] allocate_for_instance() {{(pid=73572) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 10:22:23 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-d13c54a2-f011-439f-a464-c1379db44655 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] [instance: 1bc7408c-28d0-4735-95ef-3a03dc7a86ba] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 10:22:23 user nova-compute[73572]: DEBUG nova.compute.manager [None req-d13c54a2-f011-439f-a464-c1379db44655 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] [instance: 1bc7408c-28d0-4735-95ef-3a03dc7a86ba] Start building block device mappings for instance. {{(pid=73572) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 10:22:23 user nova-compute[73572]: DEBUG nova.policy [None req-d13c54a2-f011-439f-a464-c1379db44655 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c7cf9c8d529d49149141add20c2b2af2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47abd6293c07465389c379e3b5061164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73572) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 10:22:23 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c785b609-0068-442f-91f5-d26e888a993f/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:22:23 user nova-compute[73572]: DEBUG nova.compute.manager [None req-d13c54a2-f011-439f-a464-c1379db44655 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] [instance: 1bc7408c-28d0-4735-95ef-3a03dc7a86ba] Start spawning the instance on the hypervisor. {{(pid=73572) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 10:22:23 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-d13c54a2-f011-439f-a464-c1379db44655 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] [instance: 1bc7408c-28d0-4735-95ef-3a03dc7a86ba] Creating instance directory {{(pid=73572) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 10:22:23 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-d13c54a2-f011-439f-a464-c1379db44655 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] [instance: 1bc7408c-28d0-4735-95ef-3a03dc7a86ba] Creating image(s)
Aug 26 10:22:23 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-d13c54a2-f011-439f-a464-c1379db44655 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Acquiring lock "/opt/stack/data/nova/instances/1bc7408c-28d0-4735-95ef-3a03dc7a86ba/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:22:23 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-d13c54a2-f011-439f-a464-c1379db44655 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Lock "/opt/stack/data/nova/instances/1bc7408c-28d0-4735-95ef-3a03dc7a86ba/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:22:23 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-d13c54a2-f011-439f-a464-c1379db44655 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Lock "/opt/stack/data/nova/instances/1bc7408c-28d0-4735-95ef-3a03dc7a86ba/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:22:23 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-d13c54a2-f011-439f-a464-c1379db44655 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:22:23 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c785b609-0068-442f-91f5-d26e888a993f/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:22:23 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c785b609-0068-442f-91f5-d26e888a993f/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:22:23 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-d13c54a2-f011-439f-a464-c1379db44655 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json" returned: 0 in 0.204s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:22:23 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-d13c54a2-f011-439f-a464-c1379db44655 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Acquiring lock "2099350d6f3bcd0de9471c73862d4fe75b049801" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:22:23 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-d13c54a2-f011-439f-a464-c1379db44655 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Lock "2099350d6f3bcd0de9471c73862d4fe75b049801" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:22:23 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-d13c54a2-f011-439f-a464-c1379db44655 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:22:23 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c785b609-0068-442f-91f5-d26e888a993f/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:22:23 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e468b473-515f-41ad-a75c-65d4c6d575c8/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:22:23 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-d13c54a2-f011-439f-a464-c1379db44655 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json" returned: 0 in 0.231s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:22:23 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-d13c54a2-f011-439f-a464-c1379db44655 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801,backing_fmt=raw /opt/stack/data/nova/instances/1bc7408c-28d0-4735-95ef-3a03dc7a86ba/disk 1073741824 {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:22:23 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-d13c54a2-f011-439f-a464-c1379db44655 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801,backing_fmt=raw /opt/stack/data/nova/instances/1bc7408c-28d0-4735-95ef-3a03dc7a86ba/disk 1073741824" returned: 0 in 0.057s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:22:23 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-d13c54a2-f011-439f-a464-c1379db44655 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Lock "2099350d6f3bcd0de9471c73862d4fe75b049801" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.297s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:22:23 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-d13c54a2-f011-439f-a464-c1379db44655 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:22:23 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e468b473-515f-41ad-a75c-65d4c6d575c8/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:22:23 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e468b473-515f-41ad-a75c-65d4c6d575c8/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:22:24 user nova-compute[73572]: DEBUG nova.network.neutron [None req-d13c54a2-f011-439f-a464-c1379db44655 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] [instance: 1bc7408c-28d0-4735-95ef-3a03dc7a86ba] Successfully created port: eff78739-eebe-4f04-b3d5-debe2d15fe72 {{(pid=73572) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 10:22:24 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-d13c54a2-f011-439f-a464-c1379db44655 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json" returned: 0 in 0.236s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:22:24 user nova-compute[73572]: DEBUG nova.virt.disk.api [None req-d13c54a2-f011-439f-a464-c1379db44655 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1bc7408c-28d0-4735-95ef-3a03dc7a86ba/disk. size=1073741824 {{(pid=73572) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 10:22:24 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-d13c54a2-f011-439f-a464-c1379db44655 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bc7408c-28d0-4735-95ef-3a03dc7a86ba/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:22:24 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e468b473-515f-41ad-a75c-65d4c6d575c8/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:22:24 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44a737bf-3704-4193-8d24-b8d132267279/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:22:24 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-d13c54a2-f011-439f-a464-c1379db44655 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bc7408c-28d0-4735-95ef-3a03dc7a86ba/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:22:24 user nova-compute[73572]: DEBUG nova.virt.disk.api [None req-d13c54a2-f011-439f-a464-c1379db44655 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Cannot resize image /opt/stack/data/nova/instances/1bc7408c-28d0-4735-95ef-3a03dc7a86ba/disk to a smaller size. {{(pid=73572) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 10:22:24 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-d13c54a2-f011-439f-a464-c1379db44655 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] [instance: 1bc7408c-28d0-4735-95ef-3a03dc7a86ba] Created local disks {{(pid=73572) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 10:22:24 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-d13c54a2-f011-439f-a464-c1379db44655 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] [instance: 1bc7408c-28d0-4735-95ef-3a03dc7a86ba] Ensure instance console log exists: /opt/stack/data/nova/instances/1bc7408c-28d0-4735-95ef-3a03dc7a86ba/console.log {{(pid=73572) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 10:22:24 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-d13c54a2-f011-439f-a464-c1379db44655 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:22:24 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-d13c54a2-f011-439f-a464-c1379db44655 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:22:24 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-d13c54a2-f011-439f-a464-c1379db44655 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:22:24 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44a737bf-3704-4193-8d24-b8d132267279/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:22:24 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44a737bf-3704-4193-8d24-b8d132267279/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:22:24 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44a737bf-3704-4193-8d24-b8d132267279/disk --force-share --output=json" returned: 0 in 0.253s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:22:24 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=73572) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 10:22:24 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/693f562f-ae3d-4cfb-926e-9990a1a301cb/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:22:24 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/693f562f-ae3d-4cfb-926e-9990a1a301cb/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:22:24 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/693f562f-ae3d-4cfb-926e-9990a1a301cb/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:22:24 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:22:25 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/693f562f-ae3d-4cfb-926e-9990a1a301cb/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:22:25 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73572) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 10:22:25 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00c47a06-2bf8-427d-bcb1-304688584511/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:22:25 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:22:25 user nova-compute[73572]: DEBUG nova.network.neutron [None req-d13c54a2-f011-439f-a464-c1379db44655 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] [instance: 1bc7408c-28d0-4735-95ef-3a03dc7a86ba] Successfully updated port: eff78739-eebe-4f04-b3d5-debe2d15fe72 {{(pid=73572) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 10:22:25 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-d13c54a2-f011-439f-a464-c1379db44655 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Acquiring lock "refresh_cache-1bc7408c-28d0-4735-95ef-3a03dc7a86ba" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:22:25 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-d13c54a2-f011-439f-a464-c1379db44655 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Acquired lock "refresh_cache-1bc7408c-28d0-4735-95ef-3a03dc7a86ba" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:22:25 user nova-compute[73572]: DEBUG nova.network.neutron [None req-d13c54a2-f011-439f-a464-c1379db44655 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] [instance: 1bc7408c-28d0-4735-95ef-3a03dc7a86ba] Building network info cache for instance {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 10:22:25 user nova-compute[73572]: DEBUG nova.compute.manager [req-93fa7ef7-f9d3-48cc-a8a0-2328392b25c3 req-d0b6b470-59d5-4581-b43e-beeae00c1fa6 service nova] [instance: 1bc7408c-28d0-4735-95ef-3a03dc7a86ba] Received event network-changed-eff78739-eebe-4f04-b3d5-debe2d15fe72 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:22:25 user nova-compute[73572]: DEBUG nova.compute.manager [req-93fa7ef7-f9d3-48cc-a8a0-2328392b25c3 req-d0b6b470-59d5-4581-b43e-beeae00c1fa6 service nova] [instance: 1bc7408c-28d0-4735-95ef-3a03dc7a86ba] Refreshing instance network info cache due to event network-changed-eff78739-eebe-4f04-b3d5-debe2d15fe72. {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 10:22:25 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-93fa7ef7-f9d3-48cc-a8a0-2328392b25c3 req-d0b6b470-59d5-4581-b43e-beeae00c1fa6 service nova] Acquiring lock "refresh_cache-1bc7408c-28d0-4735-95ef-3a03dc7a86ba" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:22:25 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00c47a06-2bf8-427d-bcb1-304688584511/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:22:25 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00c47a06-2bf8-427d-bcb1-304688584511/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:22:25 user nova-compute[73572]: DEBUG nova.network.neutron [None req-d13c54a2-f011-439f-a464-c1379db44655 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] [instance: 1bc7408c-28d0-4735-95ef-3a03dc7a86ba] Instance cache missing network info. {{(pid=73572) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 10:22:25 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00c47a06-2bf8-427d-bcb1-304688584511/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:22:25 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86923c1a-89a5-4e7a-b488-8bf3a013bf83/disk.rescue --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:22:25 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86923c1a-89a5-4e7a-b488-8bf3a013bf83/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:22:25 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86923c1a-89a5-4e7a-b488-8bf3a013bf83/disk.rescue --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:22:25 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86923c1a-89a5-4e7a-b488-8bf3a013bf83/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:22:25 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86923c1a-89a5-4e7a-b488-8bf3a013bf83/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:22:25 user nova-compute[73572]: DEBUG nova.network.neutron [None req-d13c54a2-f011-439f-a464-c1379db44655 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] [instance: 1bc7408c-28d0-4735-95ef-3a03dc7a86ba] Updating instance_info_cache with network_info: [{"id": "eff78739-eebe-4f04-b3d5-debe2d15fe72", "address": "fa:16:3e:9c:b2:e4", "network": {"id": "880aa066-8f77-469b-a0c4-e4e94ae31e1a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-313654920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47abd6293c07465389c379e3b5061164", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeff78739-ee", "ovs_interfaceid": "eff78739-eebe-4f04-b3d5-debe2d15fe72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:22:25 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-d13c54a2-f011-439f-a464-c1379db44655 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Releasing lock "refresh_cache-1bc7408c-28d0-4735-95ef-3a03dc7a86ba" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:22:25 user nova-compute[73572]: DEBUG nova.compute.manager [None req-d13c54a2-f011-439f-a464-c1379db44655 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] [instance: 1bc7408c-28d0-4735-95ef-3a03dc7a86ba] Instance network_info: |[{"id": "eff78739-eebe-4f04-b3d5-debe2d15fe72", "address": "fa:16:3e:9c:b2:e4", "network": {"id": "880aa066-8f77-469b-a0c4-e4e94ae31e1a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-313654920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47abd6293c07465389c379e3b5061164", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeff78739-ee", "ovs_interfaceid": "eff78739-eebe-4f04-b3d5-debe2d15fe72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73572) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 10:22:25 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-93fa7ef7-f9d3-48cc-a8a0-2328392b25c3 req-d0b6b470-59d5-4581-b43e-beeae00c1fa6 service nova] Acquired lock "refresh_cache-1bc7408c-28d0-4735-95ef-3a03dc7a86ba" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:22:25 user nova-compute[73572]: DEBUG nova.network.neutron [req-93fa7ef7-f9d3-48cc-a8a0-2328392b25c3 req-d0b6b470-59d5-4581-b43e-beeae00c1fa6 service nova] [instance: 1bc7408c-28d0-4735-95ef-3a03dc7a86ba] Refreshing network info cache for port eff78739-eebe-4f04-b3d5-debe2d15fe72 {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 10:22:25 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-d13c54a2-f011-439f-a464-c1379db44655 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] [instance: 1bc7408c-28d0-4735-95ef-3a03dc7a86ba] Start _get_guest_xml network_info=[{"id": "eff78739-eebe-4f04-b3d5-debe2d15fe72", "address": "fa:16:3e:9c:b2:e4", "network": {"id": "880aa066-8f77-469b-a0c4-e4e94ae31e1a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-313654920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47abd6293c07465389c379e3b5061164", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeff78739-ee", "ovs_interfaceid": "eff78739-eebe-4f04-b3d5-debe2d15fe72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T10:07:33Z,direct_url=<?>,disk_format='qcow2',id=299da0c9-e1c4-48f0-be55-fbe20dd06bc9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5c995f8bbbab4368b67a253e0df3971a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T10:07:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'guest_format': None, 'size': 0, 'encryption_format': None, 'device_type': 'disk', 'image_id': '299da0c9-e1c4-48f0-be55-fbe20dd06bc9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73572) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 10:22:25 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-d13c54a2-f011-439f-a464-c1379db44655 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:22:25 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-d13c54a2-f011-439f-a464-c1379db44655 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:22:25 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-d13c54a2-f011-439f-a464-c1379db44655 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73572) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 10:22:25 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-d13c54a2-f011-439f-a464-c1379db44655 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] CPU controller missing on host. {{(pid=73572) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 10:22:25 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-d13c54a2-f011-439f-a464-c1379db44655 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73572) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 10:22:25 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-d13c54a2-f011-439f-a464-c1379db44655 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] CPU controller found on host. {{(pid=73572) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 10:22:25 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-d13c54a2-f011-439f-a464-c1379db44655 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73572) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 10:22:25 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-d13c54a2-f011-439f-a464-c1379db44655 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T10:07:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T10:07:33Z,direct_url=<?>,disk_format='qcow2',id=299da0c9-e1c4-48f0-be55-fbe20dd06bc9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5c995f8bbbab4368b67a253e0df3971a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T10:07:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 10:22:25 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-d13c54a2-f011-439f-a464-c1379db44655 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Flavor limits 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 10:22:25 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-d13c54a2-f011-439f-a464-c1379db44655 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Image limits 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 10:22:25 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-d13c54a2-f011-439f-a464-c1379db44655 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Flavor pref 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 10:22:25 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-d13c54a2-f011-439f-a464-c1379db44655 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Image pref 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 10:22:25 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-d13c54a2-f011-439f-a464-c1379db44655 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 10:22:25 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-d13c54a2-f011-439f-a464-c1379db44655 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 10:22:25 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-d13c54a2-f011-439f-a464-c1379db44655 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73572) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 10:22:25 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-d13c54a2-f011-439f-a464-c1379db44655 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Got 1 possible topologies {{(pid=73572) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 10:22:25 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-d13c54a2-f011-439f-a464-c1379db44655 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 10:22:25 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-d13c54a2-f011-439f-a464-c1379db44655 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 10:22:25 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-d13c54a2-f011-439f-a464-c1379db44655 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T10:22:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-414197323',display_name='tempest-AttachVolumeNegativeTest-server-414197323',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-414197323',id=30,image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCpWEbpQmu2jjkg5ttIV0hup2/h6V2MvCmqHw+R0njQupXdVw7s5d0Z+CbB6J+0kGaMkX44EeE9olpA7JQ28UY6WI1/LVsf1dLg2vWBjqYOjVMHpsstE0hsWTjQ88eHaUw==',key_name='tempest-keypair-361963779',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='47abd6293c07465389c379e3b5061164',ramdisk_id='',reservation_id='r-ms3ukdd8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-608798758',owner_user_name='tempest-AttachVolumeNegativeTest-608798758-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T10:22:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c7cf9c8d529d49149141add20c2b2af2',uuid=1bc7408c-28d0-4735-95ef-3a03dc7a86ba,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eff78739-eebe-4f04-b3d5-debe2d15fe72", "address": "fa:16:3e:9c:b2:e4", "network": {"id": "880aa066-8f77-469b-a0c4-e4e94ae31e1a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-313654920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47abd6293c07465389c379e3b5061164", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeff78739-ee", "ovs_interfaceid": "eff78739-eebe-4f04-b3d5-debe2d15fe72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73572) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 10:22:25 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-d13c54a2-f011-439f-a464-c1379db44655 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Converting VIF {"id": "eff78739-eebe-4f04-b3d5-debe2d15fe72", "address": "fa:16:3e:9c:b2:e4", "network": {"id": "880aa066-8f77-469b-a0c4-e4e94ae31e1a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-313654920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47abd6293c07465389c379e3b5061164", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeff78739-ee", "ovs_interfaceid": "eff78739-eebe-4f04-b3d5-debe2d15fe72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:22:25 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-d13c54a2-f011-439f-a464-c1379db44655 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:b2:e4,bridge_name='br-int',has_traffic_filtering=True,id=eff78739-eebe-4f04-b3d5-debe2d15fe72,network=Network(880aa066-8f77-469b-a0c4-e4e94ae31e1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeff78739-ee') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:22:25 user nova-compute[73572]: DEBUG nova.objects.instance [None req-d13c54a2-f011-439f-a464-c1379db44655 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Lazy-loading 'pci_devices' on Instance uuid 1bc7408c-28d0-4735-95ef-3a03dc7a86ba {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:22:25 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86923c1a-89a5-4e7a-b488-8bf3a013bf83/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:22:26 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86923c1a-89a5-4e7a-b488-8bf3a013bf83/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:22:26 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-d13c54a2-f011-439f-a464-c1379db44655 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] [instance: 1bc7408c-28d0-4735-95ef-3a03dc7a86ba] End _get_guest_xml xml=<domain type="kvm">
Aug 26 10:22:26 user nova-compute[73572]:   <uuid>1bc7408c-28d0-4735-95ef-3a03dc7a86ba</uuid>
Aug 26 10:22:26 user nova-compute[73572]:   <name>instance-0000001e</name>
Aug 26 10:22:26 user nova-compute[73572]:   <memory>524288</memory>
Aug 26 10:22:26 user nova-compute[73572]:   <vcpu>1</vcpu>
Aug 26 10:22:26 user nova-compute[73572]:   <metadata>
Aug 26 10:22:26 user nova-compute[73572]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 10:22:26 user nova-compute[73572]:       <nova:package version="0.0.0"/>
Aug 26 10:22:26 user nova-compute[73572]:       <nova:name>tempest-AttachVolumeNegativeTest-server-414197323</nova:name>
Aug 26 10:22:26 user nova-compute[73572]:       <nova:creationTime>2023-08-26 10:22:25</nova:creationTime>
Aug 26 10:22:26 user nova-compute[73572]:       <nova:flavor name="m1.tiny">
Aug 26 10:22:26 user nova-compute[73572]:         <nova:memory>512</nova:memory>
Aug 26 10:22:26 user nova-compute[73572]:         <nova:disk>1</nova:disk>
Aug 26 10:22:26 user nova-compute[73572]:         <nova:swap>0</nova:swap>
Aug 26 10:22:26 user nova-compute[73572]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 10:22:26 user nova-compute[73572]:         <nova:vcpus>1</nova:vcpus>
Aug 26 10:22:26 user nova-compute[73572]:       </nova:flavor>
Aug 26 10:22:26 user nova-compute[73572]:       <nova:owner>
Aug 26 10:22:26 user nova-compute[73572]:         <nova:user uuid="c7cf9c8d529d49149141add20c2b2af2">tempest-AttachVolumeNegativeTest-608798758-project-member</nova:user>
Aug 26 10:22:26 user nova-compute[73572]:         <nova:project uuid="47abd6293c07465389c379e3b5061164">tempest-AttachVolumeNegativeTest-608798758</nova:project>
Aug 26 10:22:26 user nova-compute[73572]:       </nova:owner>
Aug 26 10:22:26 user nova-compute[73572]:       <nova:root type="image" uuid="299da0c9-e1c4-48f0-be55-fbe20dd06bc9"/>
Aug 26 10:22:26 user nova-compute[73572]:       <nova:ports>
Aug 26 10:22:26 user nova-compute[73572]:         <nova:port uuid="eff78739-eebe-4f04-b3d5-debe2d15fe72">
Aug 26 10:22:26 user nova-compute[73572]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 26 10:22:26 user nova-compute[73572]:         </nova:port>
Aug 26 10:22:26 user nova-compute[73572]:       </nova:ports>
Aug 26 10:22:26 user nova-compute[73572]:     </nova:instance>
Aug 26 10:22:26 user nova-compute[73572]:   </metadata>
Aug 26 10:22:26 user nova-compute[73572]:   <sysinfo type="smbios">
Aug 26 10:22:26 user nova-compute[73572]:     <system>
Aug 26 10:22:26 user nova-compute[73572]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 10:22:26 user nova-compute[73572]:       <entry name="product">OpenStack Nova</entry>
Aug 26 10:22:26 user nova-compute[73572]:       <entry name="version">0.0.0</entry>
Aug 26 10:22:26 user nova-compute[73572]:       <entry name="serial">1bc7408c-28d0-4735-95ef-3a03dc7a86ba</entry>
Aug 26 10:22:26 user nova-compute[73572]:       <entry name="uuid">1bc7408c-28d0-4735-95ef-3a03dc7a86ba</entry>
Aug 26 10:22:26 user nova-compute[73572]:       <entry name="family">Virtual Machine</entry>
Aug 26 10:22:26 user nova-compute[73572]:     </system>
Aug 26 10:22:26 user nova-compute[73572]:   </sysinfo>
Aug 26 10:22:26 user nova-compute[73572]:   <os>
Aug 26 10:22:26 user nova-compute[73572]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 10:22:26 user nova-compute[73572]:     <boot dev="hd"/>
Aug 26 10:22:26 user nova-compute[73572]:     <smbios mode="sysinfo"/>
Aug 26 10:22:26 user nova-compute[73572]:   </os>
Aug 26 10:22:26 user nova-compute[73572]:   <features>
Aug 26 10:22:26 user nova-compute[73572]:     <acpi/>
Aug 26 10:22:26 user nova-compute[73572]:     <apic/>
Aug 26 10:22:26 user nova-compute[73572]:     <vmcoreinfo/>
Aug 26 10:22:26 user nova-compute[73572]:   </features>
Aug 26 10:22:26 user nova-compute[73572]:   <clock offset="utc">
Aug 26 10:22:26 user nova-compute[73572]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 10:22:26 user nova-compute[73572]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 10:22:26 user nova-compute[73572]:     <timer name="hpet" present="no"/>
Aug 26 10:22:26 user nova-compute[73572]:   </clock>
Aug 26 10:22:26 user nova-compute[73572]:   <cpu mode="custom" match="exact">
Aug 26 10:22:26 user nova-compute[73572]:     <model>Nehalem</model>
Aug 26 10:22:26 user nova-compute[73572]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 10:22:26 user nova-compute[73572]:   </cpu>
Aug 26 10:22:26 user nova-compute[73572]:   <devices>
Aug 26 10:22:26 user nova-compute[73572]:     <disk type="file" device="disk">
Aug 26 10:22:26 user nova-compute[73572]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 10:22:26 user nova-compute[73572]:       <source file="/opt/stack/data/nova/instances/1bc7408c-28d0-4735-95ef-3a03dc7a86ba/disk"/>
Aug 26 10:22:26 user nova-compute[73572]:       <target dev="vda" bus="virtio"/>
Aug 26 10:22:26 user nova-compute[73572]:     </disk>
Aug 26 10:22:26 user nova-compute[73572]:     <interface type="ethernet">
Aug 26 10:22:26 user nova-compute[73572]:       <mac address="fa:16:3e:9c:b2:e4"/>
Aug 26 10:22:26 user nova-compute[73572]:       <model type="virtio"/>
Aug 26 10:22:26 user nova-compute[73572]:       <mtu size="1442"/>
Aug 26 10:22:26 user nova-compute[73572]:       <target dev="tapeff78739-ee"/>
Aug 26 10:22:26 user nova-compute[73572]:     </interface>
Aug 26 10:22:26 user nova-compute[73572]:     <serial type="pty">
Aug 26 10:22:26 user nova-compute[73572]:       <log file="/opt/stack/data/nova/instances/1bc7408c-28d0-4735-95ef-3a03dc7a86ba/console.log" append="off"/>
Aug 26 10:22:26 user nova-compute[73572]:     </serial>
Aug 26 10:22:26 user nova-compute[73572]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 10:22:26 user nova-compute[73572]:     <video>
Aug 26 10:22:26 user nova-compute[73572]:       <model type="virtio"/>
Aug 26 10:22:26 user nova-compute[73572]:     </video>
Aug 26 10:22:26 user nova-compute[73572]:     <rng model="virtio">
Aug 26 10:22:26 user nova-compute[73572]:       <backend model="random">/dev/urandom</backend>
Aug 26 10:22:26 user nova-compute[73572]:     </rng>
Aug 26 10:22:26 user nova-compute[73572]:     <controller type="usb" index="0" model="none"/>
Aug 26 10:22:26 user nova-compute[73572]:     <memballoon model="virtio">
Aug 26 10:22:26 user nova-compute[73572]:       <stats period="10"/>
Aug 26 10:22:26 user nova-compute[73572]:     </memballoon>
Aug 26 10:22:26 user nova-compute[73572]:   </devices>
Aug 26 10:22:26 user nova-compute[73572]: </domain>
Aug 26 10:22:26 user nova-compute[73572]:  {{(pid=73572) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 10:22:26 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-d13c54a2-f011-439f-a464-c1379db44655 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T10:22:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-414197323',display_name='tempest-AttachVolumeNegativeTest-server-414197323',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-414197323',id=30,image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCpWEbpQmu2jjkg5ttIV0hup2/h6V2MvCmqHw+R0njQupXdVw7s5d0Z+CbB6J+0kGaMkX44EeE9olpA7JQ28UY6WI1/LVsf1dLg2vWBjqYOjVMHpsstE0hsWTjQ88eHaUw==',key_name='tempest-keypair-361963779',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='47abd6293c07465389c379e3b5061164',ramdisk_id='',reservation_id='r-ms3ukdd8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-608798758',owner_user_name='tempest-AttachVolumeNegativeTest-608798758-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T10:22:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c7cf9c8d529d49149141add20c2b2af2',uuid=1bc7408c-28d0-4735-95ef-3a03dc7a86ba,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eff78739-eebe-4f04-b3d5-debe2d15fe72", "address": "fa:16:3e:9c:b2:e4", "network": {"id": "880aa066-8f77-469b-a0c4-e4e94ae31e1a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-313654920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47abd6293c07465389c379e3b5061164", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeff78739-ee", "ovs_interfaceid": "eff78739-eebe-4f04-b3d5-debe2d15fe72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 10:22:26 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-d13c54a2-f011-439f-a464-c1379db44655 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Converting VIF {"id": "eff78739-eebe-4f04-b3d5-debe2d15fe72", "address": "fa:16:3e:9c:b2:e4", "network": {"id": "880aa066-8f77-469b-a0c4-e4e94ae31e1a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-313654920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47abd6293c07465389c379e3b5061164", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeff78739-ee", "ovs_interfaceid": "eff78739-eebe-4f04-b3d5-debe2d15fe72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:22:26 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-d13c54a2-f011-439f-a464-c1379db44655 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:b2:e4,bridge_name='br-int',has_traffic_filtering=True,id=eff78739-eebe-4f04-b3d5-debe2d15fe72,network=Network(880aa066-8f77-469b-a0c4-e4e94ae31e1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeff78739-ee') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:22:26 user nova-compute[73572]: DEBUG os_vif [None req-d13c54a2-f011-439f-a464-c1379db44655 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:b2:e4,bridge_name='br-int',has_traffic_filtering=True,id=eff78739-eebe-4f04-b3d5-debe2d15fe72,network=Network(880aa066-8f77-469b-a0c4-e4e94ae31e1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeff78739-ee') {{(pid=73572) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 10:22:26 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:22:26 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:22:26 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 10:22:26 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:22:26 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapeff78739-ee, may_exist=True, interface_attrs={}) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:22:26 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapeff78739-ee, col_values=(('external_ids', {'iface-id': 'eff78739-eebe-4f04-b3d5-debe2d15fe72', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9c:b2:e4', 'vm-uuid': '1bc7408c-28d0-4735-95ef-3a03dc7a86ba'}),), if_exists=True) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:22:26 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:22:26 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:22:26 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:22:26 user nova-compute[73572]: INFO os_vif [None req-d13c54a2-f011-439f-a464-c1379db44655 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:b2:e4,bridge_name='br-int',has_traffic_filtering=True,id=eff78739-eebe-4f04-b3d5-debe2d15fe72,network=Network(880aa066-8f77-469b-a0c4-e4e94ae31e1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeff78739-ee')
Aug 26 10:22:26 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-d13c54a2-f011-439f-a464-c1379db44655 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] No BDM found with device name vda, not building metadata. {{(pid=73572) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 10:22:26 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-d13c54a2-f011-439f-a464-c1379db44655 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] No VIF found with MAC fa:16:3e:9c:b2:e4, not building metadata {{(pid=73572) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 10:22:26 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86923c1a-89a5-4e7a-b488-8bf3a013bf83/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:22:26 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=73572) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 10:22:26 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68613b1e-c45c-4fd9-834c-3630ed0f456a/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:22:26 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68613b1e-c45c-4fd9-834c-3630ed0f456a/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:22:26 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68613b1e-c45c-4fd9-834c-3630ed0f456a/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:22:26 user nova-compute[73572]: DEBUG nova.network.neutron [req-93fa7ef7-f9d3-48cc-a8a0-2328392b25c3 req-d0b6b470-59d5-4581-b43e-beeae00c1fa6 service nova] [instance: 1bc7408c-28d0-4735-95ef-3a03dc7a86ba] Updated VIF entry in instance network info cache for port eff78739-eebe-4f04-b3d5-debe2d15fe72. {{(pid=73572) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 10:22:26 user nova-compute[73572]: DEBUG nova.network.neutron [req-93fa7ef7-f9d3-48cc-a8a0-2328392b25c3 req-d0b6b470-59d5-4581-b43e-beeae00c1fa6 service nova] [instance: 1bc7408c-28d0-4735-95ef-3a03dc7a86ba] Updating instance_info_cache with network_info: [{"id": "eff78739-eebe-4f04-b3d5-debe2d15fe72", "address": "fa:16:3e:9c:b2:e4", "network": {"id": "880aa066-8f77-469b-a0c4-e4e94ae31e1a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-313654920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47abd6293c07465389c379e3b5061164", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeff78739-ee", "ovs_interfaceid": "eff78739-eebe-4f04-b3d5-debe2d15fe72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:22:26 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-93fa7ef7-f9d3-48cc-a8a0-2328392b25c3 req-d0b6b470-59d5-4581-b43e-beeae00c1fa6 service nova] Releasing lock "refresh_cache-1bc7408c-28d0-4735-95ef-3a03dc7a86ba" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:22:26 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68613b1e-c45c-4fd9-834c-3630ed0f456a/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:22:26 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fe47a17-4ffb-48ce-b0f6-a9b43002bd55/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:22:26 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fe47a17-4ffb-48ce-b0f6-a9b43002bd55/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:22:26 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fe47a17-4ffb-48ce-b0f6-a9b43002bd55/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:22:27 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fe47a17-4ffb-48ce-b0f6-a9b43002bd55/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:22:27 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73572) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 10:22:27 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2970584-8c2a-4f99-922c-d66d59489504/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:22:27 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2970584-8c2a-4f99-922c-d66d59489504/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:22:27 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2970584-8c2a-4f99-922c-d66d59489504/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:22:27 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2970584-8c2a-4f99-922c-d66d59489504/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:22:27 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2eaea7c2-a5c0-4950-b033-0012b5cec0ee/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:22:27 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:22:27 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:22:27 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:22:27 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:22:27 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2eaea7c2-a5c0-4950-b033-0012b5cec0ee/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:22:27 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2eaea7c2-a5c0-4950-b033-0012b5cec0ee/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:22:27 user nova-compute[73572]: DEBUG nova.compute.manager [req-3116389e-4732-47cf-962b-3bd440b0488c req-296a3cb4-c3c8-4733-b964-a4d6b8bbb767 service nova] [instance: 1bc7408c-28d0-4735-95ef-3a03dc7a86ba] Received event network-vif-plugged-eff78739-eebe-4f04-b3d5-debe2d15fe72 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:22:27 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-3116389e-4732-47cf-962b-3bd440b0488c req-296a3cb4-c3c8-4733-b964-a4d6b8bbb767 service nova] Acquiring lock "1bc7408c-28d0-4735-95ef-3a03dc7a86ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:22:27 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-3116389e-4732-47cf-962b-3bd440b0488c req-296a3cb4-c3c8-4733-b964-a4d6b8bbb767 service nova] Lock "1bc7408c-28d0-4735-95ef-3a03dc7a86ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:22:27 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-3116389e-4732-47cf-962b-3bd440b0488c req-296a3cb4-c3c8-4733-b964-a4d6b8bbb767 service nova] Lock "1bc7408c-28d0-4735-95ef-3a03dc7a86ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:22:27 user nova-compute[73572]: DEBUG nova.compute.manager [req-3116389e-4732-47cf-962b-3bd440b0488c req-296a3cb4-c3c8-4733-b964-a4d6b8bbb767 service nova] [instance: 1bc7408c-28d0-4735-95ef-3a03dc7a86ba] No waiting events found dispatching network-vif-plugged-eff78739-eebe-4f04-b3d5-debe2d15fe72 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:22:27 user nova-compute[73572]: WARNING nova.compute.manager [req-3116389e-4732-47cf-962b-3bd440b0488c req-296a3cb4-c3c8-4733-b964-a4d6b8bbb767 service nova] [instance: 1bc7408c-28d0-4735-95ef-3a03dc7a86ba] Received unexpected event network-vif-plugged-eff78739-eebe-4f04-b3d5-debe2d15fe72 for instance with vm_state building and task_state spawning.
Aug 26 10:22:27 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:22:27 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2eaea7c2-a5c0-4950-b033-0012b5cec0ee/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:22:28 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:22:28 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:22:28 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Hypervisor/Node resource view: name=user free_ram=7136MB free_disk=25.060348510742188GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=73572) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 10:22:28 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:22:28 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:22:29 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance c785b609-0068-442f-91f5-d26e888a993f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:22:29 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance 14fab12e-52be-4fe6-8777-bc7ebf3c25f1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:22:29 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance 00c47a06-2bf8-427d-bcb1-304688584511 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:22:29 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance d2970584-8c2a-4f99-922c-d66d59489504 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:22:29 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance 2eaea7c2-a5c0-4950-b033-0012b5cec0ee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:22:29 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance 86923c1a-89a5-4e7a-b488-8bf3a013bf83 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:22:29 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:22:29 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance 44a737bf-3704-4193-8d24-b8d132267279 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:22:29 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance 693f562f-ae3d-4cfb-926e-9990a1a301cb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:22:29 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance e468b473-515f-41ad-a75c-65d4c6d575c8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:22:29 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance 68613b1e-c45c-4fd9-834c-3630ed0f456a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:22:29 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance 1bc7408c-28d0-4735-95ef-3a03dc7a86ba actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:22:29 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=73572) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 10:22:29 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=73572) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 10:22:29 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Refreshing inventories for resource provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 {{(pid=73572) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 26 10:22:29 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Updating ProviderTree inventory for provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73572) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 26 10:22:29 user nova-compute[73572]: DEBUG nova.compute.provider_tree [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Updating inventory in ProviderTree for provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73572) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 26 10:22:29 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Refreshing aggregate associations for resource provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75, aggregates: None {{(pid=73572) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 26 10:22:29 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Refreshing trait associations for resource provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75, traits: COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSSE3,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE2,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NODE,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_NE2K_PCI {{(pid=73572) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 26 10:22:29 user nova-compute[73572]: DEBUG nova.compute.provider_tree [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Inventory has not changed in ProviderTree for provider: e2cec974-59b2-4c77-a53d-a7f4e5a30d75 {{(pid=73572) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 10:22:29 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Inventory has not changed for provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73572) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 10:22:29 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Compute_service record updated for user:user {{(pid=73572) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 10:22:29 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.993s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:22:29 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:22:29 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Cleaning up deleted instances {{(pid=73572) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 26 10:22:29 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] There are 0 instances to clean {{(pid=73572) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 26 10:22:29 user nova-compute[73572]: DEBUG nova.compute.manager [req-78aaec16-511e-4098-a302-65eb25df08b8 req-72b4c5cd-f745-4e6d-8192-a2a885df68f2 service nova] [instance: 1bc7408c-28d0-4735-95ef-3a03dc7a86ba] Received event network-vif-plugged-eff78739-eebe-4f04-b3d5-debe2d15fe72 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:22:29 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-78aaec16-511e-4098-a302-65eb25df08b8 req-72b4c5cd-f745-4e6d-8192-a2a885df68f2 service nova] Acquiring lock "1bc7408c-28d0-4735-95ef-3a03dc7a86ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:22:29 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-78aaec16-511e-4098-a302-65eb25df08b8 req-72b4c5cd-f745-4e6d-8192-a2a885df68f2 service nova] Lock "1bc7408c-28d0-4735-95ef-3a03dc7a86ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:22:29 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-78aaec16-511e-4098-a302-65eb25df08b8 req-72b4c5cd-f745-4e6d-8192-a2a885df68f2 service nova] Lock "1bc7408c-28d0-4735-95ef-3a03dc7a86ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:22:29 user nova-compute[73572]: DEBUG nova.compute.manager [req-78aaec16-511e-4098-a302-65eb25df08b8 req-72b4c5cd-f745-4e6d-8192-a2a885df68f2 service nova] [instance: 1bc7408c-28d0-4735-95ef-3a03dc7a86ba] No waiting events found dispatching network-vif-plugged-eff78739-eebe-4f04-b3d5-debe2d15fe72 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:22:29 user nova-compute[73572]: WARNING nova.compute.manager [req-78aaec16-511e-4098-a302-65eb25df08b8 req-72b4c5cd-f745-4e6d-8192-a2a885df68f2 service nova] [instance: 1bc7408c-28d0-4735-95ef-3a03dc7a86ba] Received unexpected event network-vif-plugged-eff78739-eebe-4f04-b3d5-debe2d15fe72 for instance with vm_state building and task_state spawning.
Aug 26 10:22:29 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:22:30 user nova-compute[73572]: DEBUG nova.virt.driver [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Emitting event <LifecycleEvent: 1693045350.0821667, 1bc7408c-28d0-4735-95ef-3a03dc7a86ba => Resumed> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:22:30 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 1bc7408c-28d0-4735-95ef-3a03dc7a86ba] VM Resumed (Lifecycle Event)
Aug 26 10:22:30 user nova-compute[73572]: DEBUG nova.compute.manager [None req-d13c54a2-f011-439f-a464-c1379db44655 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] [instance: 1bc7408c-28d0-4735-95ef-3a03dc7a86ba] Instance event wait completed in 0 seconds for  {{(pid=73572) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 10:22:30 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-d13c54a2-f011-439f-a464-c1379db44655 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] [instance: 1bc7408c-28d0-4735-95ef-3a03dc7a86ba] Guest created on hypervisor {{(pid=73572) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 10:22:30 user nova-compute[73572]: INFO nova.virt.libvirt.driver [-] [instance: 1bc7408c-28d0-4735-95ef-3a03dc7a86ba] Instance spawned successfully.
Aug 26 10:22:30 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-d13c54a2-f011-439f-a464-c1379db44655 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] [instance: 1bc7408c-28d0-4735-95ef-3a03dc7a86ba] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 10:22:30 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 1bc7408c-28d0-4735-95ef-3a03dc7a86ba] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:22:30 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 1bc7408c-28d0-4735-95ef-3a03dc7a86ba] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73572) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 10:22:30 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-d13c54a2-f011-439f-a464-c1379db44655 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] [instance: 1bc7408c-28d0-4735-95ef-3a03dc7a86ba] Found default for hw_cdrom_bus of ide {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:22:30 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-d13c54a2-f011-439f-a464-c1379db44655 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] [instance: 1bc7408c-28d0-4735-95ef-3a03dc7a86ba] Found default for hw_disk_bus of virtio {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:22:30 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-d13c54a2-f011-439f-a464-c1379db44655 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] [instance: 1bc7408c-28d0-4735-95ef-3a03dc7a86ba] Found default for hw_input_bus of None {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:22:30 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-d13c54a2-f011-439f-a464-c1379db44655 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] [instance: 1bc7408c-28d0-4735-95ef-3a03dc7a86ba] Found default for hw_pointer_model of None {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:22:30 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-d13c54a2-f011-439f-a464-c1379db44655 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] [instance: 1bc7408c-28d0-4735-95ef-3a03dc7a86ba] Found default for hw_video_model of virtio {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:22:30 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-d13c54a2-f011-439f-a464-c1379db44655 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] [instance: 1bc7408c-28d0-4735-95ef-3a03dc7a86ba] Found default for hw_vif_model of virtio {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:22:30 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 1bc7408c-28d0-4735-95ef-3a03dc7a86ba] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 10:22:30 user nova-compute[73572]: DEBUG nova.virt.driver [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Emitting event <LifecycleEvent: 1693045350.0842323, 1bc7408c-28d0-4735-95ef-3a03dc7a86ba => Started> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:22:30 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 1bc7408c-28d0-4735-95ef-3a03dc7a86ba] VM Started (Lifecycle Event)
Aug 26 10:22:30 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 1bc7408c-28d0-4735-95ef-3a03dc7a86ba] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:22:30 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 1bc7408c-28d0-4735-95ef-3a03dc7a86ba] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73572) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 10:22:30 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 1bc7408c-28d0-4735-95ef-3a03dc7a86ba] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 10:22:30 user nova-compute[73572]: INFO nova.compute.manager [None req-d13c54a2-f011-439f-a464-c1379db44655 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] [instance: 1bc7408c-28d0-4735-95ef-3a03dc7a86ba] Took 6.98 seconds to spawn the instance on the hypervisor.
Aug 26 10:22:30 user nova-compute[73572]: DEBUG nova.compute.manager [None req-d13c54a2-f011-439f-a464-c1379db44655 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] [instance: 1bc7408c-28d0-4735-95ef-3a03dc7a86ba] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:22:30 user nova-compute[73572]: INFO nova.compute.manager [None req-d13c54a2-f011-439f-a464-c1379db44655 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] [instance: 1bc7408c-28d0-4735-95ef-3a03dc7a86ba] Took 7.86 seconds to build instance.
Aug 26 10:22:30 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-d13c54a2-f011-439f-a464-c1379db44655 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Lock "1bc7408c-28d0-4735-95ef-3a03dc7a86ba" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.972s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:22:31 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:22:35 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:22:36 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:22:38 user nova-compute[73572]: DEBUG nova.compute.manager [None req-36938931-1bbf-4d21-afa9-7c1b6165cc12 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: e468b473-515f-41ad-a75c-65d4c6d575c8] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:22:38 user nova-compute[73572]: INFO nova.compute.manager [None req-36938931-1bbf-4d21-afa9-7c1b6165cc12 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: e468b473-515f-41ad-a75c-65d4c6d575c8] instance snapshotting
Aug 26 10:22:38 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-36938931-1bbf-4d21-afa9-7c1b6165cc12 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: e468b473-515f-41ad-a75c-65d4c6d575c8] Beginning live snapshot process
Aug 26 10:22:38 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-36938931-1bbf-4d21-afa9-7c1b6165cc12 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e468b473-515f-41ad-a75c-65d4c6d575c8/disk --force-share --output=json -f qcow2 {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:22:39 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-36938931-1bbf-4d21-afa9-7c1b6165cc12 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e468b473-515f-41ad-a75c-65d4c6d575c8/disk --force-share --output=json -f qcow2" returned: 0 in 0.270s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:22:39 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-36938931-1bbf-4d21-afa9-7c1b6165cc12 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e468b473-515f-41ad-a75c-65d4c6d575c8/disk --force-share --output=json -f qcow2 {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:22:39 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-36938931-1bbf-4d21-afa9-7c1b6165cc12 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e468b473-515f-41ad-a75c-65d4c6d575c8/disk --force-share --output=json -f qcow2" returned: 0 in 0.206s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:22:39 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-36938931-1bbf-4d21-afa9-7c1b6165cc12 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:22:39 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-36938931-1bbf-4d21-afa9-7c1b6165cc12 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json" returned: 0 in 0.253s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:22:39 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-36938931-1bbf-4d21-afa9-7c1b6165cc12 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpxzmsccbh/034b32b3fce4448fb1d7f80af5348feb.delta 1073741824 {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:22:39 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-36938931-1bbf-4d21-afa9-7c1b6165cc12 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpxzmsccbh/034b32b3fce4448fb1d7f80af5348feb.delta 1073741824" returned: 0 in 0.052s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:22:39 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-36938931-1bbf-4d21-afa9-7c1b6165cc12 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: e468b473-515f-41ad-a75c-65d4c6d575c8] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 26 10:22:40 user nova-compute[73572]: DEBUG nova.virt.libvirt.guest [None req-36938931-1bbf-4d21-afa9-7c1b6165cc12 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=73572) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 10:22:40 user nova-compute[73572]: DEBUG nova.virt.libvirt.guest [None req-36938931-1bbf-4d21-afa9-7c1b6165cc12 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] COPY block job progress, current cursor: 27525120 final cursor: 75497472 {{(pid=73572) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 10:22:41 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:22:41 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-40295a97-f610-4eb3-83f3-6d5660e85120 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Acquiring lock "1f3db0fa-682c-4b33-966b-9e50b7349b6e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:22:41 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-40295a97-f610-4eb3-83f3-6d5660e85120 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Lock "1f3db0fa-682c-4b33-966b-9e50b7349b6e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.003s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:22:41 user nova-compute[73572]: DEBUG nova.compute.manager [None req-40295a97-f610-4eb3-83f3-6d5660e85120 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] [instance: 1f3db0fa-682c-4b33-966b-9e50b7349b6e] Starting instance... {{(pid=73572) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 10:22:41 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-40295a97-f610-4eb3-83f3-6d5660e85120 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:22:41 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-40295a97-f610-4eb3-83f3-6d5660e85120 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:22:41 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-40295a97-f610-4eb3-83f3-6d5660e85120 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73572) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 10:22:41 user nova-compute[73572]: INFO nova.compute.claims [None req-40295a97-f610-4eb3-83f3-6d5660e85120 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] [instance: 1f3db0fa-682c-4b33-966b-9e50b7349b6e] Claim successful on node user
Aug 26 10:22:41 user nova-compute[73572]: DEBUG nova.virt.libvirt.guest [None req-36938931-1bbf-4d21-afa9-7c1b6165cc12 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=73572) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 10:22:41 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-36938931-1bbf-4d21-afa9-7c1b6165cc12 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: e468b473-515f-41ad-a75c-65d4c6d575c8] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 26 10:22:41 user nova-compute[73572]: DEBUG nova.privsep.utils [None req-36938931-1bbf-4d21-afa9-7c1b6165cc12 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73572) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 26 10:22:41 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-36938931-1bbf-4d21-afa9-7c1b6165cc12 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpxzmsccbh/034b32b3fce4448fb1d7f80af5348feb.delta /opt/stack/data/nova/instances/snapshots/tmpxzmsccbh/034b32b3fce4448fb1d7f80af5348feb {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:22:41 user nova-compute[73572]: DEBUG nova.compute.provider_tree [None req-40295a97-f610-4eb3-83f3-6d5660e85120 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Inventory has not changed in ProviderTree for provider: e2cec974-59b2-4c77-a53d-a7f4e5a30d75 {{(pid=73572) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 10:22:41 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-40295a97-f610-4eb3-83f3-6d5660e85120 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Inventory has not changed for provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73572) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 10:22:42 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-40295a97-f610-4eb3-83f3-6d5660e85120 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.805s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:22:42 user nova-compute[73572]: DEBUG nova.compute.manager [None req-40295a97-f610-4eb3-83f3-6d5660e85120 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] [instance: 1f3db0fa-682c-4b33-966b-9e50b7349b6e] Start building networks asynchronously for instance. {{(pid=73572) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 10:22:42 user nova-compute[73572]: DEBUG nova.compute.manager [None req-40295a97-f610-4eb3-83f3-6d5660e85120 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] [instance: 1f3db0fa-682c-4b33-966b-9e50b7349b6e] Allocating IP information in the background. {{(pid=73572) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 10:22:42 user nova-compute[73572]: DEBUG nova.network.neutron [None req-40295a97-f610-4eb3-83f3-6d5660e85120 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] [instance: 1f3db0fa-682c-4b33-966b-9e50b7349b6e] allocate_for_instance() {{(pid=73572) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 10:22:42 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-40295a97-f610-4eb3-83f3-6d5660e85120 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] [instance: 1f3db0fa-682c-4b33-966b-9e50b7349b6e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 10:22:42 user nova-compute[73572]: DEBUG nova.policy [None req-40295a97-f610-4eb3-83f3-6d5660e85120 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a354eb6764fd4c95a53b8962544bc49b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb6ef2597eac461f959a568abd3031ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73572) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 10:22:42 user nova-compute[73572]: DEBUG nova.compute.manager [None req-40295a97-f610-4eb3-83f3-6d5660e85120 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] [instance: 1f3db0fa-682c-4b33-966b-9e50b7349b6e] Start building block device mappings for instance. {{(pid=73572) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 10:22:42 user nova-compute[73572]: DEBUG nova.compute.manager [None req-40295a97-f610-4eb3-83f3-6d5660e85120 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] [instance: 1f3db0fa-682c-4b33-966b-9e50b7349b6e] Start spawning the instance on the hypervisor. {{(pid=73572) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 10:22:42 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-40295a97-f610-4eb3-83f3-6d5660e85120 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] [instance: 1f3db0fa-682c-4b33-966b-9e50b7349b6e] Creating instance directory {{(pid=73572) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 10:22:42 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-40295a97-f610-4eb3-83f3-6d5660e85120 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] [instance: 1f3db0fa-682c-4b33-966b-9e50b7349b6e] Creating image(s)
Aug 26 10:22:42 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-40295a97-f610-4eb3-83f3-6d5660e85120 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Acquiring lock "/opt/stack/data/nova/instances/1f3db0fa-682c-4b33-966b-9e50b7349b6e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:22:42 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-40295a97-f610-4eb3-83f3-6d5660e85120 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Lock "/opt/stack/data/nova/instances/1f3db0fa-682c-4b33-966b-9e50b7349b6e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:22:42 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-40295a97-f610-4eb3-83f3-6d5660e85120 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Lock "/opt/stack/data/nova/instances/1f3db0fa-682c-4b33-966b-9e50b7349b6e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:22:42 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-40295a97-f610-4eb3-83f3-6d5660e85120 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Acquiring lock "747d48e964c0676e8d4851cc87d91435f1032515" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:22:42 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-40295a97-f610-4eb3-83f3-6d5660e85120 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Lock "747d48e964c0676e8d4851cc87d91435f1032515" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:22:42 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-36938931-1bbf-4d21-afa9-7c1b6165cc12 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpxzmsccbh/034b32b3fce4448fb1d7f80af5348feb.delta /opt/stack/data/nova/instances/snapshots/tmpxzmsccbh/034b32b3fce4448fb1d7f80af5348feb" returned: 0 in 1.111s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:22:42 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-36938931-1bbf-4d21-afa9-7c1b6165cc12 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: e468b473-515f-41ad-a75c-65d4c6d575c8] Snapshot extracted, beginning image upload
Aug 26 10:22:43 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-40295a97-f610-4eb3-83f3-6d5660e85120 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/747d48e964c0676e8d4851cc87d91435f1032515.part --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:22:43 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:22:43 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-40295a97-f610-4eb3-83f3-6d5660e85120 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/747d48e964c0676e8d4851cc87d91435f1032515.part --force-share --output=json" returned: 0 in 0.218s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:22:43 user nova-compute[73572]: DEBUG nova.virt.images [None req-40295a97-f610-4eb3-83f3-6d5660e85120 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] 7dc1b5c8-da80-43d5-a885-7f3a806c5633 was qcow2, converting to raw {{(pid=73572) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 26 10:22:43 user nova-compute[73572]: DEBUG nova.privsep.utils [None req-40295a97-f610-4eb3-83f3-6d5660e85120 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73572) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 26 10:22:43 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-40295a97-f610-4eb3-83f3-6d5660e85120 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/747d48e964c0676e8d4851cc87d91435f1032515.part /opt/stack/data/nova/instances/_base/747d48e964c0676e8d4851cc87d91435f1032515.converted {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:22:43 user nova-compute[73572]: DEBUG nova.network.neutron [None req-40295a97-f610-4eb3-83f3-6d5660e85120 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] [instance: 1f3db0fa-682c-4b33-966b-9e50b7349b6e] Successfully created port: 56789500-c8b2-4391-b245-6a2998d9fb6c {{(pid=73572) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 10:22:43 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-40295a97-f610-4eb3-83f3-6d5660e85120 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/747d48e964c0676e8d4851cc87d91435f1032515.part /opt/stack/data/nova/instances/_base/747d48e964c0676e8d4851cc87d91435f1032515.converted" returned: 0 in 0.295s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:22:43 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-40295a97-f610-4eb3-83f3-6d5660e85120 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/747d48e964c0676e8d4851cc87d91435f1032515.converted --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:22:43 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-40295a97-f610-4eb3-83f3-6d5660e85120 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/747d48e964c0676e8d4851cc87d91435f1032515.converted --force-share --output=json" returned: 0 in 0.244s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:22:43 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-40295a97-f610-4eb3-83f3-6d5660e85120 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Lock "747d48e964c0676e8d4851cc87d91435f1032515" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.322s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:22:43 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-40295a97-f610-4eb3-83f3-6d5660e85120 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/747d48e964c0676e8d4851cc87d91435f1032515 --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:22:44 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-40295a97-f610-4eb3-83f3-6d5660e85120 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/747d48e964c0676e8d4851cc87d91435f1032515 --force-share --output=json" returned: 0 in 0.196s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:22:44 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-40295a97-f610-4eb3-83f3-6d5660e85120 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Acquiring lock "747d48e964c0676e8d4851cc87d91435f1032515" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:22:44 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-40295a97-f610-4eb3-83f3-6d5660e85120 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Lock "747d48e964c0676e8d4851cc87d91435f1032515" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:22:44 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-40295a97-f610-4eb3-83f3-6d5660e85120 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/747d48e964c0676e8d4851cc87d91435f1032515 --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:22:44 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-40295a97-f610-4eb3-83f3-6d5660e85120 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/747d48e964c0676e8d4851cc87d91435f1032515 --force-share --output=json" returned: 0 in 0.230s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:22:44 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-40295a97-f610-4eb3-83f3-6d5660e85120 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/747d48e964c0676e8d4851cc87d91435f1032515,backing_fmt=raw /opt/stack/data/nova/instances/1f3db0fa-682c-4b33-966b-9e50b7349b6e/disk 1073741824 {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:22:44 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-40295a97-f610-4eb3-83f3-6d5660e85120 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/747d48e964c0676e8d4851cc87d91435f1032515,backing_fmt=raw /opt/stack/data/nova/instances/1f3db0fa-682c-4b33-966b-9e50b7349b6e/disk 1073741824" returned: 0 in 0.103s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:22:44 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-40295a97-f610-4eb3-83f3-6d5660e85120 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Lock "747d48e964c0676e8d4851cc87d91435f1032515" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.344s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:22:44 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-40295a97-f610-4eb3-83f3-6d5660e85120 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/747d48e964c0676e8d4851cc87d91435f1032515 --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:22:44 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-40295a97-f610-4eb3-83f3-6d5660e85120 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/747d48e964c0676e8d4851cc87d91435f1032515 --force-share --output=json" returned: 0 in 0.222s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:22:44 user nova-compute[73572]: DEBUG nova.virt.disk.api [None req-40295a97-f610-4eb3-83f3-6d5660e85120 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1f3db0fa-682c-4b33-966b-9e50b7349b6e/disk. size=1073741824 {{(pid=73572) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 10:22:44 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-40295a97-f610-4eb3-83f3-6d5660e85120 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f3db0fa-682c-4b33-966b-9e50b7349b6e/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:22:44 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-40295a97-f610-4eb3-83f3-6d5660e85120 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f3db0fa-682c-4b33-966b-9e50b7349b6e/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:22:44 user nova-compute[73572]: DEBUG nova.virt.disk.api [None req-40295a97-f610-4eb3-83f3-6d5660e85120 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Cannot resize image /opt/stack/data/nova/instances/1f3db0fa-682c-4b33-966b-9e50b7349b6e/disk to a smaller size. {{(pid=73572) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 10:22:44 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-40295a97-f610-4eb3-83f3-6d5660e85120 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] [instance: 1f3db0fa-682c-4b33-966b-9e50b7349b6e] Created local disks {{(pid=73572) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 10:22:44 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-40295a97-f610-4eb3-83f3-6d5660e85120 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] [instance: 1f3db0fa-682c-4b33-966b-9e50b7349b6e] Ensure instance console log exists: /opt/stack/data/nova/instances/1f3db0fa-682c-4b33-966b-9e50b7349b6e/console.log {{(pid=73572) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 10:22:44 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-40295a97-f610-4eb3-83f3-6d5660e85120 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:22:44 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-40295a97-f610-4eb3-83f3-6d5660e85120 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:22:44 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-40295a97-f610-4eb3-83f3-6d5660e85120 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:22:45 user nova-compute[73572]: DEBUG nova.network.neutron [None req-40295a97-f610-4eb3-83f3-6d5660e85120 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] [instance: 1f3db0fa-682c-4b33-966b-9e50b7349b6e] Successfully updated port: 56789500-c8b2-4391-b245-6a2998d9fb6c {{(pid=73572) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 10:22:45 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-40295a97-f610-4eb3-83f3-6d5660e85120 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Acquiring lock "refresh_cache-1f3db0fa-682c-4b33-966b-9e50b7349b6e" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:22:45 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-40295a97-f610-4eb3-83f3-6d5660e85120 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Acquired lock "refresh_cache-1f3db0fa-682c-4b33-966b-9e50b7349b6e" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:22:45 user nova-compute[73572]: DEBUG nova.network.neutron [None req-40295a97-f610-4eb3-83f3-6d5660e85120 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] [instance: 1f3db0fa-682c-4b33-966b-9e50b7349b6e] Building network info cache for instance {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 10:22:45 user nova-compute[73572]: DEBUG nova.compute.manager [req-c2299b97-e565-497f-b0b3-4c57a659f5ba req-0550bef3-3b6c-4406-9056-3e40ac2ff413 service nova] [instance: 1f3db0fa-682c-4b33-966b-9e50b7349b6e] Received event network-changed-56789500-c8b2-4391-b245-6a2998d9fb6c {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:22:45 user nova-compute[73572]: DEBUG nova.compute.manager [req-c2299b97-e565-497f-b0b3-4c57a659f5ba req-0550bef3-3b6c-4406-9056-3e40ac2ff413 service nova] [instance: 1f3db0fa-682c-4b33-966b-9e50b7349b6e] Refreshing instance network info cache due to event network-changed-56789500-c8b2-4391-b245-6a2998d9fb6c. {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 10:22:45 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-c2299b97-e565-497f-b0b3-4c57a659f5ba req-0550bef3-3b6c-4406-9056-3e40ac2ff413 service nova] Acquiring lock "refresh_cache-1f3db0fa-682c-4b33-966b-9e50b7349b6e" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:22:45 user nova-compute[73572]: DEBUG nova.network.neutron [None req-40295a97-f610-4eb3-83f3-6d5660e85120 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] [instance: 1f3db0fa-682c-4b33-966b-9e50b7349b6e] Instance cache missing network info. {{(pid=73572) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 10:22:45 user nova-compute[73572]: DEBUG nova.network.neutron [None req-40295a97-f610-4eb3-83f3-6d5660e85120 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] [instance: 1f3db0fa-682c-4b33-966b-9e50b7349b6e] Updating instance_info_cache with network_info: [{"id": "56789500-c8b2-4391-b245-6a2998d9fb6c", "address": "fa:16:3e:b8:f0:d2", "network": {"id": "2a6e27c9-9bd2-4ccb-abf6-82d85524da90", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1822065121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb6ef2597eac461f959a568abd3031ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56789500-c8", "ovs_interfaceid": "56789500-c8b2-4391-b245-6a2998d9fb6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:22:45 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-40295a97-f610-4eb3-83f3-6d5660e85120 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Releasing lock "refresh_cache-1f3db0fa-682c-4b33-966b-9e50b7349b6e" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:22:45 user nova-compute[73572]: DEBUG nova.compute.manager [None req-40295a97-f610-4eb3-83f3-6d5660e85120 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] [instance: 1f3db0fa-682c-4b33-966b-9e50b7349b6e] Instance network_info: |[{"id": "56789500-c8b2-4391-b245-6a2998d9fb6c", "address": "fa:16:3e:b8:f0:d2", "network": {"id": "2a6e27c9-9bd2-4ccb-abf6-82d85524da90", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1822065121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb6ef2597eac461f959a568abd3031ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56789500-c8", "ovs_interfaceid": "56789500-c8b2-4391-b245-6a2998d9fb6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73572) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 10:22:45 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-c2299b97-e565-497f-b0b3-4c57a659f5ba req-0550bef3-3b6c-4406-9056-3e40ac2ff413 service nova] Acquired lock "refresh_cache-1f3db0fa-682c-4b33-966b-9e50b7349b6e" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:22:45 user nova-compute[73572]: DEBUG nova.network.neutron [req-c2299b97-e565-497f-b0b3-4c57a659f5ba req-0550bef3-3b6c-4406-9056-3e40ac2ff413 service nova] [instance: 1f3db0fa-682c-4b33-966b-9e50b7349b6e] Refreshing network info cache for port 56789500-c8b2-4391-b245-6a2998d9fb6c {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 10:22:45 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-40295a97-f610-4eb3-83f3-6d5660e85120 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] [instance: 1f3db0fa-682c-4b33-966b-9e50b7349b6e] Start _get_guest_xml network_info=[{"id": "56789500-c8b2-4391-b245-6a2998d9fb6c", "address": "fa:16:3e:b8:f0:d2", "network": {"id": "2a6e27c9-9bd2-4ccb-abf6-82d85524da90", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1822065121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb6ef2597eac461f959a568abd3031ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56789500-c8", "ovs_interfaceid": "56789500-c8b2-4391-b245-6a2998d9fb6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T10:22:37Z,direct_url=<?>,disk_format='qcow2',id=7dc1b5c8-da80-43d5-a885-7f3a806c5633,min_disk=0,min_ram=0,name='tempest-scenario-img--701864016',owner='eb6ef2597eac461f959a568abd3031ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T10:22:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'guest_format': None, 'size': 0, 'encryption_format': None, 'device_type': 'disk', 'image_id': '7dc1b5c8-da80-43d5-a885-7f3a806c5633'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73572) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 10:22:45 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-40295a97-f610-4eb3-83f3-6d5660e85120 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:22:45 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-40295a97-f610-4eb3-83f3-6d5660e85120 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:22:45 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-40295a97-f610-4eb3-83f3-6d5660e85120 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73572) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 10:22:45 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-40295a97-f610-4eb3-83f3-6d5660e85120 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] CPU controller missing on host. {{(pid=73572) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 10:22:45 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-40295a97-f610-4eb3-83f3-6d5660e85120 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73572) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 10:22:45 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-40295a97-f610-4eb3-83f3-6d5660e85120 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] CPU controller found on host. {{(pid=73572) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 10:22:45 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-40295a97-f610-4eb3-83f3-6d5660e85120 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73572) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 10:22:45 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-40295a97-f610-4eb3-83f3-6d5660e85120 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T10:07:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T10:22:37Z,direct_url=<?>,disk_format='qcow2',id=7dc1b5c8-da80-43d5-a885-7f3a806c5633,min_disk=0,min_ram=0,name='tempest-scenario-img--701864016',owner='eb6ef2597eac461f959a568abd3031ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T10:22:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 10:22:45 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-40295a97-f610-4eb3-83f3-6d5660e85120 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Flavor limits 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 10:22:45 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-40295a97-f610-4eb3-83f3-6d5660e85120 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Image limits 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 10:22:45 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-40295a97-f610-4eb3-83f3-6d5660e85120 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Flavor pref 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 10:22:45 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-40295a97-f610-4eb3-83f3-6d5660e85120 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Image pref 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 10:22:45 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-40295a97-f610-4eb3-83f3-6d5660e85120 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 10:22:45 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-40295a97-f610-4eb3-83f3-6d5660e85120 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 10:22:45 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-40295a97-f610-4eb3-83f3-6d5660e85120 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73572) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 10:22:45 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-40295a97-f610-4eb3-83f3-6d5660e85120 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Got 1 possible topologies {{(pid=73572) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 10:22:45 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-40295a97-f610-4eb3-83f3-6d5660e85120 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 10:22:45 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-40295a97-f610-4eb3-83f3-6d5660e85120 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 10:22:45 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-40295a97-f610-4eb3-83f3-6d5660e85120 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T10:22:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-243791677',display_name='tempest-TestMinimumBasicScenario-server-243791677',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-243791677',id=31,image_ref='7dc1b5c8-da80-43d5-a885-7f3a806c5633',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNcR9stjGS+uFqqOHEkcOKSz8zCmiheoV3PRsDn3F7rYFiI9jSvBV9sL0CyHK2fB2TUnsQAIqfrqM4/FFVbTOvl86Loz5xao2NEPhhtZCRWiLyYgYrAO1GfBYIBRxayR1w==',key_name='tempest-TestMinimumBasicScenario-2054612711',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eb6ef2597eac461f959a568abd3031ca',ramdisk_id='',reservation_id='r-txt0ywle',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7dc1b5c8-da80-43d5-a885-7f3a806c5633',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1705958769',owner_user_name='tempest-TestMinimumBasicScenario-1705958769-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T10:22:42Z,user_data=None,user_id='a354eb6764fd4c95a53b8962544bc49b',uuid=1f3db0fa-682c-4b33-966b-9e50b7349b6e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "56789500-c8b2-4391-b245-6a2998d9fb6c", "address": "fa:16:3e:b8:f0:d2", "network": {"id": "2a6e27c9-9bd2-4ccb-abf6-82d85524da90", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1822065121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb6ef2597eac461f959a568abd3031ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56789500-c8", "ovs_interfaceid": "56789500-c8b2-4391-b245-6a2998d9fb6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73572) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 10:22:45 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-40295a97-f610-4eb3-83f3-6d5660e85120 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Converting VIF {"id": "56789500-c8b2-4391-b245-6a2998d9fb6c", "address": "fa:16:3e:b8:f0:d2", "network": {"id": "2a6e27c9-9bd2-4ccb-abf6-82d85524da90", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1822065121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb6ef2597eac461f959a568abd3031ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56789500-c8", "ovs_interfaceid": "56789500-c8b2-4391-b245-6a2998d9fb6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:22:45 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-40295a97-f610-4eb3-83f3-6d5660e85120 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:f0:d2,bridge_name='br-int',has_traffic_filtering=True,id=56789500-c8b2-4391-b245-6a2998d9fb6c,network=Network(2a6e27c9-9bd2-4ccb-abf6-82d85524da90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56789500-c8') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:22:45 user nova-compute[73572]: DEBUG nova.objects.instance [None req-40295a97-f610-4eb3-83f3-6d5660e85120 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Lazy-loading 'pci_devices' on Instance uuid 1f3db0fa-682c-4b33-966b-9e50b7349b6e {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:22:45 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-40295a97-f610-4eb3-83f3-6d5660e85120 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] [instance: 1f3db0fa-682c-4b33-966b-9e50b7349b6e] End _get_guest_xml xml=<domain type="kvm">
Aug 26 10:22:45 user nova-compute[73572]:   <uuid>1f3db0fa-682c-4b33-966b-9e50b7349b6e</uuid>
Aug 26 10:22:45 user nova-compute[73572]:   <name>instance-0000001f</name>
Aug 26 10:22:45 user nova-compute[73572]:   <memory>524288</memory>
Aug 26 10:22:45 user nova-compute[73572]:   <vcpu>1</vcpu>
Aug 26 10:22:45 user nova-compute[73572]:   <metadata>
Aug 26 10:22:45 user nova-compute[73572]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 10:22:45 user nova-compute[73572]:       <nova:package version="0.0.0"/>
Aug 26 10:22:45 user nova-compute[73572]:       <nova:name>tempest-TestMinimumBasicScenario-server-243791677</nova:name>
Aug 26 10:22:45 user nova-compute[73572]:       <nova:creationTime>2023-08-26 10:22:45</nova:creationTime>
Aug 26 10:22:45 user nova-compute[73572]:       <nova:flavor name="m1.tiny">
Aug 26 10:22:45 user nova-compute[73572]:         <nova:memory>512</nova:memory>
Aug 26 10:22:45 user nova-compute[73572]:         <nova:disk>1</nova:disk>
Aug 26 10:22:45 user nova-compute[73572]:         <nova:swap>0</nova:swap>
Aug 26 10:22:45 user nova-compute[73572]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 10:22:45 user nova-compute[73572]:         <nova:vcpus>1</nova:vcpus>
Aug 26 10:22:45 user nova-compute[73572]:       </nova:flavor>
Aug 26 10:22:45 user nova-compute[73572]:       <nova:owner>
Aug 26 10:22:45 user nova-compute[73572]:         <nova:user uuid="a354eb6764fd4c95a53b8962544bc49b">tempest-TestMinimumBasicScenario-1705958769-project-member</nova:user>
Aug 26 10:22:45 user nova-compute[73572]:         <nova:project uuid="eb6ef2597eac461f959a568abd3031ca">tempest-TestMinimumBasicScenario-1705958769</nova:project>
Aug 26 10:22:45 user nova-compute[73572]:       </nova:owner>
Aug 26 10:22:45 user nova-compute[73572]:       <nova:root type="image" uuid="7dc1b5c8-da80-43d5-a885-7f3a806c5633"/>
Aug 26 10:22:45 user nova-compute[73572]:       <nova:ports>
Aug 26 10:22:45 user nova-compute[73572]:         <nova:port uuid="56789500-c8b2-4391-b245-6a2998d9fb6c">
Aug 26 10:22:45 user nova-compute[73572]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 26 10:22:45 user nova-compute[73572]:         </nova:port>
Aug 26 10:22:45 user nova-compute[73572]:       </nova:ports>
Aug 26 10:22:45 user nova-compute[73572]:     </nova:instance>
Aug 26 10:22:45 user nova-compute[73572]:   </metadata>
Aug 26 10:22:45 user nova-compute[73572]:   <sysinfo type="smbios">
Aug 26 10:22:45 user nova-compute[73572]:     <system>
Aug 26 10:22:45 user nova-compute[73572]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 10:22:45 user nova-compute[73572]:       <entry name="product">OpenStack Nova</entry>
Aug 26 10:22:45 user nova-compute[73572]:       <entry name="version">0.0.0</entry>
Aug 26 10:22:45 user nova-compute[73572]:       <entry name="serial">1f3db0fa-682c-4b33-966b-9e50b7349b6e</entry>
Aug 26 10:22:45 user nova-compute[73572]:       <entry name="uuid">1f3db0fa-682c-4b33-966b-9e50b7349b6e</entry>
Aug 26 10:22:45 user nova-compute[73572]:       <entry name="family">Virtual Machine</entry>
Aug 26 10:22:45 user nova-compute[73572]:     </system>
Aug 26 10:22:45 user nova-compute[73572]:   </sysinfo>
Aug 26 10:22:45 user nova-compute[73572]:   <os>
Aug 26 10:22:45 user nova-compute[73572]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 10:22:45 user nova-compute[73572]:     <boot dev="hd"/>
Aug 26 10:22:45 user nova-compute[73572]:     <smbios mode="sysinfo"/>
Aug 26 10:22:45 user nova-compute[73572]:   </os>
Aug 26 10:22:45 user nova-compute[73572]:   <features>
Aug 26 10:22:45 user nova-compute[73572]:     <acpi/>
Aug 26 10:22:45 user nova-compute[73572]:     <apic/>
Aug 26 10:22:45 user nova-compute[73572]:     <vmcoreinfo/>
Aug 26 10:22:45 user nova-compute[73572]:   </features>
Aug 26 10:22:45 user nova-compute[73572]:   <clock offset="utc">
Aug 26 10:22:45 user nova-compute[73572]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 10:22:45 user nova-compute[73572]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 10:22:45 user nova-compute[73572]:     <timer name="hpet" present="no"/>
Aug 26 10:22:45 user nova-compute[73572]:   </clock>
Aug 26 10:22:45 user nova-compute[73572]:   <cpu mode="custom" match="exact">
Aug 26 10:22:45 user nova-compute[73572]:     <model>Nehalem</model>
Aug 26 10:22:45 user nova-compute[73572]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 10:22:45 user nova-compute[73572]:   </cpu>
Aug 26 10:22:45 user nova-compute[73572]:   <devices>
Aug 26 10:22:45 user nova-compute[73572]:     <disk type="file" device="disk">
Aug 26 10:22:45 user nova-compute[73572]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 10:22:45 user nova-compute[73572]:       <source file="/opt/stack/data/nova/instances/1f3db0fa-682c-4b33-966b-9e50b7349b6e/disk"/>
Aug 26 10:22:45 user nova-compute[73572]:       <target dev="vda" bus="virtio"/>
Aug 26 10:22:45 user nova-compute[73572]:     </disk>
Aug 26 10:22:45 user nova-compute[73572]:     <interface type="ethernet">
Aug 26 10:22:45 user nova-compute[73572]:       <mac address="fa:16:3e:b8:f0:d2"/>
Aug 26 10:22:45 user nova-compute[73572]:       <model type="virtio"/>
Aug 26 10:22:45 user nova-compute[73572]:       <mtu size="1442"/>
Aug 26 10:22:45 user nova-compute[73572]:       <target dev="tap56789500-c8"/>
Aug 26 10:22:45 user nova-compute[73572]:     </interface>
Aug 26 10:22:45 user nova-compute[73572]:     <serial type="pty">
Aug 26 10:22:45 user nova-compute[73572]:       <log file="/opt/stack/data/nova/instances/1f3db0fa-682c-4b33-966b-9e50b7349b6e/console.log" append="off"/>
Aug 26 10:22:45 user nova-compute[73572]:     </serial>
Aug 26 10:22:45 user nova-compute[73572]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 10:22:45 user nova-compute[73572]:     <video>
Aug 26 10:22:45 user nova-compute[73572]:       <model type="virtio"/>
Aug 26 10:22:45 user nova-compute[73572]:     </video>
Aug 26 10:22:45 user nova-compute[73572]:     <rng model="virtio">
Aug 26 10:22:45 user nova-compute[73572]:       <backend model="random">/dev/urandom</backend>
Aug 26 10:22:45 user nova-compute[73572]:     </rng>
Aug 26 10:22:45 user nova-compute[73572]:     <controller type="usb" index="0" model="none"/>
Aug 26 10:22:45 user nova-compute[73572]:     <memballoon model="virtio">
Aug 26 10:22:45 user nova-compute[73572]:       <stats period="10"/>
Aug 26 10:22:45 user nova-compute[73572]:     </memballoon>
Aug 26 10:22:45 user nova-compute[73572]:   </devices>
Aug 26 10:22:45 user nova-compute[73572]: </domain>
Aug 26 10:22:45 user nova-compute[73572]:  {{(pid=73572) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 10:22:45 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-40295a97-f610-4eb3-83f3-6d5660e85120 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T10:22:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-243791677',display_name='tempest-TestMinimumBasicScenario-server-243791677',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-243791677',id=31,image_ref='7dc1b5c8-da80-43d5-a885-7f3a806c5633',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNcR9stjGS+uFqqOHEkcOKSz8zCmiheoV3PRsDn3F7rYFiI9jSvBV9sL0CyHK2fB2TUnsQAIqfrqM4/FFVbTOvl86Loz5xao2NEPhhtZCRWiLyYgYrAO1GfBYIBRxayR1w==',key_name='tempest-TestMinimumBasicScenario-2054612711',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eb6ef2597eac461f959a568abd3031ca',ramdisk_id='',reservation_id='r-txt0ywle',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7dc1b5c8-da80-43d5-a885-7f3a806c5633',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1705958769',owner_user_name='tempest-TestMinimumBasicScenario-1705958769-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T10:22:42Z,user_data=None,user_id='a354eb6764fd4c95a53b8962544bc49b',uuid=1f3db0fa-682c-4b33-966b-9e50b7349b6e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "56789500-c8b2-4391-b245-6a2998d9fb6c", "address": "fa:16:3e:b8:f0:d2", "network": {"id": "2a6e27c9-9bd2-4ccb-abf6-82d85524da90", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1822065121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb6ef2597eac461f959a568abd3031ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56789500-c8", "ovs_interfaceid": "56789500-c8b2-4391-b245-6a2998d9fb6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 10:22:45 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-40295a97-f610-4eb3-83f3-6d5660e85120 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Converting VIF {"id": "56789500-c8b2-4391-b245-6a2998d9fb6c", "address": "fa:16:3e:b8:f0:d2", "network": {"id": "2a6e27c9-9bd2-4ccb-abf6-82d85524da90", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1822065121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb6ef2597eac461f959a568abd3031ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56789500-c8", "ovs_interfaceid": "56789500-c8b2-4391-b245-6a2998d9fb6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:22:45 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-40295a97-f610-4eb3-83f3-6d5660e85120 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:f0:d2,bridge_name='br-int',has_traffic_filtering=True,id=56789500-c8b2-4391-b245-6a2998d9fb6c,network=Network(2a6e27c9-9bd2-4ccb-abf6-82d85524da90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56789500-c8') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:22:45 user nova-compute[73572]: DEBUG os_vif [None req-40295a97-f610-4eb3-83f3-6d5660e85120 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:f0:d2,bridge_name='br-int',has_traffic_filtering=True,id=56789500-c8b2-4391-b245-6a2998d9fb6c,network=Network(2a6e27c9-9bd2-4ccb-abf6-82d85524da90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56789500-c8') {{(pid=73572) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 10:22:45 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:22:45 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:22:45 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 10:22:45 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:22:45 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap56789500-c8, may_exist=True, interface_attrs={}) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:22:45 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap56789500-c8, col_values=(('external_ids', {'iface-id': '56789500-c8b2-4391-b245-6a2998d9fb6c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b8:f0:d2', 'vm-uuid': '1f3db0fa-682c-4b33-966b-9e50b7349b6e'}),), if_exists=True) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:22:45 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:22:45 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:22:45 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:22:45 user nova-compute[73572]: INFO os_vif [None req-40295a97-f610-4eb3-83f3-6d5660e85120 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:f0:d2,bridge_name='br-int',has_traffic_filtering=True,id=56789500-c8b2-4391-b245-6a2998d9fb6c,network=Network(2a6e27c9-9bd2-4ccb-abf6-82d85524da90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56789500-c8')
Aug 26 10:22:45 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-40295a97-f610-4eb3-83f3-6d5660e85120 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] No BDM found with device name vda, not building metadata. {{(pid=73572) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 10:22:45 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-40295a97-f610-4eb3-83f3-6d5660e85120 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] No VIF found with MAC fa:16:3e:b8:f0:d2, not building metadata {{(pid=73572) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 10:22:46 user nova-compute[73572]: DEBUG nova.network.neutron [req-c2299b97-e565-497f-b0b3-4c57a659f5ba req-0550bef3-3b6c-4406-9056-3e40ac2ff413 service nova] [instance: 1f3db0fa-682c-4b33-966b-9e50b7349b6e] Updated VIF entry in instance network info cache for port 56789500-c8b2-4391-b245-6a2998d9fb6c. {{(pid=73572) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 10:22:46 user nova-compute[73572]: DEBUG nova.network.neutron [req-c2299b97-e565-497f-b0b3-4c57a659f5ba req-0550bef3-3b6c-4406-9056-3e40ac2ff413 service nova] [instance: 1f3db0fa-682c-4b33-966b-9e50b7349b6e] Updating instance_info_cache with network_info: [{"id": "56789500-c8b2-4391-b245-6a2998d9fb6c", "address": "fa:16:3e:b8:f0:d2", "network": {"id": "2a6e27c9-9bd2-4ccb-abf6-82d85524da90", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1822065121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb6ef2597eac461f959a568abd3031ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56789500-c8", "ovs_interfaceid": "56789500-c8b2-4391-b245-6a2998d9fb6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:22:46 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-c2299b97-e565-497f-b0b3-4c57a659f5ba req-0550bef3-3b6c-4406-9056-3e40ac2ff413 service nova] Releasing lock "refresh_cache-1f3db0fa-682c-4b33-966b-9e50b7349b6e" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:22:46 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-36938931-1bbf-4d21-afa9-7c1b6165cc12 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: e468b473-515f-41ad-a75c-65d4c6d575c8] Snapshot image upload complete
Aug 26 10:22:46 user nova-compute[73572]: INFO nova.compute.manager [None req-36938931-1bbf-4d21-afa9-7c1b6165cc12 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: e468b473-515f-41ad-a75c-65d4c6d575c8] Took 8.04 seconds to snapshot the instance on the hypervisor.
Aug 26 10:22:47 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:22:47 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:22:47 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:22:47 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:22:47 user nova-compute[73572]: DEBUG nova.compute.manager [req-4a661e28-ed09-4415-af7a-fcd617298714 req-cdb171f5-81a4-4e59-8f40-6fb6f4deb59e service nova] [instance: 1f3db0fa-682c-4b33-966b-9e50b7349b6e] Received event network-vif-plugged-56789500-c8b2-4391-b245-6a2998d9fb6c {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:22:47 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-4a661e28-ed09-4415-af7a-fcd617298714 req-cdb171f5-81a4-4e59-8f40-6fb6f4deb59e service nova] Acquiring lock "1f3db0fa-682c-4b33-966b-9e50b7349b6e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:22:47 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-4a661e28-ed09-4415-af7a-fcd617298714 req-cdb171f5-81a4-4e59-8f40-6fb6f4deb59e service nova] Lock "1f3db0fa-682c-4b33-966b-9e50b7349b6e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:22:47 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-4a661e28-ed09-4415-af7a-fcd617298714 req-cdb171f5-81a4-4e59-8f40-6fb6f4deb59e service nova] Lock "1f3db0fa-682c-4b33-966b-9e50b7349b6e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:22:47 user nova-compute[73572]: DEBUG nova.compute.manager [req-4a661e28-ed09-4415-af7a-fcd617298714 req-cdb171f5-81a4-4e59-8f40-6fb6f4deb59e service nova] [instance: 1f3db0fa-682c-4b33-966b-9e50b7349b6e] No waiting events found dispatching network-vif-plugged-56789500-c8b2-4391-b245-6a2998d9fb6c {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:22:47 user nova-compute[73572]: WARNING nova.compute.manager [req-4a661e28-ed09-4415-af7a-fcd617298714 req-cdb171f5-81a4-4e59-8f40-6fb6f4deb59e service nova] [instance: 1f3db0fa-682c-4b33-966b-9e50b7349b6e] Received unexpected event network-vif-plugged-56789500-c8b2-4391-b245-6a2998d9fb6c for instance with vm_state building and task_state spawning.
Aug 26 10:22:47 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:22:47 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:22:47 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:22:47 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:22:47 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:22:49 user nova-compute[73572]: DEBUG nova.virt.driver [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Emitting event <LifecycleEvent: 1693045369.5729542, 1f3db0fa-682c-4b33-966b-9e50b7349b6e => Resumed> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:22:49 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 1f3db0fa-682c-4b33-966b-9e50b7349b6e] VM Resumed (Lifecycle Event)
Aug 26 10:22:49 user nova-compute[73572]: DEBUG nova.compute.manager [None req-40295a97-f610-4eb3-83f3-6d5660e85120 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] [instance: 1f3db0fa-682c-4b33-966b-9e50b7349b6e] Instance event wait completed in 0 seconds for  {{(pid=73572) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 10:22:49 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-40295a97-f610-4eb3-83f3-6d5660e85120 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] [instance: 1f3db0fa-682c-4b33-966b-9e50b7349b6e] Guest created on hypervisor {{(pid=73572) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 10:22:49 user nova-compute[73572]: INFO nova.virt.libvirt.driver [-] [instance: 1f3db0fa-682c-4b33-966b-9e50b7349b6e] Instance spawned successfully.
Aug 26 10:22:49 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-40295a97-f610-4eb3-83f3-6d5660e85120 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] [instance: 1f3db0fa-682c-4b33-966b-9e50b7349b6e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 10:22:49 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 1f3db0fa-682c-4b33-966b-9e50b7349b6e] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:22:49 user nova-compute[73572]: DEBUG nova.compute.manager [req-4ed89a47-f662-4482-89fc-56b6647c6e22 req-47021e64-db9a-4a7c-81c3-2270dbce9809 service nova] [instance: 1f3db0fa-682c-4b33-966b-9e50b7349b6e] Received event network-vif-plugged-56789500-c8b2-4391-b245-6a2998d9fb6c {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:22:49 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-4ed89a47-f662-4482-89fc-56b6647c6e22 req-47021e64-db9a-4a7c-81c3-2270dbce9809 service nova] Acquiring lock "1f3db0fa-682c-4b33-966b-9e50b7349b6e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:22:49 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-4ed89a47-f662-4482-89fc-56b6647c6e22 req-47021e64-db9a-4a7c-81c3-2270dbce9809 service nova] Lock "1f3db0fa-682c-4b33-966b-9e50b7349b6e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:22:49 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-4ed89a47-f662-4482-89fc-56b6647c6e22 req-47021e64-db9a-4a7c-81c3-2270dbce9809 service nova] Lock "1f3db0fa-682c-4b33-966b-9e50b7349b6e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:22:49 user nova-compute[73572]: DEBUG nova.compute.manager [req-4ed89a47-f662-4482-89fc-56b6647c6e22 req-47021e64-db9a-4a7c-81c3-2270dbce9809 service nova] [instance: 1f3db0fa-682c-4b33-966b-9e50b7349b6e] No waiting events found dispatching network-vif-plugged-56789500-c8b2-4391-b245-6a2998d9fb6c {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:22:49 user nova-compute[73572]: WARNING nova.compute.manager [req-4ed89a47-f662-4482-89fc-56b6647c6e22 req-47021e64-db9a-4a7c-81c3-2270dbce9809 service nova] [instance: 1f3db0fa-682c-4b33-966b-9e50b7349b6e] Received unexpected event network-vif-plugged-56789500-c8b2-4391-b245-6a2998d9fb6c for instance with vm_state building and task_state spawning.
Aug 26 10:22:49 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 1f3db0fa-682c-4b33-966b-9e50b7349b6e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73572) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 10:22:49 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-40295a97-f610-4eb3-83f3-6d5660e85120 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] [instance: 1f3db0fa-682c-4b33-966b-9e50b7349b6e] Found default for hw_cdrom_bus of ide {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:22:49 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-40295a97-f610-4eb3-83f3-6d5660e85120 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] [instance: 1f3db0fa-682c-4b33-966b-9e50b7349b6e] Found default for hw_disk_bus of virtio {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:22:49 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-40295a97-f610-4eb3-83f3-6d5660e85120 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] [instance: 1f3db0fa-682c-4b33-966b-9e50b7349b6e] Found default for hw_input_bus of None {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:22:49 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-40295a97-f610-4eb3-83f3-6d5660e85120 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] [instance: 1f3db0fa-682c-4b33-966b-9e50b7349b6e] Found default for hw_pointer_model of None {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:22:49 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-40295a97-f610-4eb3-83f3-6d5660e85120 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] [instance: 1f3db0fa-682c-4b33-966b-9e50b7349b6e] Found default for hw_video_model of virtio {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:22:49 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-40295a97-f610-4eb3-83f3-6d5660e85120 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] [instance: 1f3db0fa-682c-4b33-966b-9e50b7349b6e] Found default for hw_vif_model of virtio {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:22:49 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 1f3db0fa-682c-4b33-966b-9e50b7349b6e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 10:22:49 user nova-compute[73572]: DEBUG nova.virt.driver [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Emitting event <LifecycleEvent: 1693045369.5740957, 1f3db0fa-682c-4b33-966b-9e50b7349b6e => Started> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:22:49 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 1f3db0fa-682c-4b33-966b-9e50b7349b6e] VM Started (Lifecycle Event)
Aug 26 10:22:49 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 1f3db0fa-682c-4b33-966b-9e50b7349b6e] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:22:49 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 1f3db0fa-682c-4b33-966b-9e50b7349b6e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73572) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 10:22:49 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 1f3db0fa-682c-4b33-966b-9e50b7349b6e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 10:22:49 user nova-compute[73572]: INFO nova.compute.manager [None req-40295a97-f610-4eb3-83f3-6d5660e85120 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] [instance: 1f3db0fa-682c-4b33-966b-9e50b7349b6e] Took 7.08 seconds to spawn the instance on the hypervisor.
Aug 26 10:22:49 user nova-compute[73572]: DEBUG nova.compute.manager [None req-40295a97-f610-4eb3-83f3-6d5660e85120 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] [instance: 1f3db0fa-682c-4b33-966b-9e50b7349b6e] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:22:49 user nova-compute[73572]: INFO nova.compute.manager [None req-40295a97-f610-4eb3-83f3-6d5660e85120 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] [instance: 1f3db0fa-682c-4b33-966b-9e50b7349b6e] Took 8.55 seconds to build instance.
Aug 26 10:22:49 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-40295a97-f610-4eb3-83f3-6d5660e85120 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Lock "1f3db0fa-682c-4b33-966b-9e50b7349b6e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.669s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:22:50 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:22:50 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:22:51 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:22:55 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:22:55 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:22:56 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:22:58 user nova-compute[73572]: DEBUG nova.compute.manager [req-aec44111-7b40-40ac-9f6c-dc1a715c1e90 req-d1f77210-0a2a-48ec-a530-e14b616aa54b service nova] [instance: d2970584-8c2a-4f99-922c-d66d59489504] Received event network-changed-754f85e2-09b3-418b-9c3f-452c88756d3a {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:22:58 user nova-compute[73572]: DEBUG nova.compute.manager [req-aec44111-7b40-40ac-9f6c-dc1a715c1e90 req-d1f77210-0a2a-48ec-a530-e14b616aa54b service nova] [instance: d2970584-8c2a-4f99-922c-d66d59489504] Refreshing instance network info cache due to event network-changed-754f85e2-09b3-418b-9c3f-452c88756d3a. {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 10:22:58 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-aec44111-7b40-40ac-9f6c-dc1a715c1e90 req-d1f77210-0a2a-48ec-a530-e14b616aa54b service nova] Acquiring lock "refresh_cache-d2970584-8c2a-4f99-922c-d66d59489504" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:22:58 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-aec44111-7b40-40ac-9f6c-dc1a715c1e90 req-d1f77210-0a2a-48ec-a530-e14b616aa54b service nova] Acquired lock "refresh_cache-d2970584-8c2a-4f99-922c-d66d59489504" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:22:58 user nova-compute[73572]: DEBUG nova.network.neutron [req-aec44111-7b40-40ac-9f6c-dc1a715c1e90 req-d1f77210-0a2a-48ec-a530-e14b616aa54b service nova] [instance: d2970584-8c2a-4f99-922c-d66d59489504] Refreshing network info cache for port 754f85e2-09b3-418b-9c3f-452c88756d3a {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 10:22:58 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-559bcc8e-3a44-4391-a135-85fe565eecd8 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Acquiring lock "d2970584-8c2a-4f99-922c-d66d59489504" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:22:58 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-559bcc8e-3a44-4391-a135-85fe565eecd8 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Lock "d2970584-8c2a-4f99-922c-d66d59489504" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:22:58 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-559bcc8e-3a44-4391-a135-85fe565eecd8 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Acquiring lock "d2970584-8c2a-4f99-922c-d66d59489504-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:22:58 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-559bcc8e-3a44-4391-a135-85fe565eecd8 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Lock "d2970584-8c2a-4f99-922c-d66d59489504-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:22:58 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-559bcc8e-3a44-4391-a135-85fe565eecd8 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Lock "d2970584-8c2a-4f99-922c-d66d59489504-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:22:58 user nova-compute[73572]: INFO nova.compute.manager [None req-559bcc8e-3a44-4391-a135-85fe565eecd8 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] [instance: d2970584-8c2a-4f99-922c-d66d59489504] Terminating instance
Aug 26 10:22:58 user nova-compute[73572]: DEBUG nova.compute.manager [None req-559bcc8e-3a44-4391-a135-85fe565eecd8 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] [instance: d2970584-8c2a-4f99-922c-d66d59489504] Start destroying the instance on the hypervisor. {{(pid=73572) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 10:22:58 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:22:58 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:22:58 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:22:59 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:22:59 user nova-compute[73572]: INFO nova.virt.libvirt.driver [-] [instance: d2970584-8c2a-4f99-922c-d66d59489504] Instance destroyed successfully.
Aug 26 10:22:59 user nova-compute[73572]: DEBUG nova.objects.instance [None req-559bcc8e-3a44-4391-a135-85fe565eecd8 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Lazy-loading 'resources' on Instance uuid d2970584-8c2a-4f99-922c-d66d59489504 {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:22:59 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-559bcc8e-3a44-4391-a135-85fe565eecd8 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T10:15:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1555345289',display_name='tempest-TestStampPattern-server-1555345289',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1555345289',id=16,image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP9vHc9cYvgcHQg/aK0omfrRC7E/+64q6slnxR+kteK1TJpzyHka+ebCIfWJOJFiXL5L634G/nkiqr1k6bVjV80fgSFGxhy9wnZsw6PuJmiL2f9/rm8j19mT+daCzhQYQw==',key_name='tempest-TestStampPattern-1944573374',keypairs=<?>,launch_index=0,launched_at=2023-08-26T10:15:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6f2be8d4c6c147e98a1b5b7443b3828d',ramdisk_id='',reservation_id='r-ns4ykzlm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-478976113',owner_user_name='tempest-TestStampPattern-478976113-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T10:18:47Z,user_data=None,user_id='b990faa34b924d29bf7c0490aaf07644',uuid=d2970584-8c2a-4f99-922c-d66d59489504,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "754f85e2-09b3-418b-9c3f-452c88756d3a", "address": "fa:16:3e:d6:92:13", "network": {"id": "e565abb6-25f8-4f92-9cca-69db36e4216a", "bridge": "br-int", "label": "tempest-TestStampPattern-1866566708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f2be8d4c6c147e98a1b5b7443b3828d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap754f85e2-09", "ovs_interfaceid": "754f85e2-09b3-418b-9c3f-452c88756d3a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 10:22:59 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-559bcc8e-3a44-4391-a135-85fe565eecd8 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Converting VIF {"id": "754f85e2-09b3-418b-9c3f-452c88756d3a", "address": "fa:16:3e:d6:92:13", "network": {"id": "e565abb6-25f8-4f92-9cca-69db36e4216a", "bridge": "br-int", "label": "tempest-TestStampPattern-1866566708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f2be8d4c6c147e98a1b5b7443b3828d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap754f85e2-09", "ovs_interfaceid": "754f85e2-09b3-418b-9c3f-452c88756d3a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:22:59 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-559bcc8e-3a44-4391-a135-85fe565eecd8 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d6:92:13,bridge_name='br-int',has_traffic_filtering=True,id=754f85e2-09b3-418b-9c3f-452c88756d3a,network=Network(e565abb6-25f8-4f92-9cca-69db36e4216a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap754f85e2-09') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:22:59 user nova-compute[73572]: DEBUG os_vif [None req-559bcc8e-3a44-4391-a135-85fe565eecd8 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d6:92:13,bridge_name='br-int',has_traffic_filtering=True,id=754f85e2-09b3-418b-9c3f-452c88756d3a,network=Network(e565abb6-25f8-4f92-9cca-69db36e4216a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap754f85e2-09') {{(pid=73572) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 10:22:59 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:22:59 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap754f85e2-09, bridge=br-int, if_exists=True) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:22:59 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:22:59 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:22:59 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:22:59 user nova-compute[73572]: INFO os_vif [None req-559bcc8e-3a44-4391-a135-85fe565eecd8 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d6:92:13,bridge_name='br-int',has_traffic_filtering=True,id=754f85e2-09b3-418b-9c3f-452c88756d3a,network=Network(e565abb6-25f8-4f92-9cca-69db36e4216a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap754f85e2-09')
Aug 26 10:22:59 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-559bcc8e-3a44-4391-a135-85fe565eecd8 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] [instance: d2970584-8c2a-4f99-922c-d66d59489504] Deleting instance files /opt/stack/data/nova/instances/d2970584-8c2a-4f99-922c-d66d59489504_del
Aug 26 10:22:59 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-559bcc8e-3a44-4391-a135-85fe565eecd8 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] [instance: d2970584-8c2a-4f99-922c-d66d59489504] Deletion of /opt/stack/data/nova/instances/d2970584-8c2a-4f99-922c-d66d59489504_del complete
Aug 26 10:22:59 user nova-compute[73572]: DEBUG nova.network.neutron [req-aec44111-7b40-40ac-9f6c-dc1a715c1e90 req-d1f77210-0a2a-48ec-a530-e14b616aa54b service nova] [instance: d2970584-8c2a-4f99-922c-d66d59489504] Updated VIF entry in instance network info cache for port 754f85e2-09b3-418b-9c3f-452c88756d3a. {{(pid=73572) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 10:22:59 user nova-compute[73572]: DEBUG nova.network.neutron [req-aec44111-7b40-40ac-9f6c-dc1a715c1e90 req-d1f77210-0a2a-48ec-a530-e14b616aa54b service nova] [instance: d2970584-8c2a-4f99-922c-d66d59489504] Updating instance_info_cache with network_info: [{"id": "754f85e2-09b3-418b-9c3f-452c88756d3a", "address": "fa:16:3e:d6:92:13", "network": {"id": "e565abb6-25f8-4f92-9cca-69db36e4216a", "bridge": "br-int", "label": "tempest-TestStampPattern-1866566708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f2be8d4c6c147e98a1b5b7443b3828d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap754f85e2-09", "ovs_interfaceid": "754f85e2-09b3-418b-9c3f-452c88756d3a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:22:59 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-aec44111-7b40-40ac-9f6c-dc1a715c1e90 req-d1f77210-0a2a-48ec-a530-e14b616aa54b service nova] Releasing lock "refresh_cache-d2970584-8c2a-4f99-922c-d66d59489504" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:22:59 user nova-compute[73572]: INFO nova.compute.manager [None req-559bcc8e-3a44-4391-a135-85fe565eecd8 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] [instance: d2970584-8c2a-4f99-922c-d66d59489504] Took 1.03 seconds to destroy the instance on the hypervisor.
Aug 26 10:22:59 user nova-compute[73572]: DEBUG oslo.service.loopingcall [None req-559bcc8e-3a44-4391-a135-85fe565eecd8 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73572) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 10:22:59 user nova-compute[73572]: DEBUG nova.compute.manager [-] [instance: d2970584-8c2a-4f99-922c-d66d59489504] Deallocating network for instance {{(pid=73572) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 10:22:59 user nova-compute[73572]: DEBUG nova.network.neutron [-] [instance: d2970584-8c2a-4f99-922c-d66d59489504] deallocate_for_instance() {{(pid=73572) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 10:23:00 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:23:00 user nova-compute[73572]: DEBUG nova.network.neutron [-] [instance: d2970584-8c2a-4f99-922c-d66d59489504] Updating instance_info_cache with network_info: [] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:23:00 user nova-compute[73572]: INFO nova.compute.manager [-] [instance: d2970584-8c2a-4f99-922c-d66d59489504] Took 0.57 seconds to deallocate network for instance.
Aug 26 10:23:00 user nova-compute[73572]: DEBUG nova.compute.manager [req-a2d756a0-9dac-4469-be34-8a41da842bc0 req-f300baff-62d4-41ff-bbb6-f9664c0e7129 service nova] [instance: d2970584-8c2a-4f99-922c-d66d59489504] Received event network-vif-deleted-754f85e2-09b3-418b-9c3f-452c88756d3a {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:23:00 user nova-compute[73572]: INFO nova.compute.manager [req-a2d756a0-9dac-4469-be34-8a41da842bc0 req-f300baff-62d4-41ff-bbb6-f9664c0e7129 service nova] [instance: d2970584-8c2a-4f99-922c-d66d59489504] Neutron deleted interface 754f85e2-09b3-418b-9c3f-452c88756d3a; detaching it from the instance and deleting it from the info cache
Aug 26 10:23:00 user nova-compute[73572]: DEBUG nova.network.neutron [req-a2d756a0-9dac-4469-be34-8a41da842bc0 req-f300baff-62d4-41ff-bbb6-f9664c0e7129 service nova] [instance: d2970584-8c2a-4f99-922c-d66d59489504] Updating instance_info_cache with network_info: [] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:23:00 user nova-compute[73572]: DEBUG nova.compute.manager [req-a2d756a0-9dac-4469-be34-8a41da842bc0 req-f300baff-62d4-41ff-bbb6-f9664c0e7129 service nova] [instance: d2970584-8c2a-4f99-922c-d66d59489504] Detach interface failed, port_id=754f85e2-09b3-418b-9c3f-452c88756d3a, reason: Instance d2970584-8c2a-4f99-922c-d66d59489504 could not be found. {{(pid=73572) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 10:23:00 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-559bcc8e-3a44-4391-a135-85fe565eecd8 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:23:00 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-559bcc8e-3a44-4391-a135-85fe565eecd8 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:23:00 user nova-compute[73572]: DEBUG nova.compute.manager [req-4d2750b5-7b58-44b4-8c7c-cd639257fc15 req-6b36869d-2e17-4b63-8203-2a0ea9d659e6 service nova] [instance: d2970584-8c2a-4f99-922c-d66d59489504] Received event network-vif-unplugged-754f85e2-09b3-418b-9c3f-452c88756d3a {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:23:00 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-4d2750b5-7b58-44b4-8c7c-cd639257fc15 req-6b36869d-2e17-4b63-8203-2a0ea9d659e6 service nova] Acquiring lock "d2970584-8c2a-4f99-922c-d66d59489504-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:23:00 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-4d2750b5-7b58-44b4-8c7c-cd639257fc15 req-6b36869d-2e17-4b63-8203-2a0ea9d659e6 service nova] Lock "d2970584-8c2a-4f99-922c-d66d59489504-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:23:00 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-4d2750b5-7b58-44b4-8c7c-cd639257fc15 req-6b36869d-2e17-4b63-8203-2a0ea9d659e6 service nova] Lock "d2970584-8c2a-4f99-922c-d66d59489504-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:23:00 user nova-compute[73572]: DEBUG nova.compute.manager [req-4d2750b5-7b58-44b4-8c7c-cd639257fc15 req-6b36869d-2e17-4b63-8203-2a0ea9d659e6 service nova] [instance: d2970584-8c2a-4f99-922c-d66d59489504] No waiting events found dispatching network-vif-unplugged-754f85e2-09b3-418b-9c3f-452c88756d3a {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:23:00 user nova-compute[73572]: WARNING nova.compute.manager [req-4d2750b5-7b58-44b4-8c7c-cd639257fc15 req-6b36869d-2e17-4b63-8203-2a0ea9d659e6 service nova] [instance: d2970584-8c2a-4f99-922c-d66d59489504] Received unexpected event network-vif-unplugged-754f85e2-09b3-418b-9c3f-452c88756d3a for instance with vm_state deleted and task_state None.
Aug 26 10:23:00 user nova-compute[73572]: DEBUG nova.compute.manager [req-4d2750b5-7b58-44b4-8c7c-cd639257fc15 req-6b36869d-2e17-4b63-8203-2a0ea9d659e6 service nova] [instance: d2970584-8c2a-4f99-922c-d66d59489504] Received event network-vif-plugged-754f85e2-09b3-418b-9c3f-452c88756d3a {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:23:00 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-4d2750b5-7b58-44b4-8c7c-cd639257fc15 req-6b36869d-2e17-4b63-8203-2a0ea9d659e6 service nova] Acquiring lock "d2970584-8c2a-4f99-922c-d66d59489504-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:23:00 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-4d2750b5-7b58-44b4-8c7c-cd639257fc15 req-6b36869d-2e17-4b63-8203-2a0ea9d659e6 service nova] Lock "d2970584-8c2a-4f99-922c-d66d59489504-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:23:00 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-4d2750b5-7b58-44b4-8c7c-cd639257fc15 req-6b36869d-2e17-4b63-8203-2a0ea9d659e6 service nova] Lock "d2970584-8c2a-4f99-922c-d66d59489504-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:23:00 user nova-compute[73572]: DEBUG nova.compute.manager [req-4d2750b5-7b58-44b4-8c7c-cd639257fc15 req-6b36869d-2e17-4b63-8203-2a0ea9d659e6 service nova] [instance: d2970584-8c2a-4f99-922c-d66d59489504] No waiting events found dispatching network-vif-plugged-754f85e2-09b3-418b-9c3f-452c88756d3a {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:23:00 user nova-compute[73572]: WARNING nova.compute.manager [req-4d2750b5-7b58-44b4-8c7c-cd639257fc15 req-6b36869d-2e17-4b63-8203-2a0ea9d659e6 service nova] [instance: d2970584-8c2a-4f99-922c-d66d59489504] Received unexpected event network-vif-plugged-754f85e2-09b3-418b-9c3f-452c88756d3a for instance with vm_state deleted and task_state None.
Aug 26 10:23:00 user nova-compute[73572]: DEBUG nova.compute.provider_tree [None req-559bcc8e-3a44-4391-a135-85fe565eecd8 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Inventory has not changed in ProviderTree for provider: e2cec974-59b2-4c77-a53d-a7f4e5a30d75 {{(pid=73572) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 10:23:01 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-559bcc8e-3a44-4391-a135-85fe565eecd8 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Inventory has not changed for provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73572) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 10:23:01 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-559bcc8e-3a44-4391-a135-85fe565eecd8 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.576s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:23:01 user nova-compute[73572]: INFO nova.scheduler.client.report [None req-559bcc8e-3a44-4391-a135-85fe565eecd8 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Deleted allocations for instance d2970584-8c2a-4f99-922c-d66d59489504
Aug 26 10:23:01 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-559bcc8e-3a44-4391-a135-85fe565eecd8 tempest-TestStampPattern-478976113 tempest-TestStampPattern-478976113-project-member] Lock "d2970584-8c2a-4f99-922c-d66d59489504" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.406s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:23:01 user nova-compute[73572]: DEBUG nova.objects.instance [None req-1bc565cb-93d2-4ebf-b345-10b68c962989 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Lazy-loading 'flavor' on Instance uuid 00c47a06-2bf8-427d-bcb1-304688584511 {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:23:01 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-1bc565cb-93d2-4ebf-b345-10b68c962989 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Acquiring lock "refresh_cache-00c47a06-2bf8-427d-bcb1-304688584511" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:23:01 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-1bc565cb-93d2-4ebf-b345-10b68c962989 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Acquired lock "refresh_cache-00c47a06-2bf8-427d-bcb1-304688584511" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:23:01 user nova-compute[73572]: DEBUG nova.network.neutron [None req-1bc565cb-93d2-4ebf-b345-10b68c962989 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] [instance: 00c47a06-2bf8-427d-bcb1-304688584511] Building network info cache for instance {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 10:23:01 user nova-compute[73572]: DEBUG nova.objects.instance [None req-1bc565cb-93d2-4ebf-b345-10b68c962989 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Lazy-loading 'info_cache' on Instance uuid 00c47a06-2bf8-427d-bcb1-304688584511 {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:23:01 user nova-compute[73572]: DEBUG nova.objects.base [None req-1bc565cb-93d2-4ebf-b345-10b68c962989 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Object Instance<00c47a06-2bf8-427d-bcb1-304688584511> lazy-loaded attributes: flavor,info_cache {{(pid=73572) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 10:23:01 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:23:02 user nova-compute[73572]: DEBUG nova.network.neutron [None req-1bc565cb-93d2-4ebf-b345-10b68c962989 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] [instance: 00c47a06-2bf8-427d-bcb1-304688584511] Updating instance_info_cache with network_info: [{"id": "d18bfeb9-ad63-41d9-8d66-56df3d3306d8", "address": "fa:16:3e:a2:f2:f4", "network": {"id": "81543fb3-a8fe-4e9c-8180-c65fa4dcc9e1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-469390371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "084df935eab842e58bad79afad7090f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd18bfeb9-ad", "ovs_interfaceid": "d18bfeb9-ad63-41d9-8d66-56df3d3306d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:23:02 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-1bc565cb-93d2-4ebf-b345-10b68c962989 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Releasing lock "refresh_cache-00c47a06-2bf8-427d-bcb1-304688584511" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:23:02 user nova-compute[73572]: INFO nova.virt.libvirt.driver [-] [instance: 00c47a06-2bf8-427d-bcb1-304688584511] Instance destroyed successfully.
Aug 26 10:23:02 user nova-compute[73572]: DEBUG nova.objects.instance [None req-1bc565cb-93d2-4ebf-b345-10b68c962989 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Lazy-loading 'resources' on Instance uuid 00c47a06-2bf8-427d-bcb1-304688584511 {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:23:02 user nova-compute[73572]: DEBUG nova.objects.base [None req-1bc565cb-93d2-4ebf-b345-10b68c962989 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Object Instance<00c47a06-2bf8-427d-bcb1-304688584511> lazy-loaded attributes: flavor,info_cache,resources {{(pid=73572) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 10:23:02 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-1bc565cb-93d2-4ebf-b345-10b68c962989 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T10:15:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-767184678',display_name='tempest-AttachVolumeTestJSON-server-767184678',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-767184678',id=15,image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDUM4e46LSrHmno1gp4T3RRXiXfjHx917gcUppmI/sxQPEY8hKY/vqoEhT+Bxby7kAu1Ei3af6xY5p/QME/Z3JthPiVJQ1F4Ur+7V+CECg8DAf4Z/fI85QJzneAszEfomQ==',key_name='tempest-keypair-643189050',keypairs=<?>,launch_index=0,launched_at=2023-08-26T10:15:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='084df935eab842e58bad79afad7090f3',ramdisk_id='',reservation_id='r-d4j1rgky',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-716261196',owner_user_name='tempest-AttachVolumeTestJSON-716261196-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T10:21:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2a2ef00486924f318ff1e7e502e835a6',uuid=00c47a06-2bf8-427d-bcb1-304688584511,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "d18bfeb9-ad63-41d9-8d66-56df3d3306d8", "address": "fa:16:3e:a2:f2:f4", "network": {"id": "81543fb3-a8fe-4e9c-8180-c65fa4dcc9e1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-469390371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "084df935eab842e58bad79afad7090f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd18bfeb9-ad", "ovs_interfaceid": "d18bfeb9-ad63-41d9-8d66-56df3d3306d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 10:23:02 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-1bc565cb-93d2-4ebf-b345-10b68c962989 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Converting VIF {"id": "d18bfeb9-ad63-41d9-8d66-56df3d3306d8", "address": "fa:16:3e:a2:f2:f4", "network": {"id": "81543fb3-a8fe-4e9c-8180-c65fa4dcc9e1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-469390371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "084df935eab842e58bad79afad7090f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd18bfeb9-ad", "ovs_interfaceid": "d18bfeb9-ad63-41d9-8d66-56df3d3306d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:23:02 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-1bc565cb-93d2-4ebf-b345-10b68c962989 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:f2:f4,bridge_name='br-int',has_traffic_filtering=True,id=d18bfeb9-ad63-41d9-8d66-56df3d3306d8,network=Network(81543fb3-a8fe-4e9c-8180-c65fa4dcc9e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd18bfeb9-ad') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:23:02 user nova-compute[73572]: DEBUG os_vif [None req-1bc565cb-93d2-4ebf-b345-10b68c962989 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:f2:f4,bridge_name='br-int',has_traffic_filtering=True,id=d18bfeb9-ad63-41d9-8d66-56df3d3306d8,network=Network(81543fb3-a8fe-4e9c-8180-c65fa4dcc9e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd18bfeb9-ad') {{(pid=73572) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 10:23:02 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:23:02 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd18bfeb9-ad, bridge=br-int, if_exists=True) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:23:02 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:23:02 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:23:02 user nova-compute[73572]: INFO os_vif [None req-1bc565cb-93d2-4ebf-b345-10b68c962989 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:f2:f4,bridge_name='br-int',has_traffic_filtering=True,id=d18bfeb9-ad63-41d9-8d66-56df3d3306d8,network=Network(81543fb3-a8fe-4e9c-8180-c65fa4dcc9e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd18bfeb9-ad')
Aug 26 10:23:02 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-1bc565cb-93d2-4ebf-b345-10b68c962989 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] [instance: 00c47a06-2bf8-427d-bcb1-304688584511] Start _get_guest_xml network_info=[{"id": "d18bfeb9-ad63-41d9-8d66-56df3d3306d8", "address": "fa:16:3e:a2:f2:f4", "network": {"id": "81543fb3-a8fe-4e9c-8180-c65fa4dcc9e1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-469390371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "084df935eab842e58bad79afad7090f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd18bfeb9-ad", "ovs_interfaceid": "d18bfeb9-ad63-41d9-8d66-56df3d3306d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=299da0c9-e1c4-48f0-be55-fbe20dd06bc9,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'guest_format': None, 'size': 0, 'encryption_format': None, 'device_type': 'disk', 'image_id': '299da0c9-e1c4-48f0-be55-fbe20dd06bc9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73572) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 10:23:02 user nova-compute[73572]: DEBUG nova.objects.instance [None req-1bc565cb-93d2-4ebf-b345-10b68c962989 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Lazy-loading 'numa_topology' on Instance uuid 00c47a06-2bf8-427d-bcb1-304688584511 {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:23:02 user nova-compute[73572]: DEBUG nova.objects.base [None req-1bc565cb-93d2-4ebf-b345-10b68c962989 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Object Instance<00c47a06-2bf8-427d-bcb1-304688584511> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=73572) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 10:23:02 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-1bc565cb-93d2-4ebf-b345-10b68c962989 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:23:02 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-1bc565cb-93d2-4ebf-b345-10b68c962989 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:23:02 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-1bc565cb-93d2-4ebf-b345-10b68c962989 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73572) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 10:23:02 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-1bc565cb-93d2-4ebf-b345-10b68c962989 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] CPU controller missing on host. {{(pid=73572) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 10:23:02 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-1bc565cb-93d2-4ebf-b345-10b68c962989 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73572) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 10:23:02 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-1bc565cb-93d2-4ebf-b345-10b68c962989 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] CPU controller found on host. {{(pid=73572) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 10:23:02 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-1bc565cb-93d2-4ebf-b345-10b68c962989 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73572) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 10:23:02 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-1bc565cb-93d2-4ebf-b345-10b68c962989 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T10:07:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=299da0c9-e1c4-48f0-be55-fbe20dd06bc9,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 10:23:02 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-1bc565cb-93d2-4ebf-b345-10b68c962989 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Flavor limits 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 10:23:02 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-1bc565cb-93d2-4ebf-b345-10b68c962989 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Image limits 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 10:23:02 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-1bc565cb-93d2-4ebf-b345-10b68c962989 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Flavor pref 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 10:23:02 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-1bc565cb-93d2-4ebf-b345-10b68c962989 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Image pref 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 10:23:02 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-1bc565cb-93d2-4ebf-b345-10b68c962989 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 10:23:02 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-1bc565cb-93d2-4ebf-b345-10b68c962989 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 10:23:02 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-1bc565cb-93d2-4ebf-b345-10b68c962989 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73572) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 10:23:02 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-1bc565cb-93d2-4ebf-b345-10b68c962989 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Got 1 possible topologies {{(pid=73572) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 10:23:02 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-1bc565cb-93d2-4ebf-b345-10b68c962989 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 10:23:02 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-1bc565cb-93d2-4ebf-b345-10b68c962989 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 10:23:02 user nova-compute[73572]: DEBUG nova.objects.instance [None req-1bc565cb-93d2-4ebf-b345-10b68c962989 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Lazy-loading 'vcpu_model' on Instance uuid 00c47a06-2bf8-427d-bcb1-304688584511 {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:23:02 user nova-compute[73572]: DEBUG nova.objects.base [None req-1bc565cb-93d2-4ebf-b345-10b68c962989 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Object Instance<00c47a06-2bf8-427d-bcb1-304688584511> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=73572) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 10:23:02 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-1bc565cb-93d2-4ebf-b345-10b68c962989 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T10:15:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-767184678',display_name='tempest-AttachVolumeTestJSON-server-767184678',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-767184678',id=15,image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDUM4e46LSrHmno1gp4T3RRXiXfjHx917gcUppmI/sxQPEY8hKY/vqoEhT+Bxby7kAu1Ei3af6xY5p/QME/Z3JthPiVJQ1F4Ur+7V+CECg8DAf4Z/fI85QJzneAszEfomQ==',key_name='tempest-keypair-643189050',keypairs=<?>,launch_index=0,launched_at=2023-08-26T10:15:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='084df935eab842e58bad79afad7090f3',ramdisk_id='',reservation_id='r-d4j1rgky',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-716261196',owner_user_name='tempest-AttachVolumeTestJSON-716261196-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T10:21:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2a2ef00486924f318ff1e7e502e835a6',uuid=00c47a06-2bf8-427d-bcb1-304688584511,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "d18bfeb9-ad63-41d9-8d66-56df3d3306d8", "address": "fa:16:3e:a2:f2:f4", "network": {"id": "81543fb3-a8fe-4e9c-8180-c65fa4dcc9e1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-469390371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "084df935eab842e58bad79afad7090f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd18bfeb9-ad", "ovs_interfaceid": "d18bfeb9-ad63-41d9-8d66-56df3d3306d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73572) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 10:23:02 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-1bc565cb-93d2-4ebf-b345-10b68c962989 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Converting VIF {"id": "d18bfeb9-ad63-41d9-8d66-56df3d3306d8", "address": "fa:16:3e:a2:f2:f4", "network": {"id": "81543fb3-a8fe-4e9c-8180-c65fa4dcc9e1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-469390371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "084df935eab842e58bad79afad7090f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd18bfeb9-ad", "ovs_interfaceid": "d18bfeb9-ad63-41d9-8d66-56df3d3306d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:23:02 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-1bc565cb-93d2-4ebf-b345-10b68c962989 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:f2:f4,bridge_name='br-int',has_traffic_filtering=True,id=d18bfeb9-ad63-41d9-8d66-56df3d3306d8,network=Network(81543fb3-a8fe-4e9c-8180-c65fa4dcc9e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd18bfeb9-ad') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:23:02 user nova-compute[73572]: DEBUG nova.objects.instance [None req-1bc565cb-93d2-4ebf-b345-10b68c962989 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Lazy-loading 'pci_devices' on Instance uuid 00c47a06-2bf8-427d-bcb1-304688584511 {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:23:02 user nova-compute[73572]: DEBUG nova.objects.base [None req-1bc565cb-93d2-4ebf-b345-10b68c962989 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Object Instance<00c47a06-2bf8-427d-bcb1-304688584511> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=73572) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 10:23:02 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-1bc565cb-93d2-4ebf-b345-10b68c962989 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] [instance: 00c47a06-2bf8-427d-bcb1-304688584511] End _get_guest_xml xml=<domain type="kvm">
Aug 26 10:23:02 user nova-compute[73572]:   <uuid>00c47a06-2bf8-427d-bcb1-304688584511</uuid>
Aug 26 10:23:02 user nova-compute[73572]:   <name>instance-0000000f</name>
Aug 26 10:23:02 user nova-compute[73572]:   <memory>524288</memory>
Aug 26 10:23:02 user nova-compute[73572]:   <vcpu>1</vcpu>
Aug 26 10:23:02 user nova-compute[73572]:   <metadata>
Aug 26 10:23:02 user nova-compute[73572]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 10:23:02 user nova-compute[73572]:       <nova:package version="0.0.0"/>
Aug 26 10:23:02 user nova-compute[73572]:       <nova:name>tempest-AttachVolumeTestJSON-server-767184678</nova:name>
Aug 26 10:23:02 user nova-compute[73572]:       <nova:creationTime>2023-08-26 10:23:02</nova:creationTime>
Aug 26 10:23:02 user nova-compute[73572]:       <nova:flavor name="m1.tiny">
Aug 26 10:23:02 user nova-compute[73572]:         <nova:memory>512</nova:memory>
Aug 26 10:23:02 user nova-compute[73572]:         <nova:disk>1</nova:disk>
Aug 26 10:23:02 user nova-compute[73572]:         <nova:swap>0</nova:swap>
Aug 26 10:23:02 user nova-compute[73572]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 10:23:02 user nova-compute[73572]:         <nova:vcpus>1</nova:vcpus>
Aug 26 10:23:02 user nova-compute[73572]:       </nova:flavor>
Aug 26 10:23:02 user nova-compute[73572]:       <nova:owner>
Aug 26 10:23:02 user nova-compute[73572]:         <nova:user uuid="2a2ef00486924f318ff1e7e502e835a6">tempest-AttachVolumeTestJSON-716261196-project-member</nova:user>
Aug 26 10:23:02 user nova-compute[73572]:         <nova:project uuid="084df935eab842e58bad79afad7090f3">tempest-AttachVolumeTestJSON-716261196</nova:project>
Aug 26 10:23:02 user nova-compute[73572]:       </nova:owner>
Aug 26 10:23:02 user nova-compute[73572]:       <nova:root type="image" uuid="299da0c9-e1c4-48f0-be55-fbe20dd06bc9"/>
Aug 26 10:23:02 user nova-compute[73572]:       <nova:ports>
Aug 26 10:23:02 user nova-compute[73572]:         <nova:port uuid="d18bfeb9-ad63-41d9-8d66-56df3d3306d8">
Aug 26 10:23:02 user nova-compute[73572]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 26 10:23:02 user nova-compute[73572]:         </nova:port>
Aug 26 10:23:02 user nova-compute[73572]:       </nova:ports>
Aug 26 10:23:02 user nova-compute[73572]:     </nova:instance>
Aug 26 10:23:02 user nova-compute[73572]:   </metadata>
Aug 26 10:23:02 user nova-compute[73572]:   <sysinfo type="smbios">
Aug 26 10:23:02 user nova-compute[73572]:     <system>
Aug 26 10:23:02 user nova-compute[73572]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 10:23:02 user nova-compute[73572]:       <entry name="product">OpenStack Nova</entry>
Aug 26 10:23:02 user nova-compute[73572]:       <entry name="version">0.0.0</entry>
Aug 26 10:23:02 user nova-compute[73572]:       <entry name="serial">00c47a06-2bf8-427d-bcb1-304688584511</entry>
Aug 26 10:23:02 user nova-compute[73572]:       <entry name="uuid">00c47a06-2bf8-427d-bcb1-304688584511</entry>
Aug 26 10:23:02 user nova-compute[73572]:       <entry name="family">Virtual Machine</entry>
Aug 26 10:23:02 user nova-compute[73572]:     </system>
Aug 26 10:23:02 user nova-compute[73572]:   </sysinfo>
Aug 26 10:23:02 user nova-compute[73572]:   <os>
Aug 26 10:23:02 user nova-compute[73572]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 10:23:02 user nova-compute[73572]:     <boot dev="hd"/>
Aug 26 10:23:02 user nova-compute[73572]:     <smbios mode="sysinfo"/>
Aug 26 10:23:02 user nova-compute[73572]:   </os>
Aug 26 10:23:02 user nova-compute[73572]:   <features>
Aug 26 10:23:02 user nova-compute[73572]:     <acpi/>
Aug 26 10:23:02 user nova-compute[73572]:     <apic/>
Aug 26 10:23:02 user nova-compute[73572]:     <vmcoreinfo/>
Aug 26 10:23:02 user nova-compute[73572]:   </features>
Aug 26 10:23:02 user nova-compute[73572]:   <clock offset="utc">
Aug 26 10:23:02 user nova-compute[73572]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 10:23:02 user nova-compute[73572]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 10:23:02 user nova-compute[73572]:     <timer name="hpet" present="no"/>
Aug 26 10:23:02 user nova-compute[73572]:   </clock>
Aug 26 10:23:02 user nova-compute[73572]:   <cpu mode="custom" match="exact">
Aug 26 10:23:02 user nova-compute[73572]:     <model>Nehalem</model>
Aug 26 10:23:02 user nova-compute[73572]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 10:23:02 user nova-compute[73572]:   </cpu>
Aug 26 10:23:02 user nova-compute[73572]:   <devices>
Aug 26 10:23:02 user nova-compute[73572]:     <disk type="file" device="disk">
Aug 26 10:23:02 user nova-compute[73572]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 10:23:02 user nova-compute[73572]:       <source file="/opt/stack/data/nova/instances/00c47a06-2bf8-427d-bcb1-304688584511/disk"/>
Aug 26 10:23:02 user nova-compute[73572]:       <target dev="vda" bus="virtio"/>
Aug 26 10:23:02 user nova-compute[73572]:     </disk>
Aug 26 10:23:02 user nova-compute[73572]:     <interface type="ethernet">
Aug 26 10:23:02 user nova-compute[73572]:       <mac address="fa:16:3e:a2:f2:f4"/>
Aug 26 10:23:02 user nova-compute[73572]:       <model type="virtio"/>
Aug 26 10:23:02 user nova-compute[73572]:       <mtu size="1442"/>
Aug 26 10:23:02 user nova-compute[73572]:       <target dev="tapd18bfeb9-ad"/>
Aug 26 10:23:02 user nova-compute[73572]:     </interface>
Aug 26 10:23:02 user nova-compute[73572]:     <serial type="pty">
Aug 26 10:23:02 user nova-compute[73572]:       <log file="/opt/stack/data/nova/instances/00c47a06-2bf8-427d-bcb1-304688584511/console.log" append="off"/>
Aug 26 10:23:02 user nova-compute[73572]:     </serial>
Aug 26 10:23:02 user nova-compute[73572]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 10:23:02 user nova-compute[73572]:     <video>
Aug 26 10:23:02 user nova-compute[73572]:       <model type="virtio"/>
Aug 26 10:23:02 user nova-compute[73572]:     </video>
Aug 26 10:23:02 user nova-compute[73572]:     <rng model="virtio">
Aug 26 10:23:02 user nova-compute[73572]:       <backend model="random">/dev/urandom</backend>
Aug 26 10:23:02 user nova-compute[73572]:     </rng>
Aug 26 10:23:02 user nova-compute[73572]:     <controller type="usb" index="0" model="none"/>
Aug 26 10:23:02 user nova-compute[73572]:     <memballoon model="virtio">
Aug 26 10:23:02 user nova-compute[73572]:       <stats period="10"/>
Aug 26 10:23:02 user nova-compute[73572]:     </memballoon>
Aug 26 10:23:02 user nova-compute[73572]:   </devices>
Aug 26 10:23:02 user nova-compute[73572]: </domain>
Aug 26 10:23:02 user nova-compute[73572]:  {{(pid=73572) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 10:23:02 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-1bc565cb-93d2-4ebf-b345-10b68c962989 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00c47a06-2bf8-427d-bcb1-304688584511/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:23:02 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-1bc565cb-93d2-4ebf-b345-10b68c962989 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00c47a06-2bf8-427d-bcb1-304688584511/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:23:02 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-1bc565cb-93d2-4ebf-b345-10b68c962989 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00c47a06-2bf8-427d-bcb1-304688584511/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:23:02 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-1bc565cb-93d2-4ebf-b345-10b68c962989 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00c47a06-2bf8-427d-bcb1-304688584511/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:23:02 user nova-compute[73572]: DEBUG nova.objects.instance [None req-1bc565cb-93d2-4ebf-b345-10b68c962989 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Lazy-loading 'trusted_certs' on Instance uuid 00c47a06-2bf8-427d-bcb1-304688584511 {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:23:02 user nova-compute[73572]: DEBUG nova.objects.base [None req-1bc565cb-93d2-4ebf-b345-10b68c962989 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Object Instance<00c47a06-2bf8-427d-bcb1-304688584511> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=73572) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 10:23:02 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-1bc565cb-93d2-4ebf-b345-10b68c962989 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:23:03 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-1bc565cb-93d2-4ebf-b345-10b68c962989 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json" returned: 0 in 0.212s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:23:03 user nova-compute[73572]: DEBUG nova.virt.disk.api [None req-1bc565cb-93d2-4ebf-b345-10b68c962989 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Checking if we can resize image /opt/stack/data/nova/instances/00c47a06-2bf8-427d-bcb1-304688584511/disk. size=1073741824 {{(pid=73572) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 10:23:03 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-1bc565cb-93d2-4ebf-b345-10b68c962989 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00c47a06-2bf8-427d-bcb1-304688584511/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:23:03 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-1bc565cb-93d2-4ebf-b345-10b68c962989 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00c47a06-2bf8-427d-bcb1-304688584511/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:23:03 user nova-compute[73572]: DEBUG nova.virt.disk.api [None req-1bc565cb-93d2-4ebf-b345-10b68c962989 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Cannot resize image /opt/stack/data/nova/instances/00c47a06-2bf8-427d-bcb1-304688584511/disk to a smaller size. {{(pid=73572) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 10:23:03 user nova-compute[73572]: DEBUG nova.objects.instance [None req-1bc565cb-93d2-4ebf-b345-10b68c962989 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Lazy-loading 'migration_context' on Instance uuid 00c47a06-2bf8-427d-bcb1-304688584511 {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:23:03 user nova-compute[73572]: DEBUG nova.objects.base [None req-1bc565cb-93d2-4ebf-b345-10b68c962989 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Object Instance<00c47a06-2bf8-427d-bcb1-304688584511> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=73572) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 10:23:03 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-1bc565cb-93d2-4ebf-b345-10b68c962989 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T10:15:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-767184678',display_name='tempest-AttachVolumeTestJSON-server-767184678',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-767184678',id=15,image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDUM4e46LSrHmno1gp4T3RRXiXfjHx917gcUppmI/sxQPEY8hKY/vqoEhT+Bxby7kAu1Ei3af6xY5p/QME/Z3JthPiVJQ1F4Ur+7V+CECg8DAf4Z/fI85QJzneAszEfomQ==',key_name='tempest-keypair-643189050',keypairs=<?>,launch_index=0,launched_at=2023-08-26T10:15:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='084df935eab842e58bad79afad7090f3',ramdisk_id='',reservation_id='r-d4j1rgky',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-716261196',owner_user_name='tempest-AttachVolumeTestJSON-716261196-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T10:21:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2a2ef00486924f318ff1e7e502e835a6',uuid=00c47a06-2bf8-427d-bcb1-304688584511,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "d18bfeb9-ad63-41d9-8d66-56df3d3306d8", "address": "fa:16:3e:a2:f2:f4", "network": {"id": "81543fb3-a8fe-4e9c-8180-c65fa4dcc9e1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-469390371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "084df935eab842e58bad79afad7090f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd18bfeb9-ad", "ovs_interfaceid": "d18bfeb9-ad63-41d9-8d66-56df3d3306d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 10:23:03 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-1bc565cb-93d2-4ebf-b345-10b68c962989 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Converting VIF {"id": "d18bfeb9-ad63-41d9-8d66-56df3d3306d8", "address": "fa:16:3e:a2:f2:f4", "network": {"id": "81543fb3-a8fe-4e9c-8180-c65fa4dcc9e1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-469390371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "084df935eab842e58bad79afad7090f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd18bfeb9-ad", "ovs_interfaceid": "d18bfeb9-ad63-41d9-8d66-56df3d3306d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:23:03 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-1bc565cb-93d2-4ebf-b345-10b68c962989 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:f2:f4,bridge_name='br-int',has_traffic_filtering=True,id=d18bfeb9-ad63-41d9-8d66-56df3d3306d8,network=Network(81543fb3-a8fe-4e9c-8180-c65fa4dcc9e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd18bfeb9-ad') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:23:03 user nova-compute[73572]: DEBUG os_vif [None req-1bc565cb-93d2-4ebf-b345-10b68c962989 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:f2:f4,bridge_name='br-int',has_traffic_filtering=True,id=d18bfeb9-ad63-41d9-8d66-56df3d3306d8,network=Network(81543fb3-a8fe-4e9c-8180-c65fa4dcc9e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd18bfeb9-ad') {{(pid=73572) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 10:23:03 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:23:03 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:23:03 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 10:23:03 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-5f154516-d90d-402d-b121-0d20af11475f tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Acquiring lock "693f562f-ae3d-4cfb-926e-9990a1a301cb" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:23:03 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-5f154516-d90d-402d-b121-0d20af11475f tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Lock "693f562f-ae3d-4cfb-926e-9990a1a301cb" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:23:03 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:23:03 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd18bfeb9-ad, may_exist=True, interface_attrs={}) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:23:03 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd18bfeb9-ad, col_values=(('external_ids', {'iface-id': 'd18bfeb9-ad63-41d9-8d66-56df3d3306d8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a2:f2:f4', 'vm-uuid': '00c47a06-2bf8-427d-bcb1-304688584511'}),), if_exists=True) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:23:03 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:23:03 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:23:03 user nova-compute[73572]: INFO nova.compute.manager [None req-5f154516-d90d-402d-b121-0d20af11475f tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] [instance: 693f562f-ae3d-4cfb-926e-9990a1a301cb] Detaching volume cfba6f7b-c2ae-436e-8d48-681432c17790
Aug 26 10:23:03 user nova-compute[73572]: INFO os_vif [None req-1bc565cb-93d2-4ebf-b345-10b68c962989 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:f2:f4,bridge_name='br-int',has_traffic_filtering=True,id=d18bfeb9-ad63-41d9-8d66-56df3d3306d8,network=Network(81543fb3-a8fe-4e9c-8180-c65fa4dcc9e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd18bfeb9-ad')
Aug 26 10:23:03 user nova-compute[73572]: INFO nova.virt.block_device [None req-5f154516-d90d-402d-b121-0d20af11475f tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] [instance: 693f562f-ae3d-4cfb-926e-9990a1a301cb] Attempting to driver detach volume cfba6f7b-c2ae-436e-8d48-681432c17790 from mountpoint /dev/vdb
Aug 26 10:23:03 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-2f5282bf-fccb-4746-97cf-c5d584401d8b tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Acquiring lock "693f562f-ae3d-4cfb-926e-9990a1a301cb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:23:03 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-5f154516-d90d-402d-b121-0d20af11475f tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Attempting to detach device vdb from instance 693f562f-ae3d-4cfb-926e-9990a1a301cb from the persistent domain config. {{(pid=73572) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 10:23:03 user nova-compute[73572]: DEBUG nova.virt.libvirt.guest [None req-5f154516-d90d-402d-b121-0d20af11475f tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 10:23:03 user nova-compute[73572]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 10:23:03 user nova-compute[73572]:   <source dev="/dev/sdc"/>
Aug 26 10:23:03 user nova-compute[73572]:   <target dev="vdb" bus="virtio"/>
Aug 26 10:23:03 user nova-compute[73572]:   <serial>cfba6f7b-c2ae-436e-8d48-681432c17790</serial>
Aug 26 10:23:03 user nova-compute[73572]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 10:23:03 user nova-compute[73572]: </disk>
Aug 26 10:23:03 user nova-compute[73572]:  {{(pid=73572) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 10:23:03 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-5f154516-d90d-402d-b121-0d20af11475f tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Successfully detached device vdb from instance 693f562f-ae3d-4cfb-926e-9990a1a301cb from the persistent domain config.
Aug 26 10:23:03 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-5f154516-d90d-402d-b121-0d20af11475f tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 693f562f-ae3d-4cfb-926e-9990a1a301cb from the live domain config. {{(pid=73572) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 10:23:03 user nova-compute[73572]: DEBUG nova.virt.libvirt.guest [None req-5f154516-d90d-402d-b121-0d20af11475f tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 10:23:03 user nova-compute[73572]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 10:23:03 user nova-compute[73572]:   <source dev="/dev/sdc"/>
Aug 26 10:23:03 user nova-compute[73572]:   <target dev="vdb" bus="virtio"/>
Aug 26 10:23:03 user nova-compute[73572]:   <serial>cfba6f7b-c2ae-436e-8d48-681432c17790</serial>
Aug 26 10:23:03 user nova-compute[73572]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 10:23:03 user nova-compute[73572]: </disk>
Aug 26 10:23:03 user nova-compute[73572]:  {{(pid=73572) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 10:23:04 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:23:04 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Received event <DeviceRemovedEvent: 1693045384.5588443, 693f562f-ae3d-4cfb-926e-9990a1a301cb => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73572) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 10:23:04 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-5f154516-d90d-402d-b121-0d20af11475f tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 693f562f-ae3d-4cfb-926e-9990a1a301cb {{(pid=73572) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 10:23:04 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-5f154516-d90d-402d-b121-0d20af11475f tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Successfully detached device vdb from instance 693f562f-ae3d-4cfb-926e-9990a1a301cb from the live domain config.
Aug 26 10:23:04 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5f154516-d90d-402d-b121-0d20af11475f tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] [instance: 693f562f-ae3d-4cfb-926e-9990a1a301cb] calling os-brick to detach iSCSI Volume {{(pid=73572) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 10:23:04 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f154516-d90d-402d-b121-0d20af11475f tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc89c3d6a10>, {'target_iqns': ['iqn.2010-10.org.openstack:cfba6f7b-c2ae-436e-8d48-681432c17790'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VmAriJSx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 10:23:04 user nova-compute[73572]: WARNING os_brick.initiator.connectors.base [None req-5f154516-d90d-402d-b121-0d20af11475f tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 10:23:04 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-5f154516-d90d-402d-b121-0d20af11475f tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 10:23:04 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-5f154516-d90d-402d-b121-0d20af11475f tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 10:23:04 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f154516-d90d-402d-b121-0d20af11475f tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cfba6f7b-c2ae-436e-8d48-681432c17790', 0)] {{(pid=73572) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 10:23:04 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:23:04 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:23:04 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee48390f-e09d-474a-b2bf-97f6f1cbd452]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:19c2d1dd-dfb9-4ac0-8341-35f96b7ade56\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5f3a153b-1b99-4297-ad26-ea58f33330b8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cfba6f7b-c2ae-436e-8d48-681432c17790\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:23:04 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:23:04 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:23:04 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb0486a5-c497-478d-8aa7-d7facb7cb872]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f3a153b-1b99-4297-ad26-ea58f33330b8 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfba6f7b-c2ae-436e-8d48-681432c17790 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19c2d1dd-dfb9-4ac0-8341-35f96b7ade56 (non-flash)\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:23:04 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f154516-d90d-402d-b121-0d20af11475f tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)
Aug 26 10:23:04 user nova-compute[73572]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f3a153b-1b99-4297-ad26-ea58f33330b8 (non-flash)
Aug 26 10:23:04 user nova-compute[73572]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfba6f7b-c2ae-436e-8d48-681432c17790 (non-flash)
Aug 26 10:23:04 user nova-compute[73572]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19c2d1dd-dfb9-4ac0-8341-35f96b7ade56 (non-flash)
Aug 26 10:23:04 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 10:23:04 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f154516-d90d-402d-b121-0d20af11475f tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)
Aug 26 10:23:04 user nova-compute[73572]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f3a153b-1b99-4297-ad26-ea58f33330b8 (non-flash)
Aug 26 10:23:04 user nova-compute[73572]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfba6f7b-c2ae-436e-8d48-681432c17790 (non-flash)
Aug 26 10:23:04 user nova-compute[73572]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19c2d1dd-dfb9-4ac0-8341-35f96b7ade56 (non-flash)
Aug 26 10:23:04 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 10:23:04 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f154516-d90d-402d-b121-0d20af11475f tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc89c48d870>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cfba6f7b-c2ae-436e-8d48-681432c17790'): ({'sdc'}, set())}) {{(pid=73572) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 10:23:04 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-5f154516-d90d-402d-b121-0d20af11475f tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Removing single pathed devices sdc {{(pid=73572) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 10:23:04 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:23:04 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:23:04 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b10f3ea-5950-4400-b312-45fafba4c804]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:23:04 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:23:04 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.024s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:23:04 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[997074b9-c4ec-48bf-a22a-86fe74973e1b]: (4, ('ok\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:23:04 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-5f154516-d90d-402d-b121-0d20af11475f tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Flushing IO for device /dev/sdc {{(pid=73572) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 10:23:04 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:23:04 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:23:04 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c4dfb4f-6b69-4d4d-978a-8cd0576f8ce9]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:23:04 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-5f154516-d90d-402d-b121-0d20af11475f tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73572) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 10:23:04 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:23:04 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.088s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:23:04 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b790bf7-0fd3-4a19-99dc-8dc025aa4f67]: (4, ('1', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:23:04 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-5f154516-d90d-402d-b121-0d20af11475f tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73572) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 10:23:04 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-5f154516-d90d-402d-b121-0d20af11475f tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] SCSI volumes sdc have been removed. {{(pid=73572) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 10:23:04 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f154516-d90d-402d-b121-0d20af11475f tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cfba6f7b-c2ae-436e-8d48-681432c17790')] {{(pid=73572) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 10:23:04 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfba6f7b-c2ae-436e-8d48-681432c17790 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:23:04 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfba6f7b-c2ae-436e-8d48-681432c17790 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:23:04 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cbaa757-8644-41e3-ab9d-2a1c207384ae]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:23:04 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f154516-d90d-402d-b121-0d20af11475f tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:23:04 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfba6f7b-c2ae-436e-8d48-681432c17790 -p 172.16.0.220:3260 --logout {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:23:04 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfba6f7b-c2ae-436e-8d48-681432c17790 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:23:04 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fbcdcf7-00bb-4056-b118-97f1bd94ef4c]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:cfba6f7b-c2ae-436e-8d48-681432c17790, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:cfba6f7b-c2ae-436e-8d48-681432c17790, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:23:04 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f154516-d90d-402d-b121-0d20af11475f tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:cfba6f7b-c2ae-436e-8d48-681432c17790, portal: 172.16.0.220,3260]
Aug 26 10:23:04 user nova-compute[73572]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:cfba6f7b-c2ae-436e-8d48-681432c17790, portal: 172.16.0.220,3260] successful.
Aug 26 10:23:04 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:23:04 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfba6f7b-c2ae-436e-8d48-681432c17790 -p 172.16.0.220:3260 --op delete {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:23:04 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfba6f7b-c2ae-436e-8d48-681432c17790 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:23:04 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[07652031-0a87-4037-bbc1-57120b57bfcb]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:23:04 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f154516-d90d-402d-b121-0d20af11475f tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:23:04 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-5f154516-d90d-402d-b121-0d20af11475f tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.337s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 10:23:04 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f154516-d90d-402d-b121-0d20af11475f tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] <== disconnect_volume: return (338ms) None {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 10:23:04 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5f154516-d90d-402d-b121-0d20af11475f tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] [instance: 693f562f-ae3d-4cfb-926e-9990a1a301cb] Disconnected iSCSI Volume {{(pid=73572) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 10:23:05 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:23:05 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:23:05 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:23:05 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:23:05 user nova-compute[73572]: DEBUG nova.compute.manager [req-a3e5b6a9-605b-41c9-b2fb-ab03309d72b9 req-e79a7895-ca33-47d4-800b-cee2e19f290a service nova] [instance: 00c47a06-2bf8-427d-bcb1-304688584511] Received event network-vif-plugged-d18bfeb9-ad63-41d9-8d66-56df3d3306d8 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:23:05 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-a3e5b6a9-605b-41c9-b2fb-ab03309d72b9 req-e79a7895-ca33-47d4-800b-cee2e19f290a service nova] Acquiring lock "00c47a06-2bf8-427d-bcb1-304688584511-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:23:05 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-a3e5b6a9-605b-41c9-b2fb-ab03309d72b9 req-e79a7895-ca33-47d4-800b-cee2e19f290a service nova] Lock "00c47a06-2bf8-427d-bcb1-304688584511-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:23:05 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-a3e5b6a9-605b-41c9-b2fb-ab03309d72b9 req-e79a7895-ca33-47d4-800b-cee2e19f290a service nova] Lock "00c47a06-2bf8-427d-bcb1-304688584511-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:23:05 user nova-compute[73572]: DEBUG nova.compute.manager [req-a3e5b6a9-605b-41c9-b2fb-ab03309d72b9 req-e79a7895-ca33-47d4-800b-cee2e19f290a service nova] [instance: 00c47a06-2bf8-427d-bcb1-304688584511] No waiting events found dispatching network-vif-plugged-d18bfeb9-ad63-41d9-8d66-56df3d3306d8 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:23:05 user nova-compute[73572]: WARNING nova.compute.manager [req-a3e5b6a9-605b-41c9-b2fb-ab03309d72b9 req-e79a7895-ca33-47d4-800b-cee2e19f290a service nova] [instance: 00c47a06-2bf8-427d-bcb1-304688584511] Received unexpected event network-vif-plugged-d18bfeb9-ad63-41d9-8d66-56df3d3306d8 for instance with vm_state stopped and task_state powering-on.
Aug 26 10:23:05 user nova-compute[73572]: DEBUG nova.objects.instance [None req-5f154516-d90d-402d-b121-0d20af11475f tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Lazy-loading 'flavor' on Instance uuid 693f562f-ae3d-4cfb-926e-9990a1a301cb {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:23:05 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-5f154516-d90d-402d-b121-0d20af11475f tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Lock "693f562f-ae3d-4cfb-926e-9990a1a301cb" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.460s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:23:05 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-2f5282bf-fccb-4746-97cf-c5d584401d8b tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Lock "693f562f-ae3d-4cfb-926e-9990a1a301cb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 2.286s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:23:05 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-2f5282bf-fccb-4746-97cf-c5d584401d8b tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Acquiring lock "693f562f-ae3d-4cfb-926e-9990a1a301cb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:23:05 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-2f5282bf-fccb-4746-97cf-c5d584401d8b tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Lock "693f562f-ae3d-4cfb-926e-9990a1a301cb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:23:05 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-2f5282bf-fccb-4746-97cf-c5d584401d8b tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Lock "693f562f-ae3d-4cfb-926e-9990a1a301cb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:23:05 user nova-compute[73572]: INFO nova.compute.manager [None req-2f5282bf-fccb-4746-97cf-c5d584401d8b tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] [instance: 693f562f-ae3d-4cfb-926e-9990a1a301cb] Terminating instance
Aug 26 10:23:05 user nova-compute[73572]: DEBUG nova.compute.manager [None req-2f5282bf-fccb-4746-97cf-c5d584401d8b tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] [instance: 693f562f-ae3d-4cfb-926e-9990a1a301cb] Start destroying the instance on the hypervisor. {{(pid=73572) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 10:23:05 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:23:05 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:23:05 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:23:06 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:23:06 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:23:06 user nova-compute[73572]: DEBUG nova.compute.manager [req-defbf928-e2e6-4537-ad9a-74d73294e74b req-42569659-bf28-499c-a305-1888ae8f0538 service nova] [instance: 68613b1e-c45c-4fd9-834c-3630ed0f456a] Received event network-changed-aa5ef0b6-0379-4e59-a2c7-e7f1ecd3c7cb {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:23:06 user nova-compute[73572]: DEBUG nova.compute.manager [req-defbf928-e2e6-4537-ad9a-74d73294e74b req-42569659-bf28-499c-a305-1888ae8f0538 service nova] [instance: 68613b1e-c45c-4fd9-834c-3630ed0f456a] Refreshing instance network info cache due to event network-changed-aa5ef0b6-0379-4e59-a2c7-e7f1ecd3c7cb. {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 10:23:06 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-defbf928-e2e6-4537-ad9a-74d73294e74b req-42569659-bf28-499c-a305-1888ae8f0538 service nova] Acquiring lock "refresh_cache-68613b1e-c45c-4fd9-834c-3630ed0f456a" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:23:06 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-defbf928-e2e6-4537-ad9a-74d73294e74b req-42569659-bf28-499c-a305-1888ae8f0538 service nova] Acquired lock "refresh_cache-68613b1e-c45c-4fd9-834c-3630ed0f456a" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:23:06 user nova-compute[73572]: DEBUG nova.network.neutron [req-defbf928-e2e6-4537-ad9a-74d73294e74b req-42569659-bf28-499c-a305-1888ae8f0538 service nova] [instance: 68613b1e-c45c-4fd9-834c-3630ed0f456a] Refreshing network info cache for port aa5ef0b6-0379-4e59-a2c7-e7f1ecd3c7cb {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 10:23:06 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:23:06 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:23:06 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:23:06 user nova-compute[73572]: DEBUG nova.network.neutron [req-defbf928-e2e6-4537-ad9a-74d73294e74b req-42569659-bf28-499c-a305-1888ae8f0538 service nova] [instance: 68613b1e-c45c-4fd9-834c-3630ed0f456a] Updated VIF entry in instance network info cache for port aa5ef0b6-0379-4e59-a2c7-e7f1ecd3c7cb. {{(pid=73572) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 10:23:06 user nova-compute[73572]: DEBUG nova.network.neutron [req-defbf928-e2e6-4537-ad9a-74d73294e74b req-42569659-bf28-499c-a305-1888ae8f0538 service nova] [instance: 68613b1e-c45c-4fd9-834c-3630ed0f456a] Updating instance_info_cache with network_info: [{"id": "aa5ef0b6-0379-4e59-a2c7-e7f1ecd3c7cb", "address": "fa:16:3e:30:8b:7a", "network": {"id": "43215883-3d00-4be7-8c40-bdaf3f01bef9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1088544153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7935bccc360b46b589fd57d53f334595", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa5ef0b6-03", "ovs_interfaceid": "aa5ef0b6-0379-4e59-a2c7-e7f1ecd3c7cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:23:06 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-defbf928-e2e6-4537-ad9a-74d73294e74b req-42569659-bf28-499c-a305-1888ae8f0538 service nova] Releasing lock "refresh_cache-68613b1e-c45c-4fd9-834c-3630ed0f456a" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:23:06 user nova-compute[73572]: INFO nova.virt.libvirt.driver [-] [instance: 693f562f-ae3d-4cfb-926e-9990a1a301cb] Instance destroyed successfully.
Aug 26 10:23:06 user nova-compute[73572]: DEBUG nova.objects.instance [None req-2f5282bf-fccb-4746-97cf-c5d584401d8b tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Lazy-loading 'resources' on Instance uuid 693f562f-ae3d-4cfb-926e-9990a1a301cb {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:23:06 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-2f5282bf-fccb-4746-97cf-c5d584401d8b tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T10:20:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1093763151',display_name='tempest-VolumesSnapshotTestJSON-instance-1093763151',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1093763151',id=27,image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFwm+NjwvlqBsOW7bfl3V2IP/iLmBVWZkppxS5mFMzUHsXvhtjpSG9D8dHVliyOjXqPtpqOOmWZQWqWtF9qI02xKqDgcgqtSbla+oOsPk3fQ6LAPix+dIcsadoNImq5NCA==',key_name='tempest-keypair-694759692',keypairs=<?>,launch_index=0,launched_at=2023-08-26T10:20:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='84e33d9ef6ec45709135edc20c8d7720',ramdisk_id='',reservation_id='r-twq9y5fa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-760064238',owner_user_name='tempest-VolumesSnapshotTestJSON-760064238-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T10:20:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='60fb7b6cd1d14b2ea2e4ab806642e230',uuid=693f562f-ae3d-4cfb-926e-9990a1a301cb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "010eed73-8a66-4648-a616-0b9e7441ab1c", "address": "fa:16:3e:f7:66:5e", "network": {"id": "146a7a16-6dfd-48bd-8c96-766bdbe89bed", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-631761752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84e33d9ef6ec45709135edc20c8d7720", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap010eed73-8a", "ovs_interfaceid": "010eed73-8a66-4648-a616-0b9e7441ab1c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 10:23:06 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-2f5282bf-fccb-4746-97cf-c5d584401d8b tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Converting VIF {"id": "010eed73-8a66-4648-a616-0b9e7441ab1c", "address": "fa:16:3e:f7:66:5e", "network": {"id": "146a7a16-6dfd-48bd-8c96-766bdbe89bed", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-631761752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84e33d9ef6ec45709135edc20c8d7720", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap010eed73-8a", "ovs_interfaceid": "010eed73-8a66-4648-a616-0b9e7441ab1c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:23:06 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-2f5282bf-fccb-4746-97cf-c5d584401d8b tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f7:66:5e,bridge_name='br-int',has_traffic_filtering=True,id=010eed73-8a66-4648-a616-0b9e7441ab1c,network=Network(146a7a16-6dfd-48bd-8c96-766bdbe89bed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap010eed73-8a') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:23:06 user nova-compute[73572]: DEBUG os_vif [None req-2f5282bf-fccb-4746-97cf-c5d584401d8b tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f7:66:5e,bridge_name='br-int',has_traffic_filtering=True,id=010eed73-8a66-4648-a616-0b9e7441ab1c,network=Network(146a7a16-6dfd-48bd-8c96-766bdbe89bed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap010eed73-8a') {{(pid=73572) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 10:23:06 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:23:06 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap010eed73-8a, bridge=br-int, if_exists=True) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:23:06 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:23:06 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:23:06 user nova-compute[73572]: INFO os_vif [None req-2f5282bf-fccb-4746-97cf-c5d584401d8b tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f7:66:5e,bridge_name='br-int',has_traffic_filtering=True,id=010eed73-8a66-4648-a616-0b9e7441ab1c,network=Network(146a7a16-6dfd-48bd-8c96-766bdbe89bed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap010eed73-8a')
Aug 26 10:23:06 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2f5282bf-fccb-4746-97cf-c5d584401d8b tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] [instance: 693f562f-ae3d-4cfb-926e-9990a1a301cb] calling os-brick to detach iSCSI Volume {{(pid=73572) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 10:23:06 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f5282bf-fccb-4746-97cf-c5d584401d8b tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc89c3d6a10>, {'target_iqns': ['iqn.2010-10.org.openstack:cfba6f7b-c2ae-436e-8d48-681432c17790'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VmAriJSx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 10:23:06 user nova-compute[73572]: WARNING os_brick.initiator.connectors.base [None req-2f5282bf-fccb-4746-97cf-c5d584401d8b tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 10:23:06 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-2f5282bf-fccb-4746-97cf-c5d584401d8b tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 10:23:06 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-2f5282bf-fccb-4746-97cf-c5d584401d8b tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 10:23:06 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f5282bf-fccb-4746-97cf-c5d584401d8b tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cfba6f7b-c2ae-436e-8d48-681432c17790', 0)] {{(pid=73572) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 10:23:06 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:23:06 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:23:06 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[57412869-d84a-4955-ab2a-caf890b4b21f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:19c2d1dd-dfb9-4ac0-8341-35f96b7ade56\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5f3a153b-1b99-4297-ad26-ea58f33330b8\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:23:06 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:23:06 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:23:06 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[6489aa71-9e36-4c50-87fc-5d7834911912]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f3a153b-1b99-4297-ad26-ea58f33330b8 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19c2d1dd-dfb9-4ac0-8341-35f96b7ade56 (non-flash)\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:23:06 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f5282bf-fccb-4746-97cf-c5d584401d8b tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)
Aug 26 10:23:06 user nova-compute[73572]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f3a153b-1b99-4297-ad26-ea58f33330b8 (non-flash)
Aug 26 10:23:06 user nova-compute[73572]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19c2d1dd-dfb9-4ac0-8341-35f96b7ade56 (non-flash)
Aug 26 10:23:06 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 10:23:06 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f5282bf-fccb-4746-97cf-c5d584401d8b tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)
Aug 26 10:23:06 user nova-compute[73572]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f3a153b-1b99-4297-ad26-ea58f33330b8 (non-flash)
Aug 26 10:23:06 user nova-compute[73572]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19c2d1dd-dfb9-4ac0-8341-35f96b7ade56 (non-flash)
Aug 26 10:23:06 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 10:23:06 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f5282bf-fccb-4746-97cf-c5d584401d8b tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc89c5b2e60>, {}) {{(pid=73572) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 10:23:06 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f5282bf-fccb-4746-97cf-c5d584401d8b tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Disconnecting from: [] {{(pid=73572) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 10:23:06 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-2f5282bf-fccb-4746-97cf-c5d584401d8b tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.048s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 10:23:06 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f5282bf-fccb-4746-97cf-c5d584401d8b tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] <== disconnect_volume: return (49ms) None {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 10:23:06 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2f5282bf-fccb-4746-97cf-c5d584401d8b tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] [instance: 693f562f-ae3d-4cfb-926e-9990a1a301cb] Disconnected iSCSI Volume {{(pid=73572) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 10:23:06 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-2f5282bf-fccb-4746-97cf-c5d584401d8b tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] [instance: 693f562f-ae3d-4cfb-926e-9990a1a301cb] Deleting instance files /opt/stack/data/nova/instances/693f562f-ae3d-4cfb-926e-9990a1a301cb_del
Aug 26 10:23:06 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-2f5282bf-fccb-4746-97cf-c5d584401d8b tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] [instance: 693f562f-ae3d-4cfb-926e-9990a1a301cb] Deletion of /opt/stack/data/nova/instances/693f562f-ae3d-4cfb-926e-9990a1a301cb_del complete
Aug 26 10:23:06 user nova-compute[73572]: INFO nova.compute.manager [None req-2f5282bf-fccb-4746-97cf-c5d584401d8b tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] [instance: 693f562f-ae3d-4cfb-926e-9990a1a301cb] Took 0.91 seconds to destroy the instance on the hypervisor.
Aug 26 10:23:06 user nova-compute[73572]: DEBUG oslo.service.loopingcall [None req-2f5282bf-fccb-4746-97cf-c5d584401d8b tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73572) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 10:23:06 user nova-compute[73572]: DEBUG nova.compute.manager [-] [instance: 693f562f-ae3d-4cfb-926e-9990a1a301cb] Deallocating network for instance {{(pid=73572) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 10:23:06 user nova-compute[73572]: DEBUG nova.network.neutron [-] [instance: 693f562f-ae3d-4cfb-926e-9990a1a301cb] deallocate_for_instance() {{(pid=73572) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 10:23:07 user nova-compute[73572]: DEBUG nova.virt.driver [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Emitting event <LifecycleEvent: 1693045387.5522795, 00c47a06-2bf8-427d-bcb1-304688584511 => Resumed> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:23:07 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 00c47a06-2bf8-427d-bcb1-304688584511] VM Resumed (Lifecycle Event)
Aug 26 10:23:07 user nova-compute[73572]: DEBUG nova.compute.manager [None req-1bc565cb-93d2-4ebf-b345-10b68c962989 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] [instance: 00c47a06-2bf8-427d-bcb1-304688584511] Instance event wait completed in 0 seconds for  {{(pid=73572) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 10:23:07 user nova-compute[73572]: INFO nova.virt.libvirt.driver [-] [instance: 00c47a06-2bf8-427d-bcb1-304688584511] Instance rebooted successfully.
Aug 26 10:23:07 user nova-compute[73572]: DEBUG nova.compute.manager [None req-1bc565cb-93d2-4ebf-b345-10b68c962989 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] [instance: 00c47a06-2bf8-427d-bcb1-304688584511] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:23:07 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 00c47a06-2bf8-427d-bcb1-304688584511] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:23:07 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 00c47a06-2bf8-427d-bcb1-304688584511] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=73572) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 10:23:07 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 00c47a06-2bf8-427d-bcb1-304688584511] During sync_power_state the instance has a pending task (powering-on). Skip.
Aug 26 10:23:07 user nova-compute[73572]: DEBUG nova.virt.driver [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Emitting event <LifecycleEvent: 1693045387.5532737, 00c47a06-2bf8-427d-bcb1-304688584511 => Started> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:23:07 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 00c47a06-2bf8-427d-bcb1-304688584511] VM Started (Lifecycle Event)
Aug 26 10:23:07 user nova-compute[73572]: DEBUG nova.compute.manager [req-404dd221-4172-4936-85c7-7a76df921c14 req-5d19b443-ea81-4c4d-a1ed-1ade2cd7bb27 service nova] [instance: 00c47a06-2bf8-427d-bcb1-304688584511] Received event network-vif-plugged-d18bfeb9-ad63-41d9-8d66-56df3d3306d8 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:23:07 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-404dd221-4172-4936-85c7-7a76df921c14 req-5d19b443-ea81-4c4d-a1ed-1ade2cd7bb27 service nova] Acquiring lock "00c47a06-2bf8-427d-bcb1-304688584511-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:23:07 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-404dd221-4172-4936-85c7-7a76df921c14 req-5d19b443-ea81-4c4d-a1ed-1ade2cd7bb27 service nova] Lock "00c47a06-2bf8-427d-bcb1-304688584511-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:23:07 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-404dd221-4172-4936-85c7-7a76df921c14 req-5d19b443-ea81-4c4d-a1ed-1ade2cd7bb27 service nova] Lock "00c47a06-2bf8-427d-bcb1-304688584511-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:23:07 user nova-compute[73572]: DEBUG nova.compute.manager [req-404dd221-4172-4936-85c7-7a76df921c14 req-5d19b443-ea81-4c4d-a1ed-1ade2cd7bb27 service nova] [instance: 00c47a06-2bf8-427d-bcb1-304688584511] No waiting events found dispatching network-vif-plugged-d18bfeb9-ad63-41d9-8d66-56df3d3306d8 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:23:07 user nova-compute[73572]: WARNING nova.compute.manager [req-404dd221-4172-4936-85c7-7a76df921c14 req-5d19b443-ea81-4c4d-a1ed-1ade2cd7bb27 service nova] [instance: 00c47a06-2bf8-427d-bcb1-304688584511] Received unexpected event network-vif-plugged-d18bfeb9-ad63-41d9-8d66-56df3d3306d8 for instance with vm_state stopped and task_state powering-on.
Aug 26 10:23:07 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 00c47a06-2bf8-427d-bcb1-304688584511] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:23:07 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 00c47a06-2bf8-427d-bcb1-304688584511] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=73572) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 10:23:07 user nova-compute[73572]: DEBUG nova.network.neutron [-] [instance: 693f562f-ae3d-4cfb-926e-9990a1a301cb] Updating instance_info_cache with network_info: [] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:23:07 user nova-compute[73572]: INFO nova.compute.manager [-] [instance: 693f562f-ae3d-4cfb-926e-9990a1a301cb] Took 1.04 seconds to deallocate network for instance.
Aug 26 10:23:07 user nova-compute[73572]: WARNING nova.volume.cinder [None req-2f5282bf-fccb-4746-97cf-c5d584401d8b tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Attachment da987c18-3c55-486c-9e27-fb6e69f2f2c7 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = da987c18-3c55-486c-9e27-fb6e69f2f2c7. (HTTP 404) (Request-ID: req-9b2c248f-e030-46bf-aa18-0d4588fc52c2)
Aug 26 10:23:07 user nova-compute[73572]: INFO nova.compute.manager [None req-2f5282bf-fccb-4746-97cf-c5d584401d8b tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] [instance: 693f562f-ae3d-4cfb-926e-9990a1a301cb] Took 0.02 seconds to detach 1 volumes for instance.
Aug 26 10:23:07 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-2f5282bf-fccb-4746-97cf-c5d584401d8b tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:23:07 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-2f5282bf-fccb-4746-97cf-c5d584401d8b tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:23:08 user nova-compute[73572]: DEBUG nova.compute.provider_tree [None req-2f5282bf-fccb-4746-97cf-c5d584401d8b tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Inventory has not changed in ProviderTree for provider: e2cec974-59b2-4c77-a53d-a7f4e5a30d75 {{(pid=73572) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 10:23:08 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-2f5282bf-fccb-4746-97cf-c5d584401d8b tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Inventory has not changed for provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73572) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 10:23:08 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-2f5282bf-fccb-4746-97cf-c5d584401d8b tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.393s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:23:08 user nova-compute[73572]: INFO nova.scheduler.client.report [None req-2f5282bf-fccb-4746-97cf-c5d584401d8b tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Deleted allocations for instance 693f562f-ae3d-4cfb-926e-9990a1a301cb
Aug 26 10:23:08 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-2f5282bf-fccb-4746-97cf-c5d584401d8b tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Lock "693f562f-ae3d-4cfb-926e-9990a1a301cb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.556s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:23:09 user nova-compute[73572]: DEBUG nova.compute.manager [req-0e080a6c-4703-4951-9835-d9ebfcf0dc6d req-10dc15b4-d712-45bd-8884-c6349fe1eb8b service nova] [instance: 693f562f-ae3d-4cfb-926e-9990a1a301cb] Received event network-vif-deleted-010eed73-8a66-4648-a616-0b9e7441ab1c {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:23:10 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:23:11 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:23:14 user nova-compute[73572]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693045379.6033232, d2970584-8c2a-4f99-922c-d66d59489504 => Stopped> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:23:14 user nova-compute[73572]: INFO nova.compute.manager [-] [instance: d2970584-8c2a-4f99-922c-d66d59489504] VM Stopped (Lifecycle Event)
Aug 26 10:23:14 user nova-compute[73572]: DEBUG nova.compute.manager [None req-3fdae41d-161e-400f-a289-e478cf6b07a4 None None] [instance: d2970584-8c2a-4f99-922c-d66d59489504] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:23:15 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:23:16 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:23:18 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:23:18 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Starting heal instance info cache {{(pid=73572) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 10:23:18 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquiring lock "refresh_cache-0fe47a17-4ffb-48ce-b0f6-a9b43002bd55" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:23:18 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquired lock "refresh_cache-0fe47a17-4ffb-48ce-b0f6-a9b43002bd55" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:23:18 user nova-compute[73572]: DEBUG nova.network.neutron [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] [instance: 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55] Forcefully refreshing network info cache for instance {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 10:23:19 user nova-compute[73572]: DEBUG nova.network.neutron [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] [instance: 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55] Updating instance_info_cache with network_info: [{"id": "ebf9f385-e59b-4060-9bf9-a8d2006327b4", "address": "fa:16:3e:49:23:6a", "network": {"id": "7c89c22a-96d4-4e60-9c4c-b5a82a7eca55", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1976182948-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d2c922711fb445aa99ae4f30b802c12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebf9f385-e5", "ovs_interfaceid": "ebf9f385-e59b-4060-9bf9-a8d2006327b4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:23:19 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Releasing lock "refresh_cache-0fe47a17-4ffb-48ce-b0f6-a9b43002bd55" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:23:19 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] [instance: 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55] Updated the network info_cache for instance {{(pid=73572) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 10:23:19 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:23:19 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:23:19 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:23:19 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:23:19 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73572) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 10:23:19 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:23:19 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:23:20 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:23:21 user nova-compute[73572]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693045386.6864707, 693f562f-ae3d-4cfb-926e-9990a1a301cb => Stopped> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:23:21 user nova-compute[73572]: INFO nova.compute.manager [-] [instance: 693f562f-ae3d-4cfb-926e-9990a1a301cb] VM Stopped (Lifecycle Event)
Aug 26 10:23:21 user nova-compute[73572]: DEBUG nova.compute.manager [None req-f1aff856-9119-4115-a099-a6776f5310a3 None None] [instance: 693f562f-ae3d-4cfb-926e-9990a1a301cb] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:23:21 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:23:22 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:23:23 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:23:23 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:23:23 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:23:23 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:23:23 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:23:23 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Auditing locally available compute resources for user (node: user) {{(pid=73572) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 10:23:24 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c785b609-0068-442f-91f5-d26e888a993f/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:23:24 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c785b609-0068-442f-91f5-d26e888a993f/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:23:24 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c785b609-0068-442f-91f5-d26e888a993f/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:23:24 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-dab374e2-d931-4ffa-b271-3c79ce2d8f66 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Acquiring lock "0f46f84e-9cda-4450-a8a1-f6c08956324b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:23:24 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-dab374e2-d931-4ffa-b271-3c79ce2d8f66 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Lock "0f46f84e-9cda-4450-a8a1-f6c08956324b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:23:24 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c785b609-0068-442f-91f5-d26e888a993f/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:23:24 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e468b473-515f-41ad-a75c-65d4c6d575c8/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:23:24 user nova-compute[73572]: DEBUG nova.compute.manager [None req-dab374e2-d931-4ffa-b271-3c79ce2d8f66 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 0f46f84e-9cda-4450-a8a1-f6c08956324b] Starting instance... {{(pid=73572) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 10:23:24 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-dab374e2-d931-4ffa-b271-3c79ce2d8f66 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:23:24 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-dab374e2-d931-4ffa-b271-3c79ce2d8f66 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:23:24 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-dab374e2-d931-4ffa-b271-3c79ce2d8f66 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73572) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 10:23:24 user nova-compute[73572]: INFO nova.compute.claims [None req-dab374e2-d931-4ffa-b271-3c79ce2d8f66 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 0f46f84e-9cda-4450-a8a1-f6c08956324b] Claim successful on node user
Aug 26 10:23:24 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e468b473-515f-41ad-a75c-65d4c6d575c8/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:23:24 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e468b473-515f-41ad-a75c-65d4c6d575c8/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:23:24 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e468b473-515f-41ad-a75c-65d4c6d575c8/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:23:24 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44a737bf-3704-4193-8d24-b8d132267279/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:23:24 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44a737bf-3704-4193-8d24-b8d132267279/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:23:24 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44a737bf-3704-4193-8d24-b8d132267279/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:23:25 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:23:25 user nova-compute[73572]: DEBUG nova.compute.provider_tree [None req-dab374e2-d931-4ffa-b271-3c79ce2d8f66 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Inventory has not changed in ProviderTree for provider: e2cec974-59b2-4c77-a53d-a7f4e5a30d75 {{(pid=73572) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 10:23:25 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-dab374e2-d931-4ffa-b271-3c79ce2d8f66 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Inventory has not changed for provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73572) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 10:23:25 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-dab374e2-d931-4ffa-b271-3c79ce2d8f66 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.565s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:23:25 user nova-compute[73572]: DEBUG nova.compute.manager [None req-dab374e2-d931-4ffa-b271-3c79ce2d8f66 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 0f46f84e-9cda-4450-a8a1-f6c08956324b] Start building networks asynchronously for instance. {{(pid=73572) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 10:23:25 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44a737bf-3704-4193-8d24-b8d132267279/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:23:25 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=73572) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 10:23:25 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00c47a06-2bf8-427d-bcb1-304688584511/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:23:25 user nova-compute[73572]: DEBUG nova.compute.manager [None req-dab374e2-d931-4ffa-b271-3c79ce2d8f66 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 0f46f84e-9cda-4450-a8a1-f6c08956324b] Allocating IP information in the background. {{(pid=73572) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 10:23:25 user nova-compute[73572]: DEBUG nova.network.neutron [None req-dab374e2-d931-4ffa-b271-3c79ce2d8f66 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 0f46f84e-9cda-4450-a8a1-f6c08956324b] allocate_for_instance() {{(pid=73572) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 10:23:25 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-dab374e2-d931-4ffa-b271-3c79ce2d8f66 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 0f46f84e-9cda-4450-a8a1-f6c08956324b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 10:23:25 user nova-compute[73572]: DEBUG nova.compute.manager [None req-dab374e2-d931-4ffa-b271-3c79ce2d8f66 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 0f46f84e-9cda-4450-a8a1-f6c08956324b] Start building block device mappings for instance. {{(pid=73572) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 10:23:25 user nova-compute[73572]: INFO nova.virt.block_device [None req-dab374e2-d931-4ffa-b271-3c79ce2d8f66 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 0f46f84e-9cda-4450-a8a1-f6c08956324b] Booting with volume snapshot 93f926f1-06e9-43f5-83ad-ebaf6ef54cc2 at /dev/vda
Aug 26 10:23:25 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00c47a06-2bf8-427d-bcb1-304688584511/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:23:25 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00c47a06-2bf8-427d-bcb1-304688584511/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:23:25 user nova-compute[73572]: DEBUG nova.policy [None req-dab374e2-d931-4ffa-b271-3c79ce2d8f66 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e1e80942e5db41c782bda686b10e2e4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc130586d9f4581953f1b8ae1c4465e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73572) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 10:23:25 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00c47a06-2bf8-427d-bcb1-304688584511/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:23:25 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86923c1a-89a5-4e7a-b488-8bf3a013bf83/disk.rescue --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:23:25 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86923c1a-89a5-4e7a-b488-8bf3a013bf83/disk.rescue --force-share --output=json" returned: 0 in 0.199s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:23:25 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86923c1a-89a5-4e7a-b488-8bf3a013bf83/disk.rescue --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:23:25 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86923c1a-89a5-4e7a-b488-8bf3a013bf83/disk.rescue --force-share --output=json" returned: 0 in 0.193s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:23:25 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86923c1a-89a5-4e7a-b488-8bf3a013bf83/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:23:26 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86923c1a-89a5-4e7a-b488-8bf3a013bf83/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:23:26 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86923c1a-89a5-4e7a-b488-8bf3a013bf83/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:23:26 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86923c1a-89a5-4e7a-b488-8bf3a013bf83/disk --force-share --output=json" returned: 0 in 0.322s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:23:26 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=73572) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 10:23:26 user nova-compute[73572]: DEBUG nova.network.neutron [None req-dab374e2-d931-4ffa-b271-3c79ce2d8f66 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 0f46f84e-9cda-4450-a8a1-f6c08956324b] Successfully created port: b4dfa21c-473c-4801-ae7a-aac3ac21b655 {{(pid=73572) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 10:23:26 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68613b1e-c45c-4fd9-834c-3630ed0f456a/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:23:26 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68613b1e-c45c-4fd9-834c-3630ed0f456a/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:23:26 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68613b1e-c45c-4fd9-834c-3630ed0f456a/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:23:26 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:23:26 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68613b1e-c45c-4fd9-834c-3630ed0f456a/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:23:26 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bc7408c-28d0-4735-95ef-3a03dc7a86ba/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:23:27 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bc7408c-28d0-4735-95ef-3a03dc7a86ba/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:23:27 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bc7408c-28d0-4735-95ef-3a03dc7a86ba/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:23:27 user nova-compute[73572]: DEBUG nova.network.neutron [None req-dab374e2-d931-4ffa-b271-3c79ce2d8f66 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 0f46f84e-9cda-4450-a8a1-f6c08956324b] Successfully updated port: b4dfa21c-473c-4801-ae7a-aac3ac21b655 {{(pid=73572) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 10:23:27 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bc7408c-28d0-4735-95ef-3a03dc7a86ba/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:23:27 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-dab374e2-d931-4ffa-b271-3c79ce2d8f66 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Acquiring lock "refresh_cache-0f46f84e-9cda-4450-a8a1-f6c08956324b" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:23:27 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-dab374e2-d931-4ffa-b271-3c79ce2d8f66 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Acquired lock "refresh_cache-0f46f84e-9cda-4450-a8a1-f6c08956324b" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:23:27 user nova-compute[73572]: DEBUG nova.network.neutron [None req-dab374e2-d931-4ffa-b271-3c79ce2d8f66 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 0f46f84e-9cda-4450-a8a1-f6c08956324b] Building network info cache for instance {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 10:23:27 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fe47a17-4ffb-48ce-b0f6-a9b43002bd55/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:23:27 user nova-compute[73572]: DEBUG nova.compute.manager [req-bb6c1877-e35e-4934-826a-a41dff0d780c req-8331677d-396c-4c11-a271-2b69dfcae979 service nova] [instance: 0f46f84e-9cda-4450-a8a1-f6c08956324b] Received event network-changed-b4dfa21c-473c-4801-ae7a-aac3ac21b655 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:23:27 user nova-compute[73572]: DEBUG nova.compute.manager [req-bb6c1877-e35e-4934-826a-a41dff0d780c req-8331677d-396c-4c11-a271-2b69dfcae979 service nova] [instance: 0f46f84e-9cda-4450-a8a1-f6c08956324b] Refreshing instance network info cache due to event network-changed-b4dfa21c-473c-4801-ae7a-aac3ac21b655. {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 10:23:27 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-bb6c1877-e35e-4934-826a-a41dff0d780c req-8331677d-396c-4c11-a271-2b69dfcae979 service nova] Acquiring lock "refresh_cache-0f46f84e-9cda-4450-a8a1-f6c08956324b" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:23:27 user nova-compute[73572]: DEBUG nova.network.neutron [None req-dab374e2-d931-4ffa-b271-3c79ce2d8f66 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 0f46f84e-9cda-4450-a8a1-f6c08956324b] Instance cache missing network info. {{(pid=73572) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 10:23:27 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fe47a17-4ffb-48ce-b0f6-a9b43002bd55/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:23:27 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fe47a17-4ffb-48ce-b0f6-a9b43002bd55/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:23:27 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fe47a17-4ffb-48ce-b0f6-a9b43002bd55/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:23:27 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73572) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 10:23:27 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2eaea7c2-a5c0-4950-b033-0012b5cec0ee/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:23:27 user nova-compute[73572]: DEBUG nova.network.neutron [None req-dab374e2-d931-4ffa-b271-3c79ce2d8f66 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 0f46f84e-9cda-4450-a8a1-f6c08956324b] Updating instance_info_cache with network_info: [{"id": "b4dfa21c-473c-4801-ae7a-aac3ac21b655", "address": "fa:16:3e:1e:fd:c8", "network": {"id": "c520ee18-34a7-4781-bc97-419e9a702d40", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-280196989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfc130586d9f4581953f1b8ae1c4465e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4dfa21c-47", "ovs_interfaceid": "b4dfa21c-473c-4801-ae7a-aac3ac21b655", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:23:27 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-dab374e2-d931-4ffa-b271-3c79ce2d8f66 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Releasing lock "refresh_cache-0f46f84e-9cda-4450-a8a1-f6c08956324b" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:23:27 user nova-compute[73572]: DEBUG nova.compute.manager [None req-dab374e2-d931-4ffa-b271-3c79ce2d8f66 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 0f46f84e-9cda-4450-a8a1-f6c08956324b] Instance network_info: |[{"id": "b4dfa21c-473c-4801-ae7a-aac3ac21b655", "address": "fa:16:3e:1e:fd:c8", "network": {"id": "c520ee18-34a7-4781-bc97-419e9a702d40", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-280196989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfc130586d9f4581953f1b8ae1c4465e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4dfa21c-47", "ovs_interfaceid": "b4dfa21c-473c-4801-ae7a-aac3ac21b655", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73572) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 10:23:27 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-bb6c1877-e35e-4934-826a-a41dff0d780c req-8331677d-396c-4c11-a271-2b69dfcae979 service nova] Acquired lock "refresh_cache-0f46f84e-9cda-4450-a8a1-f6c08956324b" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:23:27 user nova-compute[73572]: DEBUG nova.network.neutron [req-bb6c1877-e35e-4934-826a-a41dff0d780c req-8331677d-396c-4c11-a271-2b69dfcae979 service nova] [instance: 0f46f84e-9cda-4450-a8a1-f6c08956324b] Refreshing network info cache for port b4dfa21c-473c-4801-ae7a-aac3ac21b655 {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 10:23:27 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2eaea7c2-a5c0-4950-b033-0012b5cec0ee/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:23:27 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2eaea7c2-a5c0-4950-b033-0012b5cec0ee/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:23:28 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2eaea7c2-a5c0-4950-b033-0012b5cec0ee/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:23:28 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f3db0fa-682c-4b33-966b-9e50b7349b6e/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:23:28 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f3db0fa-682c-4b33-966b-9e50b7349b6e/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:23:28 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f3db0fa-682c-4b33-966b-9e50b7349b6e/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:23:28 user nova-compute[73572]: DEBUG nova.network.neutron [req-bb6c1877-e35e-4934-826a-a41dff0d780c req-8331677d-396c-4c11-a271-2b69dfcae979 service nova] [instance: 0f46f84e-9cda-4450-a8a1-f6c08956324b] Updated VIF entry in instance network info cache for port b4dfa21c-473c-4801-ae7a-aac3ac21b655. {{(pid=73572) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 10:23:28 user nova-compute[73572]: DEBUG nova.network.neutron [req-bb6c1877-e35e-4934-826a-a41dff0d780c req-8331677d-396c-4c11-a271-2b69dfcae979 service nova] [instance: 0f46f84e-9cda-4450-a8a1-f6c08956324b] Updating instance_info_cache with network_info: [{"id": "b4dfa21c-473c-4801-ae7a-aac3ac21b655", "address": "fa:16:3e:1e:fd:c8", "network": {"id": "c520ee18-34a7-4781-bc97-419e9a702d40", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-280196989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfc130586d9f4581953f1b8ae1c4465e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4dfa21c-47", "ovs_interfaceid": "b4dfa21c-473c-4801-ae7a-aac3ac21b655", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:23:28 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-bb6c1877-e35e-4934-826a-a41dff0d780c req-8331677d-396c-4c11-a271-2b69dfcae979 service nova] Releasing lock "refresh_cache-0f46f84e-9cda-4450-a8a1-f6c08956324b" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:23:28 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f3db0fa-682c-4b33-966b-9e50b7349b6e/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:23:28 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:23:28 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:23:28 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Hypervisor/Node resource view: name=user free_ram=7178MB free_disk=25.073200225830078GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=73572) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 10:23:28 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:23:28 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:23:29 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance c785b609-0068-442f-91f5-d26e888a993f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:23:29 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance 14fab12e-52be-4fe6-8777-bc7ebf3c25f1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:23:29 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance 00c47a06-2bf8-427d-bcb1-304688584511 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:23:29 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance 2eaea7c2-a5c0-4950-b033-0012b5cec0ee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:23:29 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance 86923c1a-89a5-4e7a-b488-8bf3a013bf83 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:23:29 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:23:29 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance 44a737bf-3704-4193-8d24-b8d132267279 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:23:29 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance e468b473-515f-41ad-a75c-65d4c6d575c8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:23:29 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance 68613b1e-c45c-4fd9-834c-3630ed0f456a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:23:29 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance 1bc7408c-28d0-4735-95ef-3a03dc7a86ba actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:23:29 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance 1f3db0fa-682c-4b33-966b-9e50b7349b6e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:23:29 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance 0f46f84e-9cda-4450-a8a1-f6c08956324b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:23:29 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=73572) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 10:23:29 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=73572) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 10:23:29 user nova-compute[73572]: DEBUG nova.compute.provider_tree [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Inventory has not changed in ProviderTree for provider: e2cec974-59b2-4c77-a53d-a7f4e5a30d75 {{(pid=73572) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 10:23:29 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Inventory has not changed for provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73572) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 10:23:29 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Compute_service record updated for user:user {{(pid=73572) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 10:23:29 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.514s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:23:30 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:23:31 user nova-compute[73572]: DEBUG os_brick.utils [None req-dab374e2-d931-4ffa-b271-3c79ce2d8f66 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 10:23:31 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:23:31 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:23:31 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[db10aa82-8318-472c-906b-f794e94689cb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:de8a79ed912\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:23:31 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:23:31 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:23:31 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e539f0a-76c5-494e-bfac-30ceb733ee2c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:23:31 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:23:31 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:23:31 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b49aa09-0cf9-47dd-aaf4-b3d6e02811e7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:23:31 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[cea92239-a0bc-43b5-aa02-12d30405a19a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:23:31 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-dab374e2-d931-4ffa-b271-3c79ce2d8f66 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Running cmd (subprocess): nvme version {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:23:31 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-dab374e2-d931-4ffa-b271-3c79ce2d8f66 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] 'nvme version' failed. Not Retrying. {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 10:23:31 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.nvmeof [None req-dab374e2-d931-4ffa-b271-3c79ce2d8f66 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] nvme not present on system {{(pid=73572) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 10:23:31 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:23:31 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 10:23:31 user nova-compute[73572]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 10:23:31 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac67e485-f713-4204-90b3-5bddfd08a4fa]: (4, '') {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:23:31 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.lightos [None req-dab374e2-d931-4ffa-b271-3c79ce2d8f66 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73572) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 10:23:31 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.lightos [None req-dab374e2-d931-4ffa-b271-3c79ce2d8f66 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73572) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 10:23:31 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.lightos [None req-dab374e2-d931-4ffa-b271-3c79ce2d8f66 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] LIGHTOS: no hostnqn found. {{(pid=73572) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 10:23:31 user nova-compute[73572]: DEBUG os_brick.utils [None req-dab374e2-d931-4ffa-b271-3c79ce2d8f66 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:de8a79ed912', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 10:23:31 user nova-compute[73572]: DEBUG nova.virt.block_device [None req-dab374e2-d931-4ffa-b271-3c79ce2d8f66 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 0f46f84e-9cda-4450-a8a1-f6c08956324b] Updating existing volume attachment record: 7ba5548a-4cd5-4c59-a5ba-993e1e4ebffc {{(pid=73572) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 10:23:31 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:23:35 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:23:36 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:23:40 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:23:41 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:23:42 user nova-compute[73572]: DEBUG nova.compute.manager [None req-dab374e2-d931-4ffa-b271-3c79ce2d8f66 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 0f46f84e-9cda-4450-a8a1-f6c08956324b] Start spawning the instance on the hypervisor. {{(pid=73572) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 10:23:42 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-dab374e2-d931-4ffa-b271-3c79ce2d8f66 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 0f46f84e-9cda-4450-a8a1-f6c08956324b] Creating instance directory {{(pid=73572) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 10:23:42 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-dab374e2-d931-4ffa-b271-3c79ce2d8f66 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 0f46f84e-9cda-4450-a8a1-f6c08956324b] Creating image(s)
Aug 26 10:23:42 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-dab374e2-d931-4ffa-b271-3c79ce2d8f66 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 0f46f84e-9cda-4450-a8a1-f6c08956324b] Did not create local disks {{(pid=73572) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 26 10:23:42 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-dab374e2-d931-4ffa-b271-3c79ce2d8f66 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 0f46f84e-9cda-4450-a8a1-f6c08956324b] Ensure instance console log exists: /opt/stack/data/nova/instances/0f46f84e-9cda-4450-a8a1-f6c08956324b/console.log {{(pid=73572) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 10:23:42 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-dab374e2-d931-4ffa-b271-3c79ce2d8f66 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:23:42 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-dab374e2-d931-4ffa-b271-3c79ce2d8f66 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:23:42 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-dab374e2-d931-4ffa-b271-3c79ce2d8f66 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:23:42 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-dab374e2-d931-4ffa-b271-3c79ce2d8f66 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 0f46f84e-9cda-4450-a8a1-f6c08956324b] Start _get_guest_xml network_info=[{"id": "b4dfa21c-473c-4801-ae7a-aac3ac21b655", "address": "fa:16:3e:1e:fd:c8", "network": {"id": "c520ee18-34a7-4781-bc97-419e9a702d40", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-280196989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfc130586d9f4581953f1b8ae1c4465e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4dfa21c-47", "ovs_interfaceid": "b4dfa21c-473c-4801-ae7a-aac3ac21b655", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'disk_bus': 'virtio', 'boot_index': 0, 'mount_device': '/dev/vda', 'attachment_id': '7ba5548a-4cd5-4c59-a5ba-993e1e4ebffc', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:9dbf6103-5796-4273-a8a9-81d262560347'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZpoyDOed', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '0f46f84e-9cda-4450-a8a1-f6c08956324b', 'attached_at': '', 'detached_at': '', 'volume_id': '9dbf6103-5796-4273-a8a9-81d262560347', 'serial': '9dbf6103-5796-4273-a8a9-81d262560347'}, 'guest_format': None, 'device_type': 'disk', 'volume_type': None} {{(pid=73572) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 10:23:42 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-dab374e2-d931-4ffa-b271-3c79ce2d8f66 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:23:42 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-dab374e2-d931-4ffa-b271-3c79ce2d8f66 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:23:42 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-dab374e2-d931-4ffa-b271-3c79ce2d8f66 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73572) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 10:23:42 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-dab374e2-d931-4ffa-b271-3c79ce2d8f66 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] CPU controller missing on host. {{(pid=73572) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 10:23:42 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-dab374e2-d931-4ffa-b271-3c79ce2d8f66 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73572) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 10:23:42 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-dab374e2-d931-4ffa-b271-3c79ce2d8f66 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] CPU controller found on host. {{(pid=73572) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 10:23:42 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-dab374e2-d931-4ffa-b271-3c79ce2d8f66 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73572) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 10:23:42 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-dab374e2-d931-4ffa-b271-3c79ce2d8f66 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T10:07:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 10:23:42 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-dab374e2-d931-4ffa-b271-3c79ce2d8f66 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Flavor limits 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 10:23:42 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-dab374e2-d931-4ffa-b271-3c79ce2d8f66 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Image limits 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 10:23:42 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-dab374e2-d931-4ffa-b271-3c79ce2d8f66 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Flavor pref 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 10:23:42 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-dab374e2-d931-4ffa-b271-3c79ce2d8f66 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Image pref 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 10:23:42 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-dab374e2-d931-4ffa-b271-3c79ce2d8f66 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 10:23:42 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-dab374e2-d931-4ffa-b271-3c79ce2d8f66 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 10:23:42 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-dab374e2-d931-4ffa-b271-3c79ce2d8f66 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73572) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 10:23:42 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-dab374e2-d931-4ffa-b271-3c79ce2d8f66 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Got 1 possible topologies {{(pid=73572) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 10:23:42 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-dab374e2-d931-4ffa-b271-3c79ce2d8f66 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 10:23:42 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-dab374e2-d931-4ffa-b271-3c79ce2d8f66 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 10:23:42 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dab374e2-d931-4ffa-b271-3c79ce2d8f66 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 0f46f84e-9cda-4450-a8a1-f6c08956324b] Calling os-brick to attach iSCSI Volume {{(pid=73572) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 10:23:42 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-dab374e2-d931-4ffa-b271-3c79ce2d8f66 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc89c3d6a10>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:9dbf6103-5796-4273-a8a9-81d262560347'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZpoyDOed', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 10:23:42 user nova-compute[73572]: WARNING os_brick.initiator.connectors.base [None req-dab374e2-d931-4ffa-b271-3c79ce2d8f66 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 10:23:42 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-dab374e2-d931-4ffa-b271-3c79ce2d8f66 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 10:23:42 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-dab374e2-d931-4ffa-b271-3c79ce2d8f66 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 10:23:42 user nova-compute[73572]: WARNING os_brick.initiator.connectors.base [None req-dab374e2-d931-4ffa-b271-3c79ce2d8f66 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 10:23:42 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-dab374e2-d931-4ffa-b271-3c79ce2d8f66 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9dbf6103-5796-4273-a8a9-81d262560347" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 10:23:42 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-dab374e2-d931-4ffa-b271-3c79ce2d8f66 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9dbf6103-5796-4273-a8a9-81d262560347" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 10:23:42 user nova-compute[73572]: INFO os_brick.initiator.connectors.iscsi [None req-dab374e2-d931-4ffa-b271-3c79ce2d8f66 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 10:23:42 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9dbf6103-5796-4273-a8a9-81d262560347 -p 172.16.0.220:3260 {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:23:42 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9dbf6103-5796-4273-a8a9-81d262560347 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:23:42 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[8332eb3b-3e43-45f9-9291-47a1c4c71f63]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:23:42 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-dab374e2-d931-4ffa-b271-3c79ce2d8f66 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 10:23:42 user nova-compute[73572]:  {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:23:42 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9dbf6103-5796-4273-a8a9-81d262560347 -p 172.16.0.220:3260 --interface default --op new {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:23:42 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9dbf6103-5796-4273-a8a9-81d262560347 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:23:42 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[27f843c2-c41a-455e-966a-67bdb6c5d458]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9dbf6103-5796-4273-a8a9-81d262560347] added\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:23:42 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-dab374e2-d931-4ffa-b271-3c79ce2d8f66 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9dbf6103-5796-4273-a8a9-81d262560347] added
Aug 26 10:23:42 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:23:42 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9dbf6103-5796-4273-a8a9-81d262560347 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:23:42 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9dbf6103-5796-4273-a8a9-81d262560347 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:23:42 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a7f379b-1d61-4e33-bc1e-37b2b82854fa]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:23:42 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-dab374e2-d931-4ffa-b271-3c79ce2d8f66 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:23:42 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9dbf6103-5796-4273-a8a9-81d262560347 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:23:42 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9dbf6103-5796-4273-a8a9-81d262560347 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:23:42 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[e966be2f-bc8d-479b-a5e5-93659c082265]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:23:42 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-dab374e2-d931-4ffa-b271-3c79ce2d8f66 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:23:42 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9dbf6103-5796-4273-a8a9-81d262560347 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZpoyDOed {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:23:42 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9dbf6103-5796-4273-a8a9-81d262560347 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZpoyDOed" returned: 0 in 0.018s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:23:42 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd2bf908-7b2e-4851-8299-095720042d8f]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:23:42 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-dab374e2-d931-4ffa-b271-3c79ce2d8f66 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZpoyDOed'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:23:42 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9dbf6103-5796-4273-a8a9-81d262560347 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:23:42 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9dbf6103-5796-4273-a8a9-81d262560347 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:23:42 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cdd3826-b2f1-4dee-94ab-a9bb8d92f902]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:23:42 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-dab374e2-d931-4ffa-b271-3c79ce2d8f66 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:23:42 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:23:42 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:23:42 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c181faa-bcd8-40a5-abc4-5b53479c2b7b]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f3a153b-1b99-4297-ad26-ea58f33330b8 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19c2d1dd-dfb9-4ac0-8341-35f96b7ade56 (non-flash)\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:23:42 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-dab374e2-d931-4ffa-b271-3c79ce2d8f66 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)
Aug 26 10:23:42 user nova-compute[73572]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f3a153b-1b99-4297-ad26-ea58f33330b8 (non-flash)
Aug 26 10:23:42 user nova-compute[73572]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19c2d1dd-dfb9-4ac0-8341-35f96b7ade56 (non-flash)
Aug 26 10:23:42 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 10:23:42 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-dab374e2-d931-4ffa-b271-3c79ce2d8f66 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)
Aug 26 10:23:42 user nova-compute[73572]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f3a153b-1b99-4297-ad26-ea58f33330b8 (non-flash)
Aug 26 10:23:42 user nova-compute[73572]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19c2d1dd-dfb9-4ac0-8341-35f96b7ade56 (non-flash)
Aug 26 10:23:42 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 10:23:42 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9dbf6103-5796-4273-a8a9-81d262560347 -p 172.16.0.220:3260 --login {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:23:42 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9dbf6103-5796-4273-a8a9-81d262560347 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:23:42 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9a93100-ec54-4203-9fa3-864e9c5d07e0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9dbf6103-5796-4273-a8a9-81d262560347, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9dbf6103-5796-4273-a8a9-81d262560347, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:23:42 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-dab374e2-d931-4ffa-b271-3c79ce2d8f66 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9dbf6103-5796-4273-a8a9-81d262560347, portal: 172.16.0.220,3260]
Aug 26 10:23:42 user nova-compute[73572]: Login to [iface: default, target: iqn.2010-10.org.openstack:9dbf6103-5796-4273-a8a9-81d262560347, portal: 172.16.0.220,3260] successful.
Aug 26 10:23:42 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:23:42 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9dbf6103-5796-4273-a8a9-81d262560347 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:23:42 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9dbf6103-5796-4273-a8a9-81d262560347 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:23:42 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[e11b7ca8-2d78-46bb-9009-dfd571cca769]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:23:42 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-dab374e2-d931-4ffa-b271-3c79ce2d8f66 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:23:42 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:23:42 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:23:42 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a8c0d7f-0d25-449e-9a9e-3f158db78701]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f3a153b-1b99-4297-ad26-ea58f33330b8 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19c2d1dd-dfb9-4ac0-8341-35f96b7ade56 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dbf6103-5796-4273-a8a9-81d262560347 (non-flash)\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:23:42 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-dab374e2-d931-4ffa-b271-3c79ce2d8f66 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)
Aug 26 10:23:42 user nova-compute[73572]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f3a153b-1b99-4297-ad26-ea58f33330b8 (non-flash)
Aug 26 10:23:42 user nova-compute[73572]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19c2d1dd-dfb9-4ac0-8341-35f96b7ade56 (non-flash)
Aug 26 10:23:42 user nova-compute[73572]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dbf6103-5796-4273-a8a9-81d262560347 (non-flash)
Aug 26 10:23:42 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 10:23:42 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-dab374e2-d931-4ffa-b271-3c79ce2d8f66 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)
Aug 26 10:23:42 user nova-compute[73572]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f3a153b-1b99-4297-ad26-ea58f33330b8 (non-flash)
Aug 26 10:23:42 user nova-compute[73572]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19c2d1dd-dfb9-4ac0-8341-35f96b7ade56 (non-flash)
Aug 26 10:23:42 user nova-compute[73572]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dbf6103-5796-4273-a8a9-81d262560347 (non-flash)
Aug 26 10:23:42 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 10:23:42 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-dab374e2-d931-4ffa-b271-3c79ce2d8f66 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9dbf6103-5796-4273-a8a9-81d262560347" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.263s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 10:23:42 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-dab374e2-d931-4ffa-b271-3c79ce2d8f66 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Connected to 172.16.0.220:3260 {{(pid=73572) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 10:23:42 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-dab374e2-d931-4ffa-b271-3c79ce2d8f66 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] HCTL ('34', '-', '-', 0) found on session 33 with lun 0 {{(pid=73572) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 10:23:42 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-dab374e2-d931-4ffa-b271-3c79ce2d8f66 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73572) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 10:23:42 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:23:42 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:23:42 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5a09079-5e30-45d1-bd75-68ccac28c340]: (4, ('- - 0', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:23:42 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-dab374e2-d931-4ffa-b271-3c79ce2d8f66 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Searching for a device in session 33 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73572) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 10:23:42 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-dab374e2-d931-4ffa-b271-3c79ce2d8f66 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZpoyDOed', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73572) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 10:23:43 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-dab374e2-d931-4ffa-b271-3c79ce2d8f66 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.293s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 10:23:43 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-dab374e2-d931-4ffa-b271-3c79ce2d8f66 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] <== connect_volume: return (1295ms) {'type': 'block', 'scsi_wwn': '23464323239663632', 'path': '/dev/sdc'} {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 10:23:43 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dab374e2-d931-4ffa-b271-3c79ce2d8f66 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 0f46f84e-9cda-4450-a8a1-f6c08956324b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23464323239663632', 'path': '/dev/sdc'} {{(pid=73572) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 10:23:43 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-dab374e2-d931-4ffa-b271-3c79ce2d8f66 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T10:23:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1558485664',display_name='tempest-TestVolumeBootPattern-server-1558485664',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1558485664',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cfc130586d9f4581953f1b8ae1c4465e',ramdisk_id='',reservation_id='r-0v3nuzh2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-73786062',owner_user_name='tempest-TestVolumeBootPattern-73786062-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T10:23:25Z,user_data=None,user_id='e1e80942e5db41c782bda686b10e2e4b',uuid=0f46f84e-9cda-4450-a8a1-f6c08956324b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b4dfa21c-473c-4801-ae7a-aac3ac21b655", "address": "fa:16:3e:1e:fd:c8", "network": {"id": "c520ee18-34a7-4781-bc97-419e9a702d40", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-280196989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfc130586d9f4581953f1b8ae1c4465e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4dfa21c-47", "ovs_interfaceid": "b4dfa21c-473c-4801-ae7a-aac3ac21b655", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73572) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 10:23:43 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-dab374e2-d931-4ffa-b271-3c79ce2d8f66 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Converting VIF {"id": "b4dfa21c-473c-4801-ae7a-aac3ac21b655", "address": "fa:16:3e:1e:fd:c8", "network": {"id": "c520ee18-34a7-4781-bc97-419e9a702d40", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-280196989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfc130586d9f4581953f1b8ae1c4465e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4dfa21c-47", "ovs_interfaceid": "b4dfa21c-473c-4801-ae7a-aac3ac21b655", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:23:43 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-dab374e2-d931-4ffa-b271-3c79ce2d8f66 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:fd:c8,bridge_name='br-int',has_traffic_filtering=True,id=b4dfa21c-473c-4801-ae7a-aac3ac21b655,network=Network(c520ee18-34a7-4781-bc97-419e9a702d40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4dfa21c-47') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:23:43 user nova-compute[73572]: DEBUG nova.objects.instance [None req-dab374e2-d931-4ffa-b271-3c79ce2d8f66 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Lazy-loading 'pci_devices' on Instance uuid 0f46f84e-9cda-4450-a8a1-f6c08956324b {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:23:43 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-dab374e2-d931-4ffa-b271-3c79ce2d8f66 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 0f46f84e-9cda-4450-a8a1-f6c08956324b] End _get_guest_xml xml=<domain type="kvm">
Aug 26 10:23:43 user nova-compute[73572]:   <uuid>0f46f84e-9cda-4450-a8a1-f6c08956324b</uuid>
Aug 26 10:23:43 user nova-compute[73572]:   <name>instance-00000020</name>
Aug 26 10:23:43 user nova-compute[73572]:   <memory>524288</memory>
Aug 26 10:23:43 user nova-compute[73572]:   <vcpu>1</vcpu>
Aug 26 10:23:43 user nova-compute[73572]:   <metadata>
Aug 26 10:23:43 user nova-compute[73572]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 10:23:43 user nova-compute[73572]:       <nova:package version="0.0.0"/>
Aug 26 10:23:43 user nova-compute[73572]:       <nova:name>tempest-TestVolumeBootPattern-server-1558485664</nova:name>
Aug 26 10:23:43 user nova-compute[73572]:       <nova:creationTime>2023-08-26 10:23:42</nova:creationTime>
Aug 26 10:23:43 user nova-compute[73572]:       <nova:flavor name="m1.tiny">
Aug 26 10:23:43 user nova-compute[73572]:         <nova:memory>512</nova:memory>
Aug 26 10:23:43 user nova-compute[73572]:         <nova:disk>1</nova:disk>
Aug 26 10:23:43 user nova-compute[73572]:         <nova:swap>0</nova:swap>
Aug 26 10:23:43 user nova-compute[73572]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 10:23:43 user nova-compute[73572]:         <nova:vcpus>1</nova:vcpus>
Aug 26 10:23:43 user nova-compute[73572]:       </nova:flavor>
Aug 26 10:23:43 user nova-compute[73572]:       <nova:owner>
Aug 26 10:23:43 user nova-compute[73572]:         <nova:user uuid="e1e80942e5db41c782bda686b10e2e4b">tempest-TestVolumeBootPattern-73786062-project-member</nova:user>
Aug 26 10:23:43 user nova-compute[73572]:         <nova:project uuid="cfc130586d9f4581953f1b8ae1c4465e">tempest-TestVolumeBootPattern-73786062</nova:project>
Aug 26 10:23:43 user nova-compute[73572]:       </nova:owner>
Aug 26 10:23:43 user nova-compute[73572]:       <nova:ports>
Aug 26 10:23:43 user nova-compute[73572]:         <nova:port uuid="b4dfa21c-473c-4801-ae7a-aac3ac21b655">
Aug 26 10:23:43 user nova-compute[73572]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 26 10:23:43 user nova-compute[73572]:         </nova:port>
Aug 26 10:23:43 user nova-compute[73572]:       </nova:ports>
Aug 26 10:23:43 user nova-compute[73572]:     </nova:instance>
Aug 26 10:23:43 user nova-compute[73572]:   </metadata>
Aug 26 10:23:43 user nova-compute[73572]:   <sysinfo type="smbios">
Aug 26 10:23:43 user nova-compute[73572]:     <system>
Aug 26 10:23:43 user nova-compute[73572]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 10:23:43 user nova-compute[73572]:       <entry name="product">OpenStack Nova</entry>
Aug 26 10:23:43 user nova-compute[73572]:       <entry name="version">0.0.0</entry>
Aug 26 10:23:43 user nova-compute[73572]:       <entry name="serial">0f46f84e-9cda-4450-a8a1-f6c08956324b</entry>
Aug 26 10:23:43 user nova-compute[73572]:       <entry name="uuid">0f46f84e-9cda-4450-a8a1-f6c08956324b</entry>
Aug 26 10:23:43 user nova-compute[73572]:       <entry name="family">Virtual Machine</entry>
Aug 26 10:23:43 user nova-compute[73572]:     </system>
Aug 26 10:23:43 user nova-compute[73572]:   </sysinfo>
Aug 26 10:23:43 user nova-compute[73572]:   <os>
Aug 26 10:23:43 user nova-compute[73572]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 10:23:43 user nova-compute[73572]:     <boot dev="hd"/>
Aug 26 10:23:43 user nova-compute[73572]:     <smbios mode="sysinfo"/>
Aug 26 10:23:43 user nova-compute[73572]:   </os>
Aug 26 10:23:43 user nova-compute[73572]:   <features>
Aug 26 10:23:43 user nova-compute[73572]:     <acpi/>
Aug 26 10:23:43 user nova-compute[73572]:     <apic/>
Aug 26 10:23:43 user nova-compute[73572]:     <vmcoreinfo/>
Aug 26 10:23:43 user nova-compute[73572]:   </features>
Aug 26 10:23:43 user nova-compute[73572]:   <clock offset="utc">
Aug 26 10:23:43 user nova-compute[73572]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 10:23:43 user nova-compute[73572]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 10:23:43 user nova-compute[73572]:     <timer name="hpet" present="no"/>
Aug 26 10:23:43 user nova-compute[73572]:   </clock>
Aug 26 10:23:43 user nova-compute[73572]:   <cpu mode="custom" match="exact">
Aug 26 10:23:43 user nova-compute[73572]:     <model>Nehalem</model>
Aug 26 10:23:43 user nova-compute[73572]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 10:23:43 user nova-compute[73572]:   </cpu>
Aug 26 10:23:43 user nova-compute[73572]:   <devices>
Aug 26 10:23:43 user nova-compute[73572]:     <disk type="block" device="disk">
Aug 26 10:23:43 user nova-compute[73572]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 10:23:43 user nova-compute[73572]:       <source dev="/dev/sdc"/>
Aug 26 10:23:43 user nova-compute[73572]:       <target dev="vda" bus="virtio"/>
Aug 26 10:23:43 user nova-compute[73572]:       <serial>9dbf6103-5796-4273-a8a9-81d262560347</serial>
Aug 26 10:23:43 user nova-compute[73572]:     </disk>
Aug 26 10:23:43 user nova-compute[73572]:     <interface type="ethernet">
Aug 26 10:23:43 user nova-compute[73572]:       <mac address="fa:16:3e:1e:fd:c8"/>
Aug 26 10:23:43 user nova-compute[73572]:       <model type="virtio"/>
Aug 26 10:23:43 user nova-compute[73572]:       <mtu size="1442"/>
Aug 26 10:23:43 user nova-compute[73572]:       <target dev="tapb4dfa21c-47"/>
Aug 26 10:23:43 user nova-compute[73572]:     </interface>
Aug 26 10:23:43 user nova-compute[73572]:     <serial type="pty">
Aug 26 10:23:43 user nova-compute[73572]:       <log file="/opt/stack/data/nova/instances/0f46f84e-9cda-4450-a8a1-f6c08956324b/console.log" append="off"/>
Aug 26 10:23:43 user nova-compute[73572]:     </serial>
Aug 26 10:23:43 user nova-compute[73572]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 10:23:43 user nova-compute[73572]:     <video>
Aug 26 10:23:43 user nova-compute[73572]:       <model type="virtio"/>
Aug 26 10:23:43 user nova-compute[73572]:     </video>
Aug 26 10:23:43 user nova-compute[73572]:     <rng model="virtio">
Aug 26 10:23:43 user nova-compute[73572]:       <backend model="random">/dev/urandom</backend>
Aug 26 10:23:43 user nova-compute[73572]:     </rng>
Aug 26 10:23:43 user nova-compute[73572]:     <controller type="usb" index="0" model="none"/>
Aug 26 10:23:43 user nova-compute[73572]:     <memballoon model="virtio">
Aug 26 10:23:43 user nova-compute[73572]:       <stats period="10"/>
Aug 26 10:23:43 user nova-compute[73572]:     </memballoon>
Aug 26 10:23:43 user nova-compute[73572]:   </devices>
Aug 26 10:23:43 user nova-compute[73572]: </domain>
Aug 26 10:23:43 user nova-compute[73572]:  {{(pid=73572) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 10:23:43 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-dab374e2-d931-4ffa-b271-3c79ce2d8f66 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T10:23:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1558485664',display_name='tempest-TestVolumeBootPattern-server-1558485664',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1558485664',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cfc130586d9f4581953f1b8ae1c4465e',ramdisk_id='',reservation_id='r-0v3nuzh2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-73786062',owner_user_name='tempest-TestVolumeBootPattern-73786062-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T10:23:25Z,user_data=None,user_id='e1e80942e5db41c782bda686b10e2e4b',uuid=0f46f84e-9cda-4450-a8a1-f6c08956324b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b4dfa21c-473c-4801-ae7a-aac3ac21b655", "address": "fa:16:3e:1e:fd:c8", "network": {"id": "c520ee18-34a7-4781-bc97-419e9a702d40", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-280196989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfc130586d9f4581953f1b8ae1c4465e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4dfa21c-47", "ovs_interfaceid": "b4dfa21c-473c-4801-ae7a-aac3ac21b655", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 10:23:43 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-dab374e2-d931-4ffa-b271-3c79ce2d8f66 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Converting VIF {"id": "b4dfa21c-473c-4801-ae7a-aac3ac21b655", "address": "fa:16:3e:1e:fd:c8", "network": {"id": "c520ee18-34a7-4781-bc97-419e9a702d40", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-280196989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfc130586d9f4581953f1b8ae1c4465e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4dfa21c-47", "ovs_interfaceid": "b4dfa21c-473c-4801-ae7a-aac3ac21b655", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:23:43 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-dab374e2-d931-4ffa-b271-3c79ce2d8f66 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:fd:c8,bridge_name='br-int',has_traffic_filtering=True,id=b4dfa21c-473c-4801-ae7a-aac3ac21b655,network=Network(c520ee18-34a7-4781-bc97-419e9a702d40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4dfa21c-47') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:23:43 user nova-compute[73572]: DEBUG os_vif [None req-dab374e2-d931-4ffa-b271-3c79ce2d8f66 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:fd:c8,bridge_name='br-int',has_traffic_filtering=True,id=b4dfa21c-473c-4801-ae7a-aac3ac21b655,network=Network(c520ee18-34a7-4781-bc97-419e9a702d40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4dfa21c-47') {{(pid=73572) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 10:23:43 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:23:43 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:23:43 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 10:23:43 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:23:43 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb4dfa21c-47, may_exist=True, interface_attrs={}) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:23:43 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb4dfa21c-47, col_values=(('external_ids', {'iface-id': 'b4dfa21c-473c-4801-ae7a-aac3ac21b655', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1e:fd:c8', 'vm-uuid': '0f46f84e-9cda-4450-a8a1-f6c08956324b'}),), if_exists=True) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:23:43 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:23:43 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:23:43 user nova-compute[73572]: INFO os_vif [None req-dab374e2-d931-4ffa-b271-3c79ce2d8f66 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:fd:c8,bridge_name='br-int',has_traffic_filtering=True,id=b4dfa21c-473c-4801-ae7a-aac3ac21b655,network=Network(c520ee18-34a7-4781-bc97-419e9a702d40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4dfa21c-47')
Aug 26 10:23:43 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-dab374e2-d931-4ffa-b271-3c79ce2d8f66 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] No BDM found with device name vda, not building metadata. {{(pid=73572) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 10:23:43 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-dab374e2-d931-4ffa-b271-3c79ce2d8f66 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] No VIF found with MAC fa:16:3e:1e:fd:c8, not building metadata {{(pid=73572) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 10:23:44 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:23:44 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:23:44 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:23:44 user nova-compute[73572]: DEBUG nova.compute.manager [req-c5bcbfd2-9933-4977-a453-a254717b20d4 req-4e1fedd4-3a6e-4aab-9d1f-32701cea8522 service nova] [instance: 0f46f84e-9cda-4450-a8a1-f6c08956324b] Received event network-vif-plugged-b4dfa21c-473c-4801-ae7a-aac3ac21b655 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:23:44 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-c5bcbfd2-9933-4977-a453-a254717b20d4 req-4e1fedd4-3a6e-4aab-9d1f-32701cea8522 service nova] Acquiring lock "0f46f84e-9cda-4450-a8a1-f6c08956324b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:23:44 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-c5bcbfd2-9933-4977-a453-a254717b20d4 req-4e1fedd4-3a6e-4aab-9d1f-32701cea8522 service nova] Lock "0f46f84e-9cda-4450-a8a1-f6c08956324b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:23:44 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-c5bcbfd2-9933-4977-a453-a254717b20d4 req-4e1fedd4-3a6e-4aab-9d1f-32701cea8522 service nova] Lock "0f46f84e-9cda-4450-a8a1-f6c08956324b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:23:44 user nova-compute[73572]: DEBUG nova.compute.manager [req-c5bcbfd2-9933-4977-a453-a254717b20d4 req-4e1fedd4-3a6e-4aab-9d1f-32701cea8522 service nova] [instance: 0f46f84e-9cda-4450-a8a1-f6c08956324b] No waiting events found dispatching network-vif-plugged-b4dfa21c-473c-4801-ae7a-aac3ac21b655 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:23:44 user nova-compute[73572]: WARNING nova.compute.manager [req-c5bcbfd2-9933-4977-a453-a254717b20d4 req-4e1fedd4-3a6e-4aab-9d1f-32701cea8522 service nova] [instance: 0f46f84e-9cda-4450-a8a1-f6c08956324b] Received unexpected event network-vif-plugged-b4dfa21c-473c-4801-ae7a-aac3ac21b655 for instance with vm_state building and task_state spawning.
Aug 26 10:23:45 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:23:45 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:23:45 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:23:45 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:23:46 user nova-compute[73572]: DEBUG nova.virt.driver [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Emitting event <LifecycleEvent: 1693045426.9035206, 0f46f84e-9cda-4450-a8a1-f6c08956324b => Resumed> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:23:46 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 0f46f84e-9cda-4450-a8a1-f6c08956324b] VM Resumed (Lifecycle Event)
Aug 26 10:23:46 user nova-compute[73572]: DEBUG nova.compute.manager [None req-dab374e2-d931-4ffa-b271-3c79ce2d8f66 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 0f46f84e-9cda-4450-a8a1-f6c08956324b] Instance event wait completed in 0 seconds for  {{(pid=73572) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 10:23:46 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-dab374e2-d931-4ffa-b271-3c79ce2d8f66 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 0f46f84e-9cda-4450-a8a1-f6c08956324b] Guest created on hypervisor {{(pid=73572) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 10:23:46 user nova-compute[73572]: INFO nova.virt.libvirt.driver [-] [instance: 0f46f84e-9cda-4450-a8a1-f6c08956324b] Instance spawned successfully.
Aug 26 10:23:46 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-dab374e2-d931-4ffa-b271-3c79ce2d8f66 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 0f46f84e-9cda-4450-a8a1-f6c08956324b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 10:23:46 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 0f46f84e-9cda-4450-a8a1-f6c08956324b] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:23:46 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-dab374e2-d931-4ffa-b271-3c79ce2d8f66 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 0f46f84e-9cda-4450-a8a1-f6c08956324b] Found default for hw_cdrom_bus of ide {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:23:46 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-dab374e2-d931-4ffa-b271-3c79ce2d8f66 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 0f46f84e-9cda-4450-a8a1-f6c08956324b] Found default for hw_disk_bus of virtio {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:23:46 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-dab374e2-d931-4ffa-b271-3c79ce2d8f66 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 0f46f84e-9cda-4450-a8a1-f6c08956324b] Found default for hw_input_bus of None {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:23:46 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-dab374e2-d931-4ffa-b271-3c79ce2d8f66 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 0f46f84e-9cda-4450-a8a1-f6c08956324b] Found default for hw_pointer_model of None {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:23:46 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-dab374e2-d931-4ffa-b271-3c79ce2d8f66 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 0f46f84e-9cda-4450-a8a1-f6c08956324b] Found default for hw_video_model of virtio {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:23:46 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-dab374e2-d931-4ffa-b271-3c79ce2d8f66 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 0f46f84e-9cda-4450-a8a1-f6c08956324b] Found default for hw_vif_model of virtio {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:23:46 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 0f46f84e-9cda-4450-a8a1-f6c08956324b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73572) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 10:23:46 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 0f46f84e-9cda-4450-a8a1-f6c08956324b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 10:23:46 user nova-compute[73572]: DEBUG nova.virt.driver [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Emitting event <LifecycleEvent: 1693045426.9081807, 0f46f84e-9cda-4450-a8a1-f6c08956324b => Started> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:23:46 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 0f46f84e-9cda-4450-a8a1-f6c08956324b] VM Started (Lifecycle Event)
Aug 26 10:23:46 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 0f46f84e-9cda-4450-a8a1-f6c08956324b] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:23:46 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 0f46f84e-9cda-4450-a8a1-f6c08956324b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73572) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 10:23:47 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 0f46f84e-9cda-4450-a8a1-f6c08956324b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 10:23:47 user nova-compute[73572]: DEBUG nova.compute.manager [req-f4bdb336-81fb-418a-948f-797a8ac1e82f req-5d319b97-c336-4c8c-875c-9d55d7f5cdbf service nova] [instance: 0f46f84e-9cda-4450-a8a1-f6c08956324b] Received event network-vif-plugged-b4dfa21c-473c-4801-ae7a-aac3ac21b655 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:23:47 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-f4bdb336-81fb-418a-948f-797a8ac1e82f req-5d319b97-c336-4c8c-875c-9d55d7f5cdbf service nova] Acquiring lock "0f46f84e-9cda-4450-a8a1-f6c08956324b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:23:47 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-f4bdb336-81fb-418a-948f-797a8ac1e82f req-5d319b97-c336-4c8c-875c-9d55d7f5cdbf service nova] Lock "0f46f84e-9cda-4450-a8a1-f6c08956324b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:23:47 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-f4bdb336-81fb-418a-948f-797a8ac1e82f req-5d319b97-c336-4c8c-875c-9d55d7f5cdbf service nova] Lock "0f46f84e-9cda-4450-a8a1-f6c08956324b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:23:47 user nova-compute[73572]: DEBUG nova.compute.manager [req-f4bdb336-81fb-418a-948f-797a8ac1e82f req-5d319b97-c336-4c8c-875c-9d55d7f5cdbf service nova] [instance: 0f46f84e-9cda-4450-a8a1-f6c08956324b] No waiting events found dispatching network-vif-plugged-b4dfa21c-473c-4801-ae7a-aac3ac21b655 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:23:47 user nova-compute[73572]: WARNING nova.compute.manager [req-f4bdb336-81fb-418a-948f-797a8ac1e82f req-5d319b97-c336-4c8c-875c-9d55d7f5cdbf service nova] [instance: 0f46f84e-9cda-4450-a8a1-f6c08956324b] Received unexpected event network-vif-plugged-b4dfa21c-473c-4801-ae7a-aac3ac21b655 for instance with vm_state building and task_state spawning.
Aug 26 10:23:47 user nova-compute[73572]: INFO nova.compute.manager [None req-dab374e2-d931-4ffa-b271-3c79ce2d8f66 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 0f46f84e-9cda-4450-a8a1-f6c08956324b] Took 5.01 seconds to spawn the instance on the hypervisor.
Aug 26 10:23:47 user nova-compute[73572]: DEBUG nova.compute.manager [None req-dab374e2-d931-4ffa-b271-3c79ce2d8f66 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 0f46f84e-9cda-4450-a8a1-f6c08956324b] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:23:47 user nova-compute[73572]: INFO nova.compute.manager [None req-dab374e2-d931-4ffa-b271-3c79ce2d8f66 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 0f46f84e-9cda-4450-a8a1-f6c08956324b] Took 22.59 seconds to build instance.
Aug 26 10:23:47 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-dab374e2-d931-4ffa-b271-3c79ce2d8f66 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Lock "0f46f84e-9cda-4450-a8a1-f6c08956324b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 22.740s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:23:48 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-2d78f066-2a94-4a2e-a165-7032c5422cd4 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Acquiring lock "8a8816e5-696d-4384-b0e0-29aa7cdd957c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:23:48 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-2d78f066-2a94-4a2e-a165-7032c5422cd4 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Lock "8a8816e5-696d-4384-b0e0-29aa7cdd957c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:23:48 user nova-compute[73572]: DEBUG nova.compute.manager [None req-2d78f066-2a94-4a2e-a165-7032c5422cd4 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: 8a8816e5-696d-4384-b0e0-29aa7cdd957c] Starting instance... {{(pid=73572) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 10:23:48 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-2d78f066-2a94-4a2e-a165-7032c5422cd4 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:23:48 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-2d78f066-2a94-4a2e-a165-7032c5422cd4 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:23:48 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-2d78f066-2a94-4a2e-a165-7032c5422cd4 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73572) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 10:23:48 user nova-compute[73572]: INFO nova.compute.claims [None req-2d78f066-2a94-4a2e-a165-7032c5422cd4 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: 8a8816e5-696d-4384-b0e0-29aa7cdd957c] Claim successful on node user
Aug 26 10:23:48 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:23:48 user nova-compute[73572]: DEBUG nova.compute.provider_tree [None req-2d78f066-2a94-4a2e-a165-7032c5422cd4 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Inventory has not changed in ProviderTree for provider: e2cec974-59b2-4c77-a53d-a7f4e5a30d75 {{(pid=73572) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 10:23:48 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-2d78f066-2a94-4a2e-a165-7032c5422cd4 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Inventory has not changed for provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73572) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 10:23:48 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-2d78f066-2a94-4a2e-a165-7032c5422cd4 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.434s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:23:48 user nova-compute[73572]: DEBUG nova.compute.manager [None req-2d78f066-2a94-4a2e-a165-7032c5422cd4 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: 8a8816e5-696d-4384-b0e0-29aa7cdd957c] Start building networks asynchronously for instance. {{(pid=73572) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 10:23:48 user nova-compute[73572]: DEBUG nova.compute.manager [None req-2d78f066-2a94-4a2e-a165-7032c5422cd4 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: 8a8816e5-696d-4384-b0e0-29aa7cdd957c] Allocating IP information in the background. {{(pid=73572) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 10:23:48 user nova-compute[73572]: DEBUG nova.network.neutron [None req-2d78f066-2a94-4a2e-a165-7032c5422cd4 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: 8a8816e5-696d-4384-b0e0-29aa7cdd957c] allocate_for_instance() {{(pid=73572) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 10:23:48 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-2d78f066-2a94-4a2e-a165-7032c5422cd4 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: 8a8816e5-696d-4384-b0e0-29aa7cdd957c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 10:23:48 user nova-compute[73572]: DEBUG nova.compute.manager [None req-2d78f066-2a94-4a2e-a165-7032c5422cd4 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: 8a8816e5-696d-4384-b0e0-29aa7cdd957c] Start building block device mappings for instance. {{(pid=73572) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 10:23:48 user nova-compute[73572]: DEBUG nova.policy [None req-2d78f066-2a94-4a2e-a165-7032c5422cd4 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '07f3538038a14713af3bbe420f1fb03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4636f93c5bfc4653804de097aed2882c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73572) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 10:23:48 user nova-compute[73572]: INFO nova.virt.block_device [None req-2d78f066-2a94-4a2e-a165-7032c5422cd4 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: 8a8816e5-696d-4384-b0e0-29aa7cdd957c] Booting with volume-backed-image 299da0c9-e1c4-48f0-be55-fbe20dd06bc9 at /dev/vda
Aug 26 10:23:49 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:23:49 user nova-compute[73572]: DEBUG nova.network.neutron [None req-2d78f066-2a94-4a2e-a165-7032c5422cd4 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: 8a8816e5-696d-4384-b0e0-29aa7cdd957c] Successfully created port: 2e650fb9-427c-477e-ba45-ddc070399617 {{(pid=73572) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 10:23:50 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:23:50 user nova-compute[73572]: DEBUG nova.network.neutron [None req-2d78f066-2a94-4a2e-a165-7032c5422cd4 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: 8a8816e5-696d-4384-b0e0-29aa7cdd957c] Successfully updated port: 2e650fb9-427c-477e-ba45-ddc070399617 {{(pid=73572) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 10:23:50 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-2d78f066-2a94-4a2e-a165-7032c5422cd4 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Acquiring lock "refresh_cache-8a8816e5-696d-4384-b0e0-29aa7cdd957c" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:23:50 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-2d78f066-2a94-4a2e-a165-7032c5422cd4 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Acquired lock "refresh_cache-8a8816e5-696d-4384-b0e0-29aa7cdd957c" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:23:50 user nova-compute[73572]: DEBUG nova.network.neutron [None req-2d78f066-2a94-4a2e-a165-7032c5422cd4 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: 8a8816e5-696d-4384-b0e0-29aa7cdd957c] Building network info cache for instance {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 10:23:50 user nova-compute[73572]: DEBUG nova.compute.manager [req-01cd4237-1541-47f0-839f-bbee7191c4fd req-d74537e6-c75d-4c75-80fc-e24f482a81c5 service nova] [instance: 8a8816e5-696d-4384-b0e0-29aa7cdd957c] Received event network-changed-2e650fb9-427c-477e-ba45-ddc070399617 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:23:50 user nova-compute[73572]: DEBUG nova.compute.manager [req-01cd4237-1541-47f0-839f-bbee7191c4fd req-d74537e6-c75d-4c75-80fc-e24f482a81c5 service nova] [instance: 8a8816e5-696d-4384-b0e0-29aa7cdd957c] Refreshing instance network info cache due to event network-changed-2e650fb9-427c-477e-ba45-ddc070399617. {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 10:23:50 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-01cd4237-1541-47f0-839f-bbee7191c4fd req-d74537e6-c75d-4c75-80fc-e24f482a81c5 service nova] Acquiring lock "refresh_cache-8a8816e5-696d-4384-b0e0-29aa7cdd957c" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:23:50 user nova-compute[73572]: DEBUG nova.network.neutron [None req-2d78f066-2a94-4a2e-a165-7032c5422cd4 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: 8a8816e5-696d-4384-b0e0-29aa7cdd957c] Instance cache missing network info. {{(pid=73572) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 10:23:50 user nova-compute[73572]: DEBUG nova.network.neutron [None req-2d78f066-2a94-4a2e-a165-7032c5422cd4 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: 8a8816e5-696d-4384-b0e0-29aa7cdd957c] Updating instance_info_cache with network_info: [{"id": "2e650fb9-427c-477e-ba45-ddc070399617", "address": "fa:16:3e:6c:94:14", "network": {"id": "991b9dff-5173-4456-a530-b1f7eb5cfa4a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1845930297-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4636f93c5bfc4653804de097aed2882c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e650fb9-42", "ovs_interfaceid": "2e650fb9-427c-477e-ba45-ddc070399617", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:23:50 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-2d78f066-2a94-4a2e-a165-7032c5422cd4 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Releasing lock "refresh_cache-8a8816e5-696d-4384-b0e0-29aa7cdd957c" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:23:50 user nova-compute[73572]: DEBUG nova.compute.manager [None req-2d78f066-2a94-4a2e-a165-7032c5422cd4 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: 8a8816e5-696d-4384-b0e0-29aa7cdd957c] Instance network_info: |[{"id": "2e650fb9-427c-477e-ba45-ddc070399617", "address": "fa:16:3e:6c:94:14", "network": {"id": "991b9dff-5173-4456-a530-b1f7eb5cfa4a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1845930297-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4636f93c5bfc4653804de097aed2882c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e650fb9-42", "ovs_interfaceid": "2e650fb9-427c-477e-ba45-ddc070399617", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73572) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 10:23:50 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-01cd4237-1541-47f0-839f-bbee7191c4fd req-d74537e6-c75d-4c75-80fc-e24f482a81c5 service nova] Acquired lock "refresh_cache-8a8816e5-696d-4384-b0e0-29aa7cdd957c" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:23:50 user nova-compute[73572]: DEBUG nova.network.neutron [req-01cd4237-1541-47f0-839f-bbee7191c4fd req-d74537e6-c75d-4c75-80fc-e24f482a81c5 service nova] [instance: 8a8816e5-696d-4384-b0e0-29aa7cdd957c] Refreshing network info cache for port 2e650fb9-427c-477e-ba45-ddc070399617 {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 10:23:51 user nova-compute[73572]: DEBUG nova.network.neutron [req-01cd4237-1541-47f0-839f-bbee7191c4fd req-d74537e6-c75d-4c75-80fc-e24f482a81c5 service nova] [instance: 8a8816e5-696d-4384-b0e0-29aa7cdd957c] Updated VIF entry in instance network info cache for port 2e650fb9-427c-477e-ba45-ddc070399617. {{(pid=73572) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 10:23:51 user nova-compute[73572]: DEBUG nova.network.neutron [req-01cd4237-1541-47f0-839f-bbee7191c4fd req-d74537e6-c75d-4c75-80fc-e24f482a81c5 service nova] [instance: 8a8816e5-696d-4384-b0e0-29aa7cdd957c] Updating instance_info_cache with network_info: [{"id": "2e650fb9-427c-477e-ba45-ddc070399617", "address": "fa:16:3e:6c:94:14", "network": {"id": "991b9dff-5173-4456-a530-b1f7eb5cfa4a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1845930297-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4636f93c5bfc4653804de097aed2882c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e650fb9-42", "ovs_interfaceid": "2e650fb9-427c-477e-ba45-ddc070399617", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:23:51 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-01cd4237-1541-47f0-839f-bbee7191c4fd req-d74537e6-c75d-4c75-80fc-e24f482a81c5 service nova] Releasing lock "refresh_cache-8a8816e5-696d-4384-b0e0-29aa7cdd957c" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:23:53 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:23:57 user nova-compute[73572]: INFO nova.compute.manager [None req-6527310e-309c-4349-ab61-3f86695279b5 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] [instance: 2eaea7c2-a5c0-4950-b033-0012b5cec0ee] Rescuing
Aug 26 10:23:57 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-6527310e-309c-4349-ab61-3f86695279b5 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Acquiring lock "refresh_cache-2eaea7c2-a5c0-4950-b033-0012b5cec0ee" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:23:57 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-6527310e-309c-4349-ab61-3f86695279b5 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Acquired lock "refresh_cache-2eaea7c2-a5c0-4950-b033-0012b5cec0ee" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:23:57 user nova-compute[73572]: DEBUG nova.network.neutron [None req-6527310e-309c-4349-ab61-3f86695279b5 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] [instance: 2eaea7c2-a5c0-4950-b033-0012b5cec0ee] Building network info cache for instance {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 10:23:58 user nova-compute[73572]: DEBUG nova.network.neutron [None req-6527310e-309c-4349-ab61-3f86695279b5 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] [instance: 2eaea7c2-a5c0-4950-b033-0012b5cec0ee] Updating instance_info_cache with network_info: [{"id": "0b4d66c9-2155-45ae-873a-2ee85776eeb7", "address": "fa:16:3e:69:d4:8e", "network": {"id": "757e71b4-5177-45a5-8ef5-9b27f42092f1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1765327616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1bff48d66894950ac6690e1fd0e79b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b4d66c9-21", "ovs_interfaceid": "0b4d66c9-2155-45ae-873a-2ee85776eeb7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:23:58 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-6527310e-309c-4349-ab61-3f86695279b5 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Releasing lock "refresh_cache-2eaea7c2-a5c0-4950-b033-0012b5cec0ee" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:23:58 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:23:58 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:23:58 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:23:58 user nova-compute[73572]: DEBUG nova.compute.manager [req-2fd1da73-27d5-4190-9058-b7090367e97e req-e5ab4691-743d-4e40-b17e-0cd8b3846909 service nova] [instance: 2eaea7c2-a5c0-4950-b033-0012b5cec0ee] Received event network-vif-unplugged-0b4d66c9-2155-45ae-873a-2ee85776eeb7 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:23:58 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-2fd1da73-27d5-4190-9058-b7090367e97e req-e5ab4691-743d-4e40-b17e-0cd8b3846909 service nova] Acquiring lock "2eaea7c2-a5c0-4950-b033-0012b5cec0ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:23:58 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-2fd1da73-27d5-4190-9058-b7090367e97e req-e5ab4691-743d-4e40-b17e-0cd8b3846909 service nova] Lock "2eaea7c2-a5c0-4950-b033-0012b5cec0ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:23:58 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-2fd1da73-27d5-4190-9058-b7090367e97e req-e5ab4691-743d-4e40-b17e-0cd8b3846909 service nova] Lock "2eaea7c2-a5c0-4950-b033-0012b5cec0ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:23:58 user nova-compute[73572]: DEBUG nova.compute.manager [req-2fd1da73-27d5-4190-9058-b7090367e97e req-e5ab4691-743d-4e40-b17e-0cd8b3846909 service nova] [instance: 2eaea7c2-a5c0-4950-b033-0012b5cec0ee] No waiting events found dispatching network-vif-unplugged-0b4d66c9-2155-45ae-873a-2ee85776eeb7 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:23:58 user nova-compute[73572]: WARNING nova.compute.manager [req-2fd1da73-27d5-4190-9058-b7090367e97e req-e5ab4691-743d-4e40-b17e-0cd8b3846909 service nova] [instance: 2eaea7c2-a5c0-4950-b033-0012b5cec0ee] Received unexpected event network-vif-unplugged-0b4d66c9-2155-45ae-873a-2ee85776eeb7 for instance with vm_state active and task_state rescuing.
Aug 26 10:23:58 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:23:58 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:23:59 user nova-compute[73572]: INFO nova.virt.libvirt.driver [-] [instance: 2eaea7c2-a5c0-4950-b033-0012b5cec0ee] Instance destroyed successfully.
Aug 26 10:23:59 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-6527310e-309c-4349-ab61-3f86695279b5 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] [instance: 2eaea7c2-a5c0-4950-b033-0012b5cec0ee] Attempting rescue
Aug 26 10:23:59 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-6527310e-309c-4349-ab61-3f86695279b5 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=73572) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 26 10:23:59 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-6527310e-309c-4349-ab61-3f86695279b5 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] [instance: 2eaea7c2-a5c0-4950-b033-0012b5cec0ee] Instance directory exists: not creating {{(pid=73572) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 26 10:23:59 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-6527310e-309c-4349-ab61-3f86695279b5 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] [instance: 2eaea7c2-a5c0-4950-b033-0012b5cec0ee] Creating image(s)
Aug 26 10:23:59 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-6527310e-309c-4349-ab61-3f86695279b5 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Acquiring lock "/opt/stack/data/nova/instances/2eaea7c2-a5c0-4950-b033-0012b5cec0ee/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:23:59 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-6527310e-309c-4349-ab61-3f86695279b5 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Lock "/opt/stack/data/nova/instances/2eaea7c2-a5c0-4950-b033-0012b5cec0ee/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:23:59 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-6527310e-309c-4349-ab61-3f86695279b5 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Lock "/opt/stack/data/nova/instances/2eaea7c2-a5c0-4950-b033-0012b5cec0ee/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:23:59 user nova-compute[73572]: DEBUG nova.objects.instance [None req-6527310e-309c-4349-ab61-3f86695279b5 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Lazy-loading 'trusted_certs' on Instance uuid 2eaea7c2-a5c0-4950-b033-0012b5cec0ee {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:23:59 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-6527310e-309c-4349-ab61-3f86695279b5 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Acquiring lock "2099350d6f3bcd0de9471c73862d4fe75b049801" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:23:59 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-6527310e-309c-4349-ab61-3f86695279b5 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Lock "2099350d6f3bcd0de9471c73862d4fe75b049801" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:23:59 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-6527310e-309c-4349-ab61-3f86695279b5 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:23:59 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-6527310e-309c-4349-ab61-3f86695279b5 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json" returned: 0 in 0.184s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:23:59 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-6527310e-309c-4349-ab61-3f86695279b5 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801,backing_fmt=raw /opt/stack/data/nova/instances/2eaea7c2-a5c0-4950-b033-0012b5cec0ee/disk.rescue {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:23:59 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-6527310e-309c-4349-ab61-3f86695279b5 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801,backing_fmt=raw /opt/stack/data/nova/instances/2eaea7c2-a5c0-4950-b033-0012b5cec0ee/disk.rescue" returned: 0 in 0.067s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:23:59 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-6527310e-309c-4349-ab61-3f86695279b5 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Lock "2099350d6f3bcd0de9471c73862d4fe75b049801" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.260s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:23:59 user nova-compute[73572]: DEBUG nova.objects.instance [None req-6527310e-309c-4349-ab61-3f86695279b5 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Lazy-loading 'migration_context' on Instance uuid 2eaea7c2-a5c0-4950-b033-0012b5cec0ee {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:23:59 user nova-compute[73572]: DEBUG nova.objects.base [None req-6527310e-309c-4349-ab61-3f86695279b5 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Object Instance<2eaea7c2-a5c0-4950-b033-0012b5cec0ee> lazy-loaded attributes: trusted_certs,migration_context {{(pid=73572) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 10:23:59 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-6527310e-309c-4349-ab61-3f86695279b5 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] [instance: 2eaea7c2-a5c0-4950-b033-0012b5cec0ee] Created local disks {{(pid=73572) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 10:23:59 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-6527310e-309c-4349-ab61-3f86695279b5 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] [instance: 2eaea7c2-a5c0-4950-b033-0012b5cec0ee] Start _get_guest_xml network_info=[{"id": "0b4d66c9-2155-45ae-873a-2ee85776eeb7", "address": "fa:16:3e:69:d4:8e", "network": {"id": "757e71b4-5177-45a5-8ef5-9b27f42092f1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1765327616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1765327616-network", "vif_mac": "fa:16:3e:69:d4:8e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1bff48d66894950ac6690e1fd0e79b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b4d66c9-21", "ovs_interfaceid": "0b4d66c9-2155-45ae-873a-2ee85776eeb7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T10:07:33Z,direct_url=<?>,disk_format='qcow2',id=299da0c9-e1c4-48f0-be55-fbe20dd06bc9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5c995f8bbbab4368b67a253e0df3971a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T10:07:34Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '299da0c9-e1c4-48f0-be55-fbe20dd06bc9', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=73572) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 10:23:59 user nova-compute[73572]: DEBUG nova.objects.instance [None req-6527310e-309c-4349-ab61-3f86695279b5 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Lazy-loading 'resources' on Instance uuid 2eaea7c2-a5c0-4950-b033-0012b5cec0ee {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:23:59 user nova-compute[73572]: DEBUG nova.objects.base [None req-6527310e-309c-4349-ab61-3f86695279b5 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Object Instance<2eaea7c2-a5c0-4950-b033-0012b5cec0ee> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=73572) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 10:23:59 user nova-compute[73572]: DEBUG nova.objects.instance [None req-6527310e-309c-4349-ab61-3f86695279b5 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Lazy-loading 'numa_topology' on Instance uuid 2eaea7c2-a5c0-4950-b033-0012b5cec0ee {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:23:59 user nova-compute[73572]: DEBUG nova.objects.base [None req-6527310e-309c-4349-ab61-3f86695279b5 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Object Instance<2eaea7c2-a5c0-4950-b033-0012b5cec0ee> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=73572) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 10:23:59 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-6527310e-309c-4349-ab61-3f86695279b5 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:23:59 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-6527310e-309c-4349-ab61-3f86695279b5 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:23:59 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-6527310e-309c-4349-ab61-3f86695279b5 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73572) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 10:23:59 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-6527310e-309c-4349-ab61-3f86695279b5 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] CPU controller missing on host. {{(pid=73572) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 10:23:59 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-6527310e-309c-4349-ab61-3f86695279b5 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73572) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 10:23:59 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-6527310e-309c-4349-ab61-3f86695279b5 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] CPU controller found on host. {{(pid=73572) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 10:23:59 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-6527310e-309c-4349-ab61-3f86695279b5 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73572) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 10:23:59 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-6527310e-309c-4349-ab61-3f86695279b5 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T10:07:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T10:07:33Z,direct_url=<?>,disk_format='qcow2',id=299da0c9-e1c4-48f0-be55-fbe20dd06bc9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5c995f8bbbab4368b67a253e0df3971a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T10:07:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 10:23:59 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-6527310e-309c-4349-ab61-3f86695279b5 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Flavor limits 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 10:23:59 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-6527310e-309c-4349-ab61-3f86695279b5 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Image limits 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 10:23:59 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-6527310e-309c-4349-ab61-3f86695279b5 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Flavor pref 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 10:23:59 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-6527310e-309c-4349-ab61-3f86695279b5 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Image pref 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 10:23:59 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-6527310e-309c-4349-ab61-3f86695279b5 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 10:23:59 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-6527310e-309c-4349-ab61-3f86695279b5 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 10:23:59 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-6527310e-309c-4349-ab61-3f86695279b5 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73572) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 10:23:59 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-6527310e-309c-4349-ab61-3f86695279b5 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Got 1 possible topologies {{(pid=73572) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 10:23:59 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-6527310e-309c-4349-ab61-3f86695279b5 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 10:23:59 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-6527310e-309c-4349-ab61-3f86695279b5 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 10:23:59 user nova-compute[73572]: DEBUG nova.objects.instance [None req-6527310e-309c-4349-ab61-3f86695279b5 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Lazy-loading 'vcpu_model' on Instance uuid 2eaea7c2-a5c0-4950-b033-0012b5cec0ee {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:23:59 user nova-compute[73572]: DEBUG nova.objects.base [None req-6527310e-309c-4349-ab61-3f86695279b5 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Object Instance<2eaea7c2-a5c0-4950-b033-0012b5cec0ee> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=73572) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 10:23:59 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-6527310e-309c-4349-ab61-3f86695279b5 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T10:19:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-743407268',display_name='tempest-ServerRescueNegativeTestJSON-server-743407268',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-743407268',id=24,image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T10:19:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c1bff48d66894950ac6690e1fd0e79b9',ramdisk_id='',reservation_id='r-qoxdscxl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1710547876',owner_user_name='tempest-ServerRescueNegativeTestJSON-1710547876-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T10:19:20Z,user_data=None,user_id='099462c61dcc4816b17d2d0155823873',uuid=2eaea7c2-a5c0-4950-b033-0012b5cec0ee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0b4d66c9-2155-45ae-873a-2ee85776eeb7", "address": "fa:16:3e:69:d4:8e", "network": {"id": "757e71b4-5177-45a5-8ef5-9b27f42092f1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1765327616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1765327616-network", "vif_mac": "fa:16:3e:69:d4:8e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1bff48d66894950ac6690e1fd0e79b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b4d66c9-21", "ovs_interfaceid": "0b4d66c9-2155-45ae-873a-2ee85776eeb7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73572) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 10:23:59 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-6527310e-309c-4349-ab61-3f86695279b5 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Converting VIF {"id": "0b4d66c9-2155-45ae-873a-2ee85776eeb7", "address": "fa:16:3e:69:d4:8e", "network": {"id": "757e71b4-5177-45a5-8ef5-9b27f42092f1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1765327616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1765327616-network", "vif_mac": "fa:16:3e:69:d4:8e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1bff48d66894950ac6690e1fd0e79b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b4d66c9-21", "ovs_interfaceid": "0b4d66c9-2155-45ae-873a-2ee85776eeb7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:23:59 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-6527310e-309c-4349-ab61-3f86695279b5 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:69:d4:8e,bridge_name='br-int',has_traffic_filtering=True,id=0b4d66c9-2155-45ae-873a-2ee85776eeb7,network=Network(757e71b4-5177-45a5-8ef5-9b27f42092f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b4d66c9-21') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:23:59 user nova-compute[73572]: DEBUG nova.objects.instance [None req-6527310e-309c-4349-ab61-3f86695279b5 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Lazy-loading 'pci_devices' on Instance uuid 2eaea7c2-a5c0-4950-b033-0012b5cec0ee {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:23:59 user nova-compute[73572]: DEBUG nova.objects.base [None req-6527310e-309c-4349-ab61-3f86695279b5 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Object Instance<2eaea7c2-a5c0-4950-b033-0012b5cec0ee> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=73572) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 10:23:59 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-6527310e-309c-4349-ab61-3f86695279b5 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] [instance: 2eaea7c2-a5c0-4950-b033-0012b5cec0ee] End _get_guest_xml xml=<domain type="kvm">
Aug 26 10:23:59 user nova-compute[73572]:   <uuid>2eaea7c2-a5c0-4950-b033-0012b5cec0ee</uuid>
Aug 26 10:23:59 user nova-compute[73572]:   <name>instance-00000018</name>
Aug 26 10:23:59 user nova-compute[73572]:   <memory>524288</memory>
Aug 26 10:23:59 user nova-compute[73572]:   <vcpu>1</vcpu>
Aug 26 10:23:59 user nova-compute[73572]:   <metadata>
Aug 26 10:23:59 user nova-compute[73572]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 10:23:59 user nova-compute[73572]:       <nova:package version="0.0.0"/>
Aug 26 10:23:59 user nova-compute[73572]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-743407268</nova:name>
Aug 26 10:23:59 user nova-compute[73572]:       <nova:creationTime>2023-08-26 10:23:59</nova:creationTime>
Aug 26 10:23:59 user nova-compute[73572]:       <nova:flavor name="m1.tiny">
Aug 26 10:23:59 user nova-compute[73572]:         <nova:memory>512</nova:memory>
Aug 26 10:23:59 user nova-compute[73572]:         <nova:disk>1</nova:disk>
Aug 26 10:23:59 user nova-compute[73572]:         <nova:swap>0</nova:swap>
Aug 26 10:23:59 user nova-compute[73572]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 10:23:59 user nova-compute[73572]:         <nova:vcpus>1</nova:vcpus>
Aug 26 10:23:59 user nova-compute[73572]:       </nova:flavor>
Aug 26 10:23:59 user nova-compute[73572]:       <nova:owner>
Aug 26 10:23:59 user nova-compute[73572]:         <nova:user uuid="099462c61dcc4816b17d2d0155823873">tempest-ServerRescueNegativeTestJSON-1710547876-project-member</nova:user>
Aug 26 10:23:59 user nova-compute[73572]:         <nova:project uuid="c1bff48d66894950ac6690e1fd0e79b9">tempest-ServerRescueNegativeTestJSON-1710547876</nova:project>
Aug 26 10:23:59 user nova-compute[73572]:       </nova:owner>
Aug 26 10:23:59 user nova-compute[73572]:       <nova:root type="image" uuid="299da0c9-e1c4-48f0-be55-fbe20dd06bc9"/>
Aug 26 10:23:59 user nova-compute[73572]:       <nova:ports>
Aug 26 10:23:59 user nova-compute[73572]:         <nova:port uuid="0b4d66c9-2155-45ae-873a-2ee85776eeb7">
Aug 26 10:23:59 user nova-compute[73572]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 26 10:23:59 user nova-compute[73572]:         </nova:port>
Aug 26 10:23:59 user nova-compute[73572]:       </nova:ports>
Aug 26 10:23:59 user nova-compute[73572]:     </nova:instance>
Aug 26 10:23:59 user nova-compute[73572]:   </metadata>
Aug 26 10:23:59 user nova-compute[73572]:   <sysinfo type="smbios">
Aug 26 10:23:59 user nova-compute[73572]:     <system>
Aug 26 10:23:59 user nova-compute[73572]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 10:23:59 user nova-compute[73572]:       <entry name="product">OpenStack Nova</entry>
Aug 26 10:23:59 user nova-compute[73572]:       <entry name="version">0.0.0</entry>
Aug 26 10:23:59 user nova-compute[73572]:       <entry name="serial">2eaea7c2-a5c0-4950-b033-0012b5cec0ee</entry>
Aug 26 10:23:59 user nova-compute[73572]:       <entry name="uuid">2eaea7c2-a5c0-4950-b033-0012b5cec0ee</entry>
Aug 26 10:23:59 user nova-compute[73572]:       <entry name="family">Virtual Machine</entry>
Aug 26 10:23:59 user nova-compute[73572]:     </system>
Aug 26 10:23:59 user nova-compute[73572]:   </sysinfo>
Aug 26 10:23:59 user nova-compute[73572]:   <os>
Aug 26 10:23:59 user nova-compute[73572]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 10:23:59 user nova-compute[73572]:     <smbios mode="sysinfo"/>
Aug 26 10:23:59 user nova-compute[73572]:   </os>
Aug 26 10:23:59 user nova-compute[73572]:   <features>
Aug 26 10:23:59 user nova-compute[73572]:     <acpi/>
Aug 26 10:23:59 user nova-compute[73572]:     <apic/>
Aug 26 10:23:59 user nova-compute[73572]:     <vmcoreinfo/>
Aug 26 10:23:59 user nova-compute[73572]:   </features>
Aug 26 10:23:59 user nova-compute[73572]:   <clock offset="utc">
Aug 26 10:23:59 user nova-compute[73572]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 10:23:59 user nova-compute[73572]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 10:23:59 user nova-compute[73572]:     <timer name="hpet" present="no"/>
Aug 26 10:23:59 user nova-compute[73572]:   </clock>
Aug 26 10:23:59 user nova-compute[73572]:   <cpu mode="custom" match="exact">
Aug 26 10:23:59 user nova-compute[73572]:     <model>Nehalem</model>
Aug 26 10:23:59 user nova-compute[73572]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 10:23:59 user nova-compute[73572]:   </cpu>
Aug 26 10:23:59 user nova-compute[73572]:   <devices>
Aug 26 10:23:59 user nova-compute[73572]:     <disk type="file" device="disk">
Aug 26 10:23:59 user nova-compute[73572]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 10:23:59 user nova-compute[73572]:       <source file="/opt/stack/data/nova/instances/2eaea7c2-a5c0-4950-b033-0012b5cec0ee/disk.rescue"/>
Aug 26 10:23:59 user nova-compute[73572]:       <target dev="vda" bus="virtio"/>
Aug 26 10:23:59 user nova-compute[73572]:     </disk>
Aug 26 10:23:59 user nova-compute[73572]:     <disk type="file" device="disk">
Aug 26 10:23:59 user nova-compute[73572]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 10:23:59 user nova-compute[73572]:       <source file="/opt/stack/data/nova/instances/2eaea7c2-a5c0-4950-b033-0012b5cec0ee/disk"/>
Aug 26 10:23:59 user nova-compute[73572]:       <target dev="vdb" bus="virtio"/>
Aug 26 10:23:59 user nova-compute[73572]:     </disk>
Aug 26 10:23:59 user nova-compute[73572]:     <interface type="ethernet">
Aug 26 10:23:59 user nova-compute[73572]:       <mac address="fa:16:3e:69:d4:8e"/>
Aug 26 10:23:59 user nova-compute[73572]:       <model type="virtio"/>
Aug 26 10:23:59 user nova-compute[73572]:       <mtu size="1442"/>
Aug 26 10:23:59 user nova-compute[73572]:       <target dev="tap0b4d66c9-21"/>
Aug 26 10:23:59 user nova-compute[73572]:     </interface>
Aug 26 10:23:59 user nova-compute[73572]:     <serial type="pty">
Aug 26 10:23:59 user nova-compute[73572]:       <log file="/opt/stack/data/nova/instances/2eaea7c2-a5c0-4950-b033-0012b5cec0ee/console.log" append="off"/>
Aug 26 10:23:59 user nova-compute[73572]:     </serial>
Aug 26 10:23:59 user nova-compute[73572]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 10:23:59 user nova-compute[73572]:     <video>
Aug 26 10:23:59 user nova-compute[73572]:       <model type="virtio"/>
Aug 26 10:23:59 user nova-compute[73572]:     </video>
Aug 26 10:23:59 user nova-compute[73572]:     <rng model="virtio">
Aug 26 10:23:59 user nova-compute[73572]:       <backend model="random">/dev/urandom</backend>
Aug 26 10:23:59 user nova-compute[73572]:     </rng>
Aug 26 10:23:59 user nova-compute[73572]:     <controller type="usb" index="0" model="none"/>
Aug 26 10:23:59 user nova-compute[73572]:     <memballoon model="virtio">
Aug 26 10:23:59 user nova-compute[73572]:       <stats period="10"/>
Aug 26 10:23:59 user nova-compute[73572]:     </memballoon>
Aug 26 10:23:59 user nova-compute[73572]:   </devices>
Aug 26 10:23:59 user nova-compute[73572]: </domain>
Aug 26 10:23:59 user nova-compute[73572]:  {{(pid=73572) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 10:23:59 user nova-compute[73572]: INFO nova.virt.libvirt.driver [-] [instance: 2eaea7c2-a5c0-4950-b033-0012b5cec0ee] Instance destroyed successfully.
Aug 26 10:23:59 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-6527310e-309c-4349-ab61-3f86695279b5 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] No BDM found with device name vda, not building metadata. {{(pid=73572) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 10:23:59 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-6527310e-309c-4349-ab61-3f86695279b5 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73572) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 10:23:59 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-6527310e-309c-4349-ab61-3f86695279b5 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] No VIF found with MAC fa:16:3e:69:d4:8e, not building metadata {{(pid=73572) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 10:23:59 user nova-compute[73572]: DEBUG os_brick.utils [None req-2d78f066-2a94-4a2e-a165-7032c5422cd4 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 10:23:59 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:23:59 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:23:59 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[e267be76-617d-4b87-b60c-195e9e993f3d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:de8a79ed912\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:23:59 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:23:59 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:23:59 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[a24c7d4e-5257-4222-b8e1-0b43d8ec9293]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:23:59 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:23:59 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:23:59 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[81ae0b71-28f0-4325-9914-b0c15fcebd18]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:23:59 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[be3ab162-51ee-497d-be13-69d6e1c90a69]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:23:59 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-2d78f066-2a94-4a2e-a165-7032c5422cd4 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Running cmd (subprocess): nvme version {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:24:00 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-2d78f066-2a94-4a2e-a165-7032c5422cd4 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] 'nvme version' failed. Not Retrying. {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 10:24:00 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2d78f066-2a94-4a2e-a165-7032c5422cd4 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] nvme not present on system {{(pid=73572) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 10:24:00 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:24:00 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 10:24:00 user nova-compute[73572]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 10:24:00 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6385a46-5ab9-4aac-b1a8-5c6253fcfb0a]: (4, '') {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:24:00 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.lightos [None req-2d78f066-2a94-4a2e-a165-7032c5422cd4 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73572) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 10:24:00 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.lightos [None req-2d78f066-2a94-4a2e-a165-7032c5422cd4 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73572) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 10:24:00 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.lightos [None req-2d78f066-2a94-4a2e-a165-7032c5422cd4 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] LIGHTOS: no hostnqn found. {{(pid=73572) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 10:24:00 user nova-compute[73572]: DEBUG os_brick.utils [None req-2d78f066-2a94-4a2e-a165-7032c5422cd4 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:de8a79ed912', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 10:24:00 user nova-compute[73572]: DEBUG nova.virt.block_device [None req-2d78f066-2a94-4a2e-a165-7032c5422cd4 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: 8a8816e5-696d-4384-b0e0-29aa7cdd957c] Updating existing volume attachment record: 72ad31df-c217-45c2-b99f-be36333bf6ea {{(pid=73572) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 10:24:00 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:24:00 user nova-compute[73572]: DEBUG nova.compute.manager [req-11076d8e-eea9-4d72-a541-a4b3f6494a62 req-9186f8fb-41c3-4f83-97a3-e8a34fb1e38d service nova] [instance: 2eaea7c2-a5c0-4950-b033-0012b5cec0ee] Received event network-vif-plugged-0b4d66c9-2155-45ae-873a-2ee85776eeb7 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:24:00 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-11076d8e-eea9-4d72-a541-a4b3f6494a62 req-9186f8fb-41c3-4f83-97a3-e8a34fb1e38d service nova] Acquiring lock "2eaea7c2-a5c0-4950-b033-0012b5cec0ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:24:00 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-11076d8e-eea9-4d72-a541-a4b3f6494a62 req-9186f8fb-41c3-4f83-97a3-e8a34fb1e38d service nova] Lock "2eaea7c2-a5c0-4950-b033-0012b5cec0ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:24:00 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-11076d8e-eea9-4d72-a541-a4b3f6494a62 req-9186f8fb-41c3-4f83-97a3-e8a34fb1e38d service nova] Lock "2eaea7c2-a5c0-4950-b033-0012b5cec0ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:24:00 user nova-compute[73572]: DEBUG nova.compute.manager [req-11076d8e-eea9-4d72-a541-a4b3f6494a62 req-9186f8fb-41c3-4f83-97a3-e8a34fb1e38d service nova] [instance: 2eaea7c2-a5c0-4950-b033-0012b5cec0ee] No waiting events found dispatching network-vif-plugged-0b4d66c9-2155-45ae-873a-2ee85776eeb7 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:24:00 user nova-compute[73572]: WARNING nova.compute.manager [req-11076d8e-eea9-4d72-a541-a4b3f6494a62 req-9186f8fb-41c3-4f83-97a3-e8a34fb1e38d service nova] [instance: 2eaea7c2-a5c0-4950-b033-0012b5cec0ee] Received unexpected event network-vif-plugged-0b4d66c9-2155-45ae-873a-2ee85776eeb7 for instance with vm_state active and task_state rescuing.
Aug 26 10:24:01 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:24:01 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:24:01 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:24:01 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:24:01 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:24:01 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:24:02 user nova-compute[73572]: DEBUG nova.compute.manager [req-66bd1eb5-e801-46f6-b6a4-494eda8431be req-02a07345-77f3-4c68-a860-750aec120f08 service nova] [instance: 2eaea7c2-a5c0-4950-b033-0012b5cec0ee] Received event network-vif-plugged-0b4d66c9-2155-45ae-873a-2ee85776eeb7 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:24:02 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-66bd1eb5-e801-46f6-b6a4-494eda8431be req-02a07345-77f3-4c68-a860-750aec120f08 service nova] Acquiring lock "2eaea7c2-a5c0-4950-b033-0012b5cec0ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:24:02 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-66bd1eb5-e801-46f6-b6a4-494eda8431be req-02a07345-77f3-4c68-a860-750aec120f08 service nova] Lock "2eaea7c2-a5c0-4950-b033-0012b5cec0ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:24:02 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-66bd1eb5-e801-46f6-b6a4-494eda8431be req-02a07345-77f3-4c68-a860-750aec120f08 service nova] Lock "2eaea7c2-a5c0-4950-b033-0012b5cec0ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:24:02 user nova-compute[73572]: DEBUG nova.compute.manager [req-66bd1eb5-e801-46f6-b6a4-494eda8431be req-02a07345-77f3-4c68-a860-750aec120f08 service nova] [instance: 2eaea7c2-a5c0-4950-b033-0012b5cec0ee] No waiting events found dispatching network-vif-plugged-0b4d66c9-2155-45ae-873a-2ee85776eeb7 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:24:02 user nova-compute[73572]: WARNING nova.compute.manager [req-66bd1eb5-e801-46f6-b6a4-494eda8431be req-02a07345-77f3-4c68-a860-750aec120f08 service nova] [instance: 2eaea7c2-a5c0-4950-b033-0012b5cec0ee] Received unexpected event network-vif-plugged-0b4d66c9-2155-45ae-873a-2ee85776eeb7 for instance with vm_state active and task_state rescuing.
Aug 26 10:24:02 user nova-compute[73572]: DEBUG nova.compute.manager [req-66bd1eb5-e801-46f6-b6a4-494eda8431be req-02a07345-77f3-4c68-a860-750aec120f08 service nova] [instance: 2eaea7c2-a5c0-4950-b033-0012b5cec0ee] Received event network-vif-plugged-0b4d66c9-2155-45ae-873a-2ee85776eeb7 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:24:02 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-66bd1eb5-e801-46f6-b6a4-494eda8431be req-02a07345-77f3-4c68-a860-750aec120f08 service nova] Acquiring lock "2eaea7c2-a5c0-4950-b033-0012b5cec0ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:24:02 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-66bd1eb5-e801-46f6-b6a4-494eda8431be req-02a07345-77f3-4c68-a860-750aec120f08 service nova] Lock "2eaea7c2-a5c0-4950-b033-0012b5cec0ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:24:02 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-66bd1eb5-e801-46f6-b6a4-494eda8431be req-02a07345-77f3-4c68-a860-750aec120f08 service nova] Lock "2eaea7c2-a5c0-4950-b033-0012b5cec0ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:24:02 user nova-compute[73572]: DEBUG nova.compute.manager [req-66bd1eb5-e801-46f6-b6a4-494eda8431be req-02a07345-77f3-4c68-a860-750aec120f08 service nova] [instance: 2eaea7c2-a5c0-4950-b033-0012b5cec0ee] No waiting events found dispatching network-vif-plugged-0b4d66c9-2155-45ae-873a-2ee85776eeb7 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:24:02 user nova-compute[73572]: WARNING nova.compute.manager [req-66bd1eb5-e801-46f6-b6a4-494eda8431be req-02a07345-77f3-4c68-a860-750aec120f08 service nova] [instance: 2eaea7c2-a5c0-4950-b033-0012b5cec0ee] Received unexpected event network-vif-plugged-0b4d66c9-2155-45ae-873a-2ee85776eeb7 for instance with vm_state active and task_state rescuing.
Aug 26 10:24:03 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:24:03 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Removed pending event for 2eaea7c2-a5c0-4950-b033-0012b5cec0ee due to event {{(pid=73572) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 26 10:24:03 user nova-compute[73572]: DEBUG nova.virt.driver [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Emitting event <LifecycleEvent: 1693045443.788367, 2eaea7c2-a5c0-4950-b033-0012b5cec0ee => Resumed> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:24:03 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 2eaea7c2-a5c0-4950-b033-0012b5cec0ee] VM Resumed (Lifecycle Event)
Aug 26 10:24:03 user nova-compute[73572]: DEBUG nova.compute.manager [None req-6527310e-309c-4349-ab61-3f86695279b5 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] [instance: 2eaea7c2-a5c0-4950-b033-0012b5cec0ee] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:24:03 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 2eaea7c2-a5c0-4950-b033-0012b5cec0ee] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:24:03 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 2eaea7c2-a5c0-4950-b033-0012b5cec0ee] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73572) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 10:24:03 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 2eaea7c2-a5c0-4950-b033-0012b5cec0ee] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 26 10:24:03 user nova-compute[73572]: DEBUG nova.virt.driver [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Emitting event <LifecycleEvent: 1693045443.788607, 2eaea7c2-a5c0-4950-b033-0012b5cec0ee => Started> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:24:03 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 2eaea7c2-a5c0-4950-b033-0012b5cec0ee] VM Started (Lifecycle Event)
Aug 26 10:24:03 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 2eaea7c2-a5c0-4950-b033-0012b5cec0ee] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:24:03 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 2eaea7c2-a5c0-4950-b033-0012b5cec0ee] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73572) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 10:24:05 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:24:05 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:24:08 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:24:10 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:24:12 user nova-compute[73572]: DEBUG nova.compute.manager [None req-2d78f066-2a94-4a2e-a165-7032c5422cd4 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: 8a8816e5-696d-4384-b0e0-29aa7cdd957c] Start spawning the instance on the hypervisor. {{(pid=73572) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 10:24:12 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-2d78f066-2a94-4a2e-a165-7032c5422cd4 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: 8a8816e5-696d-4384-b0e0-29aa7cdd957c] Creating instance directory {{(pid=73572) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 10:24:12 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-2d78f066-2a94-4a2e-a165-7032c5422cd4 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: 8a8816e5-696d-4384-b0e0-29aa7cdd957c] Creating image(s)
Aug 26 10:24:12 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-2d78f066-2a94-4a2e-a165-7032c5422cd4 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: 8a8816e5-696d-4384-b0e0-29aa7cdd957c] Did not create local disks {{(pid=73572) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 26 10:24:12 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-2d78f066-2a94-4a2e-a165-7032c5422cd4 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: 8a8816e5-696d-4384-b0e0-29aa7cdd957c] Ensure instance console log exists: /opt/stack/data/nova/instances/8a8816e5-696d-4384-b0e0-29aa7cdd957c/console.log {{(pid=73572) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 10:24:12 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-2d78f066-2a94-4a2e-a165-7032c5422cd4 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:24:12 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-2d78f066-2a94-4a2e-a165-7032c5422cd4 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:24:12 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-2d78f066-2a94-4a2e-a165-7032c5422cd4 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:24:12 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-2d78f066-2a94-4a2e-a165-7032c5422cd4 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: 8a8816e5-696d-4384-b0e0-29aa7cdd957c] Start _get_guest_xml network_info=[{"id": "2e650fb9-427c-477e-ba45-ddc070399617", "address": "fa:16:3e:6c:94:14", "network": {"id": "991b9dff-5173-4456-a530-b1f7eb5cfa4a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1845930297-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4636f93c5bfc4653804de097aed2882c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e650fb9-42", "ovs_interfaceid": "2e650fb9-427c-477e-ba45-ddc070399617", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T10:07:33Z,direct_url=<?>,disk_format='qcow2',id=299da0c9-e1c4-48f0-be55-fbe20dd06bc9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5c995f8bbbab4368b67a253e0df3971a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T10:07:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'disk_bus': 'virtio', 'boot_index': 0, 'mount_device': '/dev/vda', 'attachment_id': '72ad31df-c217-45c2-b99f-be36333bf6ea', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:133098b2-106a-427f-aa6d-2c10625dd152'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RvoAbQip', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '8a8816e5-696d-4384-b0e0-29aa7cdd957c', 'attached_at': '', 'detached_at': '', 'volume_id': '133098b2-106a-427f-aa6d-2c10625dd152', 'serial': '133098b2-106a-427f-aa6d-2c10625dd152'}, 'guest_format': None, 'device_type': 'disk', 'volume_type': None} {{(pid=73572) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 10:24:12 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-2d78f066-2a94-4a2e-a165-7032c5422cd4 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:24:12 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-2d78f066-2a94-4a2e-a165-7032c5422cd4 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:24:12 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-2d78f066-2a94-4a2e-a165-7032c5422cd4 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73572) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 10:24:12 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-2d78f066-2a94-4a2e-a165-7032c5422cd4 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] CPU controller missing on host. {{(pid=73572) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 10:24:12 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-2d78f066-2a94-4a2e-a165-7032c5422cd4 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73572) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 10:24:12 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-2d78f066-2a94-4a2e-a165-7032c5422cd4 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] CPU controller found on host. {{(pid=73572) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 10:24:12 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-2d78f066-2a94-4a2e-a165-7032c5422cd4 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73572) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 10:24:12 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-2d78f066-2a94-4a2e-a165-7032c5422cd4 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T10:07:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T10:07:33Z,direct_url=<?>,disk_format='qcow2',id=299da0c9-e1c4-48f0-be55-fbe20dd06bc9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5c995f8bbbab4368b67a253e0df3971a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T10:07:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 10:24:12 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-2d78f066-2a94-4a2e-a165-7032c5422cd4 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Flavor limits 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 10:24:12 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-2d78f066-2a94-4a2e-a165-7032c5422cd4 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Image limits 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 10:24:12 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-2d78f066-2a94-4a2e-a165-7032c5422cd4 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Flavor pref 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 10:24:12 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-2d78f066-2a94-4a2e-a165-7032c5422cd4 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Image pref 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 10:24:12 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-2d78f066-2a94-4a2e-a165-7032c5422cd4 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 10:24:12 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-2d78f066-2a94-4a2e-a165-7032c5422cd4 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 10:24:12 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-2d78f066-2a94-4a2e-a165-7032c5422cd4 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73572) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 10:24:12 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-2d78f066-2a94-4a2e-a165-7032c5422cd4 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Got 1 possible topologies {{(pid=73572) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 10:24:12 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-2d78f066-2a94-4a2e-a165-7032c5422cd4 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 10:24:12 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-2d78f066-2a94-4a2e-a165-7032c5422cd4 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 10:24:13 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2d78f066-2a94-4a2e-a165-7032c5422cd4 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: 8a8816e5-696d-4384-b0e0-29aa7cdd957c] Calling os-brick to attach iSCSI Volume {{(pid=73572) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 10:24:13 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d78f066-2a94-4a2e-a165-7032c5422cd4 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc89c3d6a10>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:133098b2-106a-427f-aa6d-2c10625dd152'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RvoAbQip', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 10:24:13 user nova-compute[73572]: WARNING os_brick.initiator.connectors.base [None req-2d78f066-2a94-4a2e-a165-7032c5422cd4 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 10:24:13 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-2d78f066-2a94-4a2e-a165-7032c5422cd4 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 10:24:13 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-2d78f066-2a94-4a2e-a165-7032c5422cd4 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 10:24:13 user nova-compute[73572]: WARNING os_brick.initiator.connectors.base [None req-2d78f066-2a94-4a2e-a165-7032c5422cd4 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 10:24:13 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-2d78f066-2a94-4a2e-a165-7032c5422cd4 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:133098b2-106a-427f-aa6d-2c10625dd152" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 10:24:13 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-2d78f066-2a94-4a2e-a165-7032c5422cd4 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:133098b2-106a-427f-aa6d-2c10625dd152" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 10:24:13 user nova-compute[73572]: INFO os_brick.initiator.connectors.iscsi [None req-2d78f066-2a94-4a2e-a165-7032c5422cd4 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 10:24:13 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:133098b2-106a-427f-aa6d-2c10625dd152 -p 172.16.0.220:3260 {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:24:13 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:133098b2-106a-427f-aa6d-2c10625dd152 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:24:13 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[787dd8fa-5422-4ad7-a84e-407979725087]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:24:13 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d78f066-2a94-4a2e-a165-7032c5422cd4 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 10:24:13 user nova-compute[73572]:  {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:24:13 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:133098b2-106a-427f-aa6d-2c10625dd152 -p 172.16.0.220:3260 --interface default --op new {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:24:13 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:133098b2-106a-427f-aa6d-2c10625dd152 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:24:13 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a91ea1f-5678-4c7d-b963-d383996e2f11]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:133098b2-106a-427f-aa6d-2c10625dd152] added\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:24:13 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d78f066-2a94-4a2e-a165-7032c5422cd4 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:133098b2-106a-427f-aa6d-2c10625dd152] added
Aug 26 10:24:13 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:24:13 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:133098b2-106a-427f-aa6d-2c10625dd152 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:24:13 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:133098b2-106a-427f-aa6d-2c10625dd152 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:24:13 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e596cf3-e4e4-4fb2-ac91-d0e57f8bcbb8]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:24:13 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d78f066-2a94-4a2e-a165-7032c5422cd4 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:24:13 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:133098b2-106a-427f-aa6d-2c10625dd152 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:24:13 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:133098b2-106a-427f-aa6d-2c10625dd152 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:24:13 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[530b738b-1da8-409f-a174-f5d34229dc53]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:24:13 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d78f066-2a94-4a2e-a165-7032c5422cd4 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:24:13 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:133098b2-106a-427f-aa6d-2c10625dd152 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RvoAbQip {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:24:13 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:133098b2-106a-427f-aa6d-2c10625dd152 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RvoAbQip" returned: 0 in 0.018s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:24:13 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd445d31-cffc-46b2-a96a-f717d07abf41]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:24:13 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d78f066-2a94-4a2e-a165-7032c5422cd4 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RvoAbQip'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:24:13 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:133098b2-106a-427f-aa6d-2c10625dd152 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:24:13 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:133098b2-106a-427f-aa6d-2c10625dd152 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:24:13 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[0833dcf4-4cc3-4467-a7c8-fa79f14c96e8]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:24:13 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d78f066-2a94-4a2e-a165-7032c5422cd4 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:24:13 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:24:13 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:24:13 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc2c5e97-2e1b-45f9-a7b1-a00fac3f5cbd]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f3a153b-1b99-4297-ad26-ea58f33330b8 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19c2d1dd-dfb9-4ac0-8341-35f96b7ade56 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dbf6103-5796-4273-a8a9-81d262560347 (non-flash)\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:24:13 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d78f066-2a94-4a2e-a165-7032c5422cd4 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)
Aug 26 10:24:13 user nova-compute[73572]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f3a153b-1b99-4297-ad26-ea58f33330b8 (non-flash)
Aug 26 10:24:13 user nova-compute[73572]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19c2d1dd-dfb9-4ac0-8341-35f96b7ade56 (non-flash)
Aug 26 10:24:13 user nova-compute[73572]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dbf6103-5796-4273-a8a9-81d262560347 (non-flash)
Aug 26 10:24:13 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 10:24:13 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d78f066-2a94-4a2e-a165-7032c5422cd4 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)
Aug 26 10:24:13 user nova-compute[73572]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f3a153b-1b99-4297-ad26-ea58f33330b8 (non-flash)
Aug 26 10:24:13 user nova-compute[73572]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19c2d1dd-dfb9-4ac0-8341-35f96b7ade56 (non-flash)
Aug 26 10:24:13 user nova-compute[73572]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dbf6103-5796-4273-a8a9-81d262560347 (non-flash)
Aug 26 10:24:13 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 10:24:13 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:133098b2-106a-427f-aa6d-2c10625dd152 -p 172.16.0.220:3260 --login {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:24:13 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:133098b2-106a-427f-aa6d-2c10625dd152 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:24:13 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[61774a5d-1c32-4387-9aa1-54389f75834f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:133098b2-106a-427f-aa6d-2c10625dd152, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:133098b2-106a-427f-aa6d-2c10625dd152, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:24:13 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d78f066-2a94-4a2e-a165-7032c5422cd4 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:133098b2-106a-427f-aa6d-2c10625dd152, portal: 172.16.0.220,3260]
Aug 26 10:24:13 user nova-compute[73572]: Login to [iface: default, target: iqn.2010-10.org.openstack:133098b2-106a-427f-aa6d-2c10625dd152, portal: 172.16.0.220,3260] successful.
Aug 26 10:24:13 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:24:13 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:133098b2-106a-427f-aa6d-2c10625dd152 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:24:13 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:133098b2-106a-427f-aa6d-2c10625dd152 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:24:13 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[020354ab-6eb5-461e-bb36-74f9c8a79c47]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:24:13 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d78f066-2a94-4a2e-a165-7032c5422cd4 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:24:13 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:24:13 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:24:13 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8e47a6b-f11c-407a-8f19-d4246001938d]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f3a153b-1b99-4297-ad26-ea58f33330b8 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19c2d1dd-dfb9-4ac0-8341-35f96b7ade56 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dbf6103-5796-4273-a8a9-81d262560347 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133098b2-106a-427f-aa6d-2c10625dd152 (non-flash)\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:24:13 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d78f066-2a94-4a2e-a165-7032c5422cd4 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)
Aug 26 10:24:13 user nova-compute[73572]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f3a153b-1b99-4297-ad26-ea58f33330b8 (non-flash)
Aug 26 10:24:13 user nova-compute[73572]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19c2d1dd-dfb9-4ac0-8341-35f96b7ade56 (non-flash)
Aug 26 10:24:13 user nova-compute[73572]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dbf6103-5796-4273-a8a9-81d262560347 (non-flash)
Aug 26 10:24:13 user nova-compute[73572]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133098b2-106a-427f-aa6d-2c10625dd152 (non-flash)
Aug 26 10:24:13 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 10:24:13 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d78f066-2a94-4a2e-a165-7032c5422cd4 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)
Aug 26 10:24:13 user nova-compute[73572]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f3a153b-1b99-4297-ad26-ea58f33330b8 (non-flash)
Aug 26 10:24:13 user nova-compute[73572]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19c2d1dd-dfb9-4ac0-8341-35f96b7ade56 (non-flash)
Aug 26 10:24:13 user nova-compute[73572]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dbf6103-5796-4273-a8a9-81d262560347 (non-flash)
Aug 26 10:24:13 user nova-compute[73572]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133098b2-106a-427f-aa6d-2c10625dd152 (non-flash)
Aug 26 10:24:13 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 10:24:13 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-2d78f066-2a94-4a2e-a165-7032c5422cd4 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:133098b2-106a-427f-aa6d-2c10625dd152" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.316s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 10:24:13 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d78f066-2a94-4a2e-a165-7032c5422cd4 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Connected to 172.16.0.220:3260 {{(pid=73572) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 10:24:13 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-2d78f066-2a94-4a2e-a165-7032c5422cd4 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] HCTL ('36', '-', '-', 0) found on session 34 with lun 0 {{(pid=73572) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 10:24:13 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-2d78f066-2a94-4a2e-a165-7032c5422cd4 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73572) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 10:24:13 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:24:13 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:24:13 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fc017de-8ad8-4876-be29-84d2f7c96cd8]: (4, ('- - 0', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:24:13 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-2d78f066-2a94-4a2e-a165-7032c5422cd4 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Searching for a device in session 34 and hctl ['36', '*', '*', 0] yield: None {{(pid=73572) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 10:24:13 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:24:13 user nova-compute[73572]: DEBUG nova.compute.manager [req-9eade804-9282-4f80-a8db-61bcc195c73d req-4e5bf7bb-be4c-4468-859a-09e9b6a730e8 service nova] [instance: 1bc7408c-28d0-4735-95ef-3a03dc7a86ba] Received event network-changed-eff78739-eebe-4f04-b3d5-debe2d15fe72 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:24:13 user nova-compute[73572]: DEBUG nova.compute.manager [req-9eade804-9282-4f80-a8db-61bcc195c73d req-4e5bf7bb-be4c-4468-859a-09e9b6a730e8 service nova] [instance: 1bc7408c-28d0-4735-95ef-3a03dc7a86ba] Refreshing instance network info cache due to event network-changed-eff78739-eebe-4f04-b3d5-debe2d15fe72. {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 10:24:13 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-9eade804-9282-4f80-a8db-61bcc195c73d req-4e5bf7bb-be4c-4468-859a-09e9b6a730e8 service nova] Acquiring lock "refresh_cache-1bc7408c-28d0-4735-95ef-3a03dc7a86ba" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:24:13 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-9eade804-9282-4f80-a8db-61bcc195c73d req-4e5bf7bb-be4c-4468-859a-09e9b6a730e8 service nova] Acquired lock "refresh_cache-1bc7408c-28d0-4735-95ef-3a03dc7a86ba" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:24:13 user nova-compute[73572]: DEBUG nova.network.neutron [req-9eade804-9282-4f80-a8db-61bcc195c73d req-4e5bf7bb-be4c-4468-859a-09e9b6a730e8 service nova] [instance: 1bc7408c-28d0-4735-95ef-3a03dc7a86ba] Refreshing network info cache for port eff78739-eebe-4f04-b3d5-debe2d15fe72 {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 10:24:14 user nova-compute[73572]: DEBUG nova.network.neutron [req-9eade804-9282-4f80-a8db-61bcc195c73d req-4e5bf7bb-be4c-4468-859a-09e9b6a730e8 service nova] [instance: 1bc7408c-28d0-4735-95ef-3a03dc7a86ba] Updated VIF entry in instance network info cache for port eff78739-eebe-4f04-b3d5-debe2d15fe72. {{(pid=73572) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 10:24:14 user nova-compute[73572]: DEBUG nova.network.neutron [req-9eade804-9282-4f80-a8db-61bcc195c73d req-4e5bf7bb-be4c-4468-859a-09e9b6a730e8 service nova] [instance: 1bc7408c-28d0-4735-95ef-3a03dc7a86ba] Updating instance_info_cache with network_info: [{"id": "eff78739-eebe-4f04-b3d5-debe2d15fe72", "address": "fa:16:3e:9c:b2:e4", "network": {"id": "880aa066-8f77-469b-a0c4-e4e94ae31e1a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-313654920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47abd6293c07465389c379e3b5061164", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeff78739-ee", "ovs_interfaceid": "eff78739-eebe-4f04-b3d5-debe2d15fe72", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:24:14 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-9eade804-9282-4f80-a8db-61bcc195c73d req-4e5bf7bb-be4c-4468-859a-09e9b6a730e8 service nova] Releasing lock "refresh_cache-1bc7408c-28d0-4735-95ef-3a03dc7a86ba" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:24:14 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-2d78f066-2a94-4a2e-a165-7032c5422cd4 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Searching for a device in session 34 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73572) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 10:24:14 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d78f066-2a94-4a2e-a165-7032c5422cd4 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RvoAbQip', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73572) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 10:24:14 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-2d78f066-2a94-4a2e-a165-7032c5422cd4 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.346s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 10:24:14 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d78f066-2a94-4a2e-a165-7032c5422cd4 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] <== connect_volume: return (1347ms) {'type': 'block', 'scsi_wwn': '23933326438653337', 'path': '/dev/sde'} {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 10:24:14 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2d78f066-2a94-4a2e-a165-7032c5422cd4 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: 8a8816e5-696d-4384-b0e0-29aa7cdd957c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23933326438653337', 'path': '/dev/sde'} {{(pid=73572) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 10:24:14 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-2d78f066-2a94-4a2e-a165-7032c5422cd4 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T10:23:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1498662503',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1498662503',id=33,image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4636f93c5bfc4653804de097aed2882c',ramdisk_id='',reservation_id='r-96kck33c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-665602868',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T10:23:49Z,user_data=None,user_id='07f3538038a14713af3bbe420f1fb03a',uuid=8a8816e5-696d-4384-b0e0-29aa7cdd957c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2e650fb9-427c-477e-ba45-ddc070399617", "address": "fa:16:3e:6c:94:14", "network": {"id": "991b9dff-5173-4456-a530-b1f7eb5cfa4a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1845930297-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4636f93c5bfc4653804de097aed2882c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e650fb9-42", "ovs_interfaceid": "2e650fb9-427c-477e-ba45-ddc070399617", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73572) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 10:24:14 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-2d78f066-2a94-4a2e-a165-7032c5422cd4 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Converting VIF {"id": "2e650fb9-427c-477e-ba45-ddc070399617", "address": "fa:16:3e:6c:94:14", "network": {"id": "991b9dff-5173-4456-a530-b1f7eb5cfa4a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1845930297-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4636f93c5bfc4653804de097aed2882c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e650fb9-42", "ovs_interfaceid": "2e650fb9-427c-477e-ba45-ddc070399617", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:24:14 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-2d78f066-2a94-4a2e-a165-7032c5422cd4 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:94:14,bridge_name='br-int',has_traffic_filtering=True,id=2e650fb9-427c-477e-ba45-ddc070399617,network=Network(991b9dff-5173-4456-a530-b1f7eb5cfa4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e650fb9-42') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:24:14 user nova-compute[73572]: DEBUG nova.objects.instance [None req-2d78f066-2a94-4a2e-a165-7032c5422cd4 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Lazy-loading 'pci_devices' on Instance uuid 8a8816e5-696d-4384-b0e0-29aa7cdd957c {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:24:14 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-2d78f066-2a94-4a2e-a165-7032c5422cd4 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: 8a8816e5-696d-4384-b0e0-29aa7cdd957c] End _get_guest_xml xml=<domain type="kvm">
Aug 26 10:24:14 user nova-compute[73572]:   <uuid>8a8816e5-696d-4384-b0e0-29aa7cdd957c</uuid>
Aug 26 10:24:14 user nova-compute[73572]:   <name>instance-00000021</name>
Aug 26 10:24:14 user nova-compute[73572]:   <memory>524288</memory>
Aug 26 10:24:14 user nova-compute[73572]:   <vcpu>1</vcpu>
Aug 26 10:24:14 user nova-compute[73572]:   <metadata>
Aug 26 10:24:14 user nova-compute[73572]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 10:24:14 user nova-compute[73572]:       <nova:package version="0.0.0"/>
Aug 26 10:24:14 user nova-compute[73572]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1498662503</nova:name>
Aug 26 10:24:14 user nova-compute[73572]:       <nova:creationTime>2023-08-26 10:24:12</nova:creationTime>
Aug 26 10:24:14 user nova-compute[73572]:       <nova:flavor name="m1.tiny">
Aug 26 10:24:14 user nova-compute[73572]:         <nova:memory>512</nova:memory>
Aug 26 10:24:14 user nova-compute[73572]:         <nova:disk>1</nova:disk>
Aug 26 10:24:14 user nova-compute[73572]:         <nova:swap>0</nova:swap>
Aug 26 10:24:14 user nova-compute[73572]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 10:24:14 user nova-compute[73572]:         <nova:vcpus>1</nova:vcpus>
Aug 26 10:24:14 user nova-compute[73572]:       </nova:flavor>
Aug 26 10:24:14 user nova-compute[73572]:       <nova:owner>
Aug 26 10:24:14 user nova-compute[73572]:         <nova:user uuid="07f3538038a14713af3bbe420f1fb03a">tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member</nova:user>
Aug 26 10:24:14 user nova-compute[73572]:         <nova:project uuid="4636f93c5bfc4653804de097aed2882c">tempest-ServerBootFromVolumeStableRescueTest-665602868</nova:project>
Aug 26 10:24:14 user nova-compute[73572]:       </nova:owner>
Aug 26 10:24:14 user nova-compute[73572]:       <nova:root type="image" uuid="299da0c9-e1c4-48f0-be55-fbe20dd06bc9"/>
Aug 26 10:24:14 user nova-compute[73572]:       <nova:ports>
Aug 26 10:24:14 user nova-compute[73572]:         <nova:port uuid="2e650fb9-427c-477e-ba45-ddc070399617">
Aug 26 10:24:14 user nova-compute[73572]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 26 10:24:14 user nova-compute[73572]:         </nova:port>
Aug 26 10:24:14 user nova-compute[73572]:       </nova:ports>
Aug 26 10:24:14 user nova-compute[73572]:     </nova:instance>
Aug 26 10:24:14 user nova-compute[73572]:   </metadata>
Aug 26 10:24:14 user nova-compute[73572]:   <sysinfo type="smbios">
Aug 26 10:24:14 user nova-compute[73572]:     <system>
Aug 26 10:24:14 user nova-compute[73572]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 10:24:14 user nova-compute[73572]:       <entry name="product">OpenStack Nova</entry>
Aug 26 10:24:14 user nova-compute[73572]:       <entry name="version">0.0.0</entry>
Aug 26 10:24:14 user nova-compute[73572]:       <entry name="serial">8a8816e5-696d-4384-b0e0-29aa7cdd957c</entry>
Aug 26 10:24:14 user nova-compute[73572]:       <entry name="uuid">8a8816e5-696d-4384-b0e0-29aa7cdd957c</entry>
Aug 26 10:24:14 user nova-compute[73572]:       <entry name="family">Virtual Machine</entry>
Aug 26 10:24:14 user nova-compute[73572]:     </system>
Aug 26 10:24:14 user nova-compute[73572]:   </sysinfo>
Aug 26 10:24:14 user nova-compute[73572]:   <os>
Aug 26 10:24:14 user nova-compute[73572]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 10:24:14 user nova-compute[73572]:     <boot dev="hd"/>
Aug 26 10:24:14 user nova-compute[73572]:     <smbios mode="sysinfo"/>
Aug 26 10:24:14 user nova-compute[73572]:   </os>
Aug 26 10:24:14 user nova-compute[73572]:   <features>
Aug 26 10:24:14 user nova-compute[73572]:     <acpi/>
Aug 26 10:24:14 user nova-compute[73572]:     <apic/>
Aug 26 10:24:14 user nova-compute[73572]:     <vmcoreinfo/>
Aug 26 10:24:14 user nova-compute[73572]:   </features>
Aug 26 10:24:14 user nova-compute[73572]:   <clock offset="utc">
Aug 26 10:24:14 user nova-compute[73572]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 10:24:14 user nova-compute[73572]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 10:24:14 user nova-compute[73572]:     <timer name="hpet" present="no"/>
Aug 26 10:24:14 user nova-compute[73572]:   </clock>
Aug 26 10:24:14 user nova-compute[73572]:   <cpu mode="custom" match="exact">
Aug 26 10:24:14 user nova-compute[73572]:     <model>Nehalem</model>
Aug 26 10:24:14 user nova-compute[73572]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 10:24:14 user nova-compute[73572]:   </cpu>
Aug 26 10:24:14 user nova-compute[73572]:   <devices>
Aug 26 10:24:14 user nova-compute[73572]:     <disk type="block" device="disk">
Aug 26 10:24:14 user nova-compute[73572]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 10:24:14 user nova-compute[73572]:       <source dev="/dev/sde"/>
Aug 26 10:24:14 user nova-compute[73572]:       <target dev="vda" bus="virtio"/>
Aug 26 10:24:14 user nova-compute[73572]:       <serial>133098b2-106a-427f-aa6d-2c10625dd152</serial>
Aug 26 10:24:14 user nova-compute[73572]:     </disk>
Aug 26 10:24:14 user nova-compute[73572]:     <interface type="ethernet">
Aug 26 10:24:14 user nova-compute[73572]:       <mac address="fa:16:3e:6c:94:14"/>
Aug 26 10:24:14 user nova-compute[73572]:       <model type="virtio"/>
Aug 26 10:24:14 user nova-compute[73572]:       <mtu size="1442"/>
Aug 26 10:24:14 user nova-compute[73572]:       <target dev="tap2e650fb9-42"/>
Aug 26 10:24:14 user nova-compute[73572]:     </interface>
Aug 26 10:24:14 user nova-compute[73572]:     <serial type="pty">
Aug 26 10:24:14 user nova-compute[73572]:       <log file="/opt/stack/data/nova/instances/8a8816e5-696d-4384-b0e0-29aa7cdd957c/console.log" append="off"/>
Aug 26 10:24:14 user nova-compute[73572]:     </serial>
Aug 26 10:24:14 user nova-compute[73572]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 10:24:14 user nova-compute[73572]:     <video>
Aug 26 10:24:14 user nova-compute[73572]:       <model type="virtio"/>
Aug 26 10:24:14 user nova-compute[73572]:     </video>
Aug 26 10:24:14 user nova-compute[73572]:     <rng model="virtio">
Aug 26 10:24:14 user nova-compute[73572]:       <backend model="random">/dev/urandom</backend>
Aug 26 10:24:14 user nova-compute[73572]:     </rng>
Aug 26 10:24:14 user nova-compute[73572]:     <controller type="usb" index="0" model="none"/>
Aug 26 10:24:14 user nova-compute[73572]:     <memballoon model="virtio">
Aug 26 10:24:14 user nova-compute[73572]:       <stats period="10"/>
Aug 26 10:24:14 user nova-compute[73572]:     </memballoon>
Aug 26 10:24:14 user nova-compute[73572]:   </devices>
Aug 26 10:24:14 user nova-compute[73572]: </domain>
Aug 26 10:24:14 user nova-compute[73572]:  {{(pid=73572) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 10:24:14 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-2d78f066-2a94-4a2e-a165-7032c5422cd4 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T10:23:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1498662503',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1498662503',id=33,image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4636f93c5bfc4653804de097aed2882c',ramdisk_id='',reservation_id='r-96kck33c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-665602868',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T10:23:49Z,user_data=None,user_id='07f3538038a14713af3bbe420f1fb03a',uuid=8a8816e5-696d-4384-b0e0-29aa7cdd957c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2e650fb9-427c-477e-ba45-ddc070399617", "address": "fa:16:3e:6c:94:14", "network": {"id": "991b9dff-5173-4456-a530-b1f7eb5cfa4a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1845930297-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4636f93c5bfc4653804de097aed2882c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e650fb9-42", "ovs_interfaceid": "2e650fb9-427c-477e-ba45-ddc070399617", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 10:24:14 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-2d78f066-2a94-4a2e-a165-7032c5422cd4 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Converting VIF {"id": "2e650fb9-427c-477e-ba45-ddc070399617", "address": "fa:16:3e:6c:94:14", "network": {"id": "991b9dff-5173-4456-a530-b1f7eb5cfa4a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1845930297-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4636f93c5bfc4653804de097aed2882c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e650fb9-42", "ovs_interfaceid": "2e650fb9-427c-477e-ba45-ddc070399617", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:24:14 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-2d78f066-2a94-4a2e-a165-7032c5422cd4 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:94:14,bridge_name='br-int',has_traffic_filtering=True,id=2e650fb9-427c-477e-ba45-ddc070399617,network=Network(991b9dff-5173-4456-a530-b1f7eb5cfa4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e650fb9-42') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:24:14 user nova-compute[73572]: DEBUG os_vif [None req-2d78f066-2a94-4a2e-a165-7032c5422cd4 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:94:14,bridge_name='br-int',has_traffic_filtering=True,id=2e650fb9-427c-477e-ba45-ddc070399617,network=Network(991b9dff-5173-4456-a530-b1f7eb5cfa4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e650fb9-42') {{(pid=73572) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 10:24:14 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:24:14 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:24:14 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 10:24:14 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:24:14 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2e650fb9-42, may_exist=True, interface_attrs={}) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:24:14 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2e650fb9-42, col_values=(('external_ids', {'iface-id': '2e650fb9-427c-477e-ba45-ddc070399617', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6c:94:14', 'vm-uuid': '8a8816e5-696d-4384-b0e0-29aa7cdd957c'}),), if_exists=True) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:24:14 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:24:14 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:24:14 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:24:14 user nova-compute[73572]: INFO os_vif [None req-2d78f066-2a94-4a2e-a165-7032c5422cd4 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:94:14,bridge_name='br-int',has_traffic_filtering=True,id=2e650fb9-427c-477e-ba45-ddc070399617,network=Network(991b9dff-5173-4456-a530-b1f7eb5cfa4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e650fb9-42')
Aug 26 10:24:14 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-2d78f066-2a94-4a2e-a165-7032c5422cd4 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] No BDM found with device name vda, not building metadata. {{(pid=73572) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 10:24:14 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-2d78f066-2a94-4a2e-a165-7032c5422cd4 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] No VIF found with MAC fa:16:3e:6c:94:14, not building metadata {{(pid=73572) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 10:24:15 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-12e20477-9614-49da-8f9b-c66bdfccb8f2 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Acquiring lock "1bc7408c-28d0-4735-95ef-3a03dc7a86ba" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:24:15 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-12e20477-9614-49da-8f9b-c66bdfccb8f2 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Lock "1bc7408c-28d0-4735-95ef-3a03dc7a86ba" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:24:15 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-12e20477-9614-49da-8f9b-c66bdfccb8f2 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Acquiring lock "1bc7408c-28d0-4735-95ef-3a03dc7a86ba-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:24:15 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-12e20477-9614-49da-8f9b-c66bdfccb8f2 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Lock "1bc7408c-28d0-4735-95ef-3a03dc7a86ba-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:24:15 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-12e20477-9614-49da-8f9b-c66bdfccb8f2 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Lock "1bc7408c-28d0-4735-95ef-3a03dc7a86ba-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:24:15 user nova-compute[73572]: INFO nova.compute.manager [None req-12e20477-9614-49da-8f9b-c66bdfccb8f2 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] [instance: 1bc7408c-28d0-4735-95ef-3a03dc7a86ba] Terminating instance
Aug 26 10:24:15 user nova-compute[73572]: DEBUG nova.compute.manager [None req-12e20477-9614-49da-8f9b-c66bdfccb8f2 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] [instance: 1bc7408c-28d0-4735-95ef-3a03dc7a86ba] Start destroying the instance on the hypervisor. {{(pid=73572) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 10:24:15 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:24:15 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:24:15 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:24:15 user nova-compute[73572]: DEBUG nova.compute.manager [req-bb13db0f-6f04-48e6-a5e5-6fd29653ab37 req-c6cec771-c95f-4ba8-bedb-bfdb06d1eb9c service nova] [instance: 1bc7408c-28d0-4735-95ef-3a03dc7a86ba] Received event network-vif-unplugged-eff78739-eebe-4f04-b3d5-debe2d15fe72 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:24:15 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-bb13db0f-6f04-48e6-a5e5-6fd29653ab37 req-c6cec771-c95f-4ba8-bedb-bfdb06d1eb9c service nova] Acquiring lock "1bc7408c-28d0-4735-95ef-3a03dc7a86ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:24:15 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-bb13db0f-6f04-48e6-a5e5-6fd29653ab37 req-c6cec771-c95f-4ba8-bedb-bfdb06d1eb9c service nova] Lock "1bc7408c-28d0-4735-95ef-3a03dc7a86ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:24:15 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-bb13db0f-6f04-48e6-a5e5-6fd29653ab37 req-c6cec771-c95f-4ba8-bedb-bfdb06d1eb9c service nova] Lock "1bc7408c-28d0-4735-95ef-3a03dc7a86ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:24:15 user nova-compute[73572]: DEBUG nova.compute.manager [req-bb13db0f-6f04-48e6-a5e5-6fd29653ab37 req-c6cec771-c95f-4ba8-bedb-bfdb06d1eb9c service nova] [instance: 1bc7408c-28d0-4735-95ef-3a03dc7a86ba] No waiting events found dispatching network-vif-unplugged-eff78739-eebe-4f04-b3d5-debe2d15fe72 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:24:15 user nova-compute[73572]: DEBUG nova.compute.manager [req-bb13db0f-6f04-48e6-a5e5-6fd29653ab37 req-c6cec771-c95f-4ba8-bedb-bfdb06d1eb9c service nova] [instance: 1bc7408c-28d0-4735-95ef-3a03dc7a86ba] Received event network-vif-unplugged-eff78739-eebe-4f04-b3d5-debe2d15fe72 for instance with task_state deleting. {{(pid=73572) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 10:24:15 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:24:15 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:24:16 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:24:16 user nova-compute[73572]: INFO nova.virt.libvirt.driver [-] [instance: 1bc7408c-28d0-4735-95ef-3a03dc7a86ba] Instance destroyed successfully.
Aug 26 10:24:16 user nova-compute[73572]: DEBUG nova.objects.instance [None req-12e20477-9614-49da-8f9b-c66bdfccb8f2 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Lazy-loading 'resources' on Instance uuid 1bc7408c-28d0-4735-95ef-3a03dc7a86ba {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:24:16 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-12e20477-9614-49da-8f9b-c66bdfccb8f2 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T10:22:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-414197323',display_name='tempest-AttachVolumeNegativeTest-server-414197323',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-414197323',id=30,image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCpWEbpQmu2jjkg5ttIV0hup2/h6V2MvCmqHw+R0njQupXdVw7s5d0Z+CbB6J+0kGaMkX44EeE9olpA7JQ28UY6WI1/LVsf1dLg2vWBjqYOjVMHpsstE0hsWTjQ88eHaUw==',key_name='tempest-keypair-361963779',keypairs=<?>,launch_index=0,launched_at=2023-08-26T10:22:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='47abd6293c07465389c379e3b5061164',ramdisk_id='',reservation_id='r-ms3ukdd8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-608798758',owner_user_name='tempest-AttachVolumeNegativeTest-608798758-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T10:22:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c7cf9c8d529d49149141add20c2b2af2',uuid=1bc7408c-28d0-4735-95ef-3a03dc7a86ba,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "eff78739-eebe-4f04-b3d5-debe2d15fe72", "address": "fa:16:3e:9c:b2:e4", "network": {"id": "880aa066-8f77-469b-a0c4-e4e94ae31e1a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-313654920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47abd6293c07465389c379e3b5061164", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeff78739-ee", "ovs_interfaceid": "eff78739-eebe-4f04-b3d5-debe2d15fe72", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 10:24:16 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-12e20477-9614-49da-8f9b-c66bdfccb8f2 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Converting VIF {"id": "eff78739-eebe-4f04-b3d5-debe2d15fe72", "address": "fa:16:3e:9c:b2:e4", "network": {"id": "880aa066-8f77-469b-a0c4-e4e94ae31e1a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-313654920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47abd6293c07465389c379e3b5061164", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeff78739-ee", "ovs_interfaceid": "eff78739-eebe-4f04-b3d5-debe2d15fe72", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:24:16 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-12e20477-9614-49da-8f9b-c66bdfccb8f2 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9c:b2:e4,bridge_name='br-int',has_traffic_filtering=True,id=eff78739-eebe-4f04-b3d5-debe2d15fe72,network=Network(880aa066-8f77-469b-a0c4-e4e94ae31e1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeff78739-ee') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:24:16 user nova-compute[73572]: DEBUG os_vif [None req-12e20477-9614-49da-8f9b-c66bdfccb8f2 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9c:b2:e4,bridge_name='br-int',has_traffic_filtering=True,id=eff78739-eebe-4f04-b3d5-debe2d15fe72,network=Network(880aa066-8f77-469b-a0c4-e4e94ae31e1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeff78739-ee') {{(pid=73572) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 10:24:16 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:24:16 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapeff78739-ee, bridge=br-int, if_exists=True) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:24:16 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:24:16 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:24:16 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:24:16 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:24:16 user nova-compute[73572]: INFO os_vif [None req-12e20477-9614-49da-8f9b-c66bdfccb8f2 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9c:b2:e4,bridge_name='br-int',has_traffic_filtering=True,id=eff78739-eebe-4f04-b3d5-debe2d15fe72,network=Network(880aa066-8f77-469b-a0c4-e4e94ae31e1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeff78739-ee')
Aug 26 10:24:16 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-12e20477-9614-49da-8f9b-c66bdfccb8f2 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] [instance: 1bc7408c-28d0-4735-95ef-3a03dc7a86ba] Deleting instance files /opt/stack/data/nova/instances/1bc7408c-28d0-4735-95ef-3a03dc7a86ba_del
Aug 26 10:24:16 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-12e20477-9614-49da-8f9b-c66bdfccb8f2 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] [instance: 1bc7408c-28d0-4735-95ef-3a03dc7a86ba] Deletion of /opt/stack/data/nova/instances/1bc7408c-28d0-4735-95ef-3a03dc7a86ba_del complete
Aug 26 10:24:16 user nova-compute[73572]: INFO nova.compute.manager [None req-12e20477-9614-49da-8f9b-c66bdfccb8f2 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] [instance: 1bc7408c-28d0-4735-95ef-3a03dc7a86ba] Took 1.21 seconds to destroy the instance on the hypervisor.
Aug 26 10:24:16 user nova-compute[73572]: DEBUG oslo.service.loopingcall [None req-12e20477-9614-49da-8f9b-c66bdfccb8f2 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73572) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 10:24:16 user nova-compute[73572]: DEBUG nova.compute.manager [-] [instance: 1bc7408c-28d0-4735-95ef-3a03dc7a86ba] Deallocating network for instance {{(pid=73572) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 10:24:16 user nova-compute[73572]: DEBUG nova.network.neutron [-] [instance: 1bc7408c-28d0-4735-95ef-3a03dc7a86ba] deallocate_for_instance() {{(pid=73572) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 10:24:16 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:24:17 user nova-compute[73572]: DEBUG nova.network.neutron [-] [instance: 1bc7408c-28d0-4735-95ef-3a03dc7a86ba] Updating instance_info_cache with network_info: [] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:24:17 user nova-compute[73572]: INFO nova.compute.manager [-] [instance: 1bc7408c-28d0-4735-95ef-3a03dc7a86ba] Took 0.85 seconds to deallocate network for instance.
Aug 26 10:24:17 user nova-compute[73572]: DEBUG nova.compute.manager [req-ca072316-7f8b-4f56-8295-a21fda553474 req-05f48012-3802-4980-8b1a-b0199743cc6e service nova] [instance: 1bc7408c-28d0-4735-95ef-3a03dc7a86ba] Received event network-vif-deleted-eff78739-eebe-4f04-b3d5-debe2d15fe72 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:24:17 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-12e20477-9614-49da-8f9b-c66bdfccb8f2 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:24:17 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-12e20477-9614-49da-8f9b-c66bdfccb8f2 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:24:17 user nova-compute[73572]: DEBUG nova.compute.manager [req-24f9fd8d-f917-447c-b0a2-fbb12ac8568b req-246931c2-4396-4ab0-8f7c-bd426281e0fa service nova] [instance: 1bc7408c-28d0-4735-95ef-3a03dc7a86ba] Received event network-vif-plugged-eff78739-eebe-4f04-b3d5-debe2d15fe72 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:24:17 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-24f9fd8d-f917-447c-b0a2-fbb12ac8568b req-246931c2-4396-4ab0-8f7c-bd426281e0fa service nova] Acquiring lock "1bc7408c-28d0-4735-95ef-3a03dc7a86ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:24:17 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-24f9fd8d-f917-447c-b0a2-fbb12ac8568b req-246931c2-4396-4ab0-8f7c-bd426281e0fa service nova] Lock "1bc7408c-28d0-4735-95ef-3a03dc7a86ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:24:17 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-24f9fd8d-f917-447c-b0a2-fbb12ac8568b req-246931c2-4396-4ab0-8f7c-bd426281e0fa service nova] Lock "1bc7408c-28d0-4735-95ef-3a03dc7a86ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:24:17 user nova-compute[73572]: DEBUG nova.compute.manager [req-24f9fd8d-f917-447c-b0a2-fbb12ac8568b req-246931c2-4396-4ab0-8f7c-bd426281e0fa service nova] [instance: 1bc7408c-28d0-4735-95ef-3a03dc7a86ba] No waiting events found dispatching network-vif-plugged-eff78739-eebe-4f04-b3d5-debe2d15fe72 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:24:17 user nova-compute[73572]: WARNING nova.compute.manager [req-24f9fd8d-f917-447c-b0a2-fbb12ac8568b req-246931c2-4396-4ab0-8f7c-bd426281e0fa service nova] [instance: 1bc7408c-28d0-4735-95ef-3a03dc7a86ba] Received unexpected event network-vif-plugged-eff78739-eebe-4f04-b3d5-debe2d15fe72 for instance with vm_state deleted and task_state None.
Aug 26 10:24:17 user nova-compute[73572]: DEBUG nova.compute.manager [req-24f9fd8d-f917-447c-b0a2-fbb12ac8568b req-246931c2-4396-4ab0-8f7c-bd426281e0fa service nova] [instance: 8a8816e5-696d-4384-b0e0-29aa7cdd957c] Received event network-vif-plugged-2e650fb9-427c-477e-ba45-ddc070399617 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:24:17 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-24f9fd8d-f917-447c-b0a2-fbb12ac8568b req-246931c2-4396-4ab0-8f7c-bd426281e0fa service nova] Acquiring lock "8a8816e5-696d-4384-b0e0-29aa7cdd957c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:24:17 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-24f9fd8d-f917-447c-b0a2-fbb12ac8568b req-246931c2-4396-4ab0-8f7c-bd426281e0fa service nova] Lock "8a8816e5-696d-4384-b0e0-29aa7cdd957c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:24:17 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-24f9fd8d-f917-447c-b0a2-fbb12ac8568b req-246931c2-4396-4ab0-8f7c-bd426281e0fa service nova] Lock "8a8816e5-696d-4384-b0e0-29aa7cdd957c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:24:17 user nova-compute[73572]: DEBUG nova.compute.manager [req-24f9fd8d-f917-447c-b0a2-fbb12ac8568b req-246931c2-4396-4ab0-8f7c-bd426281e0fa service nova] [instance: 8a8816e5-696d-4384-b0e0-29aa7cdd957c] No waiting events found dispatching network-vif-plugged-2e650fb9-427c-477e-ba45-ddc070399617 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:24:17 user nova-compute[73572]: WARNING nova.compute.manager [req-24f9fd8d-f917-447c-b0a2-fbb12ac8568b req-246931c2-4396-4ab0-8f7c-bd426281e0fa service nova] [instance: 8a8816e5-696d-4384-b0e0-29aa7cdd957c] Received unexpected event network-vif-plugged-2e650fb9-427c-477e-ba45-ddc070399617 for instance with vm_state building and task_state spawning.
Aug 26 10:24:17 user nova-compute[73572]: DEBUG nova.compute.manager [req-24f9fd8d-f917-447c-b0a2-fbb12ac8568b req-246931c2-4396-4ab0-8f7c-bd426281e0fa service nova] [instance: 8a8816e5-696d-4384-b0e0-29aa7cdd957c] Received event network-vif-plugged-2e650fb9-427c-477e-ba45-ddc070399617 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:24:17 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-24f9fd8d-f917-447c-b0a2-fbb12ac8568b req-246931c2-4396-4ab0-8f7c-bd426281e0fa service nova] Acquiring lock "8a8816e5-696d-4384-b0e0-29aa7cdd957c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:24:17 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-24f9fd8d-f917-447c-b0a2-fbb12ac8568b req-246931c2-4396-4ab0-8f7c-bd426281e0fa service nova] Lock "8a8816e5-696d-4384-b0e0-29aa7cdd957c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:24:17 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-24f9fd8d-f917-447c-b0a2-fbb12ac8568b req-246931c2-4396-4ab0-8f7c-bd426281e0fa service nova] Lock "8a8816e5-696d-4384-b0e0-29aa7cdd957c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:24:17 user nova-compute[73572]: DEBUG nova.compute.manager [req-24f9fd8d-f917-447c-b0a2-fbb12ac8568b req-246931c2-4396-4ab0-8f7c-bd426281e0fa service nova] [instance: 8a8816e5-696d-4384-b0e0-29aa7cdd957c] No waiting events found dispatching network-vif-plugged-2e650fb9-427c-477e-ba45-ddc070399617 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:24:17 user nova-compute[73572]: WARNING nova.compute.manager [req-24f9fd8d-f917-447c-b0a2-fbb12ac8568b req-246931c2-4396-4ab0-8f7c-bd426281e0fa service nova] [instance: 8a8816e5-696d-4384-b0e0-29aa7cdd957c] Received unexpected event network-vif-plugged-2e650fb9-427c-477e-ba45-ddc070399617 for instance with vm_state building and task_state spawning.
Aug 26 10:24:17 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:24:17 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Starting heal instance info cache {{(pid=73572) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 10:24:17 user nova-compute[73572]: DEBUG nova.compute.provider_tree [None req-12e20477-9614-49da-8f9b-c66bdfccb8f2 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Inventory has not changed in ProviderTree for provider: e2cec974-59b2-4c77-a53d-a7f4e5a30d75 {{(pid=73572) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 10:24:17 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-12e20477-9614-49da-8f9b-c66bdfccb8f2 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Inventory has not changed for provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73572) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 10:24:17 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Didn't find any instances for network info cache update. {{(pid=73572) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 26 10:24:17 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:24:17 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:24:17 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73572) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 10:24:17 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-12e20477-9614-49da-8f9b-c66bdfccb8f2 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.433s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:24:17 user nova-compute[73572]: INFO nova.scheduler.client.report [None req-12e20477-9614-49da-8f9b-c66bdfccb8f2 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Deleted allocations for instance 1bc7408c-28d0-4735-95ef-3a03dc7a86ba
Aug 26 10:24:17 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:24:17 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-12e20477-9614-49da-8f9b-c66bdfccb8f2 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Lock "1bc7408c-28d0-4735-95ef-3a03dc7a86ba" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.757s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:24:18 user nova-compute[73572]: DEBUG nova.virt.driver [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Emitting event <LifecycleEvent: 1693045458.3429384, 8a8816e5-696d-4384-b0e0-29aa7cdd957c => Resumed> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:24:18 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 8a8816e5-696d-4384-b0e0-29aa7cdd957c] VM Resumed (Lifecycle Event)
Aug 26 10:24:18 user nova-compute[73572]: DEBUG nova.compute.manager [None req-2d78f066-2a94-4a2e-a165-7032c5422cd4 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: 8a8816e5-696d-4384-b0e0-29aa7cdd957c] Instance event wait completed in 0 seconds for  {{(pid=73572) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 10:24:18 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-2d78f066-2a94-4a2e-a165-7032c5422cd4 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: 8a8816e5-696d-4384-b0e0-29aa7cdd957c] Guest created on hypervisor {{(pid=73572) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 10:24:18 user nova-compute[73572]: INFO nova.virt.libvirt.driver [-] [instance: 8a8816e5-696d-4384-b0e0-29aa7cdd957c] Instance spawned successfully.
Aug 26 10:24:18 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-2d78f066-2a94-4a2e-a165-7032c5422cd4 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: 8a8816e5-696d-4384-b0e0-29aa7cdd957c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 10:24:18 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 8a8816e5-696d-4384-b0e0-29aa7cdd957c] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:24:18 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 8a8816e5-696d-4384-b0e0-29aa7cdd957c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73572) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 10:24:18 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-2d78f066-2a94-4a2e-a165-7032c5422cd4 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: 8a8816e5-696d-4384-b0e0-29aa7cdd957c] Found default for hw_cdrom_bus of ide {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:24:18 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-2d78f066-2a94-4a2e-a165-7032c5422cd4 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: 8a8816e5-696d-4384-b0e0-29aa7cdd957c] Found default for hw_disk_bus of virtio {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:24:18 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-2d78f066-2a94-4a2e-a165-7032c5422cd4 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: 8a8816e5-696d-4384-b0e0-29aa7cdd957c] Found default for hw_input_bus of None {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:24:18 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-2d78f066-2a94-4a2e-a165-7032c5422cd4 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: 8a8816e5-696d-4384-b0e0-29aa7cdd957c] Found default for hw_pointer_model of None {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:24:18 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-2d78f066-2a94-4a2e-a165-7032c5422cd4 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: 8a8816e5-696d-4384-b0e0-29aa7cdd957c] Found default for hw_video_model of virtio {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:24:18 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-2d78f066-2a94-4a2e-a165-7032c5422cd4 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: 8a8816e5-696d-4384-b0e0-29aa7cdd957c] Found default for hw_vif_model of virtio {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:24:18 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 8a8816e5-696d-4384-b0e0-29aa7cdd957c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 10:24:18 user nova-compute[73572]: DEBUG nova.virt.driver [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Emitting event <LifecycleEvent: 1693045458.3441749, 8a8816e5-696d-4384-b0e0-29aa7cdd957c => Started> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:24:18 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 8a8816e5-696d-4384-b0e0-29aa7cdd957c] VM Started (Lifecycle Event)
Aug 26 10:24:18 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 8a8816e5-696d-4384-b0e0-29aa7cdd957c] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:24:18 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 8a8816e5-696d-4384-b0e0-29aa7cdd957c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73572) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 10:24:18 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 8a8816e5-696d-4384-b0e0-29aa7cdd957c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 10:24:18 user nova-compute[73572]: INFO nova.compute.manager [None req-2d78f066-2a94-4a2e-a165-7032c5422cd4 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: 8a8816e5-696d-4384-b0e0-29aa7cdd957c] Took 5.50 seconds to spawn the instance on the hypervisor.
Aug 26 10:24:18 user nova-compute[73572]: DEBUG nova.compute.manager [None req-2d78f066-2a94-4a2e-a165-7032c5422cd4 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: 8a8816e5-696d-4384-b0e0-29aa7cdd957c] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:24:18 user nova-compute[73572]: INFO nova.compute.manager [None req-2d78f066-2a94-4a2e-a165-7032c5422cd4 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: 8a8816e5-696d-4384-b0e0-29aa7cdd957c] Took 30.29 seconds to build instance.
Aug 26 10:24:18 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-2d78f066-2a94-4a2e-a165-7032c5422cd4 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Lock "8a8816e5-696d-4384-b0e0-29aa7cdd957c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 30.388s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:24:19 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:24:20 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:24:21 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:24:21 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:24:23 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:24:23 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:24:23 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:24:23 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:24:23 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:24:23 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:24:23 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Auditing locally available compute resources for user (node: user) {{(pid=73572) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 10:24:24 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73572) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 10:24:24 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c785b609-0068-442f-91f5-d26e888a993f/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:24:24 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c785b609-0068-442f-91f5-d26e888a993f/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:24:24 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c785b609-0068-442f-91f5-d26e888a993f/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:24:24 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c785b609-0068-442f-91f5-d26e888a993f/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:24:24 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e468b473-515f-41ad-a75c-65d4c6d575c8/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:24:24 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e468b473-515f-41ad-a75c-65d4c6d575c8/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:24:24 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e468b473-515f-41ad-a75c-65d4c6d575c8/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:24:24 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e468b473-515f-41ad-a75c-65d4c6d575c8/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:24:24 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44a737bf-3704-4193-8d24-b8d132267279/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:24:24 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44a737bf-3704-4193-8d24-b8d132267279/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:24:24 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44a737bf-3704-4193-8d24-b8d132267279/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:24:25 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:24:25 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44a737bf-3704-4193-8d24-b8d132267279/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:24:25 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=73572) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 10:24:25 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00c47a06-2bf8-427d-bcb1-304688584511/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:24:25 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00c47a06-2bf8-427d-bcb1-304688584511/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:24:25 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00c47a06-2bf8-427d-bcb1-304688584511/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:24:25 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00c47a06-2bf8-427d-bcb1-304688584511/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:24:25 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86923c1a-89a5-4e7a-b488-8bf3a013bf83/disk.rescue --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:24:25 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86923c1a-89a5-4e7a-b488-8bf3a013bf83/disk.rescue --force-share --output=json" returned: 0 in 0.194s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:24:25 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86923c1a-89a5-4e7a-b488-8bf3a013bf83/disk.rescue --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:24:26 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86923c1a-89a5-4e7a-b488-8bf3a013bf83/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:24:26 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86923c1a-89a5-4e7a-b488-8bf3a013bf83/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:24:26 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86923c1a-89a5-4e7a-b488-8bf3a013bf83/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:24:26 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86923c1a-89a5-4e7a-b488-8bf3a013bf83/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:24:26 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:24:26 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-44d45d4a-35af-49f9-ae80-3893725fd419 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Acquiring lock "0fe47a17-4ffb-48ce-b0f6-a9b43002bd55" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:24:26 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-44d45d4a-35af-49f9-ae80-3893725fd419 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Lock "0fe47a17-4ffb-48ce-b0f6-a9b43002bd55" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:24:26 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-44d45d4a-35af-49f9-ae80-3893725fd419 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Acquiring lock "0fe47a17-4ffb-48ce-b0f6-a9b43002bd55-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:24:26 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-44d45d4a-35af-49f9-ae80-3893725fd419 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Lock "0fe47a17-4ffb-48ce-b0f6-a9b43002bd55-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:24:26 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-44d45d4a-35af-49f9-ae80-3893725fd419 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Lock "0fe47a17-4ffb-48ce-b0f6-a9b43002bd55-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:24:26 user nova-compute[73572]: INFO nova.compute.manager [None req-44d45d4a-35af-49f9-ae80-3893725fd419 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] [instance: 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55] Terminating instance
Aug 26 10:24:26 user nova-compute[73572]: DEBUG nova.compute.manager [None req-44d45d4a-35af-49f9-ae80-3893725fd419 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] [instance: 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55] Start destroying the instance on the hypervisor. {{(pid=73572) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 10:24:26 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86923c1a-89a5-4e7a-b488-8bf3a013bf83/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:24:26 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=73572) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 10:24:26 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68613b1e-c45c-4fd9-834c-3630ed0f456a/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:24:26 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:24:26 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:24:26 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:24:26 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68613b1e-c45c-4fd9-834c-3630ed0f456a/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:24:26 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68613b1e-c45c-4fd9-834c-3630ed0f456a/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:24:26 user nova-compute[73572]: DEBUG nova.compute.manager [req-80e9d1f1-5cac-4930-9d4e-43522fb9593f req-ceae489e-e48c-4d95-82d0-9955777df839 service nova] [instance: 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55] Received event network-vif-unplugged-ebf9f385-e59b-4060-9bf9-a8d2006327b4 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:24:26 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-80e9d1f1-5cac-4930-9d4e-43522fb9593f req-ceae489e-e48c-4d95-82d0-9955777df839 service nova] Acquiring lock "0fe47a17-4ffb-48ce-b0f6-a9b43002bd55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:24:26 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-80e9d1f1-5cac-4930-9d4e-43522fb9593f req-ceae489e-e48c-4d95-82d0-9955777df839 service nova] Lock "0fe47a17-4ffb-48ce-b0f6-a9b43002bd55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:24:26 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-80e9d1f1-5cac-4930-9d4e-43522fb9593f req-ceae489e-e48c-4d95-82d0-9955777df839 service nova] Lock "0fe47a17-4ffb-48ce-b0f6-a9b43002bd55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.004s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:24:26 user nova-compute[73572]: DEBUG nova.compute.manager [req-80e9d1f1-5cac-4930-9d4e-43522fb9593f req-ceae489e-e48c-4d95-82d0-9955777df839 service nova] [instance: 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55] No waiting events found dispatching network-vif-unplugged-ebf9f385-e59b-4060-9bf9-a8d2006327b4 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:24:26 user nova-compute[73572]: DEBUG nova.compute.manager [req-80e9d1f1-5cac-4930-9d4e-43522fb9593f req-ceae489e-e48c-4d95-82d0-9955777df839 service nova] [instance: 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55] Received event network-vif-unplugged-ebf9f385-e59b-4060-9bf9-a8d2006327b4 for instance with task_state deleting. {{(pid=73572) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 10:24:26 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68613b1e-c45c-4fd9-834c-3630ed0f456a/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:24:27 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fe47a17-4ffb-48ce-b0f6-a9b43002bd55/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:24:27 user nova-compute[73572]: INFO nova.virt.libvirt.driver [-] [instance: 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55] Instance destroyed successfully.
Aug 26 10:24:27 user nova-compute[73572]: DEBUG nova.objects.instance [None req-44d45d4a-35af-49f9-ae80-3893725fd419 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Lazy-loading 'resources' on Instance uuid 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55 {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:24:27 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-44d45d4a-35af-49f9-ae80-3893725fd419 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T10:15:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-220365578',display_name='tempest-ServerActionsTestOtherB-server-220365578',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-220365578',id=17,image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNpUMyiGXRzsPFYrzC1k+DPeAQeFXKXREu1ci6G2S65T1Gci+/hLSOFjcdBoLqgENyI+7/uwXL8y2F/F10thQC08ST7hXeII35W/K66MHhxc0L254FUOJIzPARZXOsUESA==',key_name='tempest-keypair-2095276623',keypairs=<?>,launch_index=0,launched_at=2023-08-26T10:22:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0d2c922711fb445aa99ae4f30b802c12',ramdisk_id='',reservation_id='r-ktz04i2y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-1806914349',owner_user_name='tempest-ServerActionsTestOtherB-1806914349-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T10:22:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0ee7e4a9f7db476eb9f16440c6b8e37e',uuid=0fe47a17-4ffb-48ce-b0f6-a9b43002bd55,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ebf9f385-e59b-4060-9bf9-a8d2006327b4", "address": "fa:16:3e:49:23:6a", "network": {"id": "7c89c22a-96d4-4e60-9c4c-b5a82a7eca55", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1976182948-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d2c922711fb445aa99ae4f30b802c12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebf9f385-e5", "ovs_interfaceid": "ebf9f385-e59b-4060-9bf9-a8d2006327b4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 10:24:27 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-44d45d4a-35af-49f9-ae80-3893725fd419 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Converting VIF {"id": "ebf9f385-e59b-4060-9bf9-a8d2006327b4", "address": "fa:16:3e:49:23:6a", "network": {"id": "7c89c22a-96d4-4e60-9c4c-b5a82a7eca55", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1976182948-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d2c922711fb445aa99ae4f30b802c12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebf9f385-e5", "ovs_interfaceid": "ebf9f385-e59b-4060-9bf9-a8d2006327b4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:24:27 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-44d45d4a-35af-49f9-ae80-3893725fd419 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:49:23:6a,bridge_name='br-int',has_traffic_filtering=True,id=ebf9f385-e59b-4060-9bf9-a8d2006327b4,network=Network(7c89c22a-96d4-4e60-9c4c-b5a82a7eca55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebf9f385-e5') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:24:27 user nova-compute[73572]: DEBUG os_vif [None req-44d45d4a-35af-49f9-ae80-3893725fd419 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:49:23:6a,bridge_name='br-int',has_traffic_filtering=True,id=ebf9f385-e59b-4060-9bf9-a8d2006327b4,network=Network(7c89c22a-96d4-4e60-9c4c-b5a82a7eca55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebf9f385-e5') {{(pid=73572) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 10:24:27 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:24:27 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapebf9f385-e5, bridge=br-int, if_exists=True) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:24:27 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:24:27 user nova-compute[73572]: INFO os_vif [None req-44d45d4a-35af-49f9-ae80-3893725fd419 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:49:23:6a,bridge_name='br-int',has_traffic_filtering=True,id=ebf9f385-e59b-4060-9bf9-a8d2006327b4,network=Network(7c89c22a-96d4-4e60-9c4c-b5a82a7eca55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebf9f385-e5')
Aug 26 10:24:27 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-44d45d4a-35af-49f9-ae80-3893725fd419 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] [instance: 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55] calling os-brick to detach iSCSI Volume {{(pid=73572) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 10:24:27 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-44d45d4a-35af-49f9-ae80-3893725fd419 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc89c3d6a10>, {'target_iqns': ['iqn.2010-10.org.openstack:5f3a153b-1b99-4297-ad26-ea58f33330b8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qjvgYBLw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 10:24:27 user nova-compute[73572]: WARNING os_brick.initiator.connectors.base [None req-44d45d4a-35af-49f9-ae80-3893725fd419 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 10:24:27 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-44d45d4a-35af-49f9-ae80-3893725fd419 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 10:24:27 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-44d45d4a-35af-49f9-ae80-3893725fd419 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 10:24:27 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-44d45d4a-35af-49f9-ae80-3893725fd419 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5f3a153b-1b99-4297-ad26-ea58f33330b8', 0)] {{(pid=73572) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 10:24:27 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:24:27 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:24:27 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a22453a-adf9-49b1-928e-1ffd35a61a5c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:133098b2-106a-427f-aa6d-2c10625dd152\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:19c2d1dd-dfb9-4ac0-8341-35f96b7ade56\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5f3a153b-1b99-4297-ad26-ea58f33330b8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9dbf6103-5796-4273-a8a9-81d262560347\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:24:27 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:24:27 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:24:27 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc489d92-0c87-471b-a2ac-e0b6f2726223]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f3a153b-1b99-4297-ad26-ea58f33330b8 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19c2d1dd-dfb9-4ac0-8341-35f96b7ade56 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dbf6103-5796-4273-a8a9-81d262560347 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133098b2-106a-427f-aa6d-2c10625dd152 (non-flash)\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:24:27 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-44d45d4a-35af-49f9-ae80-3893725fd419 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)
Aug 26 10:24:27 user nova-compute[73572]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f3a153b-1b99-4297-ad26-ea58f33330b8 (non-flash)
Aug 26 10:24:27 user nova-compute[73572]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19c2d1dd-dfb9-4ac0-8341-35f96b7ade56 (non-flash)
Aug 26 10:24:27 user nova-compute[73572]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dbf6103-5796-4273-a8a9-81d262560347 (non-flash)
Aug 26 10:24:27 user nova-compute[73572]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133098b2-106a-427f-aa6d-2c10625dd152 (non-flash)
Aug 26 10:24:27 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 10:24:27 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-44d45d4a-35af-49f9-ae80-3893725fd419 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)
Aug 26 10:24:27 user nova-compute[73572]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f3a153b-1b99-4297-ad26-ea58f33330b8 (non-flash)
Aug 26 10:24:27 user nova-compute[73572]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19c2d1dd-dfb9-4ac0-8341-35f96b7ade56 (non-flash)
Aug 26 10:24:27 user nova-compute[73572]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dbf6103-5796-4273-a8a9-81d262560347 (non-flash)
Aug 26 10:24:27 user nova-compute[73572]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133098b2-106a-427f-aa6d-2c10625dd152 (non-flash)
Aug 26 10:24:27 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 10:24:27 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-44d45d4a-35af-49f9-ae80-3893725fd419 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc878c25c60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5f3a153b-1b99-4297-ad26-ea58f33330b8'): ({'sdb'}, set())}) {{(pid=73572) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 10:24:27 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-44d45d4a-35af-49f9-ae80-3893725fd419 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Removing single pathed devices sdb {{(pid=73572) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 10:24:27 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:24:27 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fe47a17-4ffb-48ce-b0f6-a9b43002bd55/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:24:27 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fe47a17-4ffb-48ce-b0f6-a9b43002bd55/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:24:27 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:24:27 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[48f2c584-0b0b-4392-9548-6efcb6d9d44b]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:24:27 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:24:27 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:24:27 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[3edc46c9-ec32-4aec-968a-02ef03b910e3]: (4, ('ok\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:24:27 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-44d45d4a-35af-49f9-ae80-3893725fd419 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Flushing IO for device /dev/sdb {{(pid=73572) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 10:24:27 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:24:27 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:24:27 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d1797ca-29ae-4156-a166-ac003d152976]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:24:27 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-44d45d4a-35af-49f9-ae80-3893725fd419 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73572) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 10:24:27 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:24:27 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:24:27 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[9490a48e-c9a4-4724-a3ab-ef2127f6f893]: (4, ('1', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:24:27 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-44d45d4a-35af-49f9-ae80-3893725fd419 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73572) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 10:24:27 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-44d45d4a-35af-49f9-ae80-3893725fd419 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] SCSI volumes sdb have been removed. {{(pid=73572) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 10:24:27 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-44d45d4a-35af-49f9-ae80-3893725fd419 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5f3a153b-1b99-4297-ad26-ea58f33330b8')] {{(pid=73572) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 10:24:27 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f3a153b-1b99-4297-ad26-ea58f33330b8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:24:27 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f3a153b-1b99-4297-ad26-ea58f33330b8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:24:27 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[33312599-e9af-442a-85da-994a5c1dc17f]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:24:27 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-44d45d4a-35af-49f9-ae80-3893725fd419 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:24:27 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f3a153b-1b99-4297-ad26-ea58f33330b8 -p 172.16.0.220:3260 --logout {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:24:27 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fe47a17-4ffb-48ce-b0f6-a9b43002bd55/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:24:27 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73572) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 10:24:27 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=73572) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 10:24:27 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2eaea7c2-a5c0-4950-b033-0012b5cec0ee/disk.rescue --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:24:27 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f3a153b-1b99-4297-ad26-ea58f33330b8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:24:27 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[71fa354c-6fd1-4ff4-aced-f4b86297b420]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:5f3a153b-1b99-4297-ad26-ea58f33330b8, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:5f3a153b-1b99-4297-ad26-ea58f33330b8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:24:27 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-44d45d4a-35af-49f9-ae80-3893725fd419 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:5f3a153b-1b99-4297-ad26-ea58f33330b8, portal: 172.16.0.220,3260]
Aug 26 10:24:27 user nova-compute[73572]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:5f3a153b-1b99-4297-ad26-ea58f33330b8, portal: 172.16.0.220,3260] successful.
Aug 26 10:24:27 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:24:27 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f3a153b-1b99-4297-ad26-ea58f33330b8 -p 172.16.0.220:3260 --op delete {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:24:27 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f3a153b-1b99-4297-ad26-ea58f33330b8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:24:27 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[f33cb621-1388-4991-9c40-836ba99187bd]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:24:27 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-44d45d4a-35af-49f9-ae80-3893725fd419 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:24:27 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-44d45d4a-35af-49f9-ae80-3893725fd419 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.354s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 10:24:27 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-44d45d4a-35af-49f9-ae80-3893725fd419 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] <== disconnect_volume: return (356ms) None {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 10:24:27 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-44d45d4a-35af-49f9-ae80-3893725fd419 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] [instance: 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55] Disconnected iSCSI Volume {{(pid=73572) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 10:24:27 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-44d45d4a-35af-49f9-ae80-3893725fd419 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] [instance: 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55] Deleting instance files /opt/stack/data/nova/instances/0fe47a17-4ffb-48ce-b0f6-a9b43002bd55_del
Aug 26 10:24:27 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-44d45d4a-35af-49f9-ae80-3893725fd419 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] [instance: 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55] Deletion of /opt/stack/data/nova/instances/0fe47a17-4ffb-48ce-b0f6-a9b43002bd55_del complete
Aug 26 10:24:27 user nova-compute[73572]: INFO nova.compute.manager [None req-44d45d4a-35af-49f9-ae80-3893725fd419 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] [instance: 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55] Took 1.32 seconds to destroy the instance on the hypervisor.
Aug 26 10:24:27 user nova-compute[73572]: DEBUG oslo.service.loopingcall [None req-44d45d4a-35af-49f9-ae80-3893725fd419 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73572) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 10:24:27 user nova-compute[73572]: DEBUG nova.compute.manager [-] [instance: 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55] Deallocating network for instance {{(pid=73572) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 10:24:27 user nova-compute[73572]: DEBUG nova.network.neutron [-] [instance: 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55] deallocate_for_instance() {{(pid=73572) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 10:24:27 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2eaea7c2-a5c0-4950-b033-0012b5cec0ee/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:24:27 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2eaea7c2-a5c0-4950-b033-0012b5cec0ee/disk.rescue --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:24:27 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2eaea7c2-a5c0-4950-b033-0012b5cec0ee/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:24:27 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2eaea7c2-a5c0-4950-b033-0012b5cec0ee/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:24:28 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2eaea7c2-a5c0-4950-b033-0012b5cec0ee/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:24:28 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2eaea7c2-a5c0-4950-b033-0012b5cec0ee/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:24:28 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2eaea7c2-a5c0-4950-b033-0012b5cec0ee/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:24:28 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f3db0fa-682c-4b33-966b-9e50b7349b6e/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:24:28 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f3db0fa-682c-4b33-966b-9e50b7349b6e/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:24:28 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f3db0fa-682c-4b33-966b-9e50b7349b6e/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:24:28 user nova-compute[73572]: DEBUG nova.compute.manager [req-ea2217b0-42d6-454e-ba19-893d1144ac8c req-c4bfb99e-7865-44d8-bd58-f1bf5f1f41d3 service nova] [instance: 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55] Received event network-vif-deleted-ebf9f385-e59b-4060-9bf9-a8d2006327b4 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:24:28 user nova-compute[73572]: INFO nova.compute.manager [req-ea2217b0-42d6-454e-ba19-893d1144ac8c req-c4bfb99e-7865-44d8-bd58-f1bf5f1f41d3 service nova] [instance: 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55] Neutron deleted interface ebf9f385-e59b-4060-9bf9-a8d2006327b4; detaching it from the instance and deleting it from the info cache
Aug 26 10:24:28 user nova-compute[73572]: DEBUG nova.network.neutron [req-ea2217b0-42d6-454e-ba19-893d1144ac8c req-c4bfb99e-7865-44d8-bd58-f1bf5f1f41d3 service nova] [instance: 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55] Updating instance_info_cache with network_info: [] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:24:28 user nova-compute[73572]: DEBUG nova.network.neutron [-] [instance: 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55] Updating instance_info_cache with network_info: [] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:24:28 user nova-compute[73572]: INFO nova.compute.manager [-] [instance: 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55] Took 0.97 seconds to deallocate network for instance.
Aug 26 10:24:28 user nova-compute[73572]: DEBUG nova.compute.manager [req-ea2217b0-42d6-454e-ba19-893d1144ac8c req-c4bfb99e-7865-44d8-bd58-f1bf5f1f41d3 service nova] [instance: 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55] Detach interface failed, port_id=ebf9f385-e59b-4060-9bf9-a8d2006327b4, reason: Instance 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55 could not be found. {{(pid=73572) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 10:24:28 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f3db0fa-682c-4b33-966b-9e50b7349b6e/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:24:29 user nova-compute[73572]: DEBUG nova.compute.manager [req-a0e87a0e-58d4-4f97-b7a9-7cee1c708ea0 req-b47998e1-6634-4f3a-a87a-d6efa93aab8e service nova] [instance: 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55] Received event network-vif-plugged-ebf9f385-e59b-4060-9bf9-a8d2006327b4 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:24:29 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-a0e87a0e-58d4-4f97-b7a9-7cee1c708ea0 req-b47998e1-6634-4f3a-a87a-d6efa93aab8e service nova] Acquiring lock "0fe47a17-4ffb-48ce-b0f6-a9b43002bd55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:24:29 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-a0e87a0e-58d4-4f97-b7a9-7cee1c708ea0 req-b47998e1-6634-4f3a-a87a-d6efa93aab8e service nova] Lock "0fe47a17-4ffb-48ce-b0f6-a9b43002bd55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:24:29 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-a0e87a0e-58d4-4f97-b7a9-7cee1c708ea0 req-b47998e1-6634-4f3a-a87a-d6efa93aab8e service nova] Lock "0fe47a17-4ffb-48ce-b0f6-a9b43002bd55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:24:29 user nova-compute[73572]: DEBUG nova.compute.manager [req-a0e87a0e-58d4-4f97-b7a9-7cee1c708ea0 req-b47998e1-6634-4f3a-a87a-d6efa93aab8e service nova] [instance: 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55] No waiting events found dispatching network-vif-plugged-ebf9f385-e59b-4060-9bf9-a8d2006327b4 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:24:29 user nova-compute[73572]: WARNING nova.compute.manager [req-a0e87a0e-58d4-4f97-b7a9-7cee1c708ea0 req-b47998e1-6634-4f3a-a87a-d6efa93aab8e service nova] [instance: 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55] Received unexpected event network-vif-plugged-ebf9f385-e59b-4060-9bf9-a8d2006327b4 for instance with vm_state active and task_state deleting.
Aug 26 10:24:29 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:24:29 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:24:29 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Hypervisor/Node resource view: name=user free_ram=7260MB free_disk=25.087570190429688GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=73572) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 10:24:29 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:24:29 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:24:29 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance c785b609-0068-442f-91f5-d26e888a993f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:24:29 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance 14fab12e-52be-4fe6-8777-bc7ebf3c25f1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:24:29 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance 00c47a06-2bf8-427d-bcb1-304688584511 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:24:29 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance 2eaea7c2-a5c0-4950-b033-0012b5cec0ee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:24:29 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance 86923c1a-89a5-4e7a-b488-8bf3a013bf83 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:24:29 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:24:29 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance 44a737bf-3704-4193-8d24-b8d132267279 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:24:29 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance e468b473-515f-41ad-a75c-65d4c6d575c8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:24:29 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance 68613b1e-c45c-4fd9-834c-3630ed0f456a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:24:29 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance 1f3db0fa-682c-4b33-966b-9e50b7349b6e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:24:29 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance 0f46f84e-9cda-4450-a8a1-f6c08956324b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:24:29 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance 8a8816e5-696d-4384-b0e0-29aa7cdd957c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:24:29 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=73572) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 10:24:29 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=73572) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 10:24:29 user nova-compute[73572]: INFO nova.compute.manager [None req-44d45d4a-35af-49f9-ae80-3893725fd419 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] [instance: 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55] Took 0.93 seconds to detach 1 volumes for instance.
Aug 26 10:24:29 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-44d45d4a-35af-49f9-ae80-3893725fd419 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:24:29 user nova-compute[73572]: DEBUG nova.compute.provider_tree [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Inventory has not changed in ProviderTree for provider: e2cec974-59b2-4c77-a53d-a7f4e5a30d75 {{(pid=73572) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 10:24:29 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Inventory has not changed for provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73572) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 10:24:29 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Compute_service record updated for user:user {{(pid=73572) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 10:24:29 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.538s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:24:29 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-44d45d4a-35af-49f9-ae80-3893725fd419 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.119s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:24:30 user nova-compute[73572]: DEBUG nova.compute.provider_tree [None req-44d45d4a-35af-49f9-ae80-3893725fd419 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Inventory has not changed in ProviderTree for provider: e2cec974-59b2-4c77-a53d-a7f4e5a30d75 {{(pid=73572) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 10:24:30 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-44d45d4a-35af-49f9-ae80-3893725fd419 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Inventory has not changed for provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73572) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 10:24:30 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:24:30 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-44d45d4a-35af-49f9-ae80-3893725fd419 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.358s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:24:30 user nova-compute[73572]: INFO nova.scheduler.client.report [None req-44d45d4a-35af-49f9-ae80-3893725fd419 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Deleted allocations for instance 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55
Aug 26 10:24:30 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-44d45d4a-35af-49f9-ae80-3893725fd419 tempest-ServerActionsTestOtherB-1806914349 tempest-ServerActionsTestOtherB-1806914349-project-member] Lock "0fe47a17-4ffb-48ce-b0f6-a9b43002bd55" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.912s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:24:31 user nova-compute[73572]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693045456.167086, 1bc7408c-28d0-4735-95ef-3a03dc7a86ba => Stopped> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:24:31 user nova-compute[73572]: INFO nova.compute.manager [-] [instance: 1bc7408c-28d0-4735-95ef-3a03dc7a86ba] VM Stopped (Lifecycle Event)
Aug 26 10:24:31 user nova-compute[73572]: DEBUG nova.compute.manager [None req-ec9c77f8-c6eb-4a2a-b456-04151b2d970e None None] [instance: 1bc7408c-28d0-4735-95ef-3a03dc7a86ba] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:24:32 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:24:35 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:24:35 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-749db883-fca4-4e97-b0b0-6a105bbd1af9 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Acquiring lock "6422ce7d-9348-48b2-9af0-ec322d482d2b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:24:35 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-749db883-fca4-4e97-b0b0-6a105bbd1af9 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Lock "6422ce7d-9348-48b2-9af0-ec322d482d2b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:24:35 user nova-compute[73572]: DEBUG nova.compute.manager [None req-749db883-fca4-4e97-b0b0-6a105bbd1af9 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] [instance: 6422ce7d-9348-48b2-9af0-ec322d482d2b] Starting instance... {{(pid=73572) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 10:24:35 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-749db883-fca4-4e97-b0b0-6a105bbd1af9 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:24:35 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-749db883-fca4-4e97-b0b0-6a105bbd1af9 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:24:35 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-749db883-fca4-4e97-b0b0-6a105bbd1af9 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73572) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 10:24:35 user nova-compute[73572]: INFO nova.compute.claims [None req-749db883-fca4-4e97-b0b0-6a105bbd1af9 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] [instance: 6422ce7d-9348-48b2-9af0-ec322d482d2b] Claim successful on node user
Aug 26 10:24:36 user nova-compute[73572]: DEBUG nova.compute.provider_tree [None req-749db883-fca4-4e97-b0b0-6a105bbd1af9 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Inventory has not changed in ProviderTree for provider: e2cec974-59b2-4c77-a53d-a7f4e5a30d75 {{(pid=73572) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 10:24:36 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-749db883-fca4-4e97-b0b0-6a105bbd1af9 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Inventory has not changed for provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73572) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 10:24:36 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-749db883-fca4-4e97-b0b0-6a105bbd1af9 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.625s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:24:36 user nova-compute[73572]: DEBUG nova.compute.manager [None req-749db883-fca4-4e97-b0b0-6a105bbd1af9 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] [instance: 6422ce7d-9348-48b2-9af0-ec322d482d2b] Start building networks asynchronously for instance. {{(pid=73572) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 10:24:36 user nova-compute[73572]: DEBUG nova.compute.manager [None req-749db883-fca4-4e97-b0b0-6a105bbd1af9 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] [instance: 6422ce7d-9348-48b2-9af0-ec322d482d2b] Allocating IP information in the background. {{(pid=73572) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 10:24:36 user nova-compute[73572]: DEBUG nova.network.neutron [None req-749db883-fca4-4e97-b0b0-6a105bbd1af9 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] [instance: 6422ce7d-9348-48b2-9af0-ec322d482d2b] allocate_for_instance() {{(pid=73572) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 10:24:36 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-749db883-fca4-4e97-b0b0-6a105bbd1af9 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] [instance: 6422ce7d-9348-48b2-9af0-ec322d482d2b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 10:24:36 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9e44fc8c-b40a-4337-b9e1-ab79faa9705c tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Acquiring lock "1f3db0fa-682c-4b33-966b-9e50b7349b6e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:24:36 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9e44fc8c-b40a-4337-b9e1-ab79faa9705c tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Lock "1f3db0fa-682c-4b33-966b-9e50b7349b6e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:24:36 user nova-compute[73572]: DEBUG nova.compute.manager [None req-749db883-fca4-4e97-b0b0-6a105bbd1af9 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] [instance: 6422ce7d-9348-48b2-9af0-ec322d482d2b] Start building block device mappings for instance. {{(pid=73572) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 10:24:36 user nova-compute[73572]: DEBUG nova.objects.instance [None req-9e44fc8c-b40a-4337-b9e1-ab79faa9705c tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Lazy-loading 'flavor' on Instance uuid 1f3db0fa-682c-4b33-966b-9e50b7349b6e {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:24:36 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9e44fc8c-b40a-4337-b9e1-ab79faa9705c tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Lock "1f3db0fa-682c-4b33-966b-9e50b7349b6e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:24:36 user nova-compute[73572]: DEBUG nova.policy [None req-749db883-fca4-4e97-b0b0-6a105bbd1af9 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '60fb7b6cd1d14b2ea2e4ab806642e230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e33d9ef6ec45709135edc20c8d7720', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73572) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 10:24:36 user nova-compute[73572]: DEBUG nova.compute.manager [None req-749db883-fca4-4e97-b0b0-6a105bbd1af9 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] [instance: 6422ce7d-9348-48b2-9af0-ec322d482d2b] Start spawning the instance on the hypervisor. {{(pid=73572) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 10:24:36 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-749db883-fca4-4e97-b0b0-6a105bbd1af9 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] [instance: 6422ce7d-9348-48b2-9af0-ec322d482d2b] Creating instance directory {{(pid=73572) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 10:24:36 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-749db883-fca4-4e97-b0b0-6a105bbd1af9 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] [instance: 6422ce7d-9348-48b2-9af0-ec322d482d2b] Creating image(s)
Aug 26 10:24:36 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-749db883-fca4-4e97-b0b0-6a105bbd1af9 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Acquiring lock "/opt/stack/data/nova/instances/6422ce7d-9348-48b2-9af0-ec322d482d2b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:24:36 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-749db883-fca4-4e97-b0b0-6a105bbd1af9 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Lock "/opt/stack/data/nova/instances/6422ce7d-9348-48b2-9af0-ec322d482d2b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:24:36 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-749db883-fca4-4e97-b0b0-6a105bbd1af9 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Lock "/opt/stack/data/nova/instances/6422ce7d-9348-48b2-9af0-ec322d482d2b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:24:36 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-749db883-fca4-4e97-b0b0-6a105bbd1af9 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:24:36 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9e44fc8c-b40a-4337-b9e1-ab79faa9705c tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Acquiring lock "1f3db0fa-682c-4b33-966b-9e50b7349b6e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:24:36 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9e44fc8c-b40a-4337-b9e1-ab79faa9705c tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Lock "1f3db0fa-682c-4b33-966b-9e50b7349b6e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:24:36 user nova-compute[73572]: INFO nova.compute.manager [None req-9e44fc8c-b40a-4337-b9e1-ab79faa9705c tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] [instance: 1f3db0fa-682c-4b33-966b-9e50b7349b6e] Attaching volume dc0a3246-82a0-4d2f-9877-8a072dccf064 to /dev/vdb
Aug 26 10:24:36 user nova-compute[73572]: DEBUG os_brick.utils [None req-9e44fc8c-b40a-4337-b9e1-ab79faa9705c tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 10:24:36 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:24:36 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:24:36 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[f800964e-f1ae-4011-9f28-da87950cbca8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:de8a79ed912\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:24:36 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:24:36 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:24:36 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[e32c784e-a1ec-409a-bcba-467dc539da39]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:24:36 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:24:36 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:24:36 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[b803e2f2-d3e3-4906-b183-7a1455a7db98]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:24:36 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[c93a7a50-6100-4d7a-8b26-4e41fdfe36c9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:24:36 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9e44fc8c-b40a-4337-b9e1-ab79faa9705c tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Running cmd (subprocess): nvme version {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:24:36 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9e44fc8c-b40a-4337-b9e1-ab79faa9705c tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] 'nvme version' failed. Not Retrying. {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 10:24:36 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9e44fc8c-b40a-4337-b9e1-ab79faa9705c tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] nvme not present on system {{(pid=73572) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 10:24:36 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-749db883-fca4-4e97-b0b0-6a105bbd1af9 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json" returned: 0 in 0.238s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:24:36 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-749db883-fca4-4e97-b0b0-6a105bbd1af9 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Acquiring lock "2099350d6f3bcd0de9471c73862d4fe75b049801" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:24:36 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-749db883-fca4-4e97-b0b0-6a105bbd1af9 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Lock "2099350d6f3bcd0de9471c73862d4fe75b049801" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:24:36 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-749db883-fca4-4e97-b0b0-6a105bbd1af9 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:24:36 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:24:36 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 10:24:36 user nova-compute[73572]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 10:24:36 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[3555225a-1c74-427f-952a-78113247b67e]: (4, '') {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:24:36 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.lightos [None req-9e44fc8c-b40a-4337-b9e1-ab79faa9705c tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73572) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 10:24:36 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.lightos [None req-9e44fc8c-b40a-4337-b9e1-ab79faa9705c tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73572) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 10:24:36 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.lightos [None req-9e44fc8c-b40a-4337-b9e1-ab79faa9705c tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] LIGHTOS: no hostnqn found. {{(pid=73572) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 10:24:36 user nova-compute[73572]: DEBUG os_brick.utils [None req-9e44fc8c-b40a-4337-b9e1-ab79faa9705c tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] <== get_connector_properties: return (149ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:de8a79ed912', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 10:24:36 user nova-compute[73572]: DEBUG nova.virt.block_device [None req-9e44fc8c-b40a-4337-b9e1-ab79faa9705c tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] [instance: 1f3db0fa-682c-4b33-966b-9e50b7349b6e] Updating existing volume attachment record: 7f53e593-ebee-4fa1-a4f2-7b8e3083dd0f {{(pid=73572) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 10:24:36 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-749db883-fca4-4e97-b0b0-6a105bbd1af9 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json" returned: 0 in 0.172s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:24:36 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-749db883-fca4-4e97-b0b0-6a105bbd1af9 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801,backing_fmt=raw /opt/stack/data/nova/instances/6422ce7d-9348-48b2-9af0-ec322d482d2b/disk 1073741824 {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:24:36 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-749db883-fca4-4e97-b0b0-6a105bbd1af9 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801,backing_fmt=raw /opt/stack/data/nova/instances/6422ce7d-9348-48b2-9af0-ec322d482d2b/disk 1073741824" returned: 0 in 0.056s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:24:36 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-749db883-fca4-4e97-b0b0-6a105bbd1af9 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Lock "2099350d6f3bcd0de9471c73862d4fe75b049801" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.234s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:24:36 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-749db883-fca4-4e97-b0b0-6a105bbd1af9 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:24:37 user nova-compute[73572]: DEBUG nova.network.neutron [None req-749db883-fca4-4e97-b0b0-6a105bbd1af9 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] [instance: 6422ce7d-9348-48b2-9af0-ec322d482d2b] Successfully created port: f995916a-1a71-47ac-9abd-2a24136e4981 {{(pid=73572) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 10:24:37 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-749db883-fca4-4e97-b0b0-6a105bbd1af9 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json" returned: 0 in 0.185s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:24:37 user nova-compute[73572]: DEBUG nova.virt.disk.api [None req-749db883-fca4-4e97-b0b0-6a105bbd1af9 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6422ce7d-9348-48b2-9af0-ec322d482d2b/disk. size=1073741824 {{(pid=73572) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 10:24:37 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-749db883-fca4-4e97-b0b0-6a105bbd1af9 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6422ce7d-9348-48b2-9af0-ec322d482d2b/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:24:37 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:24:37 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-749db883-fca4-4e97-b0b0-6a105bbd1af9 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6422ce7d-9348-48b2-9af0-ec322d482d2b/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:24:37 user nova-compute[73572]: DEBUG nova.virt.disk.api [None req-749db883-fca4-4e97-b0b0-6a105bbd1af9 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Cannot resize image /opt/stack/data/nova/instances/6422ce7d-9348-48b2-9af0-ec322d482d2b/disk to a smaller size. {{(pid=73572) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 10:24:37 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-749db883-fca4-4e97-b0b0-6a105bbd1af9 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] [instance: 6422ce7d-9348-48b2-9af0-ec322d482d2b] Created local disks {{(pid=73572) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 10:24:37 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-749db883-fca4-4e97-b0b0-6a105bbd1af9 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] [instance: 6422ce7d-9348-48b2-9af0-ec322d482d2b] Ensure instance console log exists: /opt/stack/data/nova/instances/6422ce7d-9348-48b2-9af0-ec322d482d2b/console.log {{(pid=73572) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 10:24:37 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-749db883-fca4-4e97-b0b0-6a105bbd1af9 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:24:37 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-749db883-fca4-4e97-b0b0-6a105bbd1af9 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:24:37 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-749db883-fca4-4e97-b0b0-6a105bbd1af9 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:24:38 user nova-compute[73572]: DEBUG nova.network.neutron [None req-749db883-fca4-4e97-b0b0-6a105bbd1af9 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] [instance: 6422ce7d-9348-48b2-9af0-ec322d482d2b] Successfully updated port: f995916a-1a71-47ac-9abd-2a24136e4981 {{(pid=73572) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 10:24:38 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-749db883-fca4-4e97-b0b0-6a105bbd1af9 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Acquiring lock "refresh_cache-6422ce7d-9348-48b2-9af0-ec322d482d2b" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:24:38 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-749db883-fca4-4e97-b0b0-6a105bbd1af9 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Acquired lock "refresh_cache-6422ce7d-9348-48b2-9af0-ec322d482d2b" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:24:38 user nova-compute[73572]: DEBUG nova.network.neutron [None req-749db883-fca4-4e97-b0b0-6a105bbd1af9 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] [instance: 6422ce7d-9348-48b2-9af0-ec322d482d2b] Building network info cache for instance {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 10:24:38 user nova-compute[73572]: DEBUG nova.compute.manager [req-5551e6fe-6285-4e25-a84a-a88b60076e27 req-ac0355d5-6607-432c-b78a-1c3434b6e046 service nova] [instance: 6422ce7d-9348-48b2-9af0-ec322d482d2b] Received event network-changed-f995916a-1a71-47ac-9abd-2a24136e4981 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:24:38 user nova-compute[73572]: DEBUG nova.compute.manager [req-5551e6fe-6285-4e25-a84a-a88b60076e27 req-ac0355d5-6607-432c-b78a-1c3434b6e046 service nova] [instance: 6422ce7d-9348-48b2-9af0-ec322d482d2b] Refreshing instance network info cache due to event network-changed-f995916a-1a71-47ac-9abd-2a24136e4981. {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 10:24:38 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-5551e6fe-6285-4e25-a84a-a88b60076e27 req-ac0355d5-6607-432c-b78a-1c3434b6e046 service nova] Acquiring lock "refresh_cache-6422ce7d-9348-48b2-9af0-ec322d482d2b" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:24:38 user nova-compute[73572]: DEBUG nova.network.neutron [None req-749db883-fca4-4e97-b0b0-6a105bbd1af9 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] [instance: 6422ce7d-9348-48b2-9af0-ec322d482d2b] Instance cache missing network info. {{(pid=73572) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 10:24:38 user nova-compute[73572]: DEBUG nova.network.neutron [None req-749db883-fca4-4e97-b0b0-6a105bbd1af9 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] [instance: 6422ce7d-9348-48b2-9af0-ec322d482d2b] Updating instance_info_cache with network_info: [{"id": "f995916a-1a71-47ac-9abd-2a24136e4981", "address": "fa:16:3e:02:84:35", "network": {"id": "146a7a16-6dfd-48bd-8c96-766bdbe89bed", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-631761752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84e33d9ef6ec45709135edc20c8d7720", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf995916a-1a", "ovs_interfaceid": "f995916a-1a71-47ac-9abd-2a24136e4981", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:24:38 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-749db883-fca4-4e97-b0b0-6a105bbd1af9 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Releasing lock "refresh_cache-6422ce7d-9348-48b2-9af0-ec322d482d2b" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:24:38 user nova-compute[73572]: DEBUG nova.compute.manager [None req-749db883-fca4-4e97-b0b0-6a105bbd1af9 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] [instance: 6422ce7d-9348-48b2-9af0-ec322d482d2b] Instance network_info: |[{"id": "f995916a-1a71-47ac-9abd-2a24136e4981", "address": "fa:16:3e:02:84:35", "network": {"id": "146a7a16-6dfd-48bd-8c96-766bdbe89bed", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-631761752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84e33d9ef6ec45709135edc20c8d7720", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf995916a-1a", "ovs_interfaceid": "f995916a-1a71-47ac-9abd-2a24136e4981", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73572) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 10:24:38 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-5551e6fe-6285-4e25-a84a-a88b60076e27 req-ac0355d5-6607-432c-b78a-1c3434b6e046 service nova] Acquired lock "refresh_cache-6422ce7d-9348-48b2-9af0-ec322d482d2b" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:24:38 user nova-compute[73572]: DEBUG nova.network.neutron [req-5551e6fe-6285-4e25-a84a-a88b60076e27 req-ac0355d5-6607-432c-b78a-1c3434b6e046 service nova] [instance: 6422ce7d-9348-48b2-9af0-ec322d482d2b] Refreshing network info cache for port f995916a-1a71-47ac-9abd-2a24136e4981 {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 10:24:38 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-749db883-fca4-4e97-b0b0-6a105bbd1af9 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] [instance: 6422ce7d-9348-48b2-9af0-ec322d482d2b] Start _get_guest_xml network_info=[{"id": "f995916a-1a71-47ac-9abd-2a24136e4981", "address": "fa:16:3e:02:84:35", "network": {"id": "146a7a16-6dfd-48bd-8c96-766bdbe89bed", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-631761752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84e33d9ef6ec45709135edc20c8d7720", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf995916a-1a", "ovs_interfaceid": "f995916a-1a71-47ac-9abd-2a24136e4981", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T10:07:33Z,direct_url=<?>,disk_format='qcow2',id=299da0c9-e1c4-48f0-be55-fbe20dd06bc9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5c995f8bbbab4368b67a253e0df3971a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T10:07:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'guest_format': None, 'size': 0, 'encryption_format': None, 'device_type': 'disk', 'image_id': '299da0c9-e1c4-48f0-be55-fbe20dd06bc9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73572) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 10:24:38 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-749db883-fca4-4e97-b0b0-6a105bbd1af9 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:24:38 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-749db883-fca4-4e97-b0b0-6a105bbd1af9 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:24:38 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-749db883-fca4-4e97-b0b0-6a105bbd1af9 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73572) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 10:24:38 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-749db883-fca4-4e97-b0b0-6a105bbd1af9 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] CPU controller missing on host. {{(pid=73572) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 10:24:38 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-749db883-fca4-4e97-b0b0-6a105bbd1af9 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73572) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 10:24:38 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-749db883-fca4-4e97-b0b0-6a105bbd1af9 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] CPU controller found on host. {{(pid=73572) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 10:24:38 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-749db883-fca4-4e97-b0b0-6a105bbd1af9 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73572) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 10:24:38 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-749db883-fca4-4e97-b0b0-6a105bbd1af9 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T10:07:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T10:07:33Z,direct_url=<?>,disk_format='qcow2',id=299da0c9-e1c4-48f0-be55-fbe20dd06bc9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5c995f8bbbab4368b67a253e0df3971a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T10:07:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 10:24:38 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-749db883-fca4-4e97-b0b0-6a105bbd1af9 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Flavor limits 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 10:24:38 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-749db883-fca4-4e97-b0b0-6a105bbd1af9 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Image limits 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 10:24:38 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-749db883-fca4-4e97-b0b0-6a105bbd1af9 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Flavor pref 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 10:24:38 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-749db883-fca4-4e97-b0b0-6a105bbd1af9 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Image pref 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 10:24:38 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-749db883-fca4-4e97-b0b0-6a105bbd1af9 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 10:24:38 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-749db883-fca4-4e97-b0b0-6a105bbd1af9 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 10:24:38 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-749db883-fca4-4e97-b0b0-6a105bbd1af9 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73572) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 10:24:38 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-749db883-fca4-4e97-b0b0-6a105bbd1af9 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Got 1 possible topologies {{(pid=73572) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 10:24:38 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-749db883-fca4-4e97-b0b0-6a105bbd1af9 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 10:24:38 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-749db883-fca4-4e97-b0b0-6a105bbd1af9 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 10:24:38 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-749db883-fca4-4e97-b0b0-6a105bbd1af9 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T10:24:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1778586676',display_name='tempest-VolumesSnapshotTestJSON-instance-1778586676',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1778586676',id=34,image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFOSJsvn2NQD3oaPW07BlO9jo+ExfV5p+uOiUpR8sAv7IbS2FVu0eT2WJQvbyN5SiRBauDjD3M/Q3vW8yoI96RtMHDPJS1vnpUAPiXMVARBABVZ2Elgg2rm/3z8rpfCoJQ==',key_name='tempest-keypair-268337326',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='84e33d9ef6ec45709135edc20c8d7720',ramdisk_id='',reservation_id='r-n7d5k31s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-760064238',owner_user_name='tempest-VolumesSnapshotTestJSON-760064238-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T10:24:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='60fb7b6cd1d14b2ea2e4ab806642e230',uuid=6422ce7d-9348-48b2-9af0-ec322d482d2b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f995916a-1a71-47ac-9abd-2a24136e4981", "address": "fa:16:3e:02:84:35", "network": {"id": "146a7a16-6dfd-48bd-8c96-766bdbe89bed", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-631761752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84e33d9ef6ec45709135edc20c8d7720", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf995916a-1a", "ovs_interfaceid": "f995916a-1a71-47ac-9abd-2a24136e4981", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73572) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 10:24:38 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-749db883-fca4-4e97-b0b0-6a105bbd1af9 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Converting VIF {"id": "f995916a-1a71-47ac-9abd-2a24136e4981", "address": "fa:16:3e:02:84:35", "network": {"id": "146a7a16-6dfd-48bd-8c96-766bdbe89bed", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-631761752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84e33d9ef6ec45709135edc20c8d7720", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf995916a-1a", "ovs_interfaceid": "f995916a-1a71-47ac-9abd-2a24136e4981", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:24:38 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-749db883-fca4-4e97-b0b0-6a105bbd1af9 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:02:84:35,bridge_name='br-int',has_traffic_filtering=True,id=f995916a-1a71-47ac-9abd-2a24136e4981,network=Network(146a7a16-6dfd-48bd-8c96-766bdbe89bed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf995916a-1a') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:24:38 user nova-compute[73572]: DEBUG nova.objects.instance [None req-749db883-fca4-4e97-b0b0-6a105bbd1af9 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Lazy-loading 'pci_devices' on Instance uuid 6422ce7d-9348-48b2-9af0-ec322d482d2b {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:24:38 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-749db883-fca4-4e97-b0b0-6a105bbd1af9 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] [instance: 6422ce7d-9348-48b2-9af0-ec322d482d2b] End _get_guest_xml xml=<domain type="kvm">
Aug 26 10:24:38 user nova-compute[73572]:   <uuid>6422ce7d-9348-48b2-9af0-ec322d482d2b</uuid>
Aug 26 10:24:38 user nova-compute[73572]:   <name>instance-00000022</name>
Aug 26 10:24:38 user nova-compute[73572]:   <memory>524288</memory>
Aug 26 10:24:38 user nova-compute[73572]:   <vcpu>1</vcpu>
Aug 26 10:24:38 user nova-compute[73572]:   <metadata>
Aug 26 10:24:38 user nova-compute[73572]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 10:24:38 user nova-compute[73572]:       <nova:package version="0.0.0"/>
Aug 26 10:24:38 user nova-compute[73572]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1778586676</nova:name>
Aug 26 10:24:38 user nova-compute[73572]:       <nova:creationTime>2023-08-26 10:24:38</nova:creationTime>
Aug 26 10:24:38 user nova-compute[73572]:       <nova:flavor name="m1.tiny">
Aug 26 10:24:38 user nova-compute[73572]:         <nova:memory>512</nova:memory>
Aug 26 10:24:38 user nova-compute[73572]:         <nova:disk>1</nova:disk>
Aug 26 10:24:38 user nova-compute[73572]:         <nova:swap>0</nova:swap>
Aug 26 10:24:38 user nova-compute[73572]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 10:24:38 user nova-compute[73572]:         <nova:vcpus>1</nova:vcpus>
Aug 26 10:24:38 user nova-compute[73572]:       </nova:flavor>
Aug 26 10:24:38 user nova-compute[73572]:       <nova:owner>
Aug 26 10:24:38 user nova-compute[73572]:         <nova:user uuid="60fb7b6cd1d14b2ea2e4ab806642e230">tempest-VolumesSnapshotTestJSON-760064238-project-member</nova:user>
Aug 26 10:24:38 user nova-compute[73572]:         <nova:project uuid="84e33d9ef6ec45709135edc20c8d7720">tempest-VolumesSnapshotTestJSON-760064238</nova:project>
Aug 26 10:24:38 user nova-compute[73572]:       </nova:owner>
Aug 26 10:24:38 user nova-compute[73572]:       <nova:root type="image" uuid="299da0c9-e1c4-48f0-be55-fbe20dd06bc9"/>
Aug 26 10:24:38 user nova-compute[73572]:       <nova:ports>
Aug 26 10:24:38 user nova-compute[73572]:         <nova:port uuid="f995916a-1a71-47ac-9abd-2a24136e4981">
Aug 26 10:24:38 user nova-compute[73572]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 26 10:24:38 user nova-compute[73572]:         </nova:port>
Aug 26 10:24:38 user nova-compute[73572]:       </nova:ports>
Aug 26 10:24:38 user nova-compute[73572]:     </nova:instance>
Aug 26 10:24:38 user nova-compute[73572]:   </metadata>
Aug 26 10:24:38 user nova-compute[73572]:   <sysinfo type="smbios">
Aug 26 10:24:38 user nova-compute[73572]:     <system>
Aug 26 10:24:38 user nova-compute[73572]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 10:24:38 user nova-compute[73572]:       <entry name="product">OpenStack Nova</entry>
Aug 26 10:24:38 user nova-compute[73572]:       <entry name="version">0.0.0</entry>
Aug 26 10:24:38 user nova-compute[73572]:       <entry name="serial">6422ce7d-9348-48b2-9af0-ec322d482d2b</entry>
Aug 26 10:24:38 user nova-compute[73572]:       <entry name="uuid">6422ce7d-9348-48b2-9af0-ec322d482d2b</entry>
Aug 26 10:24:38 user nova-compute[73572]:       <entry name="family">Virtual Machine</entry>
Aug 26 10:24:38 user nova-compute[73572]:     </system>
Aug 26 10:24:38 user nova-compute[73572]:   </sysinfo>
Aug 26 10:24:38 user nova-compute[73572]:   <os>
Aug 26 10:24:38 user nova-compute[73572]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 10:24:38 user nova-compute[73572]:     <boot dev="hd"/>
Aug 26 10:24:38 user nova-compute[73572]:     <smbios mode="sysinfo"/>
Aug 26 10:24:38 user nova-compute[73572]:   </os>
Aug 26 10:24:38 user nova-compute[73572]:   <features>
Aug 26 10:24:38 user nova-compute[73572]:     <acpi/>
Aug 26 10:24:38 user nova-compute[73572]:     <apic/>
Aug 26 10:24:38 user nova-compute[73572]:     <vmcoreinfo/>
Aug 26 10:24:38 user nova-compute[73572]:   </features>
Aug 26 10:24:38 user nova-compute[73572]:   <clock offset="utc">
Aug 26 10:24:38 user nova-compute[73572]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 10:24:38 user nova-compute[73572]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 10:24:38 user nova-compute[73572]:     <timer name="hpet" present="no"/>
Aug 26 10:24:38 user nova-compute[73572]:   </clock>
Aug 26 10:24:38 user nova-compute[73572]:   <cpu mode="custom" match="exact">
Aug 26 10:24:38 user nova-compute[73572]:     <model>Nehalem</model>
Aug 26 10:24:38 user nova-compute[73572]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 10:24:38 user nova-compute[73572]:   </cpu>
Aug 26 10:24:38 user nova-compute[73572]:   <devices>
Aug 26 10:24:38 user nova-compute[73572]:     <disk type="file" device="disk">
Aug 26 10:24:38 user nova-compute[73572]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 10:24:38 user nova-compute[73572]:       <source file="/opt/stack/data/nova/instances/6422ce7d-9348-48b2-9af0-ec322d482d2b/disk"/>
Aug 26 10:24:38 user nova-compute[73572]:       <target dev="vda" bus="virtio"/>
Aug 26 10:24:38 user nova-compute[73572]:     </disk>
Aug 26 10:24:38 user nova-compute[73572]:     <interface type="ethernet">
Aug 26 10:24:38 user nova-compute[73572]:       <mac address="fa:16:3e:02:84:35"/>
Aug 26 10:24:38 user nova-compute[73572]:       <model type="virtio"/>
Aug 26 10:24:38 user nova-compute[73572]:       <mtu size="1442"/>
Aug 26 10:24:38 user nova-compute[73572]:       <target dev="tapf995916a-1a"/>
Aug 26 10:24:38 user nova-compute[73572]:     </interface>
Aug 26 10:24:38 user nova-compute[73572]:     <serial type="pty">
Aug 26 10:24:38 user nova-compute[73572]:       <log file="/opt/stack/data/nova/instances/6422ce7d-9348-48b2-9af0-ec322d482d2b/console.log" append="off"/>
Aug 26 10:24:38 user nova-compute[73572]:     </serial>
Aug 26 10:24:38 user nova-compute[73572]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 10:24:38 user nova-compute[73572]:     <video>
Aug 26 10:24:38 user nova-compute[73572]:       <model type="virtio"/>
Aug 26 10:24:38 user nova-compute[73572]:     </video>
Aug 26 10:24:38 user nova-compute[73572]:     <rng model="virtio">
Aug 26 10:24:38 user nova-compute[73572]:       <backend model="random">/dev/urandom</backend>
Aug 26 10:24:38 user nova-compute[73572]:     </rng>
Aug 26 10:24:38 user nova-compute[73572]:     <controller type="usb" index="0" model="none"/>
Aug 26 10:24:38 user nova-compute[73572]:     <memballoon model="virtio">
Aug 26 10:24:38 user nova-compute[73572]:       <stats period="10"/>
Aug 26 10:24:38 user nova-compute[73572]:     </memballoon>
Aug 26 10:24:38 user nova-compute[73572]:   </devices>
Aug 26 10:24:38 user nova-compute[73572]: </domain>
Aug 26 10:24:38 user nova-compute[73572]:  {{(pid=73572) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 10:24:38 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-749db883-fca4-4e97-b0b0-6a105bbd1af9 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T10:24:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1778586676',display_name='tempest-VolumesSnapshotTestJSON-instance-1778586676',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1778586676',id=34,image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFOSJsvn2NQD3oaPW07BlO9jo+ExfV5p+uOiUpR8sAv7IbS2FVu0eT2WJQvbyN5SiRBauDjD3M/Q3vW8yoI96RtMHDPJS1vnpUAPiXMVARBABVZ2Elgg2rm/3z8rpfCoJQ==',key_name='tempest-keypair-268337326',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='84e33d9ef6ec45709135edc20c8d7720',ramdisk_id='',reservation_id='r-n7d5k31s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-760064238',owner_user_name='tempest-VolumesSnapshotTestJSON-760064238-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T10:24:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='60fb7b6cd1d14b2ea2e4ab806642e230',uuid=6422ce7d-9348-48b2-9af0-ec322d482d2b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f995916a-1a71-47ac-9abd-2a24136e4981", "address": "fa:16:3e:02:84:35", "network": {"id": "146a7a16-6dfd-48bd-8c96-766bdbe89bed", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-631761752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84e33d9ef6ec45709135edc20c8d7720", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf995916a-1a", "ovs_interfaceid": "f995916a-1a71-47ac-9abd-2a24136e4981", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 10:24:38 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-749db883-fca4-4e97-b0b0-6a105bbd1af9 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Converting VIF {"id": "f995916a-1a71-47ac-9abd-2a24136e4981", "address": "fa:16:3e:02:84:35", "network": {"id": "146a7a16-6dfd-48bd-8c96-766bdbe89bed", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-631761752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84e33d9ef6ec45709135edc20c8d7720", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf995916a-1a", "ovs_interfaceid": "f995916a-1a71-47ac-9abd-2a24136e4981", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:24:38 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-749db883-fca4-4e97-b0b0-6a105bbd1af9 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:02:84:35,bridge_name='br-int',has_traffic_filtering=True,id=f995916a-1a71-47ac-9abd-2a24136e4981,network=Network(146a7a16-6dfd-48bd-8c96-766bdbe89bed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf995916a-1a') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:24:38 user nova-compute[73572]: DEBUG os_vif [None req-749db883-fca4-4e97-b0b0-6a105bbd1af9 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:84:35,bridge_name='br-int',has_traffic_filtering=True,id=f995916a-1a71-47ac-9abd-2a24136e4981,network=Network(146a7a16-6dfd-48bd-8c96-766bdbe89bed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf995916a-1a') {{(pid=73572) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 10:24:38 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:24:38 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:24:38 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 10:24:38 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:24:38 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf995916a-1a, may_exist=True, interface_attrs={}) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:24:38 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf995916a-1a, col_values=(('external_ids', {'iface-id': 'f995916a-1a71-47ac-9abd-2a24136e4981', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:02:84:35', 'vm-uuid': '6422ce7d-9348-48b2-9af0-ec322d482d2b'}),), if_exists=True) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:24:38 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:24:38 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:24:38 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:24:38 user nova-compute[73572]: INFO os_vif [None req-749db883-fca4-4e97-b0b0-6a105bbd1af9 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:84:35,bridge_name='br-int',has_traffic_filtering=True,id=f995916a-1a71-47ac-9abd-2a24136e4981,network=Network(146a7a16-6dfd-48bd-8c96-766bdbe89bed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf995916a-1a')
Aug 26 10:24:38 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-749db883-fca4-4e97-b0b0-6a105bbd1af9 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] No BDM found with device name vda, not building metadata. {{(pid=73572) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 10:24:38 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-749db883-fca4-4e97-b0b0-6a105bbd1af9 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] No VIF found with MAC fa:16:3e:02:84:35, not building metadata {{(pid=73572) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 10:24:38 user nova-compute[73572]: DEBUG nova.network.neutron [req-5551e6fe-6285-4e25-a84a-a88b60076e27 req-ac0355d5-6607-432c-b78a-1c3434b6e046 service nova] [instance: 6422ce7d-9348-48b2-9af0-ec322d482d2b] Updated VIF entry in instance network info cache for port f995916a-1a71-47ac-9abd-2a24136e4981. {{(pid=73572) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 10:24:38 user nova-compute[73572]: DEBUG nova.network.neutron [req-5551e6fe-6285-4e25-a84a-a88b60076e27 req-ac0355d5-6607-432c-b78a-1c3434b6e046 service nova] [instance: 6422ce7d-9348-48b2-9af0-ec322d482d2b] Updating instance_info_cache with network_info: [{"id": "f995916a-1a71-47ac-9abd-2a24136e4981", "address": "fa:16:3e:02:84:35", "network": {"id": "146a7a16-6dfd-48bd-8c96-766bdbe89bed", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-631761752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84e33d9ef6ec45709135edc20c8d7720", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf995916a-1a", "ovs_interfaceid": "f995916a-1a71-47ac-9abd-2a24136e4981", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:24:38 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-5551e6fe-6285-4e25-a84a-a88b60076e27 req-ac0355d5-6607-432c-b78a-1c3434b6e046 service nova] Releasing lock "refresh_cache-6422ce7d-9348-48b2-9af0-ec322d482d2b" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:24:39 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:24:39 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:24:39 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:24:40 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:24:40 user nova-compute[73572]: DEBUG nova.compute.manager [req-105e474e-6517-4edd-8966-cc06707c0c8e req-34e62cca-c69d-4db5-bde6-0bce0f50f369 service nova] [instance: 6422ce7d-9348-48b2-9af0-ec322d482d2b] Received event network-vif-plugged-f995916a-1a71-47ac-9abd-2a24136e4981 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:24:40 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-105e474e-6517-4edd-8966-cc06707c0c8e req-34e62cca-c69d-4db5-bde6-0bce0f50f369 service nova] Acquiring lock "6422ce7d-9348-48b2-9af0-ec322d482d2b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:24:40 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-105e474e-6517-4edd-8966-cc06707c0c8e req-34e62cca-c69d-4db5-bde6-0bce0f50f369 service nova] Lock "6422ce7d-9348-48b2-9af0-ec322d482d2b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:24:40 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-105e474e-6517-4edd-8966-cc06707c0c8e req-34e62cca-c69d-4db5-bde6-0bce0f50f369 service nova] Lock "6422ce7d-9348-48b2-9af0-ec322d482d2b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:24:40 user nova-compute[73572]: DEBUG nova.compute.manager [req-105e474e-6517-4edd-8966-cc06707c0c8e req-34e62cca-c69d-4db5-bde6-0bce0f50f369 service nova] [instance: 6422ce7d-9348-48b2-9af0-ec322d482d2b] No waiting events found dispatching network-vif-plugged-f995916a-1a71-47ac-9abd-2a24136e4981 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:24:40 user nova-compute[73572]: WARNING nova.compute.manager [req-105e474e-6517-4edd-8966-cc06707c0c8e req-34e62cca-c69d-4db5-bde6-0bce0f50f369 service nova] [instance: 6422ce7d-9348-48b2-9af0-ec322d482d2b] Received unexpected event network-vif-plugged-f995916a-1a71-47ac-9abd-2a24136e4981 for instance with vm_state building and task_state spawning.
Aug 26 10:24:40 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:24:40 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:24:40 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:24:42 user nova-compute[73572]: DEBUG nova.virt.driver [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Emitting event <LifecycleEvent: 1693045482.0342026, 6422ce7d-9348-48b2-9af0-ec322d482d2b => Resumed> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:24:42 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 6422ce7d-9348-48b2-9af0-ec322d482d2b] VM Resumed (Lifecycle Event)
Aug 26 10:24:42 user nova-compute[73572]: DEBUG nova.compute.manager [None req-749db883-fca4-4e97-b0b0-6a105bbd1af9 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] [instance: 6422ce7d-9348-48b2-9af0-ec322d482d2b] Instance event wait completed in 0 seconds for  {{(pid=73572) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 10:24:42 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-749db883-fca4-4e97-b0b0-6a105bbd1af9 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] [instance: 6422ce7d-9348-48b2-9af0-ec322d482d2b] Guest created on hypervisor {{(pid=73572) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 10:24:42 user nova-compute[73572]: INFO nova.virt.libvirt.driver [-] [instance: 6422ce7d-9348-48b2-9af0-ec322d482d2b] Instance spawned successfully.
Aug 26 10:24:42 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-749db883-fca4-4e97-b0b0-6a105bbd1af9 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] [instance: 6422ce7d-9348-48b2-9af0-ec322d482d2b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 10:24:42 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 6422ce7d-9348-48b2-9af0-ec322d482d2b] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:24:42 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 6422ce7d-9348-48b2-9af0-ec322d482d2b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73572) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 10:24:42 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-749db883-fca4-4e97-b0b0-6a105bbd1af9 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] [instance: 6422ce7d-9348-48b2-9af0-ec322d482d2b] Found default for hw_cdrom_bus of ide {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:24:42 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-749db883-fca4-4e97-b0b0-6a105bbd1af9 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] [instance: 6422ce7d-9348-48b2-9af0-ec322d482d2b] Found default for hw_disk_bus of virtio {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:24:42 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-749db883-fca4-4e97-b0b0-6a105bbd1af9 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] [instance: 6422ce7d-9348-48b2-9af0-ec322d482d2b] Found default for hw_input_bus of None {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:24:42 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-749db883-fca4-4e97-b0b0-6a105bbd1af9 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] [instance: 6422ce7d-9348-48b2-9af0-ec322d482d2b] Found default for hw_pointer_model of None {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:24:42 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-749db883-fca4-4e97-b0b0-6a105bbd1af9 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] [instance: 6422ce7d-9348-48b2-9af0-ec322d482d2b] Found default for hw_video_model of virtio {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:24:42 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-749db883-fca4-4e97-b0b0-6a105bbd1af9 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] [instance: 6422ce7d-9348-48b2-9af0-ec322d482d2b] Found default for hw_vif_model of virtio {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:24:42 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 6422ce7d-9348-48b2-9af0-ec322d482d2b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 10:24:42 user nova-compute[73572]: DEBUG nova.virt.driver [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Emitting event <LifecycleEvent: 1693045482.0354407, 6422ce7d-9348-48b2-9af0-ec322d482d2b => Started> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:24:42 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 6422ce7d-9348-48b2-9af0-ec322d482d2b] VM Started (Lifecycle Event)
Aug 26 10:24:42 user nova-compute[73572]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693045467.0966449, 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55 => Stopped> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:24:42 user nova-compute[73572]: INFO nova.compute.manager [-] [instance: 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55] VM Stopped (Lifecycle Event)
Aug 26 10:24:42 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 6422ce7d-9348-48b2-9af0-ec322d482d2b] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:24:42 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 6422ce7d-9348-48b2-9af0-ec322d482d2b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73572) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 10:24:42 user nova-compute[73572]: DEBUG nova.compute.manager [None req-4b0c224a-6287-41e1-a660-c59eb56281f3 None None] [instance: 0fe47a17-4ffb-48ce-b0f6-a9b43002bd55] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:24:42 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 6422ce7d-9348-48b2-9af0-ec322d482d2b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 10:24:42 user nova-compute[73572]: INFO nova.compute.manager [None req-749db883-fca4-4e97-b0b0-6a105bbd1af9 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] [instance: 6422ce7d-9348-48b2-9af0-ec322d482d2b] Took 5.80 seconds to spawn the instance on the hypervisor.
Aug 26 10:24:42 user nova-compute[73572]: DEBUG nova.compute.manager [None req-749db883-fca4-4e97-b0b0-6a105bbd1af9 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] [instance: 6422ce7d-9348-48b2-9af0-ec322d482d2b] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:24:42 user nova-compute[73572]: DEBUG nova.compute.manager [req-f9b0a51d-cebe-41e6-aa35-61c334fc2557 req-add586e1-e5c6-422f-99d3-a8dadea7e96f service nova] [instance: 6422ce7d-9348-48b2-9af0-ec322d482d2b] Received event network-vif-plugged-f995916a-1a71-47ac-9abd-2a24136e4981 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:24:42 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-f9b0a51d-cebe-41e6-aa35-61c334fc2557 req-add586e1-e5c6-422f-99d3-a8dadea7e96f service nova] Acquiring lock "6422ce7d-9348-48b2-9af0-ec322d482d2b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:24:42 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-f9b0a51d-cebe-41e6-aa35-61c334fc2557 req-add586e1-e5c6-422f-99d3-a8dadea7e96f service nova] Lock "6422ce7d-9348-48b2-9af0-ec322d482d2b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:24:42 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-f9b0a51d-cebe-41e6-aa35-61c334fc2557 req-add586e1-e5c6-422f-99d3-a8dadea7e96f service nova] Lock "6422ce7d-9348-48b2-9af0-ec322d482d2b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:24:42 user nova-compute[73572]: DEBUG nova.compute.manager [req-f9b0a51d-cebe-41e6-aa35-61c334fc2557 req-add586e1-e5c6-422f-99d3-a8dadea7e96f service nova] [instance: 6422ce7d-9348-48b2-9af0-ec322d482d2b] No waiting events found dispatching network-vif-plugged-f995916a-1a71-47ac-9abd-2a24136e4981 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:24:42 user nova-compute[73572]: WARNING nova.compute.manager [req-f9b0a51d-cebe-41e6-aa35-61c334fc2557 req-add586e1-e5c6-422f-99d3-a8dadea7e96f service nova] [instance: 6422ce7d-9348-48b2-9af0-ec322d482d2b] Received unexpected event network-vif-plugged-f995916a-1a71-47ac-9abd-2a24136e4981 for instance with vm_state building and task_state spawning.
Aug 26 10:24:42 user nova-compute[73572]: INFO nova.compute.manager [None req-749db883-fca4-4e97-b0b0-6a105bbd1af9 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] [instance: 6422ce7d-9348-48b2-9af0-ec322d482d2b] Took 6.73 seconds to build instance.
Aug 26 10:24:42 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-749db883-fca4-4e97-b0b0-6a105bbd1af9 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Lock "6422ce7d-9348-48b2-9af0-ec322d482d2b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.824s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:24:43 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:24:45 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:24:48 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9e44fc8c-b40a-4337-b9e1-ab79faa9705c tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] [instance: 1f3db0fa-682c-4b33-966b-9e50b7349b6e] Calling os-brick to attach iSCSI Volume {{(pid=73572) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 10:24:48 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e44fc8c-b40a-4337-b9e1-ab79faa9705c tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc89c3d6a10>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:dc0a3246-82a0-4d2f-9877-8a072dccf064'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zoNTGrvh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 10:24:48 user nova-compute[73572]: WARNING os_brick.initiator.connectors.base [None req-9e44fc8c-b40a-4337-b9e1-ab79faa9705c tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 10:24:48 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-9e44fc8c-b40a-4337-b9e1-ab79faa9705c tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 10:24:48 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-9e44fc8c-b40a-4337-b9e1-ab79faa9705c tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 10:24:48 user nova-compute[73572]: WARNING os_brick.initiator.connectors.base [None req-9e44fc8c-b40a-4337-b9e1-ab79faa9705c tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 10:24:48 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-9e44fc8c-b40a-4337-b9e1-ab79faa9705c tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dc0a3246-82a0-4d2f-9877-8a072dccf064" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 10:24:48 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-9e44fc8c-b40a-4337-b9e1-ab79faa9705c tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dc0a3246-82a0-4d2f-9877-8a072dccf064" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 10:24:48 user nova-compute[73572]: INFO os_brick.initiator.connectors.iscsi [None req-9e44fc8c-b40a-4337-b9e1-ab79faa9705c tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 10:24:48 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc0a3246-82a0-4d2f-9877-8a072dccf064 -p 172.16.0.220:3260 {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:24:48 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc0a3246-82a0-4d2f-9877-8a072dccf064 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:24:48 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ac69cb9-7a23-4404-a9fc-7fdbdbbc5f21]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:24:48 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e44fc8c-b40a-4337-b9e1-ab79faa9705c tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 10:24:48 user nova-compute[73572]:  {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:24:48 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc0a3246-82a0-4d2f-9877-8a072dccf064 -p 172.16.0.220:3260 --interface default --op new {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:24:48 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc0a3246-82a0-4d2f-9877-8a072dccf064 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:24:48 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[2df69ea5-c219-415c-9ed1-e741cf3438ca]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dc0a3246-82a0-4d2f-9877-8a072dccf064] added\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:24:48 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e44fc8c-b40a-4337-b9e1-ab79faa9705c tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dc0a3246-82a0-4d2f-9877-8a072dccf064] added
Aug 26 10:24:48 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:24:48 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc0a3246-82a0-4d2f-9877-8a072dccf064 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:24:48 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc0a3246-82a0-4d2f-9877-8a072dccf064 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:24:48 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[99c345fa-74a2-4c54-9a35-9ee59421e3be]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:24:48 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e44fc8c-b40a-4337-b9e1-ab79faa9705c tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:24:48 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc0a3246-82a0-4d2f-9877-8a072dccf064 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:24:48 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc0a3246-82a0-4d2f-9877-8a072dccf064 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:24:48 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[7836e5d7-4a21-463c-98d2-607680e44391]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:24:48 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e44fc8c-b40a-4337-b9e1-ab79faa9705c tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:24:48 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc0a3246-82a0-4d2f-9877-8a072dccf064 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zoNTGrvh {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:24:48 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc0a3246-82a0-4d2f-9877-8a072dccf064 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zoNTGrvh" returned: 0 in 0.020s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:24:48 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[3700030e-c5d0-4c81-ab0e-e02b28f68bc6]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:24:48 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e44fc8c-b40a-4337-b9e1-ab79faa9705c tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zoNTGrvh'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:24:48 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc0a3246-82a0-4d2f-9877-8a072dccf064 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:24:48 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:24:48 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc0a3246-82a0-4d2f-9877-8a072dccf064 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:24:48 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe3d8fbd-67cc-4858-abe9-4ac308f557df]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:24:48 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e44fc8c-b40a-4337-b9e1-ab79faa9705c tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:24:48 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:24:48 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:24:48 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[d832f3ea-f0ae-45c0-951f-ea4915c4e3a2]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19c2d1dd-dfb9-4ac0-8341-35f96b7ade56 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dbf6103-5796-4273-a8a9-81d262560347 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133098b2-106a-427f-aa6d-2c10625dd152 (non-flash)\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:24:48 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e44fc8c-b40a-4337-b9e1-ab79faa9705c tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)
Aug 26 10:24:48 user nova-compute[73572]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19c2d1dd-dfb9-4ac0-8341-35f96b7ade56 (non-flash)
Aug 26 10:24:48 user nova-compute[73572]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dbf6103-5796-4273-a8a9-81d262560347 (non-flash)
Aug 26 10:24:48 user nova-compute[73572]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133098b2-106a-427f-aa6d-2c10625dd152 (non-flash)
Aug 26 10:24:48 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 10:24:48 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e44fc8c-b40a-4337-b9e1-ab79faa9705c tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)
Aug 26 10:24:48 user nova-compute[73572]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19c2d1dd-dfb9-4ac0-8341-35f96b7ade56 (non-flash)
Aug 26 10:24:48 user nova-compute[73572]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dbf6103-5796-4273-a8a9-81d262560347 (non-flash)
Aug 26 10:24:48 user nova-compute[73572]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133098b2-106a-427f-aa6d-2c10625dd152 (non-flash)
Aug 26 10:24:48 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 10:24:48 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc0a3246-82a0-4d2f-9877-8a072dccf064 -p 172.16.0.220:3260 --login {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:24:48 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc0a3246-82a0-4d2f-9877-8a072dccf064 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:24:48 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b1d0f97-32c4-4663-a59d-060d8b1c5f9e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:dc0a3246-82a0-4d2f-9877-8a072dccf064, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:dc0a3246-82a0-4d2f-9877-8a072dccf064, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:24:48 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e44fc8c-b40a-4337-b9e1-ab79faa9705c tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:dc0a3246-82a0-4d2f-9877-8a072dccf064, portal: 172.16.0.220,3260]
Aug 26 10:24:48 user nova-compute[73572]: Login to [iface: default, target: iqn.2010-10.org.openstack:dc0a3246-82a0-4d2f-9877-8a072dccf064, portal: 172.16.0.220,3260] successful.
Aug 26 10:24:48 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:24:48 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc0a3246-82a0-4d2f-9877-8a072dccf064 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:24:48 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc0a3246-82a0-4d2f-9877-8a072dccf064 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:24:48 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[54fa02c8-a47d-4076-b101-3abb3f4e556d]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:24:48 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e44fc8c-b40a-4337-b9e1-ab79faa9705c tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:24:48 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:24:48 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:24:48 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea639968-7e20-4c36-b493-7f18d5e43fe7]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19c2d1dd-dfb9-4ac0-8341-35f96b7ade56 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dbf6103-5796-4273-a8a9-81d262560347 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133098b2-106a-427f-aa6d-2c10625dd152 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc0a3246-82a0-4d2f-9877-8a072dccf064 (non-flash)\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:24:48 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e44fc8c-b40a-4337-b9e1-ab79faa9705c tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)
Aug 26 10:24:48 user nova-compute[73572]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19c2d1dd-dfb9-4ac0-8341-35f96b7ade56 (non-flash)
Aug 26 10:24:48 user nova-compute[73572]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dbf6103-5796-4273-a8a9-81d262560347 (non-flash)
Aug 26 10:24:48 user nova-compute[73572]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133098b2-106a-427f-aa6d-2c10625dd152 (non-flash)
Aug 26 10:24:48 user nova-compute[73572]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc0a3246-82a0-4d2f-9877-8a072dccf064 (non-flash)
Aug 26 10:24:48 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 10:24:48 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e44fc8c-b40a-4337-b9e1-ab79faa9705c tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)
Aug 26 10:24:48 user nova-compute[73572]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19c2d1dd-dfb9-4ac0-8341-35f96b7ade56 (non-flash)
Aug 26 10:24:48 user nova-compute[73572]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dbf6103-5796-4273-a8a9-81d262560347 (non-flash)
Aug 26 10:24:48 user nova-compute[73572]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133098b2-106a-427f-aa6d-2c10625dd152 (non-flash)
Aug 26 10:24:48 user nova-compute[73572]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc0a3246-82a0-4d2f-9877-8a072dccf064 (non-flash)
Aug 26 10:24:48 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 10:24:48 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-9e44fc8c-b40a-4337-b9e1-ab79faa9705c tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dc0a3246-82a0-4d2f-9877-8a072dccf064" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.300s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 10:24:48 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e44fc8c-b40a-4337-b9e1-ab79faa9705c tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Connected to 172.16.0.220:3260 {{(pid=73572) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 10:24:48 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-9e44fc8c-b40a-4337-b9e1-ab79faa9705c tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] HCTL ('33', '-', '-', 0) found on session 35 with lun 0 {{(pid=73572) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 10:24:48 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-9e44fc8c-b40a-4337-b9e1-ab79faa9705c tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73572) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 10:24:48 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:24:48 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:24:48 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[da96ef42-ffc0-4566-9fc4-e6c3edb6d077]: (4, ('- - 0', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:24:48 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-9e44fc8c-b40a-4337-b9e1-ab79faa9705c tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Searching for a device in session 35 and hctl ['33', '*', '*', 0] yield: None {{(pid=73572) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 10:24:49 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-9e44fc8c-b40a-4337-b9e1-ab79faa9705c tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Searching for a device in session 35 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73572) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 10:24:49 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e44fc8c-b40a-4337-b9e1-ab79faa9705c tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zoNTGrvh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73572) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 10:24:49 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-9e44fc8c-b40a-4337-b9e1-ab79faa9705c tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.333s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 10:24:49 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e44fc8c-b40a-4337-b9e1-ab79faa9705c tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] <== connect_volume: return (1335ms) {'type': 'block', 'scsi_wwn': '26134376162623462', 'path': '/dev/sdb'} {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 10:24:49 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9e44fc8c-b40a-4337-b9e1-ab79faa9705c tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] [instance: 1f3db0fa-682c-4b33-966b-9e50b7349b6e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26134376162623462', 'path': '/dev/sdb'} {{(pid=73572) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 10:24:49 user nova-compute[73572]: DEBUG nova.objects.instance [None req-9e44fc8c-b40a-4337-b9e1-ab79faa9705c tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Lazy-loading 'flavor' on Instance uuid 1f3db0fa-682c-4b33-966b-9e50b7349b6e {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:24:49 user nova-compute[73572]: DEBUG nova.virt.libvirt.guest [None req-9e44fc8c-b40a-4337-b9e1-ab79faa9705c tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 10:24:49 user nova-compute[73572]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 10:24:49 user nova-compute[73572]:   <source dev="/dev/sdb"/>
Aug 26 10:24:49 user nova-compute[73572]:   <target dev="vdb" bus="virtio"/>
Aug 26 10:24:49 user nova-compute[73572]:   <serial>dc0a3246-82a0-4d2f-9877-8a072dccf064</serial>
Aug 26 10:24:49 user nova-compute[73572]: </disk>
Aug 26 10:24:49 user nova-compute[73572]:  {{(pid=73572) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 10:24:50 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:24:50 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-9e44fc8c-b40a-4337-b9e1-ab79faa9705c tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] No BDM found with device name vda, not building metadata. {{(pid=73572) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 10:24:50 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-9e44fc8c-b40a-4337-b9e1-ab79faa9705c tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73572) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 10:24:50 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-9e44fc8c-b40a-4337-b9e1-ab79faa9705c tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] No VIF found with MAC fa:16:3e:b8:f0:d2, not building metadata {{(pid=73572) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 10:24:50 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9e44fc8c-b40a-4337-b9e1-ab79faa9705c tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Lock "1f3db0fa-682c-4b33-966b-9e50b7349b6e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.839s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:24:52 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-474c93c6-e2a2-442d-8419-c5b92bac4416 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Acquiring lock "00c47a06-2bf8-427d-bcb1-304688584511" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:24:52 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-474c93c6-e2a2-442d-8419-c5b92bac4416 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Lock "00c47a06-2bf8-427d-bcb1-304688584511" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:24:52 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-474c93c6-e2a2-442d-8419-c5b92bac4416 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Acquiring lock "00c47a06-2bf8-427d-bcb1-304688584511-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:24:52 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-474c93c6-e2a2-442d-8419-c5b92bac4416 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Lock "00c47a06-2bf8-427d-bcb1-304688584511-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:24:52 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-474c93c6-e2a2-442d-8419-c5b92bac4416 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Lock "00c47a06-2bf8-427d-bcb1-304688584511-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:24:52 user nova-compute[73572]: INFO nova.compute.manager [None req-474c93c6-e2a2-442d-8419-c5b92bac4416 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] [instance: 00c47a06-2bf8-427d-bcb1-304688584511] Terminating instance
Aug 26 10:24:52 user nova-compute[73572]: DEBUG nova.compute.manager [None req-474c93c6-e2a2-442d-8419-c5b92bac4416 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] [instance: 00c47a06-2bf8-427d-bcb1-304688584511] Start destroying the instance on the hypervisor. {{(pid=73572) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 10:24:53 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:24:53 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:24:53 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:24:53 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:24:53 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:24:53 user nova-compute[73572]: DEBUG nova.compute.manager [req-5102f0d5-ce1f-45e4-8caf-33ac738e8403 req-75aaf51a-5af0-49da-8e8d-0ce92e6a7793 service nova] [instance: 00c47a06-2bf8-427d-bcb1-304688584511] Received event network-vif-unplugged-d18bfeb9-ad63-41d9-8d66-56df3d3306d8 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:24:53 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-5102f0d5-ce1f-45e4-8caf-33ac738e8403 req-75aaf51a-5af0-49da-8e8d-0ce92e6a7793 service nova] Acquiring lock "00c47a06-2bf8-427d-bcb1-304688584511-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:24:53 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-5102f0d5-ce1f-45e4-8caf-33ac738e8403 req-75aaf51a-5af0-49da-8e8d-0ce92e6a7793 service nova] Lock "00c47a06-2bf8-427d-bcb1-304688584511-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:24:53 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-5102f0d5-ce1f-45e4-8caf-33ac738e8403 req-75aaf51a-5af0-49da-8e8d-0ce92e6a7793 service nova] Lock "00c47a06-2bf8-427d-bcb1-304688584511-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:24:53 user nova-compute[73572]: DEBUG nova.compute.manager [req-5102f0d5-ce1f-45e4-8caf-33ac738e8403 req-75aaf51a-5af0-49da-8e8d-0ce92e6a7793 service nova] [instance: 00c47a06-2bf8-427d-bcb1-304688584511] No waiting events found dispatching network-vif-unplugged-d18bfeb9-ad63-41d9-8d66-56df3d3306d8 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:24:53 user nova-compute[73572]: DEBUG nova.compute.manager [req-5102f0d5-ce1f-45e4-8caf-33ac738e8403 req-75aaf51a-5af0-49da-8e8d-0ce92e6a7793 service nova] [instance: 00c47a06-2bf8-427d-bcb1-304688584511] Received event network-vif-unplugged-d18bfeb9-ad63-41d9-8d66-56df3d3306d8 for instance with task_state deleting. {{(pid=73572) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 10:24:53 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:24:53 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:24:53 user nova-compute[73572]: DEBUG nova.compute.manager [req-2c694e6e-b4af-466c-92fe-8a80ce21bf89 req-0b55ccf3-c758-4428-a592-8cc679ce4379 service nova] [instance: 1f3db0fa-682c-4b33-966b-9e50b7349b6e] Received event network-changed-56789500-c8b2-4391-b245-6a2998d9fb6c {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:24:53 user nova-compute[73572]: DEBUG nova.compute.manager [req-2c694e6e-b4af-466c-92fe-8a80ce21bf89 req-0b55ccf3-c758-4428-a592-8cc679ce4379 service nova] [instance: 1f3db0fa-682c-4b33-966b-9e50b7349b6e] Refreshing instance network info cache due to event network-changed-56789500-c8b2-4391-b245-6a2998d9fb6c. {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 10:24:53 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-2c694e6e-b4af-466c-92fe-8a80ce21bf89 req-0b55ccf3-c758-4428-a592-8cc679ce4379 service nova] Acquiring lock "refresh_cache-1f3db0fa-682c-4b33-966b-9e50b7349b6e" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:24:53 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-2c694e6e-b4af-466c-92fe-8a80ce21bf89 req-0b55ccf3-c758-4428-a592-8cc679ce4379 service nova] Acquired lock "refresh_cache-1f3db0fa-682c-4b33-966b-9e50b7349b6e" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:24:53 user nova-compute[73572]: DEBUG nova.network.neutron [req-2c694e6e-b4af-466c-92fe-8a80ce21bf89 req-0b55ccf3-c758-4428-a592-8cc679ce4379 service nova] [instance: 1f3db0fa-682c-4b33-966b-9e50b7349b6e] Refreshing network info cache for port 56789500-c8b2-4391-b245-6a2998d9fb6c {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 10:24:53 user nova-compute[73572]: INFO nova.virt.libvirt.driver [-] [instance: 00c47a06-2bf8-427d-bcb1-304688584511] Instance destroyed successfully.
Aug 26 10:24:53 user nova-compute[73572]: DEBUG nova.objects.instance [None req-474c93c6-e2a2-442d-8419-c5b92bac4416 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Lazy-loading 'resources' on Instance uuid 00c47a06-2bf8-427d-bcb1-304688584511 {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:24:53 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-474c93c6-e2a2-442d-8419-c5b92bac4416 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T10:15:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-767184678',display_name='tempest-AttachVolumeTestJSON-server-767184678',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-767184678',id=15,image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDUM4e46LSrHmno1gp4T3RRXiXfjHx917gcUppmI/sxQPEY8hKY/vqoEhT+Bxby7kAu1Ei3af6xY5p/QME/Z3JthPiVJQ1F4Ur+7V+CECg8DAf4Z/fI85QJzneAszEfomQ==',key_name='tempest-keypair-643189050',keypairs=<?>,launch_index=0,launched_at=2023-08-26T10:15:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='084df935eab842e58bad79afad7090f3',ramdisk_id='',reservation_id='r-d4j1rgky',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-716261196',owner_user_name='tempest-AttachVolumeTestJSON-716261196-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T10:23:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2a2ef00486924f318ff1e7e502e835a6',uuid=00c47a06-2bf8-427d-bcb1-304688584511,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d18bfeb9-ad63-41d9-8d66-56df3d3306d8", "address": "fa:16:3e:a2:f2:f4", "network": {"id": "81543fb3-a8fe-4e9c-8180-c65fa4dcc9e1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-469390371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "084df935eab842e58bad79afad7090f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd18bfeb9-ad", "ovs_interfaceid": "d18bfeb9-ad63-41d9-8d66-56df3d3306d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 10:24:53 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-474c93c6-e2a2-442d-8419-c5b92bac4416 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Converting VIF {"id": "d18bfeb9-ad63-41d9-8d66-56df3d3306d8", "address": "fa:16:3e:a2:f2:f4", "network": {"id": "81543fb3-a8fe-4e9c-8180-c65fa4dcc9e1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-469390371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "084df935eab842e58bad79afad7090f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd18bfeb9-ad", "ovs_interfaceid": "d18bfeb9-ad63-41d9-8d66-56df3d3306d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:24:53 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-474c93c6-e2a2-442d-8419-c5b92bac4416 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:f2:f4,bridge_name='br-int',has_traffic_filtering=True,id=d18bfeb9-ad63-41d9-8d66-56df3d3306d8,network=Network(81543fb3-a8fe-4e9c-8180-c65fa4dcc9e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd18bfeb9-ad') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:24:53 user nova-compute[73572]: DEBUG os_vif [None req-474c93c6-e2a2-442d-8419-c5b92bac4416 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:f2:f4,bridge_name='br-int',has_traffic_filtering=True,id=d18bfeb9-ad63-41d9-8d66-56df3d3306d8,network=Network(81543fb3-a8fe-4e9c-8180-c65fa4dcc9e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd18bfeb9-ad') {{(pid=73572) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 10:24:53 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:24:53 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd18bfeb9-ad, bridge=br-int, if_exists=True) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:24:53 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:24:53 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:24:53 user nova-compute[73572]: INFO os_vif [None req-474c93c6-e2a2-442d-8419-c5b92bac4416 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:f2:f4,bridge_name='br-int',has_traffic_filtering=True,id=d18bfeb9-ad63-41d9-8d66-56df3d3306d8,network=Network(81543fb3-a8fe-4e9c-8180-c65fa4dcc9e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd18bfeb9-ad')
Aug 26 10:24:53 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-474c93c6-e2a2-442d-8419-c5b92bac4416 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] [instance: 00c47a06-2bf8-427d-bcb1-304688584511] Deleting instance files /opt/stack/data/nova/instances/00c47a06-2bf8-427d-bcb1-304688584511_del
Aug 26 10:24:53 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-474c93c6-e2a2-442d-8419-c5b92bac4416 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] [instance: 00c47a06-2bf8-427d-bcb1-304688584511] Deletion of /opt/stack/data/nova/instances/00c47a06-2bf8-427d-bcb1-304688584511_del complete
Aug 26 10:24:53 user nova-compute[73572]: INFO nova.compute.manager [None req-474c93c6-e2a2-442d-8419-c5b92bac4416 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] [instance: 00c47a06-2bf8-427d-bcb1-304688584511] Took 0.89 seconds to destroy the instance on the hypervisor.
Aug 26 10:24:53 user nova-compute[73572]: DEBUG oslo.service.loopingcall [None req-474c93c6-e2a2-442d-8419-c5b92bac4416 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73572) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 10:24:53 user nova-compute[73572]: DEBUG nova.compute.manager [-] [instance: 00c47a06-2bf8-427d-bcb1-304688584511] Deallocating network for instance {{(pid=73572) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 10:24:53 user nova-compute[73572]: DEBUG nova.network.neutron [-] [instance: 00c47a06-2bf8-427d-bcb1-304688584511] deallocate_for_instance() {{(pid=73572) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 10:24:54 user nova-compute[73572]: DEBUG nova.network.neutron [req-2c694e6e-b4af-466c-92fe-8a80ce21bf89 req-0b55ccf3-c758-4428-a592-8cc679ce4379 service nova] [instance: 1f3db0fa-682c-4b33-966b-9e50b7349b6e] Updated VIF entry in instance network info cache for port 56789500-c8b2-4391-b245-6a2998d9fb6c. {{(pid=73572) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 10:24:54 user nova-compute[73572]: DEBUG nova.network.neutron [req-2c694e6e-b4af-466c-92fe-8a80ce21bf89 req-0b55ccf3-c758-4428-a592-8cc679ce4379 service nova] [instance: 1f3db0fa-682c-4b33-966b-9e50b7349b6e] Updating instance_info_cache with network_info: [{"id": "56789500-c8b2-4391-b245-6a2998d9fb6c", "address": "fa:16:3e:b8:f0:d2", "network": {"id": "2a6e27c9-9bd2-4ccb-abf6-82d85524da90", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1822065121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb6ef2597eac461f959a568abd3031ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56789500-c8", "ovs_interfaceid": "56789500-c8b2-4391-b245-6a2998d9fb6c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:24:54 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-2c694e6e-b4af-466c-92fe-8a80ce21bf89 req-0b55ccf3-c758-4428-a592-8cc679ce4379 service nova] Releasing lock "refresh_cache-1f3db0fa-682c-4b33-966b-9e50b7349b6e" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:24:54 user nova-compute[73572]: DEBUG nova.network.neutron [-] [instance: 00c47a06-2bf8-427d-bcb1-304688584511] Updating instance_info_cache with network_info: [] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:24:54 user nova-compute[73572]: INFO nova.compute.manager [-] [instance: 00c47a06-2bf8-427d-bcb1-304688584511] Took 0.90 seconds to deallocate network for instance.
Aug 26 10:24:54 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-474c93c6-e2a2-442d-8419-c5b92bac4416 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:24:54 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-474c93c6-e2a2-442d-8419-c5b92bac4416 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:24:55 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:24:55 user nova-compute[73572]: DEBUG nova.compute.provider_tree [None req-474c93c6-e2a2-442d-8419-c5b92bac4416 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Inventory has not changed in ProviderTree for provider: e2cec974-59b2-4c77-a53d-a7f4e5a30d75 {{(pid=73572) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 10:24:55 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-474c93c6-e2a2-442d-8419-c5b92bac4416 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Inventory has not changed for provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73572) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 10:24:55 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-474c93c6-e2a2-442d-8419-c5b92bac4416 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.424s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:24:55 user nova-compute[73572]: INFO nova.scheduler.client.report [None req-474c93c6-e2a2-442d-8419-c5b92bac4416 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Deleted allocations for instance 00c47a06-2bf8-427d-bcb1-304688584511
Aug 26 10:24:55 user nova-compute[73572]: DEBUG nova.compute.manager [req-12af6da9-e86d-4369-bfb4-583df2715ab5 req-bc788151-687e-44e0-b7f6-da6818044638 service nova] [instance: 00c47a06-2bf8-427d-bcb1-304688584511] Received event network-vif-plugged-d18bfeb9-ad63-41d9-8d66-56df3d3306d8 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:24:55 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-12af6da9-e86d-4369-bfb4-583df2715ab5 req-bc788151-687e-44e0-b7f6-da6818044638 service nova] Acquiring lock "00c47a06-2bf8-427d-bcb1-304688584511-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:24:55 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-12af6da9-e86d-4369-bfb4-583df2715ab5 req-bc788151-687e-44e0-b7f6-da6818044638 service nova] Lock "00c47a06-2bf8-427d-bcb1-304688584511-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:24:55 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-12af6da9-e86d-4369-bfb4-583df2715ab5 req-bc788151-687e-44e0-b7f6-da6818044638 service nova] Lock "00c47a06-2bf8-427d-bcb1-304688584511-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:24:55 user nova-compute[73572]: DEBUG nova.compute.manager [req-12af6da9-e86d-4369-bfb4-583df2715ab5 req-bc788151-687e-44e0-b7f6-da6818044638 service nova] [instance: 00c47a06-2bf8-427d-bcb1-304688584511] No waiting events found dispatching network-vif-plugged-d18bfeb9-ad63-41d9-8d66-56df3d3306d8 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:24:55 user nova-compute[73572]: WARNING nova.compute.manager [req-12af6da9-e86d-4369-bfb4-583df2715ab5 req-bc788151-687e-44e0-b7f6-da6818044638 service nova] [instance: 00c47a06-2bf8-427d-bcb1-304688584511] Received unexpected event network-vif-plugged-d18bfeb9-ad63-41d9-8d66-56df3d3306d8 for instance with vm_state deleted and task_state None.
Aug 26 10:24:55 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-474c93c6-e2a2-442d-8419-c5b92bac4416 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Lock "00c47a06-2bf8-427d-bcb1-304688584511" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.446s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:24:55 user nova-compute[73572]: DEBUG nova.compute.manager [req-9a6b0e13-cd22-446d-95b0-7a29a90b7c31 req-b86b2cd9-4e82-4657-ae6b-926247a344d8 service nova] [instance: 1f3db0fa-682c-4b33-966b-9e50b7349b6e] Received event network-changed-56789500-c8b2-4391-b245-6a2998d9fb6c {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:24:55 user nova-compute[73572]: DEBUG nova.compute.manager [req-9a6b0e13-cd22-446d-95b0-7a29a90b7c31 req-b86b2cd9-4e82-4657-ae6b-926247a344d8 service nova] [instance: 1f3db0fa-682c-4b33-966b-9e50b7349b6e] Refreshing instance network info cache due to event network-changed-56789500-c8b2-4391-b245-6a2998d9fb6c. {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 10:24:55 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-9a6b0e13-cd22-446d-95b0-7a29a90b7c31 req-b86b2cd9-4e82-4657-ae6b-926247a344d8 service nova] Acquiring lock "refresh_cache-1f3db0fa-682c-4b33-966b-9e50b7349b6e" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:24:55 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-9a6b0e13-cd22-446d-95b0-7a29a90b7c31 req-b86b2cd9-4e82-4657-ae6b-926247a344d8 service nova] Acquired lock "refresh_cache-1f3db0fa-682c-4b33-966b-9e50b7349b6e" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:24:55 user nova-compute[73572]: DEBUG nova.network.neutron [req-9a6b0e13-cd22-446d-95b0-7a29a90b7c31 req-b86b2cd9-4e82-4657-ae6b-926247a344d8 service nova] [instance: 1f3db0fa-682c-4b33-966b-9e50b7349b6e] Refreshing network info cache for port 56789500-c8b2-4391-b245-6a2998d9fb6c {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 10:24:55 user nova-compute[73572]: DEBUG nova.compute.manager [req-f08fcb2e-3672-4213-be34-bac7a94aad19 req-c65c28f0-23ce-4b16-a94f-9a3cdd642545 service nova] [instance: 00c47a06-2bf8-427d-bcb1-304688584511] Received event network-vif-deleted-d18bfeb9-ad63-41d9-8d66-56df3d3306d8 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:24:56 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-aa258db8-159d-41f8-b21c-03b568328333 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Acquiring lock "1f3db0fa-682c-4b33-966b-9e50b7349b6e" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:24:56 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-aa258db8-159d-41f8-b21c-03b568328333 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Lock "1f3db0fa-682c-4b33-966b-9e50b7349b6e" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:24:56 user nova-compute[73572]: INFO nova.compute.manager [None req-aa258db8-159d-41f8-b21c-03b568328333 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] [instance: 1f3db0fa-682c-4b33-966b-9e50b7349b6e] Rebooting instance
Aug 26 10:24:56 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-aa258db8-159d-41f8-b21c-03b568328333 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Acquiring lock "refresh_cache-1f3db0fa-682c-4b33-966b-9e50b7349b6e" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:24:56 user nova-compute[73572]: DEBUG nova.network.neutron [req-9a6b0e13-cd22-446d-95b0-7a29a90b7c31 req-b86b2cd9-4e82-4657-ae6b-926247a344d8 service nova] [instance: 1f3db0fa-682c-4b33-966b-9e50b7349b6e] Updated VIF entry in instance network info cache for port 56789500-c8b2-4391-b245-6a2998d9fb6c. {{(pid=73572) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 10:24:56 user nova-compute[73572]: DEBUG nova.network.neutron [req-9a6b0e13-cd22-446d-95b0-7a29a90b7c31 req-b86b2cd9-4e82-4657-ae6b-926247a344d8 service nova] [instance: 1f3db0fa-682c-4b33-966b-9e50b7349b6e] Updating instance_info_cache with network_info: [{"id": "56789500-c8b2-4391-b245-6a2998d9fb6c", "address": "fa:16:3e:b8:f0:d2", "network": {"id": "2a6e27c9-9bd2-4ccb-abf6-82d85524da90", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1822065121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb6ef2597eac461f959a568abd3031ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56789500-c8", "ovs_interfaceid": "56789500-c8b2-4391-b245-6a2998d9fb6c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:24:56 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-9a6b0e13-cd22-446d-95b0-7a29a90b7c31 req-b86b2cd9-4e82-4657-ae6b-926247a344d8 service nova] Releasing lock "refresh_cache-1f3db0fa-682c-4b33-966b-9e50b7349b6e" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:24:56 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-aa258db8-159d-41f8-b21c-03b568328333 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Acquired lock "refresh_cache-1f3db0fa-682c-4b33-966b-9e50b7349b6e" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:24:56 user nova-compute[73572]: DEBUG nova.network.neutron [None req-aa258db8-159d-41f8-b21c-03b568328333 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] [instance: 1f3db0fa-682c-4b33-966b-9e50b7349b6e] Building network info cache for instance {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 10:24:56 user nova-compute[73572]: DEBUG nova.network.neutron [None req-aa258db8-159d-41f8-b21c-03b568328333 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] [instance: 1f3db0fa-682c-4b33-966b-9e50b7349b6e] Updating instance_info_cache with network_info: [{"id": "56789500-c8b2-4391-b245-6a2998d9fb6c", "address": "fa:16:3e:b8:f0:d2", "network": {"id": "2a6e27c9-9bd2-4ccb-abf6-82d85524da90", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1822065121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb6ef2597eac461f959a568abd3031ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56789500-c8", "ovs_interfaceid": "56789500-c8b2-4391-b245-6a2998d9fb6c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:24:56 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-aa258db8-159d-41f8-b21c-03b568328333 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Releasing lock "refresh_cache-1f3db0fa-682c-4b33-966b-9e50b7349b6e" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:24:56 user nova-compute[73572]: DEBUG nova.compute.manager [None req-aa258db8-159d-41f8-b21c-03b568328333 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] [instance: 1f3db0fa-682c-4b33-966b-9e50b7349b6e] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:24:58 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:24:59 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:24:59 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:24:59 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:24:59 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:24:59 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:24:59 user nova-compute[73572]: DEBUG nova.compute.manager [req-21051cab-dce1-4567-b08d-1865aa305836 req-508c45a5-0374-4c2e-9ddc-aebe91c37dec service nova] [instance: 1f3db0fa-682c-4b33-966b-9e50b7349b6e] Received event network-vif-unplugged-56789500-c8b2-4391-b245-6a2998d9fb6c {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:24:59 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-21051cab-dce1-4567-b08d-1865aa305836 req-508c45a5-0374-4c2e-9ddc-aebe91c37dec service nova] Acquiring lock "1f3db0fa-682c-4b33-966b-9e50b7349b6e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:24:59 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-21051cab-dce1-4567-b08d-1865aa305836 req-508c45a5-0374-4c2e-9ddc-aebe91c37dec service nova] Lock "1f3db0fa-682c-4b33-966b-9e50b7349b6e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:24:59 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-21051cab-dce1-4567-b08d-1865aa305836 req-508c45a5-0374-4c2e-9ddc-aebe91c37dec service nova] Lock "1f3db0fa-682c-4b33-966b-9e50b7349b6e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:24:59 user nova-compute[73572]: DEBUG nova.compute.manager [req-21051cab-dce1-4567-b08d-1865aa305836 req-508c45a5-0374-4c2e-9ddc-aebe91c37dec service nova] [instance: 1f3db0fa-682c-4b33-966b-9e50b7349b6e] No waiting events found dispatching network-vif-unplugged-56789500-c8b2-4391-b245-6a2998d9fb6c {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:24:59 user nova-compute[73572]: WARNING nova.compute.manager [req-21051cab-dce1-4567-b08d-1865aa305836 req-508c45a5-0374-4c2e-9ddc-aebe91c37dec service nova] [instance: 1f3db0fa-682c-4b33-966b-9e50b7349b6e] Received unexpected event network-vif-unplugged-56789500-c8b2-4391-b245-6a2998d9fb6c for instance with vm_state active and task_state reboot_started.
Aug 26 10:25:00 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:25:00 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-aa258db8-159d-41f8-b21c-03b568328333 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] [instance: 1f3db0fa-682c-4b33-966b-9e50b7349b6e] Instance shutdown successfully.
Aug 26 10:25:00 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-53b6a152-23d8-4a36-bf48-51bfd4eae96b tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Acquiring lock "6b2d5f4e-37af-438c-859b-d4ca803b7d08" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:25:00 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-53b6a152-23d8-4a36-bf48-51bfd4eae96b tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Lock "6b2d5f4e-37af-438c-859b-d4ca803b7d08" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:25:00 user nova-compute[73572]: DEBUG nova.compute.manager [None req-53b6a152-23d8-4a36-bf48-51bfd4eae96b tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] [instance: 6b2d5f4e-37af-438c-859b-d4ca803b7d08] Starting instance... {{(pid=73572) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 10:25:01 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-53b6a152-23d8-4a36-bf48-51bfd4eae96b tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:25:01 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-53b6a152-23d8-4a36-bf48-51bfd4eae96b tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:25:01 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-53b6a152-23d8-4a36-bf48-51bfd4eae96b tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73572) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 10:25:01 user nova-compute[73572]: INFO nova.compute.claims [None req-53b6a152-23d8-4a36-bf48-51bfd4eae96b tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] [instance: 6b2d5f4e-37af-438c-859b-d4ca803b7d08] Claim successful on node user
Aug 26 10:25:01 user nova-compute[73572]: DEBUG nova.compute.provider_tree [None req-53b6a152-23d8-4a36-bf48-51bfd4eae96b tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Inventory has not changed in ProviderTree for provider: e2cec974-59b2-4c77-a53d-a7f4e5a30d75 {{(pid=73572) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 10:25:01 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-53b6a152-23d8-4a36-bf48-51bfd4eae96b tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Inventory has not changed for provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73572) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 10:25:01 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:25:01 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:25:01 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-53b6a152-23d8-4a36-bf48-51bfd4eae96b tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.439s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:25:01 user nova-compute[73572]: DEBUG nova.compute.manager [None req-53b6a152-23d8-4a36-bf48-51bfd4eae96b tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] [instance: 6b2d5f4e-37af-438c-859b-d4ca803b7d08] Start building networks asynchronously for instance. {{(pid=73572) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 10:25:01 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:25:01 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:25:01 user nova-compute[73572]: DEBUG nova.compute.manager [None req-53b6a152-23d8-4a36-bf48-51bfd4eae96b tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] [instance: 6b2d5f4e-37af-438c-859b-d4ca803b7d08] Allocating IP information in the background. {{(pid=73572) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 10:25:01 user nova-compute[73572]: DEBUG nova.network.neutron [None req-53b6a152-23d8-4a36-bf48-51bfd4eae96b tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] [instance: 6b2d5f4e-37af-438c-859b-d4ca803b7d08] allocate_for_instance() {{(pid=73572) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 10:25:01 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-53b6a152-23d8-4a36-bf48-51bfd4eae96b tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] [instance: 6b2d5f4e-37af-438c-859b-d4ca803b7d08] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 10:25:01 user nova-compute[73572]: DEBUG nova.compute.manager [None req-53b6a152-23d8-4a36-bf48-51bfd4eae96b tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] [instance: 6b2d5f4e-37af-438c-859b-d4ca803b7d08] Start building block device mappings for instance. {{(pid=73572) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 10:25:01 user nova-compute[73572]: DEBUG nova.compute.manager [req-fabda81a-4e97-4fed-a0f9-a1252c9dd90d req-586d51f2-6a68-4203-908a-a984aa6d02dd service nova] [instance: 1f3db0fa-682c-4b33-966b-9e50b7349b6e] Received event network-vif-plugged-56789500-c8b2-4391-b245-6a2998d9fb6c {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:25:01 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-fabda81a-4e97-4fed-a0f9-a1252c9dd90d req-586d51f2-6a68-4203-908a-a984aa6d02dd service nova] Acquiring lock "1f3db0fa-682c-4b33-966b-9e50b7349b6e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:25:01 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-fabda81a-4e97-4fed-a0f9-a1252c9dd90d req-586d51f2-6a68-4203-908a-a984aa6d02dd service nova] Lock "1f3db0fa-682c-4b33-966b-9e50b7349b6e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:25:01 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-fabda81a-4e97-4fed-a0f9-a1252c9dd90d req-586d51f2-6a68-4203-908a-a984aa6d02dd service nova] Lock "1f3db0fa-682c-4b33-966b-9e50b7349b6e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:25:01 user nova-compute[73572]: DEBUG nova.compute.manager [req-fabda81a-4e97-4fed-a0f9-a1252c9dd90d req-586d51f2-6a68-4203-908a-a984aa6d02dd service nova] [instance: 1f3db0fa-682c-4b33-966b-9e50b7349b6e] No waiting events found dispatching network-vif-plugged-56789500-c8b2-4391-b245-6a2998d9fb6c {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:25:01 user nova-compute[73572]: WARNING nova.compute.manager [req-fabda81a-4e97-4fed-a0f9-a1252c9dd90d req-586d51f2-6a68-4203-908a-a984aa6d02dd service nova] [instance: 1f3db0fa-682c-4b33-966b-9e50b7349b6e] Received unexpected event network-vif-plugged-56789500-c8b2-4391-b245-6a2998d9fb6c for instance with vm_state active and task_state reboot_started.
Aug 26 10:25:01 user nova-compute[73572]: DEBUG nova.policy [None req-53b6a152-23d8-4a36-bf48-51bfd4eae96b tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '61b6124f6f6e44c5b2fd0202a15da019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7935bccc360b46b589fd57d53f334595', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73572) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 10:25:01 user nova-compute[73572]: DEBUG nova.compute.manager [None req-53b6a152-23d8-4a36-bf48-51bfd4eae96b tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] [instance: 6b2d5f4e-37af-438c-859b-d4ca803b7d08] Start spawning the instance on the hypervisor. {{(pid=73572) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 10:25:01 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-53b6a152-23d8-4a36-bf48-51bfd4eae96b tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] [instance: 6b2d5f4e-37af-438c-859b-d4ca803b7d08] Creating instance directory {{(pid=73572) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 10:25:01 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-53b6a152-23d8-4a36-bf48-51bfd4eae96b tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] [instance: 6b2d5f4e-37af-438c-859b-d4ca803b7d08] Creating image(s)
Aug 26 10:25:01 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-53b6a152-23d8-4a36-bf48-51bfd4eae96b tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Acquiring lock "/opt/stack/data/nova/instances/6b2d5f4e-37af-438c-859b-d4ca803b7d08/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:25:01 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-53b6a152-23d8-4a36-bf48-51bfd4eae96b tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Lock "/opt/stack/data/nova/instances/6b2d5f4e-37af-438c-859b-d4ca803b7d08/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:25:01 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-53b6a152-23d8-4a36-bf48-51bfd4eae96b tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Lock "/opt/stack/data/nova/instances/6b2d5f4e-37af-438c-859b-d4ca803b7d08/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:25:01 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-53b6a152-23d8-4a36-bf48-51bfd4eae96b tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:25:02 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-53b6a152-23d8-4a36-bf48-51bfd4eae96b tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json" returned: 0 in 0.234s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:25:02 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-53b6a152-23d8-4a36-bf48-51bfd4eae96b tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Acquiring lock "2099350d6f3bcd0de9471c73862d4fe75b049801" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:25:02 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-53b6a152-23d8-4a36-bf48-51bfd4eae96b tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Lock "2099350d6f3bcd0de9471c73862d4fe75b049801" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:25:02 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-53b6a152-23d8-4a36-bf48-51bfd4eae96b tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:25:02 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:25:02 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-53b6a152-23d8-4a36-bf48-51bfd4eae96b tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json" returned: 0 in 0.216s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:25:02 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-53b6a152-23d8-4a36-bf48-51bfd4eae96b tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801,backing_fmt=raw /opt/stack/data/nova/instances/6b2d5f4e-37af-438c-859b-d4ca803b7d08/disk 1073741824 {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:25:02 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:25:02 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-53b6a152-23d8-4a36-bf48-51bfd4eae96b tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801,backing_fmt=raw /opt/stack/data/nova/instances/6b2d5f4e-37af-438c-859b-d4ca803b7d08/disk 1073741824" returned: 0 in 0.077s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:25:02 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-53b6a152-23d8-4a36-bf48-51bfd4eae96b tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Lock "2099350d6f3bcd0de9471c73862d4fe75b049801" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.298s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:25:02 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-53b6a152-23d8-4a36-bf48-51bfd4eae96b tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:25:02 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-53b6a152-23d8-4a36-bf48-51bfd4eae96b tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json" returned: 0 in 0.196s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:25:02 user nova-compute[73572]: DEBUG nova.virt.disk.api [None req-53b6a152-23d8-4a36-bf48-51bfd4eae96b tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6b2d5f4e-37af-438c-859b-d4ca803b7d08/disk. size=1073741824 {{(pid=73572) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 10:25:02 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-53b6a152-23d8-4a36-bf48-51bfd4eae96b tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b2d5f4e-37af-438c-859b-d4ca803b7d08/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:25:02 user nova-compute[73572]: DEBUG nova.network.neutron [None req-53b6a152-23d8-4a36-bf48-51bfd4eae96b tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] [instance: 6b2d5f4e-37af-438c-859b-d4ca803b7d08] Successfully created port: bf886914-b734-4957-9e48-4ef3d65c61f4 {{(pid=73572) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 10:25:02 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-53b6a152-23d8-4a36-bf48-51bfd4eae96b tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b2d5f4e-37af-438c-859b-d4ca803b7d08/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:25:02 user nova-compute[73572]: DEBUG nova.virt.disk.api [None req-53b6a152-23d8-4a36-bf48-51bfd4eae96b tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Cannot resize image /opt/stack/data/nova/instances/6b2d5f4e-37af-438c-859b-d4ca803b7d08/disk to a smaller size. {{(pid=73572) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 10:25:02 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-53b6a152-23d8-4a36-bf48-51bfd4eae96b tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] [instance: 6b2d5f4e-37af-438c-859b-d4ca803b7d08] Created local disks {{(pid=73572) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 10:25:02 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-53b6a152-23d8-4a36-bf48-51bfd4eae96b tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] [instance: 6b2d5f4e-37af-438c-859b-d4ca803b7d08] Ensure instance console log exists: /opt/stack/data/nova/instances/6b2d5f4e-37af-438c-859b-d4ca803b7d08/console.log {{(pid=73572) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 10:25:02 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-53b6a152-23d8-4a36-bf48-51bfd4eae96b tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:25:02 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-53b6a152-23d8-4a36-bf48-51bfd4eae96b tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:25:02 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-53b6a152-23d8-4a36-bf48-51bfd4eae96b tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:25:03 user nova-compute[73572]: DEBUG nova.network.neutron [None req-53b6a152-23d8-4a36-bf48-51bfd4eae96b tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] [instance: 6b2d5f4e-37af-438c-859b-d4ca803b7d08] Successfully updated port: bf886914-b734-4957-9e48-4ef3d65c61f4 {{(pid=73572) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 10:25:03 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-53b6a152-23d8-4a36-bf48-51bfd4eae96b tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Acquiring lock "refresh_cache-6b2d5f4e-37af-438c-859b-d4ca803b7d08" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:25:03 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-53b6a152-23d8-4a36-bf48-51bfd4eae96b tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Acquired lock "refresh_cache-6b2d5f4e-37af-438c-859b-d4ca803b7d08" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:25:03 user nova-compute[73572]: DEBUG nova.network.neutron [None req-53b6a152-23d8-4a36-bf48-51bfd4eae96b tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] [instance: 6b2d5f4e-37af-438c-859b-d4ca803b7d08] Building network info cache for instance {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 10:25:03 user nova-compute[73572]: DEBUG nova.compute.manager [req-e9e122b9-707b-4974-9b68-5da31c0a2abe req-759b9f2d-f43a-430b-8178-118a5e874fa2 service nova] [instance: 6b2d5f4e-37af-438c-859b-d4ca803b7d08] Received event network-changed-bf886914-b734-4957-9e48-4ef3d65c61f4 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:25:03 user nova-compute[73572]: DEBUG nova.compute.manager [req-e9e122b9-707b-4974-9b68-5da31c0a2abe req-759b9f2d-f43a-430b-8178-118a5e874fa2 service nova] [instance: 6b2d5f4e-37af-438c-859b-d4ca803b7d08] Refreshing instance network info cache due to event network-changed-bf886914-b734-4957-9e48-4ef3d65c61f4. {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 10:25:03 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-e9e122b9-707b-4974-9b68-5da31c0a2abe req-759b9f2d-f43a-430b-8178-118a5e874fa2 service nova] Acquiring lock "refresh_cache-6b2d5f4e-37af-438c-859b-d4ca803b7d08" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:25:03 user nova-compute[73572]: DEBUG nova.network.neutron [None req-53b6a152-23d8-4a36-bf48-51bfd4eae96b tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] [instance: 6b2d5f4e-37af-438c-859b-d4ca803b7d08] Instance cache missing network info. {{(pid=73572) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 10:25:03 user nova-compute[73572]: DEBUG nova.compute.manager [req-45933ef7-2d4f-455a-8d4c-a9c05c9bd85c req-77abf0f5-8eff-44ad-8d4d-24c161f5a51d service nova] [instance: 1f3db0fa-682c-4b33-966b-9e50b7349b6e] Received event network-vif-plugged-56789500-c8b2-4391-b245-6a2998d9fb6c {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:25:03 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-45933ef7-2d4f-455a-8d4c-a9c05c9bd85c req-77abf0f5-8eff-44ad-8d4d-24c161f5a51d service nova] Acquiring lock "1f3db0fa-682c-4b33-966b-9e50b7349b6e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:25:03 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-45933ef7-2d4f-455a-8d4c-a9c05c9bd85c req-77abf0f5-8eff-44ad-8d4d-24c161f5a51d service nova] Lock "1f3db0fa-682c-4b33-966b-9e50b7349b6e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:25:03 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-45933ef7-2d4f-455a-8d4c-a9c05c9bd85c req-77abf0f5-8eff-44ad-8d4d-24c161f5a51d service nova] Lock "1f3db0fa-682c-4b33-966b-9e50b7349b6e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:25:03 user nova-compute[73572]: DEBUG nova.compute.manager [req-45933ef7-2d4f-455a-8d4c-a9c05c9bd85c req-77abf0f5-8eff-44ad-8d4d-24c161f5a51d service nova] [instance: 1f3db0fa-682c-4b33-966b-9e50b7349b6e] No waiting events found dispatching network-vif-plugged-56789500-c8b2-4391-b245-6a2998d9fb6c {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:25:03 user nova-compute[73572]: WARNING nova.compute.manager [req-45933ef7-2d4f-455a-8d4c-a9c05c9bd85c req-77abf0f5-8eff-44ad-8d4d-24c161f5a51d service nova] [instance: 1f3db0fa-682c-4b33-966b-9e50b7349b6e] Received unexpected event network-vif-plugged-56789500-c8b2-4391-b245-6a2998d9fb6c for instance with vm_state active and task_state reboot_started.
Aug 26 10:25:03 user nova-compute[73572]: DEBUG nova.compute.manager [req-45933ef7-2d4f-455a-8d4c-a9c05c9bd85c req-77abf0f5-8eff-44ad-8d4d-24c161f5a51d service nova] [instance: 1f3db0fa-682c-4b33-966b-9e50b7349b6e] Received event network-vif-plugged-56789500-c8b2-4391-b245-6a2998d9fb6c {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:25:03 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-45933ef7-2d4f-455a-8d4c-a9c05c9bd85c req-77abf0f5-8eff-44ad-8d4d-24c161f5a51d service nova] Acquiring lock "1f3db0fa-682c-4b33-966b-9e50b7349b6e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:25:03 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-45933ef7-2d4f-455a-8d4c-a9c05c9bd85c req-77abf0f5-8eff-44ad-8d4d-24c161f5a51d service nova] Lock "1f3db0fa-682c-4b33-966b-9e50b7349b6e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:25:03 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-45933ef7-2d4f-455a-8d4c-a9c05c9bd85c req-77abf0f5-8eff-44ad-8d4d-24c161f5a51d service nova] Lock "1f3db0fa-682c-4b33-966b-9e50b7349b6e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:25:03 user nova-compute[73572]: DEBUG nova.compute.manager [req-45933ef7-2d4f-455a-8d4c-a9c05c9bd85c req-77abf0f5-8eff-44ad-8d4d-24c161f5a51d service nova] [instance: 1f3db0fa-682c-4b33-966b-9e50b7349b6e] No waiting events found dispatching network-vif-plugged-56789500-c8b2-4391-b245-6a2998d9fb6c {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:25:03 user nova-compute[73572]: WARNING nova.compute.manager [req-45933ef7-2d4f-455a-8d4c-a9c05c9bd85c req-77abf0f5-8eff-44ad-8d4d-24c161f5a51d service nova] [instance: 1f3db0fa-682c-4b33-966b-9e50b7349b6e] Received unexpected event network-vif-plugged-56789500-c8b2-4391-b245-6a2998d9fb6c for instance with vm_state active and task_state reboot_started.
Aug 26 10:25:03 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:25:03 user nova-compute[73572]: DEBUG nova.network.neutron [None req-53b6a152-23d8-4a36-bf48-51bfd4eae96b tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] [instance: 6b2d5f4e-37af-438c-859b-d4ca803b7d08] Updating instance_info_cache with network_info: [{"id": "bf886914-b734-4957-9e48-4ef3d65c61f4", "address": "fa:16:3e:b4:aa:52", "network": {"id": "43215883-3d00-4be7-8c40-bdaf3f01bef9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1088544153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7935bccc360b46b589fd57d53f334595", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf886914-b7", "ovs_interfaceid": "bf886914-b734-4957-9e48-4ef3d65c61f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:25:03 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-53b6a152-23d8-4a36-bf48-51bfd4eae96b tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Releasing lock "refresh_cache-6b2d5f4e-37af-438c-859b-d4ca803b7d08" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:25:03 user nova-compute[73572]: DEBUG nova.compute.manager [None req-53b6a152-23d8-4a36-bf48-51bfd4eae96b tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] [instance: 6b2d5f4e-37af-438c-859b-d4ca803b7d08] Instance network_info: |[{"id": "bf886914-b734-4957-9e48-4ef3d65c61f4", "address": "fa:16:3e:b4:aa:52", "network": {"id": "43215883-3d00-4be7-8c40-bdaf3f01bef9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1088544153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7935bccc360b46b589fd57d53f334595", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf886914-b7", "ovs_interfaceid": "bf886914-b734-4957-9e48-4ef3d65c61f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73572) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 10:25:03 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-e9e122b9-707b-4974-9b68-5da31c0a2abe req-759b9f2d-f43a-430b-8178-118a5e874fa2 service nova] Acquired lock "refresh_cache-6b2d5f4e-37af-438c-859b-d4ca803b7d08" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:25:03 user nova-compute[73572]: DEBUG nova.network.neutron [req-e9e122b9-707b-4974-9b68-5da31c0a2abe req-759b9f2d-f43a-430b-8178-118a5e874fa2 service nova] [instance: 6b2d5f4e-37af-438c-859b-d4ca803b7d08] Refreshing network info cache for port bf886914-b734-4957-9e48-4ef3d65c61f4 {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 10:25:03 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-53b6a152-23d8-4a36-bf48-51bfd4eae96b tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] [instance: 6b2d5f4e-37af-438c-859b-d4ca803b7d08] Start _get_guest_xml network_info=[{"id": "bf886914-b734-4957-9e48-4ef3d65c61f4", "address": "fa:16:3e:b4:aa:52", "network": {"id": "43215883-3d00-4be7-8c40-bdaf3f01bef9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1088544153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7935bccc360b46b589fd57d53f334595", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf886914-b7", "ovs_interfaceid": "bf886914-b734-4957-9e48-4ef3d65c61f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T10:07:33Z,direct_url=<?>,disk_format='qcow2',id=299da0c9-e1c4-48f0-be55-fbe20dd06bc9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5c995f8bbbab4368b67a253e0df3971a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T10:07:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'guest_format': None, 'size': 0, 'encryption_format': None, 'device_type': 'disk', 'image_id': '299da0c9-e1c4-48f0-be55-fbe20dd06bc9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73572) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 10:25:03 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Removed pending event for 1f3db0fa-682c-4b33-966b-9e50b7349b6e due to event {{(pid=73572) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 26 10:25:03 user nova-compute[73572]: DEBUG nova.virt.driver [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Emitting event <LifecycleEvent: 1693045503.9819038, 1f3db0fa-682c-4b33-966b-9e50b7349b6e => Resumed> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:25:03 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 1f3db0fa-682c-4b33-966b-9e50b7349b6e] VM Resumed (Lifecycle Event)
Aug 26 10:25:04 user nova-compute[73572]: INFO nova.virt.libvirt.driver [-] [instance: 1f3db0fa-682c-4b33-966b-9e50b7349b6e] Instance running successfully.
Aug 26 10:25:04 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-aa258db8-159d-41f8-b21c-03b568328333 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] [instance: 1f3db0fa-682c-4b33-966b-9e50b7349b6e] Instance soft rebooted successfully.
Aug 26 10:25:04 user nova-compute[73572]: DEBUG nova.compute.manager [None req-aa258db8-159d-41f8-b21c-03b568328333 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] [instance: 1f3db0fa-682c-4b33-966b-9e50b7349b6e] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:25:04 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-53b6a152-23d8-4a36-bf48-51bfd4eae96b tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:25:04 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-53b6a152-23d8-4a36-bf48-51bfd4eae96b tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:25:04 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 1f3db0fa-682c-4b33-966b-9e50b7349b6e] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:25:04 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-53b6a152-23d8-4a36-bf48-51bfd4eae96b tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73572) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 10:25:04 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-53b6a152-23d8-4a36-bf48-51bfd4eae96b tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] CPU controller missing on host. {{(pid=73572) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 10:25:04 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-53b6a152-23d8-4a36-bf48-51bfd4eae96b tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73572) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 10:25:04 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-53b6a152-23d8-4a36-bf48-51bfd4eae96b tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] CPU controller found on host. {{(pid=73572) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 10:25:04 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-53b6a152-23d8-4a36-bf48-51bfd4eae96b tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73572) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 10:25:04 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-53b6a152-23d8-4a36-bf48-51bfd4eae96b tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T10:07:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T10:07:33Z,direct_url=<?>,disk_format='qcow2',id=299da0c9-e1c4-48f0-be55-fbe20dd06bc9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5c995f8bbbab4368b67a253e0df3971a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T10:07:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 10:25:04 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-53b6a152-23d8-4a36-bf48-51bfd4eae96b tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Flavor limits 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 10:25:04 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-53b6a152-23d8-4a36-bf48-51bfd4eae96b tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Image limits 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 10:25:04 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-53b6a152-23d8-4a36-bf48-51bfd4eae96b tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Flavor pref 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 10:25:04 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-53b6a152-23d8-4a36-bf48-51bfd4eae96b tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Image pref 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 10:25:04 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-53b6a152-23d8-4a36-bf48-51bfd4eae96b tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 10:25:04 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-53b6a152-23d8-4a36-bf48-51bfd4eae96b tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 10:25:04 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-53b6a152-23d8-4a36-bf48-51bfd4eae96b tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73572) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 10:25:04 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-53b6a152-23d8-4a36-bf48-51bfd4eae96b tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Got 1 possible topologies {{(pid=73572) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 10:25:04 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-53b6a152-23d8-4a36-bf48-51bfd4eae96b tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 10:25:04 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-53b6a152-23d8-4a36-bf48-51bfd4eae96b tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 10:25:04 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-53b6a152-23d8-4a36-bf48-51bfd4eae96b tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T10:25:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-665480809',display_name='tempest-tempest.common.compute-instance-665480809',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-665480809',id=35,image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO0nFuNIAmrcfF466dgWUoupbXiGxPDsRpOPU+BV/xU9so0Ahdwm8Jau8//ZWYq9Zw/pxbXy2f1pHOKtRMmBUc3daXPj1Sj1rpkWaf2AN4lE7ndY37vYFGh9kavZVJ2YNQ==',key_name='tempest-keypair-586663623',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7935bccc360b46b589fd57d53f334595',ramdisk_id='',reservation_id='r-2h5gmgf0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-203628695',owner_user_name='tempest-ServerActionsTestOtherA-203628695-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T10:25:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='61b6124f6f6e44c5b2fd0202a15da019',uuid=6b2d5f4e-37af-438c-859b-d4ca803b7d08,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bf886914-b734-4957-9e48-4ef3d65c61f4", "address": "fa:16:3e:b4:aa:52", "network": {"id": "43215883-3d00-4be7-8c40-bdaf3f01bef9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1088544153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7935bccc360b46b589fd57d53f334595", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf886914-b7", "ovs_interfaceid": "bf886914-b734-4957-9e48-4ef3d65c61f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73572) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 10:25:04 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-53b6a152-23d8-4a36-bf48-51bfd4eae96b tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Converting VIF {"id": "bf886914-b734-4957-9e48-4ef3d65c61f4", "address": "fa:16:3e:b4:aa:52", "network": {"id": "43215883-3d00-4be7-8c40-bdaf3f01bef9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1088544153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7935bccc360b46b589fd57d53f334595", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf886914-b7", "ovs_interfaceid": "bf886914-b734-4957-9e48-4ef3d65c61f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:25:04 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-53b6a152-23d8-4a36-bf48-51bfd4eae96b tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:aa:52,bridge_name='br-int',has_traffic_filtering=True,id=bf886914-b734-4957-9e48-4ef3d65c61f4,network=Network(43215883-3d00-4be7-8c40-bdaf3f01bef9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf886914-b7') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:25:04 user nova-compute[73572]: DEBUG nova.objects.instance [None req-53b6a152-23d8-4a36-bf48-51bfd4eae96b tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Lazy-loading 'pci_devices' on Instance uuid 6b2d5f4e-37af-438c-859b-d4ca803b7d08 {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:25:04 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-aa258db8-159d-41f8-b21c-03b568328333 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Lock "1f3db0fa-682c-4b33-966b-9e50b7349b6e" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.747s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:25:04 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-53b6a152-23d8-4a36-bf48-51bfd4eae96b tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] [instance: 6b2d5f4e-37af-438c-859b-d4ca803b7d08] End _get_guest_xml xml=<domain type="kvm">
Aug 26 10:25:04 user nova-compute[73572]:   <uuid>6b2d5f4e-37af-438c-859b-d4ca803b7d08</uuid>
Aug 26 10:25:04 user nova-compute[73572]:   <name>instance-00000023</name>
Aug 26 10:25:04 user nova-compute[73572]:   <memory>524288</memory>
Aug 26 10:25:04 user nova-compute[73572]:   <vcpu>1</vcpu>
Aug 26 10:25:04 user nova-compute[73572]:   <metadata>
Aug 26 10:25:04 user nova-compute[73572]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 10:25:04 user nova-compute[73572]:       <nova:package version="0.0.0"/>
Aug 26 10:25:04 user nova-compute[73572]:       <nova:name>tempest-tempest.common.compute-instance-665480809</nova:name>
Aug 26 10:25:04 user nova-compute[73572]:       <nova:creationTime>2023-08-26 10:25:04</nova:creationTime>
Aug 26 10:25:04 user nova-compute[73572]:       <nova:flavor name="m1.tiny">
Aug 26 10:25:04 user nova-compute[73572]:         <nova:memory>512</nova:memory>
Aug 26 10:25:04 user nova-compute[73572]:         <nova:disk>1</nova:disk>
Aug 26 10:25:04 user nova-compute[73572]:         <nova:swap>0</nova:swap>
Aug 26 10:25:04 user nova-compute[73572]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 10:25:04 user nova-compute[73572]:         <nova:vcpus>1</nova:vcpus>
Aug 26 10:25:04 user nova-compute[73572]:       </nova:flavor>
Aug 26 10:25:04 user nova-compute[73572]:       <nova:owner>
Aug 26 10:25:04 user nova-compute[73572]:         <nova:user uuid="61b6124f6f6e44c5b2fd0202a15da019">tempest-ServerActionsTestOtherA-203628695-project-member</nova:user>
Aug 26 10:25:04 user nova-compute[73572]:         <nova:project uuid="7935bccc360b46b589fd57d53f334595">tempest-ServerActionsTestOtherA-203628695</nova:project>
Aug 26 10:25:04 user nova-compute[73572]:       </nova:owner>
Aug 26 10:25:04 user nova-compute[73572]:       <nova:root type="image" uuid="299da0c9-e1c4-48f0-be55-fbe20dd06bc9"/>
Aug 26 10:25:04 user nova-compute[73572]:       <nova:ports>
Aug 26 10:25:04 user nova-compute[73572]:         <nova:port uuid="bf886914-b734-4957-9e48-4ef3d65c61f4">
Aug 26 10:25:04 user nova-compute[73572]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 26 10:25:04 user nova-compute[73572]:         </nova:port>
Aug 26 10:25:04 user nova-compute[73572]:       </nova:ports>
Aug 26 10:25:04 user nova-compute[73572]:     </nova:instance>
Aug 26 10:25:04 user nova-compute[73572]:   </metadata>
Aug 26 10:25:04 user nova-compute[73572]:   <sysinfo type="smbios">
Aug 26 10:25:04 user nova-compute[73572]:     <system>
Aug 26 10:25:04 user nova-compute[73572]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 10:25:04 user nova-compute[73572]:       <entry name="product">OpenStack Nova</entry>
Aug 26 10:25:04 user nova-compute[73572]:       <entry name="version">0.0.0</entry>
Aug 26 10:25:04 user nova-compute[73572]:       <entry name="serial">6b2d5f4e-37af-438c-859b-d4ca803b7d08</entry>
Aug 26 10:25:04 user nova-compute[73572]:       <entry name="uuid">6b2d5f4e-37af-438c-859b-d4ca803b7d08</entry>
Aug 26 10:25:04 user nova-compute[73572]:       <entry name="family">Virtual Machine</entry>
Aug 26 10:25:04 user nova-compute[73572]:     </system>
Aug 26 10:25:04 user nova-compute[73572]:   </sysinfo>
Aug 26 10:25:04 user nova-compute[73572]:   <os>
Aug 26 10:25:04 user nova-compute[73572]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 10:25:04 user nova-compute[73572]:     <boot dev="hd"/>
Aug 26 10:25:04 user nova-compute[73572]:     <smbios mode="sysinfo"/>
Aug 26 10:25:04 user nova-compute[73572]:   </os>
Aug 26 10:25:04 user nova-compute[73572]:   <features>
Aug 26 10:25:04 user nova-compute[73572]:     <acpi/>
Aug 26 10:25:04 user nova-compute[73572]:     <apic/>
Aug 26 10:25:04 user nova-compute[73572]:     <vmcoreinfo/>
Aug 26 10:25:04 user nova-compute[73572]:   </features>
Aug 26 10:25:04 user nova-compute[73572]:   <clock offset="utc">
Aug 26 10:25:04 user nova-compute[73572]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 10:25:04 user nova-compute[73572]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 10:25:04 user nova-compute[73572]:     <timer name="hpet" present="no"/>
Aug 26 10:25:04 user nova-compute[73572]:   </clock>
Aug 26 10:25:04 user nova-compute[73572]:   <cpu mode="custom" match="exact">
Aug 26 10:25:04 user nova-compute[73572]:     <model>Nehalem</model>
Aug 26 10:25:04 user nova-compute[73572]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 10:25:04 user nova-compute[73572]:   </cpu>
Aug 26 10:25:04 user nova-compute[73572]:   <devices>
Aug 26 10:25:04 user nova-compute[73572]:     <disk type="file" device="disk">
Aug 26 10:25:04 user nova-compute[73572]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 10:25:04 user nova-compute[73572]:       <source file="/opt/stack/data/nova/instances/6b2d5f4e-37af-438c-859b-d4ca803b7d08/disk"/>
Aug 26 10:25:04 user nova-compute[73572]:       <target dev="vda" bus="virtio"/>
Aug 26 10:25:04 user nova-compute[73572]:     </disk>
Aug 26 10:25:04 user nova-compute[73572]:     <interface type="ethernet">
Aug 26 10:25:04 user nova-compute[73572]:       <mac address="fa:16:3e:b4:aa:52"/>
Aug 26 10:25:04 user nova-compute[73572]:       <model type="virtio"/>
Aug 26 10:25:04 user nova-compute[73572]:       <mtu size="1442"/>
Aug 26 10:25:04 user nova-compute[73572]:       <target dev="tapbf886914-b7"/>
Aug 26 10:25:04 user nova-compute[73572]:     </interface>
Aug 26 10:25:04 user nova-compute[73572]:     <serial type="pty">
Aug 26 10:25:04 user nova-compute[73572]:       <log file="/opt/stack/data/nova/instances/6b2d5f4e-37af-438c-859b-d4ca803b7d08/console.log" append="off"/>
Aug 26 10:25:04 user nova-compute[73572]:     </serial>
Aug 26 10:25:04 user nova-compute[73572]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 10:25:04 user nova-compute[73572]:     <video>
Aug 26 10:25:04 user nova-compute[73572]:       <model type="virtio"/>
Aug 26 10:25:04 user nova-compute[73572]:     </video>
Aug 26 10:25:04 user nova-compute[73572]:     <rng model="virtio">
Aug 26 10:25:04 user nova-compute[73572]:       <backend model="random">/dev/urandom</backend>
Aug 26 10:25:04 user nova-compute[73572]:     </rng>
Aug 26 10:25:04 user nova-compute[73572]:     <controller type="usb" index="0" model="none"/>
Aug 26 10:25:04 user nova-compute[73572]:     <memballoon model="virtio">
Aug 26 10:25:04 user nova-compute[73572]:       <stats period="10"/>
Aug 26 10:25:04 user nova-compute[73572]:     </memballoon>
Aug 26 10:25:04 user nova-compute[73572]:   </devices>
Aug 26 10:25:04 user nova-compute[73572]: </domain>
Aug 26 10:25:04 user nova-compute[73572]:  {{(pid=73572) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 10:25:04 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-53b6a152-23d8-4a36-bf48-51bfd4eae96b tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T10:25:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-665480809',display_name='tempest-tempest.common.compute-instance-665480809',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-665480809',id=35,image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO0nFuNIAmrcfF466dgWUoupbXiGxPDsRpOPU+BV/xU9so0Ahdwm8Jau8//ZWYq9Zw/pxbXy2f1pHOKtRMmBUc3daXPj1Sj1rpkWaf2AN4lE7ndY37vYFGh9kavZVJ2YNQ==',key_name='tempest-keypair-586663623',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7935bccc360b46b589fd57d53f334595',ramdisk_id='',reservation_id='r-2h5gmgf0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-203628695',owner_user_name='tempest-ServerActionsTestOtherA-203628695-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T10:25:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='61b6124f6f6e44c5b2fd0202a15da019',uuid=6b2d5f4e-37af-438c-859b-d4ca803b7d08,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bf886914-b734-4957-9e48-4ef3d65c61f4", "address": "fa:16:3e:b4:aa:52", "network": {"id": "43215883-3d00-4be7-8c40-bdaf3f01bef9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1088544153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7935bccc360b46b589fd57d53f334595", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf886914-b7", "ovs_interfaceid": "bf886914-b734-4957-9e48-4ef3d65c61f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 10:25:04 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-53b6a152-23d8-4a36-bf48-51bfd4eae96b tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Converting VIF {"id": "bf886914-b734-4957-9e48-4ef3d65c61f4", "address": "fa:16:3e:b4:aa:52", "network": {"id": "43215883-3d00-4be7-8c40-bdaf3f01bef9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1088544153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7935bccc360b46b589fd57d53f334595", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf886914-b7", "ovs_interfaceid": "bf886914-b734-4957-9e48-4ef3d65c61f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:25:04 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-53b6a152-23d8-4a36-bf48-51bfd4eae96b tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:aa:52,bridge_name='br-int',has_traffic_filtering=True,id=bf886914-b734-4957-9e48-4ef3d65c61f4,network=Network(43215883-3d00-4be7-8c40-bdaf3f01bef9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf886914-b7') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:25:04 user nova-compute[73572]: DEBUG os_vif [None req-53b6a152-23d8-4a36-bf48-51bfd4eae96b tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:aa:52,bridge_name='br-int',has_traffic_filtering=True,id=bf886914-b734-4957-9e48-4ef3d65c61f4,network=Network(43215883-3d00-4be7-8c40-bdaf3f01bef9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf886914-b7') {{(pid=73572) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 10:25:04 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 1f3db0fa-682c-4b33-966b-9e50b7349b6e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=73572) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 10:25:04 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:25:04 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:25:04 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 10:25:04 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:25:04 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbf886914-b7, may_exist=True, interface_attrs={}) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:25:04 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapbf886914-b7, col_values=(('external_ids', {'iface-id': 'bf886914-b734-4957-9e48-4ef3d65c61f4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b4:aa:52', 'vm-uuid': '6b2d5f4e-37af-438c-859b-d4ca803b7d08'}),), if_exists=True) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:25:04 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:25:04 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:25:04 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:25:04 user nova-compute[73572]: INFO os_vif [None req-53b6a152-23d8-4a36-bf48-51bfd4eae96b tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:aa:52,bridge_name='br-int',has_traffic_filtering=True,id=bf886914-b734-4957-9e48-4ef3d65c61f4,network=Network(43215883-3d00-4be7-8c40-bdaf3f01bef9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf886914-b7')
Aug 26 10:25:04 user nova-compute[73572]: DEBUG nova.virt.driver [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Emitting event <LifecycleEvent: 1693045503.9843292, 1f3db0fa-682c-4b33-966b-9e50b7349b6e => Started> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:25:04 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 1f3db0fa-682c-4b33-966b-9e50b7349b6e] VM Started (Lifecycle Event)
Aug 26 10:25:04 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 1f3db0fa-682c-4b33-966b-9e50b7349b6e] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:25:04 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 1f3db0fa-682c-4b33-966b-9e50b7349b6e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73572) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 10:25:04 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-53b6a152-23d8-4a36-bf48-51bfd4eae96b tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] No BDM found with device name vda, not building metadata. {{(pid=73572) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 10:25:04 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-53b6a152-23d8-4a36-bf48-51bfd4eae96b tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] No VIF found with MAC fa:16:3e:b4:aa:52, not building metadata {{(pid=73572) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 10:25:04 user nova-compute[73572]: DEBUG nova.network.neutron [req-e9e122b9-707b-4974-9b68-5da31c0a2abe req-759b9f2d-f43a-430b-8178-118a5e874fa2 service nova] [instance: 6b2d5f4e-37af-438c-859b-d4ca803b7d08] Updated VIF entry in instance network info cache for port bf886914-b734-4957-9e48-4ef3d65c61f4. {{(pid=73572) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 10:25:04 user nova-compute[73572]: DEBUG nova.network.neutron [req-e9e122b9-707b-4974-9b68-5da31c0a2abe req-759b9f2d-f43a-430b-8178-118a5e874fa2 service nova] [instance: 6b2d5f4e-37af-438c-859b-d4ca803b7d08] Updating instance_info_cache with network_info: [{"id": "bf886914-b734-4957-9e48-4ef3d65c61f4", "address": "fa:16:3e:b4:aa:52", "network": {"id": "43215883-3d00-4be7-8c40-bdaf3f01bef9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1088544153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7935bccc360b46b589fd57d53f334595", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf886914-b7", "ovs_interfaceid": "bf886914-b734-4957-9e48-4ef3d65c61f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:25:04 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-e9e122b9-707b-4974-9b68-5da31c0a2abe req-759b9f2d-f43a-430b-8178-118a5e874fa2 service nova] Releasing lock "refresh_cache-6b2d5f4e-37af-438c-859b-d4ca803b7d08" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:25:05 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:25:05 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:25:05 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:25:05 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:25:05 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:25:05 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:25:05 user nova-compute[73572]: DEBUG nova.compute.manager [req-fca9a58c-f8f7-4b3a-8ae9-a865b796ac46 req-a68e61bb-1583-448f-aa11-b38e48230c1b service nova] [instance: 6b2d5f4e-37af-438c-859b-d4ca803b7d08] Received event network-vif-plugged-bf886914-b734-4957-9e48-4ef3d65c61f4 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:25:05 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-fca9a58c-f8f7-4b3a-8ae9-a865b796ac46 req-a68e61bb-1583-448f-aa11-b38e48230c1b service nova] Acquiring lock "6b2d5f4e-37af-438c-859b-d4ca803b7d08-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:25:05 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-fca9a58c-f8f7-4b3a-8ae9-a865b796ac46 req-a68e61bb-1583-448f-aa11-b38e48230c1b service nova] Lock "6b2d5f4e-37af-438c-859b-d4ca803b7d08-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:25:05 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-fca9a58c-f8f7-4b3a-8ae9-a865b796ac46 req-a68e61bb-1583-448f-aa11-b38e48230c1b service nova] Lock "6b2d5f4e-37af-438c-859b-d4ca803b7d08-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:25:05 user nova-compute[73572]: DEBUG nova.compute.manager [req-fca9a58c-f8f7-4b3a-8ae9-a865b796ac46 req-a68e61bb-1583-448f-aa11-b38e48230c1b service nova] [instance: 6b2d5f4e-37af-438c-859b-d4ca803b7d08] No waiting events found dispatching network-vif-plugged-bf886914-b734-4957-9e48-4ef3d65c61f4 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:25:05 user nova-compute[73572]: WARNING nova.compute.manager [req-fca9a58c-f8f7-4b3a-8ae9-a865b796ac46 req-a68e61bb-1583-448f-aa11-b38e48230c1b service nova] [instance: 6b2d5f4e-37af-438c-859b-d4ca803b7d08] Received unexpected event network-vif-plugged-bf886914-b734-4957-9e48-4ef3d65c61f4 for instance with vm_state building and task_state spawning.
Aug 26 10:25:06 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-7fa403d4-ab32-4072-9e63-e6e20d88860a tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Acquiring lock "44a737bf-3704-4193-8d24-b8d132267279" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:25:06 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-7fa403d4-ab32-4072-9e63-e6e20d88860a tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Lock "44a737bf-3704-4193-8d24-b8d132267279" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:25:06 user nova-compute[73572]: INFO nova.compute.manager [None req-7fa403d4-ab32-4072-9e63-e6e20d88860a tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] [instance: 44a737bf-3704-4193-8d24-b8d132267279] Detaching volume 19c2d1dd-dfb9-4ac0-8341-35f96b7ade56
Aug 26 10:25:06 user nova-compute[73572]: INFO nova.virt.block_device [None req-7fa403d4-ab32-4072-9e63-e6e20d88860a tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] [instance: 44a737bf-3704-4193-8d24-b8d132267279] Attempting to driver detach volume 19c2d1dd-dfb9-4ac0-8341-35f96b7ade56 from mountpoint /dev/vdb
Aug 26 10:25:06 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-7fa403d4-ab32-4072-9e63-e6e20d88860a tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Attempting to detach device vdb from instance 44a737bf-3704-4193-8d24-b8d132267279 from the persistent domain config. {{(pid=73572) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 10:25:06 user nova-compute[73572]: DEBUG nova.virt.libvirt.guest [None req-7fa403d4-ab32-4072-9e63-e6e20d88860a tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 10:25:06 user nova-compute[73572]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 10:25:06 user nova-compute[73572]:   <source dev="/dev/sdd"/>
Aug 26 10:25:06 user nova-compute[73572]:   <target dev="vdb" bus="virtio"/>
Aug 26 10:25:06 user nova-compute[73572]:   <serial>19c2d1dd-dfb9-4ac0-8341-35f96b7ade56</serial>
Aug 26 10:25:06 user nova-compute[73572]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 10:25:06 user nova-compute[73572]: </disk>
Aug 26 10:25:06 user nova-compute[73572]:  {{(pid=73572) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 10:25:06 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-7fa403d4-ab32-4072-9e63-e6e20d88860a tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Successfully detached device vdb from instance 44a737bf-3704-4193-8d24-b8d132267279 from the persistent domain config.
Aug 26 10:25:06 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-7fa403d4-ab32-4072-9e63-e6e20d88860a tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 44a737bf-3704-4193-8d24-b8d132267279 from the live domain config. {{(pid=73572) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 10:25:06 user nova-compute[73572]: DEBUG nova.virt.libvirt.guest [None req-7fa403d4-ab32-4072-9e63-e6e20d88860a tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 10:25:06 user nova-compute[73572]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 10:25:06 user nova-compute[73572]:   <source dev="/dev/sdd"/>
Aug 26 10:25:06 user nova-compute[73572]:   <target dev="vdb" bus="virtio"/>
Aug 26 10:25:06 user nova-compute[73572]:   <serial>19c2d1dd-dfb9-4ac0-8341-35f96b7ade56</serial>
Aug 26 10:25:06 user nova-compute[73572]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 10:25:06 user nova-compute[73572]: </disk>
Aug 26 10:25:06 user nova-compute[73572]:  {{(pid=73572) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 10:25:07 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Received event <DeviceRemovedEvent: 1693045507.3052628, 44a737bf-3704-4193-8d24-b8d132267279 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73572) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 10:25:07 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-7fa403d4-ab32-4072-9e63-e6e20d88860a tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 44a737bf-3704-4193-8d24-b8d132267279 {{(pid=73572) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 10:25:07 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-7fa403d4-ab32-4072-9e63-e6e20d88860a tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Successfully detached device vdb from instance 44a737bf-3704-4193-8d24-b8d132267279 from the live domain config.
Aug 26 10:25:07 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7fa403d4-ab32-4072-9e63-e6e20d88860a tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] [instance: 44a737bf-3704-4193-8d24-b8d132267279] calling os-brick to detach iSCSI Volume {{(pid=73572) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 10:25:07 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fa403d4-ab32-4072-9e63-e6e20d88860a tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc89c3d6a10>, {'target_iqns': ['iqn.2010-10.org.openstack:19c2d1dd-dfb9-4ac0-8341-35f96b7ade56'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AjXYIwZy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 10:25:07 user nova-compute[73572]: WARNING os_brick.initiator.connectors.base [None req-7fa403d4-ab32-4072-9e63-e6e20d88860a tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 10:25:07 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-7fa403d4-ab32-4072-9e63-e6e20d88860a tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 10:25:07 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-7fa403d4-ab32-4072-9e63-e6e20d88860a tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 10:25:07 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fa403d4-ab32-4072-9e63-e6e20d88860a tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:19c2d1dd-dfb9-4ac0-8341-35f96b7ade56', 0)] {{(pid=73572) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 10:25:07 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:25:07 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:25:07 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[981d313c-9b08-4575-ba0d-99905e614b34]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:133098b2-106a-427f-aa6d-2c10625dd152\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:19c2d1dd-dfb9-4ac0-8341-35f96b7ade56\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9dbf6103-5796-4273-a8a9-81d262560347\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dc0a3246-82a0-4d2f-9877-8a072dccf064\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:25:07 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:25:07 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:25:07 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[525cd953-76aa-4115-a141-aff54037c4eb]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19c2d1dd-dfb9-4ac0-8341-35f96b7ade56 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dbf6103-5796-4273-a8a9-81d262560347 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133098b2-106a-427f-aa6d-2c10625dd152 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc0a3246-82a0-4d2f-9877-8a072dccf064 (non-flash)\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:25:07 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fa403d4-ab32-4072-9e63-e6e20d88860a tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)
Aug 26 10:25:07 user nova-compute[73572]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19c2d1dd-dfb9-4ac0-8341-35f96b7ade56 (non-flash)
Aug 26 10:25:07 user nova-compute[73572]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dbf6103-5796-4273-a8a9-81d262560347 (non-flash)
Aug 26 10:25:07 user nova-compute[73572]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133098b2-106a-427f-aa6d-2c10625dd152 (non-flash)
Aug 26 10:25:07 user nova-compute[73572]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc0a3246-82a0-4d2f-9877-8a072dccf064 (non-flash)
Aug 26 10:25:07 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 10:25:07 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fa403d4-ab32-4072-9e63-e6e20d88860a tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)
Aug 26 10:25:07 user nova-compute[73572]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19c2d1dd-dfb9-4ac0-8341-35f96b7ade56 (non-flash)
Aug 26 10:25:07 user nova-compute[73572]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dbf6103-5796-4273-a8a9-81d262560347 (non-flash)
Aug 26 10:25:07 user nova-compute[73572]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133098b2-106a-427f-aa6d-2c10625dd152 (non-flash)
Aug 26 10:25:07 user nova-compute[73572]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc0a3246-82a0-4d2f-9877-8a072dccf064 (non-flash)
Aug 26 10:25:07 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 10:25:07 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fa403d4-ab32-4072-9e63-e6e20d88860a tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc89c5b0550>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:19c2d1dd-dfb9-4ac0-8341-35f96b7ade56'): ({'sdd'}, set())}) {{(pid=73572) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 10:25:07 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-7fa403d4-ab32-4072-9e63-e6e20d88860a tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Removing single pathed devices sdd {{(pid=73572) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 10:25:07 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:25:07 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:25:07 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d1ddd93-73c8-49eb-970e-8290ac5799e1]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:25:07 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:25:07 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:25:07 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a28ddf7-5357-449e-a067-38bd8b56b14d]: (4, ('ok\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:25:07 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-7fa403d4-ab32-4072-9e63-e6e20d88860a tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Flushing IO for device /dev/sdd {{(pid=73572) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 10:25:07 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:25:07 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:25:07 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc043ba2-a9cd-4809-a9e1-12d95f69897d]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:25:07 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-7fa403d4-ab32-4072-9e63-e6e20d88860a tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73572) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 10:25:07 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:25:07 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.036s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:25:07 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e84eb12-801f-4587-88ea-4c01cbd4c636]: (4, ('1', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:25:07 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-7fa403d4-ab32-4072-9e63-e6e20d88860a tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73572) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 10:25:07 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-7fa403d4-ab32-4072-9e63-e6e20d88860a tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] SCSI volumes sdd have been removed. {{(pid=73572) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 10:25:07 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fa403d4-ab32-4072-9e63-e6e20d88860a tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:19c2d1dd-dfb9-4ac0-8341-35f96b7ade56')] {{(pid=73572) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 10:25:07 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19c2d1dd-dfb9-4ac0-8341-35f96b7ade56 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:25:07 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19c2d1dd-dfb9-4ac0-8341-35f96b7ade56 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:25:07 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[19989f24-e0bc-4e6b-b903-36a7508d9bd3]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:25:07 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fa403d4-ab32-4072-9e63-e6e20d88860a tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:25:07 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19c2d1dd-dfb9-4ac0-8341-35f96b7ade56 -p 172.16.0.220:3260 --logout {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:25:07 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19c2d1dd-dfb9-4ac0-8341-35f96b7ade56 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:25:07 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[46db37e7-9be7-410e-bb60-f071266dbf8d]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:19c2d1dd-dfb9-4ac0-8341-35f96b7ade56, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:19c2d1dd-dfb9-4ac0-8341-35f96b7ade56, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:25:07 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fa403d4-ab32-4072-9e63-e6e20d88860a tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:19c2d1dd-dfb9-4ac0-8341-35f96b7ade56, portal: 172.16.0.220,3260]
Aug 26 10:25:07 user nova-compute[73572]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:19c2d1dd-dfb9-4ac0-8341-35f96b7ade56, portal: 172.16.0.220,3260] successful.
Aug 26 10:25:07 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:25:07 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19c2d1dd-dfb9-4ac0-8341-35f96b7ade56 -p 172.16.0.220:3260 --op delete {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:25:07 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19c2d1dd-dfb9-4ac0-8341-35f96b7ade56 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:25:07 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[8334201d-36bf-4332-b087-3b639a7aa72e]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:25:07 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fa403d4-ab32-4072-9e63-e6e20d88860a tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:25:07 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-7fa403d4-ab32-4072-9e63-e6e20d88860a tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.289s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 10:25:07 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fa403d4-ab32-4072-9e63-e6e20d88860a tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] <== disconnect_volume: return (290ms) None {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 10:25:07 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7fa403d4-ab32-4072-9e63-e6e20d88860a tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] [instance: 44a737bf-3704-4193-8d24-b8d132267279] Disconnected iSCSI Volume {{(pid=73572) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 10:25:07 user nova-compute[73572]: DEBUG nova.virt.driver [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Emitting event <LifecycleEvent: 1693045507.692607, 6b2d5f4e-37af-438c-859b-d4ca803b7d08 => Resumed> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:25:07 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 6b2d5f4e-37af-438c-859b-d4ca803b7d08] VM Resumed (Lifecycle Event)
Aug 26 10:25:07 user nova-compute[73572]: DEBUG nova.compute.manager [None req-53b6a152-23d8-4a36-bf48-51bfd4eae96b tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] [instance: 6b2d5f4e-37af-438c-859b-d4ca803b7d08] Instance event wait completed in 0 seconds for  {{(pid=73572) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 10:25:07 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-53b6a152-23d8-4a36-bf48-51bfd4eae96b tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] [instance: 6b2d5f4e-37af-438c-859b-d4ca803b7d08] Guest created on hypervisor {{(pid=73572) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 10:25:07 user nova-compute[73572]: INFO nova.virt.libvirt.driver [-] [instance: 6b2d5f4e-37af-438c-859b-d4ca803b7d08] Instance spawned successfully.
Aug 26 10:25:07 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-53b6a152-23d8-4a36-bf48-51bfd4eae96b tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] [instance: 6b2d5f4e-37af-438c-859b-d4ca803b7d08] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 10:25:07 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 6b2d5f4e-37af-438c-859b-d4ca803b7d08] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:25:07 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-53b6a152-23d8-4a36-bf48-51bfd4eae96b tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] [instance: 6b2d5f4e-37af-438c-859b-d4ca803b7d08] Found default for hw_cdrom_bus of ide {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:25:07 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-53b6a152-23d8-4a36-bf48-51bfd4eae96b tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] [instance: 6b2d5f4e-37af-438c-859b-d4ca803b7d08] Found default for hw_disk_bus of virtio {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:25:07 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-53b6a152-23d8-4a36-bf48-51bfd4eae96b tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] [instance: 6b2d5f4e-37af-438c-859b-d4ca803b7d08] Found default for hw_input_bus of None {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:25:07 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-53b6a152-23d8-4a36-bf48-51bfd4eae96b tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] [instance: 6b2d5f4e-37af-438c-859b-d4ca803b7d08] Found default for hw_pointer_model of None {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:25:07 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-53b6a152-23d8-4a36-bf48-51bfd4eae96b tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] [instance: 6b2d5f4e-37af-438c-859b-d4ca803b7d08] Found default for hw_video_model of virtio {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:25:07 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-53b6a152-23d8-4a36-bf48-51bfd4eae96b tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] [instance: 6b2d5f4e-37af-438c-859b-d4ca803b7d08] Found default for hw_vif_model of virtio {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:25:07 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 6b2d5f4e-37af-438c-859b-d4ca803b7d08] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73572) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 10:25:07 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 6b2d5f4e-37af-438c-859b-d4ca803b7d08] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 10:25:07 user nova-compute[73572]: DEBUG nova.virt.driver [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Emitting event <LifecycleEvent: 1693045507.6938279, 6b2d5f4e-37af-438c-859b-d4ca803b7d08 => Started> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:25:07 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 6b2d5f4e-37af-438c-859b-d4ca803b7d08] VM Started (Lifecycle Event)
Aug 26 10:25:07 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 6b2d5f4e-37af-438c-859b-d4ca803b7d08] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:25:07 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 6b2d5f4e-37af-438c-859b-d4ca803b7d08] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73572) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 10:25:07 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 6b2d5f4e-37af-438c-859b-d4ca803b7d08] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 10:25:07 user nova-compute[73572]: INFO nova.compute.manager [None req-53b6a152-23d8-4a36-bf48-51bfd4eae96b tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] [instance: 6b2d5f4e-37af-438c-859b-d4ca803b7d08] Took 6.00 seconds to spawn the instance on the hypervisor.
Aug 26 10:25:07 user nova-compute[73572]: DEBUG nova.compute.manager [None req-53b6a152-23d8-4a36-bf48-51bfd4eae96b tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] [instance: 6b2d5f4e-37af-438c-859b-d4ca803b7d08] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:25:07 user nova-compute[73572]: DEBUG nova.compute.manager [req-4e3500fc-8852-4276-8a50-c84b1d30af41 req-2659fa72-9dc2-4926-bac3-cf3cbac12aa8 service nova] [instance: 6b2d5f4e-37af-438c-859b-d4ca803b7d08] Received event network-vif-plugged-bf886914-b734-4957-9e48-4ef3d65c61f4 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:25:07 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-4e3500fc-8852-4276-8a50-c84b1d30af41 req-2659fa72-9dc2-4926-bac3-cf3cbac12aa8 service nova] Acquiring lock "6b2d5f4e-37af-438c-859b-d4ca803b7d08-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:25:07 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-4e3500fc-8852-4276-8a50-c84b1d30af41 req-2659fa72-9dc2-4926-bac3-cf3cbac12aa8 service nova] Lock "6b2d5f4e-37af-438c-859b-d4ca803b7d08-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:25:07 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-4e3500fc-8852-4276-8a50-c84b1d30af41 req-2659fa72-9dc2-4926-bac3-cf3cbac12aa8 service nova] Lock "6b2d5f4e-37af-438c-859b-d4ca803b7d08-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:25:07 user nova-compute[73572]: DEBUG nova.compute.manager [req-4e3500fc-8852-4276-8a50-c84b1d30af41 req-2659fa72-9dc2-4926-bac3-cf3cbac12aa8 service nova] [instance: 6b2d5f4e-37af-438c-859b-d4ca803b7d08] No waiting events found dispatching network-vif-plugged-bf886914-b734-4957-9e48-4ef3d65c61f4 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:25:07 user nova-compute[73572]: WARNING nova.compute.manager [req-4e3500fc-8852-4276-8a50-c84b1d30af41 req-2659fa72-9dc2-4926-bac3-cf3cbac12aa8 service nova] [instance: 6b2d5f4e-37af-438c-859b-d4ca803b7d08] Received unexpected event network-vif-plugged-bf886914-b734-4957-9e48-4ef3d65c61f4 for instance with vm_state building and task_state spawning.
Aug 26 10:25:07 user nova-compute[73572]: INFO nova.compute.manager [None req-53b6a152-23d8-4a36-bf48-51bfd4eae96b tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] [instance: 6b2d5f4e-37af-438c-859b-d4ca803b7d08] Took 6.91 seconds to build instance.
Aug 26 10:25:07 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-53b6a152-23d8-4a36-bf48-51bfd4eae96b tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Lock "6b2d5f4e-37af-438c-859b-d4ca803b7d08" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.999s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:25:08 user nova-compute[73572]: DEBUG nova.objects.instance [None req-7fa403d4-ab32-4072-9e63-e6e20d88860a tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Lazy-loading 'flavor' on Instance uuid 44a737bf-3704-4193-8d24-b8d132267279 {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:25:08 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-7fa403d4-ab32-4072-9e63-e6e20d88860a tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Lock "44a737bf-3704-4193-8d24-b8d132267279" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.785s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:25:08 user nova-compute[73572]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693045493.7458389, 00c47a06-2bf8-427d-bcb1-304688584511 => Stopped> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:25:08 user nova-compute[73572]: INFO nova.compute.manager [-] [instance: 00c47a06-2bf8-427d-bcb1-304688584511] VM Stopped (Lifecycle Event)
Aug 26 10:25:08 user nova-compute[73572]: DEBUG nova.compute.manager [None req-6711def4-b92c-47f5-a7e2-2610f0026d65 None None] [instance: 00c47a06-2bf8-427d-bcb1-304688584511] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:25:09 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:25:10 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:25:14 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:25:15 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-d0bccd48-5d04-40c3-a068-8918e5594d95 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Acquiring lock "0f46f84e-9cda-4450-a8a1-f6c08956324b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:25:15 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-d0bccd48-5d04-40c3-a068-8918e5594d95 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Lock "0f46f84e-9cda-4450-a8a1-f6c08956324b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:25:15 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-d0bccd48-5d04-40c3-a068-8918e5594d95 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Acquiring lock "0f46f84e-9cda-4450-a8a1-f6c08956324b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:25:15 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-d0bccd48-5d04-40c3-a068-8918e5594d95 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Lock "0f46f84e-9cda-4450-a8a1-f6c08956324b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:25:15 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-d0bccd48-5d04-40c3-a068-8918e5594d95 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Lock "0f46f84e-9cda-4450-a8a1-f6c08956324b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:25:15 user nova-compute[73572]: INFO nova.compute.manager [None req-d0bccd48-5d04-40c3-a068-8918e5594d95 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 0f46f84e-9cda-4450-a8a1-f6c08956324b] Terminating instance
Aug 26 10:25:15 user nova-compute[73572]: DEBUG nova.compute.manager [None req-d0bccd48-5d04-40c3-a068-8918e5594d95 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 0f46f84e-9cda-4450-a8a1-f6c08956324b] Start destroying the instance on the hypervisor. {{(pid=73572) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 10:25:15 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:25:15 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:25:15 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:25:15 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:25:15 user nova-compute[73572]: DEBUG nova.compute.manager [req-8dddb32d-bc02-4387-851e-c0ef7999026b req-29667d79-1392-4af3-b690-b5cdff4958ba service nova] [instance: 0f46f84e-9cda-4450-a8a1-f6c08956324b] Received event network-vif-unplugged-b4dfa21c-473c-4801-ae7a-aac3ac21b655 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:25:15 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-8dddb32d-bc02-4387-851e-c0ef7999026b req-29667d79-1392-4af3-b690-b5cdff4958ba service nova] Acquiring lock "0f46f84e-9cda-4450-a8a1-f6c08956324b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:25:15 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-8dddb32d-bc02-4387-851e-c0ef7999026b req-29667d79-1392-4af3-b690-b5cdff4958ba service nova] Lock "0f46f84e-9cda-4450-a8a1-f6c08956324b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:25:15 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-8dddb32d-bc02-4387-851e-c0ef7999026b req-29667d79-1392-4af3-b690-b5cdff4958ba service nova] Lock "0f46f84e-9cda-4450-a8a1-f6c08956324b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:25:15 user nova-compute[73572]: DEBUG nova.compute.manager [req-8dddb32d-bc02-4387-851e-c0ef7999026b req-29667d79-1392-4af3-b690-b5cdff4958ba service nova] [instance: 0f46f84e-9cda-4450-a8a1-f6c08956324b] No waiting events found dispatching network-vif-unplugged-b4dfa21c-473c-4801-ae7a-aac3ac21b655 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:25:15 user nova-compute[73572]: DEBUG nova.compute.manager [req-8dddb32d-bc02-4387-851e-c0ef7999026b req-29667d79-1392-4af3-b690-b5cdff4958ba service nova] [instance: 0f46f84e-9cda-4450-a8a1-f6c08956324b] Received event network-vif-unplugged-b4dfa21c-473c-4801-ae7a-aac3ac21b655 for instance with task_state deleting. {{(pid=73572) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 10:25:15 user nova-compute[73572]: INFO nova.virt.libvirt.driver [-] [instance: 0f46f84e-9cda-4450-a8a1-f6c08956324b] Instance destroyed successfully.
Aug 26 10:25:15 user nova-compute[73572]: DEBUG nova.objects.instance [None req-d0bccd48-5d04-40c3-a068-8918e5594d95 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Lazy-loading 'resources' on Instance uuid 0f46f84e-9cda-4450-a8a1-f6c08956324b {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:25:15 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-d0bccd48-5d04-40c3-a068-8918e5594d95 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T10:23:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1558485664',display_name='tempest-TestVolumeBootPattern-server-1558485664',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1558485664',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T10:23:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cfc130586d9f4581953f1b8ae1c4465e',ramdisk_id='',reservation_id='r-0v3nuzh2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-73786062',owner_user_name='tempest-TestVolumeBootPattern-73786062-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T10:23:47Z,user_data=None,user_id='e1e80942e5db41c782bda686b10e2e4b',uuid=0f46f84e-9cda-4450-a8a1-f6c08956324b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b4dfa21c-473c-4801-ae7a-aac3ac21b655", "address": "fa:16:3e:1e:fd:c8", "network": {"id": "c520ee18-34a7-4781-bc97-419e9a702d40", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-280196989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfc130586d9f4581953f1b8ae1c4465e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4dfa21c-47", "ovs_interfaceid": "b4dfa21c-473c-4801-ae7a-aac3ac21b655", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 10:25:15 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-d0bccd48-5d04-40c3-a068-8918e5594d95 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Converting VIF {"id": "b4dfa21c-473c-4801-ae7a-aac3ac21b655", "address": "fa:16:3e:1e:fd:c8", "network": {"id": "c520ee18-34a7-4781-bc97-419e9a702d40", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-280196989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfc130586d9f4581953f1b8ae1c4465e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4dfa21c-47", "ovs_interfaceid": "b4dfa21c-473c-4801-ae7a-aac3ac21b655", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:25:15 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-d0bccd48-5d04-40c3-a068-8918e5594d95 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:fd:c8,bridge_name='br-int',has_traffic_filtering=True,id=b4dfa21c-473c-4801-ae7a-aac3ac21b655,network=Network(c520ee18-34a7-4781-bc97-419e9a702d40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4dfa21c-47') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:25:15 user nova-compute[73572]: DEBUG os_vif [None req-d0bccd48-5d04-40c3-a068-8918e5594d95 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:fd:c8,bridge_name='br-int',has_traffic_filtering=True,id=b4dfa21c-473c-4801-ae7a-aac3ac21b655,network=Network(c520ee18-34a7-4781-bc97-419e9a702d40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4dfa21c-47') {{(pid=73572) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 10:25:15 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:25:15 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb4dfa21c-47, bridge=br-int, if_exists=True) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:25:15 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:25:15 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:25:15 user nova-compute[73572]: INFO os_vif [None req-d0bccd48-5d04-40c3-a068-8918e5594d95 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:fd:c8,bridge_name='br-int',has_traffic_filtering=True,id=b4dfa21c-473c-4801-ae7a-aac3ac21b655,network=Network(c520ee18-34a7-4781-bc97-419e9a702d40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4dfa21c-47')
Aug 26 10:25:15 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d0bccd48-5d04-40c3-a068-8918e5594d95 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 0f46f84e-9cda-4450-a8a1-f6c08956324b] calling os-brick to detach iSCSI Volume {{(pid=73572) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 10:25:15 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0bccd48-5d04-40c3-a068-8918e5594d95 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc89c3d6a10>, {'target_iqns': ['iqn.2010-10.org.openstack:9dbf6103-5796-4273-a8a9-81d262560347'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZpoyDOed', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 10:25:15 user nova-compute[73572]: WARNING os_brick.initiator.connectors.base [None req-d0bccd48-5d04-40c3-a068-8918e5594d95 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 10:25:15 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-d0bccd48-5d04-40c3-a068-8918e5594d95 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 10:25:15 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-d0bccd48-5d04-40c3-a068-8918e5594d95 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 10:25:15 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0bccd48-5d04-40c3-a068-8918e5594d95 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9dbf6103-5796-4273-a8a9-81d262560347', 0)] {{(pid=73572) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 10:25:15 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:25:15 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:25:15 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1d7855a-a6e3-404d-96e0-ecc15faeb243]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:133098b2-106a-427f-aa6d-2c10625dd152\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9dbf6103-5796-4273-a8a9-81d262560347\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dc0a3246-82a0-4d2f-9877-8a072dccf064\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:25:15 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:25:16 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:25:16 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[dee3de3a-eb69-4081-9aeb-38a6afb42741]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dbf6103-5796-4273-a8a9-81d262560347 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133098b2-106a-427f-aa6d-2c10625dd152 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc0a3246-82a0-4d2f-9877-8a072dccf064 (non-flash)\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:25:16 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0bccd48-5d04-40c3-a068-8918e5594d95 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)
Aug 26 10:25:16 user nova-compute[73572]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dbf6103-5796-4273-a8a9-81d262560347 (non-flash)
Aug 26 10:25:16 user nova-compute[73572]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133098b2-106a-427f-aa6d-2c10625dd152 (non-flash)
Aug 26 10:25:16 user nova-compute[73572]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc0a3246-82a0-4d2f-9877-8a072dccf064 (non-flash)
Aug 26 10:25:16 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 10:25:16 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0bccd48-5d04-40c3-a068-8918e5594d95 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)
Aug 26 10:25:16 user nova-compute[73572]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dbf6103-5796-4273-a8a9-81d262560347 (non-flash)
Aug 26 10:25:16 user nova-compute[73572]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133098b2-106a-427f-aa6d-2c10625dd152 (non-flash)
Aug 26 10:25:16 user nova-compute[73572]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc0a3246-82a0-4d2f-9877-8a072dccf064 (non-flash)
Aug 26 10:25:16 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 10:25:16 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0bccd48-5d04-40c3-a068-8918e5594d95 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc89c56bbe0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9dbf6103-5796-4273-a8a9-81d262560347'): ({'sdc'}, set())}) {{(pid=73572) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 10:25:16 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-d0bccd48-5d04-40c3-a068-8918e5594d95 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Removing single pathed devices sdc {{(pid=73572) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 10:25:16 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:25:16 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:25:16 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[48941e12-3c9a-49dc-b6ed-c13a1881626d]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:25:16 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:25:16 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:25:16 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fc7ce02-de49-41f0-bae0-f640d3126a00]: (4, ('ok\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:25:16 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-d0bccd48-5d04-40c3-a068-8918e5594d95 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Flushing IO for device /dev/sdc {{(pid=73572) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 10:25:16 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:25:16 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:25:16 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[d140ac8f-8be0-46b5-8a57-5c4778b1efe3]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:25:16 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-d0bccd48-5d04-40c3-a068-8918e5594d95 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73572) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 10:25:16 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:25:16 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.047s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:25:16 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f5a5ed5-858c-4f0e-a93d-09d4d67cfe77]: (4, ('1', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:25:16 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-d0bccd48-5d04-40c3-a068-8918e5594d95 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73572) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 10:25:16 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-d0bccd48-5d04-40c3-a068-8918e5594d95 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] SCSI volumes sdc have been removed. {{(pid=73572) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 10:25:16 user nova-compute[73572]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_195e6236', '/dev/disk/by-id/scsi-1SCST_BIO195e6236-4d229f62c7cfa4b3', '/dev/disk/by-id/scsi-23464323239663632') {{(pid=84543) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 26 10:25:16 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e827718-b954-4198-a15b-5c72e3aa21de]: (4, None) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:25:16 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0bccd48-5d04-40c3-a068-8918e5594d95 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9dbf6103-5796-4273-a8a9-81d262560347')] {{(pid=73572) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 10:25:16 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9dbf6103-5796-4273-a8a9-81d262560347 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:25:16 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9dbf6103-5796-4273-a8a9-81d262560347 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:25:16 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d2ec700-ca7f-4145-a91e-29b6ac75762b]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:25:16 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0bccd48-5d04-40c3-a068-8918e5594d95 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:25:16 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9dbf6103-5796-4273-a8a9-81d262560347 -p 172.16.0.220:3260 --logout {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:25:16 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9dbf6103-5796-4273-a8a9-81d262560347 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:25:16 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9aadb28-b8ae-451d-a7eb-43d56109e6c6]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:9dbf6103-5796-4273-a8a9-81d262560347, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:9dbf6103-5796-4273-a8a9-81d262560347, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:25:16 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0bccd48-5d04-40c3-a068-8918e5594d95 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:9dbf6103-5796-4273-a8a9-81d262560347, portal: 172.16.0.220,3260]
Aug 26 10:25:16 user nova-compute[73572]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:9dbf6103-5796-4273-a8a9-81d262560347, portal: 172.16.0.220,3260] successful.
Aug 26 10:25:16 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:25:16 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9dbf6103-5796-4273-a8a9-81d262560347 -p 172.16.0.220:3260 --op delete {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:25:16 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9dbf6103-5796-4273-a8a9-81d262560347 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:25:16 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef28ad93-20e7-42ac-afb6-276b1c3fa5c5]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:25:16 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0bccd48-5d04-40c3-a068-8918e5594d95 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:25:16 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-d0bccd48-5d04-40c3-a068-8918e5594d95 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.302s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 10:25:16 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0bccd48-5d04-40c3-a068-8918e5594d95 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] <== disconnect_volume: return (303ms) None {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 10:25:16 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d0bccd48-5d04-40c3-a068-8918e5594d95 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 0f46f84e-9cda-4450-a8a1-f6c08956324b] Disconnected iSCSI Volume {{(pid=73572) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 10:25:16 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-d0bccd48-5d04-40c3-a068-8918e5594d95 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 0f46f84e-9cda-4450-a8a1-f6c08956324b] Deleting instance files /opt/stack/data/nova/instances/0f46f84e-9cda-4450-a8a1-f6c08956324b_del
Aug 26 10:25:16 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-d0bccd48-5d04-40c3-a068-8918e5594d95 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 0f46f84e-9cda-4450-a8a1-f6c08956324b] Deletion of /opt/stack/data/nova/instances/0f46f84e-9cda-4450-a8a1-f6c08956324b_del complete
Aug 26 10:25:16 user nova-compute[73572]: INFO nova.compute.manager [None req-d0bccd48-5d04-40c3-a068-8918e5594d95 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 0f46f84e-9cda-4450-a8a1-f6c08956324b] Took 1.17 seconds to destroy the instance on the hypervisor.
Aug 26 10:25:16 user nova-compute[73572]: DEBUG oslo.service.loopingcall [None req-d0bccd48-5d04-40c3-a068-8918e5594d95 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73572) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 10:25:16 user nova-compute[73572]: DEBUG nova.compute.manager [-] [instance: 0f46f84e-9cda-4450-a8a1-f6c08956324b] Deallocating network for instance {{(pid=73572) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 10:25:16 user nova-compute[73572]: DEBUG nova.network.neutron [-] [instance: 0f46f84e-9cda-4450-a8a1-f6c08956324b] deallocate_for_instance() {{(pid=73572) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 10:25:16 user nova-compute[73572]: DEBUG nova.network.neutron [-] [instance: 0f46f84e-9cda-4450-a8a1-f6c08956324b] Updating instance_info_cache with network_info: [] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:25:16 user nova-compute[73572]: INFO nova.compute.manager [-] [instance: 0f46f84e-9cda-4450-a8a1-f6c08956324b] Took 0.47 seconds to deallocate network for instance.
Aug 26 10:25:17 user nova-compute[73572]: DEBUG nova.compute.manager [req-c43455c9-7599-4a68-a010-0e45c3a88cf9 req-37efc0fc-ae64-4cd0-9287-c2171988fba6 service nova] [instance: 0f46f84e-9cda-4450-a8a1-f6c08956324b] Received event network-vif-plugged-b4dfa21c-473c-4801-ae7a-aac3ac21b655 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:25:17 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-c43455c9-7599-4a68-a010-0e45c3a88cf9 req-37efc0fc-ae64-4cd0-9287-c2171988fba6 service nova] Acquiring lock "0f46f84e-9cda-4450-a8a1-f6c08956324b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:25:17 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-c43455c9-7599-4a68-a010-0e45c3a88cf9 req-37efc0fc-ae64-4cd0-9287-c2171988fba6 service nova] Lock "0f46f84e-9cda-4450-a8a1-f6c08956324b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:25:17 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-c43455c9-7599-4a68-a010-0e45c3a88cf9 req-37efc0fc-ae64-4cd0-9287-c2171988fba6 service nova] Lock "0f46f84e-9cda-4450-a8a1-f6c08956324b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:25:17 user nova-compute[73572]: DEBUG nova.compute.manager [req-c43455c9-7599-4a68-a010-0e45c3a88cf9 req-37efc0fc-ae64-4cd0-9287-c2171988fba6 service nova] [instance: 0f46f84e-9cda-4450-a8a1-f6c08956324b] No waiting events found dispatching network-vif-plugged-b4dfa21c-473c-4801-ae7a-aac3ac21b655 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:25:17 user nova-compute[73572]: WARNING nova.compute.manager [req-c43455c9-7599-4a68-a010-0e45c3a88cf9 req-37efc0fc-ae64-4cd0-9287-c2171988fba6 service nova] [instance: 0f46f84e-9cda-4450-a8a1-f6c08956324b] Received unexpected event network-vif-plugged-b4dfa21c-473c-4801-ae7a-aac3ac21b655 for instance with vm_state active and task_state deleting.
Aug 26 10:25:17 user nova-compute[73572]: DEBUG nova.compute.manager [req-c43455c9-7599-4a68-a010-0e45c3a88cf9 req-37efc0fc-ae64-4cd0-9287-c2171988fba6 service nova] [instance: 0f46f84e-9cda-4450-a8a1-f6c08956324b] Received event network-vif-deleted-b4dfa21c-473c-4801-ae7a-aac3ac21b655 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:25:17 user nova-compute[73572]: INFO nova.compute.manager [None req-d0bccd48-5d04-40c3-a068-8918e5594d95 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 0f46f84e-9cda-4450-a8a1-f6c08956324b] Took 0.89 seconds to detach 1 volumes for instance.
Aug 26 10:25:17 user nova-compute[73572]: DEBUG nova.compute.manager [None req-d0bccd48-5d04-40c3-a068-8918e5594d95 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 0f46f84e-9cda-4450-a8a1-f6c08956324b] Deleting volume: 9dbf6103-5796-4273-a8a9-81d262560347 {{(pid=73572) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 26 10:25:17 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-d0bccd48-5d04-40c3-a068-8918e5594d95 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:25:17 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-d0bccd48-5d04-40c3-a068-8918e5594d95 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:25:18 user nova-compute[73572]: DEBUG nova.compute.provider_tree [None req-d0bccd48-5d04-40c3-a068-8918e5594d95 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Inventory has not changed in ProviderTree for provider: e2cec974-59b2-4c77-a53d-a7f4e5a30d75 {{(pid=73572) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 10:25:18 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-d0bccd48-5d04-40c3-a068-8918e5594d95 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Inventory has not changed for provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73572) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 10:25:18 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-d0bccd48-5d04-40c3-a068-8918e5594d95 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.340s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:25:18 user nova-compute[73572]: INFO nova.scheduler.client.report [None req-d0bccd48-5d04-40c3-a068-8918e5594d95 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Deleted allocations for instance 0f46f84e-9cda-4450-a8a1-f6c08956324b
Aug 26 10:25:18 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-d0bccd48-5d04-40c3-a068-8918e5594d95 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Lock "0f46f84e-9cda-4450-a8a1-f6c08956324b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.124s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:25:19 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:25:19 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Starting heal instance info cache {{(pid=73572) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 10:25:19 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Rebuilding the list of instances to heal {{(pid=73572) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 10:25:19 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquiring lock "refresh_cache-c785b609-0068-442f-91f5-d26e888a993f" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:25:19 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquired lock "refresh_cache-c785b609-0068-442f-91f5-d26e888a993f" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:25:19 user nova-compute[73572]: DEBUG nova.network.neutron [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] [instance: c785b609-0068-442f-91f5-d26e888a993f] Forcefully refreshing network info cache for instance {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 10:25:19 user nova-compute[73572]: DEBUG nova.objects.instance [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lazy-loading 'info_cache' on Instance uuid c785b609-0068-442f-91f5-d26e888a993f {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:25:20 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:25:20 user nova-compute[73572]: DEBUG nova.network.neutron [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] [instance: c785b609-0068-442f-91f5-d26e888a993f] Updating instance_info_cache with network_info: [{"id": "f01cdcf9-2430-4eb5-bb2d-3d126756dfc1", "address": "fa:16:3e:fa:6c:bc", "network": {"id": "991b9dff-5173-4456-a530-b1f7eb5cfa4a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1845930297-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4636f93c5bfc4653804de097aed2882c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf01cdcf9-24", "ovs_interfaceid": "f01cdcf9-2430-4eb5-bb2d-3d126756dfc1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:25:20 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Releasing lock "refresh_cache-c785b609-0068-442f-91f5-d26e888a993f" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:25:20 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] [instance: c785b609-0068-442f-91f5-d26e888a993f] Updated the network info_cache for instance {{(pid=73572) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 10:25:20 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:25:20 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:25:20 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:25:20 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73572) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 10:25:20 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:25:20 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:25:22 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:25:22 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:25:24 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:25:24 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:25:24 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:25:24 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:25:24 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:25:24 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Auditing locally available compute resources for user (node: user) {{(pid=73572) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 10:25:25 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b2d5f4e-37af-438c-859b-d4ca803b7d08/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:25:25 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:25:25 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b2d5f4e-37af-438c-859b-d4ca803b7d08/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:25:25 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b2d5f4e-37af-438c-859b-d4ca803b7d08/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:25:25 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b2d5f4e-37af-438c-859b-d4ca803b7d08/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:25:25 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86923c1a-89a5-4e7a-b488-8bf3a013bf83/disk.rescue --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:25:25 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86923c1a-89a5-4e7a-b488-8bf3a013bf83/disk.rescue --force-share --output=json" returned: 0 in 0.245s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:25:25 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86923c1a-89a5-4e7a-b488-8bf3a013bf83/disk.rescue --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:25:25 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86923c1a-89a5-4e7a-b488-8bf3a013bf83/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:25:25 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86923c1a-89a5-4e7a-b488-8bf3a013bf83/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:25:25 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:25:26 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86923c1a-89a5-4e7a-b488-8bf3a013bf83/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:25:26 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86923c1a-89a5-4e7a-b488-8bf3a013bf83/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:25:26 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86923c1a-89a5-4e7a-b488-8bf3a013bf83/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:25:26 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c785b609-0068-442f-91f5-d26e888a993f/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:25:26 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c785b609-0068-442f-91f5-d26e888a993f/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:25:26 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c785b609-0068-442f-91f5-d26e888a993f/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:25:26 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c785b609-0068-442f-91f5-d26e888a993f/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:25:26 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e468b473-515f-41ad-a75c-65d4c6d575c8/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:25:26 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e468b473-515f-41ad-a75c-65d4c6d575c8/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:25:26 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e468b473-515f-41ad-a75c-65d4c6d575c8/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:25:26 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e468b473-515f-41ad-a75c-65d4c6d575c8/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:25:26 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44a737bf-3704-4193-8d24-b8d132267279/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:25:27 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44a737bf-3704-4193-8d24-b8d132267279/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:25:27 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44a737bf-3704-4193-8d24-b8d132267279/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:25:27 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44a737bf-3704-4193-8d24-b8d132267279/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:25:27 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=73572) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 10:25:27 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68613b1e-c45c-4fd9-834c-3630ed0f456a/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:25:27 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68613b1e-c45c-4fd9-834c-3630ed0f456a/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:25:27 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68613b1e-c45c-4fd9-834c-3630ed0f456a/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:25:27 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68613b1e-c45c-4fd9-834c-3630ed0f456a/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:25:27 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2eaea7c2-a5c0-4950-b033-0012b5cec0ee/disk.rescue --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:25:27 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2eaea7c2-a5c0-4950-b033-0012b5cec0ee/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:25:27 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2eaea7c2-a5c0-4950-b033-0012b5cec0ee/disk.rescue --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:25:28 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2eaea7c2-a5c0-4950-b033-0012b5cec0ee/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:25:28 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2eaea7c2-a5c0-4950-b033-0012b5cec0ee/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:25:28 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2eaea7c2-a5c0-4950-b033-0012b5cec0ee/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:25:28 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2eaea7c2-a5c0-4950-b033-0012b5cec0ee/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:25:28 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2eaea7c2-a5c0-4950-b033-0012b5cec0ee/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:25:28 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=73572) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 10:25:28 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6422ce7d-9348-48b2-9af0-ec322d482d2b/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:25:28 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:25:28 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6422ce7d-9348-48b2-9af0-ec322d482d2b/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:25:28 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6422ce7d-9348-48b2-9af0-ec322d482d2b/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:25:28 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6422ce7d-9348-48b2-9af0-ec322d482d2b/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:25:28 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f3db0fa-682c-4b33-966b-9e50b7349b6e/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:25:29 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f3db0fa-682c-4b33-966b-9e50b7349b6e/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:25:29 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f3db0fa-682c-4b33-966b-9e50b7349b6e/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:25:29 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f3db0fa-682c-4b33-966b-9e50b7349b6e/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:25:29 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73572) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 10:25:29 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:25:29 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:25:29 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Hypervisor/Node resource view: name=user free_ram=7100MB free_disk=25.084095001220703GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=73572) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 10:25:29 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:25:29 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:25:29 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance c785b609-0068-442f-91f5-d26e888a993f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:25:29 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance 14fab12e-52be-4fe6-8777-bc7ebf3c25f1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:25:29 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance 2eaea7c2-a5c0-4950-b033-0012b5cec0ee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:25:29 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance 86923c1a-89a5-4e7a-b488-8bf3a013bf83 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:25:29 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance 44a737bf-3704-4193-8d24-b8d132267279 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:25:29 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance e468b473-515f-41ad-a75c-65d4c6d575c8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:25:29 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance 68613b1e-c45c-4fd9-834c-3630ed0f456a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:25:29 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance 1f3db0fa-682c-4b33-966b-9e50b7349b6e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:25:29 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance 8a8816e5-696d-4384-b0e0-29aa7cdd957c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:25:29 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance 6422ce7d-9348-48b2-9af0-ec322d482d2b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:25:29 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance 6b2d5f4e-37af-438c-859b-d4ca803b7d08 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:25:29 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=73572) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 10:25:29 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=73572) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 10:25:30 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:25:30 user nova-compute[73572]: DEBUG nova.compute.provider_tree [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Inventory has not changed in ProviderTree for provider: e2cec974-59b2-4c77-a53d-a7f4e5a30d75 {{(pid=73572) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 10:25:30 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Inventory has not changed for provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73572) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 10:25:30 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Compute_service record updated for user:user {{(pid=73572) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 10:25:30 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.627s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:25:30 user nova-compute[73572]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693045515.9201028, 0f46f84e-9cda-4450-a8a1-f6c08956324b => Stopped> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:25:30 user nova-compute[73572]: INFO nova.compute.manager [-] [instance: 0f46f84e-9cda-4450-a8a1-f6c08956324b] VM Stopped (Lifecycle Event)
Aug 26 10:25:30 user nova-compute[73572]: DEBUG nova.compute.manager [None req-f645e6fb-ec08-4293-ba3a-1fa1ece662d6 None None] [instance: 0f46f84e-9cda-4450-a8a1-f6c08956324b] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:25:30 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:25:31 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:25:34 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:25:35 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:25:35 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:25:36 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:25:39 user nova-compute[73572]: INFO nova.compute.manager [None req-3b976b48-e63d-425e-bea5-fb2dc786f622 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: 8a8816e5-696d-4384-b0e0-29aa7cdd957c] Rescuing
Aug 26 10:25:39 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-3b976b48-e63d-425e-bea5-fb2dc786f622 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Acquiring lock "refresh_cache-8a8816e5-696d-4384-b0e0-29aa7cdd957c" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:25:39 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-3b976b48-e63d-425e-bea5-fb2dc786f622 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Acquired lock "refresh_cache-8a8816e5-696d-4384-b0e0-29aa7cdd957c" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:25:39 user nova-compute[73572]: DEBUG nova.network.neutron [None req-3b976b48-e63d-425e-bea5-fb2dc786f622 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: 8a8816e5-696d-4384-b0e0-29aa7cdd957c] Building network info cache for instance {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 10:25:39 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-972e1ab5-75de-4284-977f-4f533a096c73 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Acquiring lock "6004b15a-be01-42eb-92ba-ae9d93dab708" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:25:39 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-972e1ab5-75de-4284-977f-4f533a096c73 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Lock "6004b15a-be01-42eb-92ba-ae9d93dab708" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:25:39 user nova-compute[73572]: DEBUG nova.compute.manager [None req-972e1ab5-75de-4284-977f-4f533a096c73 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] [instance: 6004b15a-be01-42eb-92ba-ae9d93dab708] Starting instance... {{(pid=73572) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 10:25:39 user nova-compute[73572]: DEBUG nova.network.neutron [None req-3b976b48-e63d-425e-bea5-fb2dc786f622 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: 8a8816e5-696d-4384-b0e0-29aa7cdd957c] Updating instance_info_cache with network_info: [{"id": "2e650fb9-427c-477e-ba45-ddc070399617", "address": "fa:16:3e:6c:94:14", "network": {"id": "991b9dff-5173-4456-a530-b1f7eb5cfa4a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1845930297-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4636f93c5bfc4653804de097aed2882c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e650fb9-42", "ovs_interfaceid": "2e650fb9-427c-477e-ba45-ddc070399617", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:25:39 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-972e1ab5-75de-4284-977f-4f533a096c73 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:25:39 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-972e1ab5-75de-4284-977f-4f533a096c73 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:25:39 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-972e1ab5-75de-4284-977f-4f533a096c73 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73572) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 10:25:39 user nova-compute[73572]: INFO nova.compute.claims [None req-972e1ab5-75de-4284-977f-4f533a096c73 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] [instance: 6004b15a-be01-42eb-92ba-ae9d93dab708] Claim successful on node user
Aug 26 10:25:39 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-3b976b48-e63d-425e-bea5-fb2dc786f622 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Releasing lock "refresh_cache-8a8816e5-696d-4384-b0e0-29aa7cdd957c" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:25:39 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:25:39 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:25:39 user nova-compute[73572]: DEBUG nova.compute.manager [req-a14019b4-661c-4fcb-8f4c-b3c13d9dd0ec req-7aa8dbb8-4aa5-41d9-89d9-33d9c6b2ab9c service nova] [instance: 8a8816e5-696d-4384-b0e0-29aa7cdd957c] Received event network-vif-unplugged-2e650fb9-427c-477e-ba45-ddc070399617 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:25:39 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-a14019b4-661c-4fcb-8f4c-b3c13d9dd0ec req-7aa8dbb8-4aa5-41d9-89d9-33d9c6b2ab9c service nova] Acquiring lock "8a8816e5-696d-4384-b0e0-29aa7cdd957c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:25:39 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-a14019b4-661c-4fcb-8f4c-b3c13d9dd0ec req-7aa8dbb8-4aa5-41d9-89d9-33d9c6b2ab9c service nova] Lock "8a8816e5-696d-4384-b0e0-29aa7cdd957c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:25:39 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-a14019b4-661c-4fcb-8f4c-b3c13d9dd0ec req-7aa8dbb8-4aa5-41d9-89d9-33d9c6b2ab9c service nova] Lock "8a8816e5-696d-4384-b0e0-29aa7cdd957c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:25:39 user nova-compute[73572]: DEBUG nova.compute.manager [req-a14019b4-661c-4fcb-8f4c-b3c13d9dd0ec req-7aa8dbb8-4aa5-41d9-89d9-33d9c6b2ab9c service nova] [instance: 8a8816e5-696d-4384-b0e0-29aa7cdd957c] No waiting events found dispatching network-vif-unplugged-2e650fb9-427c-477e-ba45-ddc070399617 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:25:39 user nova-compute[73572]: WARNING nova.compute.manager [req-a14019b4-661c-4fcb-8f4c-b3c13d9dd0ec req-7aa8dbb8-4aa5-41d9-89d9-33d9c6b2ab9c service nova] [instance: 8a8816e5-696d-4384-b0e0-29aa7cdd957c] Received unexpected event network-vif-unplugged-2e650fb9-427c-477e-ba45-ddc070399617 for instance with vm_state active and task_state rescuing.
Aug 26 10:25:39 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:25:39 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:25:39 user nova-compute[73572]: DEBUG nova.compute.provider_tree [None req-972e1ab5-75de-4284-977f-4f533a096c73 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Inventory has not changed in ProviderTree for provider: e2cec974-59b2-4c77-a53d-a7f4e5a30d75 {{(pid=73572) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 10:25:39 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-972e1ab5-75de-4284-977f-4f533a096c73 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Inventory has not changed for provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73572) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 10:25:40 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-972e1ab5-75de-4284-977f-4f533a096c73 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.519s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:25:40 user nova-compute[73572]: DEBUG nova.compute.manager [None req-972e1ab5-75de-4284-977f-4f533a096c73 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] [instance: 6004b15a-be01-42eb-92ba-ae9d93dab708] Start building networks asynchronously for instance. {{(pid=73572) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 10:25:40 user nova-compute[73572]: DEBUG nova.compute.manager [None req-972e1ab5-75de-4284-977f-4f533a096c73 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] [instance: 6004b15a-be01-42eb-92ba-ae9d93dab708] Allocating IP information in the background. {{(pid=73572) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 10:25:40 user nova-compute[73572]: DEBUG nova.network.neutron [None req-972e1ab5-75de-4284-977f-4f533a096c73 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] [instance: 6004b15a-be01-42eb-92ba-ae9d93dab708] allocate_for_instance() {{(pid=73572) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 10:25:40 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-972e1ab5-75de-4284-977f-4f533a096c73 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] [instance: 6004b15a-be01-42eb-92ba-ae9d93dab708] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 10:25:40 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:25:40 user nova-compute[73572]: DEBUG nova.compute.manager [None req-972e1ab5-75de-4284-977f-4f533a096c73 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] [instance: 6004b15a-be01-42eb-92ba-ae9d93dab708] Start building block device mappings for instance. {{(pid=73572) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 10:25:40 user nova-compute[73572]: DEBUG nova.policy [None req-972e1ab5-75de-4284-977f-4f533a096c73 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '17243251fe57431c9c98195a16239c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7e16843614c451d958e817c832d4cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73572) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 10:25:40 user nova-compute[73572]: DEBUG nova.compute.manager [None req-972e1ab5-75de-4284-977f-4f533a096c73 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] [instance: 6004b15a-be01-42eb-92ba-ae9d93dab708] Start spawning the instance on the hypervisor. {{(pid=73572) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 10:25:40 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-972e1ab5-75de-4284-977f-4f533a096c73 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] [instance: 6004b15a-be01-42eb-92ba-ae9d93dab708] Creating instance directory {{(pid=73572) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 10:25:40 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-972e1ab5-75de-4284-977f-4f533a096c73 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] [instance: 6004b15a-be01-42eb-92ba-ae9d93dab708] Creating image(s)
Aug 26 10:25:40 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-972e1ab5-75de-4284-977f-4f533a096c73 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Acquiring lock "/opt/stack/data/nova/instances/6004b15a-be01-42eb-92ba-ae9d93dab708/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:25:40 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-972e1ab5-75de-4284-977f-4f533a096c73 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Lock "/opt/stack/data/nova/instances/6004b15a-be01-42eb-92ba-ae9d93dab708/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:25:40 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-972e1ab5-75de-4284-977f-4f533a096c73 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Lock "/opt/stack/data/nova/instances/6004b15a-be01-42eb-92ba-ae9d93dab708/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:25:40 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-972e1ab5-75de-4284-977f-4f533a096c73 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:25:40 user nova-compute[73572]: INFO nova.virt.libvirt.driver [-] [instance: 8a8816e5-696d-4384-b0e0-29aa7cdd957c] Instance destroyed successfully.
Aug 26 10:25:40 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-3b976b48-e63d-425e-bea5-fb2dc786f622 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: 8a8816e5-696d-4384-b0e0-29aa7cdd957c] Attempting a stable device rescue
Aug 26 10:25:40 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-3b976b48-e63d-425e-bea5-fb2dc786f622 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=73572) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 26 10:25:40 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-3b976b48-e63d-425e-bea5-fb2dc786f622 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: 8a8816e5-696d-4384-b0e0-29aa7cdd957c] Instance directory exists: not creating {{(pid=73572) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 26 10:25:40 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-3b976b48-e63d-425e-bea5-fb2dc786f622 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: 8a8816e5-696d-4384-b0e0-29aa7cdd957c] Creating image(s)
Aug 26 10:25:40 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-3b976b48-e63d-425e-bea5-fb2dc786f622 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Acquiring lock "/opt/stack/data/nova/instances/8a8816e5-696d-4384-b0e0-29aa7cdd957c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:25:40 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-3b976b48-e63d-425e-bea5-fb2dc786f622 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Lock "/opt/stack/data/nova/instances/8a8816e5-696d-4384-b0e0-29aa7cdd957c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:25:40 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-3b976b48-e63d-425e-bea5-fb2dc786f622 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Lock "/opt/stack/data/nova/instances/8a8816e5-696d-4384-b0e0-29aa7cdd957c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:25:40 user nova-compute[73572]: DEBUG nova.objects.instance [None req-3b976b48-e63d-425e-bea5-fb2dc786f622 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Lazy-loading 'trusted_certs' on Instance uuid 8a8816e5-696d-4384-b0e0-29aa7cdd957c {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:25:40 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-3b976b48-e63d-425e-bea5-fb2dc786f622 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Acquiring lock "5a6b07019ada95d7ee0a3913be7c9a514414b976" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:25:40 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-3b976b48-e63d-425e-bea5-fb2dc786f622 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Lock "5a6b07019ada95d7ee0a3913be7c9a514414b976" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:25:40 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-972e1ab5-75de-4284-977f-4f533a096c73 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json" returned: 0 in 0.197s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:25:40 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-972e1ab5-75de-4284-977f-4f533a096c73 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Acquiring lock "2099350d6f3bcd0de9471c73862d4fe75b049801" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:25:40 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-972e1ab5-75de-4284-977f-4f533a096c73 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Lock "2099350d6f3bcd0de9471c73862d4fe75b049801" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:25:40 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-972e1ab5-75de-4284-977f-4f533a096c73 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:25:41 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-3b976b48-e63d-425e-bea5-fb2dc786f622 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a6b07019ada95d7ee0a3913be7c9a514414b976.part --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:25:41 user nova-compute[73572]: DEBUG nova.network.neutron [None req-972e1ab5-75de-4284-977f-4f533a096c73 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] [instance: 6004b15a-be01-42eb-92ba-ae9d93dab708] Successfully created port: 8c801229-2284-4cd5-bdce-45c96edfe633 {{(pid=73572) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 10:25:41 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:25:41 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-972e1ab5-75de-4284-977f-4f533a096c73 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json" returned: 0 in 1.218s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:25:41 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-972e1ab5-75de-4284-977f-4f533a096c73 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801,backing_fmt=raw /opt/stack/data/nova/instances/6004b15a-be01-42eb-92ba-ae9d93dab708/disk 1073741824 {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:25:41 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-972e1ab5-75de-4284-977f-4f533a096c73 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801,backing_fmt=raw /opt/stack/data/nova/instances/6004b15a-be01-42eb-92ba-ae9d93dab708/disk 1073741824" returned: 0 in 0.053s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:25:41 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-972e1ab5-75de-4284-977f-4f533a096c73 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Lock "2099350d6f3bcd0de9471c73862d4fe75b049801" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 1.278s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:25:41 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-972e1ab5-75de-4284-977f-4f533a096c73 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:25:41 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-3b976b48-e63d-425e-bea5-fb2dc786f622 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a6b07019ada95d7ee0a3913be7c9a514414b976.part --force-share --output=json" returned: 0 in 0.194s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:25:41 user nova-compute[73572]: DEBUG nova.virt.images [None req-3b976b48-e63d-425e-bea5-fb2dc786f622 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] a1c5e559-619b-41d2-84ed-001ad648d15b was qcow2, converting to raw {{(pid=73572) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 26 10:25:41 user nova-compute[73572]: DEBUG nova.privsep.utils [None req-3b976b48-e63d-425e-bea5-fb2dc786f622 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73572) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 26 10:25:41 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-3b976b48-e63d-425e-bea5-fb2dc786f622 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/5a6b07019ada95d7ee0a3913be7c9a514414b976.part /opt/stack/data/nova/instances/_base/5a6b07019ada95d7ee0a3913be7c9a514414b976.converted {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:25:41 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-972e1ab5-75de-4284-977f-4f533a096c73 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json" returned: 0 in 0.193s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:25:41 user nova-compute[73572]: DEBUG nova.virt.disk.api [None req-972e1ab5-75de-4284-977f-4f533a096c73 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6004b15a-be01-42eb-92ba-ae9d93dab708/disk. size=1073741824 {{(pid=73572) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 10:25:41 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-972e1ab5-75de-4284-977f-4f533a096c73 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6004b15a-be01-42eb-92ba-ae9d93dab708/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:25:42 user nova-compute[73572]: DEBUG nova.compute.manager [req-98063dfe-922a-4655-abe3-bde39f2754dc req-af6d10e0-6d61-4aa1-97bf-39b1789ccf70 service nova] [instance: 8a8816e5-696d-4384-b0e0-29aa7cdd957c] Received event network-vif-plugged-2e650fb9-427c-477e-ba45-ddc070399617 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:25:42 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-98063dfe-922a-4655-abe3-bde39f2754dc req-af6d10e0-6d61-4aa1-97bf-39b1789ccf70 service nova] Acquiring lock "8a8816e5-696d-4384-b0e0-29aa7cdd957c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:25:42 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-98063dfe-922a-4655-abe3-bde39f2754dc req-af6d10e0-6d61-4aa1-97bf-39b1789ccf70 service nova] Lock "8a8816e5-696d-4384-b0e0-29aa7cdd957c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:25:42 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-98063dfe-922a-4655-abe3-bde39f2754dc req-af6d10e0-6d61-4aa1-97bf-39b1789ccf70 service nova] Lock "8a8816e5-696d-4384-b0e0-29aa7cdd957c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:25:42 user nova-compute[73572]: DEBUG nova.compute.manager [req-98063dfe-922a-4655-abe3-bde39f2754dc req-af6d10e0-6d61-4aa1-97bf-39b1789ccf70 service nova] [instance: 8a8816e5-696d-4384-b0e0-29aa7cdd957c] No waiting events found dispatching network-vif-plugged-2e650fb9-427c-477e-ba45-ddc070399617 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:25:42 user nova-compute[73572]: WARNING nova.compute.manager [req-98063dfe-922a-4655-abe3-bde39f2754dc req-af6d10e0-6d61-4aa1-97bf-39b1789ccf70 service nova] [instance: 8a8816e5-696d-4384-b0e0-29aa7cdd957c] Received unexpected event network-vif-plugged-2e650fb9-427c-477e-ba45-ddc070399617 for instance with vm_state active and task_state rescuing.
Aug 26 10:25:42 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-972e1ab5-75de-4284-977f-4f533a096c73 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6004b15a-be01-42eb-92ba-ae9d93dab708/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:25:42 user nova-compute[73572]: DEBUG nova.virt.disk.api [None req-972e1ab5-75de-4284-977f-4f533a096c73 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Cannot resize image /opt/stack/data/nova/instances/6004b15a-be01-42eb-92ba-ae9d93dab708/disk to a smaller size. {{(pid=73572) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 10:25:42 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-972e1ab5-75de-4284-977f-4f533a096c73 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] [instance: 6004b15a-be01-42eb-92ba-ae9d93dab708] Created local disks {{(pid=73572) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 10:25:42 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-972e1ab5-75de-4284-977f-4f533a096c73 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] [instance: 6004b15a-be01-42eb-92ba-ae9d93dab708] Ensure instance console log exists: /opt/stack/data/nova/instances/6004b15a-be01-42eb-92ba-ae9d93dab708/console.log {{(pid=73572) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 10:25:42 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-972e1ab5-75de-4284-977f-4f533a096c73 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:25:42 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-972e1ab5-75de-4284-977f-4f533a096c73 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:25:42 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-972e1ab5-75de-4284-977f-4f533a096c73 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:25:42 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-3b976b48-e63d-425e-bea5-fb2dc786f622 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/5a6b07019ada95d7ee0a3913be7c9a514414b976.part /opt/stack/data/nova/instances/_base/5a6b07019ada95d7ee0a3913be7c9a514414b976.converted" returned: 0 in 0.731s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:25:42 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-3b976b48-e63d-425e-bea5-fb2dc786f622 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a6b07019ada95d7ee0a3913be7c9a514414b976.converted --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:25:42 user nova-compute[73572]: DEBUG nova.network.neutron [None req-972e1ab5-75de-4284-977f-4f533a096c73 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] [instance: 6004b15a-be01-42eb-92ba-ae9d93dab708] Successfully updated port: 8c801229-2284-4cd5-bdce-45c96edfe633 {{(pid=73572) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 10:25:42 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-972e1ab5-75de-4284-977f-4f533a096c73 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Acquiring lock "refresh_cache-6004b15a-be01-42eb-92ba-ae9d93dab708" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:25:42 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-972e1ab5-75de-4284-977f-4f533a096c73 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Acquired lock "refresh_cache-6004b15a-be01-42eb-92ba-ae9d93dab708" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:25:42 user nova-compute[73572]: DEBUG nova.network.neutron [None req-972e1ab5-75de-4284-977f-4f533a096c73 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] [instance: 6004b15a-be01-42eb-92ba-ae9d93dab708] Building network info cache for instance {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 10:25:42 user nova-compute[73572]: DEBUG nova.network.neutron [None req-972e1ab5-75de-4284-977f-4f533a096c73 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] [instance: 6004b15a-be01-42eb-92ba-ae9d93dab708] Instance cache missing network info. {{(pid=73572) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 10:25:42 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-3b976b48-e63d-425e-bea5-fb2dc786f622 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a6b07019ada95d7ee0a3913be7c9a514414b976.converted --force-share --output=json" returned: 0 in 0.191s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:25:42 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-3b976b48-e63d-425e-bea5-fb2dc786f622 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Lock "5a6b07019ada95d7ee0a3913be7c9a514414b976" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.328s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:25:42 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-3b976b48-e63d-425e-bea5-fb2dc786f622 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Acquiring lock "5a6b07019ada95d7ee0a3913be7c9a514414b976" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:25:42 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-3b976b48-e63d-425e-bea5-fb2dc786f622 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Lock "5a6b07019ada95d7ee0a3913be7c9a514414b976" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:25:42 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-3b976b48-e63d-425e-bea5-fb2dc786f622 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a6b07019ada95d7ee0a3913be7c9a514414b976 --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:25:42 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-3b976b48-e63d-425e-bea5-fb2dc786f622 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a6b07019ada95d7ee0a3913be7c9a514414b976 --force-share --output=json" returned: 0 in 0.178s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:25:42 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-3b976b48-e63d-425e-bea5-fb2dc786f622 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5a6b07019ada95d7ee0a3913be7c9a514414b976,backing_fmt=raw /opt/stack/data/nova/instances/8a8816e5-696d-4384-b0e0-29aa7cdd957c/disk.rescue {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:25:43 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-3b976b48-e63d-425e-bea5-fb2dc786f622 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5a6b07019ada95d7ee0a3913be7c9a514414b976,backing_fmt=raw /opt/stack/data/nova/instances/8a8816e5-696d-4384-b0e0-29aa7cdd957c/disk.rescue" returned: 0 in 0.047s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:25:43 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-3b976b48-e63d-425e-bea5-fb2dc786f622 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Lock "5a6b07019ada95d7ee0a3913be7c9a514414b976" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.231s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:25:43 user nova-compute[73572]: DEBUG nova.objects.instance [None req-3b976b48-e63d-425e-bea5-fb2dc786f622 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Lazy-loading 'migration_context' on Instance uuid 8a8816e5-696d-4384-b0e0-29aa7cdd957c {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:25:43 user nova-compute[73572]: DEBUG nova.objects.base [None req-3b976b48-e63d-425e-bea5-fb2dc786f622 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Object Instance<8a8816e5-696d-4384-b0e0-29aa7cdd957c> lazy-loaded attributes: trusted_certs,migration_context {{(pid=73572) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 10:25:43 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-3b976b48-e63d-425e-bea5-fb2dc786f622 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: 8a8816e5-696d-4384-b0e0-29aa7cdd957c] Created local disks {{(pid=73572) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 10:25:43 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-3b976b48-e63d-425e-bea5-fb2dc786f622 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: 8a8816e5-696d-4384-b0e0-29aa7cdd957c] Start _get_guest_xml network_info=[{"id": "2e650fb9-427c-477e-ba45-ddc070399617", "address": "fa:16:3e:6c:94:14", "network": {"id": "991b9dff-5173-4456-a530-b1f7eb5cfa4a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1845930297-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1845930297-network", "vif_mac": "fa:16:3e:6c:94:14"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4636f93c5bfc4653804de097aed2882c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e650fb9-42", "ovs_interfaceid": "2e650fb9-427c-477e-ba45-ddc070399617", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T10:07:33Z,direct_url=<?>,disk_format='qcow2',id=299da0c9-e1c4-48f0-be55-fbe20dd06bc9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5c995f8bbbab4368b67a253e0df3971a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T10:07:34Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'a1c5e559-619b-41d2-84ed-001ad648d15b', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'disk_bus': 'virtio', 'boot_index': 0, 'mount_device': '/dev/vda', 'attachment_id': '72ad31df-c217-45c2-b99f-be36333bf6ea', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:133098b2-106a-427f-aa6d-2c10625dd152'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RvoAbQip', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': '8a8816e5-696d-4384-b0e0-29aa7cdd957c', 'attached_at': '', 'detached_at': '', 'volume_id': '133098b2-106a-427f-aa6d-2c10625dd152', 'serial': '133098b2-106a-427f-aa6d-2c10625dd152'}, 'guest_format': None, 'device_type': 'disk', 'volume_type': None} {{(pid=73572) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 10:25:43 user nova-compute[73572]: DEBUG nova.objects.instance [None req-3b976b48-e63d-425e-bea5-fb2dc786f622 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Lazy-loading 'resources' on Instance uuid 8a8816e5-696d-4384-b0e0-29aa7cdd957c {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:25:43 user nova-compute[73572]: DEBUG nova.objects.base [None req-3b976b48-e63d-425e-bea5-fb2dc786f622 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Object Instance<8a8816e5-696d-4384-b0e0-29aa7cdd957c> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=73572) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 10:25:43 user nova-compute[73572]: DEBUG nova.objects.instance [None req-3b976b48-e63d-425e-bea5-fb2dc786f622 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Lazy-loading 'numa_topology' on Instance uuid 8a8816e5-696d-4384-b0e0-29aa7cdd957c {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:25:43 user nova-compute[73572]: DEBUG nova.objects.base [None req-3b976b48-e63d-425e-bea5-fb2dc786f622 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Object Instance<8a8816e5-696d-4384-b0e0-29aa7cdd957c> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=73572) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 10:25:43 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-3b976b48-e63d-425e-bea5-fb2dc786f622 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:25:43 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-3b976b48-e63d-425e-bea5-fb2dc786f622 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:25:43 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-3b976b48-e63d-425e-bea5-fb2dc786f622 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73572) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 10:25:43 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-3b976b48-e63d-425e-bea5-fb2dc786f622 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] CPU controller missing on host. {{(pid=73572) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 10:25:43 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-3b976b48-e63d-425e-bea5-fb2dc786f622 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73572) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 10:25:43 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-3b976b48-e63d-425e-bea5-fb2dc786f622 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] CPU controller found on host. {{(pid=73572) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 10:25:43 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-3b976b48-e63d-425e-bea5-fb2dc786f622 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73572) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 10:25:43 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-3b976b48-e63d-425e-bea5-fb2dc786f622 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T10:07:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T10:07:33Z,direct_url=<?>,disk_format='qcow2',id=299da0c9-e1c4-48f0-be55-fbe20dd06bc9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5c995f8bbbab4368b67a253e0df3971a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T10:07:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 10:25:43 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-3b976b48-e63d-425e-bea5-fb2dc786f622 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Flavor limits 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 10:25:43 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-3b976b48-e63d-425e-bea5-fb2dc786f622 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Image limits 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 10:25:43 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-3b976b48-e63d-425e-bea5-fb2dc786f622 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Flavor pref 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 10:25:43 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-3b976b48-e63d-425e-bea5-fb2dc786f622 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Image pref 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 10:25:43 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-3b976b48-e63d-425e-bea5-fb2dc786f622 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 10:25:43 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-3b976b48-e63d-425e-bea5-fb2dc786f622 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 10:25:43 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-3b976b48-e63d-425e-bea5-fb2dc786f622 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73572) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 10:25:43 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-3b976b48-e63d-425e-bea5-fb2dc786f622 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Got 1 possible topologies {{(pid=73572) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 10:25:43 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-3b976b48-e63d-425e-bea5-fb2dc786f622 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 10:25:43 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-3b976b48-e63d-425e-bea5-fb2dc786f622 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 10:25:43 user nova-compute[73572]: DEBUG nova.objects.instance [None req-3b976b48-e63d-425e-bea5-fb2dc786f622 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Lazy-loading 'vcpu_model' on Instance uuid 8a8816e5-696d-4384-b0e0-29aa7cdd957c {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:25:43 user nova-compute[73572]: DEBUG nova.network.neutron [None req-972e1ab5-75de-4284-977f-4f533a096c73 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] [instance: 6004b15a-be01-42eb-92ba-ae9d93dab708] Updating instance_info_cache with network_info: [{"id": "8c801229-2284-4cd5-bdce-45c96edfe633", "address": "fa:16:3e:5a:0e:fa", "network": {"id": "317d2681-96ce-4898-b6fb-8892ee6f706d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2049963835-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7e16843614c451d958e817c832d4cbc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c801229-22", "ovs_interfaceid": "8c801229-2284-4cd5-bdce-45c96edfe633", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:25:43 user nova-compute[73572]: DEBUG nova.objects.base [None req-3b976b48-e63d-425e-bea5-fb2dc786f622 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Object Instance<8a8816e5-696d-4384-b0e0-29aa7cdd957c> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=73572) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 10:25:43 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b976b48-e63d-425e-bea5-fb2dc786f622 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: 8a8816e5-696d-4384-b0e0-29aa7cdd957c] Calling os-brick to attach iSCSI Volume {{(pid=73572) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 10:25:43 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b976b48-e63d-425e-bea5-fb2dc786f622 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc89c3d6a10>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:133098b2-106a-427f-aa6d-2c10625dd152'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RvoAbQip', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 10:25:43 user nova-compute[73572]: WARNING os_brick.initiator.connectors.base [None req-3b976b48-e63d-425e-bea5-fb2dc786f622 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 10:25:43 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-3b976b48-e63d-425e-bea5-fb2dc786f622 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 10:25:43 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-3b976b48-e63d-425e-bea5-fb2dc786f622 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 10:25:43 user nova-compute[73572]: WARNING os_brick.initiator.connectors.base [None req-3b976b48-e63d-425e-bea5-fb2dc786f622 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 10:25:43 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-3b976b48-e63d-425e-bea5-fb2dc786f622 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:133098b2-106a-427f-aa6d-2c10625dd152" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 10:25:43 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-3b976b48-e63d-425e-bea5-fb2dc786f622 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:133098b2-106a-427f-aa6d-2c10625dd152" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 10:25:43 user nova-compute[73572]: INFO os_brick.initiator.connectors.iscsi [None req-3b976b48-e63d-425e-bea5-fb2dc786f622 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 10:25:43 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-972e1ab5-75de-4284-977f-4f533a096c73 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Releasing lock "refresh_cache-6004b15a-be01-42eb-92ba-ae9d93dab708" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:25:43 user nova-compute[73572]: DEBUG nova.compute.manager [None req-972e1ab5-75de-4284-977f-4f533a096c73 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] [instance: 6004b15a-be01-42eb-92ba-ae9d93dab708] Instance network_info: |[{"id": "8c801229-2284-4cd5-bdce-45c96edfe633", "address": "fa:16:3e:5a:0e:fa", "network": {"id": "317d2681-96ce-4898-b6fb-8892ee6f706d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2049963835-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7e16843614c451d958e817c832d4cbc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c801229-22", "ovs_interfaceid": "8c801229-2284-4cd5-bdce-45c96edfe633", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73572) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 10:25:43 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:133098b2-106a-427f-aa6d-2c10625dd152 -p 172.16.0.220:3260 {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:25:43 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-972e1ab5-75de-4284-977f-4f533a096c73 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] [instance: 6004b15a-be01-42eb-92ba-ae9d93dab708] Start _get_guest_xml network_info=[{"id": "8c801229-2284-4cd5-bdce-45c96edfe633", "address": "fa:16:3e:5a:0e:fa", "network": {"id": "317d2681-96ce-4898-b6fb-8892ee6f706d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2049963835-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7e16843614c451d958e817c832d4cbc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c801229-22", "ovs_interfaceid": "8c801229-2284-4cd5-bdce-45c96edfe633", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T10:07:33Z,direct_url=<?>,disk_format='qcow2',id=299da0c9-e1c4-48f0-be55-fbe20dd06bc9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5c995f8bbbab4368b67a253e0df3971a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T10:07:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'guest_format': None, 'size': 0, 'encryption_format': None, 'device_type': 'disk', 'image_id': '299da0c9-e1c4-48f0-be55-fbe20dd06bc9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73572) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 10:25:43 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-972e1ab5-75de-4284-977f-4f533a096c73 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:25:43 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-972e1ab5-75de-4284-977f-4f533a096c73 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:25:43 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-972e1ab5-75de-4284-977f-4f533a096c73 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73572) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 10:25:43 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-972e1ab5-75de-4284-977f-4f533a096c73 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] CPU controller missing on host. {{(pid=73572) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 10:25:43 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-972e1ab5-75de-4284-977f-4f533a096c73 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73572) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 10:25:43 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-972e1ab5-75de-4284-977f-4f533a096c73 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] CPU controller found on host. {{(pid=73572) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 10:25:43 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-972e1ab5-75de-4284-977f-4f533a096c73 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73572) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 10:25:43 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-972e1ab5-75de-4284-977f-4f533a096c73 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T10:07:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T10:07:33Z,direct_url=<?>,disk_format='qcow2',id=299da0c9-e1c4-48f0-be55-fbe20dd06bc9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5c995f8bbbab4368b67a253e0df3971a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T10:07:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 10:25:43 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-972e1ab5-75de-4284-977f-4f533a096c73 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Flavor limits 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 10:25:43 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-972e1ab5-75de-4284-977f-4f533a096c73 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Image limits 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 10:25:43 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-972e1ab5-75de-4284-977f-4f533a096c73 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Flavor pref 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 10:25:43 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-972e1ab5-75de-4284-977f-4f533a096c73 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Image pref 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 10:25:43 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-972e1ab5-75de-4284-977f-4f533a096c73 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 10:25:43 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-972e1ab5-75de-4284-977f-4f533a096c73 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 10:25:43 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-972e1ab5-75de-4284-977f-4f533a096c73 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73572) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 10:25:43 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-972e1ab5-75de-4284-977f-4f533a096c73 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Got 1 possible topologies {{(pid=73572) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 10:25:43 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-972e1ab5-75de-4284-977f-4f533a096c73 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 10:25:43 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-972e1ab5-75de-4284-977f-4f533a096c73 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 10:25:43 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-972e1ab5-75de-4284-977f-4f533a096c73 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T10:25:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-166680841',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-166680841',id=36,image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEWBTOS0AHv6z8RWaiABqHulvjrbLaR96xRD15E/r0t/2UB9/kL95/Qkv/M3GvF6W0m+wG/rQ4SeVcwMM5A26UfTmnRR7kQj+Z+7W0aLcHEsnrsN1N0vrrqZEDPZaXipgQ==',key_name='tempest-keypair-1985542231',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c7e16843614c451d958e817c832d4cbc',ramdisk_id='',reservation_id='r-xx7zocnt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-706965180',owner_user_name='tempest-AttachVolumeShelveTestJSON-706965180-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T10:25:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='17243251fe57431c9c98195a16239c5f',uuid=6004b15a-be01-42eb-92ba-ae9d93dab708,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8c801229-2284-4cd5-bdce-45c96edfe633", "address": "fa:16:3e:5a:0e:fa", "network": {"id": "317d2681-96ce-4898-b6fb-8892ee6f706d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2049963835-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7e16843614c451d958e817c832d4cbc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c801229-22", "ovs_interfaceid": "8c801229-2284-4cd5-bdce-45c96edfe633", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73572) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 10:25:43 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-972e1ab5-75de-4284-977f-4f533a096c73 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Converting VIF {"id": "8c801229-2284-4cd5-bdce-45c96edfe633", "address": "fa:16:3e:5a:0e:fa", "network": {"id": "317d2681-96ce-4898-b6fb-8892ee6f706d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2049963835-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7e16843614c451d958e817c832d4cbc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c801229-22", "ovs_interfaceid": "8c801229-2284-4cd5-bdce-45c96edfe633", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:25:43 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-972e1ab5-75de-4284-977f-4f533a096c73 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:0e:fa,bridge_name='br-int',has_traffic_filtering=True,id=8c801229-2284-4cd5-bdce-45c96edfe633,network=Network(317d2681-96ce-4898-b6fb-8892ee6f706d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c801229-22') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:25:43 user nova-compute[73572]: DEBUG nova.objects.instance [None req-972e1ab5-75de-4284-977f-4f533a096c73 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Lazy-loading 'pci_devices' on Instance uuid 6004b15a-be01-42eb-92ba-ae9d93dab708 {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:25:43 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:133098b2-106a-427f-aa6d-2c10625dd152 -p 172.16.0.220:3260" returned: 0 in 0.019s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:25:43 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ec7a5cb-15e7-472c-9052-e7474c13e006]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:133098b2-106a-427f-aa6d-2c10625dd152\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = RvoAbQip\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:25:43 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b976b48-e63d-425e-bea5-fb2dc786f622 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 26 10:25:43 user nova-compute[73572]: node.name = iqn.2010-10.org.openstack:133098b2-106a-427f-aa6d-2c10625dd152
Aug 26 10:25:43 user nova-compute[73572]: node.tpgt = -1
Aug 26 10:25:43 user nova-compute[73572]: node.startup = automatic
Aug 26 10:25:43 user nova-compute[73572]: node.leading_login = No
Aug 26 10:25:43 user nova-compute[73572]: iface.iscsi_ifacename = default
Aug 26 10:25:43 user nova-compute[73572]: iface.net_ifacename = <empty>
Aug 26 10:25:43 user nova-compute[73572]: iface.ipaddress = <empty>
Aug 26 10:25:43 user nova-compute[73572]: iface.prefix_len = 0
Aug 26 10:25:43 user nova-compute[73572]: iface.hwaddress = <empty>
Aug 26 10:25:43 user nova-compute[73572]: iface.transport_name = tcp
Aug 26 10:25:43 user nova-compute[73572]: iface.initiatorname = <empty>
Aug 26 10:25:43 user nova-compute[73572]: iface.state = <empty>
Aug 26 10:25:43 user nova-compute[73572]: iface.vlan_id = 0
Aug 26 10:25:43 user nova-compute[73572]: iface.vlan_priority = 0
Aug 26 10:25:43 user nova-compute[73572]: iface.vlan_state = <empty>
Aug 26 10:25:43 user nova-compute[73572]: iface.iface_num = 0
Aug 26 10:25:43 user nova-compute[73572]: iface.mtu = 0
Aug 26 10:25:43 user nova-compute[73572]: iface.port = 0
Aug 26 10:25:43 user nova-compute[73572]: iface.bootproto = <empty>
Aug 26 10:25:43 user nova-compute[73572]: iface.subnet_mask = <empty>
Aug 26 10:25:43 user nova-compute[73572]: iface.gateway = <empty>
Aug 26 10:25:43 user nova-compute[73572]: iface.dhcp_alt_client_id_state = <empty>
Aug 26 10:25:43 user nova-compute[73572]: iface.dhcp_alt_client_id = <empty>
Aug 26 10:25:43 user nova-compute[73572]: iface.dhcp_dns = <empty>
Aug 26 10:25:43 user nova-compute[73572]: iface.dhcp_learn_iqn = <empty>
Aug 26 10:25:43 user nova-compute[73572]: iface.dhcp_req_vendor_id_state = <empty>
Aug 26 10:25:43 user nova-compute[73572]: iface.dhcp_vendor_id_state = <empty>
Aug 26 10:25:43 user nova-compute[73572]: iface.dhcp_vendor_id = <empty>
Aug 26 10:25:43 user nova-compute[73572]: iface.dhcp_slp_da = <empty>
Aug 26 10:25:43 user nova-compute[73572]: iface.fragmentation = <empty>
Aug 26 10:25:43 user nova-compute[73572]: iface.gratuitous_arp = <empty>
Aug 26 10:25:43 user nova-compute[73572]: iface.incoming_forwarding = <empty>
Aug 26 10:25:43 user nova-compute[73572]: iface.tos_state = <empty>
Aug 26 10:25:43 user nova-compute[73572]: iface.tos = 0
Aug 26 10:25:43 user nova-compute[73572]: iface.ttl = 0
Aug 26 10:25:43 user nova-compute[73572]: iface.delayed_ack = <empty>
Aug 26 10:25:43 user nova-compute[73572]: iface.tcp_nagle = <empty>
Aug 26 10:25:43 user nova-compute[73572]: iface.tcp_wsf_state = <empty>
Aug 26 10:25:43 user nova-compute[73572]: iface.tcp_wsf = 0
Aug 26 10:25:43 user nova-compute[73572]: iface.tcp_timer_scale = 0
Aug 26 10:25:43 user nova-compute[73572]: iface.tcp_timestamp = <empty>
Aug 26 10:25:43 user nova-compute[73572]: iface.redirect = <empty>
Aug 26 10:25:43 user nova-compute[73572]: iface.def_task_mgmt_timeout = 0
Aug 26 10:25:43 user nova-compute[73572]: iface.header_digest = <empty>
Aug 26 10:25:43 user nova-compute[73572]: iface.data_digest = <empty>
Aug 26 10:25:43 user nova-compute[73572]: iface.immediate_data = <empty>
Aug 26 10:25:43 user nova-compute[73572]: iface.initial_r2t = <empty>
Aug 26 10:25:43 user nova-compute[73572]: iface.data_seq_inorder = <empty>
Aug 26 10:25:43 user nova-compute[73572]: iface.data_pdu_inorder = <empty>
Aug 26 10:25:43 user nova-compute[73572]: iface.erl = 0
Aug 26 10:25:43 user nova-compute[73572]: iface.max_receive_data_len = 0
Aug 26 10:25:43 user nova-compute[73572]: iface.first_burst_len = 0
Aug 26 10:25:43 user nova-compute[73572]: iface.max_outstanding_r2t = 0
Aug 26 10:25:43 user nova-compute[73572]: iface.max_burst_len = 0
Aug 26 10:25:43 user nova-compute[73572]: iface.chap_auth = <empty>
Aug 26 10:25:43 user nova-compute[73572]: iface.bidi_chap = <empty>
Aug 26 10:25:43 user nova-compute[73572]: iface.strict_login_compliance = <empty>
Aug 26 10:25:43 user nova-compute[73572]: iface.discovery_auth = <empty>
Aug 26 10:25:43 user nova-compute[73572]: iface.discovery_logout = <empty>
Aug 26 10:25:43 user nova-compute[73572]: node.discovery_address = <empty>
Aug 26 10:25:43 user nova-compute[73572]: node.discovery_port = 0
Aug 26 10:25:43 user nova-compute[73572]: node.discovery_type = static
Aug 26 10:25:43 user nova-compute[73572]: node.session.initial_cmdsn = 0
Aug 26 10:25:43 user nova-compute[73572]: node.session.initial_login_retry_max = 8
Aug 26 10:25:43 user nova-compute[73572]: node.session.xmit_thread_priority = -20
Aug 26 10:25:43 user nova-compute[73572]: node.session.cmds_max = 128
Aug 26 10:25:43 user nova-compute[73572]: node.session.queue_depth = 32
Aug 26 10:25:43 user nova-compute[73572]: node.session.nr_sessions = 1
Aug 26 10:25:43 user nova-compute[73572]: node.session.auth.authmethod = CHAP
Aug 26 10:25:43 user nova-compute[73572]: node.session.auth.username = RvoAbQip
Aug 26 10:25:43 user nova-compute[73572]: node.session.auth.password = ***
Aug 26 10:25:43 user nova-compute[73572]: node.session.auth.username_in = <empty>
Aug 26 10:25:43 user nova-compute[73572]: node.session.auth.password_in = <empty>
Aug 26 10:25:43 user nova-compute[73572]: node.session.auth.chap_algs = MD5
Aug 26 10:25:43 user nova-compute[73572]: node.session.timeo.replacement_timeout = 120
Aug 26 10:25:43 user nova-compute[73572]: node.session.err_timeo.abort_timeout = 15
Aug 26 10:25:43 user nova-compute[73572]: node.session.err_timeo.lu_reset_timeout = 30
Aug 26 10:25:43 user nova-compute[73572]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 26 10:25:43 user nova-compute[73572]: node.session.err_timeo.host_reset_timeout = 60
Aug 26 10:25:43 user nova-compute[73572]: node.session.iscsi.FastAbort = Yes
Aug 26 10:25:43 user nova-compute[73572]: node.session.iscsi.InitialR2T = No
Aug 26 10:25:43 user nova-compute[73572]: node.session.iscsi.ImmediateData = Yes
Aug 26 10:25:43 user nova-compute[73572]: node.session.iscsi.FirstBurstLength = 262144
Aug 26 10:25:43 user nova-compute[73572]: node.session.iscsi.MaxBurstLength = 16776192
Aug 26 10:25:43 user nova-compute[73572]: node.session.iscsi.DefaultTime2Retain = 0
Aug 26 10:25:43 user nova-compute[73572]: node.session.iscsi.DefaultTime2Wait = 2
Aug 26 10:25:43 user nova-compute[73572]: node.session.iscsi.MaxConnections = 1
Aug 26 10:25:43 user nova-compute[73572]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 26 10:25:43 user nova-compute[73572]: node.session.iscsi.ERL = 0
Aug 26 10:25:43 user nova-compute[73572]: node.session.scan = manual
Aug 26 10:25:43 user nova-compute[73572]: node.session.reopen_max = 0
Aug 26 10:25:43 user nova-compute[73572]: node.conn[0].address = 172.16.0.220
Aug 26 10:25:43 user nova-compute[73572]: node.conn[0].port = 3260
Aug 26 10:25:43 user nova-compute[73572]: node.conn[0].startup = manual
Aug 26 10:25:43 user nova-compute[73572]: node.conn[0].tcp.window_size = 524288
Aug 26 10:25:43 user nova-compute[73572]: node.conn[0].tcp.type_of_service = 0
Aug 26 10:25:43 user nova-compute[73572]: node.conn[0].timeo.logout_timeout = 15
Aug 26 10:25:43 user nova-compute[73572]: node.conn[0].timeo.login_timeout = 15
Aug 26 10:25:43 user nova-compute[73572]: node.conn[0].timeo.auth_timeout = 45
Aug 26 10:25:43 user nova-compute[73572]: node.conn[0].timeo.noop_out_interval = 5
Aug 26 10:25:43 user nova-compute[73572]: node.conn[0].timeo.noop_out_timeout = 5
Aug 26 10:25:43 user nova-compute[73572]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 26 10:25:43 user nova-compute[73572]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 26 10:25:43 user nova-compute[73572]: node.conn[0].iscsi.HeaderDigest = None
Aug 26 10:25:43 user nova-compute[73572]: node.conn[0].iscsi.DataDigest = None
Aug 26 10:25:43 user nova-compute[73572]: node.conn[0].iscsi.IFMarker = No
Aug 26 10:25:43 user nova-compute[73572]: node.conn[0].iscsi.OFMarker = No
Aug 26 10:25:43 user nova-compute[73572]: # END RECORD
Aug 26 10:25:43 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:25:43 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:133098b2-106a-427f-aa6d-2c10625dd152 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:25:43 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-972e1ab5-75de-4284-977f-4f533a096c73 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] [instance: 6004b15a-be01-42eb-92ba-ae9d93dab708] End _get_guest_xml xml=<domain type="kvm">
Aug 26 10:25:43 user nova-compute[73572]:   <uuid>6004b15a-be01-42eb-92ba-ae9d93dab708</uuid>
Aug 26 10:25:43 user nova-compute[73572]:   <name>instance-00000024</name>
Aug 26 10:25:43 user nova-compute[73572]:   <memory>524288</memory>
Aug 26 10:25:43 user nova-compute[73572]:   <vcpu>1</vcpu>
Aug 26 10:25:43 user nova-compute[73572]:   <metadata>
Aug 26 10:25:43 user nova-compute[73572]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 10:25:43 user nova-compute[73572]:       <nova:package version="0.0.0"/>
Aug 26 10:25:43 user nova-compute[73572]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-166680841</nova:name>
Aug 26 10:25:43 user nova-compute[73572]:       <nova:creationTime>2023-08-26 10:25:43</nova:creationTime>
Aug 26 10:25:43 user nova-compute[73572]:       <nova:flavor name="m1.tiny">
Aug 26 10:25:43 user nova-compute[73572]:         <nova:memory>512</nova:memory>
Aug 26 10:25:43 user nova-compute[73572]:         <nova:disk>1</nova:disk>
Aug 26 10:25:43 user nova-compute[73572]:         <nova:swap>0</nova:swap>
Aug 26 10:25:43 user nova-compute[73572]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 10:25:43 user nova-compute[73572]:         <nova:vcpus>1</nova:vcpus>
Aug 26 10:25:43 user nova-compute[73572]:       </nova:flavor>
Aug 26 10:25:43 user nova-compute[73572]:       <nova:owner>
Aug 26 10:25:43 user nova-compute[73572]:         <nova:user uuid="17243251fe57431c9c98195a16239c5f">tempest-AttachVolumeShelveTestJSON-706965180-project-member</nova:user>
Aug 26 10:25:43 user nova-compute[73572]:         <nova:project uuid="c7e16843614c451d958e817c832d4cbc">tempest-AttachVolumeShelveTestJSON-706965180</nova:project>
Aug 26 10:25:43 user nova-compute[73572]:       </nova:owner>
Aug 26 10:25:43 user nova-compute[73572]:       <nova:root type="image" uuid="299da0c9-e1c4-48f0-be55-fbe20dd06bc9"/>
Aug 26 10:25:43 user nova-compute[73572]:       <nova:ports>
Aug 26 10:25:43 user nova-compute[73572]:         <nova:port uuid="8c801229-2284-4cd5-bdce-45c96edfe633">
Aug 26 10:25:43 user nova-compute[73572]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 26 10:25:43 user nova-compute[73572]:         </nova:port>
Aug 26 10:25:43 user nova-compute[73572]:       </nova:ports>
Aug 26 10:25:43 user nova-compute[73572]:     </nova:instance>
Aug 26 10:25:43 user nova-compute[73572]:   </metadata>
Aug 26 10:25:43 user nova-compute[73572]:   <sysinfo type="smbios">
Aug 26 10:25:43 user nova-compute[73572]:     <system>
Aug 26 10:25:43 user nova-compute[73572]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 10:25:43 user nova-compute[73572]:       <entry name="product">OpenStack Nova</entry>
Aug 26 10:25:43 user nova-compute[73572]:       <entry name="version">0.0.0</entry>
Aug 26 10:25:43 user nova-compute[73572]:       <entry name="serial">6004b15a-be01-42eb-92ba-ae9d93dab708</entry>
Aug 26 10:25:43 user nova-compute[73572]:       <entry name="uuid">6004b15a-be01-42eb-92ba-ae9d93dab708</entry>
Aug 26 10:25:43 user nova-compute[73572]:       <entry name="family">Virtual Machine</entry>
Aug 26 10:25:43 user nova-compute[73572]:     </system>
Aug 26 10:25:43 user nova-compute[73572]:   </sysinfo>
Aug 26 10:25:43 user nova-compute[73572]:   <os>
Aug 26 10:25:43 user nova-compute[73572]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 10:25:43 user nova-compute[73572]:     <boot dev="hd"/>
Aug 26 10:25:43 user nova-compute[73572]:     <smbios mode="sysinfo"/>
Aug 26 10:25:43 user nova-compute[73572]:   </os>
Aug 26 10:25:43 user nova-compute[73572]:   <features>
Aug 26 10:25:43 user nova-compute[73572]:     <acpi/>
Aug 26 10:25:43 user nova-compute[73572]:     <apic/>
Aug 26 10:25:43 user nova-compute[73572]:     <vmcoreinfo/>
Aug 26 10:25:43 user nova-compute[73572]:   </features>
Aug 26 10:25:43 user nova-compute[73572]:   <clock offset="utc">
Aug 26 10:25:43 user nova-compute[73572]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 10:25:43 user nova-compute[73572]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 10:25:43 user nova-compute[73572]:     <timer name="hpet" present="no"/>
Aug 26 10:25:43 user nova-compute[73572]:   </clock>
Aug 26 10:25:43 user nova-compute[73572]:   <cpu mode="custom" match="exact">
Aug 26 10:25:43 user nova-compute[73572]:     <model>Nehalem</model>
Aug 26 10:25:43 user nova-compute[73572]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 10:25:43 user nova-compute[73572]:   </cpu>
Aug 26 10:25:43 user nova-compute[73572]:   <devices>
Aug 26 10:25:43 user nova-compute[73572]:     <disk type="file" device="disk">
Aug 26 10:25:43 user nova-compute[73572]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 10:25:43 user nova-compute[73572]:       <source file="/opt/stack/data/nova/instances/6004b15a-be01-42eb-92ba-ae9d93dab708/disk"/>
Aug 26 10:25:43 user nova-compute[73572]:       <target dev="vda" bus="virtio"/>
Aug 26 10:25:43 user nova-compute[73572]:     </disk>
Aug 26 10:25:43 user nova-compute[73572]:     <interface type="ethernet">
Aug 26 10:25:43 user nova-compute[73572]:       <mac address="fa:16:3e:5a:0e:fa"/>
Aug 26 10:25:43 user nova-compute[73572]:       <model type="virtio"/>
Aug 26 10:25:43 user nova-compute[73572]:       <mtu size="1442"/>
Aug 26 10:25:43 user nova-compute[73572]:       <target dev="tap8c801229-22"/>
Aug 26 10:25:43 user nova-compute[73572]:     </interface>
Aug 26 10:25:43 user nova-compute[73572]:     <serial type="pty">
Aug 26 10:25:43 user nova-compute[73572]:       <log file="/opt/stack/data/nova/instances/6004b15a-be01-42eb-92ba-ae9d93dab708/console.log" append="off"/>
Aug 26 10:25:43 user nova-compute[73572]:     </serial>
Aug 26 10:25:43 user nova-compute[73572]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 10:25:43 user nova-compute[73572]:     <video>
Aug 26 10:25:43 user nova-compute[73572]:       <model type="virtio"/>
Aug 26 10:25:43 user nova-compute[73572]:     </video>
Aug 26 10:25:43 user nova-compute[73572]:     <rng model="virtio">
Aug 26 10:25:43 user nova-compute[73572]:       <backend model="random">/dev/urandom</backend>
Aug 26 10:25:43 user nova-compute[73572]:     </rng>
Aug 26 10:25:43 user nova-compute[73572]:     <controller type="usb" index="0" model="none"/>
Aug 26 10:25:43 user nova-compute[73572]:     <memballoon model="virtio">
Aug 26 10:25:43 user nova-compute[73572]:       <stats period="10"/>
Aug 26 10:25:43 user nova-compute[73572]:     </memballoon>
Aug 26 10:25:43 user nova-compute[73572]:   </devices>
Aug 26 10:25:43 user nova-compute[73572]: </domain>
Aug 26 10:25:43 user nova-compute[73572]:  {{(pid=73572) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 10:25:43 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-972e1ab5-75de-4284-977f-4f533a096c73 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T10:25:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-166680841',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-166680841',id=36,image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEWBTOS0AHv6z8RWaiABqHulvjrbLaR96xRD15E/r0t/2UB9/kL95/Qkv/M3GvF6W0m+wG/rQ4SeVcwMM5A26UfTmnRR7kQj+Z+7W0aLcHEsnrsN1N0vrrqZEDPZaXipgQ==',key_name='tempest-keypair-1985542231',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c7e16843614c451d958e817c832d4cbc',ramdisk_id='',reservation_id='r-xx7zocnt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-706965180',owner_user_name='tempest-AttachVolumeShelveTestJSON-706965180-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T10:25:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='17243251fe57431c9c98195a16239c5f',uuid=6004b15a-be01-42eb-92ba-ae9d93dab708,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8c801229-2284-4cd5-bdce-45c96edfe633", "address": "fa:16:3e:5a:0e:fa", "network": {"id": "317d2681-96ce-4898-b6fb-8892ee6f706d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2049963835-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7e16843614c451d958e817c832d4cbc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c801229-22", "ovs_interfaceid": "8c801229-2284-4cd5-bdce-45c96edfe633", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 10:25:43 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-972e1ab5-75de-4284-977f-4f533a096c73 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Converting VIF {"id": "8c801229-2284-4cd5-bdce-45c96edfe633", "address": "fa:16:3e:5a:0e:fa", "network": {"id": "317d2681-96ce-4898-b6fb-8892ee6f706d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2049963835-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7e16843614c451d958e817c832d4cbc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c801229-22", "ovs_interfaceid": "8c801229-2284-4cd5-bdce-45c96edfe633", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:25:43 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-972e1ab5-75de-4284-977f-4f533a096c73 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:0e:fa,bridge_name='br-int',has_traffic_filtering=True,id=8c801229-2284-4cd5-bdce-45c96edfe633,network=Network(317d2681-96ce-4898-b6fb-8892ee6f706d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c801229-22') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:25:43 user nova-compute[73572]: DEBUG os_vif [None req-972e1ab5-75de-4284-977f-4f533a096c73 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:0e:fa,bridge_name='br-int',has_traffic_filtering=True,id=8c801229-2284-4cd5-bdce-45c96edfe633,network=Network(317d2681-96ce-4898-b6fb-8892ee6f706d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c801229-22') {{(pid=73572) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 10:25:43 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:25:43 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:25:43 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 10:25:43 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:25:43 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8c801229-22, may_exist=True, interface_attrs={}) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:25:43 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8c801229-22, col_values=(('external_ids', {'iface-id': '8c801229-2284-4cd5-bdce-45c96edfe633', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5a:0e:fa', 'vm-uuid': '6004b15a-be01-42eb-92ba-ae9d93dab708'}),), if_exists=True) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:25:43 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:25:43 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:25:43 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:133098b2-106a-427f-aa6d-2c10625dd152 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:25:43 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[d81b7569-701f-49d2-9504-74683c1cc6f9]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:25:43 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b976b48-e63d-425e-bea5-fb2dc786f622 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:25:43 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:133098b2-106a-427f-aa6d-2c10625dd152 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:25:43 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:25:43 user nova-compute[73572]: INFO os_vif [None req-972e1ab5-75de-4284-977f-4f533a096c73 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:0e:fa,bridge_name='br-int',has_traffic_filtering=True,id=8c801229-2284-4cd5-bdce-45c96edfe633,network=Network(317d2681-96ce-4898-b6fb-8892ee6f706d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c801229-22')
Aug 26 10:25:43 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:133098b2-106a-427f-aa6d-2c10625dd152 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:25:43 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[77b5f0f6-1f34-48a8-b48a-d7b82bc7c26e]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:25:43 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b976b48-e63d-425e-bea5-fb2dc786f622 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:25:43 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:133098b2-106a-427f-aa6d-2c10625dd152 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RvoAbQip {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:25:43 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:133098b2-106a-427f-aa6d-2c10625dd152 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RvoAbQip" returned: 0 in 0.022s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:25:43 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf7428f9-ce9f-47d2-b16e-237f24f79c9d]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:25:43 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b976b48-e63d-425e-bea5-fb2dc786f622 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RvoAbQip'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:25:43 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:133098b2-106a-427f-aa6d-2c10625dd152 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:25:43 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:133098b2-106a-427f-aa6d-2c10625dd152 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:25:43 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[587a2c7d-b50a-4642-a656-feef27949589]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:25:43 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b976b48-e63d-425e-bea5-fb2dc786f622 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:25:43 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:25:43 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-972e1ab5-75de-4284-977f-4f533a096c73 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] No BDM found with device name vda, not building metadata. {{(pid=73572) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 10:25:43 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-972e1ab5-75de-4284-977f-4f533a096c73 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] No VIF found with MAC fa:16:3e:5a:0e:fa, not building metadata {{(pid=73572) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 10:25:43 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:25:43 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5adb0ec-a64b-4612-993e-21c8eed00db3]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133098b2-106a-427f-aa6d-2c10625dd152 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc0a3246-82a0-4d2f-9877-8a072dccf064 (non-flash)\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:25:43 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b976b48-e63d-425e-bea5-fb2dc786f622 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)
Aug 26 10:25:43 user nova-compute[73572]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133098b2-106a-427f-aa6d-2c10625dd152 (non-flash)
Aug 26 10:25:43 user nova-compute[73572]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc0a3246-82a0-4d2f-9877-8a072dccf064 (non-flash)
Aug 26 10:25:43 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 10:25:43 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b976b48-e63d-425e-bea5-fb2dc786f622 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)
Aug 26 10:25:43 user nova-compute[73572]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133098b2-106a-427f-aa6d-2c10625dd152 (non-flash)
Aug 26 10:25:43 user nova-compute[73572]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc0a3246-82a0-4d2f-9877-8a072dccf064 (non-flash)
Aug 26 10:25:43 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 10:25:43 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-3b976b48-e63d-425e-bea5-fb2dc786f622 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:133098b2-106a-427f-aa6d-2c10625dd152" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.185s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 10:25:43 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b976b48-e63d-425e-bea5-fb2dc786f622 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Connected to 172.16.0.220:3260 {{(pid=73572) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 10:25:43 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-3b976b48-e63d-425e-bea5-fb2dc786f622 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] HCTL ('36', '0', '0', 0) found on session 34 with lun 0 {{(pid=73572) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 10:25:43 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-3b976b48-e63d-425e-bea5-fb2dc786f622 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Scanning host 36 c: 0, t: 0, l: 0) {{(pid=73572) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 10:25:43 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:25:43 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.014s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:25:43 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9dd2645-717a-4e63-a8e1-a81765e87d87]: (4, ('0 0 0', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:25:43 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-3b976b48-e63d-425e-bea5-fb2dc786f622 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Searching for a device in session 34 and hctl ('36', '0', '0', 0) yield: sde {{(pid=73572) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 10:25:43 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b976b48-e63d-425e-bea5-fb2dc786f622 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RvoAbQip', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73572) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 10:25:43 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-3b976b48-e63d-425e-bea5-fb2dc786f622 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.209s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 10:25:43 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b976b48-e63d-425e-bea5-fb2dc786f622 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] <== connect_volume: return (210ms) {'type': 'block', 'scsi_wwn': '23933326438653337', 'path': '/dev/sde'} {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 10:25:43 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b976b48-e63d-425e-bea5-fb2dc786f622 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: 8a8816e5-696d-4384-b0e0-29aa7cdd957c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23933326438653337', 'path': '/dev/sde'} {{(pid=73572) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 10:25:43 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-3b976b48-e63d-425e-bea5-fb2dc786f622 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T10:23:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1498662503',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1498662503',id=33,image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T10:24:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4636f93c5bfc4653804de097aed2882c',ramdisk_id='',reservation_id='r-96kck33c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-665602868',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T10:24:18Z,user_data=None,user_id='07f3538038a14713af3bbe420f1fb03a',uuid=8a8816e5-696d-4384-b0e0-29aa7cdd957c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2e650fb9-427c-477e-ba45-ddc070399617", "address": "fa:16:3e:6c:94:14", "network": {"id": "991b9dff-5173-4456-a530-b1f7eb5cfa4a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1845930297-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1845930297-network", "vif_mac": "fa:16:3e:6c:94:14"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4636f93c5bfc4653804de097aed2882c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e650fb9-42", "ovs_interfaceid": "2e650fb9-427c-477e-ba45-ddc070399617", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73572) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 10:25:43 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-3b976b48-e63d-425e-bea5-fb2dc786f622 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Converting VIF {"id": "2e650fb9-427c-477e-ba45-ddc070399617", "address": "fa:16:3e:6c:94:14", "network": {"id": "991b9dff-5173-4456-a530-b1f7eb5cfa4a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1845930297-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1845930297-network", "vif_mac": "fa:16:3e:6c:94:14"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4636f93c5bfc4653804de097aed2882c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e650fb9-42", "ovs_interfaceid": "2e650fb9-427c-477e-ba45-ddc070399617", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:25:43 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-3b976b48-e63d-425e-bea5-fb2dc786f622 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6c:94:14,bridge_name='br-int',has_traffic_filtering=True,id=2e650fb9-427c-477e-ba45-ddc070399617,network=Network(991b9dff-5173-4456-a530-b1f7eb5cfa4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e650fb9-42') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:25:43 user nova-compute[73572]: DEBUG nova.objects.instance [None req-3b976b48-e63d-425e-bea5-fb2dc786f622 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Lazy-loading 'pci_devices' on Instance uuid 8a8816e5-696d-4384-b0e0-29aa7cdd957c {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:25:43 user nova-compute[73572]: DEBUG nova.objects.base [None req-3b976b48-e63d-425e-bea5-fb2dc786f622 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Object Instance<8a8816e5-696d-4384-b0e0-29aa7cdd957c> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=73572) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 10:25:43 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-3b976b48-e63d-425e-bea5-fb2dc786f622 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: 8a8816e5-696d-4384-b0e0-29aa7cdd957c] End _get_guest_xml xml=<domain type="kvm">
Aug 26 10:25:43 user nova-compute[73572]:   <uuid>8a8816e5-696d-4384-b0e0-29aa7cdd957c</uuid>
Aug 26 10:25:43 user nova-compute[73572]:   <name>instance-00000021</name>
Aug 26 10:25:43 user nova-compute[73572]:   <memory>524288</memory>
Aug 26 10:25:43 user nova-compute[73572]:   <vcpu>1</vcpu>
Aug 26 10:25:43 user nova-compute[73572]:   <metadata>
Aug 26 10:25:43 user nova-compute[73572]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 10:25:43 user nova-compute[73572]:       <nova:package version="0.0.0"/>
Aug 26 10:25:43 user nova-compute[73572]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1498662503</nova:name>
Aug 26 10:25:43 user nova-compute[73572]:       <nova:creationTime>2023-08-26 10:25:43</nova:creationTime>
Aug 26 10:25:43 user nova-compute[73572]:       <nova:flavor name="m1.tiny">
Aug 26 10:25:43 user nova-compute[73572]:         <nova:memory>512</nova:memory>
Aug 26 10:25:43 user nova-compute[73572]:         <nova:disk>1</nova:disk>
Aug 26 10:25:43 user nova-compute[73572]:         <nova:swap>0</nova:swap>
Aug 26 10:25:43 user nova-compute[73572]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 10:25:43 user nova-compute[73572]:         <nova:vcpus>1</nova:vcpus>
Aug 26 10:25:43 user nova-compute[73572]:       </nova:flavor>
Aug 26 10:25:43 user nova-compute[73572]:       <nova:owner>
Aug 26 10:25:43 user nova-compute[73572]:         <nova:user uuid="07f3538038a14713af3bbe420f1fb03a">tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member</nova:user>
Aug 26 10:25:43 user nova-compute[73572]:         <nova:project uuid="4636f93c5bfc4653804de097aed2882c">tempest-ServerBootFromVolumeStableRescueTest-665602868</nova:project>
Aug 26 10:25:43 user nova-compute[73572]:       </nova:owner>
Aug 26 10:25:43 user nova-compute[73572]:       <nova:root type="image" uuid="299da0c9-e1c4-48f0-be55-fbe20dd06bc9"/>
Aug 26 10:25:43 user nova-compute[73572]:       <nova:ports>
Aug 26 10:25:43 user nova-compute[73572]:         <nova:port uuid="2e650fb9-427c-477e-ba45-ddc070399617">
Aug 26 10:25:43 user nova-compute[73572]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 26 10:25:43 user nova-compute[73572]:         </nova:port>
Aug 26 10:25:43 user nova-compute[73572]:       </nova:ports>
Aug 26 10:25:43 user nova-compute[73572]:     </nova:instance>
Aug 26 10:25:43 user nova-compute[73572]:   </metadata>
Aug 26 10:25:43 user nova-compute[73572]:   <sysinfo type="smbios">
Aug 26 10:25:43 user nova-compute[73572]:     <system>
Aug 26 10:25:43 user nova-compute[73572]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 10:25:43 user nova-compute[73572]:       <entry name="product">OpenStack Nova</entry>
Aug 26 10:25:43 user nova-compute[73572]:       <entry name="version">0.0.0</entry>
Aug 26 10:25:43 user nova-compute[73572]:       <entry name="serial">8a8816e5-696d-4384-b0e0-29aa7cdd957c</entry>
Aug 26 10:25:43 user nova-compute[73572]:       <entry name="uuid">8a8816e5-696d-4384-b0e0-29aa7cdd957c</entry>
Aug 26 10:25:43 user nova-compute[73572]:       <entry name="family">Virtual Machine</entry>
Aug 26 10:25:43 user nova-compute[73572]:     </system>
Aug 26 10:25:43 user nova-compute[73572]:   </sysinfo>
Aug 26 10:25:43 user nova-compute[73572]:   <os>
Aug 26 10:25:43 user nova-compute[73572]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 10:25:43 user nova-compute[73572]:     <smbios mode="sysinfo"/>
Aug 26 10:25:43 user nova-compute[73572]:   </os>
Aug 26 10:25:43 user nova-compute[73572]:   <features>
Aug 26 10:25:43 user nova-compute[73572]:     <acpi/>
Aug 26 10:25:43 user nova-compute[73572]:     <apic/>
Aug 26 10:25:43 user nova-compute[73572]:     <vmcoreinfo/>
Aug 26 10:25:43 user nova-compute[73572]:   </features>
Aug 26 10:25:43 user nova-compute[73572]:   <clock offset="utc">
Aug 26 10:25:43 user nova-compute[73572]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 10:25:43 user nova-compute[73572]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 10:25:43 user nova-compute[73572]:     <timer name="hpet" present="no"/>
Aug 26 10:25:43 user nova-compute[73572]:   </clock>
Aug 26 10:25:43 user nova-compute[73572]:   <cpu mode="custom" match="exact">
Aug 26 10:25:43 user nova-compute[73572]:     <model>Nehalem</model>
Aug 26 10:25:43 user nova-compute[73572]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 10:25:43 user nova-compute[73572]:   </cpu>
Aug 26 10:25:43 user nova-compute[73572]:   <devices>
Aug 26 10:25:43 user nova-compute[73572]:     <disk type="block" device="disk">
Aug 26 10:25:43 user nova-compute[73572]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 10:25:43 user nova-compute[73572]:       <source dev="/dev/sde"/>
Aug 26 10:25:43 user nova-compute[73572]:       <target dev="vda" bus="virtio"/>
Aug 26 10:25:43 user nova-compute[73572]:       <serial>133098b2-106a-427f-aa6d-2c10625dd152</serial>
Aug 26 10:25:43 user nova-compute[73572]:     </disk>
Aug 26 10:25:43 user nova-compute[73572]:     <disk type="file" device="disk">
Aug 26 10:25:43 user nova-compute[73572]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 10:25:43 user nova-compute[73572]:       <source file="/opt/stack/data/nova/instances/8a8816e5-696d-4384-b0e0-29aa7cdd957c/disk.rescue"/>
Aug 26 10:25:43 user nova-compute[73572]:       <target dev="vdb" bus="virtio"/>
Aug 26 10:25:43 user nova-compute[73572]:       <boot order="1"/>
Aug 26 10:25:43 user nova-compute[73572]:     </disk>
Aug 26 10:25:43 user nova-compute[73572]:     <interface type="ethernet">
Aug 26 10:25:43 user nova-compute[73572]:       <mac address="fa:16:3e:6c:94:14"/>
Aug 26 10:25:43 user nova-compute[73572]:       <model type="virtio"/>
Aug 26 10:25:43 user nova-compute[73572]:       <mtu size="1442"/>
Aug 26 10:25:43 user nova-compute[73572]:       <target dev="tap2e650fb9-42"/>
Aug 26 10:25:43 user nova-compute[73572]:     </interface>
Aug 26 10:25:43 user nova-compute[73572]:     <serial type="pty">
Aug 26 10:25:43 user nova-compute[73572]:       <log file="/opt/stack/data/nova/instances/8a8816e5-696d-4384-b0e0-29aa7cdd957c/console.log" append="off"/>
Aug 26 10:25:43 user nova-compute[73572]:     </serial>
Aug 26 10:25:43 user nova-compute[73572]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 10:25:43 user nova-compute[73572]:     <video>
Aug 26 10:25:43 user nova-compute[73572]:       <model type="virtio"/>
Aug 26 10:25:43 user nova-compute[73572]:     </video>
Aug 26 10:25:43 user nova-compute[73572]:     <rng model="virtio">
Aug 26 10:25:43 user nova-compute[73572]:       <backend model="random">/dev/urandom</backend>
Aug 26 10:25:43 user nova-compute[73572]:     </rng>
Aug 26 10:25:43 user nova-compute[73572]:     <controller type="usb" index="0" model="none"/>
Aug 26 10:25:43 user nova-compute[73572]:     <memballoon model="virtio">
Aug 26 10:25:43 user nova-compute[73572]:       <stats period="10"/>
Aug 26 10:25:43 user nova-compute[73572]:     </memballoon>
Aug 26 10:25:43 user nova-compute[73572]:   </devices>
Aug 26 10:25:43 user nova-compute[73572]: </domain>
Aug 26 10:25:43 user nova-compute[73572]:  {{(pid=73572) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 10:25:43 user nova-compute[73572]: INFO nova.virt.libvirt.driver [-] [instance: 8a8816e5-696d-4384-b0e0-29aa7cdd957c] Instance destroyed successfully.
Aug 26 10:25:43 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-3b976b48-e63d-425e-bea5-fb2dc786f622 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] No BDM found with device name vda, not building metadata. {{(pid=73572) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 10:25:43 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-3b976b48-e63d-425e-bea5-fb2dc786f622 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73572) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 10:25:43 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-3b976b48-e63d-425e-bea5-fb2dc786f622 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] No VIF found with MAC fa:16:3e:6c:94:14, not building metadata {{(pid=73572) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 10:25:44 user nova-compute[73572]: DEBUG nova.compute.manager [req-3ff09bc1-f8e7-4930-978c-ca35b8aa858d req-316e5b7f-b46c-4193-b9f3-d6b78551d396 service nova] [instance: 6004b15a-be01-42eb-92ba-ae9d93dab708] Received event network-changed-8c801229-2284-4cd5-bdce-45c96edfe633 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:25:44 user nova-compute[73572]: DEBUG nova.compute.manager [req-3ff09bc1-f8e7-4930-978c-ca35b8aa858d req-316e5b7f-b46c-4193-b9f3-d6b78551d396 service nova] [instance: 6004b15a-be01-42eb-92ba-ae9d93dab708] Refreshing instance network info cache due to event network-changed-8c801229-2284-4cd5-bdce-45c96edfe633. {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 10:25:44 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-3ff09bc1-f8e7-4930-978c-ca35b8aa858d req-316e5b7f-b46c-4193-b9f3-d6b78551d396 service nova] Acquiring lock "refresh_cache-6004b15a-be01-42eb-92ba-ae9d93dab708" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:25:44 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-3ff09bc1-f8e7-4930-978c-ca35b8aa858d req-316e5b7f-b46c-4193-b9f3-d6b78551d396 service nova] Acquired lock "refresh_cache-6004b15a-be01-42eb-92ba-ae9d93dab708" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:25:44 user nova-compute[73572]: DEBUG nova.network.neutron [req-3ff09bc1-f8e7-4930-978c-ca35b8aa858d req-316e5b7f-b46c-4193-b9f3-d6b78551d396 service nova] [instance: 6004b15a-be01-42eb-92ba-ae9d93dab708] Refreshing network info cache for port 8c801229-2284-4cd5-bdce-45c96edfe633 {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 10:25:44 user nova-compute[73572]: DEBUG nova.network.neutron [req-3ff09bc1-f8e7-4930-978c-ca35b8aa858d req-316e5b7f-b46c-4193-b9f3-d6b78551d396 service nova] [instance: 6004b15a-be01-42eb-92ba-ae9d93dab708] Updated VIF entry in instance network info cache for port 8c801229-2284-4cd5-bdce-45c96edfe633. {{(pid=73572) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 10:25:44 user nova-compute[73572]: DEBUG nova.network.neutron [req-3ff09bc1-f8e7-4930-978c-ca35b8aa858d req-316e5b7f-b46c-4193-b9f3-d6b78551d396 service nova] [instance: 6004b15a-be01-42eb-92ba-ae9d93dab708] Updating instance_info_cache with network_info: [{"id": "8c801229-2284-4cd5-bdce-45c96edfe633", "address": "fa:16:3e:5a:0e:fa", "network": {"id": "317d2681-96ce-4898-b6fb-8892ee6f706d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2049963835-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7e16843614c451d958e817c832d4cbc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c801229-22", "ovs_interfaceid": "8c801229-2284-4cd5-bdce-45c96edfe633", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:25:44 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-3ff09bc1-f8e7-4930-978c-ca35b8aa858d req-316e5b7f-b46c-4193-b9f3-d6b78551d396 service nova] Releasing lock "refresh_cache-6004b15a-be01-42eb-92ba-ae9d93dab708" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:25:45 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:25:45 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:25:45 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:25:45 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:25:45 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:25:46 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:25:46 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:25:46 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:25:46 user nova-compute[73572]: DEBUG nova.compute.manager [req-f3df49a6-5df1-4cfb-81f1-29bf42656f2b req-dc6e22ea-af5c-407f-935a-0b7a11ff0779 service nova] [instance: 6004b15a-be01-42eb-92ba-ae9d93dab708] Received event network-vif-plugged-8c801229-2284-4cd5-bdce-45c96edfe633 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:25:46 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-f3df49a6-5df1-4cfb-81f1-29bf42656f2b req-dc6e22ea-af5c-407f-935a-0b7a11ff0779 service nova] Acquiring lock "6004b15a-be01-42eb-92ba-ae9d93dab708-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:25:46 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-f3df49a6-5df1-4cfb-81f1-29bf42656f2b req-dc6e22ea-af5c-407f-935a-0b7a11ff0779 service nova] Lock "6004b15a-be01-42eb-92ba-ae9d93dab708-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:25:46 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-f3df49a6-5df1-4cfb-81f1-29bf42656f2b req-dc6e22ea-af5c-407f-935a-0b7a11ff0779 service nova] Lock "6004b15a-be01-42eb-92ba-ae9d93dab708-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:25:46 user nova-compute[73572]: DEBUG nova.compute.manager [req-f3df49a6-5df1-4cfb-81f1-29bf42656f2b req-dc6e22ea-af5c-407f-935a-0b7a11ff0779 service nova] [instance: 6004b15a-be01-42eb-92ba-ae9d93dab708] No waiting events found dispatching network-vif-plugged-8c801229-2284-4cd5-bdce-45c96edfe633 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:25:46 user nova-compute[73572]: WARNING nova.compute.manager [req-f3df49a6-5df1-4cfb-81f1-29bf42656f2b req-dc6e22ea-af5c-407f-935a-0b7a11ff0779 service nova] [instance: 6004b15a-be01-42eb-92ba-ae9d93dab708] Received unexpected event network-vif-plugged-8c801229-2284-4cd5-bdce-45c96edfe633 for instance with vm_state building and task_state spawning.
Aug 26 10:25:46 user nova-compute[73572]: DEBUG nova.compute.manager [req-7563b0e9-aa41-44ca-a4ce-98c2718f4c94 req-80892147-86d2-4abc-bea1-07d6fe86a252 service nova] [instance: 8a8816e5-696d-4384-b0e0-29aa7cdd957c] Received event network-vif-plugged-2e650fb9-427c-477e-ba45-ddc070399617 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:25:46 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-7563b0e9-aa41-44ca-a4ce-98c2718f4c94 req-80892147-86d2-4abc-bea1-07d6fe86a252 service nova] Acquiring lock "8a8816e5-696d-4384-b0e0-29aa7cdd957c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:25:46 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-7563b0e9-aa41-44ca-a4ce-98c2718f4c94 req-80892147-86d2-4abc-bea1-07d6fe86a252 service nova] Lock "8a8816e5-696d-4384-b0e0-29aa7cdd957c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:25:46 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-7563b0e9-aa41-44ca-a4ce-98c2718f4c94 req-80892147-86d2-4abc-bea1-07d6fe86a252 service nova] Lock "8a8816e5-696d-4384-b0e0-29aa7cdd957c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:25:46 user nova-compute[73572]: DEBUG nova.compute.manager [req-7563b0e9-aa41-44ca-a4ce-98c2718f4c94 req-80892147-86d2-4abc-bea1-07d6fe86a252 service nova] [instance: 8a8816e5-696d-4384-b0e0-29aa7cdd957c] No waiting events found dispatching network-vif-plugged-2e650fb9-427c-477e-ba45-ddc070399617 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:25:46 user nova-compute[73572]: WARNING nova.compute.manager [req-7563b0e9-aa41-44ca-a4ce-98c2718f4c94 req-80892147-86d2-4abc-bea1-07d6fe86a252 service nova] [instance: 8a8816e5-696d-4384-b0e0-29aa7cdd957c] Received unexpected event network-vif-plugged-2e650fb9-427c-477e-ba45-ddc070399617 for instance with vm_state active and task_state rescuing.
Aug 26 10:25:46 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:25:46 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:25:46 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:25:46 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:25:46 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:25:47 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-3e278e6e-0236-4e81-a3fb-cfb1d616e1ad tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Acquiring lock "8bb0f50b-c8fb-4961-99c0-ca2b6b1768cd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:25:47 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-3e278e6e-0236-4e81-a3fb-cfb1d616e1ad tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Lock "8bb0f50b-c8fb-4961-99c0-ca2b6b1768cd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:25:47 user nova-compute[73572]: DEBUG nova.compute.manager [None req-3e278e6e-0236-4e81-a3fb-cfb1d616e1ad tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] [instance: 8bb0f50b-c8fb-4961-99c0-ca2b6b1768cd] Starting instance... {{(pid=73572) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 10:25:47 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-3e278e6e-0236-4e81-a3fb-cfb1d616e1ad tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:25:47 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-3e278e6e-0236-4e81-a3fb-cfb1d616e1ad tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:25:47 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-3e278e6e-0236-4e81-a3fb-cfb1d616e1ad tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73572) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 10:25:47 user nova-compute[73572]: INFO nova.compute.claims [None req-3e278e6e-0236-4e81-a3fb-cfb1d616e1ad tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] [instance: 8bb0f50b-c8fb-4961-99c0-ca2b6b1768cd] Claim successful on node user
Aug 26 10:25:48 user nova-compute[73572]: DEBUG nova.compute.provider_tree [None req-3e278e6e-0236-4e81-a3fb-cfb1d616e1ad tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Inventory has not changed in ProviderTree for provider: e2cec974-59b2-4c77-a53d-a7f4e5a30d75 {{(pid=73572) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 10:25:48 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-3e278e6e-0236-4e81-a3fb-cfb1d616e1ad tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Inventory has not changed for provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73572) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 10:25:48 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-3e278e6e-0236-4e81-a3fb-cfb1d616e1ad tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.475s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:25:48 user nova-compute[73572]: DEBUG nova.compute.manager [None req-3e278e6e-0236-4e81-a3fb-cfb1d616e1ad tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] [instance: 8bb0f50b-c8fb-4961-99c0-ca2b6b1768cd] Start building networks asynchronously for instance. {{(pid=73572) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 10:25:48 user nova-compute[73572]: DEBUG nova.compute.manager [None req-3e278e6e-0236-4e81-a3fb-cfb1d616e1ad tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] [instance: 8bb0f50b-c8fb-4961-99c0-ca2b6b1768cd] Allocating IP information in the background. {{(pid=73572) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 10:25:48 user nova-compute[73572]: DEBUG nova.network.neutron [None req-3e278e6e-0236-4e81-a3fb-cfb1d616e1ad tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] [instance: 8bb0f50b-c8fb-4961-99c0-ca2b6b1768cd] allocate_for_instance() {{(pid=73572) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 10:25:48 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:25:48 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-3e278e6e-0236-4e81-a3fb-cfb1d616e1ad tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] [instance: 8bb0f50b-c8fb-4961-99c0-ca2b6b1768cd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 10:25:48 user nova-compute[73572]: DEBUG nova.compute.manager [None req-3e278e6e-0236-4e81-a3fb-cfb1d616e1ad tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] [instance: 8bb0f50b-c8fb-4961-99c0-ca2b6b1768cd] Start building block device mappings for instance. {{(pid=73572) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 10:25:48 user nova-compute[73572]: DEBUG nova.compute.manager [req-546a1ee1-5fb9-47fc-b64c-87da3247699a req-7c100096-1fc6-4a6f-bb17-a1378fb73cce service nova] [instance: 6004b15a-be01-42eb-92ba-ae9d93dab708] Received event network-vif-plugged-8c801229-2284-4cd5-bdce-45c96edfe633 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:25:48 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-546a1ee1-5fb9-47fc-b64c-87da3247699a req-7c100096-1fc6-4a6f-bb17-a1378fb73cce service nova] Acquiring lock "6004b15a-be01-42eb-92ba-ae9d93dab708-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:25:48 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-546a1ee1-5fb9-47fc-b64c-87da3247699a req-7c100096-1fc6-4a6f-bb17-a1378fb73cce service nova] Lock "6004b15a-be01-42eb-92ba-ae9d93dab708-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:25:48 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-546a1ee1-5fb9-47fc-b64c-87da3247699a req-7c100096-1fc6-4a6f-bb17-a1378fb73cce service nova] Lock "6004b15a-be01-42eb-92ba-ae9d93dab708-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:25:48 user nova-compute[73572]: DEBUG nova.compute.manager [req-546a1ee1-5fb9-47fc-b64c-87da3247699a req-7c100096-1fc6-4a6f-bb17-a1378fb73cce service nova] [instance: 6004b15a-be01-42eb-92ba-ae9d93dab708] No waiting events found dispatching network-vif-plugged-8c801229-2284-4cd5-bdce-45c96edfe633 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:25:48 user nova-compute[73572]: WARNING nova.compute.manager [req-546a1ee1-5fb9-47fc-b64c-87da3247699a req-7c100096-1fc6-4a6f-bb17-a1378fb73cce service nova] [instance: 6004b15a-be01-42eb-92ba-ae9d93dab708] Received unexpected event network-vif-plugged-8c801229-2284-4cd5-bdce-45c96edfe633 for instance with vm_state building and task_state spawning.
Aug 26 10:25:48 user nova-compute[73572]: DEBUG nova.policy [None req-3e278e6e-0236-4e81-a3fb-cfb1d616e1ad tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2a2ef00486924f318ff1e7e502e835a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084df935eab842e58bad79afad7090f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73572) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 10:25:48 user nova-compute[73572]: DEBUG nova.compute.manager [req-72a662b2-0a99-415d-b9af-a4fa7fd82357 req-4acab59c-33c7-4b11-8f59-3af42d7e538c service nova] [instance: 8a8816e5-696d-4384-b0e0-29aa7cdd957c] Received event network-vif-plugged-2e650fb9-427c-477e-ba45-ddc070399617 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:25:48 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-72a662b2-0a99-415d-b9af-a4fa7fd82357 req-4acab59c-33c7-4b11-8f59-3af42d7e538c service nova] Acquiring lock "8a8816e5-696d-4384-b0e0-29aa7cdd957c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:25:48 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-72a662b2-0a99-415d-b9af-a4fa7fd82357 req-4acab59c-33c7-4b11-8f59-3af42d7e538c service nova] Lock "8a8816e5-696d-4384-b0e0-29aa7cdd957c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:25:48 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-72a662b2-0a99-415d-b9af-a4fa7fd82357 req-4acab59c-33c7-4b11-8f59-3af42d7e538c service nova] Lock "8a8816e5-696d-4384-b0e0-29aa7cdd957c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:25:48 user nova-compute[73572]: DEBUG nova.compute.manager [req-72a662b2-0a99-415d-b9af-a4fa7fd82357 req-4acab59c-33c7-4b11-8f59-3af42d7e538c service nova] [instance: 8a8816e5-696d-4384-b0e0-29aa7cdd957c] No waiting events found dispatching network-vif-plugged-2e650fb9-427c-477e-ba45-ddc070399617 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:25:48 user nova-compute[73572]: WARNING nova.compute.manager [req-72a662b2-0a99-415d-b9af-a4fa7fd82357 req-4acab59c-33c7-4b11-8f59-3af42d7e538c service nova] [instance: 8a8816e5-696d-4384-b0e0-29aa7cdd957c] Received unexpected event network-vif-plugged-2e650fb9-427c-477e-ba45-ddc070399617 for instance with vm_state active and task_state rescuing.
Aug 26 10:25:48 user nova-compute[73572]: DEBUG nova.compute.manager [None req-3e278e6e-0236-4e81-a3fb-cfb1d616e1ad tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] [instance: 8bb0f50b-c8fb-4961-99c0-ca2b6b1768cd] Start spawning the instance on the hypervisor. {{(pid=73572) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 10:25:48 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-3e278e6e-0236-4e81-a3fb-cfb1d616e1ad tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] [instance: 8bb0f50b-c8fb-4961-99c0-ca2b6b1768cd] Creating instance directory {{(pid=73572) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 10:25:48 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-3e278e6e-0236-4e81-a3fb-cfb1d616e1ad tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] [instance: 8bb0f50b-c8fb-4961-99c0-ca2b6b1768cd] Creating image(s)
Aug 26 10:25:48 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-3e278e6e-0236-4e81-a3fb-cfb1d616e1ad tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Acquiring lock "/opt/stack/data/nova/instances/8bb0f50b-c8fb-4961-99c0-ca2b6b1768cd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:25:48 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-3e278e6e-0236-4e81-a3fb-cfb1d616e1ad tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Lock "/opt/stack/data/nova/instances/8bb0f50b-c8fb-4961-99c0-ca2b6b1768cd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:25:48 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-3e278e6e-0236-4e81-a3fb-cfb1d616e1ad tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Lock "/opt/stack/data/nova/instances/8bb0f50b-c8fb-4961-99c0-ca2b6b1768cd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:25:48 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-3e278e6e-0236-4e81-a3fb-cfb1d616e1ad tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:25:48 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Removed pending event for 8a8816e5-696d-4384-b0e0-29aa7cdd957c due to event {{(pid=73572) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 26 10:25:48 user nova-compute[73572]: DEBUG nova.virt.driver [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Emitting event <LifecycleEvent: 1693045548.5540655, 8a8816e5-696d-4384-b0e0-29aa7cdd957c => Resumed> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:25:48 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 8a8816e5-696d-4384-b0e0-29aa7cdd957c] VM Resumed (Lifecycle Event)
Aug 26 10:25:48 user nova-compute[73572]: DEBUG nova.compute.manager [None req-972e1ab5-75de-4284-977f-4f533a096c73 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] [instance: 6004b15a-be01-42eb-92ba-ae9d93dab708] Instance event wait completed in 0 seconds for  {{(pid=73572) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 10:25:48 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-972e1ab5-75de-4284-977f-4f533a096c73 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] [instance: 6004b15a-be01-42eb-92ba-ae9d93dab708] Guest created on hypervisor {{(pid=73572) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 10:25:48 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 8a8816e5-696d-4384-b0e0-29aa7cdd957c] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:25:48 user nova-compute[73572]: DEBUG nova.compute.manager [None req-3b976b48-e63d-425e-bea5-fb2dc786f622 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: 8a8816e5-696d-4384-b0e0-29aa7cdd957c] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:25:48 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-3e278e6e-0236-4e81-a3fb-cfb1d616e1ad tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json" returned: 0 in 0.191s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:25:48 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-3e278e6e-0236-4e81-a3fb-cfb1d616e1ad tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Acquiring lock "2099350d6f3bcd0de9471c73862d4fe75b049801" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:25:48 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-3e278e6e-0236-4e81-a3fb-cfb1d616e1ad tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Lock "2099350d6f3bcd0de9471c73862d4fe75b049801" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:25:48 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-3e278e6e-0236-4e81-a3fb-cfb1d616e1ad tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:25:48 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 8a8816e5-696d-4384-b0e0-29aa7cdd957c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73572) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 10:25:48 user nova-compute[73572]: INFO nova.virt.libvirt.driver [-] [instance: 6004b15a-be01-42eb-92ba-ae9d93dab708] Instance spawned successfully.
Aug 26 10:25:48 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-972e1ab5-75de-4284-977f-4f533a096c73 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] [instance: 6004b15a-be01-42eb-92ba-ae9d93dab708] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 10:25:48 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 8a8816e5-696d-4384-b0e0-29aa7cdd957c] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 26 10:25:48 user nova-compute[73572]: DEBUG nova.virt.driver [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Emitting event <LifecycleEvent: 1693045548.5576448, 8a8816e5-696d-4384-b0e0-29aa7cdd957c => Started> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:25:48 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 8a8816e5-696d-4384-b0e0-29aa7cdd957c] VM Started (Lifecycle Event)
Aug 26 10:25:48 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-972e1ab5-75de-4284-977f-4f533a096c73 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] [instance: 6004b15a-be01-42eb-92ba-ae9d93dab708] Found default for hw_cdrom_bus of ide {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:25:48 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-972e1ab5-75de-4284-977f-4f533a096c73 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] [instance: 6004b15a-be01-42eb-92ba-ae9d93dab708] Found default for hw_disk_bus of virtio {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:25:48 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-972e1ab5-75de-4284-977f-4f533a096c73 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] [instance: 6004b15a-be01-42eb-92ba-ae9d93dab708] Found default for hw_input_bus of None {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:25:48 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-972e1ab5-75de-4284-977f-4f533a096c73 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] [instance: 6004b15a-be01-42eb-92ba-ae9d93dab708] Found default for hw_pointer_model of None {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:25:48 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-972e1ab5-75de-4284-977f-4f533a096c73 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] [instance: 6004b15a-be01-42eb-92ba-ae9d93dab708] Found default for hw_video_model of virtio {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:25:48 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-972e1ab5-75de-4284-977f-4f533a096c73 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] [instance: 6004b15a-be01-42eb-92ba-ae9d93dab708] Found default for hw_vif_model of virtio {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:25:48 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 8a8816e5-696d-4384-b0e0-29aa7cdd957c] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:25:48 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 8a8816e5-696d-4384-b0e0-29aa7cdd957c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73572) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 10:25:48 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 8a8816e5-696d-4384-b0e0-29aa7cdd957c] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 26 10:25:48 user nova-compute[73572]: DEBUG nova.virt.driver [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Emitting event <LifecycleEvent: 1693045548.5789483, 6004b15a-be01-42eb-92ba-ae9d93dab708 => Resumed> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:25:48 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 6004b15a-be01-42eb-92ba-ae9d93dab708] VM Resumed (Lifecycle Event)
Aug 26 10:25:48 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 6004b15a-be01-42eb-92ba-ae9d93dab708] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:25:48 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-3e278e6e-0236-4e81-a3fb-cfb1d616e1ad tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json" returned: 0 in 0.185s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:25:48 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-3e278e6e-0236-4e81-a3fb-cfb1d616e1ad tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801,backing_fmt=raw /opt/stack/data/nova/instances/8bb0f50b-c8fb-4961-99c0-ca2b6b1768cd/disk 1073741824 {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:25:48 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 6004b15a-be01-42eb-92ba-ae9d93dab708] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73572) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 10:25:48 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-3e278e6e-0236-4e81-a3fb-cfb1d616e1ad tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801,backing_fmt=raw /opt/stack/data/nova/instances/8bb0f50b-c8fb-4961-99c0-ca2b6b1768cd/disk 1073741824" returned: 0 in 0.087s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:25:48 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-3e278e6e-0236-4e81-a3fb-cfb1d616e1ad tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Lock "2099350d6f3bcd0de9471c73862d4fe75b049801" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.277s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:25:48 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-3e278e6e-0236-4e81-a3fb-cfb1d616e1ad tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:25:48 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 6004b15a-be01-42eb-92ba-ae9d93dab708] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 10:25:48 user nova-compute[73572]: DEBUG nova.virt.driver [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Emitting event <LifecycleEvent: 1693045548.5822632, 6004b15a-be01-42eb-92ba-ae9d93dab708 => Started> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:25:48 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 6004b15a-be01-42eb-92ba-ae9d93dab708] VM Started (Lifecycle Event)
Aug 26 10:25:48 user nova-compute[73572]: INFO nova.compute.manager [None req-972e1ab5-75de-4284-977f-4f533a096c73 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] [instance: 6004b15a-be01-42eb-92ba-ae9d93dab708] Took 8.66 seconds to spawn the instance on the hypervisor.
Aug 26 10:25:48 user nova-compute[73572]: DEBUG nova.compute.manager [None req-972e1ab5-75de-4284-977f-4f533a096c73 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] [instance: 6004b15a-be01-42eb-92ba-ae9d93dab708] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:25:48 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 6004b15a-be01-42eb-92ba-ae9d93dab708] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:25:48 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 6004b15a-be01-42eb-92ba-ae9d93dab708] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73572) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 10:25:48 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 6004b15a-be01-42eb-92ba-ae9d93dab708] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 10:25:49 user nova-compute[73572]: INFO nova.compute.manager [None req-06501d72-e99a-42fe-a509-d29c61b9b678 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] [instance: 2eaea7c2-a5c0-4950-b033-0012b5cec0ee] Unrescuing
Aug 26 10:25:49 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-06501d72-e99a-42fe-a509-d29c61b9b678 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Acquiring lock "refresh_cache-2eaea7c2-a5c0-4950-b033-0012b5cec0ee" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:25:49 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-06501d72-e99a-42fe-a509-d29c61b9b678 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Acquired lock "refresh_cache-2eaea7c2-a5c0-4950-b033-0012b5cec0ee" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:25:49 user nova-compute[73572]: DEBUG nova.network.neutron [None req-06501d72-e99a-42fe-a509-d29c61b9b678 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] [instance: 2eaea7c2-a5c0-4950-b033-0012b5cec0ee] Building network info cache for instance {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 10:25:49 user nova-compute[73572]: INFO nova.compute.manager [None req-972e1ab5-75de-4284-977f-4f533a096c73 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] [instance: 6004b15a-be01-42eb-92ba-ae9d93dab708] Took 9.57 seconds to build instance.
Aug 26 10:25:49 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-3e278e6e-0236-4e81-a3fb-cfb1d616e1ad tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json" returned: 0 in 0.195s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:25:49 user nova-compute[73572]: DEBUG nova.virt.disk.api [None req-3e278e6e-0236-4e81-a3fb-cfb1d616e1ad tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8bb0f50b-c8fb-4961-99c0-ca2b6b1768cd/disk. size=1073741824 {{(pid=73572) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 10:25:49 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-3e278e6e-0236-4e81-a3fb-cfb1d616e1ad tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bb0f50b-c8fb-4961-99c0-ca2b6b1768cd/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:25:49 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-972e1ab5-75de-4284-977f-4f533a096c73 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Lock "6004b15a-be01-42eb-92ba-ae9d93dab708" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.741s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:25:49 user nova-compute[73572]: DEBUG nova.network.neutron [None req-3e278e6e-0236-4e81-a3fb-cfb1d616e1ad tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] [instance: 8bb0f50b-c8fb-4961-99c0-ca2b6b1768cd] Successfully created port: e78ed806-3f29-444e-b7d5-d0c9ba2b06aa {{(pid=73572) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 10:25:49 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-3e278e6e-0236-4e81-a3fb-cfb1d616e1ad tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bb0f50b-c8fb-4961-99c0-ca2b6b1768cd/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:25:49 user nova-compute[73572]: DEBUG nova.virt.disk.api [None req-3e278e6e-0236-4e81-a3fb-cfb1d616e1ad tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Cannot resize image /opt/stack/data/nova/instances/8bb0f50b-c8fb-4961-99c0-ca2b6b1768cd/disk to a smaller size. {{(pid=73572) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 10:25:49 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-3e278e6e-0236-4e81-a3fb-cfb1d616e1ad tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] [instance: 8bb0f50b-c8fb-4961-99c0-ca2b6b1768cd] Created local disks {{(pid=73572) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 10:25:49 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-3e278e6e-0236-4e81-a3fb-cfb1d616e1ad tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] [instance: 8bb0f50b-c8fb-4961-99c0-ca2b6b1768cd] Ensure instance console log exists: /opt/stack/data/nova/instances/8bb0f50b-c8fb-4961-99c0-ca2b6b1768cd/console.log {{(pid=73572) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 10:25:49 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-3e278e6e-0236-4e81-a3fb-cfb1d616e1ad tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:25:49 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-3e278e6e-0236-4e81-a3fb-cfb1d616e1ad tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:25:49 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-3e278e6e-0236-4e81-a3fb-cfb1d616e1ad tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:25:49 user nova-compute[73572]: DEBUG nova.network.neutron [None req-06501d72-e99a-42fe-a509-d29c61b9b678 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] [instance: 2eaea7c2-a5c0-4950-b033-0012b5cec0ee] Updating instance_info_cache with network_info: [{"id": "0b4d66c9-2155-45ae-873a-2ee85776eeb7", "address": "fa:16:3e:69:d4:8e", "network": {"id": "757e71b4-5177-45a5-8ef5-9b27f42092f1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1765327616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1bff48d66894950ac6690e1fd0e79b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b4d66c9-21", "ovs_interfaceid": "0b4d66c9-2155-45ae-873a-2ee85776eeb7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:25:49 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-06501d72-e99a-42fe-a509-d29c61b9b678 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Releasing lock "refresh_cache-2eaea7c2-a5c0-4950-b033-0012b5cec0ee" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:25:49 user nova-compute[73572]: DEBUG nova.objects.instance [None req-06501d72-e99a-42fe-a509-d29c61b9b678 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Lazy-loading 'flavor' on Instance uuid 2eaea7c2-a5c0-4950-b033-0012b5cec0ee {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:25:49 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:25:49 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:25:50 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:25:50 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:25:50 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:25:50 user nova-compute[73572]: DEBUG nova.network.neutron [None req-3e278e6e-0236-4e81-a3fb-cfb1d616e1ad tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] [instance: 8bb0f50b-c8fb-4961-99c0-ca2b6b1768cd] Successfully updated port: e78ed806-3f29-444e-b7d5-d0c9ba2b06aa {{(pid=73572) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 10:25:50 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-3e278e6e-0236-4e81-a3fb-cfb1d616e1ad tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Acquiring lock "refresh_cache-8bb0f50b-c8fb-4961-99c0-ca2b6b1768cd" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:25:50 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-3e278e6e-0236-4e81-a3fb-cfb1d616e1ad tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Acquired lock "refresh_cache-8bb0f50b-c8fb-4961-99c0-ca2b6b1768cd" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:25:50 user nova-compute[73572]: DEBUG nova.network.neutron [None req-3e278e6e-0236-4e81-a3fb-cfb1d616e1ad tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] [instance: 8bb0f50b-c8fb-4961-99c0-ca2b6b1768cd] Building network info cache for instance {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 10:25:50 user nova-compute[73572]: DEBUG nova.compute.manager [req-a2b1a97a-5922-47c1-b028-d31b0272c509 req-ea960828-4ea6-4e55-8bb6-c10474c74f1b service nova] [instance: 2eaea7c2-a5c0-4950-b033-0012b5cec0ee] Received event network-vif-unplugged-0b4d66c9-2155-45ae-873a-2ee85776eeb7 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:25:50 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-a2b1a97a-5922-47c1-b028-d31b0272c509 req-ea960828-4ea6-4e55-8bb6-c10474c74f1b service nova] Acquiring lock "2eaea7c2-a5c0-4950-b033-0012b5cec0ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:25:50 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-a2b1a97a-5922-47c1-b028-d31b0272c509 req-ea960828-4ea6-4e55-8bb6-c10474c74f1b service nova] Lock "2eaea7c2-a5c0-4950-b033-0012b5cec0ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:25:50 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-a2b1a97a-5922-47c1-b028-d31b0272c509 req-ea960828-4ea6-4e55-8bb6-c10474c74f1b service nova] Lock "2eaea7c2-a5c0-4950-b033-0012b5cec0ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:25:50 user nova-compute[73572]: DEBUG nova.compute.manager [req-a2b1a97a-5922-47c1-b028-d31b0272c509 req-ea960828-4ea6-4e55-8bb6-c10474c74f1b service nova] [instance: 2eaea7c2-a5c0-4950-b033-0012b5cec0ee] No waiting events found dispatching network-vif-unplugged-0b4d66c9-2155-45ae-873a-2ee85776eeb7 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:25:50 user nova-compute[73572]: WARNING nova.compute.manager [req-a2b1a97a-5922-47c1-b028-d31b0272c509 req-ea960828-4ea6-4e55-8bb6-c10474c74f1b service nova] [instance: 2eaea7c2-a5c0-4950-b033-0012b5cec0ee] Received unexpected event network-vif-unplugged-0b4d66c9-2155-45ae-873a-2ee85776eeb7 for instance with vm_state rescued and task_state unrescuing.
Aug 26 10:25:50 user nova-compute[73572]: DEBUG nova.compute.manager [req-a2b1a97a-5922-47c1-b028-d31b0272c509 req-ea960828-4ea6-4e55-8bb6-c10474c74f1b service nova] [instance: 2eaea7c2-a5c0-4950-b033-0012b5cec0ee] Received event network-vif-plugged-0b4d66c9-2155-45ae-873a-2ee85776eeb7 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:25:50 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-a2b1a97a-5922-47c1-b028-d31b0272c509 req-ea960828-4ea6-4e55-8bb6-c10474c74f1b service nova] Acquiring lock "2eaea7c2-a5c0-4950-b033-0012b5cec0ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:25:50 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-a2b1a97a-5922-47c1-b028-d31b0272c509 req-ea960828-4ea6-4e55-8bb6-c10474c74f1b service nova] Lock "2eaea7c2-a5c0-4950-b033-0012b5cec0ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:25:50 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-a2b1a97a-5922-47c1-b028-d31b0272c509 req-ea960828-4ea6-4e55-8bb6-c10474c74f1b service nova] Lock "2eaea7c2-a5c0-4950-b033-0012b5cec0ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:25:50 user nova-compute[73572]: DEBUG nova.compute.manager [req-a2b1a97a-5922-47c1-b028-d31b0272c509 req-ea960828-4ea6-4e55-8bb6-c10474c74f1b service nova] [instance: 2eaea7c2-a5c0-4950-b033-0012b5cec0ee] No waiting events found dispatching network-vif-plugged-0b4d66c9-2155-45ae-873a-2ee85776eeb7 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:25:50 user nova-compute[73572]: WARNING nova.compute.manager [req-a2b1a97a-5922-47c1-b028-d31b0272c509 req-ea960828-4ea6-4e55-8bb6-c10474c74f1b service nova] [instance: 2eaea7c2-a5c0-4950-b033-0012b5cec0ee] Received unexpected event network-vif-plugged-0b4d66c9-2155-45ae-873a-2ee85776eeb7 for instance with vm_state rescued and task_state unrescuing.
Aug 26 10:25:50 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:25:50 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:25:50 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:25:50 user nova-compute[73572]: DEBUG nova.compute.manager [req-6d913be2-4586-46ad-8189-3d213dc2d361 req-8b156e05-277f-473b-ab49-d6cb4e4b8bf6 service nova] [instance: 8bb0f50b-c8fb-4961-99c0-ca2b6b1768cd] Received event network-changed-e78ed806-3f29-444e-b7d5-d0c9ba2b06aa {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:25:50 user nova-compute[73572]: DEBUG nova.compute.manager [req-6d913be2-4586-46ad-8189-3d213dc2d361 req-8b156e05-277f-473b-ab49-d6cb4e4b8bf6 service nova] [instance: 8bb0f50b-c8fb-4961-99c0-ca2b6b1768cd] Refreshing instance network info cache due to event network-changed-e78ed806-3f29-444e-b7d5-d0c9ba2b06aa. {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 10:25:50 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-6d913be2-4586-46ad-8189-3d213dc2d361 req-8b156e05-277f-473b-ab49-d6cb4e4b8bf6 service nova] Acquiring lock "refresh_cache-8bb0f50b-c8fb-4961-99c0-ca2b6b1768cd" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:25:50 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:25:50 user nova-compute[73572]: INFO nova.virt.libvirt.driver [-] [instance: 2eaea7c2-a5c0-4950-b033-0012b5cec0ee] Instance destroyed successfully.
Aug 26 10:25:50 user nova-compute[73572]: DEBUG nova.network.neutron [None req-3e278e6e-0236-4e81-a3fb-cfb1d616e1ad tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] [instance: 8bb0f50b-c8fb-4961-99c0-ca2b6b1768cd] Instance cache missing network info. {{(pid=73572) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 10:25:50 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:25:50 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:25:50 user nova-compute[73572]: DEBUG nova.network.neutron [None req-3e278e6e-0236-4e81-a3fb-cfb1d616e1ad tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] [instance: 8bb0f50b-c8fb-4961-99c0-ca2b6b1768cd] Updating instance_info_cache with network_info: [{"id": "e78ed806-3f29-444e-b7d5-d0c9ba2b06aa", "address": "fa:16:3e:4a:d9:27", "network": {"id": "81543fb3-a8fe-4e9c-8180-c65fa4dcc9e1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-469390371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "084df935eab842e58bad79afad7090f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape78ed806-3f", "ovs_interfaceid": "e78ed806-3f29-444e-b7d5-d0c9ba2b06aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:25:50 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-3e278e6e-0236-4e81-a3fb-cfb1d616e1ad tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Releasing lock "refresh_cache-8bb0f50b-c8fb-4961-99c0-ca2b6b1768cd" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:25:50 user nova-compute[73572]: DEBUG nova.compute.manager [None req-3e278e6e-0236-4e81-a3fb-cfb1d616e1ad tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] [instance: 8bb0f50b-c8fb-4961-99c0-ca2b6b1768cd] Instance network_info: |[{"id": "e78ed806-3f29-444e-b7d5-d0c9ba2b06aa", "address": "fa:16:3e:4a:d9:27", "network": {"id": "81543fb3-a8fe-4e9c-8180-c65fa4dcc9e1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-469390371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "084df935eab842e58bad79afad7090f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape78ed806-3f", "ovs_interfaceid": "e78ed806-3f29-444e-b7d5-d0c9ba2b06aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73572) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 10:25:50 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-6d913be2-4586-46ad-8189-3d213dc2d361 req-8b156e05-277f-473b-ab49-d6cb4e4b8bf6 service nova] Acquired lock "refresh_cache-8bb0f50b-c8fb-4961-99c0-ca2b6b1768cd" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:25:50 user nova-compute[73572]: DEBUG nova.network.neutron [req-6d913be2-4586-46ad-8189-3d213dc2d361 req-8b156e05-277f-473b-ab49-d6cb4e4b8bf6 service nova] [instance: 8bb0f50b-c8fb-4961-99c0-ca2b6b1768cd] Refreshing network info cache for port e78ed806-3f29-444e-b7d5-d0c9ba2b06aa {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 10:25:50 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-3e278e6e-0236-4e81-a3fb-cfb1d616e1ad tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] [instance: 8bb0f50b-c8fb-4961-99c0-ca2b6b1768cd] Start _get_guest_xml network_info=[{"id": "e78ed806-3f29-444e-b7d5-d0c9ba2b06aa", "address": "fa:16:3e:4a:d9:27", "network": {"id": "81543fb3-a8fe-4e9c-8180-c65fa4dcc9e1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-469390371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "084df935eab842e58bad79afad7090f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape78ed806-3f", "ovs_interfaceid": "e78ed806-3f29-444e-b7d5-d0c9ba2b06aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T10:07:33Z,direct_url=<?>,disk_format='qcow2',id=299da0c9-e1c4-48f0-be55-fbe20dd06bc9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5c995f8bbbab4368b67a253e0df3971a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T10:07:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'guest_format': None, 'size': 0, 'encryption_format': None, 'device_type': 'disk', 'image_id': '299da0c9-e1c4-48f0-be55-fbe20dd06bc9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73572) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 10:25:50 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-3e278e6e-0236-4e81-a3fb-cfb1d616e1ad tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:25:50 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-3e278e6e-0236-4e81-a3fb-cfb1d616e1ad tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:25:50 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-3e278e6e-0236-4e81-a3fb-cfb1d616e1ad tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73572) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 10:25:50 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-3e278e6e-0236-4e81-a3fb-cfb1d616e1ad tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] CPU controller missing on host. {{(pid=73572) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 10:25:50 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-3e278e6e-0236-4e81-a3fb-cfb1d616e1ad tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73572) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 10:25:50 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-3e278e6e-0236-4e81-a3fb-cfb1d616e1ad tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] CPU controller found on host. {{(pid=73572) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 10:25:50 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-3e278e6e-0236-4e81-a3fb-cfb1d616e1ad tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73572) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 10:25:50 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-3e278e6e-0236-4e81-a3fb-cfb1d616e1ad tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T10:07:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T10:07:33Z,direct_url=<?>,disk_format='qcow2',id=299da0c9-e1c4-48f0-be55-fbe20dd06bc9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5c995f8bbbab4368b67a253e0df3971a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T10:07:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 10:25:50 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-3e278e6e-0236-4e81-a3fb-cfb1d616e1ad tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Flavor limits 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 10:25:50 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-3e278e6e-0236-4e81-a3fb-cfb1d616e1ad tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Image limits 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 10:25:50 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-3e278e6e-0236-4e81-a3fb-cfb1d616e1ad tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Flavor pref 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 10:25:50 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-3e278e6e-0236-4e81-a3fb-cfb1d616e1ad tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Image pref 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 10:25:50 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-3e278e6e-0236-4e81-a3fb-cfb1d616e1ad tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 10:25:50 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-3e278e6e-0236-4e81-a3fb-cfb1d616e1ad tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 10:25:50 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-3e278e6e-0236-4e81-a3fb-cfb1d616e1ad tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73572) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 10:25:50 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-3e278e6e-0236-4e81-a3fb-cfb1d616e1ad tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Got 1 possible topologies {{(pid=73572) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 10:25:50 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-3e278e6e-0236-4e81-a3fb-cfb1d616e1ad tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 10:25:50 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-3e278e6e-0236-4e81-a3fb-cfb1d616e1ad tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 10:25:51 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-3e278e6e-0236-4e81-a3fb-cfb1d616e1ad tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T10:25:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-723135433',display_name='tempest-AttachVolumeTestJSON-server-723135433',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-723135433',id=37,image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIvZx4NeVn88J4eELpNAcQQWHxjc5RVYfBsjUls0zhDk+x20aafUtCUQhS61fXJJJ6wYCeAkeKvAo0p6TDqNWNbsVhtXnful0b1goyJejMTatsjpAZ/US6fxqF5p1KJMYA==',key_name='tempest-keypair-1755736816',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='084df935eab842e58bad79afad7090f3',ramdisk_id='',reservation_id='r-g73b4erk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-716261196',owner_user_name='tempest-AttachVolumeTestJSON-716261196-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T10:25:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2a2ef00486924f318ff1e7e502e835a6',uuid=8bb0f50b-c8fb-4961-99c0-ca2b6b1768cd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e78ed806-3f29-444e-b7d5-d0c9ba2b06aa", "address": "fa:16:3e:4a:d9:27", "network": {"id": "81543fb3-a8fe-4e9c-8180-c65fa4dcc9e1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-469390371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "084df935eab842e58bad79afad7090f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape78ed806-3f", "ovs_interfaceid": "e78ed806-3f29-444e-b7d5-d0c9ba2b06aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73572) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 10:25:51 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-3e278e6e-0236-4e81-a3fb-cfb1d616e1ad tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Converting VIF {"id": "e78ed806-3f29-444e-b7d5-d0c9ba2b06aa", "address": "fa:16:3e:4a:d9:27", "network": {"id": "81543fb3-a8fe-4e9c-8180-c65fa4dcc9e1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-469390371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "084df935eab842e58bad79afad7090f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape78ed806-3f", "ovs_interfaceid": "e78ed806-3f29-444e-b7d5-d0c9ba2b06aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:25:51 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-3e278e6e-0236-4e81-a3fb-cfb1d616e1ad tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:d9:27,bridge_name='br-int',has_traffic_filtering=True,id=e78ed806-3f29-444e-b7d5-d0c9ba2b06aa,network=Network(81543fb3-a8fe-4e9c-8180-c65fa4dcc9e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape78ed806-3f') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:25:51 user nova-compute[73572]: DEBUG nova.objects.instance [None req-3e278e6e-0236-4e81-a3fb-cfb1d616e1ad tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Lazy-loading 'pci_devices' on Instance uuid 8bb0f50b-c8fb-4961-99c0-ca2b6b1768cd {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:25:51 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:25:51 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-3e278e6e-0236-4e81-a3fb-cfb1d616e1ad tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] [instance: 8bb0f50b-c8fb-4961-99c0-ca2b6b1768cd] End _get_guest_xml xml=<domain type="kvm">
Aug 26 10:25:51 user nova-compute[73572]:   <uuid>8bb0f50b-c8fb-4961-99c0-ca2b6b1768cd</uuid>
Aug 26 10:25:51 user nova-compute[73572]:   <name>instance-00000025</name>
Aug 26 10:25:51 user nova-compute[73572]:   <memory>524288</memory>
Aug 26 10:25:51 user nova-compute[73572]:   <vcpu>1</vcpu>
Aug 26 10:25:51 user nova-compute[73572]:   <metadata>
Aug 26 10:25:51 user nova-compute[73572]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 10:25:51 user nova-compute[73572]:       <nova:package version="0.0.0"/>
Aug 26 10:25:51 user nova-compute[73572]:       <nova:name>tempest-AttachVolumeTestJSON-server-723135433</nova:name>
Aug 26 10:25:51 user nova-compute[73572]:       <nova:creationTime>2023-08-26 10:25:50</nova:creationTime>
Aug 26 10:25:51 user nova-compute[73572]:       <nova:flavor name="m1.tiny">
Aug 26 10:25:51 user nova-compute[73572]:         <nova:memory>512</nova:memory>
Aug 26 10:25:51 user nova-compute[73572]:         <nova:disk>1</nova:disk>
Aug 26 10:25:51 user nova-compute[73572]:         <nova:swap>0</nova:swap>
Aug 26 10:25:51 user nova-compute[73572]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 10:25:51 user nova-compute[73572]:         <nova:vcpus>1</nova:vcpus>
Aug 26 10:25:51 user nova-compute[73572]:       </nova:flavor>
Aug 26 10:25:51 user nova-compute[73572]:       <nova:owner>
Aug 26 10:25:51 user nova-compute[73572]:         <nova:user uuid="2a2ef00486924f318ff1e7e502e835a6">tempest-AttachVolumeTestJSON-716261196-project-member</nova:user>
Aug 26 10:25:51 user nova-compute[73572]:         <nova:project uuid="084df935eab842e58bad79afad7090f3">tempest-AttachVolumeTestJSON-716261196</nova:project>
Aug 26 10:25:51 user nova-compute[73572]:       </nova:owner>
Aug 26 10:25:51 user nova-compute[73572]:       <nova:root type="image" uuid="299da0c9-e1c4-48f0-be55-fbe20dd06bc9"/>
Aug 26 10:25:51 user nova-compute[73572]:       <nova:ports>
Aug 26 10:25:51 user nova-compute[73572]:         <nova:port uuid="e78ed806-3f29-444e-b7d5-d0c9ba2b06aa">
Aug 26 10:25:51 user nova-compute[73572]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 26 10:25:51 user nova-compute[73572]:         </nova:port>
Aug 26 10:25:51 user nova-compute[73572]:       </nova:ports>
Aug 26 10:25:51 user nova-compute[73572]:     </nova:instance>
Aug 26 10:25:51 user nova-compute[73572]:   </metadata>
Aug 26 10:25:51 user nova-compute[73572]:   <sysinfo type="smbios">
Aug 26 10:25:51 user nova-compute[73572]:     <system>
Aug 26 10:25:51 user nova-compute[73572]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 10:25:51 user nova-compute[73572]:       <entry name="product">OpenStack Nova</entry>
Aug 26 10:25:51 user nova-compute[73572]:       <entry name="version">0.0.0</entry>
Aug 26 10:25:51 user nova-compute[73572]:       <entry name="serial">8bb0f50b-c8fb-4961-99c0-ca2b6b1768cd</entry>
Aug 26 10:25:51 user nova-compute[73572]:       <entry name="uuid">8bb0f50b-c8fb-4961-99c0-ca2b6b1768cd</entry>
Aug 26 10:25:51 user nova-compute[73572]:       <entry name="family">Virtual Machine</entry>
Aug 26 10:25:51 user nova-compute[73572]:     </system>
Aug 26 10:25:51 user nova-compute[73572]:   </sysinfo>
Aug 26 10:25:51 user nova-compute[73572]:   <os>
Aug 26 10:25:51 user nova-compute[73572]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 10:25:51 user nova-compute[73572]:     <boot dev="hd"/>
Aug 26 10:25:51 user nova-compute[73572]:     <smbios mode="sysinfo"/>
Aug 26 10:25:51 user nova-compute[73572]:   </os>
Aug 26 10:25:51 user nova-compute[73572]:   <features>
Aug 26 10:25:51 user nova-compute[73572]:     <acpi/>
Aug 26 10:25:51 user nova-compute[73572]:     <apic/>
Aug 26 10:25:51 user nova-compute[73572]:     <vmcoreinfo/>
Aug 26 10:25:51 user nova-compute[73572]:   </features>
Aug 26 10:25:51 user nova-compute[73572]:   <clock offset="utc">
Aug 26 10:25:51 user nova-compute[73572]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 10:25:51 user nova-compute[73572]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 10:25:51 user nova-compute[73572]:     <timer name="hpet" present="no"/>
Aug 26 10:25:51 user nova-compute[73572]:   </clock>
Aug 26 10:25:51 user nova-compute[73572]:   <cpu mode="custom" match="exact">
Aug 26 10:25:51 user nova-compute[73572]:     <model>Nehalem</model>
Aug 26 10:25:51 user nova-compute[73572]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 10:25:51 user nova-compute[73572]:   </cpu>
Aug 26 10:25:51 user nova-compute[73572]:   <devices>
Aug 26 10:25:51 user nova-compute[73572]:     <disk type="file" device="disk">
Aug 26 10:25:51 user nova-compute[73572]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 10:25:51 user nova-compute[73572]:       <source file="/opt/stack/data/nova/instances/8bb0f50b-c8fb-4961-99c0-ca2b6b1768cd/disk"/>
Aug 26 10:25:51 user nova-compute[73572]:       <target dev="vda" bus="virtio"/>
Aug 26 10:25:51 user nova-compute[73572]:     </disk>
Aug 26 10:25:51 user nova-compute[73572]:     <interface type="ethernet">
Aug 26 10:25:51 user nova-compute[73572]:       <mac address="fa:16:3e:4a:d9:27"/>
Aug 26 10:25:51 user nova-compute[73572]:       <model type="virtio"/>
Aug 26 10:25:51 user nova-compute[73572]:       <mtu size="1442"/>
Aug 26 10:25:51 user nova-compute[73572]:       <target dev="tape78ed806-3f"/>
Aug 26 10:25:51 user nova-compute[73572]:     </interface>
Aug 26 10:25:51 user nova-compute[73572]:     <serial type="pty">
Aug 26 10:25:51 user nova-compute[73572]:       <log file="/opt/stack/data/nova/instances/8bb0f50b-c8fb-4961-99c0-ca2b6b1768cd/console.log" append="off"/>
Aug 26 10:25:51 user nova-compute[73572]:     </serial>
Aug 26 10:25:51 user nova-compute[73572]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 10:25:51 user nova-compute[73572]:     <video>
Aug 26 10:25:51 user nova-compute[73572]:       <model type="virtio"/>
Aug 26 10:25:51 user nova-compute[73572]:     </video>
Aug 26 10:25:51 user nova-compute[73572]:     <rng model="virtio">
Aug 26 10:25:51 user nova-compute[73572]:       <backend model="random">/dev/urandom</backend>
Aug 26 10:25:51 user nova-compute[73572]:     </rng>
Aug 26 10:25:51 user nova-compute[73572]:     <controller type="usb" index="0" model="none"/>
Aug 26 10:25:51 user nova-compute[73572]:     <memballoon model="virtio">
Aug 26 10:25:51 user nova-compute[73572]:       <stats period="10"/>
Aug 26 10:25:51 user nova-compute[73572]:     </memballoon>
Aug 26 10:25:51 user nova-compute[73572]:   </devices>
Aug 26 10:25:51 user nova-compute[73572]: </domain>
Aug 26 10:25:51 user nova-compute[73572]:  {{(pid=73572) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 10:25:51 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-3e278e6e-0236-4e81-a3fb-cfb1d616e1ad tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T10:25:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-723135433',display_name='tempest-AttachVolumeTestJSON-server-723135433',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-723135433',id=37,image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIvZx4NeVn88J4eELpNAcQQWHxjc5RVYfBsjUls0zhDk+x20aafUtCUQhS61fXJJJ6wYCeAkeKvAo0p6TDqNWNbsVhtXnful0b1goyJejMTatsjpAZ/US6fxqF5p1KJMYA==',key_name='tempest-keypair-1755736816',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='084df935eab842e58bad79afad7090f3',ramdisk_id='',reservation_id='r-g73b4erk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-716261196',owner_user_name='tempest-AttachVolumeTestJSON-716261196-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T10:25:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2a2ef00486924f318ff1e7e502e835a6',uuid=8bb0f50b-c8fb-4961-99c0-ca2b6b1768cd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e78ed806-3f29-444e-b7d5-d0c9ba2b06aa", "address": "fa:16:3e:4a:d9:27", "network": {"id": "81543fb3-a8fe-4e9c-8180-c65fa4dcc9e1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-469390371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "084df935eab842e58bad79afad7090f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape78ed806-3f", "ovs_interfaceid": "e78ed806-3f29-444e-b7d5-d0c9ba2b06aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 10:25:51 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-3e278e6e-0236-4e81-a3fb-cfb1d616e1ad tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Converting VIF {"id": "e78ed806-3f29-444e-b7d5-d0c9ba2b06aa", "address": "fa:16:3e:4a:d9:27", "network": {"id": "81543fb3-a8fe-4e9c-8180-c65fa4dcc9e1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-469390371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "084df935eab842e58bad79afad7090f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape78ed806-3f", "ovs_interfaceid": "e78ed806-3f29-444e-b7d5-d0c9ba2b06aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:25:51 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-3e278e6e-0236-4e81-a3fb-cfb1d616e1ad tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:d9:27,bridge_name='br-int',has_traffic_filtering=True,id=e78ed806-3f29-444e-b7d5-d0c9ba2b06aa,network=Network(81543fb3-a8fe-4e9c-8180-c65fa4dcc9e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape78ed806-3f') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:25:51 user nova-compute[73572]: DEBUG os_vif [None req-3e278e6e-0236-4e81-a3fb-cfb1d616e1ad tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:d9:27,bridge_name='br-int',has_traffic_filtering=True,id=e78ed806-3f29-444e-b7d5-d0c9ba2b06aa,network=Network(81543fb3-a8fe-4e9c-8180-c65fa4dcc9e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape78ed806-3f') {{(pid=73572) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 10:25:51 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:25:51 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:25:51 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 10:25:51 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:25:51 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape78ed806-3f, may_exist=True, interface_attrs={}) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:25:51 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape78ed806-3f, col_values=(('external_ids', {'iface-id': 'e78ed806-3f29-444e-b7d5-d0c9ba2b06aa', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4a:d9:27', 'vm-uuid': '8bb0f50b-c8fb-4961-99c0-ca2b6b1768cd'}),), if_exists=True) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:25:51 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:25:51 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:25:51 user nova-compute[73572]: INFO os_vif [None req-3e278e6e-0236-4e81-a3fb-cfb1d616e1ad tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:d9:27,bridge_name='br-int',has_traffic_filtering=True,id=e78ed806-3f29-444e-b7d5-d0c9ba2b06aa,network=Network(81543fb3-a8fe-4e9c-8180-c65fa4dcc9e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape78ed806-3f')
Aug 26 10:25:51 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-3e278e6e-0236-4e81-a3fb-cfb1d616e1ad tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] No BDM found with device name vda, not building metadata. {{(pid=73572) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 10:25:51 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-3e278e6e-0236-4e81-a3fb-cfb1d616e1ad tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] No VIF found with MAC fa:16:3e:4a:d9:27, not building metadata {{(pid=73572) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 10:25:51 user nova-compute[73572]: DEBUG nova.network.neutron [req-6d913be2-4586-46ad-8189-3d213dc2d361 req-8b156e05-277f-473b-ab49-d6cb4e4b8bf6 service nova] [instance: 8bb0f50b-c8fb-4961-99c0-ca2b6b1768cd] Updated VIF entry in instance network info cache for port e78ed806-3f29-444e-b7d5-d0c9ba2b06aa. {{(pid=73572) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 10:25:51 user nova-compute[73572]: DEBUG nova.network.neutron [req-6d913be2-4586-46ad-8189-3d213dc2d361 req-8b156e05-277f-473b-ab49-d6cb4e4b8bf6 service nova] [instance: 8bb0f50b-c8fb-4961-99c0-ca2b6b1768cd] Updating instance_info_cache with network_info: [{"id": "e78ed806-3f29-444e-b7d5-d0c9ba2b06aa", "address": "fa:16:3e:4a:d9:27", "network": {"id": "81543fb3-a8fe-4e9c-8180-c65fa4dcc9e1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-469390371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "084df935eab842e58bad79afad7090f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape78ed806-3f", "ovs_interfaceid": "e78ed806-3f29-444e-b7d5-d0c9ba2b06aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:25:51 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-6d913be2-4586-46ad-8189-3d213dc2d361 req-8b156e05-277f-473b-ab49-d6cb4e4b8bf6 service nova] Releasing lock "refresh_cache-8bb0f50b-c8fb-4961-99c0-ca2b6b1768cd" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:25:52 user nova-compute[73572]: DEBUG nova.compute.manager [req-f0cf454a-9327-4589-a297-08764f26e107 req-cee8376f-0eac-4910-9e9e-3194b40d2811 service nova] [instance: 2eaea7c2-a5c0-4950-b033-0012b5cec0ee] Received event network-vif-plugged-0b4d66c9-2155-45ae-873a-2ee85776eeb7 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:25:52 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-f0cf454a-9327-4589-a297-08764f26e107 req-cee8376f-0eac-4910-9e9e-3194b40d2811 service nova] Acquiring lock "2eaea7c2-a5c0-4950-b033-0012b5cec0ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:25:52 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-f0cf454a-9327-4589-a297-08764f26e107 req-cee8376f-0eac-4910-9e9e-3194b40d2811 service nova] Lock "2eaea7c2-a5c0-4950-b033-0012b5cec0ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:25:52 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-f0cf454a-9327-4589-a297-08764f26e107 req-cee8376f-0eac-4910-9e9e-3194b40d2811 service nova] Lock "2eaea7c2-a5c0-4950-b033-0012b5cec0ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:25:52 user nova-compute[73572]: DEBUG nova.compute.manager [req-f0cf454a-9327-4589-a297-08764f26e107 req-cee8376f-0eac-4910-9e9e-3194b40d2811 service nova] [instance: 2eaea7c2-a5c0-4950-b033-0012b5cec0ee] No waiting events found dispatching network-vif-plugged-0b4d66c9-2155-45ae-873a-2ee85776eeb7 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:25:52 user nova-compute[73572]: WARNING nova.compute.manager [req-f0cf454a-9327-4589-a297-08764f26e107 req-cee8376f-0eac-4910-9e9e-3194b40d2811 service nova] [instance: 2eaea7c2-a5c0-4950-b033-0012b5cec0ee] Received unexpected event network-vif-plugged-0b4d66c9-2155-45ae-873a-2ee85776eeb7 for instance with vm_state rescued and task_state unrescuing.
Aug 26 10:25:52 user nova-compute[73572]: DEBUG nova.compute.manager [req-f0cf454a-9327-4589-a297-08764f26e107 req-cee8376f-0eac-4910-9e9e-3194b40d2811 service nova] [instance: 2eaea7c2-a5c0-4950-b033-0012b5cec0ee] Received event network-vif-plugged-0b4d66c9-2155-45ae-873a-2ee85776eeb7 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:25:52 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-f0cf454a-9327-4589-a297-08764f26e107 req-cee8376f-0eac-4910-9e9e-3194b40d2811 service nova] Acquiring lock "2eaea7c2-a5c0-4950-b033-0012b5cec0ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:25:52 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-f0cf454a-9327-4589-a297-08764f26e107 req-cee8376f-0eac-4910-9e9e-3194b40d2811 service nova] Lock "2eaea7c2-a5c0-4950-b033-0012b5cec0ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:25:52 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-f0cf454a-9327-4589-a297-08764f26e107 req-cee8376f-0eac-4910-9e9e-3194b40d2811 service nova] Lock "2eaea7c2-a5c0-4950-b033-0012b5cec0ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:25:52 user nova-compute[73572]: DEBUG nova.compute.manager [req-f0cf454a-9327-4589-a297-08764f26e107 req-cee8376f-0eac-4910-9e9e-3194b40d2811 service nova] [instance: 2eaea7c2-a5c0-4950-b033-0012b5cec0ee] No waiting events found dispatching network-vif-plugged-0b4d66c9-2155-45ae-873a-2ee85776eeb7 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:25:52 user nova-compute[73572]: WARNING nova.compute.manager [req-f0cf454a-9327-4589-a297-08764f26e107 req-cee8376f-0eac-4910-9e9e-3194b40d2811 service nova] [instance: 2eaea7c2-a5c0-4950-b033-0012b5cec0ee] Received unexpected event network-vif-plugged-0b4d66c9-2155-45ae-873a-2ee85776eeb7 for instance with vm_state rescued and task_state unrescuing.
Aug 26 10:25:52 user nova-compute[73572]: DEBUG nova.compute.manager [req-f0cf454a-9327-4589-a297-08764f26e107 req-cee8376f-0eac-4910-9e9e-3194b40d2811 service nova] [instance: 2eaea7c2-a5c0-4950-b033-0012b5cec0ee] Received event network-vif-unplugged-0b4d66c9-2155-45ae-873a-2ee85776eeb7 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:25:52 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-f0cf454a-9327-4589-a297-08764f26e107 req-cee8376f-0eac-4910-9e9e-3194b40d2811 service nova] Acquiring lock "2eaea7c2-a5c0-4950-b033-0012b5cec0ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:25:52 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-f0cf454a-9327-4589-a297-08764f26e107 req-cee8376f-0eac-4910-9e9e-3194b40d2811 service nova] Lock "2eaea7c2-a5c0-4950-b033-0012b5cec0ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:25:52 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-f0cf454a-9327-4589-a297-08764f26e107 req-cee8376f-0eac-4910-9e9e-3194b40d2811 service nova] Lock "2eaea7c2-a5c0-4950-b033-0012b5cec0ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:25:52 user nova-compute[73572]: DEBUG nova.compute.manager [req-f0cf454a-9327-4589-a297-08764f26e107 req-cee8376f-0eac-4910-9e9e-3194b40d2811 service nova] [instance: 2eaea7c2-a5c0-4950-b033-0012b5cec0ee] No waiting events found dispatching network-vif-unplugged-0b4d66c9-2155-45ae-873a-2ee85776eeb7 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:25:52 user nova-compute[73572]: WARNING nova.compute.manager [req-f0cf454a-9327-4589-a297-08764f26e107 req-cee8376f-0eac-4910-9e9e-3194b40d2811 service nova] [instance: 2eaea7c2-a5c0-4950-b033-0012b5cec0ee] Received unexpected event network-vif-unplugged-0b4d66c9-2155-45ae-873a-2ee85776eeb7 for instance with vm_state rescued and task_state unrescuing.
Aug 26 10:25:52 user nova-compute[73572]: DEBUG nova.compute.manager [req-f0cf454a-9327-4589-a297-08764f26e107 req-cee8376f-0eac-4910-9e9e-3194b40d2811 service nova] [instance: 2eaea7c2-a5c0-4950-b033-0012b5cec0ee] Received event network-vif-plugged-0b4d66c9-2155-45ae-873a-2ee85776eeb7 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:25:52 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-f0cf454a-9327-4589-a297-08764f26e107 req-cee8376f-0eac-4910-9e9e-3194b40d2811 service nova] Acquiring lock "2eaea7c2-a5c0-4950-b033-0012b5cec0ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:25:52 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-f0cf454a-9327-4589-a297-08764f26e107 req-cee8376f-0eac-4910-9e9e-3194b40d2811 service nova] Lock "2eaea7c2-a5c0-4950-b033-0012b5cec0ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:25:52 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-f0cf454a-9327-4589-a297-08764f26e107 req-cee8376f-0eac-4910-9e9e-3194b40d2811 service nova] Lock "2eaea7c2-a5c0-4950-b033-0012b5cec0ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:25:52 user nova-compute[73572]: DEBUG nova.compute.manager [req-f0cf454a-9327-4589-a297-08764f26e107 req-cee8376f-0eac-4910-9e9e-3194b40d2811 service nova] [instance: 2eaea7c2-a5c0-4950-b033-0012b5cec0ee] No waiting events found dispatching network-vif-plugged-0b4d66c9-2155-45ae-873a-2ee85776eeb7 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:25:52 user nova-compute[73572]: WARNING nova.compute.manager [req-f0cf454a-9327-4589-a297-08764f26e107 req-cee8376f-0eac-4910-9e9e-3194b40d2811 service nova] [instance: 2eaea7c2-a5c0-4950-b033-0012b5cec0ee] Received unexpected event network-vif-plugged-0b4d66c9-2155-45ae-873a-2ee85776eeb7 for instance with vm_state rescued and task_state unrescuing.
Aug 26 10:25:52 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:25:52 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:25:52 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:25:52 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:25:53 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:25:53 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:25:53 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:25:53 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:25:53 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:25:53 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:25:53 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:25:53 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:25:54 user nova-compute[73572]: DEBUG nova.compute.manager [req-1d955548-6e87-4927-9486-eeef77d1c072 req-f0c9f2e2-596a-4a15-a33c-738e9a5fb320 service nova] [instance: 2eaea7c2-a5c0-4950-b033-0012b5cec0ee] Received event network-vif-plugged-0b4d66c9-2155-45ae-873a-2ee85776eeb7 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:25:54 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-1d955548-6e87-4927-9486-eeef77d1c072 req-f0c9f2e2-596a-4a15-a33c-738e9a5fb320 service nova] Acquiring lock "2eaea7c2-a5c0-4950-b033-0012b5cec0ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:25:54 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-1d955548-6e87-4927-9486-eeef77d1c072 req-f0c9f2e2-596a-4a15-a33c-738e9a5fb320 service nova] Lock "2eaea7c2-a5c0-4950-b033-0012b5cec0ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:25:54 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-1d955548-6e87-4927-9486-eeef77d1c072 req-f0c9f2e2-596a-4a15-a33c-738e9a5fb320 service nova] Lock "2eaea7c2-a5c0-4950-b033-0012b5cec0ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:25:54 user nova-compute[73572]: DEBUG nova.compute.manager [req-1d955548-6e87-4927-9486-eeef77d1c072 req-f0c9f2e2-596a-4a15-a33c-738e9a5fb320 service nova] [instance: 2eaea7c2-a5c0-4950-b033-0012b5cec0ee] No waiting events found dispatching network-vif-plugged-0b4d66c9-2155-45ae-873a-2ee85776eeb7 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:25:54 user nova-compute[73572]: WARNING nova.compute.manager [req-1d955548-6e87-4927-9486-eeef77d1c072 req-f0c9f2e2-596a-4a15-a33c-738e9a5fb320 service nova] [instance: 2eaea7c2-a5c0-4950-b033-0012b5cec0ee] Received unexpected event network-vif-plugged-0b4d66c9-2155-45ae-873a-2ee85776eeb7 for instance with vm_state rescued and task_state unrescuing.
Aug 26 10:25:54 user nova-compute[73572]: DEBUG nova.compute.manager [req-1d955548-6e87-4927-9486-eeef77d1c072 req-f0c9f2e2-596a-4a15-a33c-738e9a5fb320 service nova] [instance: 2eaea7c2-a5c0-4950-b033-0012b5cec0ee] Received event network-vif-plugged-0b4d66c9-2155-45ae-873a-2ee85776eeb7 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:25:54 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-1d955548-6e87-4927-9486-eeef77d1c072 req-f0c9f2e2-596a-4a15-a33c-738e9a5fb320 service nova] Acquiring lock "2eaea7c2-a5c0-4950-b033-0012b5cec0ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:25:54 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-1d955548-6e87-4927-9486-eeef77d1c072 req-f0c9f2e2-596a-4a15-a33c-738e9a5fb320 service nova] Lock "2eaea7c2-a5c0-4950-b033-0012b5cec0ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:25:54 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-1d955548-6e87-4927-9486-eeef77d1c072 req-f0c9f2e2-596a-4a15-a33c-738e9a5fb320 service nova] Lock "2eaea7c2-a5c0-4950-b033-0012b5cec0ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:25:54 user nova-compute[73572]: DEBUG nova.compute.manager [req-1d955548-6e87-4927-9486-eeef77d1c072 req-f0c9f2e2-596a-4a15-a33c-738e9a5fb320 service nova] [instance: 2eaea7c2-a5c0-4950-b033-0012b5cec0ee] No waiting events found dispatching network-vif-plugged-0b4d66c9-2155-45ae-873a-2ee85776eeb7 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:25:54 user nova-compute[73572]: WARNING nova.compute.manager [req-1d955548-6e87-4927-9486-eeef77d1c072 req-f0c9f2e2-596a-4a15-a33c-738e9a5fb320 service nova] [instance: 2eaea7c2-a5c0-4950-b033-0012b5cec0ee] Received unexpected event network-vif-plugged-0b4d66c9-2155-45ae-873a-2ee85776eeb7 for instance with vm_state rescued and task_state unrescuing.
Aug 26 10:25:54 user nova-compute[73572]: DEBUG nova.compute.manager [req-1d955548-6e87-4927-9486-eeef77d1c072 req-f0c9f2e2-596a-4a15-a33c-738e9a5fb320 service nova] [instance: 8bb0f50b-c8fb-4961-99c0-ca2b6b1768cd] Received event network-vif-plugged-e78ed806-3f29-444e-b7d5-d0c9ba2b06aa {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:25:54 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-1d955548-6e87-4927-9486-eeef77d1c072 req-f0c9f2e2-596a-4a15-a33c-738e9a5fb320 service nova] Acquiring lock "8bb0f50b-c8fb-4961-99c0-ca2b6b1768cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:25:54 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-1d955548-6e87-4927-9486-eeef77d1c072 req-f0c9f2e2-596a-4a15-a33c-738e9a5fb320 service nova] Lock "8bb0f50b-c8fb-4961-99c0-ca2b6b1768cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:25:54 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-1d955548-6e87-4927-9486-eeef77d1c072 req-f0c9f2e2-596a-4a15-a33c-738e9a5fb320 service nova] Lock "8bb0f50b-c8fb-4961-99c0-ca2b6b1768cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:25:54 user nova-compute[73572]: DEBUG nova.compute.manager [req-1d955548-6e87-4927-9486-eeef77d1c072 req-f0c9f2e2-596a-4a15-a33c-738e9a5fb320 service nova] [instance: 8bb0f50b-c8fb-4961-99c0-ca2b6b1768cd] No waiting events found dispatching network-vif-plugged-e78ed806-3f29-444e-b7d5-d0c9ba2b06aa {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:25:54 user nova-compute[73572]: WARNING nova.compute.manager [req-1d955548-6e87-4927-9486-eeef77d1c072 req-f0c9f2e2-596a-4a15-a33c-738e9a5fb320 service nova] [instance: 8bb0f50b-c8fb-4961-99c0-ca2b6b1768cd] Received unexpected event network-vif-plugged-e78ed806-3f29-444e-b7d5-d0c9ba2b06aa for instance with vm_state building and task_state spawning.
Aug 26 10:25:54 user nova-compute[73572]: DEBUG nova.compute.manager [req-1d955548-6e87-4927-9486-eeef77d1c072 req-f0c9f2e2-596a-4a15-a33c-738e9a5fb320 service nova] [instance: 8bb0f50b-c8fb-4961-99c0-ca2b6b1768cd] Received event network-vif-plugged-e78ed806-3f29-444e-b7d5-d0c9ba2b06aa {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:25:54 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-1d955548-6e87-4927-9486-eeef77d1c072 req-f0c9f2e2-596a-4a15-a33c-738e9a5fb320 service nova] Acquiring lock "8bb0f50b-c8fb-4961-99c0-ca2b6b1768cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:25:54 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-1d955548-6e87-4927-9486-eeef77d1c072 req-f0c9f2e2-596a-4a15-a33c-738e9a5fb320 service nova] Lock "8bb0f50b-c8fb-4961-99c0-ca2b6b1768cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:25:54 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-1d955548-6e87-4927-9486-eeef77d1c072 req-f0c9f2e2-596a-4a15-a33c-738e9a5fb320 service nova] Lock "8bb0f50b-c8fb-4961-99c0-ca2b6b1768cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:25:54 user nova-compute[73572]: DEBUG nova.compute.manager [req-1d955548-6e87-4927-9486-eeef77d1c072 req-f0c9f2e2-596a-4a15-a33c-738e9a5fb320 service nova] [instance: 8bb0f50b-c8fb-4961-99c0-ca2b6b1768cd] No waiting events found dispatching network-vif-plugged-e78ed806-3f29-444e-b7d5-d0c9ba2b06aa {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:25:54 user nova-compute[73572]: WARNING nova.compute.manager [req-1d955548-6e87-4927-9486-eeef77d1c072 req-f0c9f2e2-596a-4a15-a33c-738e9a5fb320 service nova] [instance: 8bb0f50b-c8fb-4961-99c0-ca2b6b1768cd] Received unexpected event network-vif-plugged-e78ed806-3f29-444e-b7d5-d0c9ba2b06aa for instance with vm_state building and task_state spawning.
Aug 26 10:25:55 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:25:55 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Removed pending event for 2eaea7c2-a5c0-4950-b033-0012b5cec0ee due to event {{(pid=73572) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 26 10:25:55 user nova-compute[73572]: DEBUG nova.virt.driver [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Emitting event <LifecycleEvent: 1693045555.8675988, 2eaea7c2-a5c0-4950-b033-0012b5cec0ee => Resumed> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:25:55 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 2eaea7c2-a5c0-4950-b033-0012b5cec0ee] VM Resumed (Lifecycle Event)
Aug 26 10:25:55 user nova-compute[73572]: DEBUG nova.compute.manager [None req-06501d72-e99a-42fe-a509-d29c61b9b678 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] [instance: 2eaea7c2-a5c0-4950-b033-0012b5cec0ee] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:25:55 user nova-compute[73572]: DEBUG nova.compute.manager [None req-3e278e6e-0236-4e81-a3fb-cfb1d616e1ad tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] [instance: 8bb0f50b-c8fb-4961-99c0-ca2b6b1768cd] Instance event wait completed in 0 seconds for  {{(pid=73572) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 10:25:55 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-3e278e6e-0236-4e81-a3fb-cfb1d616e1ad tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] [instance: 8bb0f50b-c8fb-4961-99c0-ca2b6b1768cd] Guest created on hypervisor {{(pid=73572) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 10:25:55 user nova-compute[73572]: INFO nova.virt.libvirt.driver [-] [instance: 8bb0f50b-c8fb-4961-99c0-ca2b6b1768cd] Instance spawned successfully.
Aug 26 10:25:55 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-3e278e6e-0236-4e81-a3fb-cfb1d616e1ad tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] [instance: 8bb0f50b-c8fb-4961-99c0-ca2b6b1768cd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 10:25:55 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 2eaea7c2-a5c0-4950-b033-0012b5cec0ee] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:25:55 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 2eaea7c2-a5c0-4950-b033-0012b5cec0ee] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73572) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 10:25:55 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-3e278e6e-0236-4e81-a3fb-cfb1d616e1ad tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] [instance: 8bb0f50b-c8fb-4961-99c0-ca2b6b1768cd] Found default for hw_cdrom_bus of ide {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:25:55 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-3e278e6e-0236-4e81-a3fb-cfb1d616e1ad tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] [instance: 8bb0f50b-c8fb-4961-99c0-ca2b6b1768cd] Found default for hw_disk_bus of virtio {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:25:55 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-3e278e6e-0236-4e81-a3fb-cfb1d616e1ad tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] [instance: 8bb0f50b-c8fb-4961-99c0-ca2b6b1768cd] Found default for hw_input_bus of None {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:25:55 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-3e278e6e-0236-4e81-a3fb-cfb1d616e1ad tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] [instance: 8bb0f50b-c8fb-4961-99c0-ca2b6b1768cd] Found default for hw_pointer_model of None {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:25:55 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-3e278e6e-0236-4e81-a3fb-cfb1d616e1ad tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] [instance: 8bb0f50b-c8fb-4961-99c0-ca2b6b1768cd] Found default for hw_video_model of virtio {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:25:55 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-3e278e6e-0236-4e81-a3fb-cfb1d616e1ad tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] [instance: 8bb0f50b-c8fb-4961-99c0-ca2b6b1768cd] Found default for hw_vif_model of virtio {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:25:55 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 2eaea7c2-a5c0-4950-b033-0012b5cec0ee] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 26 10:25:55 user nova-compute[73572]: DEBUG nova.virt.driver [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Emitting event <LifecycleEvent: 1693045555.8717303, 2eaea7c2-a5c0-4950-b033-0012b5cec0ee => Started> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:25:55 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 2eaea7c2-a5c0-4950-b033-0012b5cec0ee] VM Started (Lifecycle Event)
Aug 26 10:25:55 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 2eaea7c2-a5c0-4950-b033-0012b5cec0ee] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:25:55 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 2eaea7c2-a5c0-4950-b033-0012b5cec0ee] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73572) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 10:25:55 user nova-compute[73572]: DEBUG nova.virt.driver [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Emitting event <LifecycleEvent: 1693045555.8722732, 8bb0f50b-c8fb-4961-99c0-ca2b6b1768cd => Resumed> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:25:55 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 8bb0f50b-c8fb-4961-99c0-ca2b6b1768cd] VM Resumed (Lifecycle Event)
Aug 26 10:25:56 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 8bb0f50b-c8fb-4961-99c0-ca2b6b1768cd] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:25:56 user nova-compute[73572]: INFO nova.compute.manager [None req-3e278e6e-0236-4e81-a3fb-cfb1d616e1ad tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] [instance: 8bb0f50b-c8fb-4961-99c0-ca2b6b1768cd] Took 7.63 seconds to spawn the instance on the hypervisor.
Aug 26 10:25:56 user nova-compute[73572]: DEBUG nova.compute.manager [None req-3e278e6e-0236-4e81-a3fb-cfb1d616e1ad tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] [instance: 8bb0f50b-c8fb-4961-99c0-ca2b6b1768cd] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:25:56 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 8bb0f50b-c8fb-4961-99c0-ca2b6b1768cd] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73572) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 10:25:56 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 8bb0f50b-c8fb-4961-99c0-ca2b6b1768cd] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 10:25:56 user nova-compute[73572]: DEBUG nova.virt.driver [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Emitting event <LifecycleEvent: 1693045555.8727407, 8bb0f50b-c8fb-4961-99c0-ca2b6b1768cd => Started> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:25:56 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 8bb0f50b-c8fb-4961-99c0-ca2b6b1768cd] VM Started (Lifecycle Event)
Aug 26 10:25:56 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:25:56 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 8bb0f50b-c8fb-4961-99c0-ca2b6b1768cd] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:25:56 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 8bb0f50b-c8fb-4961-99c0-ca2b6b1768cd] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73572) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 10:25:56 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 8bb0f50b-c8fb-4961-99c0-ca2b6b1768cd] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 10:25:56 user nova-compute[73572]: INFO nova.compute.manager [None req-3e278e6e-0236-4e81-a3fb-cfb1d616e1ad tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] [instance: 8bb0f50b-c8fb-4961-99c0-ca2b6b1768cd] Took 8.44 seconds to build instance.
Aug 26 10:25:56 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-3e278e6e-0236-4e81-a3fb-cfb1d616e1ad tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Lock "8bb0f50b-c8fb-4961-99c0-ca2b6b1768cd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.517s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:25:57 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-2173193a-cc29-4f8e-862d-1f4059829ad2 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Acquiring lock "44a737bf-3704-4193-8d24-b8d132267279" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:25:57 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-2173193a-cc29-4f8e-862d-1f4059829ad2 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Lock "44a737bf-3704-4193-8d24-b8d132267279" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:25:57 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-2173193a-cc29-4f8e-862d-1f4059829ad2 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Acquiring lock "44a737bf-3704-4193-8d24-b8d132267279-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:25:57 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-2173193a-cc29-4f8e-862d-1f4059829ad2 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Lock "44a737bf-3704-4193-8d24-b8d132267279-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:25:57 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-2173193a-cc29-4f8e-862d-1f4059829ad2 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Lock "44a737bf-3704-4193-8d24-b8d132267279-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:25:57 user nova-compute[73572]: INFO nova.compute.manager [None req-2173193a-cc29-4f8e-862d-1f4059829ad2 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] [instance: 44a737bf-3704-4193-8d24-b8d132267279] Terminating instance
Aug 26 10:25:57 user nova-compute[73572]: DEBUG nova.compute.manager [None req-2173193a-cc29-4f8e-862d-1f4059829ad2 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] [instance: 44a737bf-3704-4193-8d24-b8d132267279] Start destroying the instance on the hypervisor. {{(pid=73572) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 10:25:57 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:25:57 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:25:57 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:25:57 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:25:57 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:25:57 user nova-compute[73572]: DEBUG nova.compute.manager [req-b620ac31-7a8b-4f83-876d-d0af523d6c75 req-acb68534-9edb-499c-b302-bbe08916a48a service nova] [instance: 44a737bf-3704-4193-8d24-b8d132267279] Received event network-vif-unplugged-4d7425ac-5500-4d32-b0db-448d4bd29651 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:25:57 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-b620ac31-7a8b-4f83-876d-d0af523d6c75 req-acb68534-9edb-499c-b302-bbe08916a48a service nova] Acquiring lock "44a737bf-3704-4193-8d24-b8d132267279-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:25:57 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-b620ac31-7a8b-4f83-876d-d0af523d6c75 req-acb68534-9edb-499c-b302-bbe08916a48a service nova] Lock "44a737bf-3704-4193-8d24-b8d132267279-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:25:57 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-b620ac31-7a8b-4f83-876d-d0af523d6c75 req-acb68534-9edb-499c-b302-bbe08916a48a service nova] Lock "44a737bf-3704-4193-8d24-b8d132267279-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:25:57 user nova-compute[73572]: DEBUG nova.compute.manager [req-b620ac31-7a8b-4f83-876d-d0af523d6c75 req-acb68534-9edb-499c-b302-bbe08916a48a service nova] [instance: 44a737bf-3704-4193-8d24-b8d132267279] No waiting events found dispatching network-vif-unplugged-4d7425ac-5500-4d32-b0db-448d4bd29651 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:25:57 user nova-compute[73572]: DEBUG nova.compute.manager [req-b620ac31-7a8b-4f83-876d-d0af523d6c75 req-acb68534-9edb-499c-b302-bbe08916a48a service nova] [instance: 44a737bf-3704-4193-8d24-b8d132267279] Received event network-vif-unplugged-4d7425ac-5500-4d32-b0db-448d4bd29651 for instance with task_state deleting. {{(pid=73572) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 10:25:57 user nova-compute[73572]: INFO nova.virt.libvirt.driver [-] [instance: 44a737bf-3704-4193-8d24-b8d132267279] Instance destroyed successfully.
Aug 26 10:25:57 user nova-compute[73572]: DEBUG nova.objects.instance [None req-2173193a-cc29-4f8e-862d-1f4059829ad2 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Lazy-loading 'resources' on Instance uuid 44a737bf-3704-4193-8d24-b8d132267279 {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:25:57 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-2173193a-cc29-4f8e-862d-1f4059829ad2 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T10:20:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-78174165',display_name='tempest-AttachVolumeNegativeTest-server-78174165',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-78174165',id=26,image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHAXZXxh5sr9uv0a1z3l3OFMssLWWpYs2ayEFomQLQNkT5c8CXKXyIDQskEkHQQ3c+pAWzGLev6XdCDbdOJGftkfOWSncTYrStZ+JQ3aj7gzNKVMrEoaaTK4q6UEzCUVpA==',key_name='tempest-keypair-1525083416',keypairs=<?>,launch_index=0,launched_at=2023-08-26T10:20:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='47abd6293c07465389c379e3b5061164',ramdisk_id='',reservation_id='r-etn04ew6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-608798758',owner_user_name='tempest-AttachVolumeNegativeTest-608798758-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T10:20:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c7cf9c8d529d49149141add20c2b2af2',uuid=44a737bf-3704-4193-8d24-b8d132267279,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4d7425ac-5500-4d32-b0db-448d4bd29651", "address": "fa:16:3e:6a:ad:a7", "network": {"id": "880aa066-8f77-469b-a0c4-e4e94ae31e1a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-313654920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47abd6293c07465389c379e3b5061164", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d7425ac-55", "ovs_interfaceid": "4d7425ac-5500-4d32-b0db-448d4bd29651", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 10:25:57 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-2173193a-cc29-4f8e-862d-1f4059829ad2 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Converting VIF {"id": "4d7425ac-5500-4d32-b0db-448d4bd29651", "address": "fa:16:3e:6a:ad:a7", "network": {"id": "880aa066-8f77-469b-a0c4-e4e94ae31e1a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-313654920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47abd6293c07465389c379e3b5061164", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d7425ac-55", "ovs_interfaceid": "4d7425ac-5500-4d32-b0db-448d4bd29651", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:25:57 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-2173193a-cc29-4f8e-862d-1f4059829ad2 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6a:ad:a7,bridge_name='br-int',has_traffic_filtering=True,id=4d7425ac-5500-4d32-b0db-448d4bd29651,network=Network(880aa066-8f77-469b-a0c4-e4e94ae31e1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d7425ac-55') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:25:57 user nova-compute[73572]: DEBUG os_vif [None req-2173193a-cc29-4f8e-862d-1f4059829ad2 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6a:ad:a7,bridge_name='br-int',has_traffic_filtering=True,id=4d7425ac-5500-4d32-b0db-448d4bd29651,network=Network(880aa066-8f77-469b-a0c4-e4e94ae31e1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d7425ac-55') {{(pid=73572) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 10:25:57 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:25:57 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4d7425ac-55, bridge=br-int, if_exists=True) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:25:57 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:25:57 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:25:57 user nova-compute[73572]: INFO os_vif [None req-2173193a-cc29-4f8e-862d-1f4059829ad2 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6a:ad:a7,bridge_name='br-int',has_traffic_filtering=True,id=4d7425ac-5500-4d32-b0db-448d4bd29651,network=Network(880aa066-8f77-469b-a0c4-e4e94ae31e1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d7425ac-55')
Aug 26 10:25:57 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-2173193a-cc29-4f8e-862d-1f4059829ad2 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] [instance: 44a737bf-3704-4193-8d24-b8d132267279] Deleting instance files /opt/stack/data/nova/instances/44a737bf-3704-4193-8d24-b8d132267279_del
Aug 26 10:25:57 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-2173193a-cc29-4f8e-862d-1f4059829ad2 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] [instance: 44a737bf-3704-4193-8d24-b8d132267279] Deletion of /opt/stack/data/nova/instances/44a737bf-3704-4193-8d24-b8d132267279_del complete
Aug 26 10:25:57 user nova-compute[73572]: INFO nova.compute.manager [None req-2173193a-cc29-4f8e-862d-1f4059829ad2 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] [instance: 44a737bf-3704-4193-8d24-b8d132267279] Took 0.94 seconds to destroy the instance on the hypervisor.
Aug 26 10:25:57 user nova-compute[73572]: DEBUG oslo.service.loopingcall [None req-2173193a-cc29-4f8e-862d-1f4059829ad2 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73572) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 10:25:57 user nova-compute[73572]: DEBUG nova.compute.manager [-] [instance: 44a737bf-3704-4193-8d24-b8d132267279] Deallocating network for instance {{(pid=73572) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 10:25:57 user nova-compute[73572]: DEBUG nova.network.neutron [-] [instance: 44a737bf-3704-4193-8d24-b8d132267279] deallocate_for_instance() {{(pid=73572) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 10:25:58 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:25:58 user nova-compute[73572]: DEBUG nova.network.neutron [-] [instance: 44a737bf-3704-4193-8d24-b8d132267279] Updating instance_info_cache with network_info: [] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:25:58 user nova-compute[73572]: INFO nova.compute.manager [-] [instance: 44a737bf-3704-4193-8d24-b8d132267279] Took 0.97 seconds to deallocate network for instance.
Aug 26 10:25:58 user nova-compute[73572]: DEBUG nova.compute.manager [req-fab5d740-79da-4f5c-8242-5ec7f8b3e7b3 req-c4774572-de54-4994-83ac-490074ff1ca7 service nova] [instance: 44a737bf-3704-4193-8d24-b8d132267279] Received event network-vif-deleted-4d7425ac-5500-4d32-b0db-448d4bd29651 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:25:58 user nova-compute[73572]: INFO nova.compute.manager [req-fab5d740-79da-4f5c-8242-5ec7f8b3e7b3 req-c4774572-de54-4994-83ac-490074ff1ca7 service nova] [instance: 44a737bf-3704-4193-8d24-b8d132267279] Neutron deleted interface 4d7425ac-5500-4d32-b0db-448d4bd29651; detaching it from the instance and deleting it from the info cache
Aug 26 10:25:58 user nova-compute[73572]: DEBUG nova.network.neutron [req-fab5d740-79da-4f5c-8242-5ec7f8b3e7b3 req-c4774572-de54-4994-83ac-490074ff1ca7 service nova] [instance: 44a737bf-3704-4193-8d24-b8d132267279] Updating instance_info_cache with network_info: [] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:25:58 user nova-compute[73572]: DEBUG nova.compute.manager [req-fab5d740-79da-4f5c-8242-5ec7f8b3e7b3 req-c4774572-de54-4994-83ac-490074ff1ca7 service nova] [instance: 44a737bf-3704-4193-8d24-b8d132267279] Detach interface failed, port_id=4d7425ac-5500-4d32-b0db-448d4bd29651, reason: Instance 44a737bf-3704-4193-8d24-b8d132267279 could not be found. {{(pid=73572) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 10:25:58 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-2173193a-cc29-4f8e-862d-1f4059829ad2 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:25:58 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-2173193a-cc29-4f8e-862d-1f4059829ad2 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:25:59 user nova-compute[73572]: DEBUG nova.compute.provider_tree [None req-2173193a-cc29-4f8e-862d-1f4059829ad2 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Inventory has not changed in ProviderTree for provider: e2cec974-59b2-4c77-a53d-a7f4e5a30d75 {{(pid=73572) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 10:25:59 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-2173193a-cc29-4f8e-862d-1f4059829ad2 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Inventory has not changed for provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73572) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 10:25:59 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-2173193a-cc29-4f8e-862d-1f4059829ad2 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.511s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:25:59 user nova-compute[73572]: INFO nova.scheduler.client.report [None req-2173193a-cc29-4f8e-862d-1f4059829ad2 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Deleted allocations for instance 44a737bf-3704-4193-8d24-b8d132267279
Aug 26 10:25:59 user nova-compute[73572]: DEBUG nova.compute.manager [req-ddbdb852-46c9-4fe1-9262-ba6b3f331387 req-81c2d63e-468f-4fdb-a673-debdacaacfea service nova] [instance: 44a737bf-3704-4193-8d24-b8d132267279] Received event network-vif-plugged-4d7425ac-5500-4d32-b0db-448d4bd29651 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:25:59 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-ddbdb852-46c9-4fe1-9262-ba6b3f331387 req-81c2d63e-468f-4fdb-a673-debdacaacfea service nova] Acquiring lock "44a737bf-3704-4193-8d24-b8d132267279-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:25:59 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-ddbdb852-46c9-4fe1-9262-ba6b3f331387 req-81c2d63e-468f-4fdb-a673-debdacaacfea service nova] Lock "44a737bf-3704-4193-8d24-b8d132267279-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:25:59 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-ddbdb852-46c9-4fe1-9262-ba6b3f331387 req-81c2d63e-468f-4fdb-a673-debdacaacfea service nova] Lock "44a737bf-3704-4193-8d24-b8d132267279-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:25:59 user nova-compute[73572]: DEBUG nova.compute.manager [req-ddbdb852-46c9-4fe1-9262-ba6b3f331387 req-81c2d63e-468f-4fdb-a673-debdacaacfea service nova] [instance: 44a737bf-3704-4193-8d24-b8d132267279] No waiting events found dispatching network-vif-plugged-4d7425ac-5500-4d32-b0db-448d4bd29651 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:25:59 user nova-compute[73572]: WARNING nova.compute.manager [req-ddbdb852-46c9-4fe1-9262-ba6b3f331387 req-81c2d63e-468f-4fdb-a673-debdacaacfea service nova] [instance: 44a737bf-3704-4193-8d24-b8d132267279] Received unexpected event network-vif-plugged-4d7425ac-5500-4d32-b0db-448d4bd29651 for instance with vm_state deleted and task_state None.
Aug 26 10:25:59 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-2173193a-cc29-4f8e-862d-1f4059829ad2 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Lock "44a737bf-3704-4193-8d24-b8d132267279" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.616s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:26:00 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:26:02 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:26:05 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:26:07 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:26:10 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:26:12 user nova-compute[73572]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693045557.8194683, 44a737bf-3704-4193-8d24-b8d132267279 => Stopped> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:26:12 user nova-compute[73572]: INFO nova.compute.manager [-] [instance: 44a737bf-3704-4193-8d24-b8d132267279] VM Stopped (Lifecycle Event)
Aug 26 10:26:12 user nova-compute[73572]: DEBUG nova.compute.manager [None req-502f50d9-b1bf-4099-8d88-7aa1aa6cd068 None None] [instance: 44a737bf-3704-4193-8d24-b8d132267279] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:26:12 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:26:14 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:26:14 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Starting heal instance info cache {{(pid=73572) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 10:26:14 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquiring lock "refresh_cache-14fab12e-52be-4fe6-8777-bc7ebf3c25f1" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:26:14 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquired lock "refresh_cache-14fab12e-52be-4fe6-8777-bc7ebf3c25f1" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:26:14 user nova-compute[73572]: DEBUG nova.network.neutron [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] [instance: 14fab12e-52be-4fe6-8777-bc7ebf3c25f1] Forcefully refreshing network info cache for instance {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 10:26:15 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:26:15 user nova-compute[73572]: DEBUG nova.network.neutron [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] [instance: 14fab12e-52be-4fe6-8777-bc7ebf3c25f1] Updating instance_info_cache with network_info: [{"id": "1b2121f4-88b1-4815-9329-3c9e3172a2f6", "address": "fa:16:3e:b0:35:f5", "network": {"id": "991b9dff-5173-4456-a530-b1f7eb5cfa4a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1845930297-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4636f93c5bfc4653804de097aed2882c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b2121f4-88", "ovs_interfaceid": "1b2121f4-88b1-4815-9329-3c9e3172a2f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:26:15 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Releasing lock "refresh_cache-14fab12e-52be-4fe6-8777-bc7ebf3c25f1" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:26:15 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] [instance: 14fab12e-52be-4fe6-8777-bc7ebf3c25f1] Updated the network info_cache for instance {{(pid=73572) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 10:26:17 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:26:17 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:26:17 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73572) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 10:26:17 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:26:19 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:26:20 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:26:21 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:26:22 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:26:23 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:26:25 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:26:25 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:26:26 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:26:26 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:26:26 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:26:26 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:26:26 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Auditing locally available compute resources for user (node: user) {{(pid=73572) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 10:26:26 user nova-compute[73572]: DEBUG nova.compute.manager [req-11c76bd9-1a56-47c8-b354-39bec52f642d req-8d22ca23-d7f0-44e3-9ffd-858ed452da91 service nova] [instance: 6422ce7d-9348-48b2-9af0-ec322d482d2b] Received event network-changed-f995916a-1a71-47ac-9abd-2a24136e4981 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:26:26 user nova-compute[73572]: DEBUG nova.compute.manager [req-11c76bd9-1a56-47c8-b354-39bec52f642d req-8d22ca23-d7f0-44e3-9ffd-858ed452da91 service nova] [instance: 6422ce7d-9348-48b2-9af0-ec322d482d2b] Refreshing instance network info cache due to event network-changed-f995916a-1a71-47ac-9abd-2a24136e4981. {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 10:26:26 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-11c76bd9-1a56-47c8-b354-39bec52f642d req-8d22ca23-d7f0-44e3-9ffd-858ed452da91 service nova] Acquiring lock "refresh_cache-6422ce7d-9348-48b2-9af0-ec322d482d2b" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:26:26 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-11c76bd9-1a56-47c8-b354-39bec52f642d req-8d22ca23-d7f0-44e3-9ffd-858ed452da91 service nova] Acquired lock "refresh_cache-6422ce7d-9348-48b2-9af0-ec322d482d2b" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:26:26 user nova-compute[73572]: DEBUG nova.network.neutron [req-11c76bd9-1a56-47c8-b354-39bec52f642d req-8d22ca23-d7f0-44e3-9ffd-858ed452da91 service nova] [instance: 6422ce7d-9348-48b2-9af0-ec322d482d2b] Refreshing network info cache for port f995916a-1a71-47ac-9abd-2a24136e4981 {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 10:26:27 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6004b15a-be01-42eb-92ba-ae9d93dab708/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:26:27 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-05f47c2f-2e59-4eb7-a2bb-3eee3c62cd03 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Acquiring lock "6422ce7d-9348-48b2-9af0-ec322d482d2b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:26:27 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-05f47c2f-2e59-4eb7-a2bb-3eee3c62cd03 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Lock "6422ce7d-9348-48b2-9af0-ec322d482d2b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:26:27 user nova-compute[73572]: DEBUG nova.objects.instance [None req-05f47c2f-2e59-4eb7-a2bb-3eee3c62cd03 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Lazy-loading 'flavor' on Instance uuid 6422ce7d-9348-48b2-9af0-ec322d482d2b {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:26:27 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6004b15a-be01-42eb-92ba-ae9d93dab708/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:26:27 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6004b15a-be01-42eb-92ba-ae9d93dab708/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:26:27 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-05f47c2f-2e59-4eb7-a2bb-3eee3c62cd03 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] [instance: 6422ce7d-9348-48b2-9af0-ec322d482d2b] Ignoring supplied device name: /dev/vdb
Aug 26 10:26:27 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-05f47c2f-2e59-4eb7-a2bb-3eee3c62cd03 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Lock "6422ce7d-9348-48b2-9af0-ec322d482d2b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.117s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:26:27 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6004b15a-be01-42eb-92ba-ae9d93dab708/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:26:27 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b2d5f4e-37af-438c-859b-d4ca803b7d08/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:26:27 user nova-compute[73572]: DEBUG nova.network.neutron [req-11c76bd9-1a56-47c8-b354-39bec52f642d req-8d22ca23-d7f0-44e3-9ffd-858ed452da91 service nova] [instance: 6422ce7d-9348-48b2-9af0-ec322d482d2b] Updated VIF entry in instance network info cache for port f995916a-1a71-47ac-9abd-2a24136e4981. {{(pid=73572) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 10:26:27 user nova-compute[73572]: DEBUG nova.network.neutron [req-11c76bd9-1a56-47c8-b354-39bec52f642d req-8d22ca23-d7f0-44e3-9ffd-858ed452da91 service nova] [instance: 6422ce7d-9348-48b2-9af0-ec322d482d2b] Updating instance_info_cache with network_info: [{"id": "f995916a-1a71-47ac-9abd-2a24136e4981", "address": "fa:16:3e:02:84:35", "network": {"id": "146a7a16-6dfd-48bd-8c96-766bdbe89bed", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-631761752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84e33d9ef6ec45709135edc20c8d7720", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf995916a-1a", "ovs_interfaceid": "f995916a-1a71-47ac-9abd-2a24136e4981", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:26:27 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-11c76bd9-1a56-47c8-b354-39bec52f642d req-8d22ca23-d7f0-44e3-9ffd-858ed452da91 service nova] Releasing lock "refresh_cache-6422ce7d-9348-48b2-9af0-ec322d482d2b" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:26:27 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-05f47c2f-2e59-4eb7-a2bb-3eee3c62cd03 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Acquiring lock "6422ce7d-9348-48b2-9af0-ec322d482d2b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:26:27 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-05f47c2f-2e59-4eb7-a2bb-3eee3c62cd03 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Lock "6422ce7d-9348-48b2-9af0-ec322d482d2b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:26:27 user nova-compute[73572]: INFO nova.compute.manager [None req-05f47c2f-2e59-4eb7-a2bb-3eee3c62cd03 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] [instance: 6422ce7d-9348-48b2-9af0-ec322d482d2b] Attaching volume 21602e43-35ed-4842-aa13-f04aca4243f2 to /dev/vdb
Aug 26 10:26:27 user nova-compute[73572]: DEBUG os_brick.utils [None req-05f47c2f-2e59-4eb7-a2bb-3eee3c62cd03 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 10:26:27 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:26:27 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b2d5f4e-37af-438c-859b-d4ca803b7d08/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:26:27 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b2d5f4e-37af-438c-859b-d4ca803b7d08/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:26:27 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:26:27 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[95977ddb-ba23-45c8-b1d1-8efacd26d9d5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:de8a79ed912\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:26:27 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:26:27 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:26:27 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfc1413a-3887-42ae-b5be-a21f46c7e6f4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:26:27 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:26:27 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:26:27 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[89772573-002e-471f-a544-3039e6a76d3d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:26:27 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[0779aecd-f894-4e47-b4ce-71eca3407256]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:26:27 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-05f47c2f-2e59-4eb7-a2bb-3eee3c62cd03 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Running cmd (subprocess): nvme version {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:26:27 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-05f47c2f-2e59-4eb7-a2bb-3eee3c62cd03 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] 'nvme version' failed. Not Retrying. {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 10:26:27 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.nvmeof [None req-05f47c2f-2e59-4eb7-a2bb-3eee3c62cd03 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] nvme not present on system {{(pid=73572) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 10:26:27 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:26:27 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 10:26:27 user nova-compute[73572]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 10:26:27 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[7868d769-7043-4c3f-a4dd-d61727917a2f]: (4, '') {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:26:27 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.lightos [None req-05f47c2f-2e59-4eb7-a2bb-3eee3c62cd03 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73572) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 10:26:27 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.lightos [None req-05f47c2f-2e59-4eb7-a2bb-3eee3c62cd03 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73572) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 10:26:27 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.lightos [None req-05f47c2f-2e59-4eb7-a2bb-3eee3c62cd03 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] LIGHTOS: no hostnqn found. {{(pid=73572) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 10:26:27 user nova-compute[73572]: DEBUG os_brick.utils [None req-05f47c2f-2e59-4eb7-a2bb-3eee3c62cd03 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] <== get_connector_properties: return (178ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:de8a79ed912', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 10:26:27 user nova-compute[73572]: DEBUG nova.virt.block_device [None req-05f47c2f-2e59-4eb7-a2bb-3eee3c62cd03 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] [instance: 6422ce7d-9348-48b2-9af0-ec322d482d2b] Updating existing volume attachment record: 7d792b13-0b35-4cd2-99cf-d3617a6d2ae2 {{(pid=73572) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 10:26:27 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b2d5f4e-37af-438c-859b-d4ca803b7d08/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:26:27 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86923c1a-89a5-4e7a-b488-8bf3a013bf83/disk.rescue --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:26:27 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:26:28 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86923c1a-89a5-4e7a-b488-8bf3a013bf83/disk.rescue --force-share --output=json" returned: 0 in 0.197s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:26:28 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86923c1a-89a5-4e7a-b488-8bf3a013bf83/disk.rescue --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:26:28 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86923c1a-89a5-4e7a-b488-8bf3a013bf83/disk.rescue --force-share --output=json" returned: 0 in 0.190s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:26:28 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86923c1a-89a5-4e7a-b488-8bf3a013bf83/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:26:28 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86923c1a-89a5-4e7a-b488-8bf3a013bf83/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:26:28 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86923c1a-89a5-4e7a-b488-8bf3a013bf83/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:26:28 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86923c1a-89a5-4e7a-b488-8bf3a013bf83/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:26:28 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c785b609-0068-442f-91f5-d26e888a993f/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:26:28 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c785b609-0068-442f-91f5-d26e888a993f/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:26:28 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c785b609-0068-442f-91f5-d26e888a993f/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:26:28 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c785b609-0068-442f-91f5-d26e888a993f/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:26:28 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e468b473-515f-41ad-a75c-65d4c6d575c8/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:26:29 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e468b473-515f-41ad-a75c-65d4c6d575c8/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:26:29 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e468b473-515f-41ad-a75c-65d4c6d575c8/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:26:29 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e468b473-515f-41ad-a75c-65d4c6d575c8/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:26:29 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bb0f50b-c8fb-4961-99c0-ca2b6b1768cd/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:26:29 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bb0f50b-c8fb-4961-99c0-ca2b6b1768cd/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:26:29 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bb0f50b-c8fb-4961-99c0-ca2b6b1768cd/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:26:29 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bb0f50b-c8fb-4961-99c0-ca2b6b1768cd/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:26:29 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=73572) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 10:26:29 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68613b1e-c45c-4fd9-834c-3630ed0f456a/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:26:30 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68613b1e-c45c-4fd9-834c-3630ed0f456a/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:26:30 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68613b1e-c45c-4fd9-834c-3630ed0f456a/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:26:30 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:26:30 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68613b1e-c45c-4fd9-834c-3630ed0f456a/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:26:30 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2eaea7c2-a5c0-4950-b033-0012b5cec0ee/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:26:30 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2eaea7c2-a5c0-4950-b033-0012b5cec0ee/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:26:30 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2eaea7c2-a5c0-4950-b033-0012b5cec0ee/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:26:30 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2eaea7c2-a5c0-4950-b033-0012b5cec0ee/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:26:30 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=73572) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 10:26:30 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a8816e5-696d-4384-b0e0-29aa7cdd957c/disk.rescue --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:26:30 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a8816e5-696d-4384-b0e0-29aa7cdd957c/disk.rescue --force-share --output=json" returned: 0 in 0.196s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:26:30 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a8816e5-696d-4384-b0e0-29aa7cdd957c/disk.rescue --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:26:31 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a8816e5-696d-4384-b0e0-29aa7cdd957c/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:26:31 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6422ce7d-9348-48b2-9af0-ec322d482d2b/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:26:31 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6422ce7d-9348-48b2-9af0-ec322d482d2b/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:26:31 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6422ce7d-9348-48b2-9af0-ec322d482d2b/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:26:31 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6422ce7d-9348-48b2-9af0-ec322d482d2b/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:26:31 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f3db0fa-682c-4b33-966b-9e50b7349b6e/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:26:31 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f3db0fa-682c-4b33-966b-9e50b7349b6e/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:26:31 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f3db0fa-682c-4b33-966b-9e50b7349b6e/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:26:31 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f3db0fa-682c-4b33-966b-9e50b7349b6e/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:26:31 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73572) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 10:26:32 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:26:32 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:26:32 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Hypervisor/Node resource view: name=user free_ram=7027MB free_disk=24.94530487060547GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=73572) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 10:26:32 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:26:32 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:26:32 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance c785b609-0068-442f-91f5-d26e888a993f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:26:32 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance 14fab12e-52be-4fe6-8777-bc7ebf3c25f1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:26:32 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance 2eaea7c2-a5c0-4950-b033-0012b5cec0ee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:26:32 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance 86923c1a-89a5-4e7a-b488-8bf3a013bf83 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:26:32 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance e468b473-515f-41ad-a75c-65d4c6d575c8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:26:32 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance 68613b1e-c45c-4fd9-834c-3630ed0f456a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:26:32 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance 1f3db0fa-682c-4b33-966b-9e50b7349b6e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:26:32 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance 8a8816e5-696d-4384-b0e0-29aa7cdd957c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:26:32 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance 6422ce7d-9348-48b2-9af0-ec322d482d2b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:26:32 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance 6b2d5f4e-37af-438c-859b-d4ca803b7d08 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:26:32 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance 6004b15a-be01-42eb-92ba-ae9d93dab708 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:26:32 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance 8bb0f50b-c8fb-4961-99c0-ca2b6b1768cd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:26:32 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=73572) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 10:26:32 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=73572) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 10:26:32 user nova-compute[73572]: DEBUG nova.compute.provider_tree [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Inventory has not changed in ProviderTree for provider: e2cec974-59b2-4c77-a53d-a7f4e5a30d75 {{(pid=73572) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 10:26:32 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Inventory has not changed for provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73572) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 10:26:32 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Compute_service record updated for user:user {{(pid=73572) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 10:26:32 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.476s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:26:32 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:26:33 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:26:35 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:26:35 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:26:37 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-0492b932-1231-4ff7-b8b3-6da5f42ac322 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Acquiring lock "f3fe3865-3d85-46cf-b24f-10b07e23aeff" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:26:37 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-0492b932-1231-4ff7-b8b3-6da5f42ac322 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Lock "f3fe3865-3d85-46cf-b24f-10b07e23aeff" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:26:37 user nova-compute[73572]: DEBUG nova.compute.manager [None req-0492b932-1231-4ff7-b8b3-6da5f42ac322 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: f3fe3865-3d85-46cf-b24f-10b07e23aeff] Starting instance... {{(pid=73572) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 10:26:37 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:26:37 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-0492b932-1231-4ff7-b8b3-6da5f42ac322 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:26:37 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-0492b932-1231-4ff7-b8b3-6da5f42ac322 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:26:37 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-0492b932-1231-4ff7-b8b3-6da5f42ac322 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73572) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 10:26:37 user nova-compute[73572]: INFO nova.compute.claims [None req-0492b932-1231-4ff7-b8b3-6da5f42ac322 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: f3fe3865-3d85-46cf-b24f-10b07e23aeff] Claim successful on node user
Aug 26 10:26:38 user nova-compute[73572]: DEBUG nova.compute.provider_tree [None req-0492b932-1231-4ff7-b8b3-6da5f42ac322 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Inventory has not changed in ProviderTree for provider: e2cec974-59b2-4c77-a53d-a7f4e5a30d75 {{(pid=73572) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 10:26:38 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-0492b932-1231-4ff7-b8b3-6da5f42ac322 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Inventory has not changed for provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73572) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 10:26:38 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-0492b932-1231-4ff7-b8b3-6da5f42ac322 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.433s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:26:38 user nova-compute[73572]: DEBUG nova.compute.manager [None req-0492b932-1231-4ff7-b8b3-6da5f42ac322 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: f3fe3865-3d85-46cf-b24f-10b07e23aeff] Start building networks asynchronously for instance. {{(pid=73572) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 10:26:38 user nova-compute[73572]: DEBUG nova.compute.manager [None req-0492b932-1231-4ff7-b8b3-6da5f42ac322 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: f3fe3865-3d85-46cf-b24f-10b07e23aeff] Allocating IP information in the background. {{(pid=73572) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 10:26:38 user nova-compute[73572]: DEBUG nova.network.neutron [None req-0492b932-1231-4ff7-b8b3-6da5f42ac322 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: f3fe3865-3d85-46cf-b24f-10b07e23aeff] allocate_for_instance() {{(pid=73572) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 10:26:38 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-0492b932-1231-4ff7-b8b3-6da5f42ac322 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: f3fe3865-3d85-46cf-b24f-10b07e23aeff] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 10:26:38 user nova-compute[73572]: DEBUG nova.compute.manager [None req-0492b932-1231-4ff7-b8b3-6da5f42ac322 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: f3fe3865-3d85-46cf-b24f-10b07e23aeff] Start building block device mappings for instance. {{(pid=73572) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 10:26:38 user nova-compute[73572]: INFO nova.virt.block_device [None req-0492b932-1231-4ff7-b8b3-6da5f42ac322 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: f3fe3865-3d85-46cf-b24f-10b07e23aeff] Booting with volume 448cd30a-3852-471f-903f-a2e5abc34b55 at /dev/vda
Aug 26 10:26:38 user nova-compute[73572]: DEBUG nova.policy [None req-0492b932-1231-4ff7-b8b3-6da5f42ac322 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e1e80942e5db41c782bda686b10e2e4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc130586d9f4581953f1b8ae1c4465e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73572) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 10:26:38 user nova-compute[73572]: DEBUG os_brick.utils [None req-0492b932-1231-4ff7-b8b3-6da5f42ac322 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 10:26:38 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:26:38 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:26:38 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4fb2b12-ebba-4bdf-9ce2-c19f0cc86318]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:de8a79ed912\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:26:38 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:26:38 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:26:38 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[66039c5a-5be3-445f-89d2-2753c27b3e8d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:26:38 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:26:38 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:26:38 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f0e0632-cba9-40e5-92d3-d6292924dcac]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:26:38 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[15df658c-2398-4c10-b1de-e3927ee82ebf]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:26:38 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-0492b932-1231-4ff7-b8b3-6da5f42ac322 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Running cmd (subprocess): nvme version {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:26:38 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-0492b932-1231-4ff7-b8b3-6da5f42ac322 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] 'nvme version' failed. Not Retrying. {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 10:26:38 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0492b932-1231-4ff7-b8b3-6da5f42ac322 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] nvme not present on system {{(pid=73572) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 10:26:38 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:26:38 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 10:26:38 user nova-compute[73572]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 10:26:38 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[8780a69d-8fe4-4075-9407-5ce9228167fc]: (4, '') {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:26:38 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.lightos [None req-0492b932-1231-4ff7-b8b3-6da5f42ac322 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73572) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 10:26:38 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.lightos [None req-0492b932-1231-4ff7-b8b3-6da5f42ac322 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73572) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 10:26:38 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.lightos [None req-0492b932-1231-4ff7-b8b3-6da5f42ac322 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] LIGHTOS: no hostnqn found. {{(pid=73572) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 10:26:38 user nova-compute[73572]: DEBUG os_brick.utils [None req-0492b932-1231-4ff7-b8b3-6da5f42ac322 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:de8a79ed912', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 10:26:38 user nova-compute[73572]: DEBUG nova.virt.block_device [None req-0492b932-1231-4ff7-b8b3-6da5f42ac322 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: f3fe3865-3d85-46cf-b24f-10b07e23aeff] Updating existing volume attachment record: 4922789c-08c6-467f-a432-517a17fb16de {{(pid=73572) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 10:26:38 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-05f47c2f-2e59-4eb7-a2bb-3eee3c62cd03 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] [instance: 6422ce7d-9348-48b2-9af0-ec322d482d2b] Calling os-brick to attach iSCSI Volume {{(pid=73572) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 10:26:38 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-05f47c2f-2e59-4eb7-a2bb-3eee3c62cd03 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc89c3d6a10>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:21602e43-35ed-4842-aa13-f04aca4243f2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HbfPQgus', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 10:26:38 user nova-compute[73572]: WARNING os_brick.initiator.connectors.base [None req-05f47c2f-2e59-4eb7-a2bb-3eee3c62cd03 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 10:26:38 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-05f47c2f-2e59-4eb7-a2bb-3eee3c62cd03 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 10:26:38 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-05f47c2f-2e59-4eb7-a2bb-3eee3c62cd03 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 10:26:38 user nova-compute[73572]: WARNING os_brick.initiator.connectors.base [None req-05f47c2f-2e59-4eb7-a2bb-3eee3c62cd03 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 10:26:38 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-05f47c2f-2e59-4eb7-a2bb-3eee3c62cd03 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:21602e43-35ed-4842-aa13-f04aca4243f2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 10:26:38 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-05f47c2f-2e59-4eb7-a2bb-3eee3c62cd03 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:21602e43-35ed-4842-aa13-f04aca4243f2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 10:26:38 user nova-compute[73572]: INFO os_brick.initiator.connectors.iscsi [None req-05f47c2f-2e59-4eb7-a2bb-3eee3c62cd03 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 10:26:38 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21602e43-35ed-4842-aa13-f04aca4243f2 -p 172.16.0.220:3260 {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:26:38 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21602e43-35ed-4842-aa13-f04aca4243f2 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:26:38 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[d15e226a-d211-4be6-93bb-e0c7e6c3e710]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:26:38 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-05f47c2f-2e59-4eb7-a2bb-3eee3c62cd03 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 10:26:38 user nova-compute[73572]:  {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:26:38 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21602e43-35ed-4842-aa13-f04aca4243f2 -p 172.16.0.220:3260 --interface default --op new {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:26:38 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21602e43-35ed-4842-aa13-f04aca4243f2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:26:38 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e3086be-d5fb-4b6e-8987-8ffd487b528d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:21602e43-35ed-4842-aa13-f04aca4243f2] added\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:26:38 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-05f47c2f-2e59-4eb7-a2bb-3eee3c62cd03 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:21602e43-35ed-4842-aa13-f04aca4243f2] added
Aug 26 10:26:38 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:26:38 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21602e43-35ed-4842-aa13-f04aca4243f2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:26:38 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21602e43-35ed-4842-aa13-f04aca4243f2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:26:38 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[26d997e5-e0ef-4c63-9e55-635855c9b35c]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:26:38 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-05f47c2f-2e59-4eb7-a2bb-3eee3c62cd03 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:26:38 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21602e43-35ed-4842-aa13-f04aca4243f2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:26:38 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21602e43-35ed-4842-aa13-f04aca4243f2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:26:38 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[df43b7d1-0d78-44b0-92b6-e715332249d3]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:26:38 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-05f47c2f-2e59-4eb7-a2bb-3eee3c62cd03 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:26:38 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21602e43-35ed-4842-aa13-f04aca4243f2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HbfPQgus {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:26:38 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21602e43-35ed-4842-aa13-f04aca4243f2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HbfPQgus" returned: 0 in 0.022s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:26:38 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5b7b389-9896-4242-82c5-0d43b985e0d1]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:26:38 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-05f47c2f-2e59-4eb7-a2bb-3eee3c62cd03 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HbfPQgus'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:26:38 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21602e43-35ed-4842-aa13-f04aca4243f2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:26:38 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21602e43-35ed-4842-aa13-f04aca4243f2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:26:38 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c156657-435a-4c3e-acff-947f8a942dcf]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:26:38 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-05f47c2f-2e59-4eb7-a2bb-3eee3c62cd03 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:26:38 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:26:38 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:26:38 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[42b1c2d9-0290-44cb-9807-6830f85f6c4f]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133098b2-106a-427f-aa6d-2c10625dd152 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc0a3246-82a0-4d2f-9877-8a072dccf064 (non-flash)\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:26:38 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-05f47c2f-2e59-4eb7-a2bb-3eee3c62cd03 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)
Aug 26 10:26:38 user nova-compute[73572]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133098b2-106a-427f-aa6d-2c10625dd152 (non-flash)
Aug 26 10:26:38 user nova-compute[73572]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc0a3246-82a0-4d2f-9877-8a072dccf064 (non-flash)
Aug 26 10:26:38 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 10:26:38 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-05f47c2f-2e59-4eb7-a2bb-3eee3c62cd03 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)
Aug 26 10:26:38 user nova-compute[73572]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133098b2-106a-427f-aa6d-2c10625dd152 (non-flash)
Aug 26 10:26:38 user nova-compute[73572]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc0a3246-82a0-4d2f-9877-8a072dccf064 (non-flash)
Aug 26 10:26:38 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 10:26:38 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21602e43-35ed-4842-aa13-f04aca4243f2 -p 172.16.0.220:3260 --login {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:26:39 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21602e43-35ed-4842-aa13-f04aca4243f2 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:26:39 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f832049-4114-4219-874b-4d82d018685e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:21602e43-35ed-4842-aa13-f04aca4243f2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:21602e43-35ed-4842-aa13-f04aca4243f2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:26:39 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-05f47c2f-2e59-4eb7-a2bb-3eee3c62cd03 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:21602e43-35ed-4842-aa13-f04aca4243f2, portal: 172.16.0.220,3260]
Aug 26 10:26:39 user nova-compute[73572]: Login to [iface: default, target: iqn.2010-10.org.openstack:21602e43-35ed-4842-aa13-f04aca4243f2, portal: 172.16.0.220,3260] successful.
Aug 26 10:26:39 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:26:39 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21602e43-35ed-4842-aa13-f04aca4243f2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:26:39 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21602e43-35ed-4842-aa13-f04aca4243f2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:26:39 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[d72cc6c2-6eb1-4f5c-bef7-46d2f254ec69]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:26:39 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-05f47c2f-2e59-4eb7-a2bb-3eee3c62cd03 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:26:39 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:26:39 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:26:39 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[46ff89de-0a43-4e79-92db-a7cd316f72da]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133098b2-106a-427f-aa6d-2c10625dd152 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc0a3246-82a0-4d2f-9877-8a072dccf064 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21602e43-35ed-4842-aa13-f04aca4243f2 (non-flash)\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:26:39 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-05f47c2f-2e59-4eb7-a2bb-3eee3c62cd03 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)
Aug 26 10:26:39 user nova-compute[73572]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133098b2-106a-427f-aa6d-2c10625dd152 (non-flash)
Aug 26 10:26:39 user nova-compute[73572]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc0a3246-82a0-4d2f-9877-8a072dccf064 (non-flash)
Aug 26 10:26:39 user nova-compute[73572]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21602e43-35ed-4842-aa13-f04aca4243f2 (non-flash)
Aug 26 10:26:39 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 10:26:39 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-05f47c2f-2e59-4eb7-a2bb-3eee3c62cd03 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)
Aug 26 10:26:39 user nova-compute[73572]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133098b2-106a-427f-aa6d-2c10625dd152 (non-flash)
Aug 26 10:26:39 user nova-compute[73572]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc0a3246-82a0-4d2f-9877-8a072dccf064 (non-flash)
Aug 26 10:26:39 user nova-compute[73572]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21602e43-35ed-4842-aa13-f04aca4243f2 (non-flash)
Aug 26 10:26:39 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 10:26:39 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-05f47c2f-2e59-4eb7-a2bb-3eee3c62cd03 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:21602e43-35ed-4842-aa13-f04aca4243f2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.275s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 10:26:39 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-05f47c2f-2e59-4eb7-a2bb-3eee3c62cd03 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Connected to 172.16.0.220:3260 {{(pid=73572) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 10:26:39 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-05f47c2f-2e59-4eb7-a2bb-3eee3c62cd03 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] HCTL ('34', '-', '-', 0) found on session 36 with lun 0 {{(pid=73572) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 10:26:39 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-05f47c2f-2e59-4eb7-a2bb-3eee3c62cd03 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73572) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 10:26:39 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:26:39 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:26:39 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a839c32-4b43-4b2b-903b-06db39d6fcf6]: (4, ('- - 0', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:26:39 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-05f47c2f-2e59-4eb7-a2bb-3eee3c62cd03 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Searching for a device in session 36 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73572) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 10:26:39 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-05f47c2f-2e59-4eb7-a2bb-3eee3c62cd03 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HbfPQgus', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73572) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 10:26:39 user nova-compute[73572]: DEBUG nova.network.neutron [None req-0492b932-1231-4ff7-b8b3-6da5f42ac322 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: f3fe3865-3d85-46cf-b24f-10b07e23aeff] Successfully created port: 38c337db-9e4a-4f1c-ad65-e23f2afa7012 {{(pid=73572) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 10:26:40 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-05f47c2f-2e59-4eb7-a2bb-3eee3c62cd03 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.311s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 10:26:40 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-05f47c2f-2e59-4eb7-a2bb-3eee3c62cd03 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] <== connect_volume: return (1313ms) {'type': 'block', 'scsi_wwn': '23161633433303065', 'path': '/dev/sdc'} {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 10:26:40 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-05f47c2f-2e59-4eb7-a2bb-3eee3c62cd03 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] [instance: 6422ce7d-9348-48b2-9af0-ec322d482d2b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23161633433303065', 'path': '/dev/sdc'} {{(pid=73572) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 10:26:40 user nova-compute[73572]: DEBUG nova.objects.instance [None req-05f47c2f-2e59-4eb7-a2bb-3eee3c62cd03 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Lazy-loading 'flavor' on Instance uuid 6422ce7d-9348-48b2-9af0-ec322d482d2b {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:26:40 user nova-compute[73572]: DEBUG nova.virt.libvirt.guest [None req-05f47c2f-2e59-4eb7-a2bb-3eee3c62cd03 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 10:26:40 user nova-compute[73572]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 10:26:40 user nova-compute[73572]:   <source dev="/dev/sdc"/>
Aug 26 10:26:40 user nova-compute[73572]:   <target dev="vdb" bus="virtio"/>
Aug 26 10:26:40 user nova-compute[73572]:   <serial>21602e43-35ed-4842-aa13-f04aca4243f2</serial>
Aug 26 10:26:40 user nova-compute[73572]: </disk>
Aug 26 10:26:40 user nova-compute[73572]:  {{(pid=73572) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 10:26:40 user nova-compute[73572]: DEBUG nova.network.neutron [None req-0492b932-1231-4ff7-b8b3-6da5f42ac322 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: f3fe3865-3d85-46cf-b24f-10b07e23aeff] Successfully updated port: 38c337db-9e4a-4f1c-ad65-e23f2afa7012 {{(pid=73572) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 10:26:40 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-0492b932-1231-4ff7-b8b3-6da5f42ac322 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Acquiring lock "refresh_cache-f3fe3865-3d85-46cf-b24f-10b07e23aeff" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:26:40 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-0492b932-1231-4ff7-b8b3-6da5f42ac322 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Acquired lock "refresh_cache-f3fe3865-3d85-46cf-b24f-10b07e23aeff" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:26:40 user nova-compute[73572]: DEBUG nova.network.neutron [None req-0492b932-1231-4ff7-b8b3-6da5f42ac322 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: f3fe3865-3d85-46cf-b24f-10b07e23aeff] Building network info cache for instance {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 10:26:40 user nova-compute[73572]: DEBUG nova.compute.manager [req-29cd048f-11f8-4867-8860-1e7486da1645 req-103e2ded-0047-4184-8f0e-8231bf9126ce service nova] [instance: f3fe3865-3d85-46cf-b24f-10b07e23aeff] Received event network-changed-38c337db-9e4a-4f1c-ad65-e23f2afa7012 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:26:40 user nova-compute[73572]: DEBUG nova.compute.manager [req-29cd048f-11f8-4867-8860-1e7486da1645 req-103e2ded-0047-4184-8f0e-8231bf9126ce service nova] [instance: f3fe3865-3d85-46cf-b24f-10b07e23aeff] Refreshing instance network info cache due to event network-changed-38c337db-9e4a-4f1c-ad65-e23f2afa7012. {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 10:26:40 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-29cd048f-11f8-4867-8860-1e7486da1645 req-103e2ded-0047-4184-8f0e-8231bf9126ce service nova] Acquiring lock "refresh_cache-f3fe3865-3d85-46cf-b24f-10b07e23aeff" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:26:40 user nova-compute[73572]: DEBUG nova.network.neutron [None req-0492b932-1231-4ff7-b8b3-6da5f42ac322 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: f3fe3865-3d85-46cf-b24f-10b07e23aeff] Instance cache missing network info. {{(pid=73572) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 10:26:40 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-05f47c2f-2e59-4eb7-a2bb-3eee3c62cd03 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] No BDM found with device name vda, not building metadata. {{(pid=73572) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 10:26:40 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-05f47c2f-2e59-4eb7-a2bb-3eee3c62cd03 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73572) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 10:26:40 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-05f47c2f-2e59-4eb7-a2bb-3eee3c62cd03 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] No VIF found with MAC fa:16:3e:02:84:35, not building metadata {{(pid=73572) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 10:26:40 user nova-compute[73572]: DEBUG nova.network.neutron [None req-0492b932-1231-4ff7-b8b3-6da5f42ac322 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: f3fe3865-3d85-46cf-b24f-10b07e23aeff] Updating instance_info_cache with network_info: [{"id": "38c337db-9e4a-4f1c-ad65-e23f2afa7012", "address": "fa:16:3e:aa:5c:dc", "network": {"id": "c520ee18-34a7-4781-bc97-419e9a702d40", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-280196989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfc130586d9f4581953f1b8ae1c4465e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38c337db-9e", "ovs_interfaceid": "38c337db-9e4a-4f1c-ad65-e23f2afa7012", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:26:40 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-0492b932-1231-4ff7-b8b3-6da5f42ac322 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Releasing lock "refresh_cache-f3fe3865-3d85-46cf-b24f-10b07e23aeff" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:26:40 user nova-compute[73572]: DEBUG nova.compute.manager [None req-0492b932-1231-4ff7-b8b3-6da5f42ac322 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: f3fe3865-3d85-46cf-b24f-10b07e23aeff] Instance network_info: |[{"id": "38c337db-9e4a-4f1c-ad65-e23f2afa7012", "address": "fa:16:3e:aa:5c:dc", "network": {"id": "c520ee18-34a7-4781-bc97-419e9a702d40", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-280196989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfc130586d9f4581953f1b8ae1c4465e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38c337db-9e", "ovs_interfaceid": "38c337db-9e4a-4f1c-ad65-e23f2afa7012", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73572) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 10:26:40 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-29cd048f-11f8-4867-8860-1e7486da1645 req-103e2ded-0047-4184-8f0e-8231bf9126ce service nova] Acquired lock "refresh_cache-f3fe3865-3d85-46cf-b24f-10b07e23aeff" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:26:40 user nova-compute[73572]: DEBUG nova.network.neutron [req-29cd048f-11f8-4867-8860-1e7486da1645 req-103e2ded-0047-4184-8f0e-8231bf9126ce service nova] [instance: f3fe3865-3d85-46cf-b24f-10b07e23aeff] Refreshing network info cache for port 38c337db-9e4a-4f1c-ad65-e23f2afa7012 {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 10:26:40 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-05f47c2f-2e59-4eb7-a2bb-3eee3c62cd03 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Lock "6422ce7d-9348-48b2-9af0-ec322d482d2b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.281s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:26:41 user nova-compute[73572]: DEBUG nova.network.neutron [req-29cd048f-11f8-4867-8860-1e7486da1645 req-103e2ded-0047-4184-8f0e-8231bf9126ce service nova] [instance: f3fe3865-3d85-46cf-b24f-10b07e23aeff] Updated VIF entry in instance network info cache for port 38c337db-9e4a-4f1c-ad65-e23f2afa7012. {{(pid=73572) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 10:26:41 user nova-compute[73572]: DEBUG nova.network.neutron [req-29cd048f-11f8-4867-8860-1e7486da1645 req-103e2ded-0047-4184-8f0e-8231bf9126ce service nova] [instance: f3fe3865-3d85-46cf-b24f-10b07e23aeff] Updating instance_info_cache with network_info: [{"id": "38c337db-9e4a-4f1c-ad65-e23f2afa7012", "address": "fa:16:3e:aa:5c:dc", "network": {"id": "c520ee18-34a7-4781-bc97-419e9a702d40", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-280196989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfc130586d9f4581953f1b8ae1c4465e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38c337db-9e", "ovs_interfaceid": "38c337db-9e4a-4f1c-ad65-e23f2afa7012", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:26:41 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-29cd048f-11f8-4867-8860-1e7486da1645 req-103e2ded-0047-4184-8f0e-8231bf9126ce service nova] Releasing lock "refresh_cache-f3fe3865-3d85-46cf-b24f-10b07e23aeff" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:26:42 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:26:45 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:26:47 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:26:48 user nova-compute[73572]: DEBUG nova.compute.manager [req-bd0c6be4-f407-4aef-a186-74abbc46b218 req-44deb9a3-df3d-467a-b908-88509d725231 service nova] [instance: 1f3db0fa-682c-4b33-966b-9e50b7349b6e] Received event network-changed-56789500-c8b2-4391-b245-6a2998d9fb6c {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:26:48 user nova-compute[73572]: DEBUG nova.compute.manager [req-bd0c6be4-f407-4aef-a186-74abbc46b218 req-44deb9a3-df3d-467a-b908-88509d725231 service nova] [instance: 1f3db0fa-682c-4b33-966b-9e50b7349b6e] Refreshing instance network info cache due to event network-changed-56789500-c8b2-4391-b245-6a2998d9fb6c. {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 10:26:48 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-bd0c6be4-f407-4aef-a186-74abbc46b218 req-44deb9a3-df3d-467a-b908-88509d725231 service nova] Acquiring lock "refresh_cache-1f3db0fa-682c-4b33-966b-9e50b7349b6e" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:26:48 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-bd0c6be4-f407-4aef-a186-74abbc46b218 req-44deb9a3-df3d-467a-b908-88509d725231 service nova] Acquired lock "refresh_cache-1f3db0fa-682c-4b33-966b-9e50b7349b6e" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:26:48 user nova-compute[73572]: DEBUG nova.network.neutron [req-bd0c6be4-f407-4aef-a186-74abbc46b218 req-44deb9a3-df3d-467a-b908-88509d725231 service nova] [instance: 1f3db0fa-682c-4b33-966b-9e50b7349b6e] Refreshing network info cache for port 56789500-c8b2-4391-b245-6a2998d9fb6c {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 10:26:49 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-8bc46c29-5581-4c99-aaba-eea37ad1a212 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Acquiring lock "1f3db0fa-682c-4b33-966b-9e50b7349b6e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:26:49 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-8bc46c29-5581-4c99-aaba-eea37ad1a212 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Lock "1f3db0fa-682c-4b33-966b-9e50b7349b6e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.003s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:26:49 user nova-compute[73572]: INFO nova.compute.manager [None req-8bc46c29-5581-4c99-aaba-eea37ad1a212 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] [instance: 1f3db0fa-682c-4b33-966b-9e50b7349b6e] Detaching volume dc0a3246-82a0-4d2f-9877-8a072dccf064
Aug 26 10:26:49 user nova-compute[73572]: DEBUG nova.network.neutron [req-bd0c6be4-f407-4aef-a186-74abbc46b218 req-44deb9a3-df3d-467a-b908-88509d725231 service nova] [instance: 1f3db0fa-682c-4b33-966b-9e50b7349b6e] Updated VIF entry in instance network info cache for port 56789500-c8b2-4391-b245-6a2998d9fb6c. {{(pid=73572) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 10:26:49 user nova-compute[73572]: DEBUG nova.network.neutron [req-bd0c6be4-f407-4aef-a186-74abbc46b218 req-44deb9a3-df3d-467a-b908-88509d725231 service nova] [instance: 1f3db0fa-682c-4b33-966b-9e50b7349b6e] Updating instance_info_cache with network_info: [{"id": "56789500-c8b2-4391-b245-6a2998d9fb6c", "address": "fa:16:3e:b8:f0:d2", "network": {"id": "2a6e27c9-9bd2-4ccb-abf6-82d85524da90", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1822065121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb6ef2597eac461f959a568abd3031ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56789500-c8", "ovs_interfaceid": "56789500-c8b2-4391-b245-6a2998d9fb6c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:26:49 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-bd0c6be4-f407-4aef-a186-74abbc46b218 req-44deb9a3-df3d-467a-b908-88509d725231 service nova] Releasing lock "refresh_cache-1f3db0fa-682c-4b33-966b-9e50b7349b6e" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:26:49 user nova-compute[73572]: INFO nova.virt.block_device [None req-8bc46c29-5581-4c99-aaba-eea37ad1a212 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] [instance: 1f3db0fa-682c-4b33-966b-9e50b7349b6e] Attempting to driver detach volume dc0a3246-82a0-4d2f-9877-8a072dccf064 from mountpoint /dev/vdb
Aug 26 10:26:49 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-8bc46c29-5581-4c99-aaba-eea37ad1a212 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Attempting to detach device vdb from instance 1f3db0fa-682c-4b33-966b-9e50b7349b6e from the persistent domain config. {{(pid=73572) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 10:26:49 user nova-compute[73572]: DEBUG nova.virt.libvirt.guest [None req-8bc46c29-5581-4c99-aaba-eea37ad1a212 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 10:26:49 user nova-compute[73572]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 10:26:49 user nova-compute[73572]:   <source dev="/dev/sdb"/>
Aug 26 10:26:49 user nova-compute[73572]:   <target dev="vdb" bus="virtio"/>
Aug 26 10:26:49 user nova-compute[73572]:   <serial>dc0a3246-82a0-4d2f-9877-8a072dccf064</serial>
Aug 26 10:26:49 user nova-compute[73572]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 10:26:49 user nova-compute[73572]: </disk>
Aug 26 10:26:49 user nova-compute[73572]:  {{(pid=73572) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 10:26:49 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-8bc46c29-5581-4c99-aaba-eea37ad1a212 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Successfully detached device vdb from instance 1f3db0fa-682c-4b33-966b-9e50b7349b6e from the persistent domain config.
Aug 26 10:26:49 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-8bc46c29-5581-4c99-aaba-eea37ad1a212 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 1f3db0fa-682c-4b33-966b-9e50b7349b6e from the live domain config. {{(pid=73572) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 10:26:49 user nova-compute[73572]: DEBUG nova.virt.libvirt.guest [None req-8bc46c29-5581-4c99-aaba-eea37ad1a212 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 10:26:49 user nova-compute[73572]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 10:26:49 user nova-compute[73572]:   <source dev="/dev/sdb"/>
Aug 26 10:26:49 user nova-compute[73572]:   <target dev="vdb" bus="virtio"/>
Aug 26 10:26:49 user nova-compute[73572]:   <serial>dc0a3246-82a0-4d2f-9877-8a072dccf064</serial>
Aug 26 10:26:49 user nova-compute[73572]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 10:26:49 user nova-compute[73572]: </disk>
Aug 26 10:26:49 user nova-compute[73572]:  {{(pid=73572) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 10:26:49 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Received event <DeviceRemovedEvent: 1693045609.8276064, 1f3db0fa-682c-4b33-966b-9e50b7349b6e => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73572) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 10:26:49 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-8bc46c29-5581-4c99-aaba-eea37ad1a212 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 1f3db0fa-682c-4b33-966b-9e50b7349b6e {{(pid=73572) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 10:26:49 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-8bc46c29-5581-4c99-aaba-eea37ad1a212 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Successfully detached device vdb from instance 1f3db0fa-682c-4b33-966b-9e50b7349b6e from the live domain config.
Aug 26 10:26:49 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8bc46c29-5581-4c99-aaba-eea37ad1a212 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] [instance: 1f3db0fa-682c-4b33-966b-9e50b7349b6e] calling os-brick to detach iSCSI Volume {{(pid=73572) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 10:26:49 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bc46c29-5581-4c99-aaba-eea37ad1a212 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc89c3d6a10>, {'target_iqns': ['iqn.2010-10.org.openstack:dc0a3246-82a0-4d2f-9877-8a072dccf064'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zoNTGrvh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 10:26:49 user nova-compute[73572]: WARNING os_brick.initiator.connectors.base [None req-8bc46c29-5581-4c99-aaba-eea37ad1a212 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 10:26:49 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-8bc46c29-5581-4c99-aaba-eea37ad1a212 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 10:26:49 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-8bc46c29-5581-4c99-aaba-eea37ad1a212 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 10:26:49 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bc46c29-5581-4c99-aaba-eea37ad1a212 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dc0a3246-82a0-4d2f-9877-8a072dccf064', 0)] {{(pid=73572) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 10:26:49 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:26:49 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:26:49 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc8452b9-ea60-49b4-83ec-e78eb139cfe9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:133098b2-106a-427f-aa6d-2c10625dd152\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:21602e43-35ed-4842-aa13-f04aca4243f2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dc0a3246-82a0-4d2f-9877-8a072dccf064\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:26:49 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:26:49 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:26:49 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a5970d4-a48f-4080-93a5-ec5bf51b9fcd]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133098b2-106a-427f-aa6d-2c10625dd152 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc0a3246-82a0-4d2f-9877-8a072dccf064 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21602e43-35ed-4842-aa13-f04aca4243f2 (non-flash)\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:26:49 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bc46c29-5581-4c99-aaba-eea37ad1a212 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)
Aug 26 10:26:49 user nova-compute[73572]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133098b2-106a-427f-aa6d-2c10625dd152 (non-flash)
Aug 26 10:26:49 user nova-compute[73572]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc0a3246-82a0-4d2f-9877-8a072dccf064 (non-flash)
Aug 26 10:26:49 user nova-compute[73572]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21602e43-35ed-4842-aa13-f04aca4243f2 (non-flash)
Aug 26 10:26:49 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 10:26:49 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bc46c29-5581-4c99-aaba-eea37ad1a212 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)
Aug 26 10:26:49 user nova-compute[73572]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133098b2-106a-427f-aa6d-2c10625dd152 (non-flash)
Aug 26 10:26:49 user nova-compute[73572]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc0a3246-82a0-4d2f-9877-8a072dccf064 (non-flash)
Aug 26 10:26:49 user nova-compute[73572]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21602e43-35ed-4842-aa13-f04aca4243f2 (non-flash)
Aug 26 10:26:49 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 10:26:49 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bc46c29-5581-4c99-aaba-eea37ad1a212 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc878b33520>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dc0a3246-82a0-4d2f-9877-8a072dccf064'): ({'sdb'}, set())}) {{(pid=73572) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 10:26:49 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-8bc46c29-5581-4c99-aaba-eea37ad1a212 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Removing single pathed devices sdb {{(pid=73572) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 10:26:49 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:26:49 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:26:49 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[427c3f0a-285d-4129-8f2d-0bbfb79ba222]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:26:49 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:26:49 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:26:49 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[a008292a-fd2f-4d44-9262-1eb04e4d098d]: (4, ('ok\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:26:49 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-8bc46c29-5581-4c99-aaba-eea37ad1a212 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Flushing IO for device /dev/sdb {{(pid=73572) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 10:26:49 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:26:49 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:26:49 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[20499297-d55f-4dd4-a6dc-5e1686d64fe1]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:26:49 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-8bc46c29-5581-4c99-aaba-eea37ad1a212 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73572) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 10:26:49 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:26:50 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.036s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:26:50 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4582e7d-f78a-4e2b-b9d3-b8aa6038e405]: (4, ('1', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:26:50 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-8bc46c29-5581-4c99-aaba-eea37ad1a212 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73572) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 10:26:50 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-8bc46c29-5581-4c99-aaba-eea37ad1a212 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] SCSI volumes sdb have been removed. {{(pid=73572) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 10:26:50 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bc46c29-5581-4c99-aaba-eea37ad1a212 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dc0a3246-82a0-4d2f-9877-8a072dccf064')] {{(pid=73572) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 10:26:50 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc0a3246-82a0-4d2f-9877-8a072dccf064 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:26:50 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc0a3246-82a0-4d2f-9877-8a072dccf064 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:26:50 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3a3764c-9f6d-4a44-bc6d-932c4803c5c8]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:26:50 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bc46c29-5581-4c99-aaba-eea37ad1a212 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:26:50 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc0a3246-82a0-4d2f-9877-8a072dccf064 -p 172.16.0.220:3260 --logout {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:26:50 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc0a3246-82a0-4d2f-9877-8a072dccf064 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:26:50 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fe13148-6ac7-48bd-85a8-7278f96a1188]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:dc0a3246-82a0-4d2f-9877-8a072dccf064, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:dc0a3246-82a0-4d2f-9877-8a072dccf064, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:26:50 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bc46c29-5581-4c99-aaba-eea37ad1a212 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:dc0a3246-82a0-4d2f-9877-8a072dccf064, portal: 172.16.0.220,3260]
Aug 26 10:26:50 user nova-compute[73572]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:dc0a3246-82a0-4d2f-9877-8a072dccf064, portal: 172.16.0.220,3260] successful.
Aug 26 10:26:50 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:26:50 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc0a3246-82a0-4d2f-9877-8a072dccf064 -p 172.16.0.220:3260 --op delete {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:26:50 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc0a3246-82a0-4d2f-9877-8a072dccf064 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:26:50 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[b04d11a3-d324-40ab-8488-edf4b6756063]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:26:50 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bc46c29-5581-4c99-aaba-eea37ad1a212 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:26:50 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-8bc46c29-5581-4c99-aaba-eea37ad1a212 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.291s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 10:26:50 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bc46c29-5581-4c99-aaba-eea37ad1a212 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] <== disconnect_volume: return (292ms) None {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 10:26:50 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8bc46c29-5581-4c99-aaba-eea37ad1a212 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] [instance: 1f3db0fa-682c-4b33-966b-9e50b7349b6e] Disconnected iSCSI Volume {{(pid=73572) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 10:26:50 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:26:50 user nova-compute[73572]: DEBUG nova.compute.manager [req-5df32a3b-f2d3-45cc-b62a-9f98c02f614c req-90d88a88-b9e5-4d15-a8b9-479d899162e5 service nova] [instance: 1f3db0fa-682c-4b33-966b-9e50b7349b6e] Received event network-changed-56789500-c8b2-4391-b245-6a2998d9fb6c {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:26:50 user nova-compute[73572]: DEBUG nova.compute.manager [req-5df32a3b-f2d3-45cc-b62a-9f98c02f614c req-90d88a88-b9e5-4d15-a8b9-479d899162e5 service nova] [instance: 1f3db0fa-682c-4b33-966b-9e50b7349b6e] Refreshing instance network info cache due to event network-changed-56789500-c8b2-4391-b245-6a2998d9fb6c. {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 10:26:50 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-5df32a3b-f2d3-45cc-b62a-9f98c02f614c req-90d88a88-b9e5-4d15-a8b9-479d899162e5 service nova] Acquiring lock "refresh_cache-1f3db0fa-682c-4b33-966b-9e50b7349b6e" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:26:50 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-5df32a3b-f2d3-45cc-b62a-9f98c02f614c req-90d88a88-b9e5-4d15-a8b9-479d899162e5 service nova] Acquired lock "refresh_cache-1f3db0fa-682c-4b33-966b-9e50b7349b6e" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:26:50 user nova-compute[73572]: DEBUG nova.network.neutron [req-5df32a3b-f2d3-45cc-b62a-9f98c02f614c req-90d88a88-b9e5-4d15-a8b9-479d899162e5 service nova] [instance: 1f3db0fa-682c-4b33-966b-9e50b7349b6e] Refreshing network info cache for port 56789500-c8b2-4391-b245-6a2998d9fb6c {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 10:26:50 user nova-compute[73572]: DEBUG nova.compute.manager [None req-0492b932-1231-4ff7-b8b3-6da5f42ac322 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: f3fe3865-3d85-46cf-b24f-10b07e23aeff] Start spawning the instance on the hypervisor. {{(pid=73572) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 10:26:50 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-0492b932-1231-4ff7-b8b3-6da5f42ac322 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: f3fe3865-3d85-46cf-b24f-10b07e23aeff] Creating instance directory {{(pid=73572) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 10:26:50 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-0492b932-1231-4ff7-b8b3-6da5f42ac322 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: f3fe3865-3d85-46cf-b24f-10b07e23aeff] Creating image(s)
Aug 26 10:26:50 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-0492b932-1231-4ff7-b8b3-6da5f42ac322 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: f3fe3865-3d85-46cf-b24f-10b07e23aeff] Did not create local disks {{(pid=73572) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 26 10:26:50 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-0492b932-1231-4ff7-b8b3-6da5f42ac322 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: f3fe3865-3d85-46cf-b24f-10b07e23aeff] Ensure instance console log exists: /opt/stack/data/nova/instances/f3fe3865-3d85-46cf-b24f-10b07e23aeff/console.log {{(pid=73572) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 10:26:50 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-0492b932-1231-4ff7-b8b3-6da5f42ac322 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:26:50 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-0492b932-1231-4ff7-b8b3-6da5f42ac322 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:26:50 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-0492b932-1231-4ff7-b8b3-6da5f42ac322 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:26:50 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-0492b932-1231-4ff7-b8b3-6da5f42ac322 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: f3fe3865-3d85-46cf-b24f-10b07e23aeff] Start _get_guest_xml network_info=[{"id": "38c337db-9e4a-4f1c-ad65-e23f2afa7012", "address": "fa:16:3e:aa:5c:dc", "network": {"id": "c520ee18-34a7-4781-bc97-419e9a702d40", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-280196989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfc130586d9f4581953f1b8ae1c4465e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38c337db-9e", "ovs_interfaceid": "38c337db-9e4a-4f1c-ad65-e23f2afa7012", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'disk_bus': 'virtio', 'boot_index': 0, 'mount_device': '/dev/vda', 'attachment_id': '4922789c-08c6-467f-a432-517a17fb16de', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:448cd30a-3852-471f-903f-a2e5abc34b55'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'igxcACpS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f3fe3865-3d85-46cf-b24f-10b07e23aeff', 'attached_at': '', 'detached_at': '', 'volume_id': '448cd30a-3852-471f-903f-a2e5abc34b55', 'serial': '448cd30a-3852-471f-903f-a2e5abc34b55'}, 'guest_format': None, 'device_type': 'disk', 'volume_type': None} {{(pid=73572) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 10:26:50 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-0492b932-1231-4ff7-b8b3-6da5f42ac322 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:26:50 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-0492b932-1231-4ff7-b8b3-6da5f42ac322 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:26:50 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-0492b932-1231-4ff7-b8b3-6da5f42ac322 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73572) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 10:26:50 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-0492b932-1231-4ff7-b8b3-6da5f42ac322 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] CPU controller missing on host. {{(pid=73572) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 10:26:50 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-0492b932-1231-4ff7-b8b3-6da5f42ac322 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73572) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 10:26:50 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-0492b932-1231-4ff7-b8b3-6da5f42ac322 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] CPU controller found on host. {{(pid=73572) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 10:26:50 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-0492b932-1231-4ff7-b8b3-6da5f42ac322 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73572) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 10:26:50 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-0492b932-1231-4ff7-b8b3-6da5f42ac322 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T10:07:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 10:26:50 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-0492b932-1231-4ff7-b8b3-6da5f42ac322 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Flavor limits 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 10:26:50 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-0492b932-1231-4ff7-b8b3-6da5f42ac322 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Image limits 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 10:26:50 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-0492b932-1231-4ff7-b8b3-6da5f42ac322 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Flavor pref 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 10:26:50 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-0492b932-1231-4ff7-b8b3-6da5f42ac322 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Image pref 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 10:26:50 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-0492b932-1231-4ff7-b8b3-6da5f42ac322 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 10:26:50 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-0492b932-1231-4ff7-b8b3-6da5f42ac322 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 10:26:50 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-0492b932-1231-4ff7-b8b3-6da5f42ac322 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73572) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 10:26:50 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-0492b932-1231-4ff7-b8b3-6da5f42ac322 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Got 1 possible topologies {{(pid=73572) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 10:26:50 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-0492b932-1231-4ff7-b8b3-6da5f42ac322 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 10:26:50 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-0492b932-1231-4ff7-b8b3-6da5f42ac322 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 10:26:50 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0492b932-1231-4ff7-b8b3-6da5f42ac322 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: f3fe3865-3d85-46cf-b24f-10b07e23aeff] Calling os-brick to attach iSCSI Volume {{(pid=73572) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 10:26:50 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-0492b932-1231-4ff7-b8b3-6da5f42ac322 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc89c3d6a10>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:448cd30a-3852-471f-903f-a2e5abc34b55'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'igxcACpS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 10:26:50 user nova-compute[73572]: WARNING os_brick.initiator.connectors.base [None req-0492b932-1231-4ff7-b8b3-6da5f42ac322 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 10:26:50 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-0492b932-1231-4ff7-b8b3-6da5f42ac322 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 10:26:50 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-0492b932-1231-4ff7-b8b3-6da5f42ac322 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 10:26:50 user nova-compute[73572]: WARNING os_brick.initiator.connectors.base [None req-0492b932-1231-4ff7-b8b3-6da5f42ac322 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 10:26:50 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-0492b932-1231-4ff7-b8b3-6da5f42ac322 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:448cd30a-3852-471f-903f-a2e5abc34b55" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 10:26:50 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-0492b932-1231-4ff7-b8b3-6da5f42ac322 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:448cd30a-3852-471f-903f-a2e5abc34b55" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 10:26:50 user nova-compute[73572]: INFO os_brick.initiator.connectors.iscsi [None req-0492b932-1231-4ff7-b8b3-6da5f42ac322 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 10:26:50 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:448cd30a-3852-471f-903f-a2e5abc34b55 -p 172.16.0.220:3260 {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:26:50 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:448cd30a-3852-471f-903f-a2e5abc34b55 -p 172.16.0.220:3260" returned: 21 in 0.028s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:26:50 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[4993cbaa-bf63-4583-9703-1bd81bc96dff]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:26:50 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-0492b932-1231-4ff7-b8b3-6da5f42ac322 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 10:26:50 user nova-compute[73572]:  {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:26:50 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:448cd30a-3852-471f-903f-a2e5abc34b55 -p 172.16.0.220:3260 --interface default --op new {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:26:50 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:448cd30a-3852-471f-903f-a2e5abc34b55 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:26:50 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[67efc344-8bac-4ccf-8306-e643db95a139]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:448cd30a-3852-471f-903f-a2e5abc34b55] added\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:26:50 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-0492b932-1231-4ff7-b8b3-6da5f42ac322 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:448cd30a-3852-471f-903f-a2e5abc34b55] added
Aug 26 10:26:50 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:26:50 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:448cd30a-3852-471f-903f-a2e5abc34b55 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:26:50 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:448cd30a-3852-471f-903f-a2e5abc34b55 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:26:50 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4226eaa-2ed1-4bec-b724-2df6923efd2f]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:26:50 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-0492b932-1231-4ff7-b8b3-6da5f42ac322 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:26:50 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:448cd30a-3852-471f-903f-a2e5abc34b55 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:26:50 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:448cd30a-3852-471f-903f-a2e5abc34b55 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:26:50 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ed1c35d-f2a0-42d9-80a6-1de6d9093c9f]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:26:50 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-0492b932-1231-4ff7-b8b3-6da5f42ac322 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:26:50 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:448cd30a-3852-471f-903f-a2e5abc34b55 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v igxcACpS {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:26:50 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:448cd30a-3852-471f-903f-a2e5abc34b55 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v igxcACpS" returned: 0 in 0.020s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:26:50 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[35a6289a-6ed2-4a9b-ae02-bf88d796aeeb]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:26:50 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-0492b932-1231-4ff7-b8b3-6da5f42ac322 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'igxcACpS'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:26:50 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:448cd30a-3852-471f-903f-a2e5abc34b55 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:26:50 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:448cd30a-3852-471f-903f-a2e5abc34b55 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:26:50 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc4dcb55-fecd-48e9-8d5d-e1dcf80415ba]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:26:50 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-0492b932-1231-4ff7-b8b3-6da5f42ac322 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:26:50 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:26:50 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:26:50 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[6365c964-fc51-4f26-ab9b-2c4ea4c251de]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133098b2-106a-427f-aa6d-2c10625dd152 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21602e43-35ed-4842-aa13-f04aca4243f2 (non-flash)\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:26:50 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-0492b932-1231-4ff7-b8b3-6da5f42ac322 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)
Aug 26 10:26:50 user nova-compute[73572]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133098b2-106a-427f-aa6d-2c10625dd152 (non-flash)
Aug 26 10:26:50 user nova-compute[73572]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21602e43-35ed-4842-aa13-f04aca4243f2 (non-flash)
Aug 26 10:26:50 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 10:26:50 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-0492b932-1231-4ff7-b8b3-6da5f42ac322 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)
Aug 26 10:26:50 user nova-compute[73572]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133098b2-106a-427f-aa6d-2c10625dd152 (non-flash)
Aug 26 10:26:50 user nova-compute[73572]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21602e43-35ed-4842-aa13-f04aca4243f2 (non-flash)
Aug 26 10:26:50 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 10:26:50 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:448cd30a-3852-471f-903f-a2e5abc34b55 -p 172.16.0.220:3260 --login {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:26:50 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:448cd30a-3852-471f-903f-a2e5abc34b55 -p 172.16.0.220:3260 --login" returned: 0 in 0.088s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:26:50 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[53ba0c69-ce41-4701-9ddd-e8e8ab4997e9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:448cd30a-3852-471f-903f-a2e5abc34b55, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:448cd30a-3852-471f-903f-a2e5abc34b55, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:26:50 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-0492b932-1231-4ff7-b8b3-6da5f42ac322 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:448cd30a-3852-471f-903f-a2e5abc34b55, portal: 172.16.0.220,3260]
Aug 26 10:26:50 user nova-compute[73572]: Login to [iface: default, target: iqn.2010-10.org.openstack:448cd30a-3852-471f-903f-a2e5abc34b55, portal: 172.16.0.220,3260] successful.
Aug 26 10:26:50 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:26:50 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:448cd30a-3852-471f-903f-a2e5abc34b55 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:26:50 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:448cd30a-3852-471f-903f-a2e5abc34b55 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:26:50 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[023b9fad-f3f0-4232-98a0-0a16178a7c0b]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:26:50 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-0492b932-1231-4ff7-b8b3-6da5f42ac322 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:26:50 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:26:50 user nova-compute[73572]: DEBUG nova.network.neutron [req-5df32a3b-f2d3-45cc-b62a-9f98c02f614c req-90d88a88-b9e5-4d15-a8b9-479d899162e5 service nova] [instance: 1f3db0fa-682c-4b33-966b-9e50b7349b6e] Updated VIF entry in instance network info cache for port 56789500-c8b2-4391-b245-6a2998d9fb6c. {{(pid=73572) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 10:26:50 user nova-compute[73572]: DEBUG nova.network.neutron [req-5df32a3b-f2d3-45cc-b62a-9f98c02f614c req-90d88a88-b9e5-4d15-a8b9-479d899162e5 service nova] [instance: 1f3db0fa-682c-4b33-966b-9e50b7349b6e] Updating instance_info_cache with network_info: [{"id": "56789500-c8b2-4391-b245-6a2998d9fb6c", "address": "fa:16:3e:b8:f0:d2", "network": {"id": "2a6e27c9-9bd2-4ccb-abf6-82d85524da90", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1822065121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb6ef2597eac461f959a568abd3031ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56789500-c8", "ovs_interfaceid": "56789500-c8b2-4391-b245-6a2998d9fb6c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:26:50 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:26:50 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[ace55dbc-ec03-4cb0-a8a9-da4bf5deee83]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133098b2-106a-427f-aa6d-2c10625dd152 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21602e43-35ed-4842-aa13-f04aca4243f2 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:448cd30a-3852-471f-903f-a2e5abc34b55 (non-flash)\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:26:50 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-0492b932-1231-4ff7-b8b3-6da5f42ac322 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)
Aug 26 10:26:50 user nova-compute[73572]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133098b2-106a-427f-aa6d-2c10625dd152 (non-flash)
Aug 26 10:26:50 user nova-compute[73572]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21602e43-35ed-4842-aa13-f04aca4243f2 (non-flash)
Aug 26 10:26:50 user nova-compute[73572]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:448cd30a-3852-471f-903f-a2e5abc34b55 (non-flash)
Aug 26 10:26:50 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 10:26:50 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-0492b932-1231-4ff7-b8b3-6da5f42ac322 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)
Aug 26 10:26:50 user nova-compute[73572]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133098b2-106a-427f-aa6d-2c10625dd152 (non-flash)
Aug 26 10:26:50 user nova-compute[73572]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21602e43-35ed-4842-aa13-f04aca4243f2 (non-flash)
Aug 26 10:26:50 user nova-compute[73572]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:448cd30a-3852-471f-903f-a2e5abc34b55 (non-flash)
Aug 26 10:26:50 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 10:26:50 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-0492b932-1231-4ff7-b8b3-6da5f42ac322 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:448cd30a-3852-471f-903f-a2e5abc34b55" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.330s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 10:26:50 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-0492b932-1231-4ff7-b8b3-6da5f42ac322 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Connected to 172.16.0.220:3260 {{(pid=73572) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 10:26:50 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-0492b932-1231-4ff7-b8b3-6da5f42ac322 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] HCTL ('33', '-', '-', 0) found on session 37 with lun 0 {{(pid=73572) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 10:26:50 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-0492b932-1231-4ff7-b8b3-6da5f42ac322 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73572) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 10:26:50 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:26:50 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-5df32a3b-f2d3-45cc-b62a-9f98c02f614c req-90d88a88-b9e5-4d15-a8b9-479d899162e5 service nova] Releasing lock "refresh_cache-1f3db0fa-682c-4b33-966b-9e50b7349b6e" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:26:50 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.023s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:26:50 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cc32dd0-79e7-4962-bbb7-e00eba6291ba]: (4, ('- - 0', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:26:50 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-0492b932-1231-4ff7-b8b3-6da5f42ac322 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Searching for a device in session 37 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73572) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 10:26:50 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-0492b932-1231-4ff7-b8b3-6da5f42ac322 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'igxcACpS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73572) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 10:26:50 user nova-compute[73572]: DEBUG nova.objects.instance [None req-8bc46c29-5581-4c99-aaba-eea37ad1a212 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Lazy-loading 'flavor' on Instance uuid 1f3db0fa-682c-4b33-966b-9e50b7349b6e {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:26:51 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-8bc46c29-5581-4c99-aaba-eea37ad1a212 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Lock "1f3db0fa-682c-4b33-966b-9e50b7349b6e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.692s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:26:51 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-c2cc3ac7-46a2-44d0-a9b3-c8a5d73ead56 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Acquiring lock "d03d1626-e18b-4b15-a679-4543f7641ed7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:26:51 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-c2cc3ac7-46a2-44d0-a9b3-c8a5d73ead56 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Lock "d03d1626-e18b-4b15-a679-4543f7641ed7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:26:51 user nova-compute[73572]: DEBUG nova.compute.manager [None req-c2cc3ac7-46a2-44d0-a9b3-c8a5d73ead56 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] [instance: d03d1626-e18b-4b15-a679-4543f7641ed7] Starting instance... {{(pid=73572) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 10:26:51 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-c2cc3ac7-46a2-44d0-a9b3-c8a5d73ead56 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:26:51 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-c2cc3ac7-46a2-44d0-a9b3-c8a5d73ead56 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:26:51 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-c2cc3ac7-46a2-44d0-a9b3-c8a5d73ead56 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73572) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 10:26:51 user nova-compute[73572]: INFO nova.compute.claims [None req-c2cc3ac7-46a2-44d0-a9b3-c8a5d73ead56 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] [instance: d03d1626-e18b-4b15-a679-4543f7641ed7] Claim successful on node user
Aug 26 10:26:51 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-0492b932-1231-4ff7-b8b3-6da5f42ac322 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.366s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 10:26:51 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-0492b932-1231-4ff7-b8b3-6da5f42ac322 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] <== connect_volume: return (1368ms) {'type': 'block', 'scsi_wwn': '26237643961393833', 'path': '/dev/sdb'} {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 10:26:51 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0492b932-1231-4ff7-b8b3-6da5f42ac322 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: f3fe3865-3d85-46cf-b24f-10b07e23aeff] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26237643961393833', 'path': '/dev/sdb'} {{(pid=73572) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 10:26:51 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-0492b932-1231-4ff7-b8b3-6da5f42ac322 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T10:26:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1037838617',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1037838617',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1037838617',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEZK/c9rZSuuTYDFTH3zAABJ2ppblkTN/gB7qzhZcVSvG6RgE695rWpOG3yOm77jO0mCcIiwApLtU2ORv1+K6nGws7GhahZ/JGmAeI9jzNKnTvcM90KkoUFbEmUJiJyGSQ==',key_name='tempest-keypair-1727267876',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cfc130586d9f4581953f1b8ae1c4465e',ramdisk_id='',reservation_id='r-0vnd28m0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-73786062',owner_user_name='tempest-TestVolumeBootPattern-73786062-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T10:26:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e1e80942e5db41c782bda686b10e2e4b',uuid=f3fe3865-3d85-46cf-b24f-10b07e23aeff,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "38c337db-9e4a-4f1c-ad65-e23f2afa7012", "address": "fa:16:3e:aa:5c:dc", "network": {"id": "c520ee18-34a7-4781-bc97-419e9a702d40", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-280196989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfc130586d9f4581953f1b8ae1c4465e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38c337db-9e", "ovs_interfaceid": "38c337db-9e4a-4f1c-ad65-e23f2afa7012", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73572) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 10:26:51 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-0492b932-1231-4ff7-b8b3-6da5f42ac322 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Converting VIF {"id": "38c337db-9e4a-4f1c-ad65-e23f2afa7012", "address": "fa:16:3e:aa:5c:dc", "network": {"id": "c520ee18-34a7-4781-bc97-419e9a702d40", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-280196989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfc130586d9f4581953f1b8ae1c4465e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38c337db-9e", "ovs_interfaceid": "38c337db-9e4a-4f1c-ad65-e23f2afa7012", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:26:51 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-0492b932-1231-4ff7-b8b3-6da5f42ac322 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:aa:5c:dc,bridge_name='br-int',has_traffic_filtering=True,id=38c337db-9e4a-4f1c-ad65-e23f2afa7012,network=Network(c520ee18-34a7-4781-bc97-419e9a702d40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38c337db-9e') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:26:51 user nova-compute[73572]: DEBUG nova.objects.instance [None req-0492b932-1231-4ff7-b8b3-6da5f42ac322 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Lazy-loading 'pci_devices' on Instance uuid f3fe3865-3d85-46cf-b24f-10b07e23aeff {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:26:51 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-0492b932-1231-4ff7-b8b3-6da5f42ac322 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: f3fe3865-3d85-46cf-b24f-10b07e23aeff] End _get_guest_xml xml=<domain type="kvm">
Aug 26 10:26:51 user nova-compute[73572]:   <uuid>f3fe3865-3d85-46cf-b24f-10b07e23aeff</uuid>
Aug 26 10:26:51 user nova-compute[73572]:   <name>instance-00000026</name>
Aug 26 10:26:51 user nova-compute[73572]:   <memory>524288</memory>
Aug 26 10:26:51 user nova-compute[73572]:   <vcpu>1</vcpu>
Aug 26 10:26:51 user nova-compute[73572]:   <metadata>
Aug 26 10:26:51 user nova-compute[73572]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 10:26:51 user nova-compute[73572]:       <nova:package version="0.0.0"/>
Aug 26 10:26:51 user nova-compute[73572]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-1037838617</nova:name>
Aug 26 10:26:51 user nova-compute[73572]:       <nova:creationTime>2023-08-26 10:26:50</nova:creationTime>
Aug 26 10:26:51 user nova-compute[73572]:       <nova:flavor name="m1.tiny">
Aug 26 10:26:51 user nova-compute[73572]:         <nova:memory>512</nova:memory>
Aug 26 10:26:51 user nova-compute[73572]:         <nova:disk>1</nova:disk>
Aug 26 10:26:51 user nova-compute[73572]:         <nova:swap>0</nova:swap>
Aug 26 10:26:51 user nova-compute[73572]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 10:26:51 user nova-compute[73572]:         <nova:vcpus>1</nova:vcpus>
Aug 26 10:26:51 user nova-compute[73572]:       </nova:flavor>
Aug 26 10:26:51 user nova-compute[73572]:       <nova:owner>
Aug 26 10:26:51 user nova-compute[73572]:         <nova:user uuid="e1e80942e5db41c782bda686b10e2e4b">tempest-TestVolumeBootPattern-73786062-project-member</nova:user>
Aug 26 10:26:51 user nova-compute[73572]:         <nova:project uuid="cfc130586d9f4581953f1b8ae1c4465e">tempest-TestVolumeBootPattern-73786062</nova:project>
Aug 26 10:26:51 user nova-compute[73572]:       </nova:owner>
Aug 26 10:26:51 user nova-compute[73572]:       <nova:ports>
Aug 26 10:26:51 user nova-compute[73572]:         <nova:port uuid="38c337db-9e4a-4f1c-ad65-e23f2afa7012">
Aug 26 10:26:51 user nova-compute[73572]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 26 10:26:51 user nova-compute[73572]:         </nova:port>
Aug 26 10:26:51 user nova-compute[73572]:       </nova:ports>
Aug 26 10:26:51 user nova-compute[73572]:     </nova:instance>
Aug 26 10:26:51 user nova-compute[73572]:   </metadata>
Aug 26 10:26:51 user nova-compute[73572]:   <sysinfo type="smbios">
Aug 26 10:26:51 user nova-compute[73572]:     <system>
Aug 26 10:26:51 user nova-compute[73572]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 10:26:51 user nova-compute[73572]:       <entry name="product">OpenStack Nova</entry>
Aug 26 10:26:51 user nova-compute[73572]:       <entry name="version">0.0.0</entry>
Aug 26 10:26:51 user nova-compute[73572]:       <entry name="serial">f3fe3865-3d85-46cf-b24f-10b07e23aeff</entry>
Aug 26 10:26:51 user nova-compute[73572]:       <entry name="uuid">f3fe3865-3d85-46cf-b24f-10b07e23aeff</entry>
Aug 26 10:26:51 user nova-compute[73572]:       <entry name="family">Virtual Machine</entry>
Aug 26 10:26:51 user nova-compute[73572]:     </system>
Aug 26 10:26:51 user nova-compute[73572]:   </sysinfo>
Aug 26 10:26:51 user nova-compute[73572]:   <os>
Aug 26 10:26:51 user nova-compute[73572]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 10:26:51 user nova-compute[73572]:     <boot dev="hd"/>
Aug 26 10:26:51 user nova-compute[73572]:     <smbios mode="sysinfo"/>
Aug 26 10:26:51 user nova-compute[73572]:   </os>
Aug 26 10:26:51 user nova-compute[73572]:   <features>
Aug 26 10:26:51 user nova-compute[73572]:     <acpi/>
Aug 26 10:26:51 user nova-compute[73572]:     <apic/>
Aug 26 10:26:51 user nova-compute[73572]:     <vmcoreinfo/>
Aug 26 10:26:51 user nova-compute[73572]:   </features>
Aug 26 10:26:51 user nova-compute[73572]:   <clock offset="utc">
Aug 26 10:26:51 user nova-compute[73572]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 10:26:51 user nova-compute[73572]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 10:26:51 user nova-compute[73572]:     <timer name="hpet" present="no"/>
Aug 26 10:26:51 user nova-compute[73572]:   </clock>
Aug 26 10:26:51 user nova-compute[73572]:   <cpu mode="custom" match="exact">
Aug 26 10:26:51 user nova-compute[73572]:     <model>Nehalem</model>
Aug 26 10:26:51 user nova-compute[73572]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 10:26:51 user nova-compute[73572]:   </cpu>
Aug 26 10:26:51 user nova-compute[73572]:   <devices>
Aug 26 10:26:51 user nova-compute[73572]:     <disk type="block" device="disk">
Aug 26 10:26:51 user nova-compute[73572]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 10:26:51 user nova-compute[73572]:       <source dev="/dev/sdb"/>
Aug 26 10:26:51 user nova-compute[73572]:       <target dev="vda" bus="virtio"/>
Aug 26 10:26:51 user nova-compute[73572]:       <serial>448cd30a-3852-471f-903f-a2e5abc34b55</serial>
Aug 26 10:26:51 user nova-compute[73572]:     </disk>
Aug 26 10:26:51 user nova-compute[73572]:     <interface type="ethernet">
Aug 26 10:26:51 user nova-compute[73572]:       <mac address="fa:16:3e:aa:5c:dc"/>
Aug 26 10:26:51 user nova-compute[73572]:       <model type="virtio"/>
Aug 26 10:26:51 user nova-compute[73572]:       <mtu size="1442"/>
Aug 26 10:26:51 user nova-compute[73572]:       <target dev="tap38c337db-9e"/>
Aug 26 10:26:51 user nova-compute[73572]:     </interface>
Aug 26 10:26:51 user nova-compute[73572]:     <serial type="pty">
Aug 26 10:26:51 user nova-compute[73572]:       <log file="/opt/stack/data/nova/instances/f3fe3865-3d85-46cf-b24f-10b07e23aeff/console.log" append="off"/>
Aug 26 10:26:51 user nova-compute[73572]:     </serial>
Aug 26 10:26:51 user nova-compute[73572]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 10:26:51 user nova-compute[73572]:     <video>
Aug 26 10:26:51 user nova-compute[73572]:       <model type="virtio"/>
Aug 26 10:26:51 user nova-compute[73572]:     </video>
Aug 26 10:26:51 user nova-compute[73572]:     <rng model="virtio">
Aug 26 10:26:51 user nova-compute[73572]:       <backend model="random">/dev/urandom</backend>
Aug 26 10:26:51 user nova-compute[73572]:     </rng>
Aug 26 10:26:51 user nova-compute[73572]:     <controller type="usb" index="0" model="none"/>
Aug 26 10:26:51 user nova-compute[73572]:     <memballoon model="virtio">
Aug 26 10:26:51 user nova-compute[73572]:       <stats period="10"/>
Aug 26 10:26:51 user nova-compute[73572]:     </memballoon>
Aug 26 10:26:51 user nova-compute[73572]:   </devices>
Aug 26 10:26:51 user nova-compute[73572]: </domain>
Aug 26 10:26:51 user nova-compute[73572]:  {{(pid=73572) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 10:26:51 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-0492b932-1231-4ff7-b8b3-6da5f42ac322 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T10:26:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1037838617',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1037838617',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1037838617',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEZK/c9rZSuuTYDFTH3zAABJ2ppblkTN/gB7qzhZcVSvG6RgE695rWpOG3yOm77jO0mCcIiwApLtU2ORv1+K6nGws7GhahZ/JGmAeI9jzNKnTvcM90KkoUFbEmUJiJyGSQ==',key_name='tempest-keypair-1727267876',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cfc130586d9f4581953f1b8ae1c4465e',ramdisk_id='',reservation_id='r-0vnd28m0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-73786062',owner_user_name='tempest-TestVolumeBootPattern-73786062-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T10:26:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e1e80942e5db41c782bda686b10e2e4b',uuid=f3fe3865-3d85-46cf-b24f-10b07e23aeff,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "38c337db-9e4a-4f1c-ad65-e23f2afa7012", "address": "fa:16:3e:aa:5c:dc", "network": {"id": "c520ee18-34a7-4781-bc97-419e9a702d40", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-280196989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfc130586d9f4581953f1b8ae1c4465e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38c337db-9e", "ovs_interfaceid": "38c337db-9e4a-4f1c-ad65-e23f2afa7012", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 10:26:51 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-0492b932-1231-4ff7-b8b3-6da5f42ac322 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Converting VIF {"id": "38c337db-9e4a-4f1c-ad65-e23f2afa7012", "address": "fa:16:3e:aa:5c:dc", "network": {"id": "c520ee18-34a7-4781-bc97-419e9a702d40", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-280196989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfc130586d9f4581953f1b8ae1c4465e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38c337db-9e", "ovs_interfaceid": "38c337db-9e4a-4f1c-ad65-e23f2afa7012", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:26:51 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-0492b932-1231-4ff7-b8b3-6da5f42ac322 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:aa:5c:dc,bridge_name='br-int',has_traffic_filtering=True,id=38c337db-9e4a-4f1c-ad65-e23f2afa7012,network=Network(c520ee18-34a7-4781-bc97-419e9a702d40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38c337db-9e') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:26:51 user nova-compute[73572]: DEBUG os_vif [None req-0492b932-1231-4ff7-b8b3-6da5f42ac322 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:5c:dc,bridge_name='br-int',has_traffic_filtering=True,id=38c337db-9e4a-4f1c-ad65-e23f2afa7012,network=Network(c520ee18-34a7-4781-bc97-419e9a702d40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38c337db-9e') {{(pid=73572) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 10:26:51 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:26:51 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:26:51 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 10:26:51 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:26:51 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap38c337db-9e, may_exist=True, interface_attrs={}) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:26:51 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap38c337db-9e, col_values=(('external_ids', {'iface-id': '38c337db-9e4a-4f1c-ad65-e23f2afa7012', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:aa:5c:dc', 'vm-uuid': 'f3fe3865-3d85-46cf-b24f-10b07e23aeff'}),), if_exists=True) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:26:51 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:26:51 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:26:51 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:26:51 user nova-compute[73572]: INFO os_vif [None req-0492b932-1231-4ff7-b8b3-6da5f42ac322 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:5c:dc,bridge_name='br-int',has_traffic_filtering=True,id=38c337db-9e4a-4f1c-ad65-e23f2afa7012,network=Network(c520ee18-34a7-4781-bc97-419e9a702d40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38c337db-9e')
Aug 26 10:26:51 user nova-compute[73572]: DEBUG nova.compute.provider_tree [None req-c2cc3ac7-46a2-44d0-a9b3-c8a5d73ead56 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Inventory has not changed in ProviderTree for provider: e2cec974-59b2-4c77-a53d-a7f4e5a30d75 {{(pid=73572) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 10:26:51 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-0492b932-1231-4ff7-b8b3-6da5f42ac322 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] No BDM found with device name vda, not building metadata. {{(pid=73572) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 10:26:51 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-0492b932-1231-4ff7-b8b3-6da5f42ac322 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] No VIF found with MAC fa:16:3e:aa:5c:dc, not building metadata {{(pid=73572) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 10:26:51 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-c2cc3ac7-46a2-44d0-a9b3-c8a5d73ead56 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Inventory has not changed for provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73572) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 10:26:52 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-c2cc3ac7-46a2-44d0-a9b3-c8a5d73ead56 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.535s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:26:52 user nova-compute[73572]: DEBUG nova.compute.manager [None req-c2cc3ac7-46a2-44d0-a9b3-c8a5d73ead56 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] [instance: d03d1626-e18b-4b15-a679-4543f7641ed7] Start building networks asynchronously for instance. {{(pid=73572) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 10:26:52 user nova-compute[73572]: DEBUG nova.compute.manager [None req-c2cc3ac7-46a2-44d0-a9b3-c8a5d73ead56 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] [instance: d03d1626-e18b-4b15-a679-4543f7641ed7] Allocating IP information in the background. {{(pid=73572) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 10:26:52 user nova-compute[73572]: DEBUG nova.network.neutron [None req-c2cc3ac7-46a2-44d0-a9b3-c8a5d73ead56 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] [instance: d03d1626-e18b-4b15-a679-4543f7641ed7] allocate_for_instance() {{(pid=73572) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 10:26:52 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-c2cc3ac7-46a2-44d0-a9b3-c8a5d73ead56 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] [instance: d03d1626-e18b-4b15-a679-4543f7641ed7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 10:26:52 user nova-compute[73572]: DEBUG nova.compute.manager [None req-c2cc3ac7-46a2-44d0-a9b3-c8a5d73ead56 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] [instance: d03d1626-e18b-4b15-a679-4543f7641ed7] Start building block device mappings for instance. {{(pid=73572) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 10:26:52 user nova-compute[73572]: DEBUG nova.compute.manager [None req-c2cc3ac7-46a2-44d0-a9b3-c8a5d73ead56 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] [instance: d03d1626-e18b-4b15-a679-4543f7641ed7] Start spawning the instance on the hypervisor. {{(pid=73572) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 10:26:52 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-c2cc3ac7-46a2-44d0-a9b3-c8a5d73ead56 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] [instance: d03d1626-e18b-4b15-a679-4543f7641ed7] Creating instance directory {{(pid=73572) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 10:26:52 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-c2cc3ac7-46a2-44d0-a9b3-c8a5d73ead56 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] [instance: d03d1626-e18b-4b15-a679-4543f7641ed7] Creating image(s)
Aug 26 10:26:52 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-c2cc3ac7-46a2-44d0-a9b3-c8a5d73ead56 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Acquiring lock "/opt/stack/data/nova/instances/d03d1626-e18b-4b15-a679-4543f7641ed7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:26:52 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-c2cc3ac7-46a2-44d0-a9b3-c8a5d73ead56 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Lock "/opt/stack/data/nova/instances/d03d1626-e18b-4b15-a679-4543f7641ed7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:26:52 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-c2cc3ac7-46a2-44d0-a9b3-c8a5d73ead56 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Lock "/opt/stack/data/nova/instances/d03d1626-e18b-4b15-a679-4543f7641ed7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:26:52 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-c2cc3ac7-46a2-44d0-a9b3-c8a5d73ead56 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:26:52 user nova-compute[73572]: DEBUG nova.policy [None req-c2cc3ac7-46a2-44d0-a9b3-c8a5d73ead56 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c7cf9c8d529d49149141add20c2b2af2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47abd6293c07465389c379e3b5061164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73572) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 10:26:52 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-c2cc3ac7-46a2-44d0-a9b3-c8a5d73ead56 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json" returned: 0 in 0.182s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:26:52 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-c2cc3ac7-46a2-44d0-a9b3-c8a5d73ead56 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Acquiring lock "2099350d6f3bcd0de9471c73862d4fe75b049801" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:26:52 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-c2cc3ac7-46a2-44d0-a9b3-c8a5d73ead56 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Lock "2099350d6f3bcd0de9471c73862d4fe75b049801" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:26:52 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-c2cc3ac7-46a2-44d0-a9b3-c8a5d73ead56 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:26:52 user nova-compute[73572]: DEBUG nova.compute.manager [req-cc501dcb-1cb4-4b10-9608-e367fe3863f0 req-1902c190-5b90-4627-928d-b31540b77d3e service nova] [instance: 6b2d5f4e-37af-438c-859b-d4ca803b7d08] Received event network-changed-bf886914-b734-4957-9e48-4ef3d65c61f4 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:26:52 user nova-compute[73572]: DEBUG nova.compute.manager [req-cc501dcb-1cb4-4b10-9608-e367fe3863f0 req-1902c190-5b90-4627-928d-b31540b77d3e service nova] [instance: 6b2d5f4e-37af-438c-859b-d4ca803b7d08] Refreshing instance network info cache due to event network-changed-bf886914-b734-4957-9e48-4ef3d65c61f4. {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 10:26:52 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-cc501dcb-1cb4-4b10-9608-e367fe3863f0 req-1902c190-5b90-4627-928d-b31540b77d3e service nova] Acquiring lock "refresh_cache-6b2d5f4e-37af-438c-859b-d4ca803b7d08" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:26:52 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-cc501dcb-1cb4-4b10-9608-e367fe3863f0 req-1902c190-5b90-4627-928d-b31540b77d3e service nova] Acquired lock "refresh_cache-6b2d5f4e-37af-438c-859b-d4ca803b7d08" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:26:52 user nova-compute[73572]: DEBUG nova.network.neutron [req-cc501dcb-1cb4-4b10-9608-e367fe3863f0 req-1902c190-5b90-4627-928d-b31540b77d3e service nova] [instance: 6b2d5f4e-37af-438c-859b-d4ca803b7d08] Refreshing network info cache for port bf886914-b734-4957-9e48-4ef3d65c61f4 {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 10:26:52 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-c2cc3ac7-46a2-44d0-a9b3-c8a5d73ead56 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json" returned: 0 in 0.185s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:26:52 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-c2cc3ac7-46a2-44d0-a9b3-c8a5d73ead56 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801,backing_fmt=raw /opt/stack/data/nova/instances/d03d1626-e18b-4b15-a679-4543f7641ed7/disk 1073741824 {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:26:52 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-c2cc3ac7-46a2-44d0-a9b3-c8a5d73ead56 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801,backing_fmt=raw /opt/stack/data/nova/instances/d03d1626-e18b-4b15-a679-4543f7641ed7/disk 1073741824" returned: 0 in 0.064s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:26:52 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-c2cc3ac7-46a2-44d0-a9b3-c8a5d73ead56 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Lock "2099350d6f3bcd0de9471c73862d4fe75b049801" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.254s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:26:52 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-c2cc3ac7-46a2-44d0-a9b3-c8a5d73ead56 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:26:52 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-c2cc3ac7-46a2-44d0-a9b3-c8a5d73ead56 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json" returned: 0 in 0.200s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:26:52 user nova-compute[73572]: DEBUG nova.virt.disk.api [None req-c2cc3ac7-46a2-44d0-a9b3-c8a5d73ead56 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d03d1626-e18b-4b15-a679-4543f7641ed7/disk. size=1073741824 {{(pid=73572) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 10:26:52 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-c2cc3ac7-46a2-44d0-a9b3-c8a5d73ead56 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d03d1626-e18b-4b15-a679-4543f7641ed7/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:26:52 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-93417831-e3ac-48e7-bd9f-10158396cf35 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Acquiring lock "6b2d5f4e-37af-438c-859b-d4ca803b7d08" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:26:52 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-93417831-e3ac-48e7-bd9f-10158396cf35 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Lock "6b2d5f4e-37af-438c-859b-d4ca803b7d08" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:26:53 user nova-compute[73572]: DEBUG nova.objects.instance [None req-93417831-e3ac-48e7-bd9f-10158396cf35 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Lazy-loading 'flavor' on Instance uuid 6b2d5f4e-37af-438c-859b-d4ca803b7d08 {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:26:53 user nova-compute[73572]: DEBUG nova.network.neutron [None req-c2cc3ac7-46a2-44d0-a9b3-c8a5d73ead56 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] [instance: d03d1626-e18b-4b15-a679-4543f7641ed7] Successfully created port: fe6f8481-fb71-49fa-a9e7-b38adbf8e4fc {{(pid=73572) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 10:26:53 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-93417831-e3ac-48e7-bd9f-10158396cf35 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Lock "6b2d5f4e-37af-438c-859b-d4ca803b7d08" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.068s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:26:53 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-c2cc3ac7-46a2-44d0-a9b3-c8a5d73ead56 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d03d1626-e18b-4b15-a679-4543f7641ed7/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:26:53 user nova-compute[73572]: DEBUG nova.virt.disk.api [None req-c2cc3ac7-46a2-44d0-a9b3-c8a5d73ead56 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Cannot resize image /opt/stack/data/nova/instances/d03d1626-e18b-4b15-a679-4543f7641ed7/disk to a smaller size. {{(pid=73572) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 10:26:53 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-c2cc3ac7-46a2-44d0-a9b3-c8a5d73ead56 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] [instance: d03d1626-e18b-4b15-a679-4543f7641ed7] Created local disks {{(pid=73572) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 10:26:53 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-c2cc3ac7-46a2-44d0-a9b3-c8a5d73ead56 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] [instance: d03d1626-e18b-4b15-a679-4543f7641ed7] Ensure instance console log exists: /opt/stack/data/nova/instances/d03d1626-e18b-4b15-a679-4543f7641ed7/console.log {{(pid=73572) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 10:26:53 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-c2cc3ac7-46a2-44d0-a9b3-c8a5d73ead56 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:26:53 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-c2cc3ac7-46a2-44d0-a9b3-c8a5d73ead56 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:26:53 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-c2cc3ac7-46a2-44d0-a9b3-c8a5d73ead56 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:26:53 user nova-compute[73572]: DEBUG nova.network.neutron [req-cc501dcb-1cb4-4b10-9608-e367fe3863f0 req-1902c190-5b90-4627-928d-b31540b77d3e service nova] [instance: 6b2d5f4e-37af-438c-859b-d4ca803b7d08] Updated VIF entry in instance network info cache for port bf886914-b734-4957-9e48-4ef3d65c61f4. {{(pid=73572) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 10:26:53 user nova-compute[73572]: DEBUG nova.network.neutron [req-cc501dcb-1cb4-4b10-9608-e367fe3863f0 req-1902c190-5b90-4627-928d-b31540b77d3e service nova] [instance: 6b2d5f4e-37af-438c-859b-d4ca803b7d08] Updating instance_info_cache with network_info: [{"id": "bf886914-b734-4957-9e48-4ef3d65c61f4", "address": "fa:16:3e:b4:aa:52", "network": {"id": "43215883-3d00-4be7-8c40-bdaf3f01bef9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1088544153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7935bccc360b46b589fd57d53f334595", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf886914-b7", "ovs_interfaceid": "bf886914-b734-4957-9e48-4ef3d65c61f4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:26:53 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-cc501dcb-1cb4-4b10-9608-e367fe3863f0 req-1902c190-5b90-4627-928d-b31540b77d3e service nova] Releasing lock "refresh_cache-6b2d5f4e-37af-438c-859b-d4ca803b7d08" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:26:53 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:26:53 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:26:53 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:26:53 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-93417831-e3ac-48e7-bd9f-10158396cf35 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Acquiring lock "6b2d5f4e-37af-438c-859b-d4ca803b7d08" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:26:53 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-93417831-e3ac-48e7-bd9f-10158396cf35 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Lock "6b2d5f4e-37af-438c-859b-d4ca803b7d08" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:26:53 user nova-compute[73572]: INFO nova.compute.manager [None req-93417831-e3ac-48e7-bd9f-10158396cf35 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] [instance: 6b2d5f4e-37af-438c-859b-d4ca803b7d08] Attaching volume 8f8ad7ba-4084-4cd7-920f-8f7948de4212 to /dev/vdb
Aug 26 10:26:53 user nova-compute[73572]: DEBUG os_brick.utils [None req-93417831-e3ac-48e7-bd9f-10158396cf35 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 10:26:53 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:26:53 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:26:53 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[207df6ce-150e-4c14-95a6-497793afa3a3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:de8a79ed912\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:26:53 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:26:53 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:26:53 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[52641b84-49d5-4d09-9441-587b1286572f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:26:53 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:26:53 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:26:53 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[6037e568-0e86-4252-8642-64c9a0cb1be4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:26:53 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[e45da10d-71c5-455d-9a37-1834657c3a14]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:26:53 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-93417831-e3ac-48e7-bd9f-10158396cf35 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Running cmd (subprocess): nvme version {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:26:53 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-93417831-e3ac-48e7-bd9f-10158396cf35 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] 'nvme version' failed. Not Retrying. {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 10:26:53 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.nvmeof [None req-93417831-e3ac-48e7-bd9f-10158396cf35 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] nvme not present on system {{(pid=73572) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 10:26:53 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:26:53 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 10:26:53 user nova-compute[73572]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 10:26:53 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[c501f564-8ead-4134-9a99-88e590a8b6be]: (4, '') {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:26:53 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.lightos [None req-93417831-e3ac-48e7-bd9f-10158396cf35 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73572) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 10:26:53 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.lightos [None req-93417831-e3ac-48e7-bd9f-10158396cf35 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73572) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 10:26:53 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.lightos [None req-93417831-e3ac-48e7-bd9f-10158396cf35 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] LIGHTOS: no hostnqn found. {{(pid=73572) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 10:26:53 user nova-compute[73572]: DEBUG os_brick.utils [None req-93417831-e3ac-48e7-bd9f-10158396cf35 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] <== get_connector_properties: return (146ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:de8a79ed912', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 10:26:53 user nova-compute[73572]: DEBUG nova.virt.block_device [None req-93417831-e3ac-48e7-bd9f-10158396cf35 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] [instance: 6b2d5f4e-37af-438c-859b-d4ca803b7d08] Updating existing volume attachment record: 9b206522-75fc-4aae-b331-ced750662d02 {{(pid=73572) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 10:26:53 user nova-compute[73572]: DEBUG nova.compute.manager [req-a807b34b-c501-4f70-8280-421d40fcf13a req-34975db3-8884-4f2c-b6c8-b02739e7d5ef service nova] [instance: f3fe3865-3d85-46cf-b24f-10b07e23aeff] Received event network-vif-plugged-38c337db-9e4a-4f1c-ad65-e23f2afa7012 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:26:53 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-a807b34b-c501-4f70-8280-421d40fcf13a req-34975db3-8884-4f2c-b6c8-b02739e7d5ef service nova] Acquiring lock "f3fe3865-3d85-46cf-b24f-10b07e23aeff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:26:53 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-a807b34b-c501-4f70-8280-421d40fcf13a req-34975db3-8884-4f2c-b6c8-b02739e7d5ef service nova] Lock "f3fe3865-3d85-46cf-b24f-10b07e23aeff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:26:53 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-a807b34b-c501-4f70-8280-421d40fcf13a req-34975db3-8884-4f2c-b6c8-b02739e7d5ef service nova] Lock "f3fe3865-3d85-46cf-b24f-10b07e23aeff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:26:53 user nova-compute[73572]: DEBUG nova.compute.manager [req-a807b34b-c501-4f70-8280-421d40fcf13a req-34975db3-8884-4f2c-b6c8-b02739e7d5ef service nova] [instance: f3fe3865-3d85-46cf-b24f-10b07e23aeff] No waiting events found dispatching network-vif-plugged-38c337db-9e4a-4f1c-ad65-e23f2afa7012 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:26:53 user nova-compute[73572]: WARNING nova.compute.manager [req-a807b34b-c501-4f70-8280-421d40fcf13a req-34975db3-8884-4f2c-b6c8-b02739e7d5ef service nova] [instance: f3fe3865-3d85-46cf-b24f-10b07e23aeff] Received unexpected event network-vif-plugged-38c337db-9e4a-4f1c-ad65-e23f2afa7012 for instance with vm_state building and task_state spawning.
Aug 26 10:26:53 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:26:53 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:26:53 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:26:54 user nova-compute[73572]: DEBUG nova.network.neutron [None req-c2cc3ac7-46a2-44d0-a9b3-c8a5d73ead56 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] [instance: d03d1626-e18b-4b15-a679-4543f7641ed7] Successfully updated port: fe6f8481-fb71-49fa-a9e7-b38adbf8e4fc {{(pid=73572) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 10:26:54 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-c2cc3ac7-46a2-44d0-a9b3-c8a5d73ead56 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Acquiring lock "refresh_cache-d03d1626-e18b-4b15-a679-4543f7641ed7" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:26:54 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-c2cc3ac7-46a2-44d0-a9b3-c8a5d73ead56 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Acquired lock "refresh_cache-d03d1626-e18b-4b15-a679-4543f7641ed7" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:26:54 user nova-compute[73572]: DEBUG nova.network.neutron [None req-c2cc3ac7-46a2-44d0-a9b3-c8a5d73ead56 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] [instance: d03d1626-e18b-4b15-a679-4543f7641ed7] Building network info cache for instance {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 10:26:54 user nova-compute[73572]: DEBUG nova.network.neutron [None req-c2cc3ac7-46a2-44d0-a9b3-c8a5d73ead56 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] [instance: d03d1626-e18b-4b15-a679-4543f7641ed7] Instance cache missing network info. {{(pid=73572) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 10:26:54 user nova-compute[73572]: DEBUG nova.network.neutron [None req-c2cc3ac7-46a2-44d0-a9b3-c8a5d73ead56 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] [instance: d03d1626-e18b-4b15-a679-4543f7641ed7] Updating instance_info_cache with network_info: [{"id": "fe6f8481-fb71-49fa-a9e7-b38adbf8e4fc", "address": "fa:16:3e:8a:47:4e", "network": {"id": "880aa066-8f77-469b-a0c4-e4e94ae31e1a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-313654920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47abd6293c07465389c379e3b5061164", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe6f8481-fb", "ovs_interfaceid": "fe6f8481-fb71-49fa-a9e7-b38adbf8e4fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:26:54 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-c2cc3ac7-46a2-44d0-a9b3-c8a5d73ead56 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Releasing lock "refresh_cache-d03d1626-e18b-4b15-a679-4543f7641ed7" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:26:54 user nova-compute[73572]: DEBUG nova.compute.manager [None req-c2cc3ac7-46a2-44d0-a9b3-c8a5d73ead56 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] [instance: d03d1626-e18b-4b15-a679-4543f7641ed7] Instance network_info: |[{"id": "fe6f8481-fb71-49fa-a9e7-b38adbf8e4fc", "address": "fa:16:3e:8a:47:4e", "network": {"id": "880aa066-8f77-469b-a0c4-e4e94ae31e1a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-313654920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47abd6293c07465389c379e3b5061164", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe6f8481-fb", "ovs_interfaceid": "fe6f8481-fb71-49fa-a9e7-b38adbf8e4fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73572) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 10:26:54 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-c2cc3ac7-46a2-44d0-a9b3-c8a5d73ead56 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] [instance: d03d1626-e18b-4b15-a679-4543f7641ed7] Start _get_guest_xml network_info=[{"id": "fe6f8481-fb71-49fa-a9e7-b38adbf8e4fc", "address": "fa:16:3e:8a:47:4e", "network": {"id": "880aa066-8f77-469b-a0c4-e4e94ae31e1a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-313654920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47abd6293c07465389c379e3b5061164", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe6f8481-fb", "ovs_interfaceid": "fe6f8481-fb71-49fa-a9e7-b38adbf8e4fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T10:07:33Z,direct_url=<?>,disk_format='qcow2',id=299da0c9-e1c4-48f0-be55-fbe20dd06bc9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5c995f8bbbab4368b67a253e0df3971a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T10:07:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'guest_format': None, 'size': 0, 'encryption_format': None, 'device_type': 'disk', 'image_id': '299da0c9-e1c4-48f0-be55-fbe20dd06bc9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73572) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 10:26:54 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-c2cc3ac7-46a2-44d0-a9b3-c8a5d73ead56 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:26:54 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-c2cc3ac7-46a2-44d0-a9b3-c8a5d73ead56 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:26:54 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-c2cc3ac7-46a2-44d0-a9b3-c8a5d73ead56 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73572) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 10:26:54 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-c2cc3ac7-46a2-44d0-a9b3-c8a5d73ead56 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] CPU controller missing on host. {{(pid=73572) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 10:26:54 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-c2cc3ac7-46a2-44d0-a9b3-c8a5d73ead56 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73572) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 10:26:54 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-c2cc3ac7-46a2-44d0-a9b3-c8a5d73ead56 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] CPU controller found on host. {{(pid=73572) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 10:26:54 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-c2cc3ac7-46a2-44d0-a9b3-c8a5d73ead56 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73572) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 10:26:54 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-c2cc3ac7-46a2-44d0-a9b3-c8a5d73ead56 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T10:07:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T10:07:33Z,direct_url=<?>,disk_format='qcow2',id=299da0c9-e1c4-48f0-be55-fbe20dd06bc9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5c995f8bbbab4368b67a253e0df3971a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T10:07:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 10:26:54 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-c2cc3ac7-46a2-44d0-a9b3-c8a5d73ead56 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Flavor limits 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 10:26:54 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-c2cc3ac7-46a2-44d0-a9b3-c8a5d73ead56 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Image limits 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 10:26:54 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-c2cc3ac7-46a2-44d0-a9b3-c8a5d73ead56 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Flavor pref 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 10:26:54 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-c2cc3ac7-46a2-44d0-a9b3-c8a5d73ead56 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Image pref 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 10:26:54 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-c2cc3ac7-46a2-44d0-a9b3-c8a5d73ead56 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 10:26:54 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-c2cc3ac7-46a2-44d0-a9b3-c8a5d73ead56 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 10:26:54 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-c2cc3ac7-46a2-44d0-a9b3-c8a5d73ead56 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73572) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 10:26:54 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-c2cc3ac7-46a2-44d0-a9b3-c8a5d73ead56 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Got 1 possible topologies {{(pid=73572) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 10:26:54 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-c2cc3ac7-46a2-44d0-a9b3-c8a5d73ead56 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 10:26:54 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-c2cc3ac7-46a2-44d0-a9b3-c8a5d73ead56 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 10:26:54 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-c2cc3ac7-46a2-44d0-a9b3-c8a5d73ead56 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T10:26:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-807874306',display_name='tempest-AttachVolumeNegativeTest-server-807874306',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-807874306',id=39,image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCAWN3unneGTMRpIZHWWOhbC+4DsCjaqSbGq2slHT7n6C3jFRAt+pYBiom0cpZNH0I0KkQYOXOxbZwIS+umHn0Hhjp6RtQvJh3LSwuHgiwpgutKW6kkKa6pNrlOKA/kdMg==',key_name='tempest-keypair-1894762750',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='47abd6293c07465389c379e3b5061164',ramdisk_id='',reservation_id='r-dj280qr0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-608798758',owner_user_name='tempest-AttachVolumeNegativeTest-608798758-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T10:26:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c7cf9c8d529d49149141add20c2b2af2',uuid=d03d1626-e18b-4b15-a679-4543f7641ed7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fe6f8481-fb71-49fa-a9e7-b38adbf8e4fc", "address": "fa:16:3e:8a:47:4e", "network": {"id": "880aa066-8f77-469b-a0c4-e4e94ae31e1a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-313654920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47abd6293c07465389c379e3b5061164", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe6f8481-fb", "ovs_interfaceid": "fe6f8481-fb71-49fa-a9e7-b38adbf8e4fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73572) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 10:26:54 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-c2cc3ac7-46a2-44d0-a9b3-c8a5d73ead56 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Converting VIF {"id": "fe6f8481-fb71-49fa-a9e7-b38adbf8e4fc", "address": "fa:16:3e:8a:47:4e", "network": {"id": "880aa066-8f77-469b-a0c4-e4e94ae31e1a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-313654920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47abd6293c07465389c379e3b5061164", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe6f8481-fb", "ovs_interfaceid": "fe6f8481-fb71-49fa-a9e7-b38adbf8e4fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:26:54 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-c2cc3ac7-46a2-44d0-a9b3-c8a5d73ead56 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8a:47:4e,bridge_name='br-int',has_traffic_filtering=True,id=fe6f8481-fb71-49fa-a9e7-b38adbf8e4fc,network=Network(880aa066-8f77-469b-a0c4-e4e94ae31e1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe6f8481-fb') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:26:54 user nova-compute[73572]: DEBUG nova.objects.instance [None req-c2cc3ac7-46a2-44d0-a9b3-c8a5d73ead56 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Lazy-loading 'pci_devices' on Instance uuid d03d1626-e18b-4b15-a679-4543f7641ed7 {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:26:54 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-c2cc3ac7-46a2-44d0-a9b3-c8a5d73ead56 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] [instance: d03d1626-e18b-4b15-a679-4543f7641ed7] End _get_guest_xml xml=<domain type="kvm">
Aug 26 10:26:54 user nova-compute[73572]:   <uuid>d03d1626-e18b-4b15-a679-4543f7641ed7</uuid>
Aug 26 10:26:54 user nova-compute[73572]:   <name>instance-00000027</name>
Aug 26 10:26:54 user nova-compute[73572]:   <memory>524288</memory>
Aug 26 10:26:54 user nova-compute[73572]:   <vcpu>1</vcpu>
Aug 26 10:26:54 user nova-compute[73572]:   <metadata>
Aug 26 10:26:54 user nova-compute[73572]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 10:26:54 user nova-compute[73572]:       <nova:package version="0.0.0"/>
Aug 26 10:26:54 user nova-compute[73572]:       <nova:name>tempest-AttachVolumeNegativeTest-server-807874306</nova:name>
Aug 26 10:26:54 user nova-compute[73572]:       <nova:creationTime>2023-08-26 10:26:54</nova:creationTime>
Aug 26 10:26:54 user nova-compute[73572]:       <nova:flavor name="m1.tiny">
Aug 26 10:26:54 user nova-compute[73572]:         <nova:memory>512</nova:memory>
Aug 26 10:26:54 user nova-compute[73572]:         <nova:disk>1</nova:disk>
Aug 26 10:26:54 user nova-compute[73572]:         <nova:swap>0</nova:swap>
Aug 26 10:26:54 user nova-compute[73572]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 10:26:54 user nova-compute[73572]:         <nova:vcpus>1</nova:vcpus>
Aug 26 10:26:54 user nova-compute[73572]:       </nova:flavor>
Aug 26 10:26:54 user nova-compute[73572]:       <nova:owner>
Aug 26 10:26:54 user nova-compute[73572]:         <nova:user uuid="c7cf9c8d529d49149141add20c2b2af2">tempest-AttachVolumeNegativeTest-608798758-project-member</nova:user>
Aug 26 10:26:54 user nova-compute[73572]:         <nova:project uuid="47abd6293c07465389c379e3b5061164">tempest-AttachVolumeNegativeTest-608798758</nova:project>
Aug 26 10:26:54 user nova-compute[73572]:       </nova:owner>
Aug 26 10:26:54 user nova-compute[73572]:       <nova:root type="image" uuid="299da0c9-e1c4-48f0-be55-fbe20dd06bc9"/>
Aug 26 10:26:54 user nova-compute[73572]:       <nova:ports>
Aug 26 10:26:54 user nova-compute[73572]:         <nova:port uuid="fe6f8481-fb71-49fa-a9e7-b38adbf8e4fc">
Aug 26 10:26:54 user nova-compute[73572]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 26 10:26:54 user nova-compute[73572]:         </nova:port>
Aug 26 10:26:54 user nova-compute[73572]:       </nova:ports>
Aug 26 10:26:54 user nova-compute[73572]:     </nova:instance>
Aug 26 10:26:54 user nova-compute[73572]:   </metadata>
Aug 26 10:26:54 user nova-compute[73572]:   <sysinfo type="smbios">
Aug 26 10:26:54 user nova-compute[73572]:     <system>
Aug 26 10:26:54 user nova-compute[73572]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 10:26:54 user nova-compute[73572]:       <entry name="product">OpenStack Nova</entry>
Aug 26 10:26:54 user nova-compute[73572]:       <entry name="version">0.0.0</entry>
Aug 26 10:26:54 user nova-compute[73572]:       <entry name="serial">d03d1626-e18b-4b15-a679-4543f7641ed7</entry>
Aug 26 10:26:54 user nova-compute[73572]:       <entry name="uuid">d03d1626-e18b-4b15-a679-4543f7641ed7</entry>
Aug 26 10:26:54 user nova-compute[73572]:       <entry name="family">Virtual Machine</entry>
Aug 26 10:26:54 user nova-compute[73572]:     </system>
Aug 26 10:26:54 user nova-compute[73572]:   </sysinfo>
Aug 26 10:26:54 user nova-compute[73572]:   <os>
Aug 26 10:26:54 user nova-compute[73572]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 10:26:54 user nova-compute[73572]:     <boot dev="hd"/>
Aug 26 10:26:54 user nova-compute[73572]:     <smbios mode="sysinfo"/>
Aug 26 10:26:54 user nova-compute[73572]:   </os>
Aug 26 10:26:54 user nova-compute[73572]:   <features>
Aug 26 10:26:54 user nova-compute[73572]:     <acpi/>
Aug 26 10:26:54 user nova-compute[73572]:     <apic/>
Aug 26 10:26:54 user nova-compute[73572]:     <vmcoreinfo/>
Aug 26 10:26:54 user nova-compute[73572]:   </features>
Aug 26 10:26:54 user nova-compute[73572]:   <clock offset="utc">
Aug 26 10:26:54 user nova-compute[73572]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 10:26:54 user nova-compute[73572]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 10:26:54 user nova-compute[73572]:     <timer name="hpet" present="no"/>
Aug 26 10:26:54 user nova-compute[73572]:   </clock>
Aug 26 10:26:54 user nova-compute[73572]:   <cpu mode="custom" match="exact">
Aug 26 10:26:54 user nova-compute[73572]:     <model>Nehalem</model>
Aug 26 10:26:54 user nova-compute[73572]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 10:26:54 user nova-compute[73572]:   </cpu>
Aug 26 10:26:54 user nova-compute[73572]:   <devices>
Aug 26 10:26:54 user nova-compute[73572]:     <disk type="file" device="disk">
Aug 26 10:26:54 user nova-compute[73572]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 10:26:54 user nova-compute[73572]:       <source file="/opt/stack/data/nova/instances/d03d1626-e18b-4b15-a679-4543f7641ed7/disk"/>
Aug 26 10:26:54 user nova-compute[73572]:       <target dev="vda" bus="virtio"/>
Aug 26 10:26:54 user nova-compute[73572]:     </disk>
Aug 26 10:26:54 user nova-compute[73572]:     <interface type="ethernet">
Aug 26 10:26:54 user nova-compute[73572]:       <mac address="fa:16:3e:8a:47:4e"/>
Aug 26 10:26:54 user nova-compute[73572]:       <model type="virtio"/>
Aug 26 10:26:54 user nova-compute[73572]:       <mtu size="1442"/>
Aug 26 10:26:54 user nova-compute[73572]:       <target dev="tapfe6f8481-fb"/>
Aug 26 10:26:54 user nova-compute[73572]:     </interface>
Aug 26 10:26:54 user nova-compute[73572]:     <serial type="pty">
Aug 26 10:26:54 user nova-compute[73572]:       <log file="/opt/stack/data/nova/instances/d03d1626-e18b-4b15-a679-4543f7641ed7/console.log" append="off"/>
Aug 26 10:26:54 user nova-compute[73572]:     </serial>
Aug 26 10:26:54 user nova-compute[73572]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 10:26:54 user nova-compute[73572]:     <video>
Aug 26 10:26:54 user nova-compute[73572]:       <model type="virtio"/>
Aug 26 10:26:54 user nova-compute[73572]:     </video>
Aug 26 10:26:54 user nova-compute[73572]:     <rng model="virtio">
Aug 26 10:26:54 user nova-compute[73572]:       <backend model="random">/dev/urandom</backend>
Aug 26 10:26:54 user nova-compute[73572]:     </rng>
Aug 26 10:26:54 user nova-compute[73572]:     <controller type="usb" index="0" model="none"/>
Aug 26 10:26:54 user nova-compute[73572]:     <memballoon model="virtio">
Aug 26 10:26:54 user nova-compute[73572]:       <stats period="10"/>
Aug 26 10:26:54 user nova-compute[73572]:     </memballoon>
Aug 26 10:26:54 user nova-compute[73572]:   </devices>
Aug 26 10:26:54 user nova-compute[73572]: </domain>
Aug 26 10:26:54 user nova-compute[73572]:  {{(pid=73572) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 10:26:54 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-c2cc3ac7-46a2-44d0-a9b3-c8a5d73ead56 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T10:26:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-807874306',display_name='tempest-AttachVolumeNegativeTest-server-807874306',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-807874306',id=39,image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCAWN3unneGTMRpIZHWWOhbC+4DsCjaqSbGq2slHT7n6C3jFRAt+pYBiom0cpZNH0I0KkQYOXOxbZwIS+umHn0Hhjp6RtQvJh3LSwuHgiwpgutKW6kkKa6pNrlOKA/kdMg==',key_name='tempest-keypair-1894762750',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='47abd6293c07465389c379e3b5061164',ramdisk_id='',reservation_id='r-dj280qr0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-608798758',owner_user_name='tempest-AttachVolumeNegativeTest-608798758-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T10:26:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c7cf9c8d529d49149141add20c2b2af2',uuid=d03d1626-e18b-4b15-a679-4543f7641ed7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fe6f8481-fb71-49fa-a9e7-b38adbf8e4fc", "address": "fa:16:3e:8a:47:4e", "network": {"id": "880aa066-8f77-469b-a0c4-e4e94ae31e1a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-313654920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47abd6293c07465389c379e3b5061164", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe6f8481-fb", "ovs_interfaceid": "fe6f8481-fb71-49fa-a9e7-b38adbf8e4fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 10:26:54 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-c2cc3ac7-46a2-44d0-a9b3-c8a5d73ead56 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Converting VIF {"id": "fe6f8481-fb71-49fa-a9e7-b38adbf8e4fc", "address": "fa:16:3e:8a:47:4e", "network": {"id": "880aa066-8f77-469b-a0c4-e4e94ae31e1a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-313654920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47abd6293c07465389c379e3b5061164", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe6f8481-fb", "ovs_interfaceid": "fe6f8481-fb71-49fa-a9e7-b38adbf8e4fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:26:54 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-c2cc3ac7-46a2-44d0-a9b3-c8a5d73ead56 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8a:47:4e,bridge_name='br-int',has_traffic_filtering=True,id=fe6f8481-fb71-49fa-a9e7-b38adbf8e4fc,network=Network(880aa066-8f77-469b-a0c4-e4e94ae31e1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe6f8481-fb') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:26:54 user nova-compute[73572]: DEBUG os_vif [None req-c2cc3ac7-46a2-44d0-a9b3-c8a5d73ead56 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:47:4e,bridge_name='br-int',has_traffic_filtering=True,id=fe6f8481-fb71-49fa-a9e7-b38adbf8e4fc,network=Network(880aa066-8f77-469b-a0c4-e4e94ae31e1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe6f8481-fb') {{(pid=73572) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 10:26:54 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:26:54 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:26:54 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 10:26:54 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:26:54 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfe6f8481-fb, may_exist=True, interface_attrs={}) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:26:54 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapfe6f8481-fb, col_values=(('external_ids', {'iface-id': 'fe6f8481-fb71-49fa-a9e7-b38adbf8e4fc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8a:47:4e', 'vm-uuid': 'd03d1626-e18b-4b15-a679-4543f7641ed7'}),), if_exists=True) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:26:54 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:26:54 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:26:54 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:26:54 user nova-compute[73572]: INFO os_vif [None req-c2cc3ac7-46a2-44d0-a9b3-c8a5d73ead56 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:47:4e,bridge_name='br-int',has_traffic_filtering=True,id=fe6f8481-fb71-49fa-a9e7-b38adbf8e4fc,network=Network(880aa066-8f77-469b-a0c4-e4e94ae31e1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe6f8481-fb')
Aug 26 10:26:54 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-c2cc3ac7-46a2-44d0-a9b3-c8a5d73ead56 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] No BDM found with device name vda, not building metadata. {{(pid=73572) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 10:26:54 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-c2cc3ac7-46a2-44d0-a9b3-c8a5d73ead56 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] No VIF found with MAC fa:16:3e:8a:47:4e, not building metadata {{(pid=73572) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 10:26:54 user nova-compute[73572]: DEBUG nova.compute.manager [req-5d91b733-64df-4e32-93ab-83a20d33918e req-e13c9dde-930b-48f6-9d9d-e83b929c9dfd service nova] [instance: d03d1626-e18b-4b15-a679-4543f7641ed7] Received event network-changed-fe6f8481-fb71-49fa-a9e7-b38adbf8e4fc {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:26:54 user nova-compute[73572]: DEBUG nova.compute.manager [req-5d91b733-64df-4e32-93ab-83a20d33918e req-e13c9dde-930b-48f6-9d9d-e83b929c9dfd service nova] [instance: d03d1626-e18b-4b15-a679-4543f7641ed7] Refreshing instance network info cache due to event network-changed-fe6f8481-fb71-49fa-a9e7-b38adbf8e4fc. {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 10:26:54 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-5d91b733-64df-4e32-93ab-83a20d33918e req-e13c9dde-930b-48f6-9d9d-e83b929c9dfd service nova] Acquiring lock "refresh_cache-d03d1626-e18b-4b15-a679-4543f7641ed7" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:26:54 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-5d91b733-64df-4e32-93ab-83a20d33918e req-e13c9dde-930b-48f6-9d9d-e83b929c9dfd service nova] Acquired lock "refresh_cache-d03d1626-e18b-4b15-a679-4543f7641ed7" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:26:54 user nova-compute[73572]: DEBUG nova.network.neutron [req-5d91b733-64df-4e32-93ab-83a20d33918e req-e13c9dde-930b-48f6-9d9d-e83b929c9dfd service nova] [instance: d03d1626-e18b-4b15-a679-4543f7641ed7] Refreshing network info cache for port fe6f8481-fb71-49fa-a9e7-b38adbf8e4fc {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 10:26:55 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:26:55 user nova-compute[73572]: DEBUG nova.network.neutron [req-5d91b733-64df-4e32-93ab-83a20d33918e req-e13c9dde-930b-48f6-9d9d-e83b929c9dfd service nova] [instance: d03d1626-e18b-4b15-a679-4543f7641ed7] Updated VIF entry in instance network info cache for port fe6f8481-fb71-49fa-a9e7-b38adbf8e4fc. {{(pid=73572) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 10:26:55 user nova-compute[73572]: DEBUG nova.network.neutron [req-5d91b733-64df-4e32-93ab-83a20d33918e req-e13c9dde-930b-48f6-9d9d-e83b929c9dfd service nova] [instance: d03d1626-e18b-4b15-a679-4543f7641ed7] Updating instance_info_cache with network_info: [{"id": "fe6f8481-fb71-49fa-a9e7-b38adbf8e4fc", "address": "fa:16:3e:8a:47:4e", "network": {"id": "880aa066-8f77-469b-a0c4-e4e94ae31e1a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-313654920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47abd6293c07465389c379e3b5061164", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe6f8481-fb", "ovs_interfaceid": "fe6f8481-fb71-49fa-a9e7-b38adbf8e4fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:26:55 user nova-compute[73572]: DEBUG nova.virt.driver [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Emitting event <LifecycleEvent: 1693045615.4928029, f3fe3865-3d85-46cf-b24f-10b07e23aeff => Resumed> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:26:55 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: f3fe3865-3d85-46cf-b24f-10b07e23aeff] VM Resumed (Lifecycle Event)
Aug 26 10:26:55 user nova-compute[73572]: DEBUG nova.compute.manager [None req-0492b932-1231-4ff7-b8b3-6da5f42ac322 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: f3fe3865-3d85-46cf-b24f-10b07e23aeff] Instance event wait completed in 0 seconds for  {{(pid=73572) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 10:26:55 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-0492b932-1231-4ff7-b8b3-6da5f42ac322 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: f3fe3865-3d85-46cf-b24f-10b07e23aeff] Guest created on hypervisor {{(pid=73572) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 10:26:55 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-5d91b733-64df-4e32-93ab-83a20d33918e req-e13c9dde-930b-48f6-9d9d-e83b929c9dfd service nova] Releasing lock "refresh_cache-d03d1626-e18b-4b15-a679-4543f7641ed7" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:26:55 user nova-compute[73572]: INFO nova.virt.libvirt.driver [-] [instance: f3fe3865-3d85-46cf-b24f-10b07e23aeff] Instance spawned successfully.
Aug 26 10:26:55 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-0492b932-1231-4ff7-b8b3-6da5f42ac322 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: f3fe3865-3d85-46cf-b24f-10b07e23aeff] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 10:26:55 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: f3fe3865-3d85-46cf-b24f-10b07e23aeff] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:26:55 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: f3fe3865-3d85-46cf-b24f-10b07e23aeff] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73572) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 10:26:55 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-0492b932-1231-4ff7-b8b3-6da5f42ac322 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: f3fe3865-3d85-46cf-b24f-10b07e23aeff] Found default for hw_cdrom_bus of ide {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:26:55 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-0492b932-1231-4ff7-b8b3-6da5f42ac322 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: f3fe3865-3d85-46cf-b24f-10b07e23aeff] Found default for hw_disk_bus of virtio {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:26:55 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-0492b932-1231-4ff7-b8b3-6da5f42ac322 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: f3fe3865-3d85-46cf-b24f-10b07e23aeff] Found default for hw_input_bus of None {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:26:55 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-0492b932-1231-4ff7-b8b3-6da5f42ac322 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: f3fe3865-3d85-46cf-b24f-10b07e23aeff] Found default for hw_pointer_model of None {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:26:55 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-0492b932-1231-4ff7-b8b3-6da5f42ac322 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: f3fe3865-3d85-46cf-b24f-10b07e23aeff] Found default for hw_video_model of virtio {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:26:55 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-0492b932-1231-4ff7-b8b3-6da5f42ac322 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: f3fe3865-3d85-46cf-b24f-10b07e23aeff] Found default for hw_vif_model of virtio {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:26:55 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: f3fe3865-3d85-46cf-b24f-10b07e23aeff] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 10:26:55 user nova-compute[73572]: DEBUG nova.virt.driver [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Emitting event <LifecycleEvent: 1693045615.4939167, f3fe3865-3d85-46cf-b24f-10b07e23aeff => Started> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:26:55 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: f3fe3865-3d85-46cf-b24f-10b07e23aeff] VM Started (Lifecycle Event)
Aug 26 10:26:55 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: f3fe3865-3d85-46cf-b24f-10b07e23aeff] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:26:55 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: f3fe3865-3d85-46cf-b24f-10b07e23aeff] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73572) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 10:26:55 user nova-compute[73572]: DEBUG nova.compute.manager [req-0bd6260f-d5b4-400e-aa7e-5e8e6753c486 req-33f0e29c-7fdd-4cd3-8cd3-ea5d14b50ca0 service nova] [instance: f3fe3865-3d85-46cf-b24f-10b07e23aeff] Received event network-vif-plugged-38c337db-9e4a-4f1c-ad65-e23f2afa7012 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:26:55 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-0bd6260f-d5b4-400e-aa7e-5e8e6753c486 req-33f0e29c-7fdd-4cd3-8cd3-ea5d14b50ca0 service nova] Acquiring lock "f3fe3865-3d85-46cf-b24f-10b07e23aeff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:26:55 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-0bd6260f-d5b4-400e-aa7e-5e8e6753c486 req-33f0e29c-7fdd-4cd3-8cd3-ea5d14b50ca0 service nova] Lock "f3fe3865-3d85-46cf-b24f-10b07e23aeff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:26:55 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-0bd6260f-d5b4-400e-aa7e-5e8e6753c486 req-33f0e29c-7fdd-4cd3-8cd3-ea5d14b50ca0 service nova] Lock "f3fe3865-3d85-46cf-b24f-10b07e23aeff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:26:55 user nova-compute[73572]: DEBUG nova.compute.manager [req-0bd6260f-d5b4-400e-aa7e-5e8e6753c486 req-33f0e29c-7fdd-4cd3-8cd3-ea5d14b50ca0 service nova] [instance: f3fe3865-3d85-46cf-b24f-10b07e23aeff] No waiting events found dispatching network-vif-plugged-38c337db-9e4a-4f1c-ad65-e23f2afa7012 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:26:55 user nova-compute[73572]: WARNING nova.compute.manager [req-0bd6260f-d5b4-400e-aa7e-5e8e6753c486 req-33f0e29c-7fdd-4cd3-8cd3-ea5d14b50ca0 service nova] [instance: f3fe3865-3d85-46cf-b24f-10b07e23aeff] Received unexpected event network-vif-plugged-38c337db-9e4a-4f1c-ad65-e23f2afa7012 for instance with vm_state building and task_state spawning.
Aug 26 10:26:55 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: f3fe3865-3d85-46cf-b24f-10b07e23aeff] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 10:26:55 user nova-compute[73572]: INFO nova.compute.manager [None req-0492b932-1231-4ff7-b8b3-6da5f42ac322 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: f3fe3865-3d85-46cf-b24f-10b07e23aeff] Took 5.23 seconds to spawn the instance on the hypervisor.
Aug 26 10:26:55 user nova-compute[73572]: DEBUG nova.compute.manager [None req-0492b932-1231-4ff7-b8b3-6da5f42ac322 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: f3fe3865-3d85-46cf-b24f-10b07e23aeff] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:26:55 user nova-compute[73572]: INFO nova.compute.manager [None req-0492b932-1231-4ff7-b8b3-6da5f42ac322 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: f3fe3865-3d85-46cf-b24f-10b07e23aeff] Took 17.81 seconds to build instance.
Aug 26 10:26:55 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-0492b932-1231-4ff7-b8b3-6da5f42ac322 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Lock "f3fe3865-3d85-46cf-b24f-10b07e23aeff" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.901s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:26:55 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:26:55 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:26:55 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:26:56 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:26:56 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:26:57 user nova-compute[73572]: DEBUG nova.compute.manager [req-cf065952-5b22-4560-a85c-e476a2f99f6b req-7857bc91-05a7-43a3-91b6-13662cc33faf service nova] [instance: d03d1626-e18b-4b15-a679-4543f7641ed7] Received event network-vif-plugged-fe6f8481-fb71-49fa-a9e7-b38adbf8e4fc {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:26:57 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-cf065952-5b22-4560-a85c-e476a2f99f6b req-7857bc91-05a7-43a3-91b6-13662cc33faf service nova] Acquiring lock "d03d1626-e18b-4b15-a679-4543f7641ed7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:26:57 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-cf065952-5b22-4560-a85c-e476a2f99f6b req-7857bc91-05a7-43a3-91b6-13662cc33faf service nova] Lock "d03d1626-e18b-4b15-a679-4543f7641ed7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:26:57 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-cf065952-5b22-4560-a85c-e476a2f99f6b req-7857bc91-05a7-43a3-91b6-13662cc33faf service nova] Lock "d03d1626-e18b-4b15-a679-4543f7641ed7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:26:57 user nova-compute[73572]: DEBUG nova.compute.manager [req-cf065952-5b22-4560-a85c-e476a2f99f6b req-7857bc91-05a7-43a3-91b6-13662cc33faf service nova] [instance: d03d1626-e18b-4b15-a679-4543f7641ed7] No waiting events found dispatching network-vif-plugged-fe6f8481-fb71-49fa-a9e7-b38adbf8e4fc {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:26:57 user nova-compute[73572]: WARNING nova.compute.manager [req-cf065952-5b22-4560-a85c-e476a2f99f6b req-7857bc91-05a7-43a3-91b6-13662cc33faf service nova] [instance: d03d1626-e18b-4b15-a679-4543f7641ed7] Received unexpected event network-vif-plugged-fe6f8481-fb71-49fa-a9e7-b38adbf8e4fc for instance with vm_state building and task_state spawning.
Aug 26 10:26:57 user nova-compute[73572]: DEBUG nova.compute.manager [req-cf065952-5b22-4560-a85c-e476a2f99f6b req-7857bc91-05a7-43a3-91b6-13662cc33faf service nova] [instance: d03d1626-e18b-4b15-a679-4543f7641ed7] Received event network-vif-plugged-fe6f8481-fb71-49fa-a9e7-b38adbf8e4fc {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:26:57 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-cf065952-5b22-4560-a85c-e476a2f99f6b req-7857bc91-05a7-43a3-91b6-13662cc33faf service nova] Acquiring lock "d03d1626-e18b-4b15-a679-4543f7641ed7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:26:57 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-cf065952-5b22-4560-a85c-e476a2f99f6b req-7857bc91-05a7-43a3-91b6-13662cc33faf service nova] Lock "d03d1626-e18b-4b15-a679-4543f7641ed7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:26:57 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-cf065952-5b22-4560-a85c-e476a2f99f6b req-7857bc91-05a7-43a3-91b6-13662cc33faf service nova] Lock "d03d1626-e18b-4b15-a679-4543f7641ed7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:26:57 user nova-compute[73572]: DEBUG nova.compute.manager [req-cf065952-5b22-4560-a85c-e476a2f99f6b req-7857bc91-05a7-43a3-91b6-13662cc33faf service nova] [instance: d03d1626-e18b-4b15-a679-4543f7641ed7] No waiting events found dispatching network-vif-plugged-fe6f8481-fb71-49fa-a9e7-b38adbf8e4fc {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:26:57 user nova-compute[73572]: WARNING nova.compute.manager [req-cf065952-5b22-4560-a85c-e476a2f99f6b req-7857bc91-05a7-43a3-91b6-13662cc33faf service nova] [instance: d03d1626-e18b-4b15-a679-4543f7641ed7] Received unexpected event network-vif-plugged-fe6f8481-fb71-49fa-a9e7-b38adbf8e4fc for instance with vm_state building and task_state spawning.
Aug 26 10:26:58 user nova-compute[73572]: DEBUG nova.virt.driver [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Emitting event <LifecycleEvent: 1693045618.1767826, d03d1626-e18b-4b15-a679-4543f7641ed7 => Resumed> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:26:58 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: d03d1626-e18b-4b15-a679-4543f7641ed7] VM Resumed (Lifecycle Event)
Aug 26 10:26:58 user nova-compute[73572]: DEBUG nova.compute.manager [None req-c2cc3ac7-46a2-44d0-a9b3-c8a5d73ead56 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] [instance: d03d1626-e18b-4b15-a679-4543f7641ed7] Instance event wait completed in 0 seconds for  {{(pid=73572) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 10:26:58 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-c2cc3ac7-46a2-44d0-a9b3-c8a5d73ead56 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] [instance: d03d1626-e18b-4b15-a679-4543f7641ed7] Guest created on hypervisor {{(pid=73572) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 10:26:58 user nova-compute[73572]: INFO nova.virt.libvirt.driver [-] [instance: d03d1626-e18b-4b15-a679-4543f7641ed7] Instance spawned successfully.
Aug 26 10:26:58 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-c2cc3ac7-46a2-44d0-a9b3-c8a5d73ead56 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] [instance: d03d1626-e18b-4b15-a679-4543f7641ed7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 10:26:58 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: d03d1626-e18b-4b15-a679-4543f7641ed7] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:26:58 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: d03d1626-e18b-4b15-a679-4543f7641ed7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73572) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 10:26:58 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-c2cc3ac7-46a2-44d0-a9b3-c8a5d73ead56 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] [instance: d03d1626-e18b-4b15-a679-4543f7641ed7] Found default for hw_cdrom_bus of ide {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:26:58 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-c2cc3ac7-46a2-44d0-a9b3-c8a5d73ead56 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] [instance: d03d1626-e18b-4b15-a679-4543f7641ed7] Found default for hw_disk_bus of virtio {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:26:58 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-c2cc3ac7-46a2-44d0-a9b3-c8a5d73ead56 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] [instance: d03d1626-e18b-4b15-a679-4543f7641ed7] Found default for hw_input_bus of None {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:26:58 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-c2cc3ac7-46a2-44d0-a9b3-c8a5d73ead56 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] [instance: d03d1626-e18b-4b15-a679-4543f7641ed7] Found default for hw_pointer_model of None {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:26:58 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-c2cc3ac7-46a2-44d0-a9b3-c8a5d73ead56 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] [instance: d03d1626-e18b-4b15-a679-4543f7641ed7] Found default for hw_video_model of virtio {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:26:58 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-c2cc3ac7-46a2-44d0-a9b3-c8a5d73ead56 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] [instance: d03d1626-e18b-4b15-a679-4543f7641ed7] Found default for hw_vif_model of virtio {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:26:58 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: d03d1626-e18b-4b15-a679-4543f7641ed7] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 10:26:58 user nova-compute[73572]: DEBUG nova.virt.driver [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Emitting event <LifecycleEvent: 1693045618.178276, d03d1626-e18b-4b15-a679-4543f7641ed7 => Started> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:26:58 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: d03d1626-e18b-4b15-a679-4543f7641ed7] VM Started (Lifecycle Event)
Aug 26 10:26:58 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: d03d1626-e18b-4b15-a679-4543f7641ed7] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:26:58 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: d03d1626-e18b-4b15-a679-4543f7641ed7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73572) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 10:26:58 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: d03d1626-e18b-4b15-a679-4543f7641ed7] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 10:26:58 user nova-compute[73572]: INFO nova.compute.manager [None req-c2cc3ac7-46a2-44d0-a9b3-c8a5d73ead56 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] [instance: d03d1626-e18b-4b15-a679-4543f7641ed7] Took 6.08 seconds to spawn the instance on the hypervisor.
Aug 26 10:26:58 user nova-compute[73572]: DEBUG nova.compute.manager [None req-c2cc3ac7-46a2-44d0-a9b3-c8a5d73ead56 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] [instance: d03d1626-e18b-4b15-a679-4543f7641ed7] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:26:58 user nova-compute[73572]: INFO nova.compute.manager [None req-c2cc3ac7-46a2-44d0-a9b3-c8a5d73ead56 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] [instance: d03d1626-e18b-4b15-a679-4543f7641ed7] Took 6.95 seconds to build instance.
Aug 26 10:26:58 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-c2cc3ac7-46a2-44d0-a9b3-c8a5d73ead56 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Lock "d03d1626-e18b-4b15-a679-4543f7641ed7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.075s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:26:59 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:27:00 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:27:04 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:27:06 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-93417831-e3ac-48e7-bd9f-10158396cf35 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] [instance: 6b2d5f4e-37af-438c-859b-d4ca803b7d08] Calling os-brick to attach iSCSI Volume {{(pid=73572) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 10:27:06 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-93417831-e3ac-48e7-bd9f-10158396cf35 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc89c3d6a10>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:8f8ad7ba-4084-4cd7-920f-8f7948de4212'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IicowWqU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 10:27:06 user nova-compute[73572]: WARNING os_brick.initiator.connectors.base [None req-93417831-e3ac-48e7-bd9f-10158396cf35 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 10:27:06 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-93417831-e3ac-48e7-bd9f-10158396cf35 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 10:27:06 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-93417831-e3ac-48e7-bd9f-10158396cf35 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 10:27:06 user nova-compute[73572]: WARNING os_brick.initiator.connectors.base [None req-93417831-e3ac-48e7-bd9f-10158396cf35 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 10:27:06 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-93417831-e3ac-48e7-bd9f-10158396cf35 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8f8ad7ba-4084-4cd7-920f-8f7948de4212" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 10:27:06 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-93417831-e3ac-48e7-bd9f-10158396cf35 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8f8ad7ba-4084-4cd7-920f-8f7948de4212" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 10:27:06 user nova-compute[73572]: INFO os_brick.initiator.connectors.iscsi [None req-93417831-e3ac-48e7-bd9f-10158396cf35 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 10:27:06 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f8ad7ba-4084-4cd7-920f-8f7948de4212 -p 172.16.0.220:3260 {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:27:06 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f8ad7ba-4084-4cd7-920f-8f7948de4212 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:27:06 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[6716459d-d4b1-496c-ba76-84d05a038f8b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:27:06 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-93417831-e3ac-48e7-bd9f-10158396cf35 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 10:27:06 user nova-compute[73572]:  {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:27:06 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f8ad7ba-4084-4cd7-920f-8f7948de4212 -p 172.16.0.220:3260 --interface default --op new {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:27:06 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f8ad7ba-4084-4cd7-920f-8f7948de4212 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:27:06 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[fea896ee-2dd6-4c33-a82b-a3d8b8f73536]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8f8ad7ba-4084-4cd7-920f-8f7948de4212] added\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:27:06 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-93417831-e3ac-48e7-bd9f-10158396cf35 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8f8ad7ba-4084-4cd7-920f-8f7948de4212] added
Aug 26 10:27:06 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:27:06 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f8ad7ba-4084-4cd7-920f-8f7948de4212 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:27:06 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f8ad7ba-4084-4cd7-920f-8f7948de4212 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:27:06 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[d95c118e-3856-4612-955f-7dc25a77e0dc]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:27:06 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-93417831-e3ac-48e7-bd9f-10158396cf35 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:27:06 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f8ad7ba-4084-4cd7-920f-8f7948de4212 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:27:06 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f8ad7ba-4084-4cd7-920f-8f7948de4212 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:27:06 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[417b2ec8-a05e-4166-872e-99c20a0dd450]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:27:06 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-93417831-e3ac-48e7-bd9f-10158396cf35 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:27:06 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f8ad7ba-4084-4cd7-920f-8f7948de4212 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IicowWqU {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:27:06 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f8ad7ba-4084-4cd7-920f-8f7948de4212 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IicowWqU" returned: 0 in 0.019s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:27:06 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b190f28-9a07-4cd3-9bd3-29b41e2d64f7]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:27:06 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-93417831-e3ac-48e7-bd9f-10158396cf35 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IicowWqU'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:27:06 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f8ad7ba-4084-4cd7-920f-8f7948de4212 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:27:06 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f8ad7ba-4084-4cd7-920f-8f7948de4212 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:27:06 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[a076f311-d921-4f53-9565-71853287db08]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:27:06 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-93417831-e3ac-48e7-bd9f-10158396cf35 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:27:06 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:27:06 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:27:06 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bffab59-8e5f-43a1-b706-485804ea3f1a]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133098b2-106a-427f-aa6d-2c10625dd152 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21602e43-35ed-4842-aa13-f04aca4243f2 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:448cd30a-3852-471f-903f-a2e5abc34b55 (non-flash)\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:27:06 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-93417831-e3ac-48e7-bd9f-10158396cf35 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)
Aug 26 10:27:06 user nova-compute[73572]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133098b2-106a-427f-aa6d-2c10625dd152 (non-flash)
Aug 26 10:27:06 user nova-compute[73572]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21602e43-35ed-4842-aa13-f04aca4243f2 (non-flash)
Aug 26 10:27:06 user nova-compute[73572]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:448cd30a-3852-471f-903f-a2e5abc34b55 (non-flash)
Aug 26 10:27:06 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 10:27:06 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-93417831-e3ac-48e7-bd9f-10158396cf35 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)
Aug 26 10:27:06 user nova-compute[73572]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133098b2-106a-427f-aa6d-2c10625dd152 (non-flash)
Aug 26 10:27:06 user nova-compute[73572]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21602e43-35ed-4842-aa13-f04aca4243f2 (non-flash)
Aug 26 10:27:06 user nova-compute[73572]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:448cd30a-3852-471f-903f-a2e5abc34b55 (non-flash)
Aug 26 10:27:06 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 10:27:06 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f8ad7ba-4084-4cd7-920f-8f7948de4212 -p 172.16.0.220:3260 --login {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:27:06 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f8ad7ba-4084-4cd7-920f-8f7948de4212 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:27:06 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f1ef0fb-f8ea-4cbd-98dc-c2fe9abc0ce8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8f8ad7ba-4084-4cd7-920f-8f7948de4212, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8f8ad7ba-4084-4cd7-920f-8f7948de4212, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:27:06 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-93417831-e3ac-48e7-bd9f-10158396cf35 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8f8ad7ba-4084-4cd7-920f-8f7948de4212, portal: 172.16.0.220,3260]
Aug 26 10:27:06 user nova-compute[73572]: Login to [iface: default, target: iqn.2010-10.org.openstack:8f8ad7ba-4084-4cd7-920f-8f7948de4212, portal: 172.16.0.220,3260] successful.
Aug 26 10:27:06 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:27:06 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f8ad7ba-4084-4cd7-920f-8f7948de4212 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:27:06 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f8ad7ba-4084-4cd7-920f-8f7948de4212 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:27:06 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e3c27e5-2f59-4123-a5dd-4d9accd22161]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:27:06 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-93417831-e3ac-48e7-bd9f-10158396cf35 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:27:06 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:27:06 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:27:06 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0fb53da-2ac4-499b-9109-57b51f905997]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133098b2-106a-427f-aa6d-2c10625dd152 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21602e43-35ed-4842-aa13-f04aca4243f2 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:448cd30a-3852-471f-903f-a2e5abc34b55 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f8ad7ba-4084-4cd7-920f-8f7948de4212 (non-flash)\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:27:06 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-93417831-e3ac-48e7-bd9f-10158396cf35 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)
Aug 26 10:27:06 user nova-compute[73572]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133098b2-106a-427f-aa6d-2c10625dd152 (non-flash)
Aug 26 10:27:06 user nova-compute[73572]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21602e43-35ed-4842-aa13-f04aca4243f2 (non-flash)
Aug 26 10:27:06 user nova-compute[73572]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:448cd30a-3852-471f-903f-a2e5abc34b55 (non-flash)
Aug 26 10:27:06 user nova-compute[73572]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f8ad7ba-4084-4cd7-920f-8f7948de4212 (non-flash)
Aug 26 10:27:06 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 10:27:06 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-93417831-e3ac-48e7-bd9f-10158396cf35 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)
Aug 26 10:27:06 user nova-compute[73572]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133098b2-106a-427f-aa6d-2c10625dd152 (non-flash)
Aug 26 10:27:06 user nova-compute[73572]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21602e43-35ed-4842-aa13-f04aca4243f2 (non-flash)
Aug 26 10:27:06 user nova-compute[73572]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:448cd30a-3852-471f-903f-a2e5abc34b55 (non-flash)
Aug 26 10:27:06 user nova-compute[73572]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f8ad7ba-4084-4cd7-920f-8f7948de4212 (non-flash)
Aug 26 10:27:06 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 10:27:06 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-93417831-e3ac-48e7-bd9f-10158396cf35 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8f8ad7ba-4084-4cd7-920f-8f7948de4212" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.322s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 10:27:06 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-93417831-e3ac-48e7-bd9f-10158396cf35 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Connected to 172.16.0.220:3260 {{(pid=73572) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 10:27:06 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-93417831-e3ac-48e7-bd9f-10158396cf35 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] HCTL ('35', '-', '-', 0) found on session 38 with lun 0 {{(pid=73572) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 10:27:06 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-93417831-e3ac-48e7-bd9f-10158396cf35 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73572) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 10:27:06 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:27:06 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:27:06 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[20f673db-937d-4541-bbc9-88de9fab53a0]: (4, ('- - 0', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:27:06 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-93417831-e3ac-48e7-bd9f-10158396cf35 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Searching for a device in session 38 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73572) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 10:27:06 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-93417831-e3ac-48e7-bd9f-10158396cf35 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IicowWqU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73572) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 10:27:07 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-93417831-e3ac-48e7-bd9f-10158396cf35 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.370s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 10:27:07 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-93417831-e3ac-48e7-bd9f-10158396cf35 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] <== connect_volume: return (1373ms) {'type': 'block', 'scsi_wwn': '23932323866653231', 'path': '/dev/sdd'} {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 10:27:07 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-93417831-e3ac-48e7-bd9f-10158396cf35 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] [instance: 6b2d5f4e-37af-438c-859b-d4ca803b7d08] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23932323866653231', 'path': '/dev/sdd'} {{(pid=73572) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 10:27:07 user nova-compute[73572]: DEBUG nova.objects.instance [None req-93417831-e3ac-48e7-bd9f-10158396cf35 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Lazy-loading 'flavor' on Instance uuid 6b2d5f4e-37af-438c-859b-d4ca803b7d08 {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:27:07 user nova-compute[73572]: DEBUG nova.virt.libvirt.guest [None req-93417831-e3ac-48e7-bd9f-10158396cf35 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 10:27:07 user nova-compute[73572]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 10:27:07 user nova-compute[73572]:   <source dev="/dev/sdd"/>
Aug 26 10:27:07 user nova-compute[73572]:   <target dev="vdb" bus="virtio"/>
Aug 26 10:27:07 user nova-compute[73572]:   <serial>8f8ad7ba-4084-4cd7-920f-8f7948de4212</serial>
Aug 26 10:27:07 user nova-compute[73572]: </disk>
Aug 26 10:27:07 user nova-compute[73572]:  {{(pid=73572) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 10:27:08 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-93417831-e3ac-48e7-bd9f-10158396cf35 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] No BDM found with device name vda, not building metadata. {{(pid=73572) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 10:27:08 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-93417831-e3ac-48e7-bd9f-10158396cf35 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73572) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 10:27:08 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-93417831-e3ac-48e7-bd9f-10158396cf35 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] No VIF found with MAC fa:16:3e:b4:aa:52, not building metadata {{(pid=73572) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 10:27:08 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-93417831-e3ac-48e7-bd9f-10158396cf35 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Lock "6b2d5f4e-37af-438c-859b-d4ca803b7d08" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 15.032s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:27:09 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:27:09 user nova-compute[73572]: INFO nova.compute.manager [None req-9c81718d-2e3a-4ebd-9a2b-f3fb247549de tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] [instance: 6b2d5f4e-37af-438c-859b-d4ca803b7d08] Rebuilding instance
Aug 26 10:27:09 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9c81718d-2e3a-4ebd-9a2b-f3fb247549de tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] [instance: 6b2d5f4e-37af-438c-859b-d4ca803b7d08] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:27:09 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:27:09 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:27:10 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:27:10 user nova-compute[73572]: DEBUG nova.compute.manager [req-96e06587-6d7e-4608-94f0-45fc0f5c0ad1 req-09850787-f47b-4561-b465-1e5f91ed5e82 service nova] [instance: 6b2d5f4e-37af-438c-859b-d4ca803b7d08] Received event network-vif-unplugged-bf886914-b734-4957-9e48-4ef3d65c61f4 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:27:10 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-96e06587-6d7e-4608-94f0-45fc0f5c0ad1 req-09850787-f47b-4561-b465-1e5f91ed5e82 service nova] Acquiring lock "6b2d5f4e-37af-438c-859b-d4ca803b7d08-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:27:10 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-96e06587-6d7e-4608-94f0-45fc0f5c0ad1 req-09850787-f47b-4561-b465-1e5f91ed5e82 service nova] Lock "6b2d5f4e-37af-438c-859b-d4ca803b7d08-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:27:10 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-96e06587-6d7e-4608-94f0-45fc0f5c0ad1 req-09850787-f47b-4561-b465-1e5f91ed5e82 service nova] Lock "6b2d5f4e-37af-438c-859b-d4ca803b7d08-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:27:10 user nova-compute[73572]: DEBUG nova.compute.manager [req-96e06587-6d7e-4608-94f0-45fc0f5c0ad1 req-09850787-f47b-4561-b465-1e5f91ed5e82 service nova] [instance: 6b2d5f4e-37af-438c-859b-d4ca803b7d08] No waiting events found dispatching network-vif-unplugged-bf886914-b734-4957-9e48-4ef3d65c61f4 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:27:10 user nova-compute[73572]: WARNING nova.compute.manager [req-96e06587-6d7e-4608-94f0-45fc0f5c0ad1 req-09850787-f47b-4561-b465-1e5f91ed5e82 service nova] [instance: 6b2d5f4e-37af-438c-859b-d4ca803b7d08] Received unexpected event network-vif-unplugged-bf886914-b734-4957-9e48-4ef3d65c61f4 for instance with vm_state active and task_state rebuilding.
Aug 26 10:27:10 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:27:10 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:27:10 user nova-compute[73572]: INFO nova.virt.libvirt.driver [-] [instance: 6b2d5f4e-37af-438c-859b-d4ca803b7d08] Instance destroyed successfully.
Aug 26 10:27:10 user nova-compute[73572]: INFO nova.compute.manager [None req-9c81718d-2e3a-4ebd-9a2b-f3fb247549de tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] [instance: 6b2d5f4e-37af-438c-859b-d4ca803b7d08] Detaching volume 8f8ad7ba-4084-4cd7-920f-8f7948de4212
Aug 26 10:27:10 user nova-compute[73572]: INFO nova.virt.block_device [None req-9c81718d-2e3a-4ebd-9a2b-f3fb247549de tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] [instance: 6b2d5f4e-37af-438c-859b-d4ca803b7d08] Attempting to driver detach volume 8f8ad7ba-4084-4cd7-920f-8f7948de4212 from mountpoint /dev/vdb
Aug 26 10:27:10 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-9c81718d-2e3a-4ebd-9a2b-f3fb247549de tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Attempting to detach device vdb from instance 6b2d5f4e-37af-438c-859b-d4ca803b7d08 from the persistent domain config. {{(pid=73572) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 10:27:10 user nova-compute[73572]: DEBUG nova.virt.libvirt.guest [None req-9c81718d-2e3a-4ebd-9a2b-f3fb247549de tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 10:27:10 user nova-compute[73572]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 10:27:10 user nova-compute[73572]:   <source dev="/dev/sdd"/>
Aug 26 10:27:10 user nova-compute[73572]:   <target dev="vdb" bus="virtio"/>
Aug 26 10:27:10 user nova-compute[73572]:   <serial>8f8ad7ba-4084-4cd7-920f-8f7948de4212</serial>
Aug 26 10:27:10 user nova-compute[73572]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 10:27:10 user nova-compute[73572]: </disk>
Aug 26 10:27:10 user nova-compute[73572]:  {{(pid=73572) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 10:27:10 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-9c81718d-2e3a-4ebd-9a2b-f3fb247549de tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Successfully detached device vdb from instance 6b2d5f4e-37af-438c-859b-d4ca803b7d08 from the persistent domain config.
Aug 26 10:27:10 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9c81718d-2e3a-4ebd-9a2b-f3fb247549de tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] [instance: 6b2d5f4e-37af-438c-859b-d4ca803b7d08] calling os-brick to detach iSCSI Volume {{(pid=73572) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 10:27:10 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c81718d-2e3a-4ebd-9a2b-f3fb247549de tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc89c3d6a10>, {'target_iqns': ['iqn.2010-10.org.openstack:8f8ad7ba-4084-4cd7-920f-8f7948de4212'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IicowWqU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 10:27:10 user nova-compute[73572]: WARNING os_brick.initiator.connectors.base [None req-9c81718d-2e3a-4ebd-9a2b-f3fb247549de tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 26 10:27:10 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-9c81718d-2e3a-4ebd-9a2b-f3fb247549de tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 10:27:10 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-9c81718d-2e3a-4ebd-9a2b-f3fb247549de tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 10:27:10 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c81718d-2e3a-4ebd-9a2b-f3fb247549de tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8f8ad7ba-4084-4cd7-920f-8f7948de4212', 0)] {{(pid=73572) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 10:27:10 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:27:10 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:27:10 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[7db101c7-7be9-4c22-99ff-e545d33f2d2d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:133098b2-106a-427f-aa6d-2c10625dd152\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:21602e43-35ed-4842-aa13-f04aca4243f2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:448cd30a-3852-471f-903f-a2e5abc34b55\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8f8ad7ba-4084-4cd7-920f-8f7948de4212\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:27:10 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:27:10 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:27:10 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[77fbe448-ab3c-4b45-ad9d-72a8d231edfb]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133098b2-106a-427f-aa6d-2c10625dd152 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21602e43-35ed-4842-aa13-f04aca4243f2 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:448cd30a-3852-471f-903f-a2e5abc34b55 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f8ad7ba-4084-4cd7-920f-8f7948de4212 (non-flash)\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:27:10 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c81718d-2e3a-4ebd-9a2b-f3fb247549de tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)
Aug 26 10:27:10 user nova-compute[73572]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133098b2-106a-427f-aa6d-2c10625dd152 (non-flash)
Aug 26 10:27:10 user nova-compute[73572]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21602e43-35ed-4842-aa13-f04aca4243f2 (non-flash)
Aug 26 10:27:10 user nova-compute[73572]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:448cd30a-3852-471f-903f-a2e5abc34b55 (non-flash)
Aug 26 10:27:10 user nova-compute[73572]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f8ad7ba-4084-4cd7-920f-8f7948de4212 (non-flash)
Aug 26 10:27:10 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 10:27:10 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c81718d-2e3a-4ebd-9a2b-f3fb247549de tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)
Aug 26 10:27:10 user nova-compute[73572]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133098b2-106a-427f-aa6d-2c10625dd152 (non-flash)
Aug 26 10:27:10 user nova-compute[73572]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21602e43-35ed-4842-aa13-f04aca4243f2 (non-flash)
Aug 26 10:27:10 user nova-compute[73572]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:448cd30a-3852-471f-903f-a2e5abc34b55 (non-flash)
Aug 26 10:27:10 user nova-compute[73572]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f8ad7ba-4084-4cd7-920f-8f7948de4212 (non-flash)
Aug 26 10:27:10 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 10:27:10 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c81718d-2e3a-4ebd-9a2b-f3fb247549de tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc89c48cd30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8f8ad7ba-4084-4cd7-920f-8f7948de4212'): ({'sdd'}, set())}) {{(pid=73572) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 10:27:10 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-9c81718d-2e3a-4ebd-9a2b-f3fb247549de tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Removing single pathed devices sdd {{(pid=73572) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 10:27:10 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:27:10 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:27:10 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[9476404c-fab8-498a-b287-6f24e6b10b65]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:27:10 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:27:10 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:27:10 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1be5c64-7994-45dd-9d97-4786ce9cfdf9]: (4, ('ok\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:27:10 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-9c81718d-2e3a-4ebd-9a2b-f3fb247549de tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Flushing IO for device /dev/sdd {{(pid=73572) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 10:27:10 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:27:10 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:27:10 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[a95c3018-c8a5-48a3-984d-7ec2d5cca5a4]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:27:10 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-9c81718d-2e3a-4ebd-9a2b-f3fb247549de tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73572) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 10:27:10 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:27:11 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.047s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:27:11 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[c90d1a89-4fa8-4c6d-978d-1dd769f38698]: (4, ('1', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:27:11 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-9c81718d-2e3a-4ebd-9a2b-f3fb247549de tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73572) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 10:27:11 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-9c81718d-2e3a-4ebd-9a2b-f3fb247549de tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] SCSI volumes sdd have been removed. {{(pid=73572) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 10:27:11 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c81718d-2e3a-4ebd-9a2b-f3fb247549de tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8f8ad7ba-4084-4cd7-920f-8f7948de4212')] {{(pid=73572) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 10:27:11 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f8ad7ba-4084-4cd7-920f-8f7948de4212 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:27:11 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f8ad7ba-4084-4cd7-920f-8f7948de4212 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:27:11 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4b1ce09-6a0d-426c-8242-b857c23396aa]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:27:11 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c81718d-2e3a-4ebd-9a2b-f3fb247549de tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:27:11 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f8ad7ba-4084-4cd7-920f-8f7948de4212 -p 172.16.0.220:3260 --logout {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:27:11 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f8ad7ba-4084-4cd7-920f-8f7948de4212 -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:27:11 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[07fd634a-3d82-4758-8886-d8b2244dea81]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:8f8ad7ba-4084-4cd7-920f-8f7948de4212, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:8f8ad7ba-4084-4cd7-920f-8f7948de4212, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:27:11 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c81718d-2e3a-4ebd-9a2b-f3fb247549de tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:8f8ad7ba-4084-4cd7-920f-8f7948de4212, portal: 172.16.0.220,3260]
Aug 26 10:27:11 user nova-compute[73572]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:8f8ad7ba-4084-4cd7-920f-8f7948de4212, portal: 172.16.0.220,3260] successful.
Aug 26 10:27:11 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:27:11 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f8ad7ba-4084-4cd7-920f-8f7948de4212 -p 172.16.0.220:3260 --op delete {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:27:11 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f8ad7ba-4084-4cd7-920f-8f7948de4212 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.039s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:27:11 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5b93900-99b4-4658-accc-ca432397c78d]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:27:11 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c81718d-2e3a-4ebd-9a2b-f3fb247549de tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:27:11 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-9c81718d-2e3a-4ebd-9a2b-f3fb247549de tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.322s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 10:27:11 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c81718d-2e3a-4ebd-9a2b-f3fb247549de tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] <== disconnect_volume: return (323ms) None {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 10:27:11 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9c81718d-2e3a-4ebd-9a2b-f3fb247549de tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] [instance: 6b2d5f4e-37af-438c-859b-d4ca803b7d08] Disconnected iSCSI Volume {{(pid=73572) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 10:27:12 user nova-compute[73572]: INFO nova.virt.libvirt.driver [-] [instance: 6b2d5f4e-37af-438c-859b-d4ca803b7d08] Instance destroyed successfully.
Aug 26 10:27:12 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-9c81718d-2e3a-4ebd-9a2b-f3fb247549de tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T10:25:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-665480809',display_name='tempest-ServerActionsTestOtherA-server-1892262121',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-665480809',id=35,image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO0nFuNIAmrcfF466dgWUoupbXiGxPDsRpOPU+BV/xU9so0Ahdwm8Jau8//ZWYq9Zw/pxbXy2f1pHOKtRMmBUc3daXPj1Sj1rpkWaf2AN4lE7ndY37vYFGh9kavZVJ2YNQ==',key_name='tempest-keypair-586663623',keypairs=<?>,launch_index=0,launched_at=2023-08-26T10:25:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='7935bccc360b46b589fd57d53f334595',ramdisk_id='',reservation_id='r-2h5gmgf0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-203628695',owner_user_name='tempest-ServerActionsTestOtherA-203628695-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T10:27:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='61b6124f6f6e44c5b2fd0202a15da019',uuid=6b2d5f4e-37af-438c-859b-d4ca803b7d08,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bf886914-b734-4957-9e48-4ef3d65c61f4", "address": "fa:16:3e:b4:aa:52", "network": {"id": "43215883-3d00-4be7-8c40-bdaf3f01bef9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1088544153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7935bccc360b46b589fd57d53f334595", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf886914-b7", "ovs_interfaceid": "bf886914-b734-4957-9e48-4ef3d65c61f4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 10:27:12 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-9c81718d-2e3a-4ebd-9a2b-f3fb247549de tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Converting VIF {"id": "bf886914-b734-4957-9e48-4ef3d65c61f4", "address": "fa:16:3e:b4:aa:52", "network": {"id": "43215883-3d00-4be7-8c40-bdaf3f01bef9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1088544153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7935bccc360b46b589fd57d53f334595", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf886914-b7", "ovs_interfaceid": "bf886914-b734-4957-9e48-4ef3d65c61f4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:27:12 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-9c81718d-2e3a-4ebd-9a2b-f3fb247549de tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b4:aa:52,bridge_name='br-int',has_traffic_filtering=True,id=bf886914-b734-4957-9e48-4ef3d65c61f4,network=Network(43215883-3d00-4be7-8c40-bdaf3f01bef9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf886914-b7') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:27:12 user nova-compute[73572]: DEBUG os_vif [None req-9c81718d-2e3a-4ebd-9a2b-f3fb247549de tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b4:aa:52,bridge_name='br-int',has_traffic_filtering=True,id=bf886914-b734-4957-9e48-4ef3d65c61f4,network=Network(43215883-3d00-4be7-8c40-bdaf3f01bef9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf886914-b7') {{(pid=73572) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 10:27:12 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:27:12 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbf886914-b7, bridge=br-int, if_exists=True) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:27:12 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:27:12 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:27:12 user nova-compute[73572]: INFO os_vif [None req-9c81718d-2e3a-4ebd-9a2b-f3fb247549de tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b4:aa:52,bridge_name='br-int',has_traffic_filtering=True,id=bf886914-b734-4957-9e48-4ef3d65c61f4,network=Network(43215883-3d00-4be7-8c40-bdaf3f01bef9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf886914-b7')
Aug 26 10:27:12 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9c81718d-2e3a-4ebd-9a2b-f3fb247549de tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] [instance: 6b2d5f4e-37af-438c-859b-d4ca803b7d08] calling os-brick to detach iSCSI Volume {{(pid=73572) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 10:27:12 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c81718d-2e3a-4ebd-9a2b-f3fb247549de tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc89c3d6a10>, {'target_iqns': ['iqn.2010-10.org.openstack:8f8ad7ba-4084-4cd7-920f-8f7948de4212'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IicowWqU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 10:27:12 user nova-compute[73572]: WARNING os_brick.initiator.connectors.base [None req-9c81718d-2e3a-4ebd-9a2b-f3fb247549de tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 26 10:27:12 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-9c81718d-2e3a-4ebd-9a2b-f3fb247549de tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 10:27:12 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-9c81718d-2e3a-4ebd-9a2b-f3fb247549de tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 10:27:12 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c81718d-2e3a-4ebd-9a2b-f3fb247549de tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8f8ad7ba-4084-4cd7-920f-8f7948de4212', 0)] {{(pid=73572) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 10:27:12 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:27:12 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:27:12 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ffcfcd0-6363-49f4-ae06-53a295fe7df9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:133098b2-106a-427f-aa6d-2c10625dd152\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:21602e43-35ed-4842-aa13-f04aca4243f2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:448cd30a-3852-471f-903f-a2e5abc34b55\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:27:12 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:27:12 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:27:12 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9870dc2-cf20-469b-831f-05053d7bd828]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133098b2-106a-427f-aa6d-2c10625dd152 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21602e43-35ed-4842-aa13-f04aca4243f2 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:448cd30a-3852-471f-903f-a2e5abc34b55 (non-flash)\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:27:12 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c81718d-2e3a-4ebd-9a2b-f3fb247549de tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)
Aug 26 10:27:12 user nova-compute[73572]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133098b2-106a-427f-aa6d-2c10625dd152 (non-flash)
Aug 26 10:27:12 user nova-compute[73572]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21602e43-35ed-4842-aa13-f04aca4243f2 (non-flash)
Aug 26 10:27:12 user nova-compute[73572]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:448cd30a-3852-471f-903f-a2e5abc34b55 (non-flash)
Aug 26 10:27:12 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 10:27:12 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c81718d-2e3a-4ebd-9a2b-f3fb247549de tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)
Aug 26 10:27:12 user nova-compute[73572]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133098b2-106a-427f-aa6d-2c10625dd152 (non-flash)
Aug 26 10:27:12 user nova-compute[73572]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21602e43-35ed-4842-aa13-f04aca4243f2 (non-flash)
Aug 26 10:27:12 user nova-compute[73572]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:448cd30a-3852-471f-903f-a2e5abc34b55 (non-flash)
Aug 26 10:27:12 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 10:27:12 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c81718d-2e3a-4ebd-9a2b-f3fb247549de tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc878bf23b0>, {}) {{(pid=73572) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 10:27:12 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c81718d-2e3a-4ebd-9a2b-f3fb247549de tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Disconnecting from: [] {{(pid=73572) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 10:27:12 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-9c81718d-2e3a-4ebd-9a2b-f3fb247549de tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.061s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 10:27:12 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c81718d-2e3a-4ebd-9a2b-f3fb247549de tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] <== disconnect_volume: return (63ms) None {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 10:27:12 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9c81718d-2e3a-4ebd-9a2b-f3fb247549de tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] [instance: 6b2d5f4e-37af-438c-859b-d4ca803b7d08] Disconnected iSCSI Volume {{(pid=73572) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 10:27:12 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-9c81718d-2e3a-4ebd-9a2b-f3fb247549de tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] [instance: 6b2d5f4e-37af-438c-859b-d4ca803b7d08] Deleting instance files /opt/stack/data/nova/instances/6b2d5f4e-37af-438c-859b-d4ca803b7d08_del
Aug 26 10:27:12 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-9c81718d-2e3a-4ebd-9a2b-f3fb247549de tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] [instance: 6b2d5f4e-37af-438c-859b-d4ca803b7d08] Deletion of /opt/stack/data/nova/instances/6b2d5f4e-37af-438c-859b-d4ca803b7d08_del complete
Aug 26 10:27:12 user nova-compute[73572]: INFO nova.virt.block_device [None req-9c81718d-2e3a-4ebd-9a2b-f3fb247549de tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] [instance: 6b2d5f4e-37af-438c-859b-d4ca803b7d08] Booting with volume 8f8ad7ba-4084-4cd7-920f-8f7948de4212 at /dev/vdb
Aug 26 10:27:12 user nova-compute[73572]: DEBUG nova.compute.manager [req-b0a29241-c1aa-4a9d-b7f2-e31b682f80a1 req-af48f52e-0e67-4691-b27d-350a32f03dc7 service nova] [instance: 6b2d5f4e-37af-438c-859b-d4ca803b7d08] Received event network-vif-plugged-bf886914-b734-4957-9e48-4ef3d65c61f4 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:27:12 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-b0a29241-c1aa-4a9d-b7f2-e31b682f80a1 req-af48f52e-0e67-4691-b27d-350a32f03dc7 service nova] Acquiring lock "6b2d5f4e-37af-438c-859b-d4ca803b7d08-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:27:12 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-b0a29241-c1aa-4a9d-b7f2-e31b682f80a1 req-af48f52e-0e67-4691-b27d-350a32f03dc7 service nova] Lock "6b2d5f4e-37af-438c-859b-d4ca803b7d08-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:27:12 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-b0a29241-c1aa-4a9d-b7f2-e31b682f80a1 req-af48f52e-0e67-4691-b27d-350a32f03dc7 service nova] Lock "6b2d5f4e-37af-438c-859b-d4ca803b7d08-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:27:12 user nova-compute[73572]: DEBUG nova.compute.manager [req-b0a29241-c1aa-4a9d-b7f2-e31b682f80a1 req-af48f52e-0e67-4691-b27d-350a32f03dc7 service nova] [instance: 6b2d5f4e-37af-438c-859b-d4ca803b7d08] No waiting events found dispatching network-vif-plugged-bf886914-b734-4957-9e48-4ef3d65c61f4 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:27:12 user nova-compute[73572]: WARNING nova.compute.manager [req-b0a29241-c1aa-4a9d-b7f2-e31b682f80a1 req-af48f52e-0e67-4691-b27d-350a32f03dc7 service nova] [instance: 6b2d5f4e-37af-438c-859b-d4ca803b7d08] Received unexpected event network-vif-plugged-bf886914-b734-4957-9e48-4ef3d65c61f4 for instance with vm_state active and task_state rebuild_block_device_mapping.
Aug 26 10:27:12 user nova-compute[73572]: DEBUG os_brick.utils [None req-9c81718d-2e3a-4ebd-9a2b-f3fb247549de tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 10:27:12 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:27:12 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:27:12 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[f53d5b70-360c-4093-be69-74a6efc6025a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:de8a79ed912\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:27:12 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:27:12 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:27:12 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[262198b7-a031-425e-acf7-3d9811ab74fe]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:27:12 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:27:12 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:27:12 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[270abd2c-f634-4873-a0d8-df6298ec7e3b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:27:12 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ea28a72-d6c5-401f-8739-ccfa35dbb987]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:27:12 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9c81718d-2e3a-4ebd-9a2b-f3fb247549de tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Running cmd (subprocess): nvme version {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:27:12 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9c81718d-2e3a-4ebd-9a2b-f3fb247549de tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] 'nvme version' failed. Not Retrying. {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 10:27:12 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9c81718d-2e3a-4ebd-9a2b-f3fb247549de tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] nvme not present on system {{(pid=73572) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 10:27:12 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:27:12 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 10:27:12 user nova-compute[73572]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 10:27:12 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1fbfa0d-a0cb-4e4e-9e87-d03dcce9cfae]: (4, '') {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:27:12 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.lightos [None req-9c81718d-2e3a-4ebd-9a2b-f3fb247549de tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73572) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 10:27:12 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.lightos [None req-9c81718d-2e3a-4ebd-9a2b-f3fb247549de tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73572) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 10:27:12 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.lightos [None req-9c81718d-2e3a-4ebd-9a2b-f3fb247549de tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] LIGHTOS: no hostnqn found. {{(pid=73572) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 10:27:12 user nova-compute[73572]: DEBUG os_brick.utils [None req-9c81718d-2e3a-4ebd-9a2b-f3fb247549de tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] <== get_connector_properties: return (154ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:de8a79ed912', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 10:27:12 user nova-compute[73572]: DEBUG nova.virt.block_device [None req-9c81718d-2e3a-4ebd-9a2b-f3fb247549de tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] [instance: 6b2d5f4e-37af-438c-859b-d4ca803b7d08] Updating existing volume attachment record: e5ca9df8-861c-4b93-8c71-94cff7de5a51 {{(pid=73572) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 10:27:15 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:27:15 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:27:15 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Starting heal instance info cache {{(pid=73572) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 10:27:15 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquiring lock "refresh_cache-2eaea7c2-a5c0-4950-b033-0012b5cec0ee" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:27:15 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquired lock "refresh_cache-2eaea7c2-a5c0-4950-b033-0012b5cec0ee" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:27:15 user nova-compute[73572]: DEBUG nova.network.neutron [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] [instance: 2eaea7c2-a5c0-4950-b033-0012b5cec0ee] Forcefully refreshing network info cache for instance {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 10:27:16 user nova-compute[73572]: DEBUG nova.network.neutron [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] [instance: 2eaea7c2-a5c0-4950-b033-0012b5cec0ee] Updating instance_info_cache with network_info: [{"id": "0b4d66c9-2155-45ae-873a-2ee85776eeb7", "address": "fa:16:3e:69:d4:8e", "network": {"id": "757e71b4-5177-45a5-8ef5-9b27f42092f1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1765327616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1bff48d66894950ac6690e1fd0e79b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b4d66c9-21", "ovs_interfaceid": "0b4d66c9-2155-45ae-873a-2ee85776eeb7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:27:16 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Releasing lock "refresh_cache-2eaea7c2-a5c0-4950-b033-0012b5cec0ee" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:27:16 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] [instance: 2eaea7c2-a5c0-4950-b033-0012b5cec0ee] Updated the network info_cache for instance {{(pid=73572) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 10:27:17 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:27:17 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:27:19 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:27:19 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73572) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 10:27:19 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:27:19 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73572) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 26 10:27:20 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:27:20 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-5590f1df-ccf4-4b98-aa54-2414dfd27e38 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Acquiring lock "6422ce7d-9348-48b2-9af0-ec322d482d2b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:27:20 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-5590f1df-ccf4-4b98-aa54-2414dfd27e38 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Lock "6422ce7d-9348-48b2-9af0-ec322d482d2b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:27:20 user nova-compute[73572]: INFO nova.compute.manager [None req-5590f1df-ccf4-4b98-aa54-2414dfd27e38 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] [instance: 6422ce7d-9348-48b2-9af0-ec322d482d2b] Detaching volume 21602e43-35ed-4842-aa13-f04aca4243f2
Aug 26 10:27:20 user nova-compute[73572]: INFO nova.virt.block_device [None req-5590f1df-ccf4-4b98-aa54-2414dfd27e38 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] [instance: 6422ce7d-9348-48b2-9af0-ec322d482d2b] Attempting to driver detach volume 21602e43-35ed-4842-aa13-f04aca4243f2 from mountpoint /dev/vdb
Aug 26 10:27:20 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-5590f1df-ccf4-4b98-aa54-2414dfd27e38 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Attempting to detach device vdb from instance 6422ce7d-9348-48b2-9af0-ec322d482d2b from the persistent domain config. {{(pid=73572) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 10:27:20 user nova-compute[73572]: DEBUG nova.virt.libvirt.guest [None req-5590f1df-ccf4-4b98-aa54-2414dfd27e38 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 10:27:20 user nova-compute[73572]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 10:27:20 user nova-compute[73572]:   <source dev="/dev/sdc"/>
Aug 26 10:27:20 user nova-compute[73572]:   <target dev="vdb" bus="virtio"/>
Aug 26 10:27:20 user nova-compute[73572]:   <serial>21602e43-35ed-4842-aa13-f04aca4243f2</serial>
Aug 26 10:27:20 user nova-compute[73572]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 10:27:20 user nova-compute[73572]: </disk>
Aug 26 10:27:20 user nova-compute[73572]:  {{(pid=73572) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 10:27:20 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-5590f1df-ccf4-4b98-aa54-2414dfd27e38 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Successfully detached device vdb from instance 6422ce7d-9348-48b2-9af0-ec322d482d2b from the persistent domain config.
Aug 26 10:27:20 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-5590f1df-ccf4-4b98-aa54-2414dfd27e38 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 6422ce7d-9348-48b2-9af0-ec322d482d2b from the live domain config. {{(pid=73572) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 10:27:20 user nova-compute[73572]: DEBUG nova.virt.libvirt.guest [None req-5590f1df-ccf4-4b98-aa54-2414dfd27e38 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 10:27:20 user nova-compute[73572]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 10:27:20 user nova-compute[73572]:   <source dev="/dev/sdc"/>
Aug 26 10:27:20 user nova-compute[73572]:   <target dev="vdb" bus="virtio"/>
Aug 26 10:27:20 user nova-compute[73572]:   <serial>21602e43-35ed-4842-aa13-f04aca4243f2</serial>
Aug 26 10:27:20 user nova-compute[73572]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 10:27:20 user nova-compute[73572]: </disk>
Aug 26 10:27:20 user nova-compute[73572]:  {{(pid=73572) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 10:27:20 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9ca19798-f9a3-4ca1-89ff-3e658df150b4 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Acquiring lock "6422ce7d-9348-48b2-9af0-ec322d482d2b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:27:21 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Received event <DeviceRemovedEvent: 1693045641.3805213, 6422ce7d-9348-48b2-9af0-ec322d482d2b => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73572) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 10:27:21 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-5590f1df-ccf4-4b98-aa54-2414dfd27e38 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 6422ce7d-9348-48b2-9af0-ec322d482d2b {{(pid=73572) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 10:27:21 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-5590f1df-ccf4-4b98-aa54-2414dfd27e38 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Successfully detached device vdb from instance 6422ce7d-9348-48b2-9af0-ec322d482d2b from the live domain config.
Aug 26 10:27:21 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5590f1df-ccf4-4b98-aa54-2414dfd27e38 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] [instance: 6422ce7d-9348-48b2-9af0-ec322d482d2b] calling os-brick to detach iSCSI Volume {{(pid=73572) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 10:27:21 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-5590f1df-ccf4-4b98-aa54-2414dfd27e38 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc89c3d6a10>, {'target_iqns': ['iqn.2010-10.org.openstack:21602e43-35ed-4842-aa13-f04aca4243f2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HbfPQgus', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 10:27:21 user nova-compute[73572]: WARNING os_brick.initiator.connectors.base [None req-5590f1df-ccf4-4b98-aa54-2414dfd27e38 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 10:27:21 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-5590f1df-ccf4-4b98-aa54-2414dfd27e38 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 10:27:21 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-5590f1df-ccf4-4b98-aa54-2414dfd27e38 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 10:27:21 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-5590f1df-ccf4-4b98-aa54-2414dfd27e38 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:21602e43-35ed-4842-aa13-f04aca4243f2', 0)] {{(pid=73572) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 10:27:21 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:27:21 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:27:21 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[29cdc8b1-a5d1-46a9-a19f-9729e44ad56c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:133098b2-106a-427f-aa6d-2c10625dd152\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:21602e43-35ed-4842-aa13-f04aca4243f2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:448cd30a-3852-471f-903f-a2e5abc34b55\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:27:21 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:27:21 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:27:21 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[1929e135-af05-4fd5-bc64-cb4394d383a6]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133098b2-106a-427f-aa6d-2c10625dd152 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21602e43-35ed-4842-aa13-f04aca4243f2 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:448cd30a-3852-471f-903f-a2e5abc34b55 (non-flash)\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:27:21 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-5590f1df-ccf4-4b98-aa54-2414dfd27e38 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)
Aug 26 10:27:21 user nova-compute[73572]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133098b2-106a-427f-aa6d-2c10625dd152 (non-flash)
Aug 26 10:27:21 user nova-compute[73572]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21602e43-35ed-4842-aa13-f04aca4243f2 (non-flash)
Aug 26 10:27:21 user nova-compute[73572]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:448cd30a-3852-471f-903f-a2e5abc34b55 (non-flash)
Aug 26 10:27:21 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 10:27:21 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-5590f1df-ccf4-4b98-aa54-2414dfd27e38 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)
Aug 26 10:27:21 user nova-compute[73572]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133098b2-106a-427f-aa6d-2c10625dd152 (non-flash)
Aug 26 10:27:21 user nova-compute[73572]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21602e43-35ed-4842-aa13-f04aca4243f2 (non-flash)
Aug 26 10:27:21 user nova-compute[73572]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:448cd30a-3852-471f-903f-a2e5abc34b55 (non-flash)
Aug 26 10:27:21 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 10:27:21 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-5590f1df-ccf4-4b98-aa54-2414dfd27e38 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc878bf0280>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:21602e43-35ed-4842-aa13-f04aca4243f2'): ({'sdc'}, set())}) {{(pid=73572) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 10:27:21 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-5590f1df-ccf4-4b98-aa54-2414dfd27e38 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Removing single pathed devices sdc {{(pid=73572) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 10:27:21 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:27:21 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:27:21 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f6cd9df-cb2a-4f4f-b664-141cb698dbf4]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:27:21 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:27:21 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:27:21 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[31c0761f-fa17-4f69-8149-2ffbc79a26b0]: (4, ('ok\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:27:21 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-5590f1df-ccf4-4b98-aa54-2414dfd27e38 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Flushing IO for device /dev/sdc {{(pid=73572) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 10:27:21 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:27:21 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:27:21 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[02db552e-4acc-4e32-bd04-0a7c9540783b]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:27:21 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-5590f1df-ccf4-4b98-aa54-2414dfd27e38 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73572) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 10:27:21 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:27:21 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.040s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:27:21 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[e878983a-bb84-4539-99f1-79fa25c4290a]: (4, ('1', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:27:21 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-5590f1df-ccf4-4b98-aa54-2414dfd27e38 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73572) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 10:27:21 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-5590f1df-ccf4-4b98-aa54-2414dfd27e38 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] SCSI volumes sdc have been removed. {{(pid=73572) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 10:27:21 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-5590f1df-ccf4-4b98-aa54-2414dfd27e38 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:21602e43-35ed-4842-aa13-f04aca4243f2')] {{(pid=73572) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 10:27:21 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21602e43-35ed-4842-aa13-f04aca4243f2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:27:21 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21602e43-35ed-4842-aa13-f04aca4243f2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:27:21 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[109a01bb-a897-432d-a516-9fc288746bf3]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:27:21 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-5590f1df-ccf4-4b98-aa54-2414dfd27e38 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:27:21 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21602e43-35ed-4842-aa13-f04aca4243f2 -p 172.16.0.220:3260 --logout {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:27:21 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21602e43-35ed-4842-aa13-f04aca4243f2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:27:21 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ce74e82-da95-48e1-8dff-2a92ec883e47]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:21602e43-35ed-4842-aa13-f04aca4243f2, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:21602e43-35ed-4842-aa13-f04aca4243f2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:27:21 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-5590f1df-ccf4-4b98-aa54-2414dfd27e38 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:21602e43-35ed-4842-aa13-f04aca4243f2, portal: 172.16.0.220,3260]
Aug 26 10:27:21 user nova-compute[73572]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:21602e43-35ed-4842-aa13-f04aca4243f2, portal: 172.16.0.220,3260] successful.
Aug 26 10:27:21 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:27:21 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21602e43-35ed-4842-aa13-f04aca4243f2 -p 172.16.0.220:3260 --op delete {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:27:21 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21602e43-35ed-4842-aa13-f04aca4243f2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:27:21 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f7d936e-ab3e-4d19-bee1-fa3052295fad]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:27:21 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-5590f1df-ccf4-4b98-aa54-2414dfd27e38 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:27:21 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-5590f1df-ccf4-4b98-aa54-2414dfd27e38 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.290s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 10:27:21 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-5590f1df-ccf4-4b98-aa54-2414dfd27e38 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] <== disconnect_volume: return (292ms) None {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 10:27:21 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5590f1df-ccf4-4b98-aa54-2414dfd27e38 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] [instance: 6422ce7d-9348-48b2-9af0-ec322d482d2b] Disconnected iSCSI Volume {{(pid=73572) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 10:27:21 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:27:22 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:27:22 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:27:22 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:27:24 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-9c81718d-2e3a-4ebd-9a2b-f3fb247549de tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] [instance: 6b2d5f4e-37af-438c-859b-d4ca803b7d08] Creating instance directory {{(pid=73572) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 10:27:24 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-9c81718d-2e3a-4ebd-9a2b-f3fb247549de tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] [instance: 6b2d5f4e-37af-438c-859b-d4ca803b7d08] Creating image(s)
Aug 26 10:27:24 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9c81718d-2e3a-4ebd-9a2b-f3fb247549de tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Acquiring lock "/opt/stack/data/nova/instances/6b2d5f4e-37af-438c-859b-d4ca803b7d08/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:27:24 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9c81718d-2e3a-4ebd-9a2b-f3fb247549de tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Lock "/opt/stack/data/nova/instances/6b2d5f4e-37af-438c-859b-d4ca803b7d08/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:27:24 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9c81718d-2e3a-4ebd-9a2b-f3fb247549de tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Lock "/opt/stack/data/nova/instances/6b2d5f4e-37af-438c-859b-d4ca803b7d08/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:27:24 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9c81718d-2e3a-4ebd-9a2b-f3fb247549de tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:27:24 user nova-compute[73572]: DEBUG nova.objects.instance [None req-5590f1df-ccf4-4b98-aa54-2414dfd27e38 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Lazy-loading 'flavor' on Instance uuid 6422ce7d-9348-48b2-9af0-ec322d482d2b {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:27:24 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-5590f1df-ccf4-4b98-aa54-2414dfd27e38 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Lock "6422ce7d-9348-48b2-9af0-ec322d482d2b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.526s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:27:24 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9ca19798-f9a3-4ca1-89ff-3e658df150b4 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Lock "6422ce7d-9348-48b2-9af0-ec322d482d2b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 3.404s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:27:24 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9ca19798-f9a3-4ca1-89ff-3e658df150b4 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Acquiring lock "6422ce7d-9348-48b2-9af0-ec322d482d2b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:27:24 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9ca19798-f9a3-4ca1-89ff-3e658df150b4 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Lock "6422ce7d-9348-48b2-9af0-ec322d482d2b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:27:24 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9ca19798-f9a3-4ca1-89ff-3e658df150b4 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Lock "6422ce7d-9348-48b2-9af0-ec322d482d2b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:27:24 user nova-compute[73572]: INFO nova.compute.manager [None req-9ca19798-f9a3-4ca1-89ff-3e658df150b4 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] [instance: 6422ce7d-9348-48b2-9af0-ec322d482d2b] Terminating instance
Aug 26 10:27:24 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9ca19798-f9a3-4ca1-89ff-3e658df150b4 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] [instance: 6422ce7d-9348-48b2-9af0-ec322d482d2b] Start destroying the instance on the hypervisor. {{(pid=73572) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 10:27:24 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9c81718d-2e3a-4ebd-9a2b-f3fb247549de tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json" returned: 0 in 0.205s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:27:24 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9c81718d-2e3a-4ebd-9a2b-f3fb247549de tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Acquiring lock "2099350d6f3bcd0de9471c73862d4fe75b049801" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:27:24 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9c81718d-2e3a-4ebd-9a2b-f3fb247549de tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Lock "2099350d6f3bcd0de9471c73862d4fe75b049801" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:27:24 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9c81718d-2e3a-4ebd-9a2b-f3fb247549de tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:27:24 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:27:24 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:27:24 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:27:24 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9c81718d-2e3a-4ebd-9a2b-f3fb247549de tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json" returned: 0 in 0.202s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:27:24 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9c81718d-2e3a-4ebd-9a2b-f3fb247549de tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801,backing_fmt=raw /opt/stack/data/nova/instances/6b2d5f4e-37af-438c-859b-d4ca803b7d08/disk 1073741824 {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:27:24 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:27:24 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9c81718d-2e3a-4ebd-9a2b-f3fb247549de tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801,backing_fmt=raw /opt/stack/data/nova/instances/6b2d5f4e-37af-438c-859b-d4ca803b7d08/disk 1073741824" returned: 0 in 0.058s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:27:24 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9c81718d-2e3a-4ebd-9a2b-f3fb247549de tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Lock "2099350d6f3bcd0de9471c73862d4fe75b049801" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.265s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:27:24 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9c81718d-2e3a-4ebd-9a2b-f3fb247549de tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:27:24 user nova-compute[73572]: DEBUG nova.compute.manager [req-901d7353-abdf-4d6f-9421-83381984a5e6 req-416b7c73-6d51-4c0f-980a-83a3c1e50489 service nova] [instance: 6422ce7d-9348-48b2-9af0-ec322d482d2b] Received event network-vif-unplugged-f995916a-1a71-47ac-9abd-2a24136e4981 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:27:24 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-901d7353-abdf-4d6f-9421-83381984a5e6 req-416b7c73-6d51-4c0f-980a-83a3c1e50489 service nova] Acquiring lock "6422ce7d-9348-48b2-9af0-ec322d482d2b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:27:24 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-901d7353-abdf-4d6f-9421-83381984a5e6 req-416b7c73-6d51-4c0f-980a-83a3c1e50489 service nova] Lock "6422ce7d-9348-48b2-9af0-ec322d482d2b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:27:24 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-901d7353-abdf-4d6f-9421-83381984a5e6 req-416b7c73-6d51-4c0f-980a-83a3c1e50489 service nova] Lock "6422ce7d-9348-48b2-9af0-ec322d482d2b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:27:24 user nova-compute[73572]: DEBUG nova.compute.manager [req-901d7353-abdf-4d6f-9421-83381984a5e6 req-416b7c73-6d51-4c0f-980a-83a3c1e50489 service nova] [instance: 6422ce7d-9348-48b2-9af0-ec322d482d2b] No waiting events found dispatching network-vif-unplugged-f995916a-1a71-47ac-9abd-2a24136e4981 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:27:24 user nova-compute[73572]: DEBUG nova.compute.manager [req-901d7353-abdf-4d6f-9421-83381984a5e6 req-416b7c73-6d51-4c0f-980a-83a3c1e50489 service nova] [instance: 6422ce7d-9348-48b2-9af0-ec322d482d2b] Received event network-vif-unplugged-f995916a-1a71-47ac-9abd-2a24136e4981 for instance with task_state deleting. {{(pid=73572) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 10:27:24 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9c81718d-2e3a-4ebd-9a2b-f3fb247549de tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json" returned: 0 in 0.186s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:27:24 user nova-compute[73572]: DEBUG nova.virt.disk.api [None req-9c81718d-2e3a-4ebd-9a2b-f3fb247549de tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6b2d5f4e-37af-438c-859b-d4ca803b7d08/disk. size=1073741824 {{(pid=73572) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 10:27:24 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9c81718d-2e3a-4ebd-9a2b-f3fb247549de tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b2d5f4e-37af-438c-859b-d4ca803b7d08/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:27:24 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9c81718d-2e3a-4ebd-9a2b-f3fb247549de tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b2d5f4e-37af-438c-859b-d4ca803b7d08/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:27:24 user nova-compute[73572]: DEBUG nova.virt.disk.api [None req-9c81718d-2e3a-4ebd-9a2b-f3fb247549de tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Cannot resize image /opt/stack/data/nova/instances/6b2d5f4e-37af-438c-859b-d4ca803b7d08/disk to a smaller size. {{(pid=73572) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 10:27:24 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-9c81718d-2e3a-4ebd-9a2b-f3fb247549de tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] [instance: 6b2d5f4e-37af-438c-859b-d4ca803b7d08] Created local disks {{(pid=73572) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 10:27:24 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-9c81718d-2e3a-4ebd-9a2b-f3fb247549de tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] [instance: 6b2d5f4e-37af-438c-859b-d4ca803b7d08] Ensure instance console log exists: /opt/stack/data/nova/instances/6b2d5f4e-37af-438c-859b-d4ca803b7d08/console.log {{(pid=73572) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 10:27:24 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9c81718d-2e3a-4ebd-9a2b-f3fb247549de tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:27:24 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9c81718d-2e3a-4ebd-9a2b-f3fb247549de tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:27:24 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9c81718d-2e3a-4ebd-9a2b-f3fb247549de tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:27:24 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-9c81718d-2e3a-4ebd-9a2b-f3fb247549de tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] [instance: 6b2d5f4e-37af-438c-859b-d4ca803b7d08] Start _get_guest_xml network_info=[{"id": "bf886914-b734-4957-9e48-4ef3d65c61f4", "address": "fa:16:3e:b4:aa:52", "network": {"id": "43215883-3d00-4be7-8c40-bdaf3f01bef9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1088544153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7935bccc360b46b589fd57d53f334595", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf886914-b7", "ovs_interfaceid": "bf886914-b734-4957-9e48-4ef3d65c61f4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T10:07:33Z,direct_url=<?>,disk_format='qcow2',id=299da0c9-e1c4-48f0-be55-fbe20dd06bc9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5c995f8bbbab4368b67a253e0df3971a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T10:07:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'guest_format': None, 'size': 0, 'encryption_format': None, 'device_type': 'disk', 'image_id': '299da0c9-e1c4-48f0-be55-fbe20dd06bc9'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'disk_bus': 'virtio', 'boot_index': None, 'mount_device': '/dev/vdb', 'attachment_id': 'e5ca9df8-861c-4b93-8c71-94cff7de5a51', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:8f8ad7ba-4084-4cd7-920f-8f7948de4212'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IicowWqU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '6b2d5f4e-37af-438c-859b-d4ca803b7d08', 'attached_at': '', 'detached_at': '', 'volume_id': '8f8ad7ba-4084-4cd7-920f-8f7948de4212', 'serial': '8f8ad7ba-4084-4cd7-920f-8f7948de4212'}, 'guest_format': None, 'device_type': 'disk', 'volume_type': None} {{(pid=73572) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 10:27:24 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-9c81718d-2e3a-4ebd-9a2b-f3fb247549de tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 26 10:27:24 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-9c81718d-2e3a-4ebd-9a2b-f3fb247549de tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 26 10:27:25 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-9c81718d-2e3a-4ebd-9a2b-f3fb247549de tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73572) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 10:27:25 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-9c81718d-2e3a-4ebd-9a2b-f3fb247549de tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] CPU controller missing on host. {{(pid=73572) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 10:27:25 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-9c81718d-2e3a-4ebd-9a2b-f3fb247549de tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73572) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 10:27:25 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-9c81718d-2e3a-4ebd-9a2b-f3fb247549de tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] CPU controller found on host. {{(pid=73572) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 10:27:25 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-9c81718d-2e3a-4ebd-9a2b-f3fb247549de tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73572) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 10:27:25 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-9c81718d-2e3a-4ebd-9a2b-f3fb247549de tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T10:07:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T10:07:33Z,direct_url=<?>,disk_format='qcow2',id=299da0c9-e1c4-48f0-be55-fbe20dd06bc9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5c995f8bbbab4368b67a253e0df3971a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T10:07:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 10:27:25 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-9c81718d-2e3a-4ebd-9a2b-f3fb247549de tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Flavor limits 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 10:27:25 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-9c81718d-2e3a-4ebd-9a2b-f3fb247549de tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Image limits 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 10:27:25 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-9c81718d-2e3a-4ebd-9a2b-f3fb247549de tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Flavor pref 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 10:27:25 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-9c81718d-2e3a-4ebd-9a2b-f3fb247549de tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Image pref 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 10:27:25 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-9c81718d-2e3a-4ebd-9a2b-f3fb247549de tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 10:27:25 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-9c81718d-2e3a-4ebd-9a2b-f3fb247549de tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 10:27:25 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-9c81718d-2e3a-4ebd-9a2b-f3fb247549de tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73572) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 10:27:25 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-9c81718d-2e3a-4ebd-9a2b-f3fb247549de tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Got 1 possible topologies {{(pid=73572) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 10:27:25 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-9c81718d-2e3a-4ebd-9a2b-f3fb247549de tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 10:27:25 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-9c81718d-2e3a-4ebd-9a2b-f3fb247549de tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 10:27:25 user nova-compute[73572]: DEBUG nova.objects.instance [None req-9c81718d-2e3a-4ebd-9a2b-f3fb247549de tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Lazy-loading 'vcpu_model' on Instance uuid 6b2d5f4e-37af-438c-859b-d4ca803b7d08 {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:27:25 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9c81718d-2e3a-4ebd-9a2b-f3fb247549de tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] [instance: 6b2d5f4e-37af-438c-859b-d4ca803b7d08] Calling os-brick to attach iSCSI Volume {{(pid=73572) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 10:27:25 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c81718d-2e3a-4ebd-9a2b-f3fb247549de tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc89c3d6a10>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:8f8ad7ba-4084-4cd7-920f-8f7948de4212'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IicowWqU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 10:27:25 user nova-compute[73572]: WARNING os_brick.initiator.connectors.base [None req-9c81718d-2e3a-4ebd-9a2b-f3fb247549de tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 26 10:27:25 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-9c81718d-2e3a-4ebd-9a2b-f3fb247549de tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 10:27:25 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-9c81718d-2e3a-4ebd-9a2b-f3fb247549de tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 10:27:25 user nova-compute[73572]: WARNING os_brick.initiator.connectors.base [None req-9c81718d-2e3a-4ebd-9a2b-f3fb247549de tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 26 10:27:25 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-9c81718d-2e3a-4ebd-9a2b-f3fb247549de tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8f8ad7ba-4084-4cd7-920f-8f7948de4212" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 10:27:25 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-9c81718d-2e3a-4ebd-9a2b-f3fb247549de tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8f8ad7ba-4084-4cd7-920f-8f7948de4212" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 10:27:25 user nova-compute[73572]: INFO os_brick.initiator.connectors.iscsi [None req-9c81718d-2e3a-4ebd-9a2b-f3fb247549de tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 10:27:25 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f8ad7ba-4084-4cd7-920f-8f7948de4212 -p 172.16.0.220:3260 {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:27:25 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f8ad7ba-4084-4cd7-920f-8f7948de4212 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:27:25 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[04749387-6449-485f-9a52-3aaf9ab18d51]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:27:25 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c81718d-2e3a-4ebd-9a2b-f3fb247549de tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 10:27:25 user nova-compute[73572]:  {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:27:25 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f8ad7ba-4084-4cd7-920f-8f7948de4212 -p 172.16.0.220:3260 --interface default --op new {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:27:25 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f8ad7ba-4084-4cd7-920f-8f7948de4212 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:27:25 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a1bb4db-4104-492e-a02d-c012a2c54ce3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8f8ad7ba-4084-4cd7-920f-8f7948de4212] added\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:27:25 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c81718d-2e3a-4ebd-9a2b-f3fb247549de tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8f8ad7ba-4084-4cd7-920f-8f7948de4212] added
Aug 26 10:27:25 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:27:25 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f8ad7ba-4084-4cd7-920f-8f7948de4212 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:27:25 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f8ad7ba-4084-4cd7-920f-8f7948de4212 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:27:25 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[d14d3ab7-3c14-4988-adb5-fe1c5d7573a5]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:27:25 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c81718d-2e3a-4ebd-9a2b-f3fb247549de tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:27:25 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f8ad7ba-4084-4cd7-920f-8f7948de4212 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:27:25 user nova-compute[73572]: INFO nova.virt.libvirt.driver [-] [instance: 6422ce7d-9348-48b2-9af0-ec322d482d2b] Instance destroyed successfully.
Aug 26 10:27:25 user nova-compute[73572]: DEBUG nova.objects.instance [None req-9ca19798-f9a3-4ca1-89ff-3e658df150b4 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Lazy-loading 'resources' on Instance uuid 6422ce7d-9348-48b2-9af0-ec322d482d2b {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:27:25 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-9ca19798-f9a3-4ca1-89ff-3e658df150b4 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T10:24:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1778586676',display_name='tempest-VolumesSnapshotTestJSON-instance-1778586676',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1778586676',id=34,image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFOSJsvn2NQD3oaPW07BlO9jo+ExfV5p+uOiUpR8sAv7IbS2FVu0eT2WJQvbyN5SiRBauDjD3M/Q3vW8yoI96RtMHDPJS1vnpUAPiXMVARBABVZ2Elgg2rm/3z8rpfCoJQ==',key_name='tempest-keypair-268337326',keypairs=<?>,launch_index=0,launched_at=2023-08-26T10:24:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='84e33d9ef6ec45709135edc20c8d7720',ramdisk_id='',reservation_id='r-n7d5k31s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-760064238',owner_user_name='tempest-VolumesSnapshotTestJSON-760064238-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T10:24:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='60fb7b6cd1d14b2ea2e4ab806642e230',uuid=6422ce7d-9348-48b2-9af0-ec322d482d2b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f995916a-1a71-47ac-9abd-2a24136e4981", "address": "fa:16:3e:02:84:35", "network": {"id": "146a7a16-6dfd-48bd-8c96-766bdbe89bed", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-631761752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84e33d9ef6ec45709135edc20c8d7720", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf995916a-1a", "ovs_interfaceid": "f995916a-1a71-47ac-9abd-2a24136e4981", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 10:27:25 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-9ca19798-f9a3-4ca1-89ff-3e658df150b4 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Converting VIF {"id": "f995916a-1a71-47ac-9abd-2a24136e4981", "address": "fa:16:3e:02:84:35", "network": {"id": "146a7a16-6dfd-48bd-8c96-766bdbe89bed", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-631761752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84e33d9ef6ec45709135edc20c8d7720", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf995916a-1a", "ovs_interfaceid": "f995916a-1a71-47ac-9abd-2a24136e4981", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:27:25 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-9ca19798-f9a3-4ca1-89ff-3e658df150b4 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:02:84:35,bridge_name='br-int',has_traffic_filtering=True,id=f995916a-1a71-47ac-9abd-2a24136e4981,network=Network(146a7a16-6dfd-48bd-8c96-766bdbe89bed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf995916a-1a') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:27:25 user nova-compute[73572]: DEBUG os_vif [None req-9ca19798-f9a3-4ca1-89ff-3e658df150b4 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:02:84:35,bridge_name='br-int',has_traffic_filtering=True,id=f995916a-1a71-47ac-9abd-2a24136e4981,network=Network(146a7a16-6dfd-48bd-8c96-766bdbe89bed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf995916a-1a') {{(pid=73572) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 10:27:25 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f8ad7ba-4084-4cd7-920f-8f7948de4212 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:27:25 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[66dd623e-8671-49cc-8af4-edc64eff022d]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:27:25 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c81718d-2e3a-4ebd-9a2b-f3fb247549de tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:27:25 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:27:25 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf995916a-1a, bridge=br-int, if_exists=True) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:27:25 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f8ad7ba-4084-4cd7-920f-8f7948de4212 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IicowWqU {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:27:25 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:27:25 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:27:25 user nova-compute[73572]: INFO os_vif [None req-9ca19798-f9a3-4ca1-89ff-3e658df150b4 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:02:84:35,bridge_name='br-int',has_traffic_filtering=True,id=f995916a-1a71-47ac-9abd-2a24136e4981,network=Network(146a7a16-6dfd-48bd-8c96-766bdbe89bed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf995916a-1a')
Aug 26 10:27:25 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ca19798-f9a3-4ca1-89ff-3e658df150b4 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] [instance: 6422ce7d-9348-48b2-9af0-ec322d482d2b] calling os-brick to detach iSCSI Volume {{(pid=73572) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 10:27:25 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ca19798-f9a3-4ca1-89ff-3e658df150b4 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc89c3d6a10>, {'target_iqns': ['iqn.2010-10.org.openstack:21602e43-35ed-4842-aa13-f04aca4243f2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HbfPQgus', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 10:27:25 user nova-compute[73572]: WARNING os_brick.initiator.connectors.base [None req-9ca19798-f9a3-4ca1-89ff-3e658df150b4 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 10:27:25 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-9ca19798-f9a3-4ca1-89ff-3e658df150b4 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 10:27:25 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f8ad7ba-4084-4cd7-920f-8f7948de4212 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IicowWqU" returned: 0 in 0.026s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:27:25 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[88487c8a-4fe4-4c4d-9c1d-15882861029b]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:27:25 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c81718d-2e3a-4ebd-9a2b-f3fb247549de tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IicowWqU'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:27:25 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:27:25 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f8ad7ba-4084-4cd7-920f-8f7948de4212 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:27:25 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f8ad7ba-4084-4cd7-920f-8f7948de4212 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:27:25 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[d37218b8-4f65-4b20-899e-61c7138cd195]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:27:25 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c81718d-2e3a-4ebd-9a2b-f3fb247549de tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:27:25 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:27:25 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:27:25 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[c86d539d-666b-40a1-b6f9-e5fcea80b7fc]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133098b2-106a-427f-aa6d-2c10625dd152 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:448cd30a-3852-471f-903f-a2e5abc34b55 (non-flash)\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:27:25 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c81718d-2e3a-4ebd-9a2b-f3fb247549de tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)
Aug 26 10:27:25 user nova-compute[73572]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133098b2-106a-427f-aa6d-2c10625dd152 (non-flash)
Aug 26 10:27:25 user nova-compute[73572]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:448cd30a-3852-471f-903f-a2e5abc34b55 (non-flash)
Aug 26 10:27:25 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 10:27:25 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c81718d-2e3a-4ebd-9a2b-f3fb247549de tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)
Aug 26 10:27:25 user nova-compute[73572]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133098b2-106a-427f-aa6d-2c10625dd152 (non-flash)
Aug 26 10:27:25 user nova-compute[73572]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:448cd30a-3852-471f-903f-a2e5abc34b55 (non-flash)
Aug 26 10:27:25 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 10:27:25 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f8ad7ba-4084-4cd7-920f-8f7948de4212 -p 172.16.0.220:3260 --login {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:27:25 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f8ad7ba-4084-4cd7-920f-8f7948de4212 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:27:25 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[7941d861-69f5-46ae-b6ad-95b1ffd271d8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8f8ad7ba-4084-4cd7-920f-8f7948de4212, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8f8ad7ba-4084-4cd7-920f-8f7948de4212, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:27:25 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c81718d-2e3a-4ebd-9a2b-f3fb247549de tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8f8ad7ba-4084-4cd7-920f-8f7948de4212, portal: 172.16.0.220,3260]
Aug 26 10:27:25 user nova-compute[73572]: Login to [iface: default, target: iqn.2010-10.org.openstack:8f8ad7ba-4084-4cd7-920f-8f7948de4212, portal: 172.16.0.220,3260] successful.
Aug 26 10:27:25 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:27:25 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f8ad7ba-4084-4cd7-920f-8f7948de4212 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:27:25 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f8ad7ba-4084-4cd7-920f-8f7948de4212 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:27:25 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[81789ab4-110b-487a-992e-a3730227e749]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:27:25 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c81718d-2e3a-4ebd-9a2b-f3fb247549de tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:27:25 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:27:25 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:27:25 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c4b2222-53e6-458c-aeb9-c74b06a0ad58]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133098b2-106a-427f-aa6d-2c10625dd152 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:448cd30a-3852-471f-903f-a2e5abc34b55 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f8ad7ba-4084-4cd7-920f-8f7948de4212 (non-flash)\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:27:25 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c81718d-2e3a-4ebd-9a2b-f3fb247549de tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)
Aug 26 10:27:25 user nova-compute[73572]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133098b2-106a-427f-aa6d-2c10625dd152 (non-flash)
Aug 26 10:27:25 user nova-compute[73572]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:448cd30a-3852-471f-903f-a2e5abc34b55 (non-flash)
Aug 26 10:27:25 user nova-compute[73572]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f8ad7ba-4084-4cd7-920f-8f7948de4212 (non-flash)
Aug 26 10:27:25 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 10:27:25 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c81718d-2e3a-4ebd-9a2b-f3fb247549de tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)
Aug 26 10:27:25 user nova-compute[73572]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133098b2-106a-427f-aa6d-2c10625dd152 (non-flash)
Aug 26 10:27:25 user nova-compute[73572]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:448cd30a-3852-471f-903f-a2e5abc34b55 (non-flash)
Aug 26 10:27:25 user nova-compute[73572]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f8ad7ba-4084-4cd7-920f-8f7948de4212 (non-flash)
Aug 26 10:27:25 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 10:27:25 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-9c81718d-2e3a-4ebd-9a2b-f3fb247549de tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8f8ad7ba-4084-4cd7-920f-8f7948de4212" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.315s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 10:27:25 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c81718d-2e3a-4ebd-9a2b-f3fb247549de tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Connected to 172.16.0.220:3260 {{(pid=73572) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 10:27:25 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-9c81718d-2e3a-4ebd-9a2b-f3fb247549de tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] HCTL ('34', '-', '-', 0) found on session 39 with lun 0 {{(pid=73572) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 10:27:25 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-9c81718d-2e3a-4ebd-9a2b-f3fb247549de tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73572) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 10:27:25 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:27:25 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:27:25 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[d79a5089-19ee-49b8-abe2-07098813a473]: (4, ('- - 0', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:27:25 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-9c81718d-2e3a-4ebd-9a2b-f3fb247549de tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Searching for a device in session 39 and hctl ['34', '*', '*', 0] yield: None {{(pid=73572) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 10:27:25 user nova-compute[73572]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693045630.620725, 6b2d5f4e-37af-438c-859b-d4ca803b7d08 => Stopped> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:27:25 user nova-compute[73572]: INFO nova.compute.manager [-] [instance: 6b2d5f4e-37af-438c-859b-d4ca803b7d08] VM Stopped (Lifecycle Event)
Aug 26 10:27:25 user nova-compute[73572]: DEBUG nova.compute.manager [None req-d5b396c5-927d-4233-9fa0-4bbc8d97bca7 None None] [instance: 6b2d5f4e-37af-438c-859b-d4ca803b7d08] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:27:25 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:27:26 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-9c81718d-2e3a-4ebd-9a2b-f3fb247549de tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Searching for a device in session 39 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73572) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 10:27:26 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c81718d-2e3a-4ebd-9a2b-f3fb247549de tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IicowWqU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73572) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 10:27:26 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-9c81718d-2e3a-4ebd-9a2b-f3fb247549de tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.345s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 10:27:26 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c81718d-2e3a-4ebd-9a2b-f3fb247549de tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] <== connect_volume: return (1347ms) {'type': 'block', 'scsi_wwn': '23932323866653231', 'path': '/dev/sdc'} {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 10:27:26 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9c81718d-2e3a-4ebd-9a2b-f3fb247549de tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] [instance: 6b2d5f4e-37af-438c-859b-d4ca803b7d08] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23932323866653231', 'path': '/dev/sdc'} {{(pid=73572) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 10:27:26 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-9ca19798-f9a3-4ca1-89ff-3e658df150b4 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.217s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 10:27:26 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ca19798-f9a3-4ca1-89ff-3e658df150b4 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:21602e43-35ed-4842-aa13-f04aca4243f2', 0)] {{(pid=73572) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 10:27:26 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:27:26 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:27:26 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9777b5e-79c7-4feb-9ee9-96511614a52c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:133098b2-106a-427f-aa6d-2c10625dd152\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:448cd30a-3852-471f-903f-a2e5abc34b55\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8f8ad7ba-4084-4cd7-920f-8f7948de4212\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:27:26 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:27:26 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-9c81718d-2e3a-4ebd-9a2b-f3fb247549de tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-26T10:25:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-665480809',display_name='tempest-ServerActionsTestOtherA-server-1892262121',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-665480809',id=35,image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO0nFuNIAmrcfF466dgWUoupbXiGxPDsRpOPU+BV/xU9so0Ahdwm8Jau8//ZWYq9Zw/pxbXy2f1pHOKtRMmBUc3daXPj1Sj1rpkWaf2AN4lE7ndY37vYFGh9kavZVJ2YNQ==',key_name='tempest-keypair-586663623',keypairs=<?>,launch_index=0,launched_at=2023-08-26T10:25:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='7935bccc360b46b589fd57d53f334595',ramdisk_id='',reservation_id='r-2h5gmgf0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-203628695',owner_user_name='tempest-ServerActionsTestOtherA-203628695-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T10:27:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='61b6124f6f6e44c5b2fd0202a15da019',uuid=6b2d5f4e-37af-438c-859b-d4ca803b7d08,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bf886914-b734-4957-9e48-4ef3d65c61f4", "address": "fa:16:3e:b4:aa:52", "network": {"id": "43215883-3d00-4be7-8c40-bdaf3f01bef9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1088544153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7935bccc360b46b589fd57d53f334595", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf886914-b7", "ovs_interfaceid": "bf886914-b734-4957-9e48-4ef3d65c61f4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73572) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 10:27:26 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-9c81718d-2e3a-4ebd-9a2b-f3fb247549de tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Converting VIF {"id": "bf886914-b734-4957-9e48-4ef3d65c61f4", "address": "fa:16:3e:b4:aa:52", "network": {"id": "43215883-3d00-4be7-8c40-bdaf3f01bef9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1088544153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7935bccc360b46b589fd57d53f334595", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf886914-b7", "ovs_interfaceid": "bf886914-b734-4957-9e48-4ef3d65c61f4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:27:26 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-9c81718d-2e3a-4ebd-9a2b-f3fb247549de tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b4:aa:52,bridge_name='br-int',has_traffic_filtering=True,id=bf886914-b734-4957-9e48-4ef3d65c61f4,network=Network(43215883-3d00-4be7-8c40-bdaf3f01bef9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf886914-b7') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:27:26 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-9c81718d-2e3a-4ebd-9a2b-f3fb247549de tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] [instance: 6b2d5f4e-37af-438c-859b-d4ca803b7d08] End _get_guest_xml xml=<domain type="kvm">
Aug 26 10:27:26 user nova-compute[73572]:   <uuid>6b2d5f4e-37af-438c-859b-d4ca803b7d08</uuid>
Aug 26 10:27:26 user nova-compute[73572]:   <name>instance-00000023</name>
Aug 26 10:27:26 user nova-compute[73572]:   <memory>524288</memory>
Aug 26 10:27:26 user nova-compute[73572]:   <vcpu>1</vcpu>
Aug 26 10:27:26 user nova-compute[73572]:   <metadata>
Aug 26 10:27:26 user nova-compute[73572]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 10:27:26 user nova-compute[73572]:       <nova:package version="0.0.0"/>
Aug 26 10:27:26 user nova-compute[73572]:       <nova:name>tempest-ServerActionsTestOtherA-server-1892262121</nova:name>
Aug 26 10:27:26 user nova-compute[73572]:       <nova:creationTime>2023-08-26 10:27:24</nova:creationTime>
Aug 26 10:27:26 user nova-compute[73572]:       <nova:flavor name="m1.tiny">
Aug 26 10:27:26 user nova-compute[73572]:         <nova:memory>512</nova:memory>
Aug 26 10:27:26 user nova-compute[73572]:         <nova:disk>1</nova:disk>
Aug 26 10:27:26 user nova-compute[73572]:         <nova:swap>0</nova:swap>
Aug 26 10:27:26 user nova-compute[73572]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 10:27:26 user nova-compute[73572]:         <nova:vcpus>1</nova:vcpus>
Aug 26 10:27:26 user nova-compute[73572]:       </nova:flavor>
Aug 26 10:27:26 user nova-compute[73572]:       <nova:owner>
Aug 26 10:27:26 user nova-compute[73572]:         <nova:user uuid="61b6124f6f6e44c5b2fd0202a15da019">tempest-ServerActionsTestOtherA-203628695-project-member</nova:user>
Aug 26 10:27:26 user nova-compute[73572]:         <nova:project uuid="7935bccc360b46b589fd57d53f334595">tempest-ServerActionsTestOtherA-203628695</nova:project>
Aug 26 10:27:26 user nova-compute[73572]:       </nova:owner>
Aug 26 10:27:26 user nova-compute[73572]:       <nova:root type="image" uuid="299da0c9-e1c4-48f0-be55-fbe20dd06bc9"/>
Aug 26 10:27:26 user nova-compute[73572]:       <nova:ports>
Aug 26 10:27:26 user nova-compute[73572]:         <nova:port uuid="bf886914-b734-4957-9e48-4ef3d65c61f4">
Aug 26 10:27:26 user nova-compute[73572]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 26 10:27:26 user nova-compute[73572]:         </nova:port>
Aug 26 10:27:26 user nova-compute[73572]:       </nova:ports>
Aug 26 10:27:26 user nova-compute[73572]:     </nova:instance>
Aug 26 10:27:26 user nova-compute[73572]:   </metadata>
Aug 26 10:27:26 user nova-compute[73572]:   <sysinfo type="smbios">
Aug 26 10:27:26 user nova-compute[73572]:     <system>
Aug 26 10:27:26 user nova-compute[73572]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 10:27:26 user nova-compute[73572]:       <entry name="product">OpenStack Nova</entry>
Aug 26 10:27:26 user nova-compute[73572]:       <entry name="version">0.0.0</entry>
Aug 26 10:27:26 user nova-compute[73572]:       <entry name="serial">6b2d5f4e-37af-438c-859b-d4ca803b7d08</entry>
Aug 26 10:27:26 user nova-compute[73572]:       <entry name="uuid">6b2d5f4e-37af-438c-859b-d4ca803b7d08</entry>
Aug 26 10:27:26 user nova-compute[73572]:       <entry name="family">Virtual Machine</entry>
Aug 26 10:27:26 user nova-compute[73572]:     </system>
Aug 26 10:27:26 user nova-compute[73572]:   </sysinfo>
Aug 26 10:27:26 user nova-compute[73572]:   <os>
Aug 26 10:27:26 user nova-compute[73572]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 10:27:26 user nova-compute[73572]:     <boot dev="hd"/>
Aug 26 10:27:26 user nova-compute[73572]:     <smbios mode="sysinfo"/>
Aug 26 10:27:26 user nova-compute[73572]:   </os>
Aug 26 10:27:26 user nova-compute[73572]:   <features>
Aug 26 10:27:26 user nova-compute[73572]:     <acpi/>
Aug 26 10:27:26 user nova-compute[73572]:     <apic/>
Aug 26 10:27:26 user nova-compute[73572]:     <vmcoreinfo/>
Aug 26 10:27:26 user nova-compute[73572]:   </features>
Aug 26 10:27:26 user nova-compute[73572]:   <clock offset="utc">
Aug 26 10:27:26 user nova-compute[73572]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 10:27:26 user nova-compute[73572]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 10:27:26 user nova-compute[73572]:     <timer name="hpet" present="no"/>
Aug 26 10:27:26 user nova-compute[73572]:   </clock>
Aug 26 10:27:26 user nova-compute[73572]:   <cpu mode="custom" match="exact">
Aug 26 10:27:26 user nova-compute[73572]:     <model>Nehalem</model>
Aug 26 10:27:26 user nova-compute[73572]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 10:27:26 user nova-compute[73572]:   </cpu>
Aug 26 10:27:26 user nova-compute[73572]:   <devices>
Aug 26 10:27:26 user nova-compute[73572]:     <disk type="file" device="disk">
Aug 26 10:27:26 user nova-compute[73572]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 10:27:26 user nova-compute[73572]:       <source file="/opt/stack/data/nova/instances/6b2d5f4e-37af-438c-859b-d4ca803b7d08/disk"/>
Aug 26 10:27:26 user nova-compute[73572]:       <target dev="vda" bus="virtio"/>
Aug 26 10:27:26 user nova-compute[73572]:     </disk>
Aug 26 10:27:26 user nova-compute[73572]:     <disk type="block" device="disk">
Aug 26 10:27:26 user nova-compute[73572]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 10:27:26 user nova-compute[73572]:       <source dev="/dev/sdc"/>
Aug 26 10:27:26 user nova-compute[73572]:       <target dev="vdb" bus="virtio"/>
Aug 26 10:27:26 user nova-compute[73572]:       <serial>8f8ad7ba-4084-4cd7-920f-8f7948de4212</serial>
Aug 26 10:27:26 user nova-compute[73572]:     </disk>
Aug 26 10:27:26 user nova-compute[73572]:     <interface type="ethernet">
Aug 26 10:27:26 user nova-compute[73572]:       <mac address="fa:16:3e:b4:aa:52"/>
Aug 26 10:27:26 user nova-compute[73572]:       <model type="virtio"/>
Aug 26 10:27:26 user nova-compute[73572]:       <mtu size="1442"/>
Aug 26 10:27:26 user nova-compute[73572]:       <target dev="tapbf886914-b7"/>
Aug 26 10:27:26 user nova-compute[73572]:     </interface>
Aug 26 10:27:26 user nova-compute[73572]:     <serial type="pty">
Aug 26 10:27:26 user nova-compute[73572]:       <log file="/opt/stack/data/nova/instances/6b2d5f4e-37af-438c-859b-d4ca803b7d08/console.log" append="off"/>
Aug 26 10:27:26 user nova-compute[73572]:     </serial>
Aug 26 10:27:26 user nova-compute[73572]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 10:27:26 user nova-compute[73572]:     <video>
Aug 26 10:27:26 user nova-compute[73572]:       <model type="virtio"/>
Aug 26 10:27:26 user nova-compute[73572]:     </video>
Aug 26 10:27:26 user nova-compute[73572]:     <rng model="virtio">
Aug 26 10:27:26 user nova-compute[73572]:       <backend model="random">/dev/urandom</backend>
Aug 26 10:27:26 user nova-compute[73572]:     </rng>
Aug 26 10:27:26 user nova-compute[73572]:     <controller type="usb" index="0" model="none"/>
Aug 26 10:27:26 user nova-compute[73572]:     <memballoon model="virtio">
Aug 26 10:27:26 user nova-compute[73572]:       <stats period="10"/>
Aug 26 10:27:26 user nova-compute[73572]:     </memballoon>
Aug 26 10:27:26 user nova-compute[73572]:   </devices>
Aug 26 10:27:26 user nova-compute[73572]: </domain>
Aug 26 10:27:26 user nova-compute[73572]:  {{(pid=73572) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 10:27:26 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-9c81718d-2e3a-4ebd-9a2b-f3fb247549de tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-26T10:25:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-665480809',display_name='tempest-ServerActionsTestOtherA-server-1892262121',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-665480809',id=35,image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO0nFuNIAmrcfF466dgWUoupbXiGxPDsRpOPU+BV/xU9so0Ahdwm8Jau8//ZWYq9Zw/pxbXy2f1pHOKtRMmBUc3daXPj1Sj1rpkWaf2AN4lE7ndY37vYFGh9kavZVJ2YNQ==',key_name='tempest-keypair-586663623',keypairs=<?>,launch_index=0,launched_at=2023-08-26T10:25:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='7935bccc360b46b589fd57d53f334595',ramdisk_id='',reservation_id='r-2h5gmgf0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-203628695',owner_user_name='tempest-ServerActionsTestOtherA-203628695-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T10:27:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='61b6124f6f6e44c5b2fd0202a15da019',uuid=6b2d5f4e-37af-438c-859b-d4ca803b7d08,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bf886914-b734-4957-9e48-4ef3d65c61f4", "address": "fa:16:3e:b4:aa:52", "network": {"id": "43215883-3d00-4be7-8c40-bdaf3f01bef9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1088544153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7935bccc360b46b589fd57d53f334595", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf886914-b7", "ovs_interfaceid": "bf886914-b734-4957-9e48-4ef3d65c61f4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 10:27:26 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-9c81718d-2e3a-4ebd-9a2b-f3fb247549de tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Converting VIF {"id": "bf886914-b734-4957-9e48-4ef3d65c61f4", "address": "fa:16:3e:b4:aa:52", "network": {"id": "43215883-3d00-4be7-8c40-bdaf3f01bef9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1088544153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7935bccc360b46b589fd57d53f334595", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf886914-b7", "ovs_interfaceid": "bf886914-b734-4957-9e48-4ef3d65c61f4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:27:26 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-9c81718d-2e3a-4ebd-9a2b-f3fb247549de tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b4:aa:52,bridge_name='br-int',has_traffic_filtering=True,id=bf886914-b734-4957-9e48-4ef3d65c61f4,network=Network(43215883-3d00-4be7-8c40-bdaf3f01bef9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf886914-b7') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:27:26 user nova-compute[73572]: DEBUG os_vif [None req-9c81718d-2e3a-4ebd-9a2b-f3fb247549de tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b4:aa:52,bridge_name='br-int',has_traffic_filtering=True,id=bf886914-b734-4957-9e48-4ef3d65c61f4,network=Network(43215883-3d00-4be7-8c40-bdaf3f01bef9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf886914-b7') {{(pid=73572) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 10:27:26 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:27:26 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:27:26 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 10:27:26 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:27:26 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbf886914-b7, may_exist=True, interface_attrs={}) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:27:26 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapbf886914-b7, col_values=(('external_ids', {'iface-id': 'bf886914-b734-4957-9e48-4ef3d65c61f4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b4:aa:52', 'vm-uuid': '6b2d5f4e-37af-438c-859b-d4ca803b7d08'}),), if_exists=True) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:27:26 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:27:26 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[a416f9c7-0e3c-42a9-aeb5-240081dad8c2]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133098b2-106a-427f-aa6d-2c10625dd152 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:448cd30a-3852-471f-903f-a2e5abc34b55 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f8ad7ba-4084-4cd7-920f-8f7948de4212 (non-flash)\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:27:26 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ca19798-f9a3-4ca1-89ff-3e658df150b4 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)
Aug 26 10:27:26 user nova-compute[73572]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133098b2-106a-427f-aa6d-2c10625dd152 (non-flash)
Aug 26 10:27:26 user nova-compute[73572]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:448cd30a-3852-471f-903f-a2e5abc34b55 (non-flash)
Aug 26 10:27:26 user nova-compute[73572]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f8ad7ba-4084-4cd7-920f-8f7948de4212 (non-flash)
Aug 26 10:27:26 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 10:27:26 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ca19798-f9a3-4ca1-89ff-3e658df150b4 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)
Aug 26 10:27:26 user nova-compute[73572]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133098b2-106a-427f-aa6d-2c10625dd152 (non-flash)
Aug 26 10:27:26 user nova-compute[73572]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:448cd30a-3852-471f-903f-a2e5abc34b55 (non-flash)
Aug 26 10:27:26 user nova-compute[73572]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f8ad7ba-4084-4cd7-920f-8f7948de4212 (non-flash)
Aug 26 10:27:26 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 10:27:26 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ca19798-f9a3-4ca1-89ff-3e658df150b4 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc89c569630>, {}) {{(pid=73572) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 10:27:26 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ca19798-f9a3-4ca1-89ff-3e658df150b4 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Disconnecting from: [] {{(pid=73572) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 10:27:26 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-9ca19798-f9a3-4ca1-89ff-3e658df150b4 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.055s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 10:27:26 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ca19798-f9a3-4ca1-89ff-3e658df150b4 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] <== disconnect_volume: return (1272ms) None {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 10:27:26 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ca19798-f9a3-4ca1-89ff-3e658df150b4 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] [instance: 6422ce7d-9348-48b2-9af0-ec322d482d2b] Disconnected iSCSI Volume {{(pid=73572) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 10:27:26 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-9ca19798-f9a3-4ca1-89ff-3e658df150b4 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] [instance: 6422ce7d-9348-48b2-9af0-ec322d482d2b] Deleting instance files /opt/stack/data/nova/instances/6422ce7d-9348-48b2-9af0-ec322d482d2b_del
Aug 26 10:27:26 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-9ca19798-f9a3-4ca1-89ff-3e658df150b4 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] [instance: 6422ce7d-9348-48b2-9af0-ec322d482d2b] Deletion of /opt/stack/data/nova/instances/6422ce7d-9348-48b2-9af0-ec322d482d2b_del complete
Aug 26 10:27:26 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:27:26 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:27:26 user nova-compute[73572]: INFO os_vif [None req-9c81718d-2e3a-4ebd-9a2b-f3fb247549de tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b4:aa:52,bridge_name='br-int',has_traffic_filtering=True,id=bf886914-b734-4957-9e48-4ef3d65c61f4,network=Network(43215883-3d00-4be7-8c40-bdaf3f01bef9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf886914-b7')
Aug 26 10:27:26 user nova-compute[73572]: INFO nova.compute.manager [None req-9ca19798-f9a3-4ca1-89ff-3e658df150b4 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] [instance: 6422ce7d-9348-48b2-9af0-ec322d482d2b] Took 2.20 seconds to destroy the instance on the hypervisor.
Aug 26 10:27:26 user nova-compute[73572]: DEBUG oslo.service.loopingcall [None req-9ca19798-f9a3-4ca1-89ff-3e658df150b4 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73572) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 10:27:26 user nova-compute[73572]: DEBUG nova.compute.manager [-] [instance: 6422ce7d-9348-48b2-9af0-ec322d482d2b] Deallocating network for instance {{(pid=73572) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 10:27:26 user nova-compute[73572]: DEBUG nova.network.neutron [-] [instance: 6422ce7d-9348-48b2-9af0-ec322d482d2b] deallocate_for_instance() {{(pid=73572) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 10:27:26 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-9c81718d-2e3a-4ebd-9a2b-f3fb247549de tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] No BDM found with device name vda, not building metadata. {{(pid=73572) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 10:27:26 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-9c81718d-2e3a-4ebd-9a2b-f3fb247549de tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73572) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 10:27:26 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-9c81718d-2e3a-4ebd-9a2b-f3fb247549de tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] No VIF found with MAC fa:16:3e:b4:aa:52, not building metadata {{(pid=73572) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 10:27:26 user nova-compute[73572]: DEBUG nova.compute.manager [req-633a3ba8-bd25-400b-80de-3bc63c6633d8 req-aaf9f8da-964d-44ad-a270-1b9ce74a79f3 service nova] [instance: 6422ce7d-9348-48b2-9af0-ec322d482d2b] Received event network-vif-plugged-f995916a-1a71-47ac-9abd-2a24136e4981 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:27:26 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-633a3ba8-bd25-400b-80de-3bc63c6633d8 req-aaf9f8da-964d-44ad-a270-1b9ce74a79f3 service nova] Acquiring lock "6422ce7d-9348-48b2-9af0-ec322d482d2b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:27:26 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-633a3ba8-bd25-400b-80de-3bc63c6633d8 req-aaf9f8da-964d-44ad-a270-1b9ce74a79f3 service nova] Lock "6422ce7d-9348-48b2-9af0-ec322d482d2b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:27:26 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-633a3ba8-bd25-400b-80de-3bc63c6633d8 req-aaf9f8da-964d-44ad-a270-1b9ce74a79f3 service nova] Lock "6422ce7d-9348-48b2-9af0-ec322d482d2b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:27:26 user nova-compute[73572]: DEBUG nova.compute.manager [req-633a3ba8-bd25-400b-80de-3bc63c6633d8 req-aaf9f8da-964d-44ad-a270-1b9ce74a79f3 service nova] [instance: 6422ce7d-9348-48b2-9af0-ec322d482d2b] No waiting events found dispatching network-vif-plugged-f995916a-1a71-47ac-9abd-2a24136e4981 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:27:26 user nova-compute[73572]: WARNING nova.compute.manager [req-633a3ba8-bd25-400b-80de-3bc63c6633d8 req-aaf9f8da-964d-44ad-a270-1b9ce74a79f3 service nova] [instance: 6422ce7d-9348-48b2-9af0-ec322d482d2b] Received unexpected event network-vif-plugged-f995916a-1a71-47ac-9abd-2a24136e4981 for instance with vm_state active and task_state deleting.
Aug 26 10:27:26 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:27:27 user nova-compute[73572]: DEBUG nova.network.neutron [-] [instance: 6422ce7d-9348-48b2-9af0-ec322d482d2b] Updating instance_info_cache with network_info: [] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:27:27 user nova-compute[73572]: INFO nova.compute.manager [-] [instance: 6422ce7d-9348-48b2-9af0-ec322d482d2b] Took 1.02 seconds to deallocate network for instance.
Aug 26 10:27:27 user nova-compute[73572]: WARNING nova.volume.cinder [None req-9ca19798-f9a3-4ca1-89ff-3e658df150b4 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Attachment 7d792b13-0b35-4cd2-99cf-d3617a6d2ae2 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 7d792b13-0b35-4cd2-99cf-d3617a6d2ae2. (HTTP 404) (Request-ID: req-ece347da-5124-40cf-9820-809ab2877c7d)
Aug 26 10:27:27 user nova-compute[73572]: INFO nova.compute.manager [None req-9ca19798-f9a3-4ca1-89ff-3e658df150b4 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] [instance: 6422ce7d-9348-48b2-9af0-ec322d482d2b] Took 0.03 seconds to detach 1 volumes for instance.
Aug 26 10:27:27 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9ca19798-f9a3-4ca1-89ff-3e658df150b4 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:27:27 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9ca19798-f9a3-4ca1-89ff-3e658df150b4 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:27:27 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:27:27 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:27:27 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:27:28 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:27:28 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:27:28 user nova-compute[73572]: DEBUG nova.compute.provider_tree [None req-9ca19798-f9a3-4ca1-89ff-3e658df150b4 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Inventory has not changed in ProviderTree for provider: e2cec974-59b2-4c77-a53d-a7f4e5a30d75 {{(pid=73572) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 10:27:28 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-9ca19798-f9a3-4ca1-89ff-3e658df150b4 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Inventory has not changed for provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73572) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 10:27:28 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9ca19798-f9a3-4ca1-89ff-3e658df150b4 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.465s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:27:28 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.276s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:27:28 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:27:28 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Auditing locally available compute resources for user (node: user) {{(pid=73572) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 10:27:28 user nova-compute[73572]: INFO nova.scheduler.client.report [None req-9ca19798-f9a3-4ca1-89ff-3e658df150b4 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Deleted allocations for instance 6422ce7d-9348-48b2-9af0-ec322d482d2b
Aug 26 10:27:28 user nova-compute[73572]: DEBUG nova.compute.manager [req-61c78d62-1a6a-4853-bcba-6931116101b6 req-2e07d33d-5d4c-4083-8afc-53b7c9aeeef2 service nova] [instance: 6b2d5f4e-37af-438c-859b-d4ca803b7d08] Received event network-vif-plugged-bf886914-b734-4957-9e48-4ef3d65c61f4 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:27:28 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-61c78d62-1a6a-4853-bcba-6931116101b6 req-2e07d33d-5d4c-4083-8afc-53b7c9aeeef2 service nova] Acquiring lock "6b2d5f4e-37af-438c-859b-d4ca803b7d08-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:27:28 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-61c78d62-1a6a-4853-bcba-6931116101b6 req-2e07d33d-5d4c-4083-8afc-53b7c9aeeef2 service nova] Lock "6b2d5f4e-37af-438c-859b-d4ca803b7d08-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:27:28 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-61c78d62-1a6a-4853-bcba-6931116101b6 req-2e07d33d-5d4c-4083-8afc-53b7c9aeeef2 service nova] Lock "6b2d5f4e-37af-438c-859b-d4ca803b7d08-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:27:28 user nova-compute[73572]: DEBUG nova.compute.manager [req-61c78d62-1a6a-4853-bcba-6931116101b6 req-2e07d33d-5d4c-4083-8afc-53b7c9aeeef2 service nova] [instance: 6b2d5f4e-37af-438c-859b-d4ca803b7d08] No waiting events found dispatching network-vif-plugged-bf886914-b734-4957-9e48-4ef3d65c61f4 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:27:28 user nova-compute[73572]: WARNING nova.compute.manager [req-61c78d62-1a6a-4853-bcba-6931116101b6 req-2e07d33d-5d4c-4083-8afc-53b7c9aeeef2 service nova] [instance: 6b2d5f4e-37af-438c-859b-d4ca803b7d08] Received unexpected event network-vif-plugged-bf886914-b734-4957-9e48-4ef3d65c61f4 for instance with vm_state active and task_state rebuild_spawning.
Aug 26 10:27:28 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:27:28 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:27:28 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9ca19798-f9a3-4ca1-89ff-3e658df150b4 tempest-VolumesSnapshotTestJSON-760064238 tempest-VolumesSnapshotTestJSON-760064238-project-member] Lock "6422ce7d-9348-48b2-9af0-ec322d482d2b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.937s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:27:28 user nova-compute[73572]: DEBUG nova.compute.manager [req-6f7c3cc4-6748-4ee2-9f4c-2776003a214e req-0883d47d-65e7-4bed-b3e7-99b9bfb7e0b1 service nova] [instance: 6422ce7d-9348-48b2-9af0-ec322d482d2b] Received event network-vif-deleted-f995916a-1a71-47ac-9abd-2a24136e4981 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:27:29 user nova-compute[73572]: INFO nova.compute.manager [None req-15a6313d-80a5-4d3f-9bff-24af0d2e7705 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: 8a8816e5-696d-4384-b0e0-29aa7cdd957c] Unrescuing
Aug 26 10:27:29 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-15a6313d-80a5-4d3f-9bff-24af0d2e7705 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Acquiring lock "refresh_cache-8a8816e5-696d-4384-b0e0-29aa7cdd957c" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:27:29 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-15a6313d-80a5-4d3f-9bff-24af0d2e7705 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Acquired lock "refresh_cache-8a8816e5-696d-4384-b0e0-29aa7cdd957c" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:27:29 user nova-compute[73572]: DEBUG nova.network.neutron [None req-15a6313d-80a5-4d3f-9bff-24af0d2e7705 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: 8a8816e5-696d-4384-b0e0-29aa7cdd957c] Building network info cache for instance {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 10:27:30 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:27:30 user nova-compute[73572]: DEBUG nova.virt.driver [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Emitting event <LifecycleEvent: 1693045650.2409685, 6b2d5f4e-37af-438c-859b-d4ca803b7d08 => Resumed> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:27:30 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 6b2d5f4e-37af-438c-859b-d4ca803b7d08] VM Resumed (Lifecycle Event)
Aug 26 10:27:30 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9c81718d-2e3a-4ebd-9a2b-f3fb247549de tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] [instance: 6b2d5f4e-37af-438c-859b-d4ca803b7d08] Instance event wait completed in 0 seconds for  {{(pid=73572) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 10:27:30 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-9c81718d-2e3a-4ebd-9a2b-f3fb247549de tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] [instance: 6b2d5f4e-37af-438c-859b-d4ca803b7d08] Guest created on hypervisor {{(pid=73572) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 10:27:30 user nova-compute[73572]: INFO nova.virt.libvirt.driver [-] [instance: 6b2d5f4e-37af-438c-859b-d4ca803b7d08] Instance spawned successfully.
Aug 26 10:27:30 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-9c81718d-2e3a-4ebd-9a2b-f3fb247549de tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] [instance: 6b2d5f4e-37af-438c-859b-d4ca803b7d08] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 10:27:30 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 6b2d5f4e-37af-438c-859b-d4ca803b7d08] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:27:30 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 6b2d5f4e-37af-438c-859b-d4ca803b7d08] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=73572) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 10:27:30 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-9c81718d-2e3a-4ebd-9a2b-f3fb247549de tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] [instance: 6b2d5f4e-37af-438c-859b-d4ca803b7d08] Found default for hw_cdrom_bus of ide {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:27:30 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-9c81718d-2e3a-4ebd-9a2b-f3fb247549de tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] [instance: 6b2d5f4e-37af-438c-859b-d4ca803b7d08] Found default for hw_disk_bus of virtio {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:27:30 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-9c81718d-2e3a-4ebd-9a2b-f3fb247549de tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] [instance: 6b2d5f4e-37af-438c-859b-d4ca803b7d08] Found default for hw_input_bus of None {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:27:30 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-9c81718d-2e3a-4ebd-9a2b-f3fb247549de tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] [instance: 6b2d5f4e-37af-438c-859b-d4ca803b7d08] Found default for hw_pointer_model of None {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:27:30 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-9c81718d-2e3a-4ebd-9a2b-f3fb247549de tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] [instance: 6b2d5f4e-37af-438c-859b-d4ca803b7d08] Found default for hw_video_model of virtio {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:27:30 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-9c81718d-2e3a-4ebd-9a2b-f3fb247549de tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] [instance: 6b2d5f4e-37af-438c-859b-d4ca803b7d08] Found default for hw_vif_model of virtio {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:27:30 user nova-compute[73572]: DEBUG nova.network.neutron [None req-15a6313d-80a5-4d3f-9bff-24af0d2e7705 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: 8a8816e5-696d-4384-b0e0-29aa7cdd957c] Updating instance_info_cache with network_info: [{"id": "2e650fb9-427c-477e-ba45-ddc070399617", "address": "fa:16:3e:6c:94:14", "network": {"id": "991b9dff-5173-4456-a530-b1f7eb5cfa4a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1845930297-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4636f93c5bfc4653804de097aed2882c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e650fb9-42", "ovs_interfaceid": "2e650fb9-427c-477e-ba45-ddc070399617", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:27:30 user nova-compute[73572]: DEBUG nova.compute.manager [req-a68b2613-474f-4f6e-b82f-e355db093d04 req-ed853525-2fdd-4fec-b1c9-9892e359ec25 service nova] [instance: 6b2d5f4e-37af-438c-859b-d4ca803b7d08] Received event network-vif-plugged-bf886914-b734-4957-9e48-4ef3d65c61f4 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:27:30 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-a68b2613-474f-4f6e-b82f-e355db093d04 req-ed853525-2fdd-4fec-b1c9-9892e359ec25 service nova] Acquiring lock "6b2d5f4e-37af-438c-859b-d4ca803b7d08-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:27:30 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-a68b2613-474f-4f6e-b82f-e355db093d04 req-ed853525-2fdd-4fec-b1c9-9892e359ec25 service nova] Lock "6b2d5f4e-37af-438c-859b-d4ca803b7d08-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:27:30 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-a68b2613-474f-4f6e-b82f-e355db093d04 req-ed853525-2fdd-4fec-b1c9-9892e359ec25 service nova] Lock "6b2d5f4e-37af-438c-859b-d4ca803b7d08-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:27:30 user nova-compute[73572]: DEBUG nova.compute.manager [req-a68b2613-474f-4f6e-b82f-e355db093d04 req-ed853525-2fdd-4fec-b1c9-9892e359ec25 service nova] [instance: 6b2d5f4e-37af-438c-859b-d4ca803b7d08] No waiting events found dispatching network-vif-plugged-bf886914-b734-4957-9e48-4ef3d65c61f4 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:27:30 user nova-compute[73572]: WARNING nova.compute.manager [req-a68b2613-474f-4f6e-b82f-e355db093d04 req-ed853525-2fdd-4fec-b1c9-9892e359ec25 service nova] [instance: 6b2d5f4e-37af-438c-859b-d4ca803b7d08] Received unexpected event network-vif-plugged-bf886914-b734-4957-9e48-4ef3d65c61f4 for instance with vm_state active and task_state rebuild_spawning.
Aug 26 10:27:30 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 6b2d5f4e-37af-438c-859b-d4ca803b7d08] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 26 10:27:30 user nova-compute[73572]: DEBUG nova.virt.driver [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Emitting event <LifecycleEvent: 1693045650.2448583, 6b2d5f4e-37af-438c-859b-d4ca803b7d08 => Started> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:27:30 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 6b2d5f4e-37af-438c-859b-d4ca803b7d08] VM Started (Lifecycle Event)
Aug 26 10:27:30 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-15a6313d-80a5-4d3f-9bff-24af0d2e7705 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Releasing lock "refresh_cache-8a8816e5-696d-4384-b0e0-29aa7cdd957c" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:27:30 user nova-compute[73572]: DEBUG nova.objects.instance [None req-15a6313d-80a5-4d3f-9bff-24af0d2e7705 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Lazy-loading 'flavor' on Instance uuid 8a8816e5-696d-4384-b0e0-29aa7cdd957c {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:27:30 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 6b2d5f4e-37af-438c-859b-d4ca803b7d08] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:27:30 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9c81718d-2e3a-4ebd-9a2b-f3fb247549de tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] [instance: 6b2d5f4e-37af-438c-859b-d4ca803b7d08] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:27:30 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 6b2d5f4e-37af-438c-859b-d4ca803b7d08] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=73572) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 10:27:30 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 6b2d5f4e-37af-438c-859b-d4ca803b7d08] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 26 10:27:30 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9c81718d-2e3a-4ebd-9a2b-f3fb247549de tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:27:30 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9c81718d-2e3a-4ebd-9a2b-f3fb247549de tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:27:30 user nova-compute[73572]: DEBUG nova.objects.instance [None req-9c81718d-2e3a-4ebd-9a2b-f3fb247549de tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] [instance: 6b2d5f4e-37af-438c-859b-d4ca803b7d08] Trying to apply a migration context that does not seem to be set for this instance {{(pid=73572) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1078}}
Aug 26 10:27:30 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:27:30 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:27:30 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6004b15a-be01-42eb-92ba-ae9d93dab708/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:27:30 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9c81718d-2e3a-4ebd-9a2b-f3fb247549de tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.144s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:27:31 user nova-compute[73572]: DEBUG nova.compute.manager [req-36a53e16-70c0-4bec-808b-fa31c842891f req-085bee9d-dd49-4d77-8336-0ca11126f2ad service nova] [instance: 8a8816e5-696d-4384-b0e0-29aa7cdd957c] Received event network-vif-unplugged-2e650fb9-427c-477e-ba45-ddc070399617 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:27:31 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-36a53e16-70c0-4bec-808b-fa31c842891f req-085bee9d-dd49-4d77-8336-0ca11126f2ad service nova] Acquiring lock "8a8816e5-696d-4384-b0e0-29aa7cdd957c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:27:31 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-36a53e16-70c0-4bec-808b-fa31c842891f req-085bee9d-dd49-4d77-8336-0ca11126f2ad service nova] Lock "8a8816e5-696d-4384-b0e0-29aa7cdd957c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:27:31 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-36a53e16-70c0-4bec-808b-fa31c842891f req-085bee9d-dd49-4d77-8336-0ca11126f2ad service nova] Lock "8a8816e5-696d-4384-b0e0-29aa7cdd957c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:27:31 user nova-compute[73572]: DEBUG nova.compute.manager [req-36a53e16-70c0-4bec-808b-fa31c842891f req-085bee9d-dd49-4d77-8336-0ca11126f2ad service nova] [instance: 8a8816e5-696d-4384-b0e0-29aa7cdd957c] No waiting events found dispatching network-vif-unplugged-2e650fb9-427c-477e-ba45-ddc070399617 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:27:31 user nova-compute[73572]: WARNING nova.compute.manager [req-36a53e16-70c0-4bec-808b-fa31c842891f req-085bee9d-dd49-4d77-8336-0ca11126f2ad service nova] [instance: 8a8816e5-696d-4384-b0e0-29aa7cdd957c] Received unexpected event network-vif-unplugged-2e650fb9-427c-477e-ba45-ddc070399617 for instance with vm_state rescued and task_state unrescuing.
Aug 26 10:27:31 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6004b15a-be01-42eb-92ba-ae9d93dab708/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:27:31 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6004b15a-be01-42eb-92ba-ae9d93dab708/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:27:31 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:27:31 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6004b15a-be01-42eb-92ba-ae9d93dab708/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:27:31 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b2d5f4e-37af-438c-859b-d4ca803b7d08/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:27:31 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:27:31 user nova-compute[73572]: INFO nova.virt.libvirt.driver [-] [instance: 8a8816e5-696d-4384-b0e0-29aa7cdd957c] Instance destroyed successfully.
Aug 26 10:27:31 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b2d5f4e-37af-438c-859b-d4ca803b7d08/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:27:31 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b2d5f4e-37af-438c-859b-d4ca803b7d08/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:27:31 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b2d5f4e-37af-438c-859b-d4ca803b7d08/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:27:31 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73572) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 10:27:31 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86923c1a-89a5-4e7a-b488-8bf3a013bf83/disk.rescue --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:27:31 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86923c1a-89a5-4e7a-b488-8bf3a013bf83/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:27:31 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86923c1a-89a5-4e7a-b488-8bf3a013bf83/disk.rescue --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:27:32 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86923c1a-89a5-4e7a-b488-8bf3a013bf83/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:27:32 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86923c1a-89a5-4e7a-b488-8bf3a013bf83/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:27:32 user nova-compute[73572]: DEBUG nova.compute.manager [req-a05e3d6d-5f4c-4f49-b3e0-358f12326ec8 req-c8c2f34f-a85f-498e-8b48-ccfd80266f84 service nova] [instance: 6004b15a-be01-42eb-92ba-ae9d93dab708] Received event network-changed-8c801229-2284-4cd5-bdce-45c96edfe633 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:27:32 user nova-compute[73572]: DEBUG nova.compute.manager [req-a05e3d6d-5f4c-4f49-b3e0-358f12326ec8 req-c8c2f34f-a85f-498e-8b48-ccfd80266f84 service nova] [instance: 6004b15a-be01-42eb-92ba-ae9d93dab708] Refreshing instance network info cache due to event network-changed-8c801229-2284-4cd5-bdce-45c96edfe633. {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 10:27:32 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-a05e3d6d-5f4c-4f49-b3e0-358f12326ec8 req-c8c2f34f-a85f-498e-8b48-ccfd80266f84 service nova] Acquiring lock "refresh_cache-6004b15a-be01-42eb-92ba-ae9d93dab708" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:27:32 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-a05e3d6d-5f4c-4f49-b3e0-358f12326ec8 req-c8c2f34f-a85f-498e-8b48-ccfd80266f84 service nova] Acquired lock "refresh_cache-6004b15a-be01-42eb-92ba-ae9d93dab708" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:27:32 user nova-compute[73572]: DEBUG nova.network.neutron [req-a05e3d6d-5f4c-4f49-b3e0-358f12326ec8 req-c8c2f34f-a85f-498e-8b48-ccfd80266f84 service nova] [instance: 6004b15a-be01-42eb-92ba-ae9d93dab708] Refreshing network info cache for port 8c801229-2284-4cd5-bdce-45c96edfe633 {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 10:27:32 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86923c1a-89a5-4e7a-b488-8bf3a013bf83/disk --force-share --output=json" returned: 0 in 0.255s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:27:32 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86923c1a-89a5-4e7a-b488-8bf3a013bf83/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:27:32 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86923c1a-89a5-4e7a-b488-8bf3a013bf83/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:27:32 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c785b609-0068-442f-91f5-d26e888a993f/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:27:32 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c785b609-0068-442f-91f5-d26e888a993f/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:27:32 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c785b609-0068-442f-91f5-d26e888a993f/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:27:32 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:27:32 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:27:33 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c785b609-0068-442f-91f5-d26e888a993f/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:27:33 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e468b473-515f-41ad-a75c-65d4c6d575c8/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:27:33 user nova-compute[73572]: DEBUG nova.compute.manager [req-3c67fe5c-3676-424f-b0cb-3b71a6e27909 req-fab0294c-5b2e-408f-a16c-123c6e0d4ab8 service nova] [instance: 8a8816e5-696d-4384-b0e0-29aa7cdd957c] Received event network-vif-plugged-2e650fb9-427c-477e-ba45-ddc070399617 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:27:33 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-3c67fe5c-3676-424f-b0cb-3b71a6e27909 req-fab0294c-5b2e-408f-a16c-123c6e0d4ab8 service nova] Acquiring lock "8a8816e5-696d-4384-b0e0-29aa7cdd957c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:27:33 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-3c67fe5c-3676-424f-b0cb-3b71a6e27909 req-fab0294c-5b2e-408f-a16c-123c6e0d4ab8 service nova] Lock "8a8816e5-696d-4384-b0e0-29aa7cdd957c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:27:33 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-3c67fe5c-3676-424f-b0cb-3b71a6e27909 req-fab0294c-5b2e-408f-a16c-123c6e0d4ab8 service nova] Lock "8a8816e5-696d-4384-b0e0-29aa7cdd957c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:27:33 user nova-compute[73572]: DEBUG nova.compute.manager [req-3c67fe5c-3676-424f-b0cb-3b71a6e27909 req-fab0294c-5b2e-408f-a16c-123c6e0d4ab8 service nova] [instance: 8a8816e5-696d-4384-b0e0-29aa7cdd957c] No waiting events found dispatching network-vif-plugged-2e650fb9-427c-477e-ba45-ddc070399617 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:27:33 user nova-compute[73572]: WARNING nova.compute.manager [req-3c67fe5c-3676-424f-b0cb-3b71a6e27909 req-fab0294c-5b2e-408f-a16c-123c6e0d4ab8 service nova] [instance: 8a8816e5-696d-4384-b0e0-29aa7cdd957c] Received unexpected event network-vif-plugged-2e650fb9-427c-477e-ba45-ddc070399617 for instance with vm_state rescued and task_state unrescuing.
Aug 26 10:27:33 user nova-compute[73572]: DEBUG nova.network.neutron [req-a05e3d6d-5f4c-4f49-b3e0-358f12326ec8 req-c8c2f34f-a85f-498e-8b48-ccfd80266f84 service nova] [instance: 6004b15a-be01-42eb-92ba-ae9d93dab708] Updated VIF entry in instance network info cache for port 8c801229-2284-4cd5-bdce-45c96edfe633. {{(pid=73572) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 10:27:33 user nova-compute[73572]: DEBUG nova.network.neutron [req-a05e3d6d-5f4c-4f49-b3e0-358f12326ec8 req-c8c2f34f-a85f-498e-8b48-ccfd80266f84 service nova] [instance: 6004b15a-be01-42eb-92ba-ae9d93dab708] Updating instance_info_cache with network_info: [{"id": "8c801229-2284-4cd5-bdce-45c96edfe633", "address": "fa:16:3e:5a:0e:fa", "network": {"id": "317d2681-96ce-4898-b6fb-8892ee6f706d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2049963835-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7e16843614c451d958e817c832d4cbc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c801229-22", "ovs_interfaceid": "8c801229-2284-4cd5-bdce-45c96edfe633", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:27:33 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-a05e3d6d-5f4c-4f49-b3e0-358f12326ec8 req-c8c2f34f-a85f-498e-8b48-ccfd80266f84 service nova] Releasing lock "refresh_cache-6004b15a-be01-42eb-92ba-ae9d93dab708" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:27:33 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:27:33 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e468b473-515f-41ad-a75c-65d4c6d575c8/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:27:33 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e468b473-515f-41ad-a75c-65d4c6d575c8/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:27:33 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e468b473-515f-41ad-a75c-65d4c6d575c8/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:27:33 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d03d1626-e18b-4b15-a679-4543f7641ed7/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:27:33 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d03d1626-e18b-4b15-a679-4543f7641ed7/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:27:33 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d03d1626-e18b-4b15-a679-4543f7641ed7/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:27:33 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d03d1626-e18b-4b15-a679-4543f7641ed7/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:27:33 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73572) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 10:27:33 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bb0f50b-c8fb-4961-99c0-ca2b6b1768cd/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:27:34 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bb0f50b-c8fb-4961-99c0-ca2b6b1768cd/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:27:34 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bb0f50b-c8fb-4961-99c0-ca2b6b1768cd/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:27:34 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bb0f50b-c8fb-4961-99c0-ca2b6b1768cd/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:27:34 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=73572) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 10:27:34 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68613b1e-c45c-4fd9-834c-3630ed0f456a/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:27:34 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68613b1e-c45c-4fd9-834c-3630ed0f456a/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:27:34 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68613b1e-c45c-4fd9-834c-3630ed0f456a/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:27:34 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68613b1e-c45c-4fd9-834c-3630ed0f456a/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:27:34 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2eaea7c2-a5c0-4950-b033-0012b5cec0ee/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:27:34 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2eaea7c2-a5c0-4950-b033-0012b5cec0ee/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:27:34 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2eaea7c2-a5c0-4950-b033-0012b5cec0ee/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:27:35 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Removed pending event for 8a8816e5-696d-4384-b0e0-29aa7cdd957c due to event {{(pid=73572) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 26 10:27:35 user nova-compute[73572]: DEBUG nova.virt.driver [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Emitting event <LifecycleEvent: 1693045655.0974607, 8a8816e5-696d-4384-b0e0-29aa7cdd957c => Resumed> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:27:35 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 8a8816e5-696d-4384-b0e0-29aa7cdd957c] VM Resumed (Lifecycle Event)
Aug 26 10:27:35 user nova-compute[73572]: DEBUG nova.compute.manager [None req-15a6313d-80a5-4d3f-9bff-24af0d2e7705 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: 8a8816e5-696d-4384-b0e0-29aa7cdd957c] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:27:35 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 8a8816e5-696d-4384-b0e0-29aa7cdd957c] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:27:35 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2eaea7c2-a5c0-4950-b033-0012b5cec0ee/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:27:35 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 8a8816e5-696d-4384-b0e0-29aa7cdd957c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73572) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 10:27:35 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=73572) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 10:27:35 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f3db0fa-682c-4b33-966b-9e50b7349b6e/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:27:35 user nova-compute[73572]: DEBUG nova.compute.manager [req-08024f7b-e124-497d-9a52-d9791507a35a req-c135d913-290a-4fd2-af1e-e8bea4549de6 service nova] [instance: 8a8816e5-696d-4384-b0e0-29aa7cdd957c] Received event network-vif-plugged-2e650fb9-427c-477e-ba45-ddc070399617 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:27:35 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-08024f7b-e124-497d-9a52-d9791507a35a req-c135d913-290a-4fd2-af1e-e8bea4549de6 service nova] Acquiring lock "8a8816e5-696d-4384-b0e0-29aa7cdd957c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:27:35 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-08024f7b-e124-497d-9a52-d9791507a35a req-c135d913-290a-4fd2-af1e-e8bea4549de6 service nova] Lock "8a8816e5-696d-4384-b0e0-29aa7cdd957c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:27:35 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-08024f7b-e124-497d-9a52-d9791507a35a req-c135d913-290a-4fd2-af1e-e8bea4549de6 service nova] Lock "8a8816e5-696d-4384-b0e0-29aa7cdd957c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:27:35 user nova-compute[73572]: DEBUG nova.compute.manager [req-08024f7b-e124-497d-9a52-d9791507a35a req-c135d913-290a-4fd2-af1e-e8bea4549de6 service nova] [instance: 8a8816e5-696d-4384-b0e0-29aa7cdd957c] No waiting events found dispatching network-vif-plugged-2e650fb9-427c-477e-ba45-ddc070399617 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:27:35 user nova-compute[73572]: WARNING nova.compute.manager [req-08024f7b-e124-497d-9a52-d9791507a35a req-c135d913-290a-4fd2-af1e-e8bea4549de6 service nova] [instance: 8a8816e5-696d-4384-b0e0-29aa7cdd957c] Received unexpected event network-vif-plugged-2e650fb9-427c-477e-ba45-ddc070399617 for instance with vm_state rescued and task_state unrescuing.
Aug 26 10:27:35 user nova-compute[73572]: DEBUG nova.compute.manager [req-08024f7b-e124-497d-9a52-d9791507a35a req-c135d913-290a-4fd2-af1e-e8bea4549de6 service nova] [instance: 8a8816e5-696d-4384-b0e0-29aa7cdd957c] Received event network-vif-plugged-2e650fb9-427c-477e-ba45-ddc070399617 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:27:35 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-08024f7b-e124-497d-9a52-d9791507a35a req-c135d913-290a-4fd2-af1e-e8bea4549de6 service nova] Acquiring lock "8a8816e5-696d-4384-b0e0-29aa7cdd957c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:27:35 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-08024f7b-e124-497d-9a52-d9791507a35a req-c135d913-290a-4fd2-af1e-e8bea4549de6 service nova] Lock "8a8816e5-696d-4384-b0e0-29aa7cdd957c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:27:35 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-08024f7b-e124-497d-9a52-d9791507a35a req-c135d913-290a-4fd2-af1e-e8bea4549de6 service nova] Lock "8a8816e5-696d-4384-b0e0-29aa7cdd957c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:27:35 user nova-compute[73572]: DEBUG nova.compute.manager [req-08024f7b-e124-497d-9a52-d9791507a35a req-c135d913-290a-4fd2-af1e-e8bea4549de6 service nova] [instance: 8a8816e5-696d-4384-b0e0-29aa7cdd957c] No waiting events found dispatching network-vif-plugged-2e650fb9-427c-477e-ba45-ddc070399617 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:27:35 user nova-compute[73572]: WARNING nova.compute.manager [req-08024f7b-e124-497d-9a52-d9791507a35a req-c135d913-290a-4fd2-af1e-e8bea4549de6 service nova] [instance: 8a8816e5-696d-4384-b0e0-29aa7cdd957c] Received unexpected event network-vif-plugged-2e650fb9-427c-477e-ba45-ddc070399617 for instance with vm_state rescued and task_state unrescuing.
Aug 26 10:27:35 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 8a8816e5-696d-4384-b0e0-29aa7cdd957c] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 26 10:27:35 user nova-compute[73572]: DEBUG nova.virt.driver [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Emitting event <LifecycleEvent: 1693045655.1012926, 8a8816e5-696d-4384-b0e0-29aa7cdd957c => Started> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:27:35 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 8a8816e5-696d-4384-b0e0-29aa7cdd957c] VM Started (Lifecycle Event)
Aug 26 10:27:35 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:27:35 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 8a8816e5-696d-4384-b0e0-29aa7cdd957c] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:27:35 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 8a8816e5-696d-4384-b0e0-29aa7cdd957c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73572) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 10:27:35 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f3db0fa-682c-4b33-966b-9e50b7349b6e/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:27:35 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f3db0fa-682c-4b33-966b-9e50b7349b6e/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:27:35 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f3db0fa-682c-4b33-966b-9e50b7349b6e/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:27:36 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:27:36 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:27:36 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Hypervisor/Node resource view: name=user free_ram=7097MB free_disk=24.95993423461914GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=73572) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 10:27:36 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:27:36 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:27:36 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance c785b609-0068-442f-91f5-d26e888a993f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:27:36 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance 14fab12e-52be-4fe6-8777-bc7ebf3c25f1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:27:36 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance 2eaea7c2-a5c0-4950-b033-0012b5cec0ee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:27:36 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance 86923c1a-89a5-4e7a-b488-8bf3a013bf83 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:27:36 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance e468b473-515f-41ad-a75c-65d4c6d575c8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:27:36 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance 68613b1e-c45c-4fd9-834c-3630ed0f456a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:27:36 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance 1f3db0fa-682c-4b33-966b-9e50b7349b6e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:27:36 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance 8a8816e5-696d-4384-b0e0-29aa7cdd957c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:27:36 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance 6b2d5f4e-37af-438c-859b-d4ca803b7d08 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:27:36 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance 6004b15a-be01-42eb-92ba-ae9d93dab708 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:27:36 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance 8bb0f50b-c8fb-4961-99c0-ca2b6b1768cd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:27:36 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance f3fe3865-3d85-46cf-b24f-10b07e23aeff actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:27:36 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance d03d1626-e18b-4b15-a679-4543f7641ed7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:27:36 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=73572) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 10:27:36 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=73572) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 10:27:36 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Refreshing inventories for resource provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 {{(pid=73572) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 26 10:27:36 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:27:36 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Updating ProviderTree inventory for provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73572) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 26 10:27:36 user nova-compute[73572]: DEBUG nova.compute.provider_tree [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Updating inventory in ProviderTree for provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73572) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 26 10:27:36 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Refreshing aggregate associations for resource provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75, aggregates: None {{(pid=73572) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 26 10:27:36 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Refreshing trait associations for resource provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75, traits: COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSSE3,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE2,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NODE,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_NE2K_PCI {{(pid=73572) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 26 10:27:36 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-39c0e71b-7453-4d30-b38e-21260556736b tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Acquiring lock "6004b15a-be01-42eb-92ba-ae9d93dab708" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:27:36 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-39c0e71b-7453-4d30-b38e-21260556736b tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Lock "6004b15a-be01-42eb-92ba-ae9d93dab708" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:27:36 user nova-compute[73572]: INFO nova.compute.manager [None req-39c0e71b-7453-4d30-b38e-21260556736b tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] [instance: 6004b15a-be01-42eb-92ba-ae9d93dab708] Shelving
Aug 26 10:27:36 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:27:36 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:27:36 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:27:37 user nova-compute[73572]: DEBUG nova.compute.provider_tree [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Inventory has not changed in ProviderTree for provider: e2cec974-59b2-4c77-a53d-a7f4e5a30d75 {{(pid=73572) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 10:27:37 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Inventory has not changed for provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73572) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 10:27:37 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Compute_service record updated for user:user {{(pid=73572) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 10:27:37 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.971s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:27:37 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:27:37 user nova-compute[73572]: DEBUG nova.compute.manager [req-e6a401b3-a011-4104-85f3-7e3851374f33 req-82c3c3d2-b771-4339-8f6b-37bac878580d service nova] [instance: 6004b15a-be01-42eb-92ba-ae9d93dab708] Received event network-vif-unplugged-8c801229-2284-4cd5-bdce-45c96edfe633 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:27:37 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-e6a401b3-a011-4104-85f3-7e3851374f33 req-82c3c3d2-b771-4339-8f6b-37bac878580d service nova] Acquiring lock "6004b15a-be01-42eb-92ba-ae9d93dab708-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:27:37 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-e6a401b3-a011-4104-85f3-7e3851374f33 req-82c3c3d2-b771-4339-8f6b-37bac878580d service nova] Lock "6004b15a-be01-42eb-92ba-ae9d93dab708-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:27:37 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-e6a401b3-a011-4104-85f3-7e3851374f33 req-82c3c3d2-b771-4339-8f6b-37bac878580d service nova] Lock "6004b15a-be01-42eb-92ba-ae9d93dab708-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:27:37 user nova-compute[73572]: DEBUG nova.compute.manager [req-e6a401b3-a011-4104-85f3-7e3851374f33 req-82c3c3d2-b771-4339-8f6b-37bac878580d service nova] [instance: 6004b15a-be01-42eb-92ba-ae9d93dab708] No waiting events found dispatching network-vif-unplugged-8c801229-2284-4cd5-bdce-45c96edfe633 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:27:37 user nova-compute[73572]: WARNING nova.compute.manager [req-e6a401b3-a011-4104-85f3-7e3851374f33 req-82c3c3d2-b771-4339-8f6b-37bac878580d service nova] [instance: 6004b15a-be01-42eb-92ba-ae9d93dab708] Received unexpected event network-vif-unplugged-8c801229-2284-4cd5-bdce-45c96edfe633 for instance with vm_state active and task_state shelving.
Aug 26 10:27:37 user nova-compute[73572]: INFO nova.virt.libvirt.driver [-] [instance: 6004b15a-be01-42eb-92ba-ae9d93dab708] Instance destroyed successfully.
Aug 26 10:27:37 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-39c0e71b-7453-4d30-b38e-21260556736b tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] [instance: 6004b15a-be01-42eb-92ba-ae9d93dab708] Beginning cold snapshot process
Aug 26 10:27:37 user nova-compute[73572]: DEBUG nova.privsep.utils [None req-39c0e71b-7453-4d30-b38e-21260556736b tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73572) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 26 10:27:37 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-39c0e71b-7453-4d30-b38e-21260556736b tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/6004b15a-be01-42eb-92ba-ae9d93dab708/disk /opt/stack/data/nova/instances/snapshots/tmpvwdaot8z/16d47f38ce45460d97de1bdce1422b0d {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:27:38 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-39c0e71b-7453-4d30-b38e-21260556736b tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/6004b15a-be01-42eb-92ba-ae9d93dab708/disk /opt/stack/data/nova/instances/snapshots/tmpvwdaot8z/16d47f38ce45460d97de1bdce1422b0d" returned: 0 in 0.536s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:27:38 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-39c0e71b-7453-4d30-b38e-21260556736b tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] [instance: 6004b15a-be01-42eb-92ba-ae9d93dab708] Snapshot extracted, beginning image upload
Aug 26 10:27:39 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:27:39 user nova-compute[73572]: DEBUG nova.compute.manager [req-a3514a08-0405-46ac-aced-49708fde335d req-6242f12f-4709-4eb1-8f8d-968d4635afcc service nova] [instance: 6004b15a-be01-42eb-92ba-ae9d93dab708] Received event network-vif-plugged-8c801229-2284-4cd5-bdce-45c96edfe633 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:27:39 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-a3514a08-0405-46ac-aced-49708fde335d req-6242f12f-4709-4eb1-8f8d-968d4635afcc service nova] Acquiring lock "6004b15a-be01-42eb-92ba-ae9d93dab708-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:27:39 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-a3514a08-0405-46ac-aced-49708fde335d req-6242f12f-4709-4eb1-8f8d-968d4635afcc service nova] Lock "6004b15a-be01-42eb-92ba-ae9d93dab708-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:27:39 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-a3514a08-0405-46ac-aced-49708fde335d req-6242f12f-4709-4eb1-8f8d-968d4635afcc service nova] Lock "6004b15a-be01-42eb-92ba-ae9d93dab708-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:27:39 user nova-compute[73572]: DEBUG nova.compute.manager [req-a3514a08-0405-46ac-aced-49708fde335d req-6242f12f-4709-4eb1-8f8d-968d4635afcc service nova] [instance: 6004b15a-be01-42eb-92ba-ae9d93dab708] No waiting events found dispatching network-vif-plugged-8c801229-2284-4cd5-bdce-45c96edfe633 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:27:39 user nova-compute[73572]: WARNING nova.compute.manager [req-a3514a08-0405-46ac-aced-49708fde335d req-6242f12f-4709-4eb1-8f8d-968d4635afcc service nova] [instance: 6004b15a-be01-42eb-92ba-ae9d93dab708] Received unexpected event network-vif-plugged-8c801229-2284-4cd5-bdce-45c96edfe633 for instance with vm_state active and task_state shelving_image_uploading.
Aug 26 10:27:39 user nova-compute[73572]: DEBUG nova.compute.manager [req-a3514a08-0405-46ac-aced-49708fde335d req-6242f12f-4709-4eb1-8f8d-968d4635afcc service nova] [instance: 8bb0f50b-c8fb-4961-99c0-ca2b6b1768cd] Received event network-changed-e78ed806-3f29-444e-b7d5-d0c9ba2b06aa {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:27:39 user nova-compute[73572]: DEBUG nova.compute.manager [req-a3514a08-0405-46ac-aced-49708fde335d req-6242f12f-4709-4eb1-8f8d-968d4635afcc service nova] [instance: 8bb0f50b-c8fb-4961-99c0-ca2b6b1768cd] Refreshing instance network info cache due to event network-changed-e78ed806-3f29-444e-b7d5-d0c9ba2b06aa. {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 10:27:39 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-a3514a08-0405-46ac-aced-49708fde335d req-6242f12f-4709-4eb1-8f8d-968d4635afcc service nova] Acquiring lock "refresh_cache-8bb0f50b-c8fb-4961-99c0-ca2b6b1768cd" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:27:39 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-a3514a08-0405-46ac-aced-49708fde335d req-6242f12f-4709-4eb1-8f8d-968d4635afcc service nova] Acquired lock "refresh_cache-8bb0f50b-c8fb-4961-99c0-ca2b6b1768cd" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:27:39 user nova-compute[73572]: DEBUG nova.network.neutron [req-a3514a08-0405-46ac-aced-49708fde335d req-6242f12f-4709-4eb1-8f8d-968d4635afcc service nova] [instance: 8bb0f50b-c8fb-4961-99c0-ca2b6b1768cd] Refreshing network info cache for port e78ed806-3f29-444e-b7d5-d0c9ba2b06aa {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 10:27:39 user nova-compute[73572]: DEBUG nova.network.neutron [req-a3514a08-0405-46ac-aced-49708fde335d req-6242f12f-4709-4eb1-8f8d-968d4635afcc service nova] [instance: 8bb0f50b-c8fb-4961-99c0-ca2b6b1768cd] Updated VIF entry in instance network info cache for port e78ed806-3f29-444e-b7d5-d0c9ba2b06aa. {{(pid=73572) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 10:27:39 user nova-compute[73572]: DEBUG nova.network.neutron [req-a3514a08-0405-46ac-aced-49708fde335d req-6242f12f-4709-4eb1-8f8d-968d4635afcc service nova] [instance: 8bb0f50b-c8fb-4961-99c0-ca2b6b1768cd] Updating instance_info_cache with network_info: [{"id": "e78ed806-3f29-444e-b7d5-d0c9ba2b06aa", "address": "fa:16:3e:4a:d9:27", "network": {"id": "81543fb3-a8fe-4e9c-8180-c65fa4dcc9e1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-469390371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "084df935eab842e58bad79afad7090f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape78ed806-3f", "ovs_interfaceid": "e78ed806-3f29-444e-b7d5-d0c9ba2b06aa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:27:39 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-a3514a08-0405-46ac-aced-49708fde335d req-6242f12f-4709-4eb1-8f8d-968d4635afcc service nova] Releasing lock "refresh_cache-8bb0f50b-c8fb-4961-99c0-ca2b6b1768cd" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:27:40 user nova-compute[73572]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693045645.1470554, 6422ce7d-9348-48b2-9af0-ec322d482d2b => Stopped> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:27:40 user nova-compute[73572]: INFO nova.compute.manager [-] [instance: 6422ce7d-9348-48b2-9af0-ec322d482d2b] VM Stopped (Lifecycle Event)
Aug 26 10:27:40 user nova-compute[73572]: DEBUG nova.compute.manager [None req-ca6bd5b3-09b2-4024-bdce-883c0fc13196 None None] [instance: 6422ce7d-9348-48b2-9af0-ec322d482d2b] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:27:40 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:27:41 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-39c0e71b-7453-4d30-b38e-21260556736b tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] [instance: 6004b15a-be01-42eb-92ba-ae9d93dab708] Snapshot image upload complete
Aug 26 10:27:41 user nova-compute[73572]: DEBUG nova.compute.manager [None req-39c0e71b-7453-4d30-b38e-21260556736b tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] [instance: 6004b15a-be01-42eb-92ba-ae9d93dab708] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:27:41 user nova-compute[73572]: INFO nova.compute.manager [None req-39c0e71b-7453-4d30-b38e-21260556736b tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] [instance: 6004b15a-be01-42eb-92ba-ae9d93dab708] Shelve offloading
Aug 26 10:27:41 user nova-compute[73572]: INFO nova.virt.libvirt.driver [-] [instance: 6004b15a-be01-42eb-92ba-ae9d93dab708] Instance destroyed successfully.
Aug 26 10:27:41 user nova-compute[73572]: DEBUG nova.compute.manager [None req-39c0e71b-7453-4d30-b38e-21260556736b tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] [instance: 6004b15a-be01-42eb-92ba-ae9d93dab708] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:27:41 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-39c0e71b-7453-4d30-b38e-21260556736b tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Acquiring lock "refresh_cache-6004b15a-be01-42eb-92ba-ae9d93dab708" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:27:41 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-39c0e71b-7453-4d30-b38e-21260556736b tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Acquired lock "refresh_cache-6004b15a-be01-42eb-92ba-ae9d93dab708" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:27:41 user nova-compute[73572]: DEBUG nova.network.neutron [None req-39c0e71b-7453-4d30-b38e-21260556736b tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] [instance: 6004b15a-be01-42eb-92ba-ae9d93dab708] Building network info cache for instance {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 10:27:41 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:27:41 user nova-compute[73572]: DEBUG nova.network.neutron [None req-39c0e71b-7453-4d30-b38e-21260556736b tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] [instance: 6004b15a-be01-42eb-92ba-ae9d93dab708] Updating instance_info_cache with network_info: [{"id": "8c801229-2284-4cd5-bdce-45c96edfe633", "address": "fa:16:3e:5a:0e:fa", "network": {"id": "317d2681-96ce-4898-b6fb-8892ee6f706d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2049963835-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7e16843614c451d958e817c832d4cbc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c801229-22", "ovs_interfaceid": "8c801229-2284-4cd5-bdce-45c96edfe633", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:27:41 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-39c0e71b-7453-4d30-b38e-21260556736b tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Releasing lock "refresh_cache-6004b15a-be01-42eb-92ba-ae9d93dab708" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:27:42 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:27:42 user nova-compute[73572]: INFO nova.virt.libvirt.driver [-] [instance: 6004b15a-be01-42eb-92ba-ae9d93dab708] Instance destroyed successfully.
Aug 26 10:27:42 user nova-compute[73572]: DEBUG nova.objects.instance [None req-39c0e71b-7453-4d30-b38e-21260556736b tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Lazy-loading 'resources' on Instance uuid 6004b15a-be01-42eb-92ba-ae9d93dab708 {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:27:42 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-39c0e71b-7453-4d30-b38e-21260556736b tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T10:25:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-166680841',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-166680841',id=36,image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEWBTOS0AHv6z8RWaiABqHulvjrbLaR96xRD15E/r0t/2UB9/kL95/Qkv/M3GvF6W0m+wG/rQ4SeVcwMM5A26UfTmnRR7kQj+Z+7W0aLcHEsnrsN1N0vrrqZEDPZaXipgQ==',key_name='tempest-keypair-1985542231',keypairs=<?>,launch_index=0,launched_at=2023-08-26T10:25:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='c7e16843614c451d958e817c832d4cbc',ramdisk_id='',reservation_id='r-xx7zocnt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-706965180',owner_user_name='tempest-AttachVolumeShelveTestJSON-706965180-project-member',shelved_at='2023-08-26T10:27:41.022388',shelved_host='user',shelved_image_id='26cc70a1-8b04-41ca-a800-4e3d44b1d424'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T10:27:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='17243251fe57431c9c98195a16239c5f',uuid=6004b15a-be01-42eb-92ba-ae9d93dab708,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "8c801229-2284-4cd5-bdce-45c96edfe633", "address": "fa:16:3e:5a:0e:fa", "network": {"id": "317d2681-96ce-4898-b6fb-8892ee6f706d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2049963835-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7e16843614c451d958e817c832d4cbc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c801229-22", "ovs_interfaceid": "8c801229-2284-4cd5-bdce-45c96edfe633", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 10:27:42 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-39c0e71b-7453-4d30-b38e-21260556736b tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Converting VIF {"id": "8c801229-2284-4cd5-bdce-45c96edfe633", "address": "fa:16:3e:5a:0e:fa", "network": {"id": "317d2681-96ce-4898-b6fb-8892ee6f706d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2049963835-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7e16843614c451d958e817c832d4cbc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c801229-22", "ovs_interfaceid": "8c801229-2284-4cd5-bdce-45c96edfe633", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:27:42 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-39c0e71b-7453-4d30-b38e-21260556736b tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:0e:fa,bridge_name='br-int',has_traffic_filtering=True,id=8c801229-2284-4cd5-bdce-45c96edfe633,network=Network(317d2681-96ce-4898-b6fb-8892ee6f706d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c801229-22') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:27:42 user nova-compute[73572]: DEBUG os_vif [None req-39c0e71b-7453-4d30-b38e-21260556736b tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:0e:fa,bridge_name='br-int',has_traffic_filtering=True,id=8c801229-2284-4cd5-bdce-45c96edfe633,network=Network(317d2681-96ce-4898-b6fb-8892ee6f706d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c801229-22') {{(pid=73572) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 10:27:42 user nova-compute[73572]: DEBUG nova.compute.manager [req-a799b92f-ea65-4603-bd0f-be0f835c7165 req-f90c1dfc-5c26-44ce-8d6a-41f0007e803d service nova] [instance: 6004b15a-be01-42eb-92ba-ae9d93dab708] Received event network-changed-8c801229-2284-4cd5-bdce-45c96edfe633 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:27:42 user nova-compute[73572]: DEBUG nova.compute.manager [req-a799b92f-ea65-4603-bd0f-be0f835c7165 req-f90c1dfc-5c26-44ce-8d6a-41f0007e803d service nova] [instance: 6004b15a-be01-42eb-92ba-ae9d93dab708] Refreshing instance network info cache due to event network-changed-8c801229-2284-4cd5-bdce-45c96edfe633. {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 10:27:42 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-a799b92f-ea65-4603-bd0f-be0f835c7165 req-f90c1dfc-5c26-44ce-8d6a-41f0007e803d service nova] Acquiring lock "refresh_cache-6004b15a-be01-42eb-92ba-ae9d93dab708" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:27:42 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-a799b92f-ea65-4603-bd0f-be0f835c7165 req-f90c1dfc-5c26-44ce-8d6a-41f0007e803d service nova] Acquired lock "refresh_cache-6004b15a-be01-42eb-92ba-ae9d93dab708" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:27:42 user nova-compute[73572]: DEBUG nova.network.neutron [req-a799b92f-ea65-4603-bd0f-be0f835c7165 req-f90c1dfc-5c26-44ce-8d6a-41f0007e803d service nova] [instance: 6004b15a-be01-42eb-92ba-ae9d93dab708] Refreshing network info cache for port 8c801229-2284-4cd5-bdce-45c96edfe633 {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 10:27:42 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:27:42 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8c801229-22, bridge=br-int, if_exists=True) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:27:42 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:27:42 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:27:42 user nova-compute[73572]: INFO os_vif [None req-39c0e71b-7453-4d30-b38e-21260556736b tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:0e:fa,bridge_name='br-int',has_traffic_filtering=True,id=8c801229-2284-4cd5-bdce-45c96edfe633,network=Network(317d2681-96ce-4898-b6fb-8892ee6f706d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c801229-22')
Aug 26 10:27:42 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-39c0e71b-7453-4d30-b38e-21260556736b tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] [instance: 6004b15a-be01-42eb-92ba-ae9d93dab708] Deleting instance files /opt/stack/data/nova/instances/6004b15a-be01-42eb-92ba-ae9d93dab708_del
Aug 26 10:27:42 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-39c0e71b-7453-4d30-b38e-21260556736b tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] [instance: 6004b15a-be01-42eb-92ba-ae9d93dab708] Deletion of /opt/stack/data/nova/instances/6004b15a-be01-42eb-92ba-ae9d93dab708_del complete
Aug 26 10:27:42 user nova-compute[73572]: INFO nova.scheduler.client.report [None req-39c0e71b-7453-4d30-b38e-21260556736b tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Deleted allocations for instance 6004b15a-be01-42eb-92ba-ae9d93dab708
Aug 26 10:27:42 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:27:42 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Cleaning up deleted instances {{(pid=73572) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 26 10:27:42 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] There are 0 instances to clean {{(pid=73572) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 26 10:27:42 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-39c0e71b-7453-4d30-b38e-21260556736b tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:27:42 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-39c0e71b-7453-4d30-b38e-21260556736b tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:27:42 user nova-compute[73572]: DEBUG nova.objects.instance [None req-39c0e71b-7453-4d30-b38e-21260556736b tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Lazy-loading 'numa_topology' on Instance uuid 6004b15a-be01-42eb-92ba-ae9d93dab708 {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:27:42 user nova-compute[73572]: DEBUG nova.objects.base [None req-39c0e71b-7453-4d30-b38e-21260556736b tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Object Instance<6004b15a-be01-42eb-92ba-ae9d93dab708> lazy-loaded attributes: resources,numa_topology {{(pid=73572) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 10:27:43 user nova-compute[73572]: DEBUG nova.compute.provider_tree [None req-39c0e71b-7453-4d30-b38e-21260556736b tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Inventory has not changed in ProviderTree for provider: e2cec974-59b2-4c77-a53d-a7f4e5a30d75 {{(pid=73572) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 10:27:43 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-39c0e71b-7453-4d30-b38e-21260556736b tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Inventory has not changed for provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73572) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 10:27:43 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-39c0e71b-7453-4d30-b38e-21260556736b tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.436s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:27:43 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-39c0e71b-7453-4d30-b38e-21260556736b tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Lock "6004b15a-be01-42eb-92ba-ae9d93dab708" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.638s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:27:43 user nova-compute[73572]: DEBUG nova.network.neutron [req-a799b92f-ea65-4603-bd0f-be0f835c7165 req-f90c1dfc-5c26-44ce-8d6a-41f0007e803d service nova] [instance: 6004b15a-be01-42eb-92ba-ae9d93dab708] Updated VIF entry in instance network info cache for port 8c801229-2284-4cd5-bdce-45c96edfe633. {{(pid=73572) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 10:27:43 user nova-compute[73572]: DEBUG nova.network.neutron [req-a799b92f-ea65-4603-bd0f-be0f835c7165 req-f90c1dfc-5c26-44ce-8d6a-41f0007e803d service nova] [instance: 6004b15a-be01-42eb-92ba-ae9d93dab708] Updating instance_info_cache with network_info: [{"id": "8c801229-2284-4cd5-bdce-45c96edfe633", "address": "fa:16:3e:5a:0e:fa", "network": {"id": "317d2681-96ce-4898-b6fb-8892ee6f706d", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-2049963835-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7e16843614c451d958e817c832d4cbc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap8c801229-22", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:27:43 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-a799b92f-ea65-4603-bd0f-be0f835c7165 req-f90c1dfc-5c26-44ce-8d6a-41f0007e803d service nova] Releasing lock "refresh_cache-6004b15a-be01-42eb-92ba-ae9d93dab708" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:27:43 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-4894fa9d-2d66-4954-89b1-b8ae80ed70ed tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Acquiring lock "8bb0f50b-c8fb-4961-99c0-ca2b6b1768cd" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:27:43 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-4894fa9d-2d66-4954-89b1-b8ae80ed70ed tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Lock "8bb0f50b-c8fb-4961-99c0-ca2b6b1768cd" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:27:43 user nova-compute[73572]: DEBUG nova.objects.instance [None req-4894fa9d-2d66-4954-89b1-b8ae80ed70ed tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Lazy-loading 'flavor' on Instance uuid 8bb0f50b-c8fb-4961-99c0-ca2b6b1768cd {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:27:43 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-4894fa9d-2d66-4954-89b1-b8ae80ed70ed tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Lock "8bb0f50b-c8fb-4961-99c0-ca2b6b1768cd" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.088s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:27:43 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-4894fa9d-2d66-4954-89b1-b8ae80ed70ed tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Acquiring lock "8bb0f50b-c8fb-4961-99c0-ca2b6b1768cd" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:27:43 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-4894fa9d-2d66-4954-89b1-b8ae80ed70ed tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Lock "8bb0f50b-c8fb-4961-99c0-ca2b6b1768cd" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:27:43 user nova-compute[73572]: INFO nova.compute.manager [None req-4894fa9d-2d66-4954-89b1-b8ae80ed70ed tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] [instance: 8bb0f50b-c8fb-4961-99c0-ca2b6b1768cd] Attaching volume b2235d5a-9737-4ed6-bb6d-6aa8704db37f to /dev/vdb
Aug 26 10:27:44 user nova-compute[73572]: DEBUG os_brick.utils [None req-4894fa9d-2d66-4954-89b1-b8ae80ed70ed tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 10:27:44 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:27:44 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:27:44 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[800c5bdd-a272-4b54-b98c-2cf5ec5aef33]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:de8a79ed912\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:27:44 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:27:44 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:27:44 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd11a9ce-3cdd-452a-95c5-b85541037806]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:27:44 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:27:44 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:27:44 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d5dc56e-0f8d-4776-8453-d1e5de9a43dd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:27:44 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[9de769cc-7d3e-448a-896e-2965f24b1dc0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:27:44 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-4894fa9d-2d66-4954-89b1-b8ae80ed70ed tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Running cmd (subprocess): nvme version {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:27:44 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-4894fa9d-2d66-4954-89b1-b8ae80ed70ed tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] 'nvme version' failed. Not Retrying. {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 10:27:44 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4894fa9d-2d66-4954-89b1-b8ae80ed70ed tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] nvme not present on system {{(pid=73572) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 10:27:44 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:27:44 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 10:27:44 user nova-compute[73572]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 10:27:44 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[972c7b0d-20bc-4349-9528-ff8ab8a47af9]: (4, '') {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:27:44 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.lightos [None req-4894fa9d-2d66-4954-89b1-b8ae80ed70ed tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73572) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 10:27:44 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.lightos [None req-4894fa9d-2d66-4954-89b1-b8ae80ed70ed tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73572) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 10:27:44 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.lightos [None req-4894fa9d-2d66-4954-89b1-b8ae80ed70ed tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] LIGHTOS: no hostnqn found. {{(pid=73572) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 10:27:44 user nova-compute[73572]: DEBUG os_brick.utils [None req-4894fa9d-2d66-4954-89b1-b8ae80ed70ed tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:de8a79ed912', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 10:27:44 user nova-compute[73572]: DEBUG nova.virt.block_device [None req-4894fa9d-2d66-4954-89b1-b8ae80ed70ed tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] [instance: 8bb0f50b-c8fb-4961-99c0-ca2b6b1768cd] Updating existing volume attachment record: 4dbb79a2-c135-4911-83c5-a456c3fa2f3f {{(pid=73572) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 10:27:45 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:27:47 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-511530b6-3cd7-45a9-9792-66716ba7e572 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Acquiring lock "1f3db0fa-682c-4b33-966b-9e50b7349b6e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:27:47 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-511530b6-3cd7-45a9-9792-66716ba7e572 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Lock "1f3db0fa-682c-4b33-966b-9e50b7349b6e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:27:47 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-511530b6-3cd7-45a9-9792-66716ba7e572 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Acquiring lock "1f3db0fa-682c-4b33-966b-9e50b7349b6e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:27:47 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-511530b6-3cd7-45a9-9792-66716ba7e572 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Lock "1f3db0fa-682c-4b33-966b-9e50b7349b6e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:27:47 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-511530b6-3cd7-45a9-9792-66716ba7e572 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Lock "1f3db0fa-682c-4b33-966b-9e50b7349b6e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:27:47 user nova-compute[73572]: INFO nova.compute.manager [None req-511530b6-3cd7-45a9-9792-66716ba7e572 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] [instance: 1f3db0fa-682c-4b33-966b-9e50b7349b6e] Terminating instance
Aug 26 10:27:47 user nova-compute[73572]: DEBUG nova.compute.manager [None req-511530b6-3cd7-45a9-9792-66716ba7e572 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] [instance: 1f3db0fa-682c-4b33-966b-9e50b7349b6e] Start destroying the instance on the hypervisor. {{(pid=73572) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 10:27:47 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:27:47 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:27:47 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:27:47 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:27:47 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:27:47 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-3b784915-9f22-49b8-b60f-07d035ff8e8c tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Acquiring lock "1c8e780d-0a13-4484-bf18-ac0879db263a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:27:47 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-3b784915-9f22-49b8-b60f-07d035ff8e8c tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Lock "1c8e780d-0a13-4484-bf18-ac0879db263a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:27:47 user nova-compute[73572]: DEBUG nova.compute.manager [None req-3b784915-9f22-49b8-b60f-07d035ff8e8c tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] [instance: 1c8e780d-0a13-4484-bf18-ac0879db263a] Starting instance... {{(pid=73572) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 10:27:47 user nova-compute[73572]: DEBUG nova.compute.manager [req-88a2248b-c86f-4c50-9cda-18736b59687e req-cb17d146-dde2-454d-a788-b966231ea625 service nova] [instance: 1f3db0fa-682c-4b33-966b-9e50b7349b6e] Received event network-vif-unplugged-56789500-c8b2-4391-b245-6a2998d9fb6c {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:27:47 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-88a2248b-c86f-4c50-9cda-18736b59687e req-cb17d146-dde2-454d-a788-b966231ea625 service nova] Acquiring lock "1f3db0fa-682c-4b33-966b-9e50b7349b6e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:27:47 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-88a2248b-c86f-4c50-9cda-18736b59687e req-cb17d146-dde2-454d-a788-b966231ea625 service nova] Lock "1f3db0fa-682c-4b33-966b-9e50b7349b6e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:27:47 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-88a2248b-c86f-4c50-9cda-18736b59687e req-cb17d146-dde2-454d-a788-b966231ea625 service nova] Lock "1f3db0fa-682c-4b33-966b-9e50b7349b6e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:27:47 user nova-compute[73572]: DEBUG nova.compute.manager [req-88a2248b-c86f-4c50-9cda-18736b59687e req-cb17d146-dde2-454d-a788-b966231ea625 service nova] [instance: 1f3db0fa-682c-4b33-966b-9e50b7349b6e] No waiting events found dispatching network-vif-unplugged-56789500-c8b2-4391-b245-6a2998d9fb6c {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:27:47 user nova-compute[73572]: DEBUG nova.compute.manager [req-88a2248b-c86f-4c50-9cda-18736b59687e req-cb17d146-dde2-454d-a788-b966231ea625 service nova] [instance: 1f3db0fa-682c-4b33-966b-9e50b7349b6e] Received event network-vif-unplugged-56789500-c8b2-4391-b245-6a2998d9fb6c for instance with task_state deleting. {{(pid=73572) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 10:27:47 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-3b784915-9f22-49b8-b60f-07d035ff8e8c tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:27:47 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-3b784915-9f22-49b8-b60f-07d035ff8e8c tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:27:47 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-3b784915-9f22-49b8-b60f-07d035ff8e8c tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73572) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 10:27:47 user nova-compute[73572]: INFO nova.compute.claims [None req-3b784915-9f22-49b8-b60f-07d035ff8e8c tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] [instance: 1c8e780d-0a13-4484-bf18-ac0879db263a] Claim successful on node user
Aug 26 10:27:48 user nova-compute[73572]: DEBUG nova.compute.provider_tree [None req-3b784915-9f22-49b8-b60f-07d035ff8e8c tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Inventory has not changed in ProviderTree for provider: e2cec974-59b2-4c77-a53d-a7f4e5a30d75 {{(pid=73572) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 10:27:48 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-3b784915-9f22-49b8-b60f-07d035ff8e8c tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Inventory has not changed for provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73572) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 10:27:48 user nova-compute[73572]: INFO nova.virt.libvirt.driver [-] [instance: 1f3db0fa-682c-4b33-966b-9e50b7349b6e] Instance destroyed successfully.
Aug 26 10:27:48 user nova-compute[73572]: DEBUG nova.objects.instance [None req-511530b6-3cd7-45a9-9792-66716ba7e572 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Lazy-loading 'resources' on Instance uuid 1f3db0fa-682c-4b33-966b-9e50b7349b6e {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:27:48 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-511530b6-3cd7-45a9-9792-66716ba7e572 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T10:22:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-243791677',display_name='tempest-TestMinimumBasicScenario-server-243791677',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-243791677',id=31,image_ref='7dc1b5c8-da80-43d5-a885-7f3a806c5633',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNcR9stjGS+uFqqOHEkcOKSz8zCmiheoV3PRsDn3F7rYFiI9jSvBV9sL0CyHK2fB2TUnsQAIqfrqM4/FFVbTOvl86Loz5xao2NEPhhtZCRWiLyYgYrAO1GfBYIBRxayR1w==',key_name='tempest-TestMinimumBasicScenario-2054612711',keypairs=<?>,launch_index=0,launched_at=2023-08-26T10:22:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='eb6ef2597eac461f959a568abd3031ca',ramdisk_id='',reservation_id='r-txt0ywle',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7dc1b5c8-da80-43d5-a885-7f3a806c5633',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1705958769',owner_user_name='tempest-TestMinimumBasicScenario-1705958769-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T10:25:04Z,user_data=None,user_id='a354eb6764fd4c95a53b8962544bc49b',uuid=1f3db0fa-682c-4b33-966b-9e50b7349b6e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "56789500-c8b2-4391-b245-6a2998d9fb6c", "address": "fa:16:3e:b8:f0:d2", "network": {"id": "2a6e27c9-9bd2-4ccb-abf6-82d85524da90", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1822065121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb6ef2597eac461f959a568abd3031ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56789500-c8", "ovs_interfaceid": "56789500-c8b2-4391-b245-6a2998d9fb6c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 10:27:48 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-511530b6-3cd7-45a9-9792-66716ba7e572 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Converting VIF {"id": "56789500-c8b2-4391-b245-6a2998d9fb6c", "address": "fa:16:3e:b8:f0:d2", "network": {"id": "2a6e27c9-9bd2-4ccb-abf6-82d85524da90", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1822065121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb6ef2597eac461f959a568abd3031ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56789500-c8", "ovs_interfaceid": "56789500-c8b2-4391-b245-6a2998d9fb6c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:27:48 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-511530b6-3cd7-45a9-9792-66716ba7e572 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b8:f0:d2,bridge_name='br-int',has_traffic_filtering=True,id=56789500-c8b2-4391-b245-6a2998d9fb6c,network=Network(2a6e27c9-9bd2-4ccb-abf6-82d85524da90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56789500-c8') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:27:48 user nova-compute[73572]: DEBUG os_vif [None req-511530b6-3cd7-45a9-9792-66716ba7e572 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b8:f0:d2,bridge_name='br-int',has_traffic_filtering=True,id=56789500-c8b2-4391-b245-6a2998d9fb6c,network=Network(2a6e27c9-9bd2-4ccb-abf6-82d85524da90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56789500-c8') {{(pid=73572) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 10:27:48 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-3b784915-9f22-49b8-b60f-07d035ff8e8c tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.561s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:27:48 user nova-compute[73572]: DEBUG nova.compute.manager [None req-3b784915-9f22-49b8-b60f-07d035ff8e8c tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] [instance: 1c8e780d-0a13-4484-bf18-ac0879db263a] Start building networks asynchronously for instance. {{(pid=73572) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 10:27:48 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:27:48 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap56789500-c8, bridge=br-int, if_exists=True) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:27:48 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:27:48 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:27:48 user nova-compute[73572]: INFO os_vif [None req-511530b6-3cd7-45a9-9792-66716ba7e572 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b8:f0:d2,bridge_name='br-int',has_traffic_filtering=True,id=56789500-c8b2-4391-b245-6a2998d9fb6c,network=Network(2a6e27c9-9bd2-4ccb-abf6-82d85524da90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56789500-c8')
Aug 26 10:27:48 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-511530b6-3cd7-45a9-9792-66716ba7e572 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] [instance: 1f3db0fa-682c-4b33-966b-9e50b7349b6e] Deleting instance files /opt/stack/data/nova/instances/1f3db0fa-682c-4b33-966b-9e50b7349b6e_del
Aug 26 10:27:48 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-511530b6-3cd7-45a9-9792-66716ba7e572 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] [instance: 1f3db0fa-682c-4b33-966b-9e50b7349b6e] Deletion of /opt/stack/data/nova/instances/1f3db0fa-682c-4b33-966b-9e50b7349b6e_del complete
Aug 26 10:27:48 user nova-compute[73572]: DEBUG nova.compute.manager [None req-3b784915-9f22-49b8-b60f-07d035ff8e8c tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] [instance: 1c8e780d-0a13-4484-bf18-ac0879db263a] Allocating IP information in the background. {{(pid=73572) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 10:27:48 user nova-compute[73572]: DEBUG nova.network.neutron [None req-3b784915-9f22-49b8-b60f-07d035ff8e8c tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] [instance: 1c8e780d-0a13-4484-bf18-ac0879db263a] allocate_for_instance() {{(pid=73572) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 10:27:48 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-3b784915-9f22-49b8-b60f-07d035ff8e8c tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] [instance: 1c8e780d-0a13-4484-bf18-ac0879db263a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 10:27:48 user nova-compute[73572]: INFO nova.compute.manager [None req-511530b6-3cd7-45a9-9792-66716ba7e572 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] [instance: 1f3db0fa-682c-4b33-966b-9e50b7349b6e] Took 1.14 seconds to destroy the instance on the hypervisor.
Aug 26 10:27:48 user nova-compute[73572]: DEBUG oslo.service.loopingcall [None req-511530b6-3cd7-45a9-9792-66716ba7e572 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73572) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 10:27:48 user nova-compute[73572]: DEBUG nova.compute.manager [-] [instance: 1f3db0fa-682c-4b33-966b-9e50b7349b6e] Deallocating network for instance {{(pid=73572) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 10:27:48 user nova-compute[73572]: DEBUG nova.network.neutron [-] [instance: 1f3db0fa-682c-4b33-966b-9e50b7349b6e] deallocate_for_instance() {{(pid=73572) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 10:27:48 user nova-compute[73572]: DEBUG nova.compute.manager [None req-3b784915-9f22-49b8-b60f-07d035ff8e8c tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] [instance: 1c8e780d-0a13-4484-bf18-ac0879db263a] Start building block device mappings for instance. {{(pid=73572) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 10:27:48 user nova-compute[73572]: DEBUG nova.policy [None req-3b784915-9f22-49b8-b60f-07d035ff8e8c tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '099462c61dcc4816b17d2d0155823873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1bff48d66894950ac6690e1fd0e79b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73572) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 10:27:48 user nova-compute[73572]: DEBUG nova.compute.manager [None req-3b784915-9f22-49b8-b60f-07d035ff8e8c tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] [instance: 1c8e780d-0a13-4484-bf18-ac0879db263a] Start spawning the instance on the hypervisor. {{(pid=73572) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 10:27:48 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-3b784915-9f22-49b8-b60f-07d035ff8e8c tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] [instance: 1c8e780d-0a13-4484-bf18-ac0879db263a] Creating instance directory {{(pid=73572) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 10:27:48 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-3b784915-9f22-49b8-b60f-07d035ff8e8c tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] [instance: 1c8e780d-0a13-4484-bf18-ac0879db263a] Creating image(s)
Aug 26 10:27:48 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-3b784915-9f22-49b8-b60f-07d035ff8e8c tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Acquiring lock "/opt/stack/data/nova/instances/1c8e780d-0a13-4484-bf18-ac0879db263a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:27:48 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-3b784915-9f22-49b8-b60f-07d035ff8e8c tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Lock "/opt/stack/data/nova/instances/1c8e780d-0a13-4484-bf18-ac0879db263a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:27:48 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-3b784915-9f22-49b8-b60f-07d035ff8e8c tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Lock "/opt/stack/data/nova/instances/1c8e780d-0a13-4484-bf18-ac0879db263a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:27:48 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-3b784915-9f22-49b8-b60f-07d035ff8e8c tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:27:48 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-3b784915-9f22-49b8-b60f-07d035ff8e8c tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json" returned: 0 in 0.200s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:27:48 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-3b784915-9f22-49b8-b60f-07d035ff8e8c tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Acquiring lock "2099350d6f3bcd0de9471c73862d4fe75b049801" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:27:48 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-3b784915-9f22-49b8-b60f-07d035ff8e8c tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Lock "2099350d6f3bcd0de9471c73862d4fe75b049801" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:27:48 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-3b784915-9f22-49b8-b60f-07d035ff8e8c tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:27:49 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-3b784915-9f22-49b8-b60f-07d035ff8e8c tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json" returned: 0 in 0.191s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:27:49 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-3b784915-9f22-49b8-b60f-07d035ff8e8c tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801,backing_fmt=raw /opt/stack/data/nova/instances/1c8e780d-0a13-4484-bf18-ac0879db263a/disk 1073741824 {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:27:49 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-3b784915-9f22-49b8-b60f-07d035ff8e8c tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801,backing_fmt=raw /opt/stack/data/nova/instances/1c8e780d-0a13-4484-bf18-ac0879db263a/disk 1073741824" returned: 0 in 0.058s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:27:49 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-3b784915-9f22-49b8-b60f-07d035ff8e8c tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Lock "2099350d6f3bcd0de9471c73862d4fe75b049801" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.257s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:27:49 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-3b784915-9f22-49b8-b60f-07d035ff8e8c tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:27:49 user nova-compute[73572]: DEBUG nova.network.neutron [-] [instance: 1f3db0fa-682c-4b33-966b-9e50b7349b6e] Updating instance_info_cache with network_info: [] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:27:49 user nova-compute[73572]: INFO nova.compute.manager [-] [instance: 1f3db0fa-682c-4b33-966b-9e50b7349b6e] Took 0.69 seconds to deallocate network for instance.
Aug 26 10:27:49 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-511530b6-3cd7-45a9-9792-66716ba7e572 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:27:49 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-511530b6-3cd7-45a9-9792-66716ba7e572 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:27:49 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-3b784915-9f22-49b8-b60f-07d035ff8e8c tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json" returned: 0 in 0.209s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:27:49 user nova-compute[73572]: DEBUG nova.virt.disk.api [None req-3b784915-9f22-49b8-b60f-07d035ff8e8c tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1c8e780d-0a13-4484-bf18-ac0879db263a/disk. size=1073741824 {{(pid=73572) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 10:27:49 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-3b784915-9f22-49b8-b60f-07d035ff8e8c tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c8e780d-0a13-4484-bf18-ac0879db263a/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:27:49 user nova-compute[73572]: DEBUG nova.network.neutron [None req-3b784915-9f22-49b8-b60f-07d035ff8e8c tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] [instance: 1c8e780d-0a13-4484-bf18-ac0879db263a] Successfully created port: d03460b0-e0b9-4c39-a8a6-12cb80aca6bc {{(pid=73572) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 10:27:49 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-3b784915-9f22-49b8-b60f-07d035ff8e8c tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c8e780d-0a13-4484-bf18-ac0879db263a/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:27:49 user nova-compute[73572]: DEBUG nova.virt.disk.api [None req-3b784915-9f22-49b8-b60f-07d035ff8e8c tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Cannot resize image /opt/stack/data/nova/instances/1c8e780d-0a13-4484-bf18-ac0879db263a/disk to a smaller size. {{(pid=73572) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 10:27:49 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-3b784915-9f22-49b8-b60f-07d035ff8e8c tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] [instance: 1c8e780d-0a13-4484-bf18-ac0879db263a] Created local disks {{(pid=73572) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 10:27:49 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-3b784915-9f22-49b8-b60f-07d035ff8e8c tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] [instance: 1c8e780d-0a13-4484-bf18-ac0879db263a] Ensure instance console log exists: /opt/stack/data/nova/instances/1c8e780d-0a13-4484-bf18-ac0879db263a/console.log {{(pid=73572) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 10:27:49 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-3b784915-9f22-49b8-b60f-07d035ff8e8c tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:27:49 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-3b784915-9f22-49b8-b60f-07d035ff8e8c tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:27:49 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-3b784915-9f22-49b8-b60f-07d035ff8e8c tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:27:49 user nova-compute[73572]: DEBUG nova.compute.provider_tree [None req-511530b6-3cd7-45a9-9792-66716ba7e572 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Inventory has not changed in ProviderTree for provider: e2cec974-59b2-4c77-a53d-a7f4e5a30d75 {{(pid=73572) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 10:27:49 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-511530b6-3cd7-45a9-9792-66716ba7e572 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Inventory has not changed for provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73572) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 10:27:49 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-511530b6-3cd7-45a9-9792-66716ba7e572 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.521s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:27:49 user nova-compute[73572]: DEBUG nova.compute.manager [req-73808d84-81d5-4e7f-a393-544ccde021b1 req-d0b9ff8d-6ebc-4e04-a7df-3196653c5e6d service nova] [instance: 1f3db0fa-682c-4b33-966b-9e50b7349b6e] Received event network-vif-plugged-56789500-c8b2-4391-b245-6a2998d9fb6c {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:27:49 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-73808d84-81d5-4e7f-a393-544ccde021b1 req-d0b9ff8d-6ebc-4e04-a7df-3196653c5e6d service nova] Acquiring lock "1f3db0fa-682c-4b33-966b-9e50b7349b6e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:27:49 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-73808d84-81d5-4e7f-a393-544ccde021b1 req-d0b9ff8d-6ebc-4e04-a7df-3196653c5e6d service nova] Lock "1f3db0fa-682c-4b33-966b-9e50b7349b6e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:27:49 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-73808d84-81d5-4e7f-a393-544ccde021b1 req-d0b9ff8d-6ebc-4e04-a7df-3196653c5e6d service nova] Lock "1f3db0fa-682c-4b33-966b-9e50b7349b6e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:27:49 user nova-compute[73572]: DEBUG nova.compute.manager [req-73808d84-81d5-4e7f-a393-544ccde021b1 req-d0b9ff8d-6ebc-4e04-a7df-3196653c5e6d service nova] [instance: 1f3db0fa-682c-4b33-966b-9e50b7349b6e] No waiting events found dispatching network-vif-plugged-56789500-c8b2-4391-b245-6a2998d9fb6c {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:27:49 user nova-compute[73572]: WARNING nova.compute.manager [req-73808d84-81d5-4e7f-a393-544ccde021b1 req-d0b9ff8d-6ebc-4e04-a7df-3196653c5e6d service nova] [instance: 1f3db0fa-682c-4b33-966b-9e50b7349b6e] Received unexpected event network-vif-plugged-56789500-c8b2-4391-b245-6a2998d9fb6c for instance with vm_state deleted and task_state None.
Aug 26 10:27:49 user nova-compute[73572]: DEBUG nova.compute.manager [req-73808d84-81d5-4e7f-a393-544ccde021b1 req-d0b9ff8d-6ebc-4e04-a7df-3196653c5e6d service nova] [instance: 1f3db0fa-682c-4b33-966b-9e50b7349b6e] Received event network-vif-deleted-56789500-c8b2-4391-b245-6a2998d9fb6c {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:27:49 user nova-compute[73572]: INFO nova.scheduler.client.report [None req-511530b6-3cd7-45a9-9792-66716ba7e572 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Deleted allocations for instance 1f3db0fa-682c-4b33-966b-9e50b7349b6e
Aug 26 10:27:50 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-511530b6-3cd7-45a9-9792-66716ba7e572 tempest-TestMinimumBasicScenario-1705958769 tempest-TestMinimumBasicScenario-1705958769-project-member] Lock "1f3db0fa-682c-4b33-966b-9e50b7349b6e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.609s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:27:50 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:27:50 user nova-compute[73572]: DEBUG nova.network.neutron [None req-3b784915-9f22-49b8-b60f-07d035ff8e8c tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] [instance: 1c8e780d-0a13-4484-bf18-ac0879db263a] Successfully updated port: d03460b0-e0b9-4c39-a8a6-12cb80aca6bc {{(pid=73572) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 10:27:50 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-3b784915-9f22-49b8-b60f-07d035ff8e8c tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Acquiring lock "refresh_cache-1c8e780d-0a13-4484-bf18-ac0879db263a" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:27:50 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-3b784915-9f22-49b8-b60f-07d035ff8e8c tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Acquired lock "refresh_cache-1c8e780d-0a13-4484-bf18-ac0879db263a" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:27:50 user nova-compute[73572]: DEBUG nova.network.neutron [None req-3b784915-9f22-49b8-b60f-07d035ff8e8c tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] [instance: 1c8e780d-0a13-4484-bf18-ac0879db263a] Building network info cache for instance {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 10:27:50 user nova-compute[73572]: DEBUG nova.compute.manager [req-db35bdce-129a-43e8-b659-d9fdd51adbf5 req-01968291-3429-4f7d-8d54-45997ff70eda service nova] [instance: 1c8e780d-0a13-4484-bf18-ac0879db263a] Received event network-changed-d03460b0-e0b9-4c39-a8a6-12cb80aca6bc {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:27:50 user nova-compute[73572]: DEBUG nova.compute.manager [req-db35bdce-129a-43e8-b659-d9fdd51adbf5 req-01968291-3429-4f7d-8d54-45997ff70eda service nova] [instance: 1c8e780d-0a13-4484-bf18-ac0879db263a] Refreshing instance network info cache due to event network-changed-d03460b0-e0b9-4c39-a8a6-12cb80aca6bc. {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 10:27:50 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-db35bdce-129a-43e8-b659-d9fdd51adbf5 req-01968291-3429-4f7d-8d54-45997ff70eda service nova] Acquiring lock "refresh_cache-1c8e780d-0a13-4484-bf18-ac0879db263a" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:27:50 user nova-compute[73572]: DEBUG nova.network.neutron [None req-3b784915-9f22-49b8-b60f-07d035ff8e8c tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] [instance: 1c8e780d-0a13-4484-bf18-ac0879db263a] Instance cache missing network info. {{(pid=73572) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 10:27:50 user nova-compute[73572]: DEBUG nova.network.neutron [None req-3b784915-9f22-49b8-b60f-07d035ff8e8c tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] [instance: 1c8e780d-0a13-4484-bf18-ac0879db263a] Updating instance_info_cache with network_info: [{"id": "d03460b0-e0b9-4c39-a8a6-12cb80aca6bc", "address": "fa:16:3e:c2:0f:20", "network": {"id": "757e71b4-5177-45a5-8ef5-9b27f42092f1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1765327616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1bff48d66894950ac6690e1fd0e79b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd03460b0-e0", "ovs_interfaceid": "d03460b0-e0b9-4c39-a8a6-12cb80aca6bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:27:50 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-3b784915-9f22-49b8-b60f-07d035ff8e8c tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Releasing lock "refresh_cache-1c8e780d-0a13-4484-bf18-ac0879db263a" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:27:50 user nova-compute[73572]: DEBUG nova.compute.manager [None req-3b784915-9f22-49b8-b60f-07d035ff8e8c tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] [instance: 1c8e780d-0a13-4484-bf18-ac0879db263a] Instance network_info: |[{"id": "d03460b0-e0b9-4c39-a8a6-12cb80aca6bc", "address": "fa:16:3e:c2:0f:20", "network": {"id": "757e71b4-5177-45a5-8ef5-9b27f42092f1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1765327616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1bff48d66894950ac6690e1fd0e79b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd03460b0-e0", "ovs_interfaceid": "d03460b0-e0b9-4c39-a8a6-12cb80aca6bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73572) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 10:27:50 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-db35bdce-129a-43e8-b659-d9fdd51adbf5 req-01968291-3429-4f7d-8d54-45997ff70eda service nova] Acquired lock "refresh_cache-1c8e780d-0a13-4484-bf18-ac0879db263a" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:27:50 user nova-compute[73572]: DEBUG nova.network.neutron [req-db35bdce-129a-43e8-b659-d9fdd51adbf5 req-01968291-3429-4f7d-8d54-45997ff70eda service nova] [instance: 1c8e780d-0a13-4484-bf18-ac0879db263a] Refreshing network info cache for port d03460b0-e0b9-4c39-a8a6-12cb80aca6bc {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 10:27:51 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-3b784915-9f22-49b8-b60f-07d035ff8e8c tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] [instance: 1c8e780d-0a13-4484-bf18-ac0879db263a] Start _get_guest_xml network_info=[{"id": "d03460b0-e0b9-4c39-a8a6-12cb80aca6bc", "address": "fa:16:3e:c2:0f:20", "network": {"id": "757e71b4-5177-45a5-8ef5-9b27f42092f1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1765327616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1bff48d66894950ac6690e1fd0e79b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd03460b0-e0", "ovs_interfaceid": "d03460b0-e0b9-4c39-a8a6-12cb80aca6bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T10:07:33Z,direct_url=<?>,disk_format='qcow2',id=299da0c9-e1c4-48f0-be55-fbe20dd06bc9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5c995f8bbbab4368b67a253e0df3971a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T10:07:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'guest_format': None, 'size': 0, 'encryption_format': None, 'device_type': 'disk', 'image_id': '299da0c9-e1c4-48f0-be55-fbe20dd06bc9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73572) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 10:27:51 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-3b784915-9f22-49b8-b60f-07d035ff8e8c tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:27:51 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-3b784915-9f22-49b8-b60f-07d035ff8e8c tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:27:51 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-3b784915-9f22-49b8-b60f-07d035ff8e8c tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73572) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 10:27:51 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-3b784915-9f22-49b8-b60f-07d035ff8e8c tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] CPU controller missing on host. {{(pid=73572) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 10:27:51 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-3b784915-9f22-49b8-b60f-07d035ff8e8c tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73572) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 10:27:51 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-3b784915-9f22-49b8-b60f-07d035ff8e8c tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] CPU controller found on host. {{(pid=73572) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 10:27:51 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-3b784915-9f22-49b8-b60f-07d035ff8e8c tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73572) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 10:27:51 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-3b784915-9f22-49b8-b60f-07d035ff8e8c tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T10:07:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T10:07:33Z,direct_url=<?>,disk_format='qcow2',id=299da0c9-e1c4-48f0-be55-fbe20dd06bc9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5c995f8bbbab4368b67a253e0df3971a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T10:07:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 10:27:51 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-3b784915-9f22-49b8-b60f-07d035ff8e8c tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Flavor limits 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 10:27:51 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-3b784915-9f22-49b8-b60f-07d035ff8e8c tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Image limits 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 10:27:51 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-3b784915-9f22-49b8-b60f-07d035ff8e8c tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Flavor pref 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 10:27:51 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-3b784915-9f22-49b8-b60f-07d035ff8e8c tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Image pref 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 10:27:51 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-3b784915-9f22-49b8-b60f-07d035ff8e8c tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 10:27:51 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-3b784915-9f22-49b8-b60f-07d035ff8e8c tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 10:27:51 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-3b784915-9f22-49b8-b60f-07d035ff8e8c tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73572) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 10:27:51 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-3b784915-9f22-49b8-b60f-07d035ff8e8c tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Got 1 possible topologies {{(pid=73572) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 10:27:51 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-3b784915-9f22-49b8-b60f-07d035ff8e8c tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 10:27:51 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-3b784915-9f22-49b8-b60f-07d035ff8e8c tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 10:27:51 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-3b784915-9f22-49b8-b60f-07d035ff8e8c tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T10:27:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-821156998',display_name='tempest-ServerRescueNegativeTestJSON-server-821156998',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-821156998',id=40,image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBdJWXCpcpht4n3qLptinC08jNqNS/A7/DSoqFpXtHq2HTCyjzpcW8MUPvSYgPW74WssX1EyPCLQNLXv88U5ywgbLueToZjk8R5ItyFWItCp9yIBOnN3M8i0e9J/+MVdhA==',key_name='tempest-keypair-1014482907',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c1bff48d66894950ac6690e1fd0e79b9',ramdisk_id='',reservation_id='r-wv0dakc2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1710547876',owner_user_name='tempest-ServerRescueNegativeTestJSON-1710547876-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T10:27:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='099462c61dcc4816b17d2d0155823873',uuid=1c8e780d-0a13-4484-bf18-ac0879db263a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d03460b0-e0b9-4c39-a8a6-12cb80aca6bc", "address": "fa:16:3e:c2:0f:20", "network": {"id": "757e71b4-5177-45a5-8ef5-9b27f42092f1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1765327616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1bff48d66894950ac6690e1fd0e79b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd03460b0-e0", "ovs_interfaceid": "d03460b0-e0b9-4c39-a8a6-12cb80aca6bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73572) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 10:27:51 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-3b784915-9f22-49b8-b60f-07d035ff8e8c tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Converting VIF {"id": "d03460b0-e0b9-4c39-a8a6-12cb80aca6bc", "address": "fa:16:3e:c2:0f:20", "network": {"id": "757e71b4-5177-45a5-8ef5-9b27f42092f1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1765327616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1bff48d66894950ac6690e1fd0e79b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd03460b0-e0", "ovs_interfaceid": "d03460b0-e0b9-4c39-a8a6-12cb80aca6bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:27:51 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-3b784915-9f22-49b8-b60f-07d035ff8e8c tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:0f:20,bridge_name='br-int',has_traffic_filtering=True,id=d03460b0-e0b9-4c39-a8a6-12cb80aca6bc,network=Network(757e71b4-5177-45a5-8ef5-9b27f42092f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd03460b0-e0') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:27:51 user nova-compute[73572]: DEBUG nova.objects.instance [None req-3b784915-9f22-49b8-b60f-07d035ff8e8c tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Lazy-loading 'pci_devices' on Instance uuid 1c8e780d-0a13-4484-bf18-ac0879db263a {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:27:51 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-3b784915-9f22-49b8-b60f-07d035ff8e8c tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] [instance: 1c8e780d-0a13-4484-bf18-ac0879db263a] End _get_guest_xml xml=<domain type="kvm">
Aug 26 10:27:51 user nova-compute[73572]:   <uuid>1c8e780d-0a13-4484-bf18-ac0879db263a</uuid>
Aug 26 10:27:51 user nova-compute[73572]:   <name>instance-00000028</name>
Aug 26 10:27:51 user nova-compute[73572]:   <memory>524288</memory>
Aug 26 10:27:51 user nova-compute[73572]:   <vcpu>1</vcpu>
Aug 26 10:27:51 user nova-compute[73572]:   <metadata>
Aug 26 10:27:51 user nova-compute[73572]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 10:27:51 user nova-compute[73572]:       <nova:package version="0.0.0"/>
Aug 26 10:27:51 user nova-compute[73572]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-821156998</nova:name>
Aug 26 10:27:51 user nova-compute[73572]:       <nova:creationTime>2023-08-26 10:27:51</nova:creationTime>
Aug 26 10:27:51 user nova-compute[73572]:       <nova:flavor name="m1.tiny">
Aug 26 10:27:51 user nova-compute[73572]:         <nova:memory>512</nova:memory>
Aug 26 10:27:51 user nova-compute[73572]:         <nova:disk>1</nova:disk>
Aug 26 10:27:51 user nova-compute[73572]:         <nova:swap>0</nova:swap>
Aug 26 10:27:51 user nova-compute[73572]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 10:27:51 user nova-compute[73572]:         <nova:vcpus>1</nova:vcpus>
Aug 26 10:27:51 user nova-compute[73572]:       </nova:flavor>
Aug 26 10:27:51 user nova-compute[73572]:       <nova:owner>
Aug 26 10:27:51 user nova-compute[73572]:         <nova:user uuid="099462c61dcc4816b17d2d0155823873">tempest-ServerRescueNegativeTestJSON-1710547876-project-member</nova:user>
Aug 26 10:27:51 user nova-compute[73572]:         <nova:project uuid="c1bff48d66894950ac6690e1fd0e79b9">tempest-ServerRescueNegativeTestJSON-1710547876</nova:project>
Aug 26 10:27:51 user nova-compute[73572]:       </nova:owner>
Aug 26 10:27:51 user nova-compute[73572]:       <nova:root type="image" uuid="299da0c9-e1c4-48f0-be55-fbe20dd06bc9"/>
Aug 26 10:27:51 user nova-compute[73572]:       <nova:ports>
Aug 26 10:27:51 user nova-compute[73572]:         <nova:port uuid="d03460b0-e0b9-4c39-a8a6-12cb80aca6bc">
Aug 26 10:27:51 user nova-compute[73572]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 26 10:27:51 user nova-compute[73572]:         </nova:port>
Aug 26 10:27:51 user nova-compute[73572]:       </nova:ports>
Aug 26 10:27:51 user nova-compute[73572]:     </nova:instance>
Aug 26 10:27:51 user nova-compute[73572]:   </metadata>
Aug 26 10:27:51 user nova-compute[73572]:   <sysinfo type="smbios">
Aug 26 10:27:51 user nova-compute[73572]:     <system>
Aug 26 10:27:51 user nova-compute[73572]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 10:27:51 user nova-compute[73572]:       <entry name="product">OpenStack Nova</entry>
Aug 26 10:27:51 user nova-compute[73572]:       <entry name="version">0.0.0</entry>
Aug 26 10:27:51 user nova-compute[73572]:       <entry name="serial">1c8e780d-0a13-4484-bf18-ac0879db263a</entry>
Aug 26 10:27:51 user nova-compute[73572]:       <entry name="uuid">1c8e780d-0a13-4484-bf18-ac0879db263a</entry>
Aug 26 10:27:51 user nova-compute[73572]:       <entry name="family">Virtual Machine</entry>
Aug 26 10:27:51 user nova-compute[73572]:     </system>
Aug 26 10:27:51 user nova-compute[73572]:   </sysinfo>
Aug 26 10:27:51 user nova-compute[73572]:   <os>
Aug 26 10:27:51 user nova-compute[73572]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 10:27:51 user nova-compute[73572]:     <boot dev="hd"/>
Aug 26 10:27:51 user nova-compute[73572]:     <smbios mode="sysinfo"/>
Aug 26 10:27:51 user nova-compute[73572]:   </os>
Aug 26 10:27:51 user nova-compute[73572]:   <features>
Aug 26 10:27:51 user nova-compute[73572]:     <acpi/>
Aug 26 10:27:51 user nova-compute[73572]:     <apic/>
Aug 26 10:27:51 user nova-compute[73572]:     <vmcoreinfo/>
Aug 26 10:27:51 user nova-compute[73572]:   </features>
Aug 26 10:27:51 user nova-compute[73572]:   <clock offset="utc">
Aug 26 10:27:51 user nova-compute[73572]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 10:27:51 user nova-compute[73572]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 10:27:51 user nova-compute[73572]:     <timer name="hpet" present="no"/>
Aug 26 10:27:51 user nova-compute[73572]:   </clock>
Aug 26 10:27:51 user nova-compute[73572]:   <cpu mode="custom" match="exact">
Aug 26 10:27:51 user nova-compute[73572]:     <model>Nehalem</model>
Aug 26 10:27:51 user nova-compute[73572]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 10:27:51 user nova-compute[73572]:   </cpu>
Aug 26 10:27:51 user nova-compute[73572]:   <devices>
Aug 26 10:27:51 user nova-compute[73572]:     <disk type="file" device="disk">
Aug 26 10:27:51 user nova-compute[73572]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 10:27:51 user nova-compute[73572]:       <source file="/opt/stack/data/nova/instances/1c8e780d-0a13-4484-bf18-ac0879db263a/disk"/>
Aug 26 10:27:51 user nova-compute[73572]:       <target dev="vda" bus="virtio"/>
Aug 26 10:27:51 user nova-compute[73572]:     </disk>
Aug 26 10:27:51 user nova-compute[73572]:     <interface type="ethernet">
Aug 26 10:27:51 user nova-compute[73572]:       <mac address="fa:16:3e:c2:0f:20"/>
Aug 26 10:27:51 user nova-compute[73572]:       <model type="virtio"/>
Aug 26 10:27:51 user nova-compute[73572]:       <mtu size="1442"/>
Aug 26 10:27:51 user nova-compute[73572]:       <target dev="tapd03460b0-e0"/>
Aug 26 10:27:51 user nova-compute[73572]:     </interface>
Aug 26 10:27:51 user nova-compute[73572]:     <serial type="pty">
Aug 26 10:27:51 user nova-compute[73572]:       <log file="/opt/stack/data/nova/instances/1c8e780d-0a13-4484-bf18-ac0879db263a/console.log" append="off"/>
Aug 26 10:27:51 user nova-compute[73572]:     </serial>
Aug 26 10:27:51 user nova-compute[73572]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 10:27:51 user nova-compute[73572]:     <video>
Aug 26 10:27:51 user nova-compute[73572]:       <model type="virtio"/>
Aug 26 10:27:51 user nova-compute[73572]:     </video>
Aug 26 10:27:51 user nova-compute[73572]:     <rng model="virtio">
Aug 26 10:27:51 user nova-compute[73572]:       <backend model="random">/dev/urandom</backend>
Aug 26 10:27:51 user nova-compute[73572]:     </rng>
Aug 26 10:27:51 user nova-compute[73572]:     <controller type="usb" index="0" model="none"/>
Aug 26 10:27:51 user nova-compute[73572]:     <memballoon model="virtio">
Aug 26 10:27:51 user nova-compute[73572]:       <stats period="10"/>
Aug 26 10:27:51 user nova-compute[73572]:     </memballoon>
Aug 26 10:27:51 user nova-compute[73572]:   </devices>
Aug 26 10:27:51 user nova-compute[73572]: </domain>
Aug 26 10:27:51 user nova-compute[73572]:  {{(pid=73572) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 10:27:51 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-3b784915-9f22-49b8-b60f-07d035ff8e8c tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T10:27:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-821156998',display_name='tempest-ServerRescueNegativeTestJSON-server-821156998',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-821156998',id=40,image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBdJWXCpcpht4n3qLptinC08jNqNS/A7/DSoqFpXtHq2HTCyjzpcW8MUPvSYgPW74WssX1EyPCLQNLXv88U5ywgbLueToZjk8R5ItyFWItCp9yIBOnN3M8i0e9J/+MVdhA==',key_name='tempest-keypair-1014482907',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c1bff48d66894950ac6690e1fd0e79b9',ramdisk_id='',reservation_id='r-wv0dakc2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1710547876',owner_user_name='tempest-ServerRescueNegativeTestJSON-1710547876-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T10:27:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='099462c61dcc4816b17d2d0155823873',uuid=1c8e780d-0a13-4484-bf18-ac0879db263a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d03460b0-e0b9-4c39-a8a6-12cb80aca6bc", "address": "fa:16:3e:c2:0f:20", "network": {"id": "757e71b4-5177-45a5-8ef5-9b27f42092f1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1765327616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1bff48d66894950ac6690e1fd0e79b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd03460b0-e0", "ovs_interfaceid": "d03460b0-e0b9-4c39-a8a6-12cb80aca6bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 10:27:51 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-3b784915-9f22-49b8-b60f-07d035ff8e8c tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Converting VIF {"id": "d03460b0-e0b9-4c39-a8a6-12cb80aca6bc", "address": "fa:16:3e:c2:0f:20", "network": {"id": "757e71b4-5177-45a5-8ef5-9b27f42092f1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1765327616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1bff48d66894950ac6690e1fd0e79b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd03460b0-e0", "ovs_interfaceid": "d03460b0-e0b9-4c39-a8a6-12cb80aca6bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:27:51 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-3b784915-9f22-49b8-b60f-07d035ff8e8c tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:0f:20,bridge_name='br-int',has_traffic_filtering=True,id=d03460b0-e0b9-4c39-a8a6-12cb80aca6bc,network=Network(757e71b4-5177-45a5-8ef5-9b27f42092f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd03460b0-e0') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:27:51 user nova-compute[73572]: DEBUG os_vif [None req-3b784915-9f22-49b8-b60f-07d035ff8e8c tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:0f:20,bridge_name='br-int',has_traffic_filtering=True,id=d03460b0-e0b9-4c39-a8a6-12cb80aca6bc,network=Network(757e71b4-5177-45a5-8ef5-9b27f42092f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd03460b0-e0') {{(pid=73572) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 10:27:51 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:27:51 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:27:51 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 10:27:51 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:27:51 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd03460b0-e0, may_exist=True, interface_attrs={}) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:27:51 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd03460b0-e0, col_values=(('external_ids', {'iface-id': 'd03460b0-e0b9-4c39-a8a6-12cb80aca6bc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c2:0f:20', 'vm-uuid': '1c8e780d-0a13-4484-bf18-ac0879db263a'}),), if_exists=True) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:27:51 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:27:51 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:27:51 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:27:51 user nova-compute[73572]: INFO os_vif [None req-3b784915-9f22-49b8-b60f-07d035ff8e8c tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:0f:20,bridge_name='br-int',has_traffic_filtering=True,id=d03460b0-e0b9-4c39-a8a6-12cb80aca6bc,network=Network(757e71b4-5177-45a5-8ef5-9b27f42092f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd03460b0-e0')
Aug 26 10:27:51 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-3b784915-9f22-49b8-b60f-07d035ff8e8c tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] No BDM found with device name vda, not building metadata. {{(pid=73572) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 10:27:51 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-3b784915-9f22-49b8-b60f-07d035ff8e8c tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] No VIF found with MAC fa:16:3e:c2:0f:20, not building metadata {{(pid=73572) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 10:27:51 user nova-compute[73572]: DEBUG nova.network.neutron [req-db35bdce-129a-43e8-b659-d9fdd51adbf5 req-01968291-3429-4f7d-8d54-45997ff70eda service nova] [instance: 1c8e780d-0a13-4484-bf18-ac0879db263a] Updated VIF entry in instance network info cache for port d03460b0-e0b9-4c39-a8a6-12cb80aca6bc. {{(pid=73572) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 10:27:51 user nova-compute[73572]: DEBUG nova.network.neutron [req-db35bdce-129a-43e8-b659-d9fdd51adbf5 req-01968291-3429-4f7d-8d54-45997ff70eda service nova] [instance: 1c8e780d-0a13-4484-bf18-ac0879db263a] Updating instance_info_cache with network_info: [{"id": "d03460b0-e0b9-4c39-a8a6-12cb80aca6bc", "address": "fa:16:3e:c2:0f:20", "network": {"id": "757e71b4-5177-45a5-8ef5-9b27f42092f1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1765327616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1bff48d66894950ac6690e1fd0e79b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd03460b0-e0", "ovs_interfaceid": "d03460b0-e0b9-4c39-a8a6-12cb80aca6bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:27:51 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-db35bdce-129a-43e8-b659-d9fdd51adbf5 req-01968291-3429-4f7d-8d54-45997ff70eda service nova] Releasing lock "refresh_cache-1c8e780d-0a13-4484-bf18-ac0879db263a" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:27:52 user nova-compute[73572]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693045657.419355, 6004b15a-be01-42eb-92ba-ae9d93dab708 => Stopped> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:27:52 user nova-compute[73572]: INFO nova.compute.manager [-] [instance: 6004b15a-be01-42eb-92ba-ae9d93dab708] VM Stopped (Lifecycle Event)
Aug 26 10:27:52 user nova-compute[73572]: DEBUG nova.compute.manager [None req-855e2cac-cdef-4740-af2f-dc9cadbb079e None None] [instance: 6004b15a-be01-42eb-92ba-ae9d93dab708] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:27:52 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:27:52 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:27:52 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:27:52 user nova-compute[73572]: DEBUG nova.compute.manager [req-a3ee1a42-6e99-4cab-9d17-a0e36614bea7 req-62c8d8ab-912b-4dba-a71b-f7d8c5050442 service nova] [instance: 1c8e780d-0a13-4484-bf18-ac0879db263a] Received event network-vif-plugged-d03460b0-e0b9-4c39-a8a6-12cb80aca6bc {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:27:52 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-a3ee1a42-6e99-4cab-9d17-a0e36614bea7 req-62c8d8ab-912b-4dba-a71b-f7d8c5050442 service nova] Acquiring lock "1c8e780d-0a13-4484-bf18-ac0879db263a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:27:52 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-a3ee1a42-6e99-4cab-9d17-a0e36614bea7 req-62c8d8ab-912b-4dba-a71b-f7d8c5050442 service nova] Lock "1c8e780d-0a13-4484-bf18-ac0879db263a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:27:52 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-a3ee1a42-6e99-4cab-9d17-a0e36614bea7 req-62c8d8ab-912b-4dba-a71b-f7d8c5050442 service nova] Lock "1c8e780d-0a13-4484-bf18-ac0879db263a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:27:52 user nova-compute[73572]: DEBUG nova.compute.manager [req-a3ee1a42-6e99-4cab-9d17-a0e36614bea7 req-62c8d8ab-912b-4dba-a71b-f7d8c5050442 service nova] [instance: 1c8e780d-0a13-4484-bf18-ac0879db263a] No waiting events found dispatching network-vif-plugged-d03460b0-e0b9-4c39-a8a6-12cb80aca6bc {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:27:52 user nova-compute[73572]: WARNING nova.compute.manager [req-a3ee1a42-6e99-4cab-9d17-a0e36614bea7 req-62c8d8ab-912b-4dba-a71b-f7d8c5050442 service nova] [instance: 1c8e780d-0a13-4484-bf18-ac0879db263a] Received unexpected event network-vif-plugged-d03460b0-e0b9-4c39-a8a6-12cb80aca6bc for instance with vm_state building and task_state spawning.
Aug 26 10:27:52 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:27:52 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:27:54 user nova-compute[73572]: DEBUG nova.virt.driver [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Emitting event <LifecycleEvent: 1693045674.6923301, 1c8e780d-0a13-4484-bf18-ac0879db263a => Resumed> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:27:54 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 1c8e780d-0a13-4484-bf18-ac0879db263a] VM Resumed (Lifecycle Event)
Aug 26 10:27:54 user nova-compute[73572]: DEBUG nova.compute.manager [None req-3b784915-9f22-49b8-b60f-07d035ff8e8c tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] [instance: 1c8e780d-0a13-4484-bf18-ac0879db263a] Instance event wait completed in 0 seconds for  {{(pid=73572) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 10:27:54 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-3b784915-9f22-49b8-b60f-07d035ff8e8c tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] [instance: 1c8e780d-0a13-4484-bf18-ac0879db263a] Guest created on hypervisor {{(pid=73572) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 10:27:54 user nova-compute[73572]: INFO nova.virt.libvirt.driver [-] [instance: 1c8e780d-0a13-4484-bf18-ac0879db263a] Instance spawned successfully.
Aug 26 10:27:54 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-3b784915-9f22-49b8-b60f-07d035ff8e8c tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] [instance: 1c8e780d-0a13-4484-bf18-ac0879db263a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 10:27:54 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 1c8e780d-0a13-4484-bf18-ac0879db263a] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:27:54 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 1c8e780d-0a13-4484-bf18-ac0879db263a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73572) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 10:27:54 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-3b784915-9f22-49b8-b60f-07d035ff8e8c tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] [instance: 1c8e780d-0a13-4484-bf18-ac0879db263a] Found default for hw_cdrom_bus of ide {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:27:54 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-3b784915-9f22-49b8-b60f-07d035ff8e8c tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] [instance: 1c8e780d-0a13-4484-bf18-ac0879db263a] Found default for hw_disk_bus of virtio {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:27:54 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-3b784915-9f22-49b8-b60f-07d035ff8e8c tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] [instance: 1c8e780d-0a13-4484-bf18-ac0879db263a] Found default for hw_input_bus of None {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:27:54 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-3b784915-9f22-49b8-b60f-07d035ff8e8c tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] [instance: 1c8e780d-0a13-4484-bf18-ac0879db263a] Found default for hw_pointer_model of None {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:27:54 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-3b784915-9f22-49b8-b60f-07d035ff8e8c tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] [instance: 1c8e780d-0a13-4484-bf18-ac0879db263a] Found default for hw_video_model of virtio {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:27:54 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-3b784915-9f22-49b8-b60f-07d035ff8e8c tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] [instance: 1c8e780d-0a13-4484-bf18-ac0879db263a] Found default for hw_vif_model of virtio {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:27:54 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 1c8e780d-0a13-4484-bf18-ac0879db263a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 10:27:54 user nova-compute[73572]: DEBUG nova.virt.driver [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Emitting event <LifecycleEvent: 1693045674.695412, 1c8e780d-0a13-4484-bf18-ac0879db263a => Started> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:27:54 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 1c8e780d-0a13-4484-bf18-ac0879db263a] VM Started (Lifecycle Event)
Aug 26 10:27:54 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 1c8e780d-0a13-4484-bf18-ac0879db263a] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:27:54 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 1c8e780d-0a13-4484-bf18-ac0879db263a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73572) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 10:27:54 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 1c8e780d-0a13-4484-bf18-ac0879db263a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 10:27:54 user nova-compute[73572]: INFO nova.compute.manager [None req-3b784915-9f22-49b8-b60f-07d035ff8e8c tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] [instance: 1c8e780d-0a13-4484-bf18-ac0879db263a] Took 6.04 seconds to spawn the instance on the hypervisor.
Aug 26 10:27:54 user nova-compute[73572]: DEBUG nova.compute.manager [None req-3b784915-9f22-49b8-b60f-07d035ff8e8c tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] [instance: 1c8e780d-0a13-4484-bf18-ac0879db263a] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:27:54 user nova-compute[73572]: DEBUG nova.compute.manager [req-cc96847d-c3a5-471e-942a-de5c57e7a562 req-3b584082-06b7-4bf8-ab09-a83fd97f68f8 service nova] [instance: 1c8e780d-0a13-4484-bf18-ac0879db263a] Received event network-vif-plugged-d03460b0-e0b9-4c39-a8a6-12cb80aca6bc {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:27:54 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-cc96847d-c3a5-471e-942a-de5c57e7a562 req-3b584082-06b7-4bf8-ab09-a83fd97f68f8 service nova] Acquiring lock "1c8e780d-0a13-4484-bf18-ac0879db263a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:27:54 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-cc96847d-c3a5-471e-942a-de5c57e7a562 req-3b584082-06b7-4bf8-ab09-a83fd97f68f8 service nova] Lock "1c8e780d-0a13-4484-bf18-ac0879db263a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:27:54 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-cc96847d-c3a5-471e-942a-de5c57e7a562 req-3b584082-06b7-4bf8-ab09-a83fd97f68f8 service nova] Lock "1c8e780d-0a13-4484-bf18-ac0879db263a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:27:54 user nova-compute[73572]: DEBUG nova.compute.manager [req-cc96847d-c3a5-471e-942a-de5c57e7a562 req-3b584082-06b7-4bf8-ab09-a83fd97f68f8 service nova] [instance: 1c8e780d-0a13-4484-bf18-ac0879db263a] No waiting events found dispatching network-vif-plugged-d03460b0-e0b9-4c39-a8a6-12cb80aca6bc {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:27:54 user nova-compute[73572]: WARNING nova.compute.manager [req-cc96847d-c3a5-471e-942a-de5c57e7a562 req-3b584082-06b7-4bf8-ab09-a83fd97f68f8 service nova] [instance: 1c8e780d-0a13-4484-bf18-ac0879db263a] Received unexpected event network-vif-plugged-d03460b0-e0b9-4c39-a8a6-12cb80aca6bc for instance with vm_state building and task_state spawning.
Aug 26 10:27:54 user nova-compute[73572]: INFO nova.compute.manager [None req-3b784915-9f22-49b8-b60f-07d035ff8e8c tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] [instance: 1c8e780d-0a13-4484-bf18-ac0879db263a] Took 6.97 seconds to build instance.
Aug 26 10:27:54 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-3b784915-9f22-49b8-b60f-07d035ff8e8c tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Lock "1c8e780d-0a13-4484-bf18-ac0879db263a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.267s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:27:55 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:27:56 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:27:56 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4894fa9d-2d66-4954-89b1-b8ae80ed70ed tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] [instance: 8bb0f50b-c8fb-4961-99c0-ca2b6b1768cd] Calling os-brick to attach iSCSI Volume {{(pid=73572) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 10:27:56 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-4894fa9d-2d66-4954-89b1-b8ae80ed70ed tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc89c3d6a10>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b2235d5a-9737-4ed6-bb6d-6aa8704db37f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ECMiIwNq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 10:27:56 user nova-compute[73572]: WARNING os_brick.initiator.connectors.base [None req-4894fa9d-2d66-4954-89b1-b8ae80ed70ed tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 10:27:56 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-4894fa9d-2d66-4954-89b1-b8ae80ed70ed tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 10:27:56 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-4894fa9d-2d66-4954-89b1-b8ae80ed70ed tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 10:27:56 user nova-compute[73572]: WARNING os_brick.initiator.connectors.base [None req-4894fa9d-2d66-4954-89b1-b8ae80ed70ed tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 10:27:56 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-4894fa9d-2d66-4954-89b1-b8ae80ed70ed tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b2235d5a-9737-4ed6-bb6d-6aa8704db37f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 10:27:56 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-4894fa9d-2d66-4954-89b1-b8ae80ed70ed tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b2235d5a-9737-4ed6-bb6d-6aa8704db37f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 10:27:56 user nova-compute[73572]: INFO os_brick.initiator.connectors.iscsi [None req-4894fa9d-2d66-4954-89b1-b8ae80ed70ed tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 10:27:56 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2235d5a-9737-4ed6-bb6d-6aa8704db37f -p 172.16.0.220:3260 {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:27:56 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2235d5a-9737-4ed6-bb6d-6aa8704db37f -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:27:56 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e2b7338-699c-4a32-ada1-10b967bcecc2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:27:56 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-4894fa9d-2d66-4954-89b1-b8ae80ed70ed tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 10:27:56 user nova-compute[73572]:  {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:27:56 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2235d5a-9737-4ed6-bb6d-6aa8704db37f -p 172.16.0.220:3260 --interface default --op new {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:27:56 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2235d5a-9737-4ed6-bb6d-6aa8704db37f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:27:56 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c733312-74dd-4e37-b677-55d1b75f5ba7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b2235d5a-9737-4ed6-bb6d-6aa8704db37f] added\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:27:56 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-4894fa9d-2d66-4954-89b1-b8ae80ed70ed tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b2235d5a-9737-4ed6-bb6d-6aa8704db37f] added
Aug 26 10:27:56 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:27:56 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2235d5a-9737-4ed6-bb6d-6aa8704db37f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:27:56 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2235d5a-9737-4ed6-bb6d-6aa8704db37f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:27:56 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[47fe16d5-4603-423e-9379-4dc650d135dd]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:27:56 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-4894fa9d-2d66-4954-89b1-b8ae80ed70ed tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:27:56 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2235d5a-9737-4ed6-bb6d-6aa8704db37f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:27:56 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2235d5a-9737-4ed6-bb6d-6aa8704db37f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:27:56 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[6900fe6c-53d2-44da-a7c3-be222889d3fd]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:27:56 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-4894fa9d-2d66-4954-89b1-b8ae80ed70ed tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:27:56 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2235d5a-9737-4ed6-bb6d-6aa8704db37f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ECMiIwNq {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:27:56 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2235d5a-9737-4ed6-bb6d-6aa8704db37f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ECMiIwNq" returned: 0 in 0.019s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:27:56 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[faedd333-3cea-422a-9b69-038de3d83ccc]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:27:56 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-4894fa9d-2d66-4954-89b1-b8ae80ed70ed tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ECMiIwNq'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:27:56 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2235d5a-9737-4ed6-bb6d-6aa8704db37f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:27:56 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2235d5a-9737-4ed6-bb6d-6aa8704db37f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:27:56 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6f97dc2-94f5-42c3-9134-22ac441393ce]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:27:56 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-4894fa9d-2d66-4954-89b1-b8ae80ed70ed tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:27:56 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:27:56 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:27:56 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[16a4eff7-626a-46cf-b5de-dbc9de565863]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133098b2-106a-427f-aa6d-2c10625dd152 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:448cd30a-3852-471f-903f-a2e5abc34b55 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f8ad7ba-4084-4cd7-920f-8f7948de4212 (non-flash)\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:27:56 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-4894fa9d-2d66-4954-89b1-b8ae80ed70ed tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)
Aug 26 10:27:56 user nova-compute[73572]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133098b2-106a-427f-aa6d-2c10625dd152 (non-flash)
Aug 26 10:27:56 user nova-compute[73572]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:448cd30a-3852-471f-903f-a2e5abc34b55 (non-flash)
Aug 26 10:27:56 user nova-compute[73572]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f8ad7ba-4084-4cd7-920f-8f7948de4212 (non-flash)
Aug 26 10:27:56 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 10:27:56 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-4894fa9d-2d66-4954-89b1-b8ae80ed70ed tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)
Aug 26 10:27:56 user nova-compute[73572]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133098b2-106a-427f-aa6d-2c10625dd152 (non-flash)
Aug 26 10:27:56 user nova-compute[73572]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:448cd30a-3852-471f-903f-a2e5abc34b55 (non-flash)
Aug 26 10:27:56 user nova-compute[73572]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f8ad7ba-4084-4cd7-920f-8f7948de4212 (non-flash)
Aug 26 10:27:56 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 10:27:56 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2235d5a-9737-4ed6-bb6d-6aa8704db37f -p 172.16.0.220:3260 --login {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:27:56 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2235d5a-9737-4ed6-bb6d-6aa8704db37f -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:27:56 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[73ad09ea-427d-4ee0-badb-3a223c9cd8ca]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b2235d5a-9737-4ed6-bb6d-6aa8704db37f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b2235d5a-9737-4ed6-bb6d-6aa8704db37f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:27:56 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-4894fa9d-2d66-4954-89b1-b8ae80ed70ed tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b2235d5a-9737-4ed6-bb6d-6aa8704db37f, portal: 172.16.0.220,3260]
Aug 26 10:27:56 user nova-compute[73572]: Login to [iface: default, target: iqn.2010-10.org.openstack:b2235d5a-9737-4ed6-bb6d-6aa8704db37f, portal: 172.16.0.220,3260] successful.
Aug 26 10:27:56 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:27:56 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2235d5a-9737-4ed6-bb6d-6aa8704db37f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:27:56 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2235d5a-9737-4ed6-bb6d-6aa8704db37f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:27:56 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[eae59101-f987-4662-b1e8-33e4f9118a11]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:27:56 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-4894fa9d-2d66-4954-89b1-b8ae80ed70ed tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:27:56 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:27:56 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:27:56 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[302bcb21-6b56-48eb-8f57-94bce44b4e0f]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133098b2-106a-427f-aa6d-2c10625dd152 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:448cd30a-3852-471f-903f-a2e5abc34b55 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f8ad7ba-4084-4cd7-920f-8f7948de4212 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2235d5a-9737-4ed6-bb6d-6aa8704db37f (non-flash)\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:27:56 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-4894fa9d-2d66-4954-89b1-b8ae80ed70ed tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)
Aug 26 10:27:56 user nova-compute[73572]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133098b2-106a-427f-aa6d-2c10625dd152 (non-flash)
Aug 26 10:27:56 user nova-compute[73572]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:448cd30a-3852-471f-903f-a2e5abc34b55 (non-flash)
Aug 26 10:27:56 user nova-compute[73572]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f8ad7ba-4084-4cd7-920f-8f7948de4212 (non-flash)
Aug 26 10:27:56 user nova-compute[73572]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2235d5a-9737-4ed6-bb6d-6aa8704db37f (non-flash)
Aug 26 10:27:56 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 10:27:56 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-4894fa9d-2d66-4954-89b1-b8ae80ed70ed tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)
Aug 26 10:27:56 user nova-compute[73572]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133098b2-106a-427f-aa6d-2c10625dd152 (non-flash)
Aug 26 10:27:56 user nova-compute[73572]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:448cd30a-3852-471f-903f-a2e5abc34b55 (non-flash)
Aug 26 10:27:56 user nova-compute[73572]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f8ad7ba-4084-4cd7-920f-8f7948de4212 (non-flash)
Aug 26 10:27:56 user nova-compute[73572]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2235d5a-9737-4ed6-bb6d-6aa8704db37f (non-flash)
Aug 26 10:27:56 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 10:27:56 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-4894fa9d-2d66-4954-89b1-b8ae80ed70ed tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b2235d5a-9737-4ed6-bb6d-6aa8704db37f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.283s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 10:27:56 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-4894fa9d-2d66-4954-89b1-b8ae80ed70ed tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Connected to 172.16.0.220:3260 {{(pid=73572) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 10:27:56 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-4894fa9d-2d66-4954-89b1-b8ae80ed70ed tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] HCTL ('35', '-', '-', 0) found on session 40 with lun 0 {{(pid=73572) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 10:27:56 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-4894fa9d-2d66-4954-89b1-b8ae80ed70ed tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73572) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 10:27:56 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:27:56 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:27:56 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[585bb358-8d33-4ace-af81-304551caf216]: (4, ('- - 0', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:27:56 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-4894fa9d-2d66-4954-89b1-b8ae80ed70ed tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Searching for a device in session 40 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73572) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 10:27:56 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-4894fa9d-2d66-4954-89b1-b8ae80ed70ed tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ECMiIwNq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73572) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 10:27:57 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-4894fa9d-2d66-4954-89b1-b8ae80ed70ed tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.317s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 10:27:57 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-4894fa9d-2d66-4954-89b1-b8ae80ed70ed tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] <== connect_volume: return (1318ms) {'type': 'block', 'scsi_wwn': '26533313666393563', 'path': '/dev/sdd'} {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 10:27:57 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4894fa9d-2d66-4954-89b1-b8ae80ed70ed tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] [instance: 8bb0f50b-c8fb-4961-99c0-ca2b6b1768cd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26533313666393563', 'path': '/dev/sdd'} {{(pid=73572) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 10:27:57 user nova-compute[73572]: DEBUG nova.objects.instance [None req-4894fa9d-2d66-4954-89b1-b8ae80ed70ed tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Lazy-loading 'flavor' on Instance uuid 8bb0f50b-c8fb-4961-99c0-ca2b6b1768cd {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:27:57 user nova-compute[73572]: DEBUG nova.virt.libvirt.guest [None req-4894fa9d-2d66-4954-89b1-b8ae80ed70ed tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 10:27:57 user nova-compute[73572]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 10:27:57 user nova-compute[73572]:   <source dev="/dev/sdd"/>
Aug 26 10:27:57 user nova-compute[73572]:   <target dev="vdb" bus="virtio"/>
Aug 26 10:27:57 user nova-compute[73572]:   <serial>b2235d5a-9737-4ed6-bb6d-6aa8704db37f</serial>
Aug 26 10:27:57 user nova-compute[73572]: </disk>
Aug 26 10:27:57 user nova-compute[73572]:  {{(pid=73572) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 10:27:58 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-4894fa9d-2d66-4954-89b1-b8ae80ed70ed tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] No BDM found with device name vda, not building metadata. {{(pid=73572) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 10:27:58 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-4894fa9d-2d66-4954-89b1-b8ae80ed70ed tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73572) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 10:27:58 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-4894fa9d-2d66-4954-89b1-b8ae80ed70ed tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] No VIF found with MAC fa:16:3e:4a:d9:27, not building metadata {{(pid=73572) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 10:27:58 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-4894fa9d-2d66-4954-89b1-b8ae80ed70ed tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Lock "8bb0f50b-c8fb-4961-99c0-ca2b6b1768cd" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.267s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:28:00 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:28:01 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:28:03 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._sync_power_states {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:28:03 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Triggering sync for uuid c785b609-0068-442f-91f5-d26e888a993f {{(pid=73572) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 10:28:03 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Triggering sync for uuid 14fab12e-52be-4fe6-8777-bc7ebf3c25f1 {{(pid=73572) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 10:28:03 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Triggering sync for uuid 2eaea7c2-a5c0-4950-b033-0012b5cec0ee {{(pid=73572) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 10:28:03 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Triggering sync for uuid 86923c1a-89a5-4e7a-b488-8bf3a013bf83 {{(pid=73572) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 10:28:03 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Triggering sync for uuid e468b473-515f-41ad-a75c-65d4c6d575c8 {{(pid=73572) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 10:28:03 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Triggering sync for uuid 68613b1e-c45c-4fd9-834c-3630ed0f456a {{(pid=73572) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 10:28:03 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Triggering sync for uuid 8a8816e5-696d-4384-b0e0-29aa7cdd957c {{(pid=73572) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 10:28:03 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Triggering sync for uuid 8bb0f50b-c8fb-4961-99c0-ca2b6b1768cd {{(pid=73572) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 10:28:03 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Triggering sync for uuid f3fe3865-3d85-46cf-b24f-10b07e23aeff {{(pid=73572) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 10:28:03 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Triggering sync for uuid d03d1626-e18b-4b15-a679-4543f7641ed7 {{(pid=73572) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 10:28:03 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Triggering sync for uuid 1c8e780d-0a13-4484-bf18-ac0879db263a {{(pid=73572) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 10:28:03 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Triggering sync for uuid 6b2d5f4e-37af-438c-859b-d4ca803b7d08 {{(pid=73572) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 10:28:03 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquiring lock "c785b609-0068-442f-91f5-d26e888a993f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:28:03 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "c785b609-0068-442f-91f5-d26e888a993f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:28:03 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquiring lock "14fab12e-52be-4fe6-8777-bc7ebf3c25f1" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:28:03 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "14fab12e-52be-4fe6-8777-bc7ebf3c25f1" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:28:03 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquiring lock "2eaea7c2-a5c0-4950-b033-0012b5cec0ee" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:28:03 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "2eaea7c2-a5c0-4950-b033-0012b5cec0ee" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:28:03 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquiring lock "86923c1a-89a5-4e7a-b488-8bf3a013bf83" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:28:03 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "86923c1a-89a5-4e7a-b488-8bf3a013bf83" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:28:03 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquiring lock "e468b473-515f-41ad-a75c-65d4c6d575c8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:28:03 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "e468b473-515f-41ad-a75c-65d4c6d575c8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:28:03 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquiring lock "68613b1e-c45c-4fd9-834c-3630ed0f456a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:28:03 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "68613b1e-c45c-4fd9-834c-3630ed0f456a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:28:03 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquiring lock "8a8816e5-696d-4384-b0e0-29aa7cdd957c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:28:03 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "8a8816e5-696d-4384-b0e0-29aa7cdd957c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:28:03 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquiring lock "8bb0f50b-c8fb-4961-99c0-ca2b6b1768cd" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:28:03 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "8bb0f50b-c8fb-4961-99c0-ca2b6b1768cd" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:28:03 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquiring lock "f3fe3865-3d85-46cf-b24f-10b07e23aeff" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:28:03 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "f3fe3865-3d85-46cf-b24f-10b07e23aeff" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:28:03 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquiring lock "d03d1626-e18b-4b15-a679-4543f7641ed7" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:28:03 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "d03d1626-e18b-4b15-a679-4543f7641ed7" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:28:03 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquiring lock "1c8e780d-0a13-4484-bf18-ac0879db263a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:28:03 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "1c8e780d-0a13-4484-bf18-ac0879db263a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:28:03 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquiring lock "6b2d5f4e-37af-438c-859b-d4ca803b7d08" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:28:03 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "6b2d5f4e-37af-438c-859b-d4ca803b7d08" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:28:03 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "c785b609-0068-442f-91f5-d26e888a993f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.041s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:28:03 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "14fab12e-52be-4fe6-8777-bc7ebf3c25f1" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.047s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:28:03 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "2eaea7c2-a5c0-4950-b033-0012b5cec0ee" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.046s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:28:03 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "86923c1a-89a5-4e7a-b488-8bf3a013bf83" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.055s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:28:03 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "68613b1e-c45c-4fd9-834c-3630ed0f456a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.062s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:28:03 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "e468b473-515f-41ad-a75c-65d4c6d575c8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.075s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:28:03 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "8a8816e5-696d-4384-b0e0-29aa7cdd957c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.076s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:28:03 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "f3fe3865-3d85-46cf-b24f-10b07e23aeff" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.083s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:28:03 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "d03d1626-e18b-4b15-a679-4543f7641ed7" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.091s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:28:03 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "6b2d5f4e-37af-438c-859b-d4ca803b7d08" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.091s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:28:03 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "8bb0f50b-c8fb-4961-99c0-ca2b6b1768cd" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.096s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:28:03 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "1c8e780d-0a13-4484-bf18-ac0879db263a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.096s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:28:03 user nova-compute[73572]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693045668.48635, 1f3db0fa-682c-4b33-966b-9e50b7349b6e => Stopped> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:28:03 user nova-compute[73572]: INFO nova.compute.manager [-] [instance: 1f3db0fa-682c-4b33-966b-9e50b7349b6e] VM Stopped (Lifecycle Event)
Aug 26 10:28:03 user nova-compute[73572]: DEBUG nova.compute.manager [None req-3920e655-ae7d-435c-a9e0-f100bbd8669a None None] [instance: 1f3db0fa-682c-4b33-966b-9e50b7349b6e] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:28:03 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-b3dcc52e-9256-4a4a-9b8b-1dd0f9e3a79f tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Acquiring lock "8bb0f50b-c8fb-4961-99c0-ca2b6b1768cd" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:28:03 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-b3dcc52e-9256-4a4a-9b8b-1dd0f9e3a79f tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Lock "8bb0f50b-c8fb-4961-99c0-ca2b6b1768cd" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:28:03 user nova-compute[73572]: DEBUG nova.objects.instance [None req-b3dcc52e-9256-4a4a-9b8b-1dd0f9e3a79f tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Lazy-loading 'flavor' on Instance uuid 8bb0f50b-c8fb-4961-99c0-ca2b6b1768cd {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:28:03 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-b3dcc52e-9256-4a4a-9b8b-1dd0f9e3a79f tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Lock "8bb0f50b-c8fb-4961-99c0-ca2b6b1768cd" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.091s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:28:03 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-b3dcc52e-9256-4a4a-9b8b-1dd0f9e3a79f tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Acquiring lock "8bb0f50b-c8fb-4961-99c0-ca2b6b1768cd" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:28:03 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-b3dcc52e-9256-4a4a-9b8b-1dd0f9e3a79f tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Lock "8bb0f50b-c8fb-4961-99c0-ca2b6b1768cd" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:28:03 user nova-compute[73572]: INFO nova.compute.manager [None req-b3dcc52e-9256-4a4a-9b8b-1dd0f9e3a79f tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] [instance: 8bb0f50b-c8fb-4961-99c0-ca2b6b1768cd] Attaching volume 4fe105f9-87b1-4b96-9594-4cea247d4540 to /dev/vdc
Aug 26 10:28:03 user nova-compute[73572]: DEBUG os_brick.utils [None req-b3dcc52e-9256-4a4a-9b8b-1dd0f9e3a79f tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 10:28:03 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:28:04 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:28:04 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9a4fa32-16d8-4bca-9a38-f88d3ffba3b0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:de8a79ed912\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:28:04 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:28:04 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:28:04 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0f06f6f-c0aa-4cd9-8aee-52d6411b2284]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:28:04 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:28:04 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:28:04 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b0c82b8-c72a-4c80-9b57-e3d02c5097bd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:28:04 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[185bb0cb-12b4-4f47-9184-5d4666f840a5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:28:04 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-b3dcc52e-9256-4a4a-9b8b-1dd0f9e3a79f tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Running cmd (subprocess): nvme version {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:28:04 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-b3dcc52e-9256-4a4a-9b8b-1dd0f9e3a79f tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] 'nvme version' failed. Not Retrying. {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 10:28:04 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b3dcc52e-9256-4a4a-9b8b-1dd0f9e3a79f tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] nvme not present on system {{(pid=73572) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 10:28:04 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:28:04 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 10:28:04 user nova-compute[73572]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 10:28:04 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a79efb4-9363-4634-a0cc-2ec8ee5d8b67]: (4, '') {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:28:04 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.lightos [None req-b3dcc52e-9256-4a4a-9b8b-1dd0f9e3a79f tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73572) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 10:28:04 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.lightos [None req-b3dcc52e-9256-4a4a-9b8b-1dd0f9e3a79f tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73572) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 10:28:04 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.lightos [None req-b3dcc52e-9256-4a4a-9b8b-1dd0f9e3a79f tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] LIGHTOS: no hostnqn found. {{(pid=73572) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 10:28:04 user nova-compute[73572]: DEBUG os_brick.utils [None req-b3dcc52e-9256-4a4a-9b8b-1dd0f9e3a79f tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:de8a79ed912', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 10:28:04 user nova-compute[73572]: DEBUG nova.virt.block_device [None req-b3dcc52e-9256-4a4a-9b8b-1dd0f9e3a79f tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] [instance: 8bb0f50b-c8fb-4961-99c0-ca2b6b1768cd] Updating existing volume attachment record: 560a4d30-3130-48d4-b3b0-b8adc9cd3663 {{(pid=73572) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 10:28:05 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:28:06 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:28:10 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:28:11 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:28:15 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b3dcc52e-9256-4a4a-9b8b-1dd0f9e3a79f tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] [instance: 8bb0f50b-c8fb-4961-99c0-ca2b6b1768cd] Calling os-brick to attach iSCSI Volume {{(pid=73572) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 10:28:15 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3dcc52e-9256-4a4a-9b8b-1dd0f9e3a79f tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc89c3d6a10>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:4fe105f9-87b1-4b96-9594-4cea247d4540'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eWCZhipa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 10:28:15 user nova-compute[73572]: WARNING os_brick.initiator.connectors.base [None req-b3dcc52e-9256-4a4a-9b8b-1dd0f9e3a79f tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 10:28:15 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-b3dcc52e-9256-4a4a-9b8b-1dd0f9e3a79f tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 10:28:15 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-b3dcc52e-9256-4a4a-9b8b-1dd0f9e3a79f tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 10:28:15 user nova-compute[73572]: WARNING os_brick.initiator.connectors.base [None req-b3dcc52e-9256-4a4a-9b8b-1dd0f9e3a79f tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 10:28:15 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-b3dcc52e-9256-4a4a-9b8b-1dd0f9e3a79f tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4fe105f9-87b1-4b96-9594-4cea247d4540" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 10:28:15 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-b3dcc52e-9256-4a4a-9b8b-1dd0f9e3a79f tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4fe105f9-87b1-4b96-9594-4cea247d4540" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 10:28:15 user nova-compute[73572]: INFO os_brick.initiator.connectors.iscsi [None req-b3dcc52e-9256-4a4a-9b8b-1dd0f9e3a79f tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 10:28:15 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fe105f9-87b1-4b96-9594-4cea247d4540 -p 172.16.0.220:3260 {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:28:15 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fe105f9-87b1-4b96-9594-4cea247d4540 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:28:15 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f163912-a06a-4a7f-b594-69cfc58033b0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:28:15 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3dcc52e-9256-4a4a-9b8b-1dd0f9e3a79f tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 10:28:15 user nova-compute[73572]:  {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:28:15 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fe105f9-87b1-4b96-9594-4cea247d4540 -p 172.16.0.220:3260 --interface default --op new {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:28:15 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:28:15 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fe105f9-87b1-4b96-9594-4cea247d4540 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:28:15 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca828786-1df8-4079-af73-a0adff38d7b0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4fe105f9-87b1-4b96-9594-4cea247d4540] added\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:28:15 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3dcc52e-9256-4a4a-9b8b-1dd0f9e3a79f tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4fe105f9-87b1-4b96-9594-4cea247d4540] added
Aug 26 10:28:15 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:28:15 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fe105f9-87b1-4b96-9594-4cea247d4540 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:28:15 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fe105f9-87b1-4b96-9594-4cea247d4540 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:28:15 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[38686ee5-12fb-47e6-99b6-bcbcf4895116]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:28:15 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3dcc52e-9256-4a4a-9b8b-1dd0f9e3a79f tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:28:15 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fe105f9-87b1-4b96-9594-4cea247d4540 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:28:15 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fe105f9-87b1-4b96-9594-4cea247d4540 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:28:15 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[cab151cd-4c77-459c-b216-fed59ccbd2cf]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:28:15 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3dcc52e-9256-4a4a-9b8b-1dd0f9e3a79f tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:28:15 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fe105f9-87b1-4b96-9594-4cea247d4540 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eWCZhipa {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:28:15 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fe105f9-87b1-4b96-9594-4cea247d4540 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eWCZhipa" returned: 0 in 0.018s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:28:15 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[5535ad7c-3690-49d4-bcbb-15908d8ffb0d]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:28:15 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3dcc52e-9256-4a4a-9b8b-1dd0f9e3a79f tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'eWCZhipa'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:28:15 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fe105f9-87b1-4b96-9594-4cea247d4540 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:28:15 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fe105f9-87b1-4b96-9594-4cea247d4540 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:28:15 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[56c3ff1a-99f8-4c86-8982-f82ef56e9b1d]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:28:15 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3dcc52e-9256-4a4a-9b8b-1dd0f9e3a79f tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:28:15 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:28:15 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:28:15 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9d8aa8f-089c-4d5f-997d-c9c5a6fb55c7]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133098b2-106a-427f-aa6d-2c10625dd152 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:448cd30a-3852-471f-903f-a2e5abc34b55 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f8ad7ba-4084-4cd7-920f-8f7948de4212 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2235d5a-9737-4ed6-bb6d-6aa8704db37f (non-flash)\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:28:15 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3dcc52e-9256-4a4a-9b8b-1dd0f9e3a79f tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)
Aug 26 10:28:15 user nova-compute[73572]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133098b2-106a-427f-aa6d-2c10625dd152 (non-flash)
Aug 26 10:28:15 user nova-compute[73572]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:448cd30a-3852-471f-903f-a2e5abc34b55 (non-flash)
Aug 26 10:28:15 user nova-compute[73572]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f8ad7ba-4084-4cd7-920f-8f7948de4212 (non-flash)
Aug 26 10:28:15 user nova-compute[73572]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2235d5a-9737-4ed6-bb6d-6aa8704db37f (non-flash)
Aug 26 10:28:15 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 10:28:15 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3dcc52e-9256-4a4a-9b8b-1dd0f9e3a79f tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)
Aug 26 10:28:15 user nova-compute[73572]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133098b2-106a-427f-aa6d-2c10625dd152 (non-flash)
Aug 26 10:28:15 user nova-compute[73572]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:448cd30a-3852-471f-903f-a2e5abc34b55 (non-flash)
Aug 26 10:28:15 user nova-compute[73572]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f8ad7ba-4084-4cd7-920f-8f7948de4212 (non-flash)
Aug 26 10:28:15 user nova-compute[73572]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2235d5a-9737-4ed6-bb6d-6aa8704db37f (non-flash)
Aug 26 10:28:15 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 10:28:15 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fe105f9-87b1-4b96-9594-4cea247d4540 -p 172.16.0.220:3260 --login {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:28:15 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fe105f9-87b1-4b96-9594-4cea247d4540 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:28:15 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[c08e1be0-484e-4ed7-b637-14ac696006f5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4fe105f9-87b1-4b96-9594-4cea247d4540, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4fe105f9-87b1-4b96-9594-4cea247d4540, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:28:15 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3dcc52e-9256-4a4a-9b8b-1dd0f9e3a79f tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4fe105f9-87b1-4b96-9594-4cea247d4540, portal: 172.16.0.220,3260]
Aug 26 10:28:15 user nova-compute[73572]: Login to [iface: default, target: iqn.2010-10.org.openstack:4fe105f9-87b1-4b96-9594-4cea247d4540, portal: 172.16.0.220,3260] successful.
Aug 26 10:28:15 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:28:15 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fe105f9-87b1-4b96-9594-4cea247d4540 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:28:15 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fe105f9-87b1-4b96-9594-4cea247d4540 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:28:15 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dfb681f-08a0-4d0d-82c0-d69fb27be564]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:28:15 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3dcc52e-9256-4a4a-9b8b-1dd0f9e3a79f tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:28:15 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:28:15 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:28:15 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[a70e0ab0-b513-47ac-9527-ffae3aa83be4]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133098b2-106a-427f-aa6d-2c10625dd152 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:448cd30a-3852-471f-903f-a2e5abc34b55 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f8ad7ba-4084-4cd7-920f-8f7948de4212 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2235d5a-9737-4ed6-bb6d-6aa8704db37f (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fe105f9-87b1-4b96-9594-4cea247d4540 (non-flash)\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:28:15 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3dcc52e-9256-4a4a-9b8b-1dd0f9e3a79f tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)
Aug 26 10:28:15 user nova-compute[73572]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133098b2-106a-427f-aa6d-2c10625dd152 (non-flash)
Aug 26 10:28:15 user nova-compute[73572]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:448cd30a-3852-471f-903f-a2e5abc34b55 (non-flash)
Aug 26 10:28:15 user nova-compute[73572]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f8ad7ba-4084-4cd7-920f-8f7948de4212 (non-flash)
Aug 26 10:28:15 user nova-compute[73572]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2235d5a-9737-4ed6-bb6d-6aa8704db37f (non-flash)
Aug 26 10:28:15 user nova-compute[73572]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fe105f9-87b1-4b96-9594-4cea247d4540 (non-flash)
Aug 26 10:28:15 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 10:28:15 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3dcc52e-9256-4a4a-9b8b-1dd0f9e3a79f tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)
Aug 26 10:28:15 user nova-compute[73572]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133098b2-106a-427f-aa6d-2c10625dd152 (non-flash)
Aug 26 10:28:15 user nova-compute[73572]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:448cd30a-3852-471f-903f-a2e5abc34b55 (non-flash)
Aug 26 10:28:15 user nova-compute[73572]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f8ad7ba-4084-4cd7-920f-8f7948de4212 (non-flash)
Aug 26 10:28:15 user nova-compute[73572]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2235d5a-9737-4ed6-bb6d-6aa8704db37f (non-flash)
Aug 26 10:28:15 user nova-compute[73572]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fe105f9-87b1-4b96-9594-4cea247d4540 (non-flash)
Aug 26 10:28:15 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 10:28:15 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-b3dcc52e-9256-4a4a-9b8b-1dd0f9e3a79f tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4fe105f9-87b1-4b96-9594-4cea247d4540" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.289s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 10:28:15 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3dcc52e-9256-4a4a-9b8b-1dd0f9e3a79f tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Connected to 172.16.0.220:3260 {{(pid=73572) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 10:28:15 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-b3dcc52e-9256-4a4a-9b8b-1dd0f9e3a79f tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] HCTL ('38', '-', '-', 0) found on session 41 with lun 0 {{(pid=73572) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 10:28:15 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-b3dcc52e-9256-4a4a-9b8b-1dd0f9e3a79f tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=73572) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 10:28:15 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:28:15 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.016s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:28:15 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[181682c5-7c9a-4fc7-ab17-17757382eb60]: (4, ('- - 0', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:28:15 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-b3dcc52e-9256-4a4a-9b8b-1dd0f9e3a79f tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Searching for a device in session 41 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=73572) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 10:28:15 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3dcc52e-9256-4a4a-9b8b-1dd0f9e3a79f tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eWCZhipa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73572) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 10:28:16 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:28:16 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-b3dcc52e-9256-4a4a-9b8b-1dd0f9e3a79f tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.322s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 10:28:16 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3dcc52e-9256-4a4a-9b8b-1dd0f9e3a79f tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] <== connect_volume: return (1324ms) {'type': 'block', 'scsi_wwn': '23732626662343234', 'path': '/dev/sdg'} {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 10:28:16 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b3dcc52e-9256-4a4a-9b8b-1dd0f9e3a79f tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] [instance: 8bb0f50b-c8fb-4961-99c0-ca2b6b1768cd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23732626662343234', 'path': '/dev/sdg'} {{(pid=73572) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 10:28:16 user nova-compute[73572]: DEBUG nova.objects.instance [None req-b3dcc52e-9256-4a4a-9b8b-1dd0f9e3a79f tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Lazy-loading 'flavor' on Instance uuid 8bb0f50b-c8fb-4961-99c0-ca2b6b1768cd {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:28:16 user nova-compute[73572]: DEBUG nova.virt.libvirt.guest [None req-b3dcc52e-9256-4a4a-9b8b-1dd0f9e3a79f tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 10:28:16 user nova-compute[73572]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 10:28:16 user nova-compute[73572]:   <source dev="/dev/sdg"/>
Aug 26 10:28:16 user nova-compute[73572]:   <target dev="vdc" bus="virtio"/>
Aug 26 10:28:16 user nova-compute[73572]:   <serial>4fe105f9-87b1-4b96-9594-4cea247d4540</serial>
Aug 26 10:28:16 user nova-compute[73572]: </disk>
Aug 26 10:28:16 user nova-compute[73572]:  {{(pid=73572) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 10:28:16 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:28:16 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Starting heal instance info cache {{(pid=73572) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 10:28:16 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquiring lock "refresh_cache-86923c1a-89a5-4e7a-b488-8bf3a013bf83" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:28:16 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquired lock "refresh_cache-86923c1a-89a5-4e7a-b488-8bf3a013bf83" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:28:16 user nova-compute[73572]: DEBUG nova.network.neutron [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] [instance: 86923c1a-89a5-4e7a-b488-8bf3a013bf83] Forcefully refreshing network info cache for instance {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 10:28:17 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-b3dcc52e-9256-4a4a-9b8b-1dd0f9e3a79f tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] No BDM found with device name vda, not building metadata. {{(pid=73572) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 10:28:17 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-b3dcc52e-9256-4a4a-9b8b-1dd0f9e3a79f tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73572) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 10:28:17 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-b3dcc52e-9256-4a4a-9b8b-1dd0f9e3a79f tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] No BDM found with device name vdc, not building metadata. {{(pid=73572) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 10:28:17 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-b3dcc52e-9256-4a4a-9b8b-1dd0f9e3a79f tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] No VIF found with MAC fa:16:3e:4a:d9:27, not building metadata {{(pid=73572) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 10:28:17 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-b3dcc52e-9256-4a4a-9b8b-1dd0f9e3a79f tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Lock "8bb0f50b-c8fb-4961-99c0-ca2b6b1768cd" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.259s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:28:17 user nova-compute[73572]: DEBUG nova.network.neutron [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] [instance: 86923c1a-89a5-4e7a-b488-8bf3a013bf83] Updating instance_info_cache with network_info: [{"id": "db682944-8949-4bf9-b9d5-2213f0d507bc", "address": "fa:16:3e:7d:b9:15", "network": {"id": "757e71b4-5177-45a5-8ef5-9b27f42092f1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1765327616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1bff48d66894950ac6690e1fd0e79b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb682944-89", "ovs_interfaceid": "db682944-8949-4bf9-b9d5-2213f0d507bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:28:17 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Releasing lock "refresh_cache-86923c1a-89a5-4e7a-b488-8bf3a013bf83" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:28:17 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] [instance: 86923c1a-89a5-4e7a-b488-8bf3a013bf83] Updated the network info_cache for instance {{(pid=73572) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 10:28:17 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:28:18 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-24bd33f7-914e-4614-a589-31f7fb9a905c tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Acquiring lock "8bb0f50b-c8fb-4961-99c0-ca2b6b1768cd" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:28:18 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-24bd33f7-914e-4614-a589-31f7fb9a905c tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Lock "8bb0f50b-c8fb-4961-99c0-ca2b6b1768cd" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:28:18 user nova-compute[73572]: INFO nova.compute.manager [None req-24bd33f7-914e-4614-a589-31f7fb9a905c tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] [instance: 8bb0f50b-c8fb-4961-99c0-ca2b6b1768cd] Detaching volume b2235d5a-9737-4ed6-bb6d-6aa8704db37f
Aug 26 10:28:18 user nova-compute[73572]: INFO nova.virt.block_device [None req-24bd33f7-914e-4614-a589-31f7fb9a905c tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] [instance: 8bb0f50b-c8fb-4961-99c0-ca2b6b1768cd] Attempting to driver detach volume b2235d5a-9737-4ed6-bb6d-6aa8704db37f from mountpoint /dev/vdb
Aug 26 10:28:18 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-24bd33f7-914e-4614-a589-31f7fb9a905c tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Attempting to detach device vdb from instance 8bb0f50b-c8fb-4961-99c0-ca2b6b1768cd from the persistent domain config. {{(pid=73572) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 10:28:18 user nova-compute[73572]: DEBUG nova.virt.libvirt.guest [None req-24bd33f7-914e-4614-a589-31f7fb9a905c tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 10:28:18 user nova-compute[73572]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 10:28:18 user nova-compute[73572]:   <source dev="/dev/sdd"/>
Aug 26 10:28:18 user nova-compute[73572]:   <target dev="vdb" bus="virtio"/>
Aug 26 10:28:18 user nova-compute[73572]:   <serial>b2235d5a-9737-4ed6-bb6d-6aa8704db37f</serial>
Aug 26 10:28:18 user nova-compute[73572]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 10:28:18 user nova-compute[73572]: </disk>
Aug 26 10:28:18 user nova-compute[73572]:  {{(pid=73572) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 10:28:18 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-24bd33f7-914e-4614-a589-31f7fb9a905c tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Successfully detached device vdb from instance 8bb0f50b-c8fb-4961-99c0-ca2b6b1768cd from the persistent domain config.
Aug 26 10:28:18 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-24bd33f7-914e-4614-a589-31f7fb9a905c tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8bb0f50b-c8fb-4961-99c0-ca2b6b1768cd from the live domain config. {{(pid=73572) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 10:28:18 user nova-compute[73572]: DEBUG nova.virt.libvirt.guest [None req-24bd33f7-914e-4614-a589-31f7fb9a905c tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 10:28:18 user nova-compute[73572]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 10:28:18 user nova-compute[73572]:   <source dev="/dev/sdd"/>
Aug 26 10:28:18 user nova-compute[73572]:   <target dev="vdb" bus="virtio"/>
Aug 26 10:28:18 user nova-compute[73572]:   <serial>b2235d5a-9737-4ed6-bb6d-6aa8704db37f</serial>
Aug 26 10:28:18 user nova-compute[73572]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 10:28:18 user nova-compute[73572]: </disk>
Aug 26 10:28:18 user nova-compute[73572]:  {{(pid=73572) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 10:28:18 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Received event <DeviceRemovedEvent: 1693045698.787818, 8bb0f50b-c8fb-4961-99c0-ca2b6b1768cd => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73572) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 10:28:18 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-24bd33f7-914e-4614-a589-31f7fb9a905c tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8bb0f50b-c8fb-4961-99c0-ca2b6b1768cd {{(pid=73572) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 10:28:18 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-24bd33f7-914e-4614-a589-31f7fb9a905c tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Successfully detached device vdb from instance 8bb0f50b-c8fb-4961-99c0-ca2b6b1768cd from the live domain config.
Aug 26 10:28:18 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-24bd33f7-914e-4614-a589-31f7fb9a905c tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] [instance: 8bb0f50b-c8fb-4961-99c0-ca2b6b1768cd] calling os-brick to detach iSCSI Volume {{(pid=73572) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 10:28:18 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-24bd33f7-914e-4614-a589-31f7fb9a905c tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc89c3d6a10>, {'target_iqns': ['iqn.2010-10.org.openstack:b2235d5a-9737-4ed6-bb6d-6aa8704db37f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ECMiIwNq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 10:28:18 user nova-compute[73572]: WARNING os_brick.initiator.connectors.base [None req-24bd33f7-914e-4614-a589-31f7fb9a905c tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 10:28:18 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-24bd33f7-914e-4614-a589-31f7fb9a905c tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 10:28:18 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-24bd33f7-914e-4614-a589-31f7fb9a905c tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 10:28:18 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-24bd33f7-914e-4614-a589-31f7fb9a905c tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b2235d5a-9737-4ed6-bb6d-6aa8704db37f', 0)] {{(pid=73572) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 10:28:18 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:28:18 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:28:18 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce5fa5d0-f44c-47cd-a373-917a85152605]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:133098b2-106a-427f-aa6d-2c10625dd152\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:448cd30a-3852-471f-903f-a2e5abc34b55\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4fe105f9-87b1-4b96-9594-4cea247d4540\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8f8ad7ba-4084-4cd7-920f-8f7948de4212\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b2235d5a-9737-4ed6-bb6d-6aa8704db37f\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:28:18 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:28:18 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:28:18 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c9fd59d-a3d1-4058-a93e-1ee29d3c0150]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133098b2-106a-427f-aa6d-2c10625dd152 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:448cd30a-3852-471f-903f-a2e5abc34b55 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f8ad7ba-4084-4cd7-920f-8f7948de4212 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2235d5a-9737-4ed6-bb6d-6aa8704db37f (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fe105f9-87b1-4b96-9594-4cea247d4540 (non-flash)\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:28:18 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-24bd33f7-914e-4614-a589-31f7fb9a905c tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)
Aug 26 10:28:18 user nova-compute[73572]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133098b2-106a-427f-aa6d-2c10625dd152 (non-flash)
Aug 26 10:28:18 user nova-compute[73572]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:448cd30a-3852-471f-903f-a2e5abc34b55 (non-flash)
Aug 26 10:28:18 user nova-compute[73572]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f8ad7ba-4084-4cd7-920f-8f7948de4212 (non-flash)
Aug 26 10:28:18 user nova-compute[73572]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2235d5a-9737-4ed6-bb6d-6aa8704db37f (non-flash)
Aug 26 10:28:18 user nova-compute[73572]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fe105f9-87b1-4b96-9594-4cea247d4540 (non-flash)
Aug 26 10:28:18 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 10:28:18 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-24bd33f7-914e-4614-a589-31f7fb9a905c tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)
Aug 26 10:28:18 user nova-compute[73572]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133098b2-106a-427f-aa6d-2c10625dd152 (non-flash)
Aug 26 10:28:18 user nova-compute[73572]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:448cd30a-3852-471f-903f-a2e5abc34b55 (non-flash)
Aug 26 10:28:18 user nova-compute[73572]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f8ad7ba-4084-4cd7-920f-8f7948de4212 (non-flash)
Aug 26 10:28:18 user nova-compute[73572]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2235d5a-9737-4ed6-bb6d-6aa8704db37f (non-flash)
Aug 26 10:28:18 user nova-compute[73572]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fe105f9-87b1-4b96-9594-4cea247d4540 (non-flash)
Aug 26 10:28:18 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 10:28:18 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-24bd33f7-914e-4614-a589-31f7fb9a905c tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc878a652d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b2235d5a-9737-4ed6-bb6d-6aa8704db37f'): ({'sdd'}, set())}) {{(pid=73572) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 10:28:18 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-24bd33f7-914e-4614-a589-31f7fb9a905c tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Removing single pathed devices sdd {{(pid=73572) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 10:28:18 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:28:18 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:28:18 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9b9a973-6de9-4384-9662-2fdeb5d61941]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:28:18 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:28:18 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:28:18 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[109ed8a3-f3d8-4df4-9d90-724c8e3c4333]: (4, ('ok\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:28:18 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-24bd33f7-914e-4614-a589-31f7fb9a905c tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Flushing IO for device /dev/sdd {{(pid=73572) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 10:28:18 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:28:18 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:28:18 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f7eaec0-1eaf-4ab6-9215-dba0d7781d44]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:28:18 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-24bd33f7-914e-4614-a589-31f7fb9a905c tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73572) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 10:28:18 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:28:18 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.042s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:28:18 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[32ac525c-c65f-420a-ac87-97598da53538]: (4, ('1', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:28:18 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-24bd33f7-914e-4614-a589-31f7fb9a905c tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73572) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 10:28:18 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-24bd33f7-914e-4614-a589-31f7fb9a905c tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] SCSI volumes sdd have been removed. {{(pid=73572) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 10:28:18 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-24bd33f7-914e-4614-a589-31f7fb9a905c tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b2235d5a-9737-4ed6-bb6d-6aa8704db37f')] {{(pid=73572) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 10:28:18 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2235d5a-9737-4ed6-bb6d-6aa8704db37f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:28:18 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2235d5a-9737-4ed6-bb6d-6aa8704db37f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:28:18 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[87435a8f-2ea5-4515-8e82-ee5edd7544e4]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:28:18 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-24bd33f7-914e-4614-a589-31f7fb9a905c tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:28:18 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2235d5a-9737-4ed6-bb6d-6aa8704db37f -p 172.16.0.220:3260 --logout {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:28:19 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2235d5a-9737-4ed6-bb6d-6aa8704db37f -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:28:19 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[45f8a187-3c8e-4731-aebe-ce36a6e2a773]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:b2235d5a-9737-4ed6-bb6d-6aa8704db37f, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:b2235d5a-9737-4ed6-bb6d-6aa8704db37f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:28:19 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-24bd33f7-914e-4614-a589-31f7fb9a905c tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:b2235d5a-9737-4ed6-bb6d-6aa8704db37f, portal: 172.16.0.220,3260]
Aug 26 10:28:19 user nova-compute[73572]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:b2235d5a-9737-4ed6-bb6d-6aa8704db37f, portal: 172.16.0.220,3260] successful.
Aug 26 10:28:19 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:28:19 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2235d5a-9737-4ed6-bb6d-6aa8704db37f -p 172.16.0.220:3260 --op delete {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:28:19 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2235d5a-9737-4ed6-bb6d-6aa8704db37f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:28:19 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9c27730-11aa-4c70-bc33-d21dc5070531]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:28:19 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-24bd33f7-914e-4614-a589-31f7fb9a905c tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:28:19 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-24bd33f7-914e-4614-a589-31f7fb9a905c tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.299s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 10:28:19 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-24bd33f7-914e-4614-a589-31f7fb9a905c tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] <== disconnect_volume: return (300ms) None {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 10:28:19 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-24bd33f7-914e-4614-a589-31f7fb9a905c tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] [instance: 8bb0f50b-c8fb-4961-99c0-ca2b6b1768cd] Disconnected iSCSI Volume {{(pid=73572) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 10:28:19 user nova-compute[73572]: DEBUG nova.objects.instance [None req-24bd33f7-914e-4614-a589-31f7fb9a905c tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Lazy-loading 'flavor' on Instance uuid 8bb0f50b-c8fb-4961-99c0-ca2b6b1768cd {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:28:19 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-24bd33f7-914e-4614-a589-31f7fb9a905c tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Lock "8bb0f50b-c8fb-4961-99c0-ca2b6b1768cd" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.728s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:28:20 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:28:20 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-166b328b-50e4-4357-b110-073d8628c818 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Acquiring lock "8bb0f50b-c8fb-4961-99c0-ca2b6b1768cd" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:28:20 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-166b328b-50e4-4357-b110-073d8628c818 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Lock "8bb0f50b-c8fb-4961-99c0-ca2b6b1768cd" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:28:20 user nova-compute[73572]: INFO nova.compute.manager [None req-166b328b-50e4-4357-b110-073d8628c818 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] [instance: 8bb0f50b-c8fb-4961-99c0-ca2b6b1768cd] Detaching volume 4fe105f9-87b1-4b96-9594-4cea247d4540
Aug 26 10:28:20 user nova-compute[73572]: INFO nova.virt.block_device [None req-166b328b-50e4-4357-b110-073d8628c818 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] [instance: 8bb0f50b-c8fb-4961-99c0-ca2b6b1768cd] Attempting to driver detach volume 4fe105f9-87b1-4b96-9594-4cea247d4540 from mountpoint /dev/vdc
Aug 26 10:28:20 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-166b328b-50e4-4357-b110-073d8628c818 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Attempting to detach device vdc from instance 8bb0f50b-c8fb-4961-99c0-ca2b6b1768cd from the persistent domain config. {{(pid=73572) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 10:28:20 user nova-compute[73572]: DEBUG nova.virt.libvirt.guest [None req-166b328b-50e4-4357-b110-073d8628c818 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 10:28:20 user nova-compute[73572]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 10:28:20 user nova-compute[73572]:   <source dev="/dev/sdg"/>
Aug 26 10:28:20 user nova-compute[73572]:   <target dev="vdc" bus="virtio"/>
Aug 26 10:28:20 user nova-compute[73572]:   <serial>4fe105f9-87b1-4b96-9594-4cea247d4540</serial>
Aug 26 10:28:20 user nova-compute[73572]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 26 10:28:20 user nova-compute[73572]: </disk>
Aug 26 10:28:20 user nova-compute[73572]:  {{(pid=73572) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 10:28:20 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-166b328b-50e4-4357-b110-073d8628c818 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Successfully detached device vdc from instance 8bb0f50b-c8fb-4961-99c0-ca2b6b1768cd from the persistent domain config.
Aug 26 10:28:20 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-166b328b-50e4-4357-b110-073d8628c818 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 8bb0f50b-c8fb-4961-99c0-ca2b6b1768cd from the live domain config. {{(pid=73572) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 10:28:20 user nova-compute[73572]: DEBUG nova.virt.libvirt.guest [None req-166b328b-50e4-4357-b110-073d8628c818 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 10:28:20 user nova-compute[73572]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 10:28:20 user nova-compute[73572]:   <source dev="/dev/sdg"/>
Aug 26 10:28:20 user nova-compute[73572]:   <target dev="vdc" bus="virtio"/>
Aug 26 10:28:20 user nova-compute[73572]:   <serial>4fe105f9-87b1-4b96-9594-4cea247d4540</serial>
Aug 26 10:28:20 user nova-compute[73572]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 26 10:28:20 user nova-compute[73572]: </disk>
Aug 26 10:28:20 user nova-compute[73572]:  {{(pid=73572) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 10:28:20 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:28:20 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73572) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 10:28:21 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:28:21 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Received event <DeviceRemovedEvent: 1693045701.1924388, 8bb0f50b-c8fb-4961-99c0-ca2b6b1768cd => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=73572) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 10:28:21 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-166b328b-50e4-4357-b110-073d8628c818 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 8bb0f50b-c8fb-4961-99c0-ca2b6b1768cd {{(pid=73572) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 10:28:21 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-166b328b-50e4-4357-b110-073d8628c818 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Successfully detached device vdc from instance 8bb0f50b-c8fb-4961-99c0-ca2b6b1768cd from the live domain config.
Aug 26 10:28:21 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-166b328b-50e4-4357-b110-073d8628c818 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] [instance: 8bb0f50b-c8fb-4961-99c0-ca2b6b1768cd] calling os-brick to detach iSCSI Volume {{(pid=73572) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 10:28:21 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-166b328b-50e4-4357-b110-073d8628c818 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc89c3d6a10>, {'target_iqns': ['iqn.2010-10.org.openstack:4fe105f9-87b1-4b96-9594-4cea247d4540'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eWCZhipa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 10:28:21 user nova-compute[73572]: WARNING os_brick.initiator.connectors.base [None req-166b328b-50e4-4357-b110-073d8628c818 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 10:28:21 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-166b328b-50e4-4357-b110-073d8628c818 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 10:28:21 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-166b328b-50e4-4357-b110-073d8628c818 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 10:28:21 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-166b328b-50e4-4357-b110-073d8628c818 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4fe105f9-87b1-4b96-9594-4cea247d4540', 0)] {{(pid=73572) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 10:28:21 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:28:21 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:28:21 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[d688725e-37f5-42ba-baa6-ab9a6750492b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:133098b2-106a-427f-aa6d-2c10625dd152\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:448cd30a-3852-471f-903f-a2e5abc34b55\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4fe105f9-87b1-4b96-9594-4cea247d4540\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8f8ad7ba-4084-4cd7-920f-8f7948de4212\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:28:21 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:28:21 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:28:21 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[438944f5-80a8-4289-a712-f108cb8dbf44]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133098b2-106a-427f-aa6d-2c10625dd152 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:448cd30a-3852-471f-903f-a2e5abc34b55 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f8ad7ba-4084-4cd7-920f-8f7948de4212 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fe105f9-87b1-4b96-9594-4cea247d4540 (non-flash)\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:28:21 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-166b328b-50e4-4357-b110-073d8628c818 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)
Aug 26 10:28:21 user nova-compute[73572]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133098b2-106a-427f-aa6d-2c10625dd152 (non-flash)
Aug 26 10:28:21 user nova-compute[73572]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:448cd30a-3852-471f-903f-a2e5abc34b55 (non-flash)
Aug 26 10:28:21 user nova-compute[73572]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f8ad7ba-4084-4cd7-920f-8f7948de4212 (non-flash)
Aug 26 10:28:21 user nova-compute[73572]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fe105f9-87b1-4b96-9594-4cea247d4540 (non-flash)
Aug 26 10:28:21 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 10:28:21 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-166b328b-50e4-4357-b110-073d8628c818 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)
Aug 26 10:28:21 user nova-compute[73572]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133098b2-106a-427f-aa6d-2c10625dd152 (non-flash)
Aug 26 10:28:21 user nova-compute[73572]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:448cd30a-3852-471f-903f-a2e5abc34b55 (non-flash)
Aug 26 10:28:21 user nova-compute[73572]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f8ad7ba-4084-4cd7-920f-8f7948de4212 (non-flash)
Aug 26 10:28:21 user nova-compute[73572]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fe105f9-87b1-4b96-9594-4cea247d4540 (non-flash)
Aug 26 10:28:21 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 10:28:21 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-166b328b-50e4-4357-b110-073d8628c818 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc89c3e1120>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4fe105f9-87b1-4b96-9594-4cea247d4540'): ({'sdg'}, set())}) {{(pid=73572) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 10:28:21 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-166b328b-50e4-4357-b110-073d8628c818 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Removing single pathed devices sdg {{(pid=73572) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 10:28:21 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:28:21 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:28:21 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[59797ee0-8713-4fe6-8028-99b6c55354cb]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:28:21 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:28:21 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.019s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:28:21 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8d172a7-c347-4857-9556-181c5a320dc7]: (4, ('ok\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:28:21 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-166b328b-50e4-4357-b110-073d8628c818 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Flushing IO for device /dev/sdg {{(pid=73572) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 10:28:21 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:28:21 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.013s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:28:21 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[9286efb1-9fb7-4d83-837d-f263c6520a57]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:28:21 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-166b328b-50e4-4357-b110-073d8628c818 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=73572) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 10:28:21 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:28:21 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.039s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:28:21 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[68849640-9758-43e1-a2f1-e87bd05ff357]: (4, ('1', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:28:21 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-166b328b-50e4-4357-b110-073d8628c818 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=73572) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 10:28:21 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-166b328b-50e4-4357-b110-073d8628c818 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] SCSI volumes sdg have been removed. {{(pid=73572) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 10:28:21 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-166b328b-50e4-4357-b110-073d8628c818 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4fe105f9-87b1-4b96-9594-4cea247d4540')] {{(pid=73572) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 10:28:21 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fe105f9-87b1-4b96-9594-4cea247d4540 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:28:21 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fe105f9-87b1-4b96-9594-4cea247d4540 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:28:21 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6f9f15a-d8b9-453e-b27a-851a7ca63bcb]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:28:21 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-166b328b-50e4-4357-b110-073d8628c818 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:28:21 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fe105f9-87b1-4b96-9594-4cea247d4540 -p 172.16.0.220:3260 --logout {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:28:21 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fe105f9-87b1-4b96-9594-4cea247d4540 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:28:21 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bd250c4-a2dd-4598-bcdd-874fa8587c5e]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:4fe105f9-87b1-4b96-9594-4cea247d4540, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:4fe105f9-87b1-4b96-9594-4cea247d4540, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:28:21 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-166b328b-50e4-4357-b110-073d8628c818 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:4fe105f9-87b1-4b96-9594-4cea247d4540, portal: 172.16.0.220,3260]
Aug 26 10:28:21 user nova-compute[73572]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:4fe105f9-87b1-4b96-9594-4cea247d4540, portal: 172.16.0.220,3260] successful.
Aug 26 10:28:21 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:28:21 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fe105f9-87b1-4b96-9594-4cea247d4540 -p 172.16.0.220:3260 --op delete {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:28:21 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fe105f9-87b1-4b96-9594-4cea247d4540 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:28:21 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[258306ae-d9f3-44ec-a503-baf0687ea7b5]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:28:21 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-166b328b-50e4-4357-b110-073d8628c818 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:28:21 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-166b328b-50e4-4357-b110-073d8628c818 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.287s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 10:28:21 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-166b328b-50e4-4357-b110-073d8628c818 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] <== disconnect_volume: return (288ms) None {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 10:28:21 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-166b328b-50e4-4357-b110-073d8628c818 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] [instance: 8bb0f50b-c8fb-4961-99c0-ca2b6b1768cd] Disconnected iSCSI Volume {{(pid=73572) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 10:28:21 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:28:22 user nova-compute[73572]: DEBUG nova.objects.instance [None req-166b328b-50e4-4357-b110-073d8628c818 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Lazy-loading 'flavor' on Instance uuid 8bb0f50b-c8fb-4961-99c0-ca2b6b1768cd {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:28:22 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-166b328b-50e4-4357-b110-073d8628c818 tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Lock "8bb0f50b-c8fb-4961-99c0-ca2b6b1768cd" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.692s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:28:22 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:28:23 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-f1899712-aae6-485f-b313-362e6c8fabfe tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Acquiring lock "8bb0f50b-c8fb-4961-99c0-ca2b6b1768cd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:28:23 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-f1899712-aae6-485f-b313-362e6c8fabfe tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Lock "8bb0f50b-c8fb-4961-99c0-ca2b6b1768cd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:28:23 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-f1899712-aae6-485f-b313-362e6c8fabfe tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Acquiring lock "8bb0f50b-c8fb-4961-99c0-ca2b6b1768cd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:28:23 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-f1899712-aae6-485f-b313-362e6c8fabfe tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Lock "8bb0f50b-c8fb-4961-99c0-ca2b6b1768cd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:28:23 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-f1899712-aae6-485f-b313-362e6c8fabfe tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Lock "8bb0f50b-c8fb-4961-99c0-ca2b6b1768cd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:28:23 user nova-compute[73572]: INFO nova.compute.manager [None req-f1899712-aae6-485f-b313-362e6c8fabfe tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] [instance: 8bb0f50b-c8fb-4961-99c0-ca2b6b1768cd] Terminating instance
Aug 26 10:28:23 user nova-compute[73572]: DEBUG nova.compute.manager [None req-f1899712-aae6-485f-b313-362e6c8fabfe tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] [instance: 8bb0f50b-c8fb-4961-99c0-ca2b6b1768cd] Start destroying the instance on the hypervisor. {{(pid=73572) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 10:28:23 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:28:23 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:28:23 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:28:23 user nova-compute[73572]: DEBUG nova.compute.manager [req-fc372857-de1b-4fdf-ac4b-90ac9c794ca4 req-1f50b827-5e26-4192-907f-9d8f578c1ffc service nova] [instance: 8bb0f50b-c8fb-4961-99c0-ca2b6b1768cd] Received event network-vif-unplugged-e78ed806-3f29-444e-b7d5-d0c9ba2b06aa {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:28:23 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-fc372857-de1b-4fdf-ac4b-90ac9c794ca4 req-1f50b827-5e26-4192-907f-9d8f578c1ffc service nova] Acquiring lock "8bb0f50b-c8fb-4961-99c0-ca2b6b1768cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:28:23 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-fc372857-de1b-4fdf-ac4b-90ac9c794ca4 req-1f50b827-5e26-4192-907f-9d8f578c1ffc service nova] Lock "8bb0f50b-c8fb-4961-99c0-ca2b6b1768cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:28:23 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-fc372857-de1b-4fdf-ac4b-90ac9c794ca4 req-1f50b827-5e26-4192-907f-9d8f578c1ffc service nova] Lock "8bb0f50b-c8fb-4961-99c0-ca2b6b1768cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:28:23 user nova-compute[73572]: DEBUG nova.compute.manager [req-fc372857-de1b-4fdf-ac4b-90ac9c794ca4 req-1f50b827-5e26-4192-907f-9d8f578c1ffc service nova] [instance: 8bb0f50b-c8fb-4961-99c0-ca2b6b1768cd] No waiting events found dispatching network-vif-unplugged-e78ed806-3f29-444e-b7d5-d0c9ba2b06aa {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:28:23 user nova-compute[73572]: DEBUG nova.compute.manager [req-fc372857-de1b-4fdf-ac4b-90ac9c794ca4 req-1f50b827-5e26-4192-907f-9d8f578c1ffc service nova] [instance: 8bb0f50b-c8fb-4961-99c0-ca2b6b1768cd] Received event network-vif-unplugged-e78ed806-3f29-444e-b7d5-d0c9ba2b06aa for instance with task_state deleting. {{(pid=73572) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 10:28:23 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:28:24 user nova-compute[73572]: INFO nova.virt.libvirt.driver [-] [instance: 8bb0f50b-c8fb-4961-99c0-ca2b6b1768cd] Instance destroyed successfully.
Aug 26 10:28:24 user nova-compute[73572]: DEBUG nova.objects.instance [None req-f1899712-aae6-485f-b313-362e6c8fabfe tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Lazy-loading 'resources' on Instance uuid 8bb0f50b-c8fb-4961-99c0-ca2b6b1768cd {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:28:24 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-f1899712-aae6-485f-b313-362e6c8fabfe tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T10:25:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-723135433',display_name='tempest-AttachVolumeTestJSON-server-723135433',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-723135433',id=37,image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIvZx4NeVn88J4eELpNAcQQWHxjc5RVYfBsjUls0zhDk+x20aafUtCUQhS61fXJJJ6wYCeAkeKvAo0p6TDqNWNbsVhtXnful0b1goyJejMTatsjpAZ/US6fxqF5p1KJMYA==',key_name='tempest-keypair-1755736816',keypairs=<?>,launch_index=0,launched_at=2023-08-26T10:25:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='084df935eab842e58bad79afad7090f3',ramdisk_id='',reservation_id='r-g73b4erk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-716261196',owner_user_name='tempest-AttachVolumeTestJSON-716261196-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T10:25:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2a2ef00486924f318ff1e7e502e835a6',uuid=8bb0f50b-c8fb-4961-99c0-ca2b6b1768cd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e78ed806-3f29-444e-b7d5-d0c9ba2b06aa", "address": "fa:16:3e:4a:d9:27", "network": {"id": "81543fb3-a8fe-4e9c-8180-c65fa4dcc9e1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-469390371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "084df935eab842e58bad79afad7090f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape78ed806-3f", "ovs_interfaceid": "e78ed806-3f29-444e-b7d5-d0c9ba2b06aa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 10:28:24 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-f1899712-aae6-485f-b313-362e6c8fabfe tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Converting VIF {"id": "e78ed806-3f29-444e-b7d5-d0c9ba2b06aa", "address": "fa:16:3e:4a:d9:27", "network": {"id": "81543fb3-a8fe-4e9c-8180-c65fa4dcc9e1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-469390371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "084df935eab842e58bad79afad7090f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape78ed806-3f", "ovs_interfaceid": "e78ed806-3f29-444e-b7d5-d0c9ba2b06aa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:28:24 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-f1899712-aae6-485f-b313-362e6c8fabfe tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4a:d9:27,bridge_name='br-int',has_traffic_filtering=True,id=e78ed806-3f29-444e-b7d5-d0c9ba2b06aa,network=Network(81543fb3-a8fe-4e9c-8180-c65fa4dcc9e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape78ed806-3f') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:28:24 user nova-compute[73572]: DEBUG os_vif [None req-f1899712-aae6-485f-b313-362e6c8fabfe tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4a:d9:27,bridge_name='br-int',has_traffic_filtering=True,id=e78ed806-3f29-444e-b7d5-d0c9ba2b06aa,network=Network(81543fb3-a8fe-4e9c-8180-c65fa4dcc9e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape78ed806-3f') {{(pid=73572) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 10:28:24 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:28:24 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape78ed806-3f, bridge=br-int, if_exists=True) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:28:24 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:28:24 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:28:24 user nova-compute[73572]: INFO os_vif [None req-f1899712-aae6-485f-b313-362e6c8fabfe tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4a:d9:27,bridge_name='br-int',has_traffic_filtering=True,id=e78ed806-3f29-444e-b7d5-d0c9ba2b06aa,network=Network(81543fb3-a8fe-4e9c-8180-c65fa4dcc9e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape78ed806-3f')
Aug 26 10:28:24 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-f1899712-aae6-485f-b313-362e6c8fabfe tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] [instance: 8bb0f50b-c8fb-4961-99c0-ca2b6b1768cd] Deleting instance files /opt/stack/data/nova/instances/8bb0f50b-c8fb-4961-99c0-ca2b6b1768cd_del
Aug 26 10:28:24 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-f1899712-aae6-485f-b313-362e6c8fabfe tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] [instance: 8bb0f50b-c8fb-4961-99c0-ca2b6b1768cd] Deletion of /opt/stack/data/nova/instances/8bb0f50b-c8fb-4961-99c0-ca2b6b1768cd_del complete
Aug 26 10:28:24 user nova-compute[73572]: INFO nova.compute.manager [None req-f1899712-aae6-485f-b313-362e6c8fabfe tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] [instance: 8bb0f50b-c8fb-4961-99c0-ca2b6b1768cd] Took 0.93 seconds to destroy the instance on the hypervisor.
Aug 26 10:28:24 user nova-compute[73572]: DEBUG oslo.service.loopingcall [None req-f1899712-aae6-485f-b313-362e6c8fabfe tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73572) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 10:28:24 user nova-compute[73572]: DEBUG nova.compute.manager [-] [instance: 8bb0f50b-c8fb-4961-99c0-ca2b6b1768cd] Deallocating network for instance {{(pid=73572) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 10:28:24 user nova-compute[73572]: DEBUG nova.network.neutron [-] [instance: 8bb0f50b-c8fb-4961-99c0-ca2b6b1768cd] deallocate_for_instance() {{(pid=73572) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 10:28:25 user nova-compute[73572]: DEBUG nova.network.neutron [-] [instance: 8bb0f50b-c8fb-4961-99c0-ca2b6b1768cd] Updating instance_info_cache with network_info: [] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:28:25 user nova-compute[73572]: INFO nova.compute.manager [-] [instance: 8bb0f50b-c8fb-4961-99c0-ca2b6b1768cd] Took 0.86 seconds to deallocate network for instance.
Aug 26 10:28:25 user nova-compute[73572]: DEBUG nova.compute.manager [req-8bbc6af3-2dc8-4f1a-8719-c9eef4a1673d req-894abc2a-3f90-4b51-b3e3-70fc17c71f3c service nova] [instance: 8bb0f50b-c8fb-4961-99c0-ca2b6b1768cd] Received event network-vif-deleted-e78ed806-3f29-444e-b7d5-d0c9ba2b06aa {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:28:25 user nova-compute[73572]: INFO nova.compute.manager [req-8bbc6af3-2dc8-4f1a-8719-c9eef4a1673d req-894abc2a-3f90-4b51-b3e3-70fc17c71f3c service nova] [instance: 8bb0f50b-c8fb-4961-99c0-ca2b6b1768cd] Neutron deleted interface e78ed806-3f29-444e-b7d5-d0c9ba2b06aa; detaching it from the instance and deleting it from the info cache
Aug 26 10:28:25 user nova-compute[73572]: DEBUG nova.network.neutron [req-8bbc6af3-2dc8-4f1a-8719-c9eef4a1673d req-894abc2a-3f90-4b51-b3e3-70fc17c71f3c service nova] [instance: 8bb0f50b-c8fb-4961-99c0-ca2b6b1768cd] Updating instance_info_cache with network_info: [] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:28:25 user nova-compute[73572]: DEBUG nova.compute.manager [req-8bbc6af3-2dc8-4f1a-8719-c9eef4a1673d req-894abc2a-3f90-4b51-b3e3-70fc17c71f3c service nova] [instance: 8bb0f50b-c8fb-4961-99c0-ca2b6b1768cd] Detach interface failed, port_id=e78ed806-3f29-444e-b7d5-d0c9ba2b06aa, reason: Instance 8bb0f50b-c8fb-4961-99c0-ca2b6b1768cd could not be found. {{(pid=73572) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 10:28:25 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-f1899712-aae6-485f-b313-362e6c8fabfe tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:28:25 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-f1899712-aae6-485f-b313-362e6c8fabfe tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:28:25 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:28:25 user nova-compute[73572]: DEBUG nova.compute.provider_tree [None req-f1899712-aae6-485f-b313-362e6c8fabfe tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Inventory has not changed in ProviderTree for provider: e2cec974-59b2-4c77-a53d-a7f4e5a30d75 {{(pid=73572) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 10:28:25 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-f1899712-aae6-485f-b313-362e6c8fabfe tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Inventory has not changed for provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73572) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 10:28:25 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-f1899712-aae6-485f-b313-362e6c8fabfe tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.392s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:28:25 user nova-compute[73572]: INFO nova.scheduler.client.report [None req-f1899712-aae6-485f-b313-362e6c8fabfe tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Deleted allocations for instance 8bb0f50b-c8fb-4961-99c0-ca2b6b1768cd
Aug 26 10:28:25 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-f1899712-aae6-485f-b313-362e6c8fabfe tempest-AttachVolumeTestJSON-716261196 tempest-AttachVolumeTestJSON-716261196-project-member] Lock "8bb0f50b-c8fb-4961-99c0-ca2b6b1768cd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.363s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:28:25 user nova-compute[73572]: DEBUG nova.compute.manager [req-0e117ac7-92fb-493b-83df-ba23f3f0caae req-ddfc6267-16f3-4246-a5eb-3018f3338f84 service nova] [instance: 8bb0f50b-c8fb-4961-99c0-ca2b6b1768cd] Received event network-vif-plugged-e78ed806-3f29-444e-b7d5-d0c9ba2b06aa {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:28:25 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-0e117ac7-92fb-493b-83df-ba23f3f0caae req-ddfc6267-16f3-4246-a5eb-3018f3338f84 service nova] Acquiring lock "8bb0f50b-c8fb-4961-99c0-ca2b6b1768cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:28:25 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-0e117ac7-92fb-493b-83df-ba23f3f0caae req-ddfc6267-16f3-4246-a5eb-3018f3338f84 service nova] Lock "8bb0f50b-c8fb-4961-99c0-ca2b6b1768cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:28:25 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-0e117ac7-92fb-493b-83df-ba23f3f0caae req-ddfc6267-16f3-4246-a5eb-3018f3338f84 service nova] Lock "8bb0f50b-c8fb-4961-99c0-ca2b6b1768cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:28:25 user nova-compute[73572]: DEBUG nova.compute.manager [req-0e117ac7-92fb-493b-83df-ba23f3f0caae req-ddfc6267-16f3-4246-a5eb-3018f3338f84 service nova] [instance: 8bb0f50b-c8fb-4961-99c0-ca2b6b1768cd] No waiting events found dispatching network-vif-plugged-e78ed806-3f29-444e-b7d5-d0c9ba2b06aa {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:28:25 user nova-compute[73572]: WARNING nova.compute.manager [req-0e117ac7-92fb-493b-83df-ba23f3f0caae req-ddfc6267-16f3-4246-a5eb-3018f3338f84 service nova] [instance: 8bb0f50b-c8fb-4961-99c0-ca2b6b1768cd] Received unexpected event network-vif-plugged-e78ed806-3f29-444e-b7d5-d0c9ba2b06aa for instance with vm_state deleted and task_state None.
Aug 26 10:28:25 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:28:27 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:28:28 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:28:28 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:28:28 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:28:28 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:28:28 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Auditing locally available compute resources for user (node: user) {{(pid=73572) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 10:28:28 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b2d5f4e-37af-438c-859b-d4ca803b7d08/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:28:29 user nova-compute[73572]: DEBUG nova.compute.manager [req-63f50808-8c73-4e69-891a-88030ce447a2 req-bdb39e38-e2d6-44a7-b49d-e4f03e51275d service nova] [instance: f3fe3865-3d85-46cf-b24f-10b07e23aeff] Received event network-changed-38c337db-9e4a-4f1c-ad65-e23f2afa7012 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:28:29 user nova-compute[73572]: DEBUG nova.compute.manager [req-63f50808-8c73-4e69-891a-88030ce447a2 req-bdb39e38-e2d6-44a7-b49d-e4f03e51275d service nova] [instance: f3fe3865-3d85-46cf-b24f-10b07e23aeff] Refreshing instance network info cache due to event network-changed-38c337db-9e4a-4f1c-ad65-e23f2afa7012. {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 10:28:29 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-63f50808-8c73-4e69-891a-88030ce447a2 req-bdb39e38-e2d6-44a7-b49d-e4f03e51275d service nova] Acquiring lock "refresh_cache-f3fe3865-3d85-46cf-b24f-10b07e23aeff" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:28:29 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-63f50808-8c73-4e69-891a-88030ce447a2 req-bdb39e38-e2d6-44a7-b49d-e4f03e51275d service nova] Acquired lock "refresh_cache-f3fe3865-3d85-46cf-b24f-10b07e23aeff" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:28:29 user nova-compute[73572]: DEBUG nova.network.neutron [req-63f50808-8c73-4e69-891a-88030ce447a2 req-bdb39e38-e2d6-44a7-b49d-e4f03e51275d service nova] [instance: f3fe3865-3d85-46cf-b24f-10b07e23aeff] Refreshing network info cache for port 38c337db-9e4a-4f1c-ad65-e23f2afa7012 {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 10:28:29 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:28:29 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b2d5f4e-37af-438c-859b-d4ca803b7d08/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:28:29 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b2d5f4e-37af-438c-859b-d4ca803b7d08/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:28:29 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b2d5f4e-37af-438c-859b-d4ca803b7d08/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:28:29 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73572) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 10:28:29 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86923c1a-89a5-4e7a-b488-8bf3a013bf83/disk.rescue --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:28:29 user nova-compute[73572]: DEBUG nova.network.neutron [req-63f50808-8c73-4e69-891a-88030ce447a2 req-bdb39e38-e2d6-44a7-b49d-e4f03e51275d service nova] [instance: f3fe3865-3d85-46cf-b24f-10b07e23aeff] Updated VIF entry in instance network info cache for port 38c337db-9e4a-4f1c-ad65-e23f2afa7012. {{(pid=73572) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 10:28:29 user nova-compute[73572]: DEBUG nova.network.neutron [req-63f50808-8c73-4e69-891a-88030ce447a2 req-bdb39e38-e2d6-44a7-b49d-e4f03e51275d service nova] [instance: f3fe3865-3d85-46cf-b24f-10b07e23aeff] Updating instance_info_cache with network_info: [{"id": "38c337db-9e4a-4f1c-ad65-e23f2afa7012", "address": "fa:16:3e:aa:5c:dc", "network": {"id": "c520ee18-34a7-4781-bc97-419e9a702d40", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-280196989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfc130586d9f4581953f1b8ae1c4465e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38c337db-9e", "ovs_interfaceid": "38c337db-9e4a-4f1c-ad65-e23f2afa7012", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:28:29 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-63f50808-8c73-4e69-891a-88030ce447a2 req-bdb39e38-e2d6-44a7-b49d-e4f03e51275d service nova] Releasing lock "refresh_cache-f3fe3865-3d85-46cf-b24f-10b07e23aeff" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:28:29 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86923c1a-89a5-4e7a-b488-8bf3a013bf83/disk.rescue --force-share --output=json" returned: 0 in 0.192s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:28:29 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86923c1a-89a5-4e7a-b488-8bf3a013bf83/disk.rescue --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:28:29 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86923c1a-89a5-4e7a-b488-8bf3a013bf83/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:28:29 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86923c1a-89a5-4e7a-b488-8bf3a013bf83/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:28:29 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86923c1a-89a5-4e7a-b488-8bf3a013bf83/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:28:29 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86923c1a-89a5-4e7a-b488-8bf3a013bf83/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:28:30 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86923c1a-89a5-4e7a-b488-8bf3a013bf83/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:28:30 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c785b609-0068-442f-91f5-d26e888a993f/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:28:30 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:28:30 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c785b609-0068-442f-91f5-d26e888a993f/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:28:30 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c785b609-0068-442f-91f5-d26e888a993f/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:28:30 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c785b609-0068-442f-91f5-d26e888a993f/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:28:30 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e468b473-515f-41ad-a75c-65d4c6d575c8/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:28:30 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e468b473-515f-41ad-a75c-65d4c6d575c8/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:28:30 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e468b473-515f-41ad-a75c-65d4c6d575c8/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:28:30 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e468b473-515f-41ad-a75c-65d4c6d575c8/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:28:30 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d03d1626-e18b-4b15-a679-4543f7641ed7/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:28:31 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d03d1626-e18b-4b15-a679-4543f7641ed7/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:28:31 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d03d1626-e18b-4b15-a679-4543f7641ed7/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:28:31 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d03d1626-e18b-4b15-a679-4543f7641ed7/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:28:31 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73572) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 10:28:31 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=73572) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 10:28:31 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68613b1e-c45c-4fd9-834c-3630ed0f456a/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:28:31 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68613b1e-c45c-4fd9-834c-3630ed0f456a/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:28:31 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68613b1e-c45c-4fd9-834c-3630ed0f456a/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:28:31 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68613b1e-c45c-4fd9-834c-3630ed0f456a/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:28:31 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2eaea7c2-a5c0-4950-b033-0012b5cec0ee/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:28:31 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2eaea7c2-a5c0-4950-b033-0012b5cec0ee/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:28:31 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2eaea7c2-a5c0-4950-b033-0012b5cec0ee/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:28:32 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2eaea7c2-a5c0-4950-b033-0012b5cec0ee/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:28:32 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=73572) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 10:28:32 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c8e780d-0a13-4484-bf18-ac0879db263a/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:28:32 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c8e780d-0a13-4484-bf18-ac0879db263a/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:28:32 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c8e780d-0a13-4484-bf18-ac0879db263a/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:28:32 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c8e780d-0a13-4484-bf18-ac0879db263a/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:28:33 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:28:33 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:28:33 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Hypervisor/Node resource view: name=user free_ram=7117MB free_disk=24.93533706665039GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=73572) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 10:28:33 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:28:33 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:28:33 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance c785b609-0068-442f-91f5-d26e888a993f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:28:33 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance 14fab12e-52be-4fe6-8777-bc7ebf3c25f1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:28:33 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance 2eaea7c2-a5c0-4950-b033-0012b5cec0ee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:28:33 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance 86923c1a-89a5-4e7a-b488-8bf3a013bf83 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:28:33 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance e468b473-515f-41ad-a75c-65d4c6d575c8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:28:33 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance 68613b1e-c45c-4fd9-834c-3630ed0f456a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:28:33 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance 8a8816e5-696d-4384-b0e0-29aa7cdd957c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:28:33 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance 6b2d5f4e-37af-438c-859b-d4ca803b7d08 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:28:33 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance f3fe3865-3d85-46cf-b24f-10b07e23aeff actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:28:33 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance d03d1626-e18b-4b15-a679-4543f7641ed7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:28:33 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance 1c8e780d-0a13-4484-bf18-ac0879db263a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:28:33 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=73572) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 10:28:33 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=73572) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 10:28:33 user nova-compute[73572]: DEBUG nova.compute.provider_tree [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Inventory has not changed in ProviderTree for provider: e2cec974-59b2-4c77-a53d-a7f4e5a30d75 {{(pid=73572) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 10:28:33 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Inventory has not changed for provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73572) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 10:28:33 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Compute_service record updated for user:user {{(pid=73572) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 10:28:33 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.496s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:28:34 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:28:35 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:28:36 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:28:39 user nova-compute[73572]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693045704.0538363, 8bb0f50b-c8fb-4961-99c0-ca2b6b1768cd => Stopped> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:28:39 user nova-compute[73572]: INFO nova.compute.manager [-] [instance: 8bb0f50b-c8fb-4961-99c0-ca2b6b1768cd] VM Stopped (Lifecycle Event)
Aug 26 10:28:39 user nova-compute[73572]: DEBUG nova.compute.manager [None req-de18842e-b2f7-4805-bda4-019ed5eed194 None None] [instance: 8bb0f50b-c8fb-4961-99c0-ca2b6b1768cd] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:28:39 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:28:40 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:28:41 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:28:42 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-02ba6d5b-893a-4d99-8e37-bf117cd66cde tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Acquiring lock "6076ed21-24d2-4921-b47e-f70702b0adf1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:28:42 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-02ba6d5b-893a-4d99-8e37-bf117cd66cde tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Lock "6076ed21-24d2-4921-b47e-f70702b0adf1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:28:42 user nova-compute[73572]: DEBUG nova.compute.manager [None req-02ba6d5b-893a-4d99-8e37-bf117cd66cde tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 6076ed21-24d2-4921-b47e-f70702b0adf1] Starting instance... {{(pid=73572) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 10:28:42 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-02ba6d5b-893a-4d99-8e37-bf117cd66cde tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:28:42 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-02ba6d5b-893a-4d99-8e37-bf117cd66cde tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:28:42 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-02ba6d5b-893a-4d99-8e37-bf117cd66cde tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73572) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 10:28:42 user nova-compute[73572]: INFO nova.compute.claims [None req-02ba6d5b-893a-4d99-8e37-bf117cd66cde tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 6076ed21-24d2-4921-b47e-f70702b0adf1] Claim successful on node user
Aug 26 10:28:42 user nova-compute[73572]: DEBUG nova.compute.provider_tree [None req-02ba6d5b-893a-4d99-8e37-bf117cd66cde tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Inventory has not changed in ProviderTree for provider: e2cec974-59b2-4c77-a53d-a7f4e5a30d75 {{(pid=73572) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 10:28:42 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-02ba6d5b-893a-4d99-8e37-bf117cd66cde tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Inventory has not changed for provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73572) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 10:28:42 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-02ba6d5b-893a-4d99-8e37-bf117cd66cde tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.481s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:28:42 user nova-compute[73572]: DEBUG nova.compute.manager [None req-02ba6d5b-893a-4d99-8e37-bf117cd66cde tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 6076ed21-24d2-4921-b47e-f70702b0adf1] Start building networks asynchronously for instance. {{(pid=73572) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 10:28:42 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-02ba6d5b-893a-4d99-8e37-bf117cd66cde tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 6076ed21-24d2-4921-b47e-f70702b0adf1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 10:28:42 user nova-compute[73572]: DEBUG nova.compute.manager [None req-02ba6d5b-893a-4d99-8e37-bf117cd66cde tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 6076ed21-24d2-4921-b47e-f70702b0adf1] Allocating IP information in the background. {{(pid=73572) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 10:28:42 user nova-compute[73572]: DEBUG nova.network.neutron [None req-02ba6d5b-893a-4d99-8e37-bf117cd66cde tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 6076ed21-24d2-4921-b47e-f70702b0adf1] allocate_for_instance() {{(pid=73572) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 10:28:42 user nova-compute[73572]: DEBUG nova.compute.manager [None req-02ba6d5b-893a-4d99-8e37-bf117cd66cde tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 6076ed21-24d2-4921-b47e-f70702b0adf1] Start building block device mappings for instance. {{(pid=73572) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 10:28:42 user nova-compute[73572]: INFO nova.virt.block_device [None req-02ba6d5b-893a-4d99-8e37-bf117cd66cde tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 6076ed21-24d2-4921-b47e-f70702b0adf1] Booting with volume snapshot 201bbdac-ca0a-49ad-842f-004c30a72a5c at /dev/vda
Aug 26 10:28:43 user nova-compute[73572]: DEBUG nova.policy [None req-02ba6d5b-893a-4d99-8e37-bf117cd66cde tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e1e80942e5db41c782bda686b10e2e4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc130586d9f4581953f1b8ae1c4465e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73572) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 10:28:43 user nova-compute[73572]: DEBUG nova.compute.manager [req-6626e9d2-44b3-4e69-9fd2-d20662b71c7a req-45811d1c-28fe-4903-931a-6c5a69fe90f5 service nova] [instance: d03d1626-e18b-4b15-a679-4543f7641ed7] Received event network-changed-fe6f8481-fb71-49fa-a9e7-b38adbf8e4fc {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:28:43 user nova-compute[73572]: DEBUG nova.compute.manager [req-6626e9d2-44b3-4e69-9fd2-d20662b71c7a req-45811d1c-28fe-4903-931a-6c5a69fe90f5 service nova] [instance: d03d1626-e18b-4b15-a679-4543f7641ed7] Refreshing instance network info cache due to event network-changed-fe6f8481-fb71-49fa-a9e7-b38adbf8e4fc. {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 10:28:43 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-6626e9d2-44b3-4e69-9fd2-d20662b71c7a req-45811d1c-28fe-4903-931a-6c5a69fe90f5 service nova] Acquiring lock "refresh_cache-d03d1626-e18b-4b15-a679-4543f7641ed7" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:28:43 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-6626e9d2-44b3-4e69-9fd2-d20662b71c7a req-45811d1c-28fe-4903-931a-6c5a69fe90f5 service nova] Acquired lock "refresh_cache-d03d1626-e18b-4b15-a679-4543f7641ed7" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:28:43 user nova-compute[73572]: DEBUG nova.network.neutron [req-6626e9d2-44b3-4e69-9fd2-d20662b71c7a req-45811d1c-28fe-4903-931a-6c5a69fe90f5 service nova] [instance: d03d1626-e18b-4b15-a679-4543f7641ed7] Refreshing network info cache for port fe6f8481-fb71-49fa-a9e7-b38adbf8e4fc {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 10:28:43 user nova-compute[73572]: DEBUG nova.network.neutron [req-6626e9d2-44b3-4e69-9fd2-d20662b71c7a req-45811d1c-28fe-4903-931a-6c5a69fe90f5 service nova] [instance: d03d1626-e18b-4b15-a679-4543f7641ed7] Updated VIF entry in instance network info cache for port fe6f8481-fb71-49fa-a9e7-b38adbf8e4fc. {{(pid=73572) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 10:28:43 user nova-compute[73572]: DEBUG nova.network.neutron [req-6626e9d2-44b3-4e69-9fd2-d20662b71c7a req-45811d1c-28fe-4903-931a-6c5a69fe90f5 service nova] [instance: d03d1626-e18b-4b15-a679-4543f7641ed7] Updating instance_info_cache with network_info: [{"id": "fe6f8481-fb71-49fa-a9e7-b38adbf8e4fc", "address": "fa:16:3e:8a:47:4e", "network": {"id": "880aa066-8f77-469b-a0c4-e4e94ae31e1a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-313654920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47abd6293c07465389c379e3b5061164", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe6f8481-fb", "ovs_interfaceid": "fe6f8481-fb71-49fa-a9e7-b38adbf8e4fc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:28:43 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-6626e9d2-44b3-4e69-9fd2-d20662b71c7a req-45811d1c-28fe-4903-931a-6c5a69fe90f5 service nova] Releasing lock "refresh_cache-d03d1626-e18b-4b15-a679-4543f7641ed7" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:28:44 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:28:45 user nova-compute[73572]: DEBUG nova.network.neutron [None req-02ba6d5b-893a-4d99-8e37-bf117cd66cde tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 6076ed21-24d2-4921-b47e-f70702b0adf1] Successfully created port: 49381412-2deb-4ed5-9b1c-3c693fefec38 {{(pid=73572) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 10:28:45 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:28:46 user nova-compute[73572]: DEBUG nova.network.neutron [None req-02ba6d5b-893a-4d99-8e37-bf117cd66cde tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 6076ed21-24d2-4921-b47e-f70702b0adf1] Successfully updated port: 49381412-2deb-4ed5-9b1c-3c693fefec38 {{(pid=73572) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 10:28:46 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-02ba6d5b-893a-4d99-8e37-bf117cd66cde tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Acquiring lock "refresh_cache-6076ed21-24d2-4921-b47e-f70702b0adf1" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:28:46 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-02ba6d5b-893a-4d99-8e37-bf117cd66cde tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Acquired lock "refresh_cache-6076ed21-24d2-4921-b47e-f70702b0adf1" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:28:46 user nova-compute[73572]: DEBUG nova.network.neutron [None req-02ba6d5b-893a-4d99-8e37-bf117cd66cde tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 6076ed21-24d2-4921-b47e-f70702b0adf1] Building network info cache for instance {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 10:28:46 user nova-compute[73572]: DEBUG nova.compute.manager [req-058067bd-894b-47c1-b83f-7d3ca40f71f9 req-76b1c23f-2485-4836-ba98-9d3ef19d4866 service nova] [instance: 6076ed21-24d2-4921-b47e-f70702b0adf1] Received event network-changed-49381412-2deb-4ed5-9b1c-3c693fefec38 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:28:46 user nova-compute[73572]: DEBUG nova.compute.manager [req-058067bd-894b-47c1-b83f-7d3ca40f71f9 req-76b1c23f-2485-4836-ba98-9d3ef19d4866 service nova] [instance: 6076ed21-24d2-4921-b47e-f70702b0adf1] Refreshing instance network info cache due to event network-changed-49381412-2deb-4ed5-9b1c-3c693fefec38. {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 10:28:46 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-058067bd-894b-47c1-b83f-7d3ca40f71f9 req-76b1c23f-2485-4836-ba98-9d3ef19d4866 service nova] Acquiring lock "refresh_cache-6076ed21-24d2-4921-b47e-f70702b0adf1" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:28:46 user nova-compute[73572]: DEBUG nova.network.neutron [None req-02ba6d5b-893a-4d99-8e37-bf117cd66cde tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 6076ed21-24d2-4921-b47e-f70702b0adf1] Instance cache missing network info. {{(pid=73572) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 10:28:46 user nova-compute[73572]: DEBUG nova.network.neutron [None req-02ba6d5b-893a-4d99-8e37-bf117cd66cde tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 6076ed21-24d2-4921-b47e-f70702b0adf1] Updating instance_info_cache with network_info: [{"id": "49381412-2deb-4ed5-9b1c-3c693fefec38", "address": "fa:16:3e:6f:f9:b8", "network": {"id": "c520ee18-34a7-4781-bc97-419e9a702d40", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-280196989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfc130586d9f4581953f1b8ae1c4465e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49381412-2d", "ovs_interfaceid": "49381412-2deb-4ed5-9b1c-3c693fefec38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:28:46 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-02ba6d5b-893a-4d99-8e37-bf117cd66cde tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Releasing lock "refresh_cache-6076ed21-24d2-4921-b47e-f70702b0adf1" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:28:46 user nova-compute[73572]: DEBUG nova.compute.manager [None req-02ba6d5b-893a-4d99-8e37-bf117cd66cde tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 6076ed21-24d2-4921-b47e-f70702b0adf1] Instance network_info: |[{"id": "49381412-2deb-4ed5-9b1c-3c693fefec38", "address": "fa:16:3e:6f:f9:b8", "network": {"id": "c520ee18-34a7-4781-bc97-419e9a702d40", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-280196989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfc130586d9f4581953f1b8ae1c4465e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49381412-2d", "ovs_interfaceid": "49381412-2deb-4ed5-9b1c-3c693fefec38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73572) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 10:28:46 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-058067bd-894b-47c1-b83f-7d3ca40f71f9 req-76b1c23f-2485-4836-ba98-9d3ef19d4866 service nova] Acquired lock "refresh_cache-6076ed21-24d2-4921-b47e-f70702b0adf1" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:28:46 user nova-compute[73572]: DEBUG nova.network.neutron [req-058067bd-894b-47c1-b83f-7d3ca40f71f9 req-76b1c23f-2485-4836-ba98-9d3ef19d4866 service nova] [instance: 6076ed21-24d2-4921-b47e-f70702b0adf1] Refreshing network info cache for port 49381412-2deb-4ed5-9b1c-3c693fefec38 {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 10:28:46 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:28:47 user nova-compute[73572]: DEBUG nova.network.neutron [req-058067bd-894b-47c1-b83f-7d3ca40f71f9 req-76b1c23f-2485-4836-ba98-9d3ef19d4866 service nova] [instance: 6076ed21-24d2-4921-b47e-f70702b0adf1] Updated VIF entry in instance network info cache for port 49381412-2deb-4ed5-9b1c-3c693fefec38. {{(pid=73572) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 10:28:47 user nova-compute[73572]: DEBUG nova.network.neutron [req-058067bd-894b-47c1-b83f-7d3ca40f71f9 req-76b1c23f-2485-4836-ba98-9d3ef19d4866 service nova] [instance: 6076ed21-24d2-4921-b47e-f70702b0adf1] Updating instance_info_cache with network_info: [{"id": "49381412-2deb-4ed5-9b1c-3c693fefec38", "address": "fa:16:3e:6f:f9:b8", "network": {"id": "c520ee18-34a7-4781-bc97-419e9a702d40", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-280196989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfc130586d9f4581953f1b8ae1c4465e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49381412-2d", "ovs_interfaceid": "49381412-2deb-4ed5-9b1c-3c693fefec38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:28:47 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-058067bd-894b-47c1-b83f-7d3ca40f71f9 req-76b1c23f-2485-4836-ba98-9d3ef19d4866 service nova] Releasing lock "refresh_cache-6076ed21-24d2-4921-b47e-f70702b0adf1" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:28:48 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-fca38d76-290c-4a74-ac88-777bd1b689f4 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Acquiring lock "d03d1626-e18b-4b15-a679-4543f7641ed7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:28:48 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-fca38d76-290c-4a74-ac88-777bd1b689f4 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Lock "d03d1626-e18b-4b15-a679-4543f7641ed7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:28:48 user nova-compute[73572]: DEBUG nova.objects.instance [None req-fca38d76-290c-4a74-ac88-777bd1b689f4 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Lazy-loading 'flavor' on Instance uuid d03d1626-e18b-4b15-a679-4543f7641ed7 {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:28:48 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-fca38d76-290c-4a74-ac88-777bd1b689f4 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Lock "d03d1626-e18b-4b15-a679-4543f7641ed7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.066s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:28:48 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-fca38d76-290c-4a74-ac88-777bd1b689f4 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Acquiring lock "d03d1626-e18b-4b15-a679-4543f7641ed7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:28:48 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-fca38d76-290c-4a74-ac88-777bd1b689f4 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Lock "d03d1626-e18b-4b15-a679-4543f7641ed7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:28:48 user nova-compute[73572]: INFO nova.compute.manager [None req-fca38d76-290c-4a74-ac88-777bd1b689f4 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] [instance: d03d1626-e18b-4b15-a679-4543f7641ed7] Attaching volume 5604a0a3-82f0-4d15-8e42-1d770f51b265 to /dev/vdb
Aug 26 10:28:48 user nova-compute[73572]: DEBUG os_brick.utils [None req-fca38d76-290c-4a74-ac88-777bd1b689f4 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 10:28:48 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:28:48 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:28:48 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e018aba-834a-4c8f-9b31-3ddf36fae429]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:de8a79ed912\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:28:48 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:28:48 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:28:48 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[a77cccf8-c738-4bcc-8b4b-17d28ec4e934]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:28:48 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:28:48 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:28:48 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[68f7325e-e1bb-4af7-8385-fcc25a2841c8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:28:48 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[0356813f-dde1-4b74-b18f-91941a1bcce4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:28:48 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-fca38d76-290c-4a74-ac88-777bd1b689f4 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Running cmd (subprocess): nvme version {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:28:48 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-fca38d76-290c-4a74-ac88-777bd1b689f4 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] 'nvme version' failed. Not Retrying. {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 10:28:48 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fca38d76-290c-4a74-ac88-777bd1b689f4 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] nvme not present on system {{(pid=73572) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 10:28:48 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:28:48 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 10:28:48 user nova-compute[73572]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 10:28:48 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed62a7ec-eda1-4616-9b41-73bd8c67b473]: (4, '') {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:28:48 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.lightos [None req-fca38d76-290c-4a74-ac88-777bd1b689f4 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73572) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 10:28:48 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.lightos [None req-fca38d76-290c-4a74-ac88-777bd1b689f4 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73572) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 10:28:48 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.lightos [None req-fca38d76-290c-4a74-ac88-777bd1b689f4 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] LIGHTOS: no hostnqn found. {{(pid=73572) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 10:28:48 user nova-compute[73572]: DEBUG os_brick.utils [None req-fca38d76-290c-4a74-ac88-777bd1b689f4 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:de8a79ed912', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 10:28:48 user nova-compute[73572]: DEBUG nova.virt.block_device [None req-fca38d76-290c-4a74-ac88-777bd1b689f4 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] [instance: d03d1626-e18b-4b15-a679-4543f7641ed7] Updating existing volume attachment record: 9927239d-e24f-4474-9796-e0307570947c {{(pid=73572) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 10:28:48 user nova-compute[73572]: DEBUG os_brick.utils [None req-02ba6d5b-893a-4d99-8e37-bf117cd66cde tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 10:28:48 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:28:48 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:28:48 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[1df5d1d3-b36c-4cae-8f3a-de6db0532bb8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:de8a79ed912\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:28:48 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:28:48 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:28:48 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6d3aa6e-54d2-48d6-8fa8-1dc2dc5c7297]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:28:48 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:28:48 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:28:48 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e714ea5-917e-4f99-bd3c-f87bbd3dd37e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:28:48 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4ccdfd4-608d-4dd5-b239-9fd2e3cfd2bb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:28:48 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-02ba6d5b-893a-4d99-8e37-bf117cd66cde tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Running cmd (subprocess): nvme version {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:28:48 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-02ba6d5b-893a-4d99-8e37-bf117cd66cde tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] 'nvme version' failed. Not Retrying. {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 10:28:48 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.nvmeof [None req-02ba6d5b-893a-4d99-8e37-bf117cd66cde tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] nvme not present on system {{(pid=73572) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 10:28:48 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:28:48 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 10:28:48 user nova-compute[73572]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 10:28:48 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[54129af1-ac75-4606-8de1-4251bd039465]: (4, '') {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:28:48 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.lightos [None req-02ba6d5b-893a-4d99-8e37-bf117cd66cde tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73572) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 10:28:48 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.lightos [None req-02ba6d5b-893a-4d99-8e37-bf117cd66cde tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73572) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 10:28:48 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.lightos [None req-02ba6d5b-893a-4d99-8e37-bf117cd66cde tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] LIGHTOS: no hostnqn found. {{(pid=73572) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 10:28:48 user nova-compute[73572]: DEBUG os_brick.utils [None req-02ba6d5b-893a-4d99-8e37-bf117cd66cde tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:de8a79ed912', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 10:28:48 user nova-compute[73572]: DEBUG nova.virt.block_device [None req-02ba6d5b-893a-4d99-8e37-bf117cd66cde tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 6076ed21-24d2-4921-b47e-f70702b0adf1] Updating existing volume attachment record: 94f40cce-f6cf-42e8-8a2e-d326cb1ccd7e {{(pid=73572) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 10:28:49 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:28:50 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:28:54 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:28:59 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:29:00 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:29:03 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fca38d76-290c-4a74-ac88-777bd1b689f4 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] [instance: d03d1626-e18b-4b15-a679-4543f7641ed7] Calling os-brick to attach iSCSI Volume {{(pid=73572) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 10:29:03 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-fca38d76-290c-4a74-ac88-777bd1b689f4 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc89c3d6a10>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:5604a0a3-82f0-4d15-8e42-1d770f51b265'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'spOknaJQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 10:29:03 user nova-compute[73572]: WARNING os_brick.initiator.connectors.base [None req-fca38d76-290c-4a74-ac88-777bd1b689f4 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 10:29:03 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-fca38d76-290c-4a74-ac88-777bd1b689f4 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 10:29:03 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-fca38d76-290c-4a74-ac88-777bd1b689f4 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 10:29:03 user nova-compute[73572]: WARNING os_brick.initiator.connectors.base [None req-fca38d76-290c-4a74-ac88-777bd1b689f4 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 10:29:03 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-fca38d76-290c-4a74-ac88-777bd1b689f4 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5604a0a3-82f0-4d15-8e42-1d770f51b265" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 10:29:03 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-fca38d76-290c-4a74-ac88-777bd1b689f4 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5604a0a3-82f0-4d15-8e42-1d770f51b265" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 10:29:03 user nova-compute[73572]: INFO os_brick.initiator.connectors.iscsi [None req-fca38d76-290c-4a74-ac88-777bd1b689f4 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 10:29:03 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5604a0a3-82f0-4d15-8e42-1d770f51b265 -p 172.16.0.220:3260 {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:29:03 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5604a0a3-82f0-4d15-8e42-1d770f51b265 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:29:03 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[f15a2856-8590-4440-88fe-4e8cf200e3dd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:29:03 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-fca38d76-290c-4a74-ac88-777bd1b689f4 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 10:29:03 user nova-compute[73572]:  {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:29:03 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5604a0a3-82f0-4d15-8e42-1d770f51b265 -p 172.16.0.220:3260 --interface default --op new {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:29:03 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5604a0a3-82f0-4d15-8e42-1d770f51b265 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:29:03 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[13808907-cb0a-45f6-80ad-c0689cc767c9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5604a0a3-82f0-4d15-8e42-1d770f51b265] added\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:29:03 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-fca38d76-290c-4a74-ac88-777bd1b689f4 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5604a0a3-82f0-4d15-8e42-1d770f51b265] added
Aug 26 10:29:03 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:29:03 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5604a0a3-82f0-4d15-8e42-1d770f51b265 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:29:03 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5604a0a3-82f0-4d15-8e42-1d770f51b265 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:29:03 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecdfecc9-b028-41bb-83a8-28d9107560fa]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:29:03 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-fca38d76-290c-4a74-ac88-777bd1b689f4 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:29:03 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5604a0a3-82f0-4d15-8e42-1d770f51b265 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:29:03 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5604a0a3-82f0-4d15-8e42-1d770f51b265 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:29:03 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e37dfa0-0aeb-4c38-a19b-db08da49de89]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:29:03 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-fca38d76-290c-4a74-ac88-777bd1b689f4 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:29:03 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5604a0a3-82f0-4d15-8e42-1d770f51b265 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v spOknaJQ {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:29:03 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5604a0a3-82f0-4d15-8e42-1d770f51b265 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v spOknaJQ" returned: 0 in 0.019s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:29:03 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[a442a7d9-46b3-4528-8ede-7d5f3c023381]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:29:03 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-fca38d76-290c-4a74-ac88-777bd1b689f4 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'spOknaJQ'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:29:03 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5604a0a3-82f0-4d15-8e42-1d770f51b265 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:29:03 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5604a0a3-82f0-4d15-8e42-1d770f51b265 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:29:03 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d9f391b-d4b5-4549-b87a-ecd10e0095d4]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:29:03 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-fca38d76-290c-4a74-ac88-777bd1b689f4 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:29:03 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:29:03 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:29:03 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[725f79d6-89a5-41c8-ae4e-ad0506abceac]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133098b2-106a-427f-aa6d-2c10625dd152 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:448cd30a-3852-471f-903f-a2e5abc34b55 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f8ad7ba-4084-4cd7-920f-8f7948de4212 (non-flash)\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:29:03 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-fca38d76-290c-4a74-ac88-777bd1b689f4 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)
Aug 26 10:29:03 user nova-compute[73572]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133098b2-106a-427f-aa6d-2c10625dd152 (non-flash)
Aug 26 10:29:03 user nova-compute[73572]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:448cd30a-3852-471f-903f-a2e5abc34b55 (non-flash)
Aug 26 10:29:03 user nova-compute[73572]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f8ad7ba-4084-4cd7-920f-8f7948de4212 (non-flash)
Aug 26 10:29:03 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 10:29:03 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-fca38d76-290c-4a74-ac88-777bd1b689f4 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)
Aug 26 10:29:03 user nova-compute[73572]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133098b2-106a-427f-aa6d-2c10625dd152 (non-flash)
Aug 26 10:29:03 user nova-compute[73572]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:448cd30a-3852-471f-903f-a2e5abc34b55 (non-flash)
Aug 26 10:29:03 user nova-compute[73572]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f8ad7ba-4084-4cd7-920f-8f7948de4212 (non-flash)
Aug 26 10:29:03 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 10:29:03 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5604a0a3-82f0-4d15-8e42-1d770f51b265 -p 172.16.0.220:3260 --login {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:29:03 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5604a0a3-82f0-4d15-8e42-1d770f51b265 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:29:03 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b2b11d5-5421-48ab-bae7-a97321e27d3b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5604a0a3-82f0-4d15-8e42-1d770f51b265, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5604a0a3-82f0-4d15-8e42-1d770f51b265, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:29:03 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-fca38d76-290c-4a74-ac88-777bd1b689f4 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5604a0a3-82f0-4d15-8e42-1d770f51b265, portal: 172.16.0.220,3260]
Aug 26 10:29:03 user nova-compute[73572]: Login to [iface: default, target: iqn.2010-10.org.openstack:5604a0a3-82f0-4d15-8e42-1d770f51b265, portal: 172.16.0.220,3260] successful.
Aug 26 10:29:03 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:29:03 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5604a0a3-82f0-4d15-8e42-1d770f51b265 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:29:03 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5604a0a3-82f0-4d15-8e42-1d770f51b265 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:29:03 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[d45e39ba-20d5-4938-b7ad-e528ac6065c4]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:29:03 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-fca38d76-290c-4a74-ac88-777bd1b689f4 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:29:03 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:29:03 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:29:03 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[21fb33e1-e17d-4dfb-947d-53bcb5bdac58]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133098b2-106a-427f-aa6d-2c10625dd152 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:448cd30a-3852-471f-903f-a2e5abc34b55 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f8ad7ba-4084-4cd7-920f-8f7948de4212 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5604a0a3-82f0-4d15-8e42-1d770f51b265 (non-flash)\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:29:03 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-fca38d76-290c-4a74-ac88-777bd1b689f4 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)
Aug 26 10:29:03 user nova-compute[73572]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133098b2-106a-427f-aa6d-2c10625dd152 (non-flash)
Aug 26 10:29:03 user nova-compute[73572]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:448cd30a-3852-471f-903f-a2e5abc34b55 (non-flash)
Aug 26 10:29:03 user nova-compute[73572]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f8ad7ba-4084-4cd7-920f-8f7948de4212 (non-flash)
Aug 26 10:29:03 user nova-compute[73572]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5604a0a3-82f0-4d15-8e42-1d770f51b265 (non-flash)
Aug 26 10:29:03 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 10:29:03 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-fca38d76-290c-4a74-ac88-777bd1b689f4 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)
Aug 26 10:29:03 user nova-compute[73572]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133098b2-106a-427f-aa6d-2c10625dd152 (non-flash)
Aug 26 10:29:03 user nova-compute[73572]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:448cd30a-3852-471f-903f-a2e5abc34b55 (non-flash)
Aug 26 10:29:03 user nova-compute[73572]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f8ad7ba-4084-4cd7-920f-8f7948de4212 (non-flash)
Aug 26 10:29:03 user nova-compute[73572]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5604a0a3-82f0-4d15-8e42-1d770f51b265 (non-flash)
Aug 26 10:29:03 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 10:29:03 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-fca38d76-290c-4a74-ac88-777bd1b689f4 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5604a0a3-82f0-4d15-8e42-1d770f51b265" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.296s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 10:29:03 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-fca38d76-290c-4a74-ac88-777bd1b689f4 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Connected to 172.16.0.220:3260 {{(pid=73572) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 10:29:03 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-fca38d76-290c-4a74-ac88-777bd1b689f4 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] HCTL ('35', '-', '-', 0) found on session 42 with lun 0 {{(pid=73572) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 10:29:03 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-fca38d76-290c-4a74-ac88-777bd1b689f4 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73572) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 10:29:03 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:29:03 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:29:03 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb695c24-1ddf-4451-bcf7-981e06524abb]: (4, ('- - 0', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:29:03 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-fca38d76-290c-4a74-ac88-777bd1b689f4 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Searching for a device in session 42 and hctl ['35', '*', '*', 0] yield: None {{(pid=73572) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 10:29:04 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:29:04 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-fca38d76-290c-4a74-ac88-777bd1b689f4 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Searching for a device in session 42 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73572) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 10:29:04 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-fca38d76-290c-4a74-ac88-777bd1b689f4 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'spOknaJQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73572) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 10:29:04 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-fca38d76-290c-4a74-ac88-777bd1b689f4 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.329s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 10:29:04 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-fca38d76-290c-4a74-ac88-777bd1b689f4 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] <== connect_volume: return (1331ms) {'type': 'block', 'scsi_wwn': '23965306534613964', 'path': '/dev/sdd'} {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 10:29:04 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fca38d76-290c-4a74-ac88-777bd1b689f4 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] [instance: d03d1626-e18b-4b15-a679-4543f7641ed7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23965306534613964', 'path': '/dev/sdd'} {{(pid=73572) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 10:29:04 user nova-compute[73572]: DEBUG nova.objects.instance [None req-fca38d76-290c-4a74-ac88-777bd1b689f4 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Lazy-loading 'flavor' on Instance uuid d03d1626-e18b-4b15-a679-4543f7641ed7 {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:29:04 user nova-compute[73572]: DEBUG nova.virt.libvirt.guest [None req-fca38d76-290c-4a74-ac88-777bd1b689f4 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 10:29:04 user nova-compute[73572]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 10:29:04 user nova-compute[73572]:   <source dev="/dev/sdd"/>
Aug 26 10:29:04 user nova-compute[73572]:   <target dev="vdb" bus="virtio"/>
Aug 26 10:29:04 user nova-compute[73572]:   <serial>5604a0a3-82f0-4d15-8e42-1d770f51b265</serial>
Aug 26 10:29:04 user nova-compute[73572]: </disk>
Aug 26 10:29:04 user nova-compute[73572]:  {{(pid=73572) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 10:29:05 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-fca38d76-290c-4a74-ac88-777bd1b689f4 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] No BDM found with device name vda, not building metadata. {{(pid=73572) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 10:29:05 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-fca38d76-290c-4a74-ac88-777bd1b689f4 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73572) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 10:29:05 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-fca38d76-290c-4a74-ac88-777bd1b689f4 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] No VIF found with MAC fa:16:3e:8a:47:4e, not building metadata {{(pid=73572) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 10:29:05 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-fca38d76-290c-4a74-ac88-777bd1b689f4 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Lock "d03d1626-e18b-4b15-a679-4543f7641ed7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 16.924s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:29:05 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:29:05 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-de5964d9-0ea4-41be-bd25-bec67e275348 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Acquiring lock "d03d1626-e18b-4b15-a679-4543f7641ed7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:29:05 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-de5964d9-0ea4-41be-bd25-bec67e275348 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Lock "d03d1626-e18b-4b15-a679-4543f7641ed7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:29:05 user nova-compute[73572]: INFO nova.compute.manager [None req-de5964d9-0ea4-41be-bd25-bec67e275348 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] [instance: d03d1626-e18b-4b15-a679-4543f7641ed7] Detaching volume 5604a0a3-82f0-4d15-8e42-1d770f51b265
Aug 26 10:29:06 user nova-compute[73572]: INFO nova.virt.block_device [None req-de5964d9-0ea4-41be-bd25-bec67e275348 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] [instance: d03d1626-e18b-4b15-a679-4543f7641ed7] Attempting to driver detach volume 5604a0a3-82f0-4d15-8e42-1d770f51b265 from mountpoint /dev/vdb
Aug 26 10:29:06 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-de5964d9-0ea4-41be-bd25-bec67e275348 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Attempting to detach device vdb from instance d03d1626-e18b-4b15-a679-4543f7641ed7 from the persistent domain config. {{(pid=73572) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 10:29:06 user nova-compute[73572]: DEBUG nova.virt.libvirt.guest [None req-de5964d9-0ea4-41be-bd25-bec67e275348 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 10:29:06 user nova-compute[73572]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 10:29:06 user nova-compute[73572]:   <source dev="/dev/sdd"/>
Aug 26 10:29:06 user nova-compute[73572]:   <target dev="vdb" bus="virtio"/>
Aug 26 10:29:06 user nova-compute[73572]:   <serial>5604a0a3-82f0-4d15-8e42-1d770f51b265</serial>
Aug 26 10:29:06 user nova-compute[73572]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 10:29:06 user nova-compute[73572]: </disk>
Aug 26 10:29:06 user nova-compute[73572]:  {{(pid=73572) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 10:29:06 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-de5964d9-0ea4-41be-bd25-bec67e275348 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Successfully detached device vdb from instance d03d1626-e18b-4b15-a679-4543f7641ed7 from the persistent domain config.
Aug 26 10:29:06 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-de5964d9-0ea4-41be-bd25-bec67e275348 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d03d1626-e18b-4b15-a679-4543f7641ed7 from the live domain config. {{(pid=73572) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 10:29:06 user nova-compute[73572]: DEBUG nova.virt.libvirt.guest [None req-de5964d9-0ea4-41be-bd25-bec67e275348 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 10:29:06 user nova-compute[73572]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 10:29:06 user nova-compute[73572]:   <source dev="/dev/sdd"/>
Aug 26 10:29:06 user nova-compute[73572]:   <target dev="vdb" bus="virtio"/>
Aug 26 10:29:06 user nova-compute[73572]:   <serial>5604a0a3-82f0-4d15-8e42-1d770f51b265</serial>
Aug 26 10:29:06 user nova-compute[73572]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 10:29:06 user nova-compute[73572]: </disk>
Aug 26 10:29:06 user nova-compute[73572]:  {{(pid=73572) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 10:29:06 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Received event <DeviceRemovedEvent: 1693045746.517771, d03d1626-e18b-4b15-a679-4543f7641ed7 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73572) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 10:29:06 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-de5964d9-0ea4-41be-bd25-bec67e275348 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d03d1626-e18b-4b15-a679-4543f7641ed7 {{(pid=73572) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 10:29:06 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-de5964d9-0ea4-41be-bd25-bec67e275348 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Successfully detached device vdb from instance d03d1626-e18b-4b15-a679-4543f7641ed7 from the live domain config.
Aug 26 10:29:06 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de5964d9-0ea4-41be-bd25-bec67e275348 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] [instance: d03d1626-e18b-4b15-a679-4543f7641ed7] calling os-brick to detach iSCSI Volume {{(pid=73572) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 10:29:06 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-de5964d9-0ea4-41be-bd25-bec67e275348 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc89c3d6a10>, {'target_iqns': ['iqn.2010-10.org.openstack:5604a0a3-82f0-4d15-8e42-1d770f51b265'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'spOknaJQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 10:29:06 user nova-compute[73572]: WARNING os_brick.initiator.connectors.base [None req-de5964d9-0ea4-41be-bd25-bec67e275348 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 10:29:06 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-de5964d9-0ea4-41be-bd25-bec67e275348 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 10:29:06 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-de5964d9-0ea4-41be-bd25-bec67e275348 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 10:29:06 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-de5964d9-0ea4-41be-bd25-bec67e275348 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5604a0a3-82f0-4d15-8e42-1d770f51b265', 0)] {{(pid=73572) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 10:29:06 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:29:06 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:29:06 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[066041ed-4083-4a49-a935-3a3f675b9bc2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:133098b2-106a-427f-aa6d-2c10625dd152\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:448cd30a-3852-471f-903f-a2e5abc34b55\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5604a0a3-82f0-4d15-8e42-1d770f51b265\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8f8ad7ba-4084-4cd7-920f-8f7948de4212\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:29:06 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:29:06 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:29:06 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[10266d4a-fe8b-46fc-b02e-3cca04c60574]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133098b2-106a-427f-aa6d-2c10625dd152 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:448cd30a-3852-471f-903f-a2e5abc34b55 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f8ad7ba-4084-4cd7-920f-8f7948de4212 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5604a0a3-82f0-4d15-8e42-1d770f51b265 (non-flash)\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:29:06 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-de5964d9-0ea4-41be-bd25-bec67e275348 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)
Aug 26 10:29:06 user nova-compute[73572]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133098b2-106a-427f-aa6d-2c10625dd152 (non-flash)
Aug 26 10:29:06 user nova-compute[73572]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:448cd30a-3852-471f-903f-a2e5abc34b55 (non-flash)
Aug 26 10:29:06 user nova-compute[73572]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f8ad7ba-4084-4cd7-920f-8f7948de4212 (non-flash)
Aug 26 10:29:06 user nova-compute[73572]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5604a0a3-82f0-4d15-8e42-1d770f51b265 (non-flash)
Aug 26 10:29:06 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 10:29:06 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-de5964d9-0ea4-41be-bd25-bec67e275348 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)
Aug 26 10:29:06 user nova-compute[73572]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133098b2-106a-427f-aa6d-2c10625dd152 (non-flash)
Aug 26 10:29:06 user nova-compute[73572]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:448cd30a-3852-471f-903f-a2e5abc34b55 (non-flash)
Aug 26 10:29:06 user nova-compute[73572]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f8ad7ba-4084-4cd7-920f-8f7948de4212 (non-flash)
Aug 26 10:29:06 user nova-compute[73572]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5604a0a3-82f0-4d15-8e42-1d770f51b265 (non-flash)
Aug 26 10:29:06 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 10:29:06 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-de5964d9-0ea4-41be-bd25-bec67e275348 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc878dc63b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5604a0a3-82f0-4d15-8e42-1d770f51b265'): ({'sdd'}, set())}) {{(pid=73572) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 10:29:06 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-de5964d9-0ea4-41be-bd25-bec67e275348 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Removing single pathed devices sdd {{(pid=73572) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 10:29:06 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:29:06 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:29:06 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7526b0c-8da5-4a28-83f5-b8cec630307a]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:29:06 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:29:06 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:29:06 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[d180eb43-32de-444c-8411-1ce431a5e5b5]: (4, ('ok\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:29:06 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-de5964d9-0ea4-41be-bd25-bec67e275348 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Flushing IO for device /dev/sdd {{(pid=73572) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 10:29:06 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:29:06 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:29:06 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a5d540b-a414-4ca5-98c3-d10dc4130340]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:29:06 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-de5964d9-0ea4-41be-bd25-bec67e275348 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73572) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 10:29:06 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:29:06 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.032s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:29:06 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a94d00c-f6be-4bd8-a6d2-22759def9ed2]: (4, ('1', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:29:06 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-de5964d9-0ea4-41be-bd25-bec67e275348 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73572) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 10:29:06 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-de5964d9-0ea4-41be-bd25-bec67e275348 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] SCSI volumes sdd have been removed. {{(pid=73572) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 10:29:06 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-de5964d9-0ea4-41be-bd25-bec67e275348 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5604a0a3-82f0-4d15-8e42-1d770f51b265')] {{(pid=73572) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 10:29:06 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5604a0a3-82f0-4d15-8e42-1d770f51b265 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:29:06 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5604a0a3-82f0-4d15-8e42-1d770f51b265 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:29:06 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[35146506-182a-49b9-8dc1-26e0d77e9684]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:29:06 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-de5964d9-0ea4-41be-bd25-bec67e275348 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:29:06 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5604a0a3-82f0-4d15-8e42-1d770f51b265 -p 172.16.0.220:3260 --logout {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:29:06 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5604a0a3-82f0-4d15-8e42-1d770f51b265 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:29:06 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c802a86-5b34-4b39-9e06-c7cb9d61e9fe]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:5604a0a3-82f0-4d15-8e42-1d770f51b265, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:5604a0a3-82f0-4d15-8e42-1d770f51b265, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:29:06 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-de5964d9-0ea4-41be-bd25-bec67e275348 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:5604a0a3-82f0-4d15-8e42-1d770f51b265, portal: 172.16.0.220,3260]
Aug 26 10:29:06 user nova-compute[73572]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:5604a0a3-82f0-4d15-8e42-1d770f51b265, portal: 172.16.0.220,3260] successful.
Aug 26 10:29:06 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:29:06 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5604a0a3-82f0-4d15-8e42-1d770f51b265 -p 172.16.0.220:3260 --op delete {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:29:06 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5604a0a3-82f0-4d15-8e42-1d770f51b265 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:29:06 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[3744d590-69dc-4af8-9f5d-cba4b19ae3ca]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:29:06 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-de5964d9-0ea4-41be-bd25-bec67e275348 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:29:06 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-de5964d9-0ea4-41be-bd25-bec67e275348 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.264s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 10:29:06 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-de5964d9-0ea4-41be-bd25-bec67e275348 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] <== disconnect_volume: return (264ms) None {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 10:29:06 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de5964d9-0ea4-41be-bd25-bec67e275348 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] [instance: d03d1626-e18b-4b15-a679-4543f7641ed7] Disconnected iSCSI Volume {{(pid=73572) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 10:29:09 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:29:12 user nova-compute[73572]: DEBUG nova.compute.manager [None req-02ba6d5b-893a-4d99-8e37-bf117cd66cde tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 6076ed21-24d2-4921-b47e-f70702b0adf1] Start spawning the instance on the hypervisor. {{(pid=73572) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 10:29:12 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-02ba6d5b-893a-4d99-8e37-bf117cd66cde tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 6076ed21-24d2-4921-b47e-f70702b0adf1] Creating instance directory {{(pid=73572) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 10:29:12 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-02ba6d5b-893a-4d99-8e37-bf117cd66cde tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 6076ed21-24d2-4921-b47e-f70702b0adf1] Creating image(s)
Aug 26 10:29:12 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-02ba6d5b-893a-4d99-8e37-bf117cd66cde tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 6076ed21-24d2-4921-b47e-f70702b0adf1] Did not create local disks {{(pid=73572) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 26 10:29:12 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-02ba6d5b-893a-4d99-8e37-bf117cd66cde tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 6076ed21-24d2-4921-b47e-f70702b0adf1] Ensure instance console log exists: /opt/stack/data/nova/instances/6076ed21-24d2-4921-b47e-f70702b0adf1/console.log {{(pid=73572) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 10:29:12 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-02ba6d5b-893a-4d99-8e37-bf117cd66cde tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:29:12 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-02ba6d5b-893a-4d99-8e37-bf117cd66cde tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:29:12 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-02ba6d5b-893a-4d99-8e37-bf117cd66cde tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:29:12 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-02ba6d5b-893a-4d99-8e37-bf117cd66cde tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 6076ed21-24d2-4921-b47e-f70702b0adf1] Start _get_guest_xml network_info=[{"id": "49381412-2deb-4ed5-9b1c-3c693fefec38", "address": "fa:16:3e:6f:f9:b8", "network": {"id": "c520ee18-34a7-4781-bc97-419e9a702d40", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-280196989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfc130586d9f4581953f1b8ae1c4465e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49381412-2d", "ovs_interfaceid": "49381412-2deb-4ed5-9b1c-3c693fefec38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-08-26T10:28:30Z,direct_url=<?>,disk_format='qcow2',id=544ae7de-0284-42c0-9bfe-65adf5523670,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-52270331',owner='cfc130586d9f4581953f1b8ae1c4465e',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-08-26T10:28:32Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'disk_bus': 'virtio', 'boot_index': 0, 'mount_device': '/dev/vda', 'attachment_id': '94f40cce-f6cf-42e8-8a2e-d326cb1ccd7e', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:8c7946b2-965a-4156-9a34-72518f8596f0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UPnqyzCY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '6076ed21-24d2-4921-b47e-f70702b0adf1', 'attached_at': '', 'detached_at': '', 'volume_id': '8c7946b2-965a-4156-9a34-72518f8596f0', 'serial': '8c7946b2-965a-4156-9a34-72518f8596f0'}, 'guest_format': None, 'device_type': 'disk', 'volume_type': None} {{(pid=73572) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 10:29:12 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-02ba6d5b-893a-4d99-8e37-bf117cd66cde tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:29:12 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-02ba6d5b-893a-4d99-8e37-bf117cd66cde tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:29:12 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-02ba6d5b-893a-4d99-8e37-bf117cd66cde tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73572) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 10:29:12 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-02ba6d5b-893a-4d99-8e37-bf117cd66cde tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] CPU controller missing on host. {{(pid=73572) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 10:29:12 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-02ba6d5b-893a-4d99-8e37-bf117cd66cde tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73572) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 10:29:12 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-02ba6d5b-893a-4d99-8e37-bf117cd66cde tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] CPU controller found on host. {{(pid=73572) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 10:29:12 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-02ba6d5b-893a-4d99-8e37-bf117cd66cde tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73572) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 10:29:12 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-02ba6d5b-893a-4d99-8e37-bf117cd66cde tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T10:07:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-08-26T10:28:30Z,direct_url=<?>,disk_format='qcow2',id=544ae7de-0284-42c0-9bfe-65adf5523670,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-52270331',owner='cfc130586d9f4581953f1b8ae1c4465e',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-08-26T10:28:32Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 10:29:12 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-02ba6d5b-893a-4d99-8e37-bf117cd66cde tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Flavor limits 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 10:29:12 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-02ba6d5b-893a-4d99-8e37-bf117cd66cde tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Image limits 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 10:29:12 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-02ba6d5b-893a-4d99-8e37-bf117cd66cde tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Flavor pref 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 10:29:12 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-02ba6d5b-893a-4d99-8e37-bf117cd66cde tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Image pref 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 10:29:12 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-02ba6d5b-893a-4d99-8e37-bf117cd66cde tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 10:29:12 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-02ba6d5b-893a-4d99-8e37-bf117cd66cde tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 10:29:12 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-02ba6d5b-893a-4d99-8e37-bf117cd66cde tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73572) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 10:29:12 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-02ba6d5b-893a-4d99-8e37-bf117cd66cde tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Got 1 possible topologies {{(pid=73572) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 10:29:12 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-02ba6d5b-893a-4d99-8e37-bf117cd66cde tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 10:29:12 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-02ba6d5b-893a-4d99-8e37-bf117cd66cde tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 10:29:12 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-02ba6d5b-893a-4d99-8e37-bf117cd66cde tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 6076ed21-24d2-4921-b47e-f70702b0adf1] Calling os-brick to attach iSCSI Volume {{(pid=73572) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 10:29:12 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-02ba6d5b-893a-4d99-8e37-bf117cd66cde tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc89c3d6a10>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:8c7946b2-965a-4156-9a34-72518f8596f0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UPnqyzCY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 10:29:12 user nova-compute[73572]: WARNING os_brick.initiator.connectors.base [None req-02ba6d5b-893a-4d99-8e37-bf117cd66cde tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 10:29:12 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-02ba6d5b-893a-4d99-8e37-bf117cd66cde tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 10:29:12 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-02ba6d5b-893a-4d99-8e37-bf117cd66cde tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 10:29:12 user nova-compute[73572]: WARNING os_brick.initiator.connectors.base [None req-02ba6d5b-893a-4d99-8e37-bf117cd66cde tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 10:29:12 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-02ba6d5b-893a-4d99-8e37-bf117cd66cde tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8c7946b2-965a-4156-9a34-72518f8596f0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 10:29:12 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-02ba6d5b-893a-4d99-8e37-bf117cd66cde tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8c7946b2-965a-4156-9a34-72518f8596f0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 10:29:12 user nova-compute[73572]: INFO os_brick.initiator.connectors.iscsi [None req-02ba6d5b-893a-4d99-8e37-bf117cd66cde tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 10:29:12 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c7946b2-965a-4156-9a34-72518f8596f0 -p 172.16.0.220:3260 {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:29:12 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c7946b2-965a-4156-9a34-72518f8596f0 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:29:12 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[57de717a-ebfe-4d1b-bff3-4b932d8f68b2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:29:12 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-02ba6d5b-893a-4d99-8e37-bf117cd66cde tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 10:29:12 user nova-compute[73572]:  {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:29:12 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c7946b2-965a-4156-9a34-72518f8596f0 -p 172.16.0.220:3260 --interface default --op new {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:29:12 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c7946b2-965a-4156-9a34-72518f8596f0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:29:12 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[c318e327-2aea-4b2b-9955-9d208047d21d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8c7946b2-965a-4156-9a34-72518f8596f0] added\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:29:12 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-02ba6d5b-893a-4d99-8e37-bf117cd66cde tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8c7946b2-965a-4156-9a34-72518f8596f0] added
Aug 26 10:29:12 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:29:12 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c7946b2-965a-4156-9a34-72518f8596f0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:29:12 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c7946b2-965a-4156-9a34-72518f8596f0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:29:12 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[22cc8b9c-5ad6-49e0-a6ce-749205a1c3ca]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:29:12 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-02ba6d5b-893a-4d99-8e37-bf117cd66cde tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:29:12 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c7946b2-965a-4156-9a34-72518f8596f0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:29:12 user nova-compute[73572]: DEBUG nova.objects.instance [None req-de5964d9-0ea4-41be-bd25-bec67e275348 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Lazy-loading 'flavor' on Instance uuid d03d1626-e18b-4b15-a679-4543f7641ed7 {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:29:12 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c7946b2-965a-4156-9a34-72518f8596f0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:29:12 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[765f9289-d1fd-4f3d-8ae1-d8119e810e22]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:29:12 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-02ba6d5b-893a-4d99-8e37-bf117cd66cde tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:29:12 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c7946b2-965a-4156-9a34-72518f8596f0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UPnqyzCY {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:29:12 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c7946b2-965a-4156-9a34-72518f8596f0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UPnqyzCY" returned: 0 in 0.018s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:29:12 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[6936e41d-e289-4164-8b25-73161249639b]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:29:12 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-02ba6d5b-893a-4d99-8e37-bf117cd66cde tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UPnqyzCY'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:29:12 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-de5964d9-0ea4-41be-bd25-bec67e275348 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Lock "d03d1626-e18b-4b15-a679-4543f7641ed7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 6.486s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:29:12 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c7946b2-965a-4156-9a34-72518f8596f0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:29:12 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c7946b2-965a-4156-9a34-72518f8596f0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:29:12 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[3175e8e6-0f04-4c0a-b365-8edcdbba7476]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:29:12 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-02ba6d5b-893a-4d99-8e37-bf117cd66cde tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:29:12 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:29:12 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:29:12 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[0885cba8-0d6c-4b66-9f7b-c8e562f4a00e]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133098b2-106a-427f-aa6d-2c10625dd152 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:448cd30a-3852-471f-903f-a2e5abc34b55 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f8ad7ba-4084-4cd7-920f-8f7948de4212 (non-flash)\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:29:12 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-02ba6d5b-893a-4d99-8e37-bf117cd66cde tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)
Aug 26 10:29:12 user nova-compute[73572]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133098b2-106a-427f-aa6d-2c10625dd152 (non-flash)
Aug 26 10:29:12 user nova-compute[73572]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:448cd30a-3852-471f-903f-a2e5abc34b55 (non-flash)
Aug 26 10:29:12 user nova-compute[73572]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f8ad7ba-4084-4cd7-920f-8f7948de4212 (non-flash)
Aug 26 10:29:12 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 10:29:12 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-02ba6d5b-893a-4d99-8e37-bf117cd66cde tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)
Aug 26 10:29:12 user nova-compute[73572]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133098b2-106a-427f-aa6d-2c10625dd152 (non-flash)
Aug 26 10:29:12 user nova-compute[73572]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:448cd30a-3852-471f-903f-a2e5abc34b55 (non-flash)
Aug 26 10:29:12 user nova-compute[73572]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f8ad7ba-4084-4cd7-920f-8f7948de4212 (non-flash)
Aug 26 10:29:12 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 10:29:12 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c7946b2-965a-4156-9a34-72518f8596f0 -p 172.16.0.220:3260 --login {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:29:12 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c7946b2-965a-4156-9a34-72518f8596f0 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:29:12 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[a95c2c37-7b75-46ed-b806-47249fb91aa1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8c7946b2-965a-4156-9a34-72518f8596f0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8c7946b2-965a-4156-9a34-72518f8596f0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:29:12 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-02ba6d5b-893a-4d99-8e37-bf117cd66cde tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8c7946b2-965a-4156-9a34-72518f8596f0, portal: 172.16.0.220,3260]
Aug 26 10:29:12 user nova-compute[73572]: Login to [iface: default, target: iqn.2010-10.org.openstack:8c7946b2-965a-4156-9a34-72518f8596f0, portal: 172.16.0.220,3260] successful.
Aug 26 10:29:12 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:29:12 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c7946b2-965a-4156-9a34-72518f8596f0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:29:12 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c7946b2-965a-4156-9a34-72518f8596f0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:29:12 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[a133f10e-a005-4927-b5c5-4e381631d56a]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:29:12 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-02ba6d5b-893a-4d99-8e37-bf117cd66cde tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:29:12 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:29:12 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:29:12 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b4be9ac-336e-4ffb-a353-7e081be6cb73]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133098b2-106a-427f-aa6d-2c10625dd152 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:448cd30a-3852-471f-903f-a2e5abc34b55 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f8ad7ba-4084-4cd7-920f-8f7948de4212 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c7946b2-965a-4156-9a34-72518f8596f0 (non-flash)\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:29:12 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-02ba6d5b-893a-4d99-8e37-bf117cd66cde tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)
Aug 26 10:29:12 user nova-compute[73572]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133098b2-106a-427f-aa6d-2c10625dd152 (non-flash)
Aug 26 10:29:12 user nova-compute[73572]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:448cd30a-3852-471f-903f-a2e5abc34b55 (non-flash)
Aug 26 10:29:12 user nova-compute[73572]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f8ad7ba-4084-4cd7-920f-8f7948de4212 (non-flash)
Aug 26 10:29:12 user nova-compute[73572]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c7946b2-965a-4156-9a34-72518f8596f0 (non-flash)
Aug 26 10:29:12 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 10:29:12 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-02ba6d5b-893a-4d99-8e37-bf117cd66cde tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)
Aug 26 10:29:12 user nova-compute[73572]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133098b2-106a-427f-aa6d-2c10625dd152 (non-flash)
Aug 26 10:29:12 user nova-compute[73572]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:448cd30a-3852-471f-903f-a2e5abc34b55 (non-flash)
Aug 26 10:29:12 user nova-compute[73572]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f8ad7ba-4084-4cd7-920f-8f7948de4212 (non-flash)
Aug 26 10:29:12 user nova-compute[73572]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c7946b2-965a-4156-9a34-72518f8596f0 (non-flash)
Aug 26 10:29:12 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 10:29:12 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-02ba6d5b-893a-4d99-8e37-bf117cd66cde tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8c7946b2-965a-4156-9a34-72518f8596f0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.292s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 10:29:12 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-02ba6d5b-893a-4d99-8e37-bf117cd66cde tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Connected to 172.16.0.220:3260 {{(pid=73572) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 10:29:12 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-02ba6d5b-893a-4d99-8e37-bf117cd66cde tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] HCTL ('35', '-', '-', 0) found on session 43 with lun 0 {{(pid=73572) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 10:29:12 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-02ba6d5b-893a-4d99-8e37-bf117cd66cde tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73572) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 10:29:12 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:29:12 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:29:12 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cb729f2-4dd1-462e-a2c6-00c63eee4d6f]: (4, ('- - 0', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:29:12 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-02ba6d5b-893a-4d99-8e37-bf117cd66cde tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Searching for a device in session 43 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73572) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 10:29:12 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-02ba6d5b-893a-4d99-8e37-bf117cd66cde tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UPnqyzCY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73572) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 10:29:13 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-02ba6d5b-893a-4d99-8e37-bf117cd66cde tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.324s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 10:29:13 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-02ba6d5b-893a-4d99-8e37-bf117cd66cde tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] <== connect_volume: return (1325ms) {'type': 'block', 'scsi_wwn': '26233353137616336', 'path': '/dev/sdd'} {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 10:29:13 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-02ba6d5b-893a-4d99-8e37-bf117cd66cde tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 6076ed21-24d2-4921-b47e-f70702b0adf1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26233353137616336', 'path': '/dev/sdd'} {{(pid=73572) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 10:29:13 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-02ba6d5b-893a-4d99-8e37-bf117cd66cde tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T10:28:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1191607855',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1191607855',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1191607855',id=41,image_ref='544ae7de-0284-42c0-9bfe-65adf5523670',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHFSJE2g2PjDiDqwewJpsXro8A5LPvfdKpVqM1E/P47SmR9F9iooXILdAPkSmVUPBnQDNFAeGEbTvljBE84bSsovPui5kFoS1RXOhZtS7jbSiwoC5/V92HY7HEr92ASF1Q==',key_name='tempest-keypair-1121287772',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cfc130586d9f4581953f1b8ae1c4465e',ramdisk_id='',reservation_id='r-eh9ofgkx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-73786062',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-73786062-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-73786062',owner_user_name='tempest-TestVolumeBootPattern-73786062-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T10:28:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e1e80942e5db41c782bda686b10e2e4b',uuid=6076ed21-24d2-4921-b47e-f70702b0adf1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "49381412-2deb-4ed5-9b1c-3c693fefec38", "address": "fa:16:3e:6f:f9:b8", "network": {"id": "c520ee18-34a7-4781-bc97-419e9a702d40", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-280196989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfc130586d9f4581953f1b8ae1c4465e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49381412-2d", "ovs_interfaceid": "49381412-2deb-4ed5-9b1c-3c693fefec38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73572) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 10:29:13 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-02ba6d5b-893a-4d99-8e37-bf117cd66cde tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Converting VIF {"id": "49381412-2deb-4ed5-9b1c-3c693fefec38", "address": "fa:16:3e:6f:f9:b8", "network": {"id": "c520ee18-34a7-4781-bc97-419e9a702d40", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-280196989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfc130586d9f4581953f1b8ae1c4465e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49381412-2d", "ovs_interfaceid": "49381412-2deb-4ed5-9b1c-3c693fefec38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:29:13 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-02ba6d5b-893a-4d99-8e37-bf117cd66cde tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6f:f9:b8,bridge_name='br-int',has_traffic_filtering=True,id=49381412-2deb-4ed5-9b1c-3c693fefec38,network=Network(c520ee18-34a7-4781-bc97-419e9a702d40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49381412-2d') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:29:13 user nova-compute[73572]: DEBUG nova.objects.instance [None req-02ba6d5b-893a-4d99-8e37-bf117cd66cde tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Lazy-loading 'pci_devices' on Instance uuid 6076ed21-24d2-4921-b47e-f70702b0adf1 {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:29:13 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-02ba6d5b-893a-4d99-8e37-bf117cd66cde tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 6076ed21-24d2-4921-b47e-f70702b0adf1] End _get_guest_xml xml=<domain type="kvm">
Aug 26 10:29:13 user nova-compute[73572]:   <uuid>6076ed21-24d2-4921-b47e-f70702b0adf1</uuid>
Aug 26 10:29:13 user nova-compute[73572]:   <name>instance-00000029</name>
Aug 26 10:29:13 user nova-compute[73572]:   <memory>524288</memory>
Aug 26 10:29:13 user nova-compute[73572]:   <vcpu>1</vcpu>
Aug 26 10:29:13 user nova-compute[73572]:   <metadata>
Aug 26 10:29:13 user nova-compute[73572]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 10:29:13 user nova-compute[73572]:       <nova:package version="0.0.0"/>
Aug 26 10:29:13 user nova-compute[73572]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-1191607855</nova:name>
Aug 26 10:29:13 user nova-compute[73572]:       <nova:creationTime>2023-08-26 10:29:12</nova:creationTime>
Aug 26 10:29:13 user nova-compute[73572]:       <nova:flavor name="m1.tiny">
Aug 26 10:29:13 user nova-compute[73572]:         <nova:memory>512</nova:memory>
Aug 26 10:29:13 user nova-compute[73572]:         <nova:disk>1</nova:disk>
Aug 26 10:29:13 user nova-compute[73572]:         <nova:swap>0</nova:swap>
Aug 26 10:29:13 user nova-compute[73572]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 10:29:13 user nova-compute[73572]:         <nova:vcpus>1</nova:vcpus>
Aug 26 10:29:13 user nova-compute[73572]:       </nova:flavor>
Aug 26 10:29:13 user nova-compute[73572]:       <nova:owner>
Aug 26 10:29:13 user nova-compute[73572]:         <nova:user uuid="e1e80942e5db41c782bda686b10e2e4b">tempest-TestVolumeBootPattern-73786062-project-member</nova:user>
Aug 26 10:29:13 user nova-compute[73572]:         <nova:project uuid="cfc130586d9f4581953f1b8ae1c4465e">tempest-TestVolumeBootPattern-73786062</nova:project>
Aug 26 10:29:13 user nova-compute[73572]:       </nova:owner>
Aug 26 10:29:13 user nova-compute[73572]:       <nova:root type="image" uuid="544ae7de-0284-42c0-9bfe-65adf5523670"/>
Aug 26 10:29:13 user nova-compute[73572]:       <nova:ports>
Aug 26 10:29:13 user nova-compute[73572]:         <nova:port uuid="49381412-2deb-4ed5-9b1c-3c693fefec38">
Aug 26 10:29:13 user nova-compute[73572]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 26 10:29:13 user nova-compute[73572]:         </nova:port>
Aug 26 10:29:13 user nova-compute[73572]:       </nova:ports>
Aug 26 10:29:13 user nova-compute[73572]:     </nova:instance>
Aug 26 10:29:13 user nova-compute[73572]:   </metadata>
Aug 26 10:29:13 user nova-compute[73572]:   <sysinfo type="smbios">
Aug 26 10:29:13 user nova-compute[73572]:     <system>
Aug 26 10:29:13 user nova-compute[73572]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 10:29:13 user nova-compute[73572]:       <entry name="product">OpenStack Nova</entry>
Aug 26 10:29:13 user nova-compute[73572]:       <entry name="version">0.0.0</entry>
Aug 26 10:29:13 user nova-compute[73572]:       <entry name="serial">6076ed21-24d2-4921-b47e-f70702b0adf1</entry>
Aug 26 10:29:13 user nova-compute[73572]:       <entry name="uuid">6076ed21-24d2-4921-b47e-f70702b0adf1</entry>
Aug 26 10:29:13 user nova-compute[73572]:       <entry name="family">Virtual Machine</entry>
Aug 26 10:29:13 user nova-compute[73572]:     </system>
Aug 26 10:29:13 user nova-compute[73572]:   </sysinfo>
Aug 26 10:29:13 user nova-compute[73572]:   <os>
Aug 26 10:29:13 user nova-compute[73572]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 10:29:13 user nova-compute[73572]:     <boot dev="hd"/>
Aug 26 10:29:13 user nova-compute[73572]:     <smbios mode="sysinfo"/>
Aug 26 10:29:13 user nova-compute[73572]:   </os>
Aug 26 10:29:13 user nova-compute[73572]:   <features>
Aug 26 10:29:13 user nova-compute[73572]:     <acpi/>
Aug 26 10:29:13 user nova-compute[73572]:     <apic/>
Aug 26 10:29:13 user nova-compute[73572]:     <vmcoreinfo/>
Aug 26 10:29:13 user nova-compute[73572]:   </features>
Aug 26 10:29:13 user nova-compute[73572]:   <clock offset="utc">
Aug 26 10:29:13 user nova-compute[73572]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 10:29:13 user nova-compute[73572]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 10:29:13 user nova-compute[73572]:     <timer name="hpet" present="no"/>
Aug 26 10:29:13 user nova-compute[73572]:   </clock>
Aug 26 10:29:13 user nova-compute[73572]:   <cpu mode="custom" match="exact">
Aug 26 10:29:13 user nova-compute[73572]:     <model>Nehalem</model>
Aug 26 10:29:13 user nova-compute[73572]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 10:29:13 user nova-compute[73572]:   </cpu>
Aug 26 10:29:13 user nova-compute[73572]:   <devices>
Aug 26 10:29:13 user nova-compute[73572]:     <disk type="block" device="disk">
Aug 26 10:29:13 user nova-compute[73572]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 10:29:13 user nova-compute[73572]:       <source dev="/dev/sdd"/>
Aug 26 10:29:13 user nova-compute[73572]:       <target dev="vda" bus="virtio"/>
Aug 26 10:29:13 user nova-compute[73572]:       <serial>8c7946b2-965a-4156-9a34-72518f8596f0</serial>
Aug 26 10:29:13 user nova-compute[73572]:     </disk>
Aug 26 10:29:13 user nova-compute[73572]:     <interface type="ethernet">
Aug 26 10:29:13 user nova-compute[73572]:       <mac address="fa:16:3e:6f:f9:b8"/>
Aug 26 10:29:13 user nova-compute[73572]:       <model type="virtio"/>
Aug 26 10:29:13 user nova-compute[73572]:       <mtu size="1442"/>
Aug 26 10:29:13 user nova-compute[73572]:       <target dev="tap49381412-2d"/>
Aug 26 10:29:13 user nova-compute[73572]:     </interface>
Aug 26 10:29:13 user nova-compute[73572]:     <serial type="pty">
Aug 26 10:29:13 user nova-compute[73572]:       <log file="/opt/stack/data/nova/instances/6076ed21-24d2-4921-b47e-f70702b0adf1/console.log" append="off"/>
Aug 26 10:29:13 user nova-compute[73572]:     </serial>
Aug 26 10:29:13 user nova-compute[73572]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 10:29:13 user nova-compute[73572]:     <video>
Aug 26 10:29:13 user nova-compute[73572]:       <model type="virtio"/>
Aug 26 10:29:13 user nova-compute[73572]:     </video>
Aug 26 10:29:13 user nova-compute[73572]:     <rng model="virtio">
Aug 26 10:29:13 user nova-compute[73572]:       <backend model="random">/dev/urandom</backend>
Aug 26 10:29:13 user nova-compute[73572]:     </rng>
Aug 26 10:29:13 user nova-compute[73572]:     <controller type="usb" index="0" model="none"/>
Aug 26 10:29:13 user nova-compute[73572]:     <memballoon model="virtio">
Aug 26 10:29:13 user nova-compute[73572]:       <stats period="10"/>
Aug 26 10:29:13 user nova-compute[73572]:     </memballoon>
Aug 26 10:29:13 user nova-compute[73572]:   </devices>
Aug 26 10:29:13 user nova-compute[73572]: </domain>
Aug 26 10:29:13 user nova-compute[73572]:  {{(pid=73572) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 10:29:13 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-02ba6d5b-893a-4d99-8e37-bf117cd66cde tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T10:28:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1191607855',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1191607855',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1191607855',id=41,image_ref='544ae7de-0284-42c0-9bfe-65adf5523670',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHFSJE2g2PjDiDqwewJpsXro8A5LPvfdKpVqM1E/P47SmR9F9iooXILdAPkSmVUPBnQDNFAeGEbTvljBE84bSsovPui5kFoS1RXOhZtS7jbSiwoC5/V92HY7HEr92ASF1Q==',key_name='tempest-keypair-1121287772',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cfc130586d9f4581953f1b8ae1c4465e',ramdisk_id='',reservation_id='r-eh9ofgkx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-73786062',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-73786062-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-73786062',owner_user_name='tempest-TestVolumeBootPattern-73786062-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T10:28:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e1e80942e5db41c782bda686b10e2e4b',uuid=6076ed21-24d2-4921-b47e-f70702b0adf1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "49381412-2deb-4ed5-9b1c-3c693fefec38", "address": "fa:16:3e:6f:f9:b8", "network": {"id": "c520ee18-34a7-4781-bc97-419e9a702d40", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-280196989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfc130586d9f4581953f1b8ae1c4465e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49381412-2d", "ovs_interfaceid": "49381412-2deb-4ed5-9b1c-3c693fefec38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 10:29:13 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-02ba6d5b-893a-4d99-8e37-bf117cd66cde tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Converting VIF {"id": "49381412-2deb-4ed5-9b1c-3c693fefec38", "address": "fa:16:3e:6f:f9:b8", "network": {"id": "c520ee18-34a7-4781-bc97-419e9a702d40", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-280196989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfc130586d9f4581953f1b8ae1c4465e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49381412-2d", "ovs_interfaceid": "49381412-2deb-4ed5-9b1c-3c693fefec38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:29:13 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-02ba6d5b-893a-4d99-8e37-bf117cd66cde tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6f:f9:b8,bridge_name='br-int',has_traffic_filtering=True,id=49381412-2deb-4ed5-9b1c-3c693fefec38,network=Network(c520ee18-34a7-4781-bc97-419e9a702d40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49381412-2d') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:29:13 user nova-compute[73572]: DEBUG os_vif [None req-02ba6d5b-893a-4d99-8e37-bf117cd66cde tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:f9:b8,bridge_name='br-int',has_traffic_filtering=True,id=49381412-2deb-4ed5-9b1c-3c693fefec38,network=Network(c520ee18-34a7-4781-bc97-419e9a702d40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49381412-2d') {{(pid=73572) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 10:29:13 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:29:13 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:29:13 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 10:29:13 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:29:13 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap49381412-2d, may_exist=True, interface_attrs={}) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:29:13 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap49381412-2d, col_values=(('external_ids', {'iface-id': '49381412-2deb-4ed5-9b1c-3c693fefec38', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6f:f9:b8', 'vm-uuid': '6076ed21-24d2-4921-b47e-f70702b0adf1'}),), if_exists=True) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:29:13 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:29:13 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:29:13 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:29:13 user nova-compute[73572]: INFO os_vif [None req-02ba6d5b-893a-4d99-8e37-bf117cd66cde tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:f9:b8,bridge_name='br-int',has_traffic_filtering=True,id=49381412-2deb-4ed5-9b1c-3c693fefec38,network=Network(c520ee18-34a7-4781-bc97-419e9a702d40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49381412-2d')
Aug 26 10:29:13 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-02ba6d5b-893a-4d99-8e37-bf117cd66cde tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] No BDM found with device name vda, not building metadata. {{(pid=73572) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 10:29:13 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-02ba6d5b-893a-4d99-8e37-bf117cd66cde tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] No VIF found with MAC fa:16:3e:6f:f9:b8, not building metadata {{(pid=73572) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 10:29:15 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:29:15 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:29:15 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:29:15 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:29:15 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:29:15 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:29:15 user nova-compute[73572]: DEBUG nova.compute.manager [req-2f44c7db-d77f-4bcd-81fd-32e446677d43 req-b3a7c057-fedf-4e31-ab9b-b04366d7db03 service nova] [instance: 6076ed21-24d2-4921-b47e-f70702b0adf1] Received event network-vif-plugged-49381412-2deb-4ed5-9b1c-3c693fefec38 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:29:15 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-2f44c7db-d77f-4bcd-81fd-32e446677d43 req-b3a7c057-fedf-4e31-ab9b-b04366d7db03 service nova] Acquiring lock "6076ed21-24d2-4921-b47e-f70702b0adf1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:29:15 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-2f44c7db-d77f-4bcd-81fd-32e446677d43 req-b3a7c057-fedf-4e31-ab9b-b04366d7db03 service nova] Lock "6076ed21-24d2-4921-b47e-f70702b0adf1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:29:15 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-2f44c7db-d77f-4bcd-81fd-32e446677d43 req-b3a7c057-fedf-4e31-ab9b-b04366d7db03 service nova] Lock "6076ed21-24d2-4921-b47e-f70702b0adf1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:29:15 user nova-compute[73572]: DEBUG nova.compute.manager [req-2f44c7db-d77f-4bcd-81fd-32e446677d43 req-b3a7c057-fedf-4e31-ab9b-b04366d7db03 service nova] [instance: 6076ed21-24d2-4921-b47e-f70702b0adf1] No waiting events found dispatching network-vif-plugged-49381412-2deb-4ed5-9b1c-3c693fefec38 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:29:15 user nova-compute[73572]: WARNING nova.compute.manager [req-2f44c7db-d77f-4bcd-81fd-32e446677d43 req-b3a7c057-fedf-4e31-ab9b-b04366d7db03 service nova] [instance: 6076ed21-24d2-4921-b47e-f70702b0adf1] Received unexpected event network-vif-plugged-49381412-2deb-4ed5-9b1c-3c693fefec38 for instance with vm_state building and task_state spawning.
Aug 26 10:29:16 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:29:16 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Starting heal instance info cache {{(pid=73572) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 10:29:16 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquiring lock "refresh_cache-e468b473-515f-41ad-a75c-65d4c6d575c8" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:29:16 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquired lock "refresh_cache-e468b473-515f-41ad-a75c-65d4c6d575c8" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:29:16 user nova-compute[73572]: DEBUG nova.network.neutron [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] [instance: e468b473-515f-41ad-a75c-65d4c6d575c8] Forcefully refreshing network info cache for instance {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 10:29:17 user nova-compute[73572]: DEBUG nova.network.neutron [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] [instance: e468b473-515f-41ad-a75c-65d4c6d575c8] Updating instance_info_cache with network_info: [{"id": "fa77d8f8-b250-421f-a410-34f61a42bd83", "address": "fa:16:3e:29:89:56", "network": {"id": "991b9dff-5173-4456-a530-b1f7eb5cfa4a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1845930297-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4636f93c5bfc4653804de097aed2882c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa77d8f8-b2", "ovs_interfaceid": "fa77d8f8-b250-421f-a410-34f61a42bd83", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:29:17 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Releasing lock "refresh_cache-e468b473-515f-41ad-a75c-65d4c6d575c8" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:29:17 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] [instance: e468b473-515f-41ad-a75c-65d4c6d575c8] Updated the network info_cache for instance {{(pid=73572) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 10:29:17 user nova-compute[73572]: DEBUG nova.compute.manager [None req-02ba6d5b-893a-4d99-8e37-bf117cd66cde tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 6076ed21-24d2-4921-b47e-f70702b0adf1] Instance event wait completed in 0 seconds for  {{(pid=73572) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 10:29:17 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-02ba6d5b-893a-4d99-8e37-bf117cd66cde tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 6076ed21-24d2-4921-b47e-f70702b0adf1] Guest created on hypervisor {{(pid=73572) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 10:29:17 user nova-compute[73572]: DEBUG nova.virt.driver [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Emitting event <LifecycleEvent: 1693045757.5214097, 6076ed21-24d2-4921-b47e-f70702b0adf1 => Resumed> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:29:17 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 6076ed21-24d2-4921-b47e-f70702b0adf1] VM Resumed (Lifecycle Event)
Aug 26 10:29:17 user nova-compute[73572]: INFO nova.virt.libvirt.driver [-] [instance: 6076ed21-24d2-4921-b47e-f70702b0adf1] Instance spawned successfully.
Aug 26 10:29:17 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-02ba6d5b-893a-4d99-8e37-bf117cd66cde tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 6076ed21-24d2-4921-b47e-f70702b0adf1] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 10:29:17 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-02ba6d5b-893a-4d99-8e37-bf117cd66cde tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 6076ed21-24d2-4921-b47e-f70702b0adf1] Found default for hw_input_bus of None {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:29:17 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-02ba6d5b-893a-4d99-8e37-bf117cd66cde tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 6076ed21-24d2-4921-b47e-f70702b0adf1] Found default for hw_pointer_model of None {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:29:17 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 6076ed21-24d2-4921-b47e-f70702b0adf1] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:29:17 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 6076ed21-24d2-4921-b47e-f70702b0adf1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73572) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 10:29:17 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 6076ed21-24d2-4921-b47e-f70702b0adf1] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 10:29:17 user nova-compute[73572]: DEBUG nova.virt.driver [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Emitting event <LifecycleEvent: 1693045757.5241566, 6076ed21-24d2-4921-b47e-f70702b0adf1 => Started> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:29:17 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 6076ed21-24d2-4921-b47e-f70702b0adf1] VM Started (Lifecycle Event)
Aug 26 10:29:17 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 6076ed21-24d2-4921-b47e-f70702b0adf1] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:29:17 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 6076ed21-24d2-4921-b47e-f70702b0adf1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73572) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 10:29:17 user nova-compute[73572]: INFO nova.compute.manager [None req-02ba6d5b-893a-4d99-8e37-bf117cd66cde tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 6076ed21-24d2-4921-b47e-f70702b0adf1] Took 5.33 seconds to spawn the instance on the hypervisor.
Aug 26 10:29:17 user nova-compute[73572]: DEBUG nova.compute.manager [None req-02ba6d5b-893a-4d99-8e37-bf117cd66cde tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 6076ed21-24d2-4921-b47e-f70702b0adf1] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:29:17 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 6076ed21-24d2-4921-b47e-f70702b0adf1] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 10:29:17 user nova-compute[73572]: DEBUG nova.compute.manager [req-531da407-1df5-4d20-aced-9b70a8c0cee5 req-928a7f34-497f-48ac-9a70-6be24d878f71 service nova] [instance: 6076ed21-24d2-4921-b47e-f70702b0adf1] Received event network-vif-plugged-49381412-2deb-4ed5-9b1c-3c693fefec38 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:29:17 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-531da407-1df5-4d20-aced-9b70a8c0cee5 req-928a7f34-497f-48ac-9a70-6be24d878f71 service nova] Acquiring lock "6076ed21-24d2-4921-b47e-f70702b0adf1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:29:17 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-531da407-1df5-4d20-aced-9b70a8c0cee5 req-928a7f34-497f-48ac-9a70-6be24d878f71 service nova] Lock "6076ed21-24d2-4921-b47e-f70702b0adf1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:29:17 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-531da407-1df5-4d20-aced-9b70a8c0cee5 req-928a7f34-497f-48ac-9a70-6be24d878f71 service nova] Lock "6076ed21-24d2-4921-b47e-f70702b0adf1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:29:17 user nova-compute[73572]: DEBUG nova.compute.manager [req-531da407-1df5-4d20-aced-9b70a8c0cee5 req-928a7f34-497f-48ac-9a70-6be24d878f71 service nova] [instance: 6076ed21-24d2-4921-b47e-f70702b0adf1] No waiting events found dispatching network-vif-plugged-49381412-2deb-4ed5-9b1c-3c693fefec38 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:29:17 user nova-compute[73572]: WARNING nova.compute.manager [req-531da407-1df5-4d20-aced-9b70a8c0cee5 req-928a7f34-497f-48ac-9a70-6be24d878f71 service nova] [instance: 6076ed21-24d2-4921-b47e-f70702b0adf1] Received unexpected event network-vif-plugged-49381412-2deb-4ed5-9b1c-3c693fefec38 for instance with vm_state building and task_state spawning.
Aug 26 10:29:17 user nova-compute[73572]: INFO nova.compute.manager [None req-02ba6d5b-893a-4d99-8e37-bf117cd66cde tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 6076ed21-24d2-4921-b47e-f70702b0adf1] Took 35.61 seconds to build instance.
Aug 26 10:29:17 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-02ba6d5b-893a-4d99-8e37-bf117cd66cde tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Lock "6076ed21-24d2-4921-b47e-f70702b0adf1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 35.718s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:29:18 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:29:19 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:29:20 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:29:20 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-94fada24-ec60-4d5a-ac80-0f826d83dffd tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Acquiring lock "8a8816e5-696d-4384-b0e0-29aa7cdd957c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:29:20 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-94fada24-ec60-4d5a-ac80-0f826d83dffd tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Lock "8a8816e5-696d-4384-b0e0-29aa7cdd957c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:29:20 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-94fada24-ec60-4d5a-ac80-0f826d83dffd tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Acquiring lock "8a8816e5-696d-4384-b0e0-29aa7cdd957c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:29:20 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-94fada24-ec60-4d5a-ac80-0f826d83dffd tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Lock "8a8816e5-696d-4384-b0e0-29aa7cdd957c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:29:20 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-94fada24-ec60-4d5a-ac80-0f826d83dffd tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Lock "8a8816e5-696d-4384-b0e0-29aa7cdd957c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:29:20 user nova-compute[73572]: INFO nova.compute.manager [None req-94fada24-ec60-4d5a-ac80-0f826d83dffd tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: 8a8816e5-696d-4384-b0e0-29aa7cdd957c] Terminating instance
Aug 26 10:29:20 user nova-compute[73572]: DEBUG nova.compute.manager [None req-94fada24-ec60-4d5a-ac80-0f826d83dffd tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: 8a8816e5-696d-4384-b0e0-29aa7cdd957c] Start destroying the instance on the hypervisor. {{(pid=73572) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 10:29:20 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:29:21 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:29:21 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:29:21 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:29:21 user nova-compute[73572]: DEBUG nova.compute.manager [req-02a8b79d-db98-40fb-a39e-75f57813a7d0 req-503ced9f-8ab3-4fd4-8b0c-c3cd323d2f76 service nova] [instance: 8a8816e5-696d-4384-b0e0-29aa7cdd957c] Received event network-vif-unplugged-2e650fb9-427c-477e-ba45-ddc070399617 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:29:21 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-02a8b79d-db98-40fb-a39e-75f57813a7d0 req-503ced9f-8ab3-4fd4-8b0c-c3cd323d2f76 service nova] Acquiring lock "8a8816e5-696d-4384-b0e0-29aa7cdd957c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:29:21 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-02a8b79d-db98-40fb-a39e-75f57813a7d0 req-503ced9f-8ab3-4fd4-8b0c-c3cd323d2f76 service nova] Lock "8a8816e5-696d-4384-b0e0-29aa7cdd957c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:29:21 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-02a8b79d-db98-40fb-a39e-75f57813a7d0 req-503ced9f-8ab3-4fd4-8b0c-c3cd323d2f76 service nova] Lock "8a8816e5-696d-4384-b0e0-29aa7cdd957c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:29:21 user nova-compute[73572]: DEBUG nova.compute.manager [req-02a8b79d-db98-40fb-a39e-75f57813a7d0 req-503ced9f-8ab3-4fd4-8b0c-c3cd323d2f76 service nova] [instance: 8a8816e5-696d-4384-b0e0-29aa7cdd957c] No waiting events found dispatching network-vif-unplugged-2e650fb9-427c-477e-ba45-ddc070399617 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:29:21 user nova-compute[73572]: DEBUG nova.compute.manager [req-02a8b79d-db98-40fb-a39e-75f57813a7d0 req-503ced9f-8ab3-4fd4-8b0c-c3cd323d2f76 service nova] [instance: 8a8816e5-696d-4384-b0e0-29aa7cdd957c] Received event network-vif-unplugged-2e650fb9-427c-477e-ba45-ddc070399617 for instance with task_state deleting. {{(pid=73572) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 10:29:21 user nova-compute[73572]: INFO nova.virt.libvirt.driver [-] [instance: 8a8816e5-696d-4384-b0e0-29aa7cdd957c] Instance destroyed successfully.
Aug 26 10:29:21 user nova-compute[73572]: DEBUG nova.objects.instance [None req-94fada24-ec60-4d5a-ac80-0f826d83dffd tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Lazy-loading 'resources' on Instance uuid 8a8816e5-696d-4384-b0e0-29aa7cdd957c {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:29:21 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-94fada24-ec60-4d5a-ac80-0f826d83dffd tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T10:23:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1498662503',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1498662503',id=33,image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T10:25:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4636f93c5bfc4653804de097aed2882c',ramdisk_id='',reservation_id='r-96kck33c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-665602868',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T10:27:35Z,user_data=None,user_id='07f3538038a14713af3bbe420f1fb03a',uuid=8a8816e5-696d-4384-b0e0-29aa7cdd957c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2e650fb9-427c-477e-ba45-ddc070399617", "address": "fa:16:3e:6c:94:14", "network": {"id": "991b9dff-5173-4456-a530-b1f7eb5cfa4a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1845930297-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4636f93c5bfc4653804de097aed2882c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e650fb9-42", "ovs_interfaceid": "2e650fb9-427c-477e-ba45-ddc070399617", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 10:29:21 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-94fada24-ec60-4d5a-ac80-0f826d83dffd tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Converting VIF {"id": "2e650fb9-427c-477e-ba45-ddc070399617", "address": "fa:16:3e:6c:94:14", "network": {"id": "991b9dff-5173-4456-a530-b1f7eb5cfa4a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1845930297-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4636f93c5bfc4653804de097aed2882c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e650fb9-42", "ovs_interfaceid": "2e650fb9-427c-477e-ba45-ddc070399617", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:29:21 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-94fada24-ec60-4d5a-ac80-0f826d83dffd tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6c:94:14,bridge_name='br-int',has_traffic_filtering=True,id=2e650fb9-427c-477e-ba45-ddc070399617,network=Network(991b9dff-5173-4456-a530-b1f7eb5cfa4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e650fb9-42') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:29:21 user nova-compute[73572]: DEBUG os_vif [None req-94fada24-ec60-4d5a-ac80-0f826d83dffd tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6c:94:14,bridge_name='br-int',has_traffic_filtering=True,id=2e650fb9-427c-477e-ba45-ddc070399617,network=Network(991b9dff-5173-4456-a530-b1f7eb5cfa4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e650fb9-42') {{(pid=73572) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 10:29:21 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:29:21 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2e650fb9-42, bridge=br-int, if_exists=True) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:29:21 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:29:21 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:29:21 user nova-compute[73572]: INFO os_vif [None req-94fada24-ec60-4d5a-ac80-0f826d83dffd tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6c:94:14,bridge_name='br-int',has_traffic_filtering=True,id=2e650fb9-427c-477e-ba45-ddc070399617,network=Network(991b9dff-5173-4456-a530-b1f7eb5cfa4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e650fb9-42')
Aug 26 10:29:21 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-94fada24-ec60-4d5a-ac80-0f826d83dffd tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: 8a8816e5-696d-4384-b0e0-29aa7cdd957c] calling os-brick to detach iSCSI Volume {{(pid=73572) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 10:29:21 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-94fada24-ec60-4d5a-ac80-0f826d83dffd tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc89c3d6a10>, {'target_iqns': ['iqn.2010-10.org.openstack:133098b2-106a-427f-aa6d-2c10625dd152'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RvoAbQip', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 10:29:21 user nova-compute[73572]: WARNING os_brick.initiator.connectors.base [None req-94fada24-ec60-4d5a-ac80-0f826d83dffd tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 10:29:21 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-94fada24-ec60-4d5a-ac80-0f826d83dffd tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 10:29:21 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-94fada24-ec60-4d5a-ac80-0f826d83dffd tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 10:29:21 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-94fada24-ec60-4d5a-ac80-0f826d83dffd tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:133098b2-106a-427f-aa6d-2c10625dd152', 0)] {{(pid=73572) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 10:29:21 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:29:21 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:29:21 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[d37d2c66-22a7-4466-82d1-ea521b201adc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:133098b2-106a-427f-aa6d-2c10625dd152\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:448cd30a-3852-471f-903f-a2e5abc34b55\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8c7946b2-965a-4156-9a34-72518f8596f0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8f8ad7ba-4084-4cd7-920f-8f7948de4212\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:29:21 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:29:21 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:29:21 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:29:21 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[4abf559e-c123-4046-8d83-64b521a610d0]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133098b2-106a-427f-aa6d-2c10625dd152 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:448cd30a-3852-471f-903f-a2e5abc34b55 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f8ad7ba-4084-4cd7-920f-8f7948de4212 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c7946b2-965a-4156-9a34-72518f8596f0 (non-flash)\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:29:21 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-94fada24-ec60-4d5a-ac80-0f826d83dffd tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)
Aug 26 10:29:21 user nova-compute[73572]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133098b2-106a-427f-aa6d-2c10625dd152 (non-flash)
Aug 26 10:29:21 user nova-compute[73572]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:448cd30a-3852-471f-903f-a2e5abc34b55 (non-flash)
Aug 26 10:29:21 user nova-compute[73572]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f8ad7ba-4084-4cd7-920f-8f7948de4212 (non-flash)
Aug 26 10:29:21 user nova-compute[73572]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c7946b2-965a-4156-9a34-72518f8596f0 (non-flash)
Aug 26 10:29:21 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 10:29:21 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-94fada24-ec60-4d5a-ac80-0f826d83dffd tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)
Aug 26 10:29:21 user nova-compute[73572]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133098b2-106a-427f-aa6d-2c10625dd152 (non-flash)
Aug 26 10:29:21 user nova-compute[73572]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:448cd30a-3852-471f-903f-a2e5abc34b55 (non-flash)
Aug 26 10:29:21 user nova-compute[73572]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f8ad7ba-4084-4cd7-920f-8f7948de4212 (non-flash)
Aug 26 10:29:21 user nova-compute[73572]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c7946b2-965a-4156-9a34-72518f8596f0 (non-flash)
Aug 26 10:29:21 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 10:29:21 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-94fada24-ec60-4d5a-ac80-0f826d83dffd tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc8cb8e75b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:133098b2-106a-427f-aa6d-2c10625dd152'): ({'sde'}, set())}) {{(pid=73572) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 10:29:21 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-94fada24-ec60-4d5a-ac80-0f826d83dffd tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Removing single pathed devices sde {{(pid=73572) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 10:29:21 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:29:21 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:29:21 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[35a7f43e-553f-4aa7-9b75-3db3b886d932]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:29:21 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:29:21 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.021s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:29:21 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcaa6e4d-c478-4281-a4f6-1fd2d2d1d7dc]: (4, ('ok\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:29:21 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-94fada24-ec60-4d5a-ac80-0f826d83dffd tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Flushing IO for device /dev/sde {{(pid=73572) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 10:29:21 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:29:21 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:29:21 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c8800d0-2e4c-4ca9-9af2-633ffc5d47a4]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:29:21 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-94fada24-ec60-4d5a-ac80-0f826d83dffd tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73572) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 10:29:21 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:29:21 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.039s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:29:21 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[000177d7-b8a0-4b91-9c38-8bcf9f4f9414]: (4, ('1', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:29:21 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-94fada24-ec60-4d5a-ac80-0f826d83dffd tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73572) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 10:29:21 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-94fada24-ec60-4d5a-ac80-0f826d83dffd tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] SCSI volumes sde have been removed. {{(pid=73572) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 10:29:21 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-94fada24-ec60-4d5a-ac80-0f826d83dffd tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:133098b2-106a-427f-aa6d-2c10625dd152')] {{(pid=73572) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 10:29:21 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:133098b2-106a-427f-aa6d-2c10625dd152 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:29:21 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:133098b2-106a-427f-aa6d-2c10625dd152 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:29:21 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[7803da56-b050-4888-b786-5db32aaa376c]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:29:21 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-94fada24-ec60-4d5a-ac80-0f826d83dffd tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:29:21 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:133098b2-106a-427f-aa6d-2c10625dd152 -p 172.16.0.220:3260 --logout {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:29:22 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:133098b2-106a-427f-aa6d-2c10625dd152 -p 172.16.0.220:3260 --logout" returned: 0 in 0.078s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:29:22 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[74a32d4d-31f7-4105-b3f5-107f60f3c42b]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:133098b2-106a-427f-aa6d-2c10625dd152, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:133098b2-106a-427f-aa6d-2c10625dd152, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:29:22 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-94fada24-ec60-4d5a-ac80-0f826d83dffd tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:133098b2-106a-427f-aa6d-2c10625dd152, portal: 172.16.0.220,3260]
Aug 26 10:29:22 user nova-compute[73572]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:133098b2-106a-427f-aa6d-2c10625dd152, portal: 172.16.0.220,3260] successful.
Aug 26 10:29:22 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:29:22 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:133098b2-106a-427f-aa6d-2c10625dd152 -p 172.16.0.220:3260 --op delete {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:29:22 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:133098b2-106a-427f-aa6d-2c10625dd152 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:29:22 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[f527cb88-26d6-4760-8c89-6d2c47ae1bd5]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:29:22 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-94fada24-ec60-4d5a-ac80-0f826d83dffd tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:29:22 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-94fada24-ec60-4d5a-ac80-0f826d83dffd tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.341s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 10:29:22 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-94fada24-ec60-4d5a-ac80-0f826d83dffd tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] <== disconnect_volume: return (343ms) None {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 10:29:22 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-94fada24-ec60-4d5a-ac80-0f826d83dffd tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: 8a8816e5-696d-4384-b0e0-29aa7cdd957c] Disconnected iSCSI Volume {{(pid=73572) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 10:29:22 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-94fada24-ec60-4d5a-ac80-0f826d83dffd tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: 8a8816e5-696d-4384-b0e0-29aa7cdd957c] Deleting instance files /opt/stack/data/nova/instances/8a8816e5-696d-4384-b0e0-29aa7cdd957c_del
Aug 26 10:29:22 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-94fada24-ec60-4d5a-ac80-0f826d83dffd tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: 8a8816e5-696d-4384-b0e0-29aa7cdd957c] Deletion of /opt/stack/data/nova/instances/8a8816e5-696d-4384-b0e0-29aa7cdd957c_del complete
Aug 26 10:29:22 user nova-compute[73572]: INFO nova.compute.manager [None req-94fada24-ec60-4d5a-ac80-0f826d83dffd tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: 8a8816e5-696d-4384-b0e0-29aa7cdd957c] Took 1.26 seconds to destroy the instance on the hypervisor.
Aug 26 10:29:22 user nova-compute[73572]: DEBUG oslo.service.loopingcall [None req-94fada24-ec60-4d5a-ac80-0f826d83dffd tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73572) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 10:29:22 user nova-compute[73572]: DEBUG nova.compute.manager [-] [instance: 8a8816e5-696d-4384-b0e0-29aa7cdd957c] Deallocating network for instance {{(pid=73572) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 10:29:22 user nova-compute[73572]: DEBUG nova.network.neutron [-] [instance: 8a8816e5-696d-4384-b0e0-29aa7cdd957c] deallocate_for_instance() {{(pid=73572) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 10:29:22 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:29:22 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73572) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 10:29:22 user nova-compute[73572]: DEBUG nova.network.neutron [-] [instance: 8a8816e5-696d-4384-b0e0-29aa7cdd957c] Updating instance_info_cache with network_info: [] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:29:22 user nova-compute[73572]: INFO nova.compute.manager [-] [instance: 8a8816e5-696d-4384-b0e0-29aa7cdd957c] Took 0.70 seconds to deallocate network for instance.
Aug 26 10:29:23 user nova-compute[73572]: DEBUG nova.compute.manager [req-fe209de6-4154-4f05-a715-920f3be53e5e req-fe870de4-2c19-462c-b88c-70da967d9099 service nova] [instance: 8a8816e5-696d-4384-b0e0-29aa7cdd957c] Received event network-vif-plugged-2e650fb9-427c-477e-ba45-ddc070399617 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:29:23 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-fe209de6-4154-4f05-a715-920f3be53e5e req-fe870de4-2c19-462c-b88c-70da967d9099 service nova] Acquiring lock "8a8816e5-696d-4384-b0e0-29aa7cdd957c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:29:23 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-fe209de6-4154-4f05-a715-920f3be53e5e req-fe870de4-2c19-462c-b88c-70da967d9099 service nova] Lock "8a8816e5-696d-4384-b0e0-29aa7cdd957c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:29:23 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-fe209de6-4154-4f05-a715-920f3be53e5e req-fe870de4-2c19-462c-b88c-70da967d9099 service nova] Lock "8a8816e5-696d-4384-b0e0-29aa7cdd957c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:29:23 user nova-compute[73572]: DEBUG nova.compute.manager [req-fe209de6-4154-4f05-a715-920f3be53e5e req-fe870de4-2c19-462c-b88c-70da967d9099 service nova] [instance: 8a8816e5-696d-4384-b0e0-29aa7cdd957c] No waiting events found dispatching network-vif-plugged-2e650fb9-427c-477e-ba45-ddc070399617 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:29:23 user nova-compute[73572]: WARNING nova.compute.manager [req-fe209de6-4154-4f05-a715-920f3be53e5e req-fe870de4-2c19-462c-b88c-70da967d9099 service nova] [instance: 8a8816e5-696d-4384-b0e0-29aa7cdd957c] Received unexpected event network-vif-plugged-2e650fb9-427c-477e-ba45-ddc070399617 for instance with vm_state active and task_state deleting.
Aug 26 10:29:23 user nova-compute[73572]: DEBUG nova.compute.manager [req-fe209de6-4154-4f05-a715-920f3be53e5e req-fe870de4-2c19-462c-b88c-70da967d9099 service nova] [instance: 8a8816e5-696d-4384-b0e0-29aa7cdd957c] Received event network-vif-deleted-2e650fb9-427c-477e-ba45-ddc070399617 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:29:23 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:29:23 user nova-compute[73572]: INFO nova.compute.manager [None req-94fada24-ec60-4d5a-ac80-0f826d83dffd tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: 8a8816e5-696d-4384-b0e0-29aa7cdd957c] Took 0.95 seconds to detach 1 volumes for instance.
Aug 26 10:29:23 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-94fada24-ec60-4d5a-ac80-0f826d83dffd tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:29:23 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-94fada24-ec60-4d5a-ac80-0f826d83dffd tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:29:24 user nova-compute[73572]: DEBUG nova.compute.provider_tree [None req-94fada24-ec60-4d5a-ac80-0f826d83dffd tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Inventory has not changed in ProviderTree for provider: e2cec974-59b2-4c77-a53d-a7f4e5a30d75 {{(pid=73572) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 10:29:24 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-94fada24-ec60-4d5a-ac80-0f826d83dffd tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Inventory has not changed for provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73572) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 10:29:24 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-94fada24-ec60-4d5a-ac80-0f826d83dffd tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.408s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:29:24 user nova-compute[73572]: INFO nova.scheduler.client.report [None req-94fada24-ec60-4d5a-ac80-0f826d83dffd tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Deleted allocations for instance 8a8816e5-696d-4384-b0e0-29aa7cdd957c
Aug 26 10:29:24 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-94fada24-ec60-4d5a-ac80-0f826d83dffd tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Lock "8a8816e5-696d-4384-b0e0-29aa7cdd957c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.541s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:29:25 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:29:26 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:29:27 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:29:28 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:29:28 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:29:28 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:29:28 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:29:28 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Auditing locally available compute resources for user (node: user) {{(pid=73572) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 10:29:29 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b2d5f4e-37af-438c-859b-d4ca803b7d08/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:29:29 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b2d5f4e-37af-438c-859b-d4ca803b7d08/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:29:29 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b2d5f4e-37af-438c-859b-d4ca803b7d08/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:29:29 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-7f5e25d8-ab0e-4c93-8e60-1a0ac0120df7 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Acquiring lock "6004b15a-be01-42eb-92ba-ae9d93dab708" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:29:29 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-7f5e25d8-ab0e-4c93-8e60-1a0ac0120df7 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Lock "6004b15a-be01-42eb-92ba-ae9d93dab708" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.002s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:29:29 user nova-compute[73572]: INFO nova.compute.manager [None req-7f5e25d8-ab0e-4c93-8e60-1a0ac0120df7 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] [instance: 6004b15a-be01-42eb-92ba-ae9d93dab708] Unshelving
Aug 26 10:29:29 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b2d5f4e-37af-438c-859b-d4ca803b7d08/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:29:29 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73572) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 10:29:29 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86923c1a-89a5-4e7a-b488-8bf3a013bf83/disk.rescue --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:29:29 user nova-compute[73572]: INFO nova.virt.block_device [None req-7f5e25d8-ab0e-4c93-8e60-1a0ac0120df7 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] [instance: 6004b15a-be01-42eb-92ba-ae9d93dab708] Booting with volume 0b5f9f26-8454-44d8-aa18-724b5d18938e at /dev/vdc
Aug 26 10:29:29 user nova-compute[73572]: DEBUG os_brick.utils [None req-7f5e25d8-ab0e-4c93-8e60-1a0ac0120df7 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 10:29:29 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:29:29 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:29:29 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[aadcf363-38ae-48ed-8b63-ee0e2b064e7c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:de8a79ed912\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:29:29 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:29:29 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:29:29 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[2805d694-4118-4d58-a323-f730a7b4df3a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:29:29 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:29:29 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86923c1a-89a5-4e7a-b488-8bf3a013bf83/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:29:29 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86923c1a-89a5-4e7a-b488-8bf3a013bf83/disk.rescue --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:29:29 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:29:29 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[42332a50-5246-42e4-a861-6265d7bb2d2f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:29:29 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebf58874-d5e7-4bf8-aa53-83c698a8cac2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:29:29 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-7f5e25d8-ab0e-4c93-8e60-1a0ac0120df7 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Running cmd (subprocess): nvme version {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:29:29 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-7f5e25d8-ab0e-4c93-8e60-1a0ac0120df7 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] 'nvme version' failed. Not Retrying. {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 10:29:29 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7f5e25d8-ab0e-4c93-8e60-1a0ac0120df7 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] nvme not present on system {{(pid=73572) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 10:29:29 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:29:29 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 10:29:29 user nova-compute[73572]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 10:29:29 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[895982cf-ccbb-4c2b-837b-40f5b9da8661]: (4, '') {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:29:29 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.lightos [None req-7f5e25d8-ab0e-4c93-8e60-1a0ac0120df7 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73572) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 10:29:29 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.lightos [None req-7f5e25d8-ab0e-4c93-8e60-1a0ac0120df7 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73572) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 10:29:29 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.lightos [None req-7f5e25d8-ab0e-4c93-8e60-1a0ac0120df7 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] LIGHTOS: no hostnqn found. {{(pid=73572) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 10:29:29 user nova-compute[73572]: DEBUG os_brick.utils [None req-7f5e25d8-ab0e-4c93-8e60-1a0ac0120df7 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] <== get_connector_properties: return (172ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:de8a79ed912', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 10:29:29 user nova-compute[73572]: DEBUG nova.virt.block_device [None req-7f5e25d8-ab0e-4c93-8e60-1a0ac0120df7 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] [instance: 6004b15a-be01-42eb-92ba-ae9d93dab708] Updating existing volume attachment record: 16f6a437-c682-423a-9ae8-dc0b5636de47 {{(pid=73572) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 10:29:29 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86923c1a-89a5-4e7a-b488-8bf3a013bf83/disk.rescue --force-share --output=json" returned: 0 in 0.193s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:29:29 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86923c1a-89a5-4e7a-b488-8bf3a013bf83/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:29:29 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86923c1a-89a5-4e7a-b488-8bf3a013bf83/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:29:29 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86923c1a-89a5-4e7a-b488-8bf3a013bf83/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:29:30 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86923c1a-89a5-4e7a-b488-8bf3a013bf83/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:29:30 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c785b609-0068-442f-91f5-d26e888a993f/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:29:30 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c785b609-0068-442f-91f5-d26e888a993f/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:29:30 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c785b609-0068-442f-91f5-d26e888a993f/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:29:30 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c785b609-0068-442f-91f5-d26e888a993f/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:29:30 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e468b473-515f-41ad-a75c-65d4c6d575c8/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:29:30 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e468b473-515f-41ad-a75c-65d4c6d575c8/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:29:30 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e468b473-515f-41ad-a75c-65d4c6d575c8/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:29:30 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e468b473-515f-41ad-a75c-65d4c6d575c8/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:29:30 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d03d1626-e18b-4b15-a679-4543f7641ed7/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:29:31 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d03d1626-e18b-4b15-a679-4543f7641ed7/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:29:31 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d03d1626-e18b-4b15-a679-4543f7641ed7/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:29:31 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d03d1626-e18b-4b15-a679-4543f7641ed7/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:29:31 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73572) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 10:29:31 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=73572) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 10:29:31 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68613b1e-c45c-4fd9-834c-3630ed0f456a/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:29:31 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68613b1e-c45c-4fd9-834c-3630ed0f456a/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:29:31 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68613b1e-c45c-4fd9-834c-3630ed0f456a/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:29:31 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:29:31 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68613b1e-c45c-4fd9-834c-3630ed0f456a/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:29:31 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2eaea7c2-a5c0-4950-b033-0012b5cec0ee/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:29:32 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2eaea7c2-a5c0-4950-b033-0012b5cec0ee/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:29:32 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2eaea7c2-a5c0-4950-b033-0012b5cec0ee/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:29:32 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2eaea7c2-a5c0-4950-b033-0012b5cec0ee/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:29:32 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73572) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 10:29:32 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c8e780d-0a13-4484-bf18-ac0879db263a/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:29:32 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c8e780d-0a13-4484-bf18-ac0879db263a/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:29:32 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c8e780d-0a13-4484-bf18-ac0879db263a/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:29:32 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c8e780d-0a13-4484-bf18-ac0879db263a/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:29:33 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:29:33 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:29:33 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Hypervisor/Node resource view: name=user free_ram=7398MB free_disk=24.947139739990234GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=73572) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 10:29:33 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:29:33 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:29:33 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance c785b609-0068-442f-91f5-d26e888a993f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:29:33 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance 14fab12e-52be-4fe6-8777-bc7ebf3c25f1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:29:33 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance 2eaea7c2-a5c0-4950-b033-0012b5cec0ee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:29:33 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance 86923c1a-89a5-4e7a-b488-8bf3a013bf83 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:29:33 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance e468b473-515f-41ad-a75c-65d4c6d575c8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:29:33 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance 68613b1e-c45c-4fd9-834c-3630ed0f456a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:29:33 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance 6b2d5f4e-37af-438c-859b-d4ca803b7d08 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:29:33 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance f3fe3865-3d85-46cf-b24f-10b07e23aeff actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:29:33 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance d03d1626-e18b-4b15-a679-4543f7641ed7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:29:33 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance 1c8e780d-0a13-4484-bf18-ac0879db263a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:29:33 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance 6076ed21-24d2-4921-b47e-f70702b0adf1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:29:33 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance 6004b15a-be01-42eb-92ba-ae9d93dab708 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Aug 26 10:29:33 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=73572) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 10:29:33 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=73572) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 10:29:33 user nova-compute[73572]: DEBUG nova.compute.provider_tree [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Inventory has not changed in ProviderTree for provider: e2cec974-59b2-4c77-a53d-a7f4e5a30d75 {{(pid=73572) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 10:29:33 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Inventory has not changed for provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73572) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 10:29:33 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Compute_service record updated for user:user {{(pid=73572) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 10:29:33 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.559s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:29:34 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:29:34 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:29:35 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:29:36 user nova-compute[73572]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693045761.715068, 8a8816e5-696d-4384-b0e0-29aa7cdd957c => Stopped> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:29:36 user nova-compute[73572]: INFO nova.compute.manager [-] [instance: 8a8816e5-696d-4384-b0e0-29aa7cdd957c] VM Stopped (Lifecycle Event)
Aug 26 10:29:36 user nova-compute[73572]: DEBUG nova.compute.manager [None req-356502ee-8e47-49fe-b086-c71ef1215a46 None None] [instance: 8a8816e5-696d-4384-b0e0-29aa7cdd957c] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:29:36 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:29:37 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:29:38 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:29:39 user nova-compute[73572]: DEBUG nova.compute.manager [req-6cc93ba4-da90-4690-890c-e7b67608c0aa req-94aa2c6f-ff01-41a4-bb11-7f6a6f6b918a service nova] [instance: 1c8e780d-0a13-4484-bf18-ac0879db263a] Received event network-changed-d03460b0-e0b9-4c39-a8a6-12cb80aca6bc {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:29:39 user nova-compute[73572]: DEBUG nova.compute.manager [req-6cc93ba4-da90-4690-890c-e7b67608c0aa req-94aa2c6f-ff01-41a4-bb11-7f6a6f6b918a service nova] [instance: 1c8e780d-0a13-4484-bf18-ac0879db263a] Refreshing instance network info cache due to event network-changed-d03460b0-e0b9-4c39-a8a6-12cb80aca6bc. {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 10:29:39 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-6cc93ba4-da90-4690-890c-e7b67608c0aa req-94aa2c6f-ff01-41a4-bb11-7f6a6f6b918a service nova] Acquiring lock "refresh_cache-1c8e780d-0a13-4484-bf18-ac0879db263a" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:29:39 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-6cc93ba4-da90-4690-890c-e7b67608c0aa req-94aa2c6f-ff01-41a4-bb11-7f6a6f6b918a service nova] Acquired lock "refresh_cache-1c8e780d-0a13-4484-bf18-ac0879db263a" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:29:39 user nova-compute[73572]: DEBUG nova.network.neutron [req-6cc93ba4-da90-4690-890c-e7b67608c0aa req-94aa2c6f-ff01-41a4-bb11-7f6a6f6b918a service nova] [instance: 1c8e780d-0a13-4484-bf18-ac0879db263a] Refreshing network info cache for port d03460b0-e0b9-4c39-a8a6-12cb80aca6bc {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 10:29:39 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-84caf4b7-0a31-42b8-9a38-84c4109cc063 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Acquiring lock "1c8e780d-0a13-4484-bf18-ac0879db263a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:29:39 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-84caf4b7-0a31-42b8-9a38-84c4109cc063 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Lock "1c8e780d-0a13-4484-bf18-ac0879db263a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:29:39 user nova-compute[73572]: DEBUG nova.objects.instance [None req-84caf4b7-0a31-42b8-9a38-84c4109cc063 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Lazy-loading 'flavor' on Instance uuid 1c8e780d-0a13-4484-bf18-ac0879db263a {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:29:39 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-84caf4b7-0a31-42b8-9a38-84c4109cc063 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Lock "1c8e780d-0a13-4484-bf18-ac0879db263a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:29:39 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-84caf4b7-0a31-42b8-9a38-84c4109cc063 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Acquiring lock "1c8e780d-0a13-4484-bf18-ac0879db263a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:29:39 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-84caf4b7-0a31-42b8-9a38-84c4109cc063 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Lock "1c8e780d-0a13-4484-bf18-ac0879db263a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:29:39 user nova-compute[73572]: INFO nova.compute.manager [None req-84caf4b7-0a31-42b8-9a38-84c4109cc063 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] [instance: 1c8e780d-0a13-4484-bf18-ac0879db263a] Attaching volume d8aa6fc0-ce50-4db6-8d7d-9f37eae07207 to /dev/vdb
Aug 26 10:29:39 user nova-compute[73572]: DEBUG nova.network.neutron [req-6cc93ba4-da90-4690-890c-e7b67608c0aa req-94aa2c6f-ff01-41a4-bb11-7f6a6f6b918a service nova] [instance: 1c8e780d-0a13-4484-bf18-ac0879db263a] Updated VIF entry in instance network info cache for port d03460b0-e0b9-4c39-a8a6-12cb80aca6bc. {{(pid=73572) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 10:29:39 user nova-compute[73572]: DEBUG nova.network.neutron [req-6cc93ba4-da90-4690-890c-e7b67608c0aa req-94aa2c6f-ff01-41a4-bb11-7f6a6f6b918a service nova] [instance: 1c8e780d-0a13-4484-bf18-ac0879db263a] Updating instance_info_cache with network_info: [{"id": "d03460b0-e0b9-4c39-a8a6-12cb80aca6bc", "address": "fa:16:3e:c2:0f:20", "network": {"id": "757e71b4-5177-45a5-8ef5-9b27f42092f1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1765327616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1bff48d66894950ac6690e1fd0e79b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd03460b0-e0", "ovs_interfaceid": "d03460b0-e0b9-4c39-a8a6-12cb80aca6bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:29:39 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-6cc93ba4-da90-4690-890c-e7b67608c0aa req-94aa2c6f-ff01-41a4-bb11-7f6a6f6b918a service nova] Releasing lock "refresh_cache-1c8e780d-0a13-4484-bf18-ac0879db263a" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:29:39 user nova-compute[73572]: DEBUG os_brick.utils [None req-84caf4b7-0a31-42b8-9a38-84c4109cc063 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 10:29:39 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:29:39 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:29:39 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[37ab775e-8930-477d-a2ba-adb009e5f3d8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:de8a79ed912\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:29:39 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:29:39 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:29:39 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[585b5c9d-7821-4321-afc3-193e80972fa6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:29:39 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:29:39 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:29:39 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1fc600f-a25d-4ce1-a3a5-407891f9d8a1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:29:39 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[235bea0b-55fb-4dc6-96de-ee481191d7ff]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:29:39 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-84caf4b7-0a31-42b8-9a38-84c4109cc063 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Running cmd (subprocess): nvme version {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:29:39 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-84caf4b7-0a31-42b8-9a38-84c4109cc063 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] 'nvme version' failed. Not Retrying. {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 10:29:39 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.nvmeof [None req-84caf4b7-0a31-42b8-9a38-84c4109cc063 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] nvme not present on system {{(pid=73572) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 10:29:39 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:29:39 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 10:29:39 user nova-compute[73572]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 10:29:39 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[948c6ab0-0b6d-45ac-8227-8d1163ed2634]: (4, '') {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:29:39 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.lightos [None req-84caf4b7-0a31-42b8-9a38-84c4109cc063 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73572) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 10:29:39 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.lightos [None req-84caf4b7-0a31-42b8-9a38-84c4109cc063 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73572) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 10:29:39 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.lightos [None req-84caf4b7-0a31-42b8-9a38-84c4109cc063 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] LIGHTOS: no hostnqn found. {{(pid=73572) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 10:29:39 user nova-compute[73572]: DEBUG os_brick.utils [None req-84caf4b7-0a31-42b8-9a38-84c4109cc063 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:de8a79ed912', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 10:29:39 user nova-compute[73572]: DEBUG nova.virt.block_device [None req-84caf4b7-0a31-42b8-9a38-84c4109cc063 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] [instance: 1c8e780d-0a13-4484-bf18-ac0879db263a] Updating existing volume attachment record: edeb58f4-bafb-4be1-8e73-7bae09248ed5 {{(pid=73572) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 10:29:40 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:29:40 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:29:41 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-7f5e25d8-ab0e-4c93-8e60-1a0ac0120df7 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:29:41 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-7f5e25d8-ab0e-4c93-8e60-1a0ac0120df7 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:29:41 user nova-compute[73572]: DEBUG nova.objects.instance [None req-7f5e25d8-ab0e-4c93-8e60-1a0ac0120df7 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Lazy-loading 'pci_requests' on Instance uuid 6004b15a-be01-42eb-92ba-ae9d93dab708 {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:29:41 user nova-compute[73572]: DEBUG nova.objects.instance [None req-7f5e25d8-ab0e-4c93-8e60-1a0ac0120df7 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Lazy-loading 'numa_topology' on Instance uuid 6004b15a-be01-42eb-92ba-ae9d93dab708 {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:29:41 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-7f5e25d8-ab0e-4c93-8e60-1a0ac0120df7 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73572) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 10:29:41 user nova-compute[73572]: INFO nova.compute.claims [None req-7f5e25d8-ab0e-4c93-8e60-1a0ac0120df7 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] [instance: 6004b15a-be01-42eb-92ba-ae9d93dab708] Claim successful on node user
Aug 26 10:29:41 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:29:42 user nova-compute[73572]: DEBUG nova.compute.provider_tree [None req-7f5e25d8-ab0e-4c93-8e60-1a0ac0120df7 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Inventory has not changed in ProviderTree for provider: e2cec974-59b2-4c77-a53d-a7f4e5a30d75 {{(pid=73572) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 10:29:42 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-7f5e25d8-ab0e-4c93-8e60-1a0ac0120df7 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Inventory has not changed for provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73572) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 10:29:42 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-7f5e25d8-ab0e-4c93-8e60-1a0ac0120df7 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.660s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:29:42 user nova-compute[73572]: INFO nova.network.neutron [None req-7f5e25d8-ab0e-4c93-8e60-1a0ac0120df7 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] [instance: 6004b15a-be01-42eb-92ba-ae9d93dab708] Updating port 8c801229-2284-4cd5-bdce-45c96edfe633 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 26 10:29:43 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-7f5e25d8-ab0e-4c93-8e60-1a0ac0120df7 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Acquiring lock "refresh_cache-6004b15a-be01-42eb-92ba-ae9d93dab708" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:29:43 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-7f5e25d8-ab0e-4c93-8e60-1a0ac0120df7 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Acquired lock "refresh_cache-6004b15a-be01-42eb-92ba-ae9d93dab708" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:29:43 user nova-compute[73572]: DEBUG nova.network.neutron [None req-7f5e25d8-ab0e-4c93-8e60-1a0ac0120df7 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] [instance: 6004b15a-be01-42eb-92ba-ae9d93dab708] Building network info cache for instance {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 10:29:43 user nova-compute[73572]: DEBUG nova.compute.manager [req-8979523c-0dda-4e3b-8c08-3cc9d1a51926 req-8b5dc488-7706-400c-81c6-f1d27d048399 service nova] [instance: 6004b15a-be01-42eb-92ba-ae9d93dab708] Received event network-changed-8c801229-2284-4cd5-bdce-45c96edfe633 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:29:43 user nova-compute[73572]: DEBUG nova.compute.manager [req-8979523c-0dda-4e3b-8c08-3cc9d1a51926 req-8b5dc488-7706-400c-81c6-f1d27d048399 service nova] [instance: 6004b15a-be01-42eb-92ba-ae9d93dab708] Refreshing instance network info cache due to event network-changed-8c801229-2284-4cd5-bdce-45c96edfe633. {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 10:29:43 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-8979523c-0dda-4e3b-8c08-3cc9d1a51926 req-8b5dc488-7706-400c-81c6-f1d27d048399 service nova] Acquiring lock "refresh_cache-6004b15a-be01-42eb-92ba-ae9d93dab708" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:29:43 user nova-compute[73572]: DEBUG nova.network.neutron [None req-7f5e25d8-ab0e-4c93-8e60-1a0ac0120df7 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] [instance: 6004b15a-be01-42eb-92ba-ae9d93dab708] Updating instance_info_cache with network_info: [{"id": "8c801229-2284-4cd5-bdce-45c96edfe633", "address": "fa:16:3e:5a:0e:fa", "network": {"id": "317d2681-96ce-4898-b6fb-8892ee6f706d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2049963835-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7e16843614c451d958e817c832d4cbc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c801229-22", "ovs_interfaceid": "8c801229-2284-4cd5-bdce-45c96edfe633", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:29:43 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-7f5e25d8-ab0e-4c93-8e60-1a0ac0120df7 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Releasing lock "refresh_cache-6004b15a-be01-42eb-92ba-ae9d93dab708" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:29:43 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-7f5e25d8-ab0e-4c93-8e60-1a0ac0120df7 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] [instance: 6004b15a-be01-42eb-92ba-ae9d93dab708] Creating instance directory {{(pid=73572) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 10:29:43 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-7f5e25d8-ab0e-4c93-8e60-1a0ac0120df7 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] [instance: 6004b15a-be01-42eb-92ba-ae9d93dab708] Creating image(s)
Aug 26 10:29:43 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-7f5e25d8-ab0e-4c93-8e60-1a0ac0120df7 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Acquiring lock "/opt/stack/data/nova/instances/6004b15a-be01-42eb-92ba-ae9d93dab708/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:29:43 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-7f5e25d8-ab0e-4c93-8e60-1a0ac0120df7 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Lock "/opt/stack/data/nova/instances/6004b15a-be01-42eb-92ba-ae9d93dab708/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:29:43 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-7f5e25d8-ab0e-4c93-8e60-1a0ac0120df7 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Lock "/opt/stack/data/nova/instances/6004b15a-be01-42eb-92ba-ae9d93dab708/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:29:43 user nova-compute[73572]: DEBUG nova.objects.instance [None req-7f5e25d8-ab0e-4c93-8e60-1a0ac0120df7 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Lazy-loading 'trusted_certs' on Instance uuid 6004b15a-be01-42eb-92ba-ae9d93dab708 {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:29:43 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-8979523c-0dda-4e3b-8c08-3cc9d1a51926 req-8b5dc488-7706-400c-81c6-f1d27d048399 service nova] Acquired lock "refresh_cache-6004b15a-be01-42eb-92ba-ae9d93dab708" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:29:43 user nova-compute[73572]: DEBUG nova.network.neutron [req-8979523c-0dda-4e3b-8c08-3cc9d1a51926 req-8b5dc488-7706-400c-81c6-f1d27d048399 service nova] [instance: 6004b15a-be01-42eb-92ba-ae9d93dab708] Refreshing network info cache for port 8c801229-2284-4cd5-bdce-45c96edfe633 {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 10:29:43 user nova-compute[73572]: DEBUG nova.objects.base [None req-7f5e25d8-ab0e-4c93-8e60-1a0ac0120df7 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Object Instance<6004b15a-be01-42eb-92ba-ae9d93dab708> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=73572) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 10:29:43 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-7f5e25d8-ab0e-4c93-8e60-1a0ac0120df7 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Acquiring lock "856ce9f1ce221991f19ccb14996e0e14779d8b86" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:29:43 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-7f5e25d8-ab0e-4c93-8e60-1a0ac0120df7 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Lock "856ce9f1ce221991f19ccb14996e0e14779d8b86" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:29:44 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-7f5e25d8-ab0e-4c93-8e60-1a0ac0120df7 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/856ce9f1ce221991f19ccb14996e0e14779d8b86.part --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:29:45 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-7f5e25d8-ab0e-4c93-8e60-1a0ac0120df7 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/856ce9f1ce221991f19ccb14996e0e14779d8b86.part --force-share --output=json" returned: 0 in 0.182s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:29:45 user nova-compute[73572]: DEBUG nova.virt.images [None req-7f5e25d8-ab0e-4c93-8e60-1a0ac0120df7 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] 26cc70a1-8b04-41ca-a800-4e3d44b1d424 was qcow2, converting to raw {{(pid=73572) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 26 10:29:45 user nova-compute[73572]: DEBUG nova.privsep.utils [None req-7f5e25d8-ab0e-4c93-8e60-1a0ac0120df7 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73572) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 26 10:29:45 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-7f5e25d8-ab0e-4c93-8e60-1a0ac0120df7 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/856ce9f1ce221991f19ccb14996e0e14779d8b86.part /opt/stack/data/nova/instances/_base/856ce9f1ce221991f19ccb14996e0e14779d8b86.converted {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:29:45 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:29:45 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-7f5e25d8-ab0e-4c93-8e60-1a0ac0120df7 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/856ce9f1ce221991f19ccb14996e0e14779d8b86.part /opt/stack/data/nova/instances/_base/856ce9f1ce221991f19ccb14996e0e14779d8b86.converted" returned: 0 in 0.305s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:29:45 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-7f5e25d8-ab0e-4c93-8e60-1a0ac0120df7 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/856ce9f1ce221991f19ccb14996e0e14779d8b86.converted --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:29:45 user nova-compute[73572]: DEBUG nova.network.neutron [req-8979523c-0dda-4e3b-8c08-3cc9d1a51926 req-8b5dc488-7706-400c-81c6-f1d27d048399 service nova] [instance: 6004b15a-be01-42eb-92ba-ae9d93dab708] Updated VIF entry in instance network info cache for port 8c801229-2284-4cd5-bdce-45c96edfe633. {{(pid=73572) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 10:29:45 user nova-compute[73572]: DEBUG nova.network.neutron [req-8979523c-0dda-4e3b-8c08-3cc9d1a51926 req-8b5dc488-7706-400c-81c6-f1d27d048399 service nova] [instance: 6004b15a-be01-42eb-92ba-ae9d93dab708] Updating instance_info_cache with network_info: [{"id": "8c801229-2284-4cd5-bdce-45c96edfe633", "address": "fa:16:3e:5a:0e:fa", "network": {"id": "317d2681-96ce-4898-b6fb-8892ee6f706d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2049963835-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7e16843614c451d958e817c832d4cbc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c801229-22", "ovs_interfaceid": "8c801229-2284-4cd5-bdce-45c96edfe633", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:29:45 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-8979523c-0dda-4e3b-8c08-3cc9d1a51926 req-8b5dc488-7706-400c-81c6-f1d27d048399 service nova] Releasing lock "refresh_cache-6004b15a-be01-42eb-92ba-ae9d93dab708" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:29:45 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-7f5e25d8-ab0e-4c93-8e60-1a0ac0120df7 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/856ce9f1ce221991f19ccb14996e0e14779d8b86.converted --force-share --output=json" returned: 0 in 0.205s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:29:45 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-7f5e25d8-ab0e-4c93-8e60-1a0ac0120df7 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Lock "856ce9f1ce221991f19ccb14996e0e14779d8b86" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.676s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:29:45 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-7f5e25d8-ab0e-4c93-8e60-1a0ac0120df7 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/856ce9f1ce221991f19ccb14996e0e14779d8b86 --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:29:45 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-7f5e25d8-ab0e-4c93-8e60-1a0ac0120df7 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/856ce9f1ce221991f19ccb14996e0e14779d8b86 --force-share --output=json" returned: 0 in 0.179s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:29:45 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-7f5e25d8-ab0e-4c93-8e60-1a0ac0120df7 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Acquiring lock "856ce9f1ce221991f19ccb14996e0e14779d8b86" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:29:45 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-7f5e25d8-ab0e-4c93-8e60-1a0ac0120df7 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Lock "856ce9f1ce221991f19ccb14996e0e14779d8b86" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:29:45 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-7f5e25d8-ab0e-4c93-8e60-1a0ac0120df7 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/856ce9f1ce221991f19ccb14996e0e14779d8b86 --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:29:45 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-7f5e25d8-ab0e-4c93-8e60-1a0ac0120df7 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/856ce9f1ce221991f19ccb14996e0e14779d8b86 --force-share --output=json" returned: 0 in 0.177s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:29:45 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-7f5e25d8-ab0e-4c93-8e60-1a0ac0120df7 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/856ce9f1ce221991f19ccb14996e0e14779d8b86,backing_fmt=raw /opt/stack/data/nova/instances/6004b15a-be01-42eb-92ba-ae9d93dab708/disk 1073741824 {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:29:46 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-7f5e25d8-ab0e-4c93-8e60-1a0ac0120df7 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/856ce9f1ce221991f19ccb14996e0e14779d8b86,backing_fmt=raw /opt/stack/data/nova/instances/6004b15a-be01-42eb-92ba-ae9d93dab708/disk 1073741824" returned: 0 in 0.056s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:29:46 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-7f5e25d8-ab0e-4c93-8e60-1a0ac0120df7 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Lock "856ce9f1ce221991f19ccb14996e0e14779d8b86" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.241s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:29:46 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-7f5e25d8-ab0e-4c93-8e60-1a0ac0120df7 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/856ce9f1ce221991f19ccb14996e0e14779d8b86 --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:29:46 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-7f5e25d8-ab0e-4c93-8e60-1a0ac0120df7 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/856ce9f1ce221991f19ccb14996e0e14779d8b86 --force-share --output=json" returned: 0 in 0.189s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:29:46 user nova-compute[73572]: DEBUG nova.objects.instance [None req-7f5e25d8-ab0e-4c93-8e60-1a0ac0120df7 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Lazy-loading 'migration_context' on Instance uuid 6004b15a-be01-42eb-92ba-ae9d93dab708 {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:29:46 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:29:46 user nova-compute[73572]: DEBUG nova.objects.base [None req-7f5e25d8-ab0e-4c93-8e60-1a0ac0120df7 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Object Instance<6004b15a-be01-42eb-92ba-ae9d93dab708> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=73572) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 10:29:46 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-7f5e25d8-ab0e-4c93-8e60-1a0ac0120df7 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] [instance: 6004b15a-be01-42eb-92ba-ae9d93dab708] Rebasing disk image.
Aug 26 10:29:46 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-7f5e25d8-ab0e-4c93-8e60-1a0ac0120df7 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:29:46 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-7f5e25d8-ab0e-4c93-8e60-1a0ac0120df7 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json" returned: 0 in 0.194s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:29:46 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-7f5e25d8-ab0e-4c93-8e60-1a0ac0120df7 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 -F raw /opt/stack/data/nova/instances/6004b15a-be01-42eb-92ba-ae9d93dab708/disk {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:29:46 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:29:49 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:29:49 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-7f5e25d8-ab0e-4c93-8e60-1a0ac0120df7 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 -F raw /opt/stack/data/nova/instances/6004b15a-be01-42eb-92ba-ae9d93dab708/disk" returned: 0 in 2.865s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:29:49 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-7f5e25d8-ab0e-4c93-8e60-1a0ac0120df7 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] [instance: 6004b15a-be01-42eb-92ba-ae9d93dab708] Created local disks {{(pid=73572) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 10:29:49 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-7f5e25d8-ab0e-4c93-8e60-1a0ac0120df7 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] [instance: 6004b15a-be01-42eb-92ba-ae9d93dab708] Ensure instance console log exists: /opt/stack/data/nova/instances/6004b15a-be01-42eb-92ba-ae9d93dab708/console.log {{(pid=73572) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 10:29:49 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-7f5e25d8-ab0e-4c93-8e60-1a0ac0120df7 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:29:49 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-7f5e25d8-ab0e-4c93-8e60-1a0ac0120df7 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:29:49 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-7f5e25d8-ab0e-4c93-8e60-1a0ac0120df7 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:29:49 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-7f5e25d8-ab0e-4c93-8e60-1a0ac0120df7 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] [instance: 6004b15a-be01-42eb-92ba-ae9d93dab708] Start _get_guest_xml network_info=[{"id": "8c801229-2284-4cd5-bdce-45c96edfe633", "address": "fa:16:3e:5a:0e:fa", "network": {"id": "317d2681-96ce-4898-b6fb-8892ee6f706d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2049963835-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7e16843614c451d958e817c832d4cbc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c801229-22", "ovs_interfaceid": "8c801229-2284-4cd5-bdce-45c96edfe633", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='7710a976b006e9bbff143aadbafd308c',container_format='bare',created_at=2023-08-26T10:27:37Z,direct_url=<?>,disk_format='qcow2',id=26cc70a1-8b04-41ca-a800-4e3d44b1d424,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-166680841-shelved',owner='c7e16843614c451d958e817c832d4cbc',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-26T10:27:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'guest_format': None, 'size': 0, 'encryption_format': None, 'device_type': 'disk', 'image_id': '299da0c9-e1c4-48f0-be55-fbe20dd06bc9'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'disk_bus': 'virtio', 'boot_index': None, 'mount_device': '/dev/vdc', 'attachment_id': '16f6a437-c682-423a-9ae8-dc0b5636de47', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:0b5f9f26-8454-44d8-aa18-724b5d18938e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EgYoJksa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': '6004b15a-be01-42eb-92ba-ae9d93dab708', 'attached_at': '', 'detached_at': '', 'volume_id': '0b5f9f26-8454-44d8-aa18-724b5d18938e', 'serial': '0b5f9f26-8454-44d8-aa18-724b5d18938e'}, 'guest_format': None, 'device_type': 'disk', 'volume_type': None} {{(pid=73572) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 10:29:49 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-7f5e25d8-ab0e-4c93-8e60-1a0ac0120df7 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:29:49 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-7f5e25d8-ab0e-4c93-8e60-1a0ac0120df7 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:29:49 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-7f5e25d8-ab0e-4c93-8e60-1a0ac0120df7 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73572) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 10:29:49 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-7f5e25d8-ab0e-4c93-8e60-1a0ac0120df7 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] CPU controller missing on host. {{(pid=73572) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 10:29:49 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-7f5e25d8-ab0e-4c93-8e60-1a0ac0120df7 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73572) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 10:29:49 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-7f5e25d8-ab0e-4c93-8e60-1a0ac0120df7 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] CPU controller found on host. {{(pid=73572) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 10:29:49 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-7f5e25d8-ab0e-4c93-8e60-1a0ac0120df7 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73572) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 10:29:49 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-7f5e25d8-ab0e-4c93-8e60-1a0ac0120df7 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T10:07:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='7710a976b006e9bbff143aadbafd308c',container_format='bare',created_at=2023-08-26T10:27:37Z,direct_url=<?>,disk_format='qcow2',id=26cc70a1-8b04-41ca-a800-4e3d44b1d424,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-166680841-shelved',owner='c7e16843614c451d958e817c832d4cbc',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-26T10:27:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 10:29:49 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-7f5e25d8-ab0e-4c93-8e60-1a0ac0120df7 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Flavor limits 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 10:29:49 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-7f5e25d8-ab0e-4c93-8e60-1a0ac0120df7 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Image limits 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 10:29:49 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-7f5e25d8-ab0e-4c93-8e60-1a0ac0120df7 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Flavor pref 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 10:29:49 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-7f5e25d8-ab0e-4c93-8e60-1a0ac0120df7 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Image pref 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 10:29:49 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-7f5e25d8-ab0e-4c93-8e60-1a0ac0120df7 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 10:29:49 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-7f5e25d8-ab0e-4c93-8e60-1a0ac0120df7 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 10:29:49 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-7f5e25d8-ab0e-4c93-8e60-1a0ac0120df7 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73572) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 10:29:49 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-7f5e25d8-ab0e-4c93-8e60-1a0ac0120df7 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Got 1 possible topologies {{(pid=73572) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 10:29:49 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-7f5e25d8-ab0e-4c93-8e60-1a0ac0120df7 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 10:29:49 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-7f5e25d8-ab0e-4c93-8e60-1a0ac0120df7 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 10:29:49 user nova-compute[73572]: DEBUG nova.objects.instance [None req-7f5e25d8-ab0e-4c93-8e60-1a0ac0120df7 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Lazy-loading 'vcpu_model' on Instance uuid 6004b15a-be01-42eb-92ba-ae9d93dab708 {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:29:49 user nova-compute[73572]: DEBUG nova.objects.base [None req-7f5e25d8-ab0e-4c93-8e60-1a0ac0120df7 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Object Instance<6004b15a-be01-42eb-92ba-ae9d93dab708> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=73572) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 10:29:49 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7f5e25d8-ab0e-4c93-8e60-1a0ac0120df7 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] [instance: 6004b15a-be01-42eb-92ba-ae9d93dab708] Calling os-brick to attach iSCSI Volume {{(pid=73572) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 10:29:49 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f5e25d8-ab0e-4c93-8e60-1a0ac0120df7 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc89c3d6a10>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:0b5f9f26-8454-44d8-aa18-724b5d18938e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EgYoJksa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 10:29:49 user nova-compute[73572]: WARNING os_brick.initiator.connectors.base [None req-7f5e25d8-ab0e-4c93-8e60-1a0ac0120df7 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 10:29:49 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-7f5e25d8-ab0e-4c93-8e60-1a0ac0120df7 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 10:29:49 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-7f5e25d8-ab0e-4c93-8e60-1a0ac0120df7 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 10:29:49 user nova-compute[73572]: WARNING os_brick.initiator.connectors.base [None req-7f5e25d8-ab0e-4c93-8e60-1a0ac0120df7 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 10:29:49 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-7f5e25d8-ab0e-4c93-8e60-1a0ac0120df7 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0b5f9f26-8454-44d8-aa18-724b5d18938e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 10:29:49 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-7f5e25d8-ab0e-4c93-8e60-1a0ac0120df7 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0b5f9f26-8454-44d8-aa18-724b5d18938e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 10:29:49 user nova-compute[73572]: INFO os_brick.initiator.connectors.iscsi [None req-7f5e25d8-ab0e-4c93-8e60-1a0ac0120df7 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 10:29:49 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b5f9f26-8454-44d8-aa18-724b5d18938e -p 172.16.0.220:3260 {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:29:49 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b5f9f26-8454-44d8-aa18-724b5d18938e -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:29:49 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f4e4310-5b5f-4f67-976e-09ee4fc313b4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:29:49 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f5e25d8-ab0e-4c93-8e60-1a0ac0120df7 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 10:29:49 user nova-compute[73572]:  {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:29:49 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b5f9f26-8454-44d8-aa18-724b5d18938e -p 172.16.0.220:3260 --interface default --op new {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:29:49 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b5f9f26-8454-44d8-aa18-724b5d18938e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:29:49 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7e7fb9d-c4c1-448d-9c5c-6eefff8a02cb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0b5f9f26-8454-44d8-aa18-724b5d18938e] added\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:29:49 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f5e25d8-ab0e-4c93-8e60-1a0ac0120df7 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0b5f9f26-8454-44d8-aa18-724b5d18938e] added
Aug 26 10:29:49 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:29:49 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b5f9f26-8454-44d8-aa18-724b5d18938e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:29:49 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b5f9f26-8454-44d8-aa18-724b5d18938e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:29:49 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[0391d098-8ff0-4bd8-b679-b54a506aa1b4]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:29:49 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f5e25d8-ab0e-4c93-8e60-1a0ac0120df7 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:29:49 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b5f9f26-8454-44d8-aa18-724b5d18938e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:29:49 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b5f9f26-8454-44d8-aa18-724b5d18938e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:29:49 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c7c1fd8-cc66-4f88-b576-972bf2a3f7d0]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:29:49 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f5e25d8-ab0e-4c93-8e60-1a0ac0120df7 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:29:49 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b5f9f26-8454-44d8-aa18-724b5d18938e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EgYoJksa {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:29:49 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b5f9f26-8454-44d8-aa18-724b5d18938e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EgYoJksa" returned: 0 in 0.019s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:29:49 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2ed3aa2-2a2d-4665-98fd-f7f19e751544]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:29:49 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f5e25d8-ab0e-4c93-8e60-1a0ac0120df7 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EgYoJksa'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:29:49 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b5f9f26-8454-44d8-aa18-724b5d18938e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:29:49 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b5f9f26-8454-44d8-aa18-724b5d18938e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:29:49 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[63eb6b3f-01a4-47fe-94b3-d3d35bdc5112]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:29:49 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f5e25d8-ab0e-4c93-8e60-1a0ac0120df7 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:29:49 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:29:49 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:29:49 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f787ca3-4106-4898-ae13-c3b457780170]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:448cd30a-3852-471f-903f-a2e5abc34b55 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f8ad7ba-4084-4cd7-920f-8f7948de4212 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c7946b2-965a-4156-9a34-72518f8596f0 (non-flash)\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:29:49 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f5e25d8-ab0e-4c93-8e60-1a0ac0120df7 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)
Aug 26 10:29:49 user nova-compute[73572]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:448cd30a-3852-471f-903f-a2e5abc34b55 (non-flash)
Aug 26 10:29:49 user nova-compute[73572]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f8ad7ba-4084-4cd7-920f-8f7948de4212 (non-flash)
Aug 26 10:29:49 user nova-compute[73572]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c7946b2-965a-4156-9a34-72518f8596f0 (non-flash)
Aug 26 10:29:49 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 10:29:49 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f5e25d8-ab0e-4c93-8e60-1a0ac0120df7 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)
Aug 26 10:29:49 user nova-compute[73572]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:448cd30a-3852-471f-903f-a2e5abc34b55 (non-flash)
Aug 26 10:29:49 user nova-compute[73572]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f8ad7ba-4084-4cd7-920f-8f7948de4212 (non-flash)
Aug 26 10:29:49 user nova-compute[73572]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c7946b2-965a-4156-9a34-72518f8596f0 (non-flash)
Aug 26 10:29:49 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 10:29:49 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b5f9f26-8454-44d8-aa18-724b5d18938e -p 172.16.0.220:3260 --login {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:29:49 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b5f9f26-8454-44d8-aa18-724b5d18938e -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:29:49 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[d65f9f67-52d6-49a2-bd8c-f2a6e3443a0d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0b5f9f26-8454-44d8-aa18-724b5d18938e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0b5f9f26-8454-44d8-aa18-724b5d18938e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:29:49 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f5e25d8-ab0e-4c93-8e60-1a0ac0120df7 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0b5f9f26-8454-44d8-aa18-724b5d18938e, portal: 172.16.0.220,3260]
Aug 26 10:29:49 user nova-compute[73572]: Login to [iface: default, target: iqn.2010-10.org.openstack:0b5f9f26-8454-44d8-aa18-724b5d18938e, portal: 172.16.0.220,3260] successful.
Aug 26 10:29:49 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:29:49 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b5f9f26-8454-44d8-aa18-724b5d18938e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:29:49 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b5f9f26-8454-44d8-aa18-724b5d18938e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:29:49 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e56817c-97f2-4e07-b227-9ba2169c26d8]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:29:49 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f5e25d8-ab0e-4c93-8e60-1a0ac0120df7 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:29:49 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:29:49 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:29:49 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f3b004c-a4cc-4b64-b863-5404c73d32e7]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:448cd30a-3852-471f-903f-a2e5abc34b55 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f8ad7ba-4084-4cd7-920f-8f7948de4212 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c7946b2-965a-4156-9a34-72518f8596f0 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b5f9f26-8454-44d8-aa18-724b5d18938e (non-flash)\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:29:49 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f5e25d8-ab0e-4c93-8e60-1a0ac0120df7 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)
Aug 26 10:29:49 user nova-compute[73572]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:448cd30a-3852-471f-903f-a2e5abc34b55 (non-flash)
Aug 26 10:29:49 user nova-compute[73572]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f8ad7ba-4084-4cd7-920f-8f7948de4212 (non-flash)
Aug 26 10:29:49 user nova-compute[73572]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c7946b2-965a-4156-9a34-72518f8596f0 (non-flash)
Aug 26 10:29:49 user nova-compute[73572]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b5f9f26-8454-44d8-aa18-724b5d18938e (non-flash)
Aug 26 10:29:49 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 10:29:49 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f5e25d8-ab0e-4c93-8e60-1a0ac0120df7 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)
Aug 26 10:29:49 user nova-compute[73572]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:448cd30a-3852-471f-903f-a2e5abc34b55 (non-flash)
Aug 26 10:29:49 user nova-compute[73572]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f8ad7ba-4084-4cd7-920f-8f7948de4212 (non-flash)
Aug 26 10:29:49 user nova-compute[73572]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c7946b2-965a-4156-9a34-72518f8596f0 (non-flash)
Aug 26 10:29:49 user nova-compute[73572]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b5f9f26-8454-44d8-aa18-724b5d18938e (non-flash)
Aug 26 10:29:49 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 10:29:49 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-7f5e25d8-ab0e-4c93-8e60-1a0ac0120df7 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0b5f9f26-8454-44d8-aa18-724b5d18938e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.308s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 10:29:49 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f5e25d8-ab0e-4c93-8e60-1a0ac0120df7 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Connected to 172.16.0.220:3260 {{(pid=73572) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 10:29:49 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-7f5e25d8-ab0e-4c93-8e60-1a0ac0120df7 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] HCTL ('36', '-', '-', 0) found on session 44 with lun 0 {{(pid=73572) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 10:29:49 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-7f5e25d8-ab0e-4c93-8e60-1a0ac0120df7 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73572) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 10:29:49 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:29:49 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.035s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:29:49 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1aa8307-11df-40bb-b266-4e1f0888bbff]: (4, ('- - 0', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:29:49 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-7f5e25d8-ab0e-4c93-8e60-1a0ac0120df7 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Searching for a device in session 44 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73572) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 10:29:49 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f5e25d8-ab0e-4c93-8e60-1a0ac0120df7 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EgYoJksa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73572) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 10:29:50 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:29:50 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-7f5e25d8-ab0e-4c93-8e60-1a0ac0120df7 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.377s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 10:29:50 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f5e25d8-ab0e-4c93-8e60-1a0ac0120df7 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] <== connect_volume: return (1378ms) {'type': 'block', 'scsi_wwn': '23638303932643338', 'path': '/dev/sde'} {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 10:29:50 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7f5e25d8-ab0e-4c93-8e60-1a0ac0120df7 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] [instance: 6004b15a-be01-42eb-92ba-ae9d93dab708] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23638303932643338', 'path': '/dev/sde'} {{(pid=73572) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 10:29:50 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-7f5e25d8-ab0e-4c93-8e60-1a0ac0120df7 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-26T10:25:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-166680841',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-166680841',id=36,image_ref='26cc70a1-8b04-41ca-a800-4e3d44b1d424',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1985542231',keypairs=<?>,launch_index=0,launched_at=2023-08-26T10:25:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='c7e16843614c451d958e817c832d4cbc',ramdisk_id='',reservation_id='r-xx7zocnt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-706965180',owner_user_name='tempest-AttachVolumeShelveTestJSON-706965180-project-member',shelved_at='2023-08-26T10:27:41.022388',shelved_host='user',shelved_image_id='26cc70a1-8b04-41ca-a800-4e3d44b1d424'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T10:29:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='17243251fe57431c9c98195a16239c5f',uuid=6004b15a-be01-42eb-92ba-ae9d93dab708,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "8c801229-2284-4cd5-bdce-45c96edfe633", "address": "fa:16:3e:5a:0e:fa", "network": {"id": "317d2681-96ce-4898-b6fb-8892ee6f706d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2049963835-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7e16843614c451d958e817c832d4cbc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c801229-22", "ovs_interfaceid": "8c801229-2284-4cd5-bdce-45c96edfe633", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73572) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 10:29:50 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-7f5e25d8-ab0e-4c93-8e60-1a0ac0120df7 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Converting VIF {"id": "8c801229-2284-4cd5-bdce-45c96edfe633", "address": "fa:16:3e:5a:0e:fa", "network": {"id": "317d2681-96ce-4898-b6fb-8892ee6f706d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2049963835-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7e16843614c451d958e817c832d4cbc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c801229-22", "ovs_interfaceid": "8c801229-2284-4cd5-bdce-45c96edfe633", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:29:50 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-7f5e25d8-ab0e-4c93-8e60-1a0ac0120df7 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:0e:fa,bridge_name='br-int',has_traffic_filtering=True,id=8c801229-2284-4cd5-bdce-45c96edfe633,network=Network(317d2681-96ce-4898-b6fb-8892ee6f706d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c801229-22') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:29:50 user nova-compute[73572]: DEBUG nova.objects.instance [None req-7f5e25d8-ab0e-4c93-8e60-1a0ac0120df7 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Lazy-loading 'pci_devices' on Instance uuid 6004b15a-be01-42eb-92ba-ae9d93dab708 {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:29:50 user nova-compute[73572]: DEBUG nova.objects.base [None req-7f5e25d8-ab0e-4c93-8e60-1a0ac0120df7 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Object Instance<6004b15a-be01-42eb-92ba-ae9d93dab708> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=73572) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 10:29:50 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-7f5e25d8-ab0e-4c93-8e60-1a0ac0120df7 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] [instance: 6004b15a-be01-42eb-92ba-ae9d93dab708] End _get_guest_xml xml=<domain type="kvm">
Aug 26 10:29:50 user nova-compute[73572]:   <uuid>6004b15a-be01-42eb-92ba-ae9d93dab708</uuid>
Aug 26 10:29:50 user nova-compute[73572]:   <name>instance-00000024</name>
Aug 26 10:29:50 user nova-compute[73572]:   <memory>524288</memory>
Aug 26 10:29:50 user nova-compute[73572]:   <vcpu>1</vcpu>
Aug 26 10:29:50 user nova-compute[73572]:   <metadata>
Aug 26 10:29:50 user nova-compute[73572]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 10:29:50 user nova-compute[73572]:       <nova:package version="0.0.0"/>
Aug 26 10:29:50 user nova-compute[73572]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-166680841</nova:name>
Aug 26 10:29:50 user nova-compute[73572]:       <nova:creationTime>2023-08-26 10:29:49</nova:creationTime>
Aug 26 10:29:50 user nova-compute[73572]:       <nova:flavor name="m1.tiny">
Aug 26 10:29:50 user nova-compute[73572]:         <nova:memory>512</nova:memory>
Aug 26 10:29:50 user nova-compute[73572]:         <nova:disk>1</nova:disk>
Aug 26 10:29:50 user nova-compute[73572]:         <nova:swap>0</nova:swap>
Aug 26 10:29:50 user nova-compute[73572]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 10:29:50 user nova-compute[73572]:         <nova:vcpus>1</nova:vcpus>
Aug 26 10:29:50 user nova-compute[73572]:       </nova:flavor>
Aug 26 10:29:50 user nova-compute[73572]:       <nova:owner>
Aug 26 10:29:50 user nova-compute[73572]:         <nova:user uuid="17243251fe57431c9c98195a16239c5f">tempest-AttachVolumeShelveTestJSON-706965180-project-member</nova:user>
Aug 26 10:29:50 user nova-compute[73572]:         <nova:project uuid="c7e16843614c451d958e817c832d4cbc">tempest-AttachVolumeShelveTestJSON-706965180</nova:project>
Aug 26 10:29:50 user nova-compute[73572]:       </nova:owner>
Aug 26 10:29:50 user nova-compute[73572]:       <nova:root type="image" uuid="26cc70a1-8b04-41ca-a800-4e3d44b1d424"/>
Aug 26 10:29:50 user nova-compute[73572]:       <nova:ports>
Aug 26 10:29:50 user nova-compute[73572]:         <nova:port uuid="8c801229-2284-4cd5-bdce-45c96edfe633">
Aug 26 10:29:50 user nova-compute[73572]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 26 10:29:50 user nova-compute[73572]:         </nova:port>
Aug 26 10:29:50 user nova-compute[73572]:       </nova:ports>
Aug 26 10:29:50 user nova-compute[73572]:     </nova:instance>
Aug 26 10:29:50 user nova-compute[73572]:   </metadata>
Aug 26 10:29:50 user nova-compute[73572]:   <sysinfo type="smbios">
Aug 26 10:29:50 user nova-compute[73572]:     <system>
Aug 26 10:29:50 user nova-compute[73572]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 10:29:50 user nova-compute[73572]:       <entry name="product">OpenStack Nova</entry>
Aug 26 10:29:50 user nova-compute[73572]:       <entry name="version">0.0.0</entry>
Aug 26 10:29:50 user nova-compute[73572]:       <entry name="serial">6004b15a-be01-42eb-92ba-ae9d93dab708</entry>
Aug 26 10:29:50 user nova-compute[73572]:       <entry name="uuid">6004b15a-be01-42eb-92ba-ae9d93dab708</entry>
Aug 26 10:29:50 user nova-compute[73572]:       <entry name="family">Virtual Machine</entry>
Aug 26 10:29:50 user nova-compute[73572]:     </system>
Aug 26 10:29:50 user nova-compute[73572]:   </sysinfo>
Aug 26 10:29:50 user nova-compute[73572]:   <os>
Aug 26 10:29:50 user nova-compute[73572]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 10:29:50 user nova-compute[73572]:     <boot dev="hd"/>
Aug 26 10:29:50 user nova-compute[73572]:     <smbios mode="sysinfo"/>
Aug 26 10:29:50 user nova-compute[73572]:   </os>
Aug 26 10:29:50 user nova-compute[73572]:   <features>
Aug 26 10:29:50 user nova-compute[73572]:     <acpi/>
Aug 26 10:29:50 user nova-compute[73572]:     <apic/>
Aug 26 10:29:50 user nova-compute[73572]:     <vmcoreinfo/>
Aug 26 10:29:50 user nova-compute[73572]:   </features>
Aug 26 10:29:50 user nova-compute[73572]:   <clock offset="utc">
Aug 26 10:29:50 user nova-compute[73572]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 10:29:50 user nova-compute[73572]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 10:29:50 user nova-compute[73572]:     <timer name="hpet" present="no"/>
Aug 26 10:29:50 user nova-compute[73572]:   </clock>
Aug 26 10:29:50 user nova-compute[73572]:   <cpu mode="custom" match="exact">
Aug 26 10:29:50 user nova-compute[73572]:     <model>Nehalem</model>
Aug 26 10:29:50 user nova-compute[73572]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 10:29:50 user nova-compute[73572]:   </cpu>
Aug 26 10:29:50 user nova-compute[73572]:   <devices>
Aug 26 10:29:50 user nova-compute[73572]:     <disk type="file" device="disk">
Aug 26 10:29:50 user nova-compute[73572]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 10:29:50 user nova-compute[73572]:       <source file="/opt/stack/data/nova/instances/6004b15a-be01-42eb-92ba-ae9d93dab708/disk"/>
Aug 26 10:29:50 user nova-compute[73572]:       <target dev="vda" bus="virtio"/>
Aug 26 10:29:50 user nova-compute[73572]:     </disk>
Aug 26 10:29:50 user nova-compute[73572]:     <disk type="block" device="disk">
Aug 26 10:29:50 user nova-compute[73572]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 10:29:50 user nova-compute[73572]:       <source dev="/dev/sde"/>
Aug 26 10:29:50 user nova-compute[73572]:       <target dev="vdc" bus="virtio"/>
Aug 26 10:29:50 user nova-compute[73572]:       <serial>0b5f9f26-8454-44d8-aa18-724b5d18938e</serial>
Aug 26 10:29:50 user nova-compute[73572]:     </disk>
Aug 26 10:29:50 user nova-compute[73572]:     <interface type="ethernet">
Aug 26 10:29:50 user nova-compute[73572]:       <mac address="fa:16:3e:5a:0e:fa"/>
Aug 26 10:29:50 user nova-compute[73572]:       <model type="virtio"/>
Aug 26 10:29:50 user nova-compute[73572]:       <mtu size="1442"/>
Aug 26 10:29:50 user nova-compute[73572]:       <target dev="tap8c801229-22"/>
Aug 26 10:29:50 user nova-compute[73572]:     </interface>
Aug 26 10:29:50 user nova-compute[73572]:     <serial type="pty">
Aug 26 10:29:50 user nova-compute[73572]:       <log file="/opt/stack/data/nova/instances/6004b15a-be01-42eb-92ba-ae9d93dab708/console.log" append="off"/>
Aug 26 10:29:50 user nova-compute[73572]:     </serial>
Aug 26 10:29:50 user nova-compute[73572]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 10:29:50 user nova-compute[73572]:     <video>
Aug 26 10:29:50 user nova-compute[73572]:       <model type="virtio"/>
Aug 26 10:29:50 user nova-compute[73572]:     </video>
Aug 26 10:29:50 user nova-compute[73572]:     <rng model="virtio">
Aug 26 10:29:50 user nova-compute[73572]:       <backend model="random">/dev/urandom</backend>
Aug 26 10:29:50 user nova-compute[73572]:     </rng>
Aug 26 10:29:50 user nova-compute[73572]:     <controller type="usb" index="0" model="none"/>
Aug 26 10:29:50 user nova-compute[73572]:     <memballoon model="virtio">
Aug 26 10:29:50 user nova-compute[73572]:       <stats period="10"/>
Aug 26 10:29:50 user nova-compute[73572]:     </memballoon>
Aug 26 10:29:50 user nova-compute[73572]:   </devices>
Aug 26 10:29:50 user nova-compute[73572]: </domain>
Aug 26 10:29:50 user nova-compute[73572]:  {{(pid=73572) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 10:29:50 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-7f5e25d8-ab0e-4c93-8e60-1a0ac0120df7 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-26T10:25:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-166680841',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-166680841',id=36,image_ref='26cc70a1-8b04-41ca-a800-4e3d44b1d424',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1985542231',keypairs=<?>,launch_index=0,launched_at=2023-08-26T10:25:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='c7e16843614c451d958e817c832d4cbc',ramdisk_id='',reservation_id='r-xx7zocnt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-706965180',owner_user_name='tempest-AttachVolumeShelveTestJSON-706965180-project-member',shelved_at='2023-08-26T10:27:41.022388',shelved_host='user',shelved_image_id='26cc70a1-8b04-41ca-a800-4e3d44b1d424'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T10:29:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='17243251fe57431c9c98195a16239c5f',uuid=6004b15a-be01-42eb-92ba-ae9d93dab708,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "8c801229-2284-4cd5-bdce-45c96edfe633", "address": "fa:16:3e:5a:0e:fa", "network": {"id": "317d2681-96ce-4898-b6fb-8892ee6f706d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2049963835-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7e16843614c451d958e817c832d4cbc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c801229-22", "ovs_interfaceid": "8c801229-2284-4cd5-bdce-45c96edfe633", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 10:29:50 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-7f5e25d8-ab0e-4c93-8e60-1a0ac0120df7 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Converting VIF {"id": "8c801229-2284-4cd5-bdce-45c96edfe633", "address": "fa:16:3e:5a:0e:fa", "network": {"id": "317d2681-96ce-4898-b6fb-8892ee6f706d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2049963835-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7e16843614c451d958e817c832d4cbc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c801229-22", "ovs_interfaceid": "8c801229-2284-4cd5-bdce-45c96edfe633", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:29:50 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-7f5e25d8-ab0e-4c93-8e60-1a0ac0120df7 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:0e:fa,bridge_name='br-int',has_traffic_filtering=True,id=8c801229-2284-4cd5-bdce-45c96edfe633,network=Network(317d2681-96ce-4898-b6fb-8892ee6f706d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c801229-22') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:29:50 user nova-compute[73572]: DEBUG os_vif [None req-7f5e25d8-ab0e-4c93-8e60-1a0ac0120df7 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:0e:fa,bridge_name='br-int',has_traffic_filtering=True,id=8c801229-2284-4cd5-bdce-45c96edfe633,network=Network(317d2681-96ce-4898-b6fb-8892ee6f706d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c801229-22') {{(pid=73572) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 10:29:50 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:29:50 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:29:50 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 10:29:50 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:29:50 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8c801229-22, may_exist=True, interface_attrs={}) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:29:50 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8c801229-22, col_values=(('external_ids', {'iface-id': '8c801229-2284-4cd5-bdce-45c96edfe633', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5a:0e:fa', 'vm-uuid': '6004b15a-be01-42eb-92ba-ae9d93dab708'}),), if_exists=True) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:29:50 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:29:50 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:29:50 user nova-compute[73572]: INFO os_vif [None req-7f5e25d8-ab0e-4c93-8e60-1a0ac0120df7 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:0e:fa,bridge_name='br-int',has_traffic_filtering=True,id=8c801229-2284-4cd5-bdce-45c96edfe633,network=Network(317d2681-96ce-4898-b6fb-8892ee6f706d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c801229-22')
Aug 26 10:29:51 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-7f5e25d8-ab0e-4c93-8e60-1a0ac0120df7 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] No BDM found with device name vda, not building metadata. {{(pid=73572) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 10:29:51 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-7f5e25d8-ab0e-4c93-8e60-1a0ac0120df7 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] No BDM found with device name vdc, not building metadata. {{(pid=73572) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 10:29:51 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-7f5e25d8-ab0e-4c93-8e60-1a0ac0120df7 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] No VIF found with MAC fa:16:3e:5a:0e:fa, not building metadata {{(pid=73572) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 10:29:52 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:29:52 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:29:52 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-84caf4b7-0a31-42b8-9a38-84c4109cc063 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] [instance: 1c8e780d-0a13-4484-bf18-ac0879db263a] Calling os-brick to attach iSCSI Volume {{(pid=73572) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 10:29:52 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-84caf4b7-0a31-42b8-9a38-84c4109cc063 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc89c3d6a10>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:d8aa6fc0-ce50-4db6-8d7d-9f37eae07207'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'seaDVAkb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 10:29:52 user nova-compute[73572]: WARNING os_brick.initiator.connectors.base [None req-84caf4b7-0a31-42b8-9a38-84c4109cc063 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 10:29:52 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-84caf4b7-0a31-42b8-9a38-84c4109cc063 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 10:29:52 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-84caf4b7-0a31-42b8-9a38-84c4109cc063 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 10:29:52 user nova-compute[73572]: WARNING os_brick.initiator.connectors.base [None req-84caf4b7-0a31-42b8-9a38-84c4109cc063 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 10:29:52 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-84caf4b7-0a31-42b8-9a38-84c4109cc063 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d8aa6fc0-ce50-4db6-8d7d-9f37eae07207" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 10:29:52 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-84caf4b7-0a31-42b8-9a38-84c4109cc063 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d8aa6fc0-ce50-4db6-8d7d-9f37eae07207" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 10:29:52 user nova-compute[73572]: INFO os_brick.initiator.connectors.iscsi [None req-84caf4b7-0a31-42b8-9a38-84c4109cc063 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 10:29:52 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8aa6fc0-ce50-4db6-8d7d-9f37eae07207 -p 172.16.0.220:3260 {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:29:52 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8aa6fc0-ce50-4db6-8d7d-9f37eae07207 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:29:52 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[b31ee4c3-e449-4b78-b729-61a558d5c573]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:29:52 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-84caf4b7-0a31-42b8-9a38-84c4109cc063 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 10:29:52 user nova-compute[73572]:  {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:29:52 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8aa6fc0-ce50-4db6-8d7d-9f37eae07207 -p 172.16.0.220:3260 --interface default --op new {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:29:52 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8aa6fc0-ce50-4db6-8d7d-9f37eae07207 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:29:52 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fe68c5d-885d-433a-b8d4-97bdd326847f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d8aa6fc0-ce50-4db6-8d7d-9f37eae07207] added\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:29:52 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-84caf4b7-0a31-42b8-9a38-84c4109cc063 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d8aa6fc0-ce50-4db6-8d7d-9f37eae07207] added
Aug 26 10:29:52 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:29:52 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8aa6fc0-ce50-4db6-8d7d-9f37eae07207 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:29:52 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8aa6fc0-ce50-4db6-8d7d-9f37eae07207 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:29:52 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[60efb3aa-1363-4b05-b168-187aa89ccd34]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:29:52 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-84caf4b7-0a31-42b8-9a38-84c4109cc063 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:29:52 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8aa6fc0-ce50-4db6-8d7d-9f37eae07207 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:29:52 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8aa6fc0-ce50-4db6-8d7d-9f37eae07207 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:29:52 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ce0a4ae-7052-4a64-ad59-25fef114c34c]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:29:52 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-84caf4b7-0a31-42b8-9a38-84c4109cc063 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:29:52 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8aa6fc0-ce50-4db6-8d7d-9f37eae07207 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v seaDVAkb {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:29:52 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8aa6fc0-ce50-4db6-8d7d-9f37eae07207 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v seaDVAkb" returned: 0 in 0.020s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:29:52 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4c0dabf-7c49-4f8e-93ac-f4e7c0460a6e]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:29:52 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-84caf4b7-0a31-42b8-9a38-84c4109cc063 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'seaDVAkb'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:29:52 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8aa6fc0-ce50-4db6-8d7d-9f37eae07207 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:29:52 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8aa6fc0-ce50-4db6-8d7d-9f37eae07207 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.028s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:29:52 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[b99c6f2b-d7ad-4d3c-9dbe-1c63add288e3]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:29:52 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-84caf4b7-0a31-42b8-9a38-84c4109cc063 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:29:52 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:29:52 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:29:52 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cedeae5-332d-4d27-aef9-3ab925a9a5bf]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:448cd30a-3852-471f-903f-a2e5abc34b55 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f8ad7ba-4084-4cd7-920f-8f7948de4212 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c7946b2-965a-4156-9a34-72518f8596f0 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b5f9f26-8454-44d8-aa18-724b5d18938e (non-flash)\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:29:52 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-84caf4b7-0a31-42b8-9a38-84c4109cc063 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)
Aug 26 10:29:52 user nova-compute[73572]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:448cd30a-3852-471f-903f-a2e5abc34b55 (non-flash)
Aug 26 10:29:52 user nova-compute[73572]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f8ad7ba-4084-4cd7-920f-8f7948de4212 (non-flash)
Aug 26 10:29:52 user nova-compute[73572]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c7946b2-965a-4156-9a34-72518f8596f0 (non-flash)
Aug 26 10:29:52 user nova-compute[73572]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b5f9f26-8454-44d8-aa18-724b5d18938e (non-flash)
Aug 26 10:29:52 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 10:29:52 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-84caf4b7-0a31-42b8-9a38-84c4109cc063 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)
Aug 26 10:29:52 user nova-compute[73572]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:448cd30a-3852-471f-903f-a2e5abc34b55 (non-flash)
Aug 26 10:29:52 user nova-compute[73572]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f8ad7ba-4084-4cd7-920f-8f7948de4212 (non-flash)
Aug 26 10:29:52 user nova-compute[73572]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c7946b2-965a-4156-9a34-72518f8596f0 (non-flash)
Aug 26 10:29:52 user nova-compute[73572]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b5f9f26-8454-44d8-aa18-724b5d18938e (non-flash)
Aug 26 10:29:52 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 10:29:52 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8aa6fc0-ce50-4db6-8d7d-9f37eae07207 -p 172.16.0.220:3260 --login {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:29:52 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8aa6fc0-ce50-4db6-8d7d-9f37eae07207 -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:29:52 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[2599360c-b495-47c3-877e-ab86602335ba]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d8aa6fc0-ce50-4db6-8d7d-9f37eae07207, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d8aa6fc0-ce50-4db6-8d7d-9f37eae07207, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:29:52 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-84caf4b7-0a31-42b8-9a38-84c4109cc063 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d8aa6fc0-ce50-4db6-8d7d-9f37eae07207, portal: 172.16.0.220,3260]
Aug 26 10:29:52 user nova-compute[73572]: Login to [iface: default, target: iqn.2010-10.org.openstack:d8aa6fc0-ce50-4db6-8d7d-9f37eae07207, portal: 172.16.0.220,3260] successful.
Aug 26 10:29:52 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:29:52 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8aa6fc0-ce50-4db6-8d7d-9f37eae07207 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:29:52 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8aa6fc0-ce50-4db6-8d7d-9f37eae07207 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:29:52 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4efe780-a303-48a7-bf4d-e76958277e28]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:29:52 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-84caf4b7-0a31-42b8-9a38-84c4109cc063 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:29:52 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:29:52 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:29:52 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[414225d6-6f6f-40d3-b1cb-d95d66870e0b]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:448cd30a-3852-471f-903f-a2e5abc34b55 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f8ad7ba-4084-4cd7-920f-8f7948de4212 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c7946b2-965a-4156-9a34-72518f8596f0 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b5f9f26-8454-44d8-aa18-724b5d18938e (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8aa6fc0-ce50-4db6-8d7d-9f37eae07207 (non-flash)\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:29:52 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-84caf4b7-0a31-42b8-9a38-84c4109cc063 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)
Aug 26 10:29:52 user nova-compute[73572]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:448cd30a-3852-471f-903f-a2e5abc34b55 (non-flash)
Aug 26 10:29:52 user nova-compute[73572]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f8ad7ba-4084-4cd7-920f-8f7948de4212 (non-flash)
Aug 26 10:29:52 user nova-compute[73572]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c7946b2-965a-4156-9a34-72518f8596f0 (non-flash)
Aug 26 10:29:52 user nova-compute[73572]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b5f9f26-8454-44d8-aa18-724b5d18938e (non-flash)
Aug 26 10:29:52 user nova-compute[73572]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8aa6fc0-ce50-4db6-8d7d-9f37eae07207 (non-flash)
Aug 26 10:29:52 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 10:29:52 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-84caf4b7-0a31-42b8-9a38-84c4109cc063 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)
Aug 26 10:29:52 user nova-compute[73572]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:448cd30a-3852-471f-903f-a2e5abc34b55 (non-flash)
Aug 26 10:29:52 user nova-compute[73572]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f8ad7ba-4084-4cd7-920f-8f7948de4212 (non-flash)
Aug 26 10:29:52 user nova-compute[73572]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c7946b2-965a-4156-9a34-72518f8596f0 (non-flash)
Aug 26 10:29:52 user nova-compute[73572]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b5f9f26-8454-44d8-aa18-724b5d18938e (non-flash)
Aug 26 10:29:52 user nova-compute[73572]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8aa6fc0-ce50-4db6-8d7d-9f37eae07207 (non-flash)
Aug 26 10:29:52 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 10:29:52 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-84caf4b7-0a31-42b8-9a38-84c4109cc063 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d8aa6fc0-ce50-4db6-8d7d-9f37eae07207" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.338s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 10:29:52 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-84caf4b7-0a31-42b8-9a38-84c4109cc063 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Connected to 172.16.0.220:3260 {{(pid=73572) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 10:29:52 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-84caf4b7-0a31-42b8-9a38-84c4109cc063 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] HCTL ('38', '-', '-', 0) found on session 45 with lun 0 {{(pid=73572) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 10:29:52 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-84caf4b7-0a31-42b8-9a38-84c4109cc063 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=73572) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 10:29:52 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:29:52 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.022s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:29:52 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9c251a5-0d75-4eff-a868-269b59469b59]: (4, ('- - 0', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:29:52 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-84caf4b7-0a31-42b8-9a38-84c4109cc063 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Searching for a device in session 45 and hctl ['38', '*', '*', 0] yield: None {{(pid=73572) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 10:29:53 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:29:53 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:29:53 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:29:53 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-84caf4b7-0a31-42b8-9a38-84c4109cc063 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Searching for a device in session 45 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=73572) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 10:29:53 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-84caf4b7-0a31-42b8-9a38-84c4109cc063 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'seaDVAkb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73572) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 10:29:53 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-84caf4b7-0a31-42b8-9a38-84c4109cc063 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.373s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 10:29:53 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-84caf4b7-0a31-42b8-9a38-84c4109cc063 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] <== connect_volume: return (1374ms) {'type': 'block', 'scsi_wwn': '23162373634653434', 'path': '/dev/sdg'} {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 10:29:53 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-84caf4b7-0a31-42b8-9a38-84c4109cc063 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] [instance: 1c8e780d-0a13-4484-bf18-ac0879db263a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23162373634653434', 'path': '/dev/sdg'} {{(pid=73572) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 10:29:53 user nova-compute[73572]: DEBUG nova.objects.instance [None req-84caf4b7-0a31-42b8-9a38-84c4109cc063 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Lazy-loading 'flavor' on Instance uuid 1c8e780d-0a13-4484-bf18-ac0879db263a {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:29:53 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:29:53 user nova-compute[73572]: DEBUG nova.virt.libvirt.guest [None req-84caf4b7-0a31-42b8-9a38-84c4109cc063 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 10:29:53 user nova-compute[73572]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 10:29:53 user nova-compute[73572]:   <source dev="/dev/sdg"/>
Aug 26 10:29:53 user nova-compute[73572]:   <target dev="vdb" bus="virtio"/>
Aug 26 10:29:53 user nova-compute[73572]:   <serial>d8aa6fc0-ce50-4db6-8d7d-9f37eae07207</serial>
Aug 26 10:29:53 user nova-compute[73572]: </disk>
Aug 26 10:29:53 user nova-compute[73572]:  {{(pid=73572) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 10:29:54 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-84caf4b7-0a31-42b8-9a38-84c4109cc063 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] No BDM found with device name vda, not building metadata. {{(pid=73572) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 10:29:54 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-84caf4b7-0a31-42b8-9a38-84c4109cc063 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73572) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 10:29:54 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-84caf4b7-0a31-42b8-9a38-84c4109cc063 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] No VIF found with MAC fa:16:3e:c2:0f:20, not building metadata {{(pid=73572) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 10:29:54 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-84caf4b7-0a31-42b8-9a38-84c4109cc063 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Lock "1c8e780d-0a13-4484-bf18-ac0879db263a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.699s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:29:54 user nova-compute[73572]: DEBUG nova.compute.manager [req-e6f8b618-fbf5-4bb9-aa84-f467e616f686 req-a5f8dd4b-f45e-4d34-9be7-68b66ec7754a service nova] [instance: 6004b15a-be01-42eb-92ba-ae9d93dab708] Received event network-vif-plugged-8c801229-2284-4cd5-bdce-45c96edfe633 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:29:54 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-e6f8b618-fbf5-4bb9-aa84-f467e616f686 req-a5f8dd4b-f45e-4d34-9be7-68b66ec7754a service nova] Acquiring lock "6004b15a-be01-42eb-92ba-ae9d93dab708-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:29:54 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-e6f8b618-fbf5-4bb9-aa84-f467e616f686 req-a5f8dd4b-f45e-4d34-9be7-68b66ec7754a service nova] Lock "6004b15a-be01-42eb-92ba-ae9d93dab708-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:29:54 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-e6f8b618-fbf5-4bb9-aa84-f467e616f686 req-a5f8dd4b-f45e-4d34-9be7-68b66ec7754a service nova] Lock "6004b15a-be01-42eb-92ba-ae9d93dab708-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:29:54 user nova-compute[73572]: DEBUG nova.compute.manager [req-e6f8b618-fbf5-4bb9-aa84-f467e616f686 req-a5f8dd4b-f45e-4d34-9be7-68b66ec7754a service nova] [instance: 6004b15a-be01-42eb-92ba-ae9d93dab708] No waiting events found dispatching network-vif-plugged-8c801229-2284-4cd5-bdce-45c96edfe633 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:29:54 user nova-compute[73572]: WARNING nova.compute.manager [req-e6f8b618-fbf5-4bb9-aa84-f467e616f686 req-a5f8dd4b-f45e-4d34-9be7-68b66ec7754a service nova] [instance: 6004b15a-be01-42eb-92ba-ae9d93dab708] Received unexpected event network-vif-plugged-8c801229-2284-4cd5-bdce-45c96edfe633 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 26 10:29:54 user nova-compute[73572]: DEBUG nova.virt.driver [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Emitting event <LifecycleEvent: 1693045794.7196035, 6004b15a-be01-42eb-92ba-ae9d93dab708 => Resumed> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:29:54 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 6004b15a-be01-42eb-92ba-ae9d93dab708] VM Resumed (Lifecycle Event)
Aug 26 10:29:54 user nova-compute[73572]: DEBUG nova.compute.manager [None req-7f5e25d8-ab0e-4c93-8e60-1a0ac0120df7 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] [instance: 6004b15a-be01-42eb-92ba-ae9d93dab708] Instance event wait completed in 0 seconds for  {{(pid=73572) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 10:29:54 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-7f5e25d8-ab0e-4c93-8e60-1a0ac0120df7 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] [instance: 6004b15a-be01-42eb-92ba-ae9d93dab708] Guest created on hypervisor {{(pid=73572) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 10:29:54 user nova-compute[73572]: INFO nova.virt.libvirt.driver [-] [instance: 6004b15a-be01-42eb-92ba-ae9d93dab708] Instance spawned successfully.
Aug 26 10:29:54 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 6004b15a-be01-42eb-92ba-ae9d93dab708] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:29:54 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 6004b15a-be01-42eb-92ba-ae9d93dab708] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=73572) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 10:29:54 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 6004b15a-be01-42eb-92ba-ae9d93dab708] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 10:29:54 user nova-compute[73572]: DEBUG nova.virt.driver [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Emitting event <LifecycleEvent: 1693045794.7208116, 6004b15a-be01-42eb-92ba-ae9d93dab708 => Started> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:29:54 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 6004b15a-be01-42eb-92ba-ae9d93dab708] VM Started (Lifecycle Event)
Aug 26 10:29:54 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 6004b15a-be01-42eb-92ba-ae9d93dab708] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:29:54 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 6004b15a-be01-42eb-92ba-ae9d93dab708] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=73572) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 10:29:54 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 6004b15a-be01-42eb-92ba-ae9d93dab708] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 10:29:54 user nova-compute[73572]: DEBUG nova.compute.manager [None req-7f5e25d8-ab0e-4c93-8e60-1a0ac0120df7 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] [instance: 6004b15a-be01-42eb-92ba-ae9d93dab708] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:29:55 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-7f5e25d8-ab0e-4c93-8e60-1a0ac0120df7 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Lock "6004b15a-be01-42eb-92ba-ae9d93dab708" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 25.734s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:29:55 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:29:55 user nova-compute[73572]: INFO nova.compute.manager [None req-c94ae9c9-0b8f-4ae1-bc2d-9555452fd83a tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] [instance: 1c8e780d-0a13-4484-bf18-ac0879db263a] Rescuing
Aug 26 10:29:55 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-c94ae9c9-0b8f-4ae1-bc2d-9555452fd83a tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Acquiring lock "refresh_cache-1c8e780d-0a13-4484-bf18-ac0879db263a" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:29:55 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-c94ae9c9-0b8f-4ae1-bc2d-9555452fd83a tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Acquired lock "refresh_cache-1c8e780d-0a13-4484-bf18-ac0879db263a" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:29:55 user nova-compute[73572]: DEBUG nova.network.neutron [None req-c94ae9c9-0b8f-4ae1-bc2d-9555452fd83a tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] [instance: 1c8e780d-0a13-4484-bf18-ac0879db263a] Building network info cache for instance {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 10:29:55 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:29:56 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-f84ef7b3-d511-4051-aff3-3471805f1ceb tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Acquiring lock "d03d1626-e18b-4b15-a679-4543f7641ed7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:29:56 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-f84ef7b3-d511-4051-aff3-3471805f1ceb tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Lock "d03d1626-e18b-4b15-a679-4543f7641ed7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:29:56 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-f84ef7b3-d511-4051-aff3-3471805f1ceb tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Acquiring lock "d03d1626-e18b-4b15-a679-4543f7641ed7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:29:56 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-f84ef7b3-d511-4051-aff3-3471805f1ceb tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Lock "d03d1626-e18b-4b15-a679-4543f7641ed7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:29:56 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-f84ef7b3-d511-4051-aff3-3471805f1ceb tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Lock "d03d1626-e18b-4b15-a679-4543f7641ed7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:29:56 user nova-compute[73572]: INFO nova.compute.manager [None req-f84ef7b3-d511-4051-aff3-3471805f1ceb tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] [instance: d03d1626-e18b-4b15-a679-4543f7641ed7] Terminating instance
Aug 26 10:29:56 user nova-compute[73572]: DEBUG nova.compute.manager [None req-f84ef7b3-d511-4051-aff3-3471805f1ceb tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] [instance: d03d1626-e18b-4b15-a679-4543f7641ed7] Start destroying the instance on the hypervisor. {{(pid=73572) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 10:29:56 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:29:56 user nova-compute[73572]: DEBUG nova.network.neutron [None req-c94ae9c9-0b8f-4ae1-bc2d-9555452fd83a tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] [instance: 1c8e780d-0a13-4484-bf18-ac0879db263a] Updating instance_info_cache with network_info: [{"id": "d03460b0-e0b9-4c39-a8a6-12cb80aca6bc", "address": "fa:16:3e:c2:0f:20", "network": {"id": "757e71b4-5177-45a5-8ef5-9b27f42092f1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1765327616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1bff48d66894950ac6690e1fd0e79b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd03460b0-e0", "ovs_interfaceid": "d03460b0-e0b9-4c39-a8a6-12cb80aca6bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:29:56 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-c94ae9c9-0b8f-4ae1-bc2d-9555452fd83a tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Releasing lock "refresh_cache-1c8e780d-0a13-4484-bf18-ac0879db263a" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:29:56 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:29:56 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:29:56 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:29:56 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:29:56 user nova-compute[73572]: DEBUG nova.compute.manager [req-b2f46da7-08dd-419a-a4e2-c685438ca4d6 req-d44b3c35-6e77-4f72-beb3-16ad18400a94 service nova] [instance: 6004b15a-be01-42eb-92ba-ae9d93dab708] Received event network-vif-plugged-8c801229-2284-4cd5-bdce-45c96edfe633 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:29:56 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-b2f46da7-08dd-419a-a4e2-c685438ca4d6 req-d44b3c35-6e77-4f72-beb3-16ad18400a94 service nova] Acquiring lock "6004b15a-be01-42eb-92ba-ae9d93dab708-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:29:56 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-b2f46da7-08dd-419a-a4e2-c685438ca4d6 req-d44b3c35-6e77-4f72-beb3-16ad18400a94 service nova] Lock "6004b15a-be01-42eb-92ba-ae9d93dab708-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:29:56 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-b2f46da7-08dd-419a-a4e2-c685438ca4d6 req-d44b3c35-6e77-4f72-beb3-16ad18400a94 service nova] Lock "6004b15a-be01-42eb-92ba-ae9d93dab708-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:29:56 user nova-compute[73572]: DEBUG nova.compute.manager [req-b2f46da7-08dd-419a-a4e2-c685438ca4d6 req-d44b3c35-6e77-4f72-beb3-16ad18400a94 service nova] [instance: 6004b15a-be01-42eb-92ba-ae9d93dab708] No waiting events found dispatching network-vif-plugged-8c801229-2284-4cd5-bdce-45c96edfe633 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:29:56 user nova-compute[73572]: WARNING nova.compute.manager [req-b2f46da7-08dd-419a-a4e2-c685438ca4d6 req-d44b3c35-6e77-4f72-beb3-16ad18400a94 service nova] [instance: 6004b15a-be01-42eb-92ba-ae9d93dab708] Received unexpected event network-vif-plugged-8c801229-2284-4cd5-bdce-45c96edfe633 for instance with vm_state active and task_state None.
Aug 26 10:29:56 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:29:56 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:29:56 user nova-compute[73572]: DEBUG nova.compute.manager [req-c50d8c43-21fc-4753-9e38-aa7b1120a0b8 req-0ba46a07-0513-4825-b099-cba3384fcc57 service nova] [instance: d03d1626-e18b-4b15-a679-4543f7641ed7] Received event network-vif-unplugged-fe6f8481-fb71-49fa-a9e7-b38adbf8e4fc {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:29:56 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-c50d8c43-21fc-4753-9e38-aa7b1120a0b8 req-0ba46a07-0513-4825-b099-cba3384fcc57 service nova] Acquiring lock "d03d1626-e18b-4b15-a679-4543f7641ed7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:29:56 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-c50d8c43-21fc-4753-9e38-aa7b1120a0b8 req-0ba46a07-0513-4825-b099-cba3384fcc57 service nova] Lock "d03d1626-e18b-4b15-a679-4543f7641ed7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:29:56 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-c50d8c43-21fc-4753-9e38-aa7b1120a0b8 req-0ba46a07-0513-4825-b099-cba3384fcc57 service nova] Lock "d03d1626-e18b-4b15-a679-4543f7641ed7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:29:56 user nova-compute[73572]: DEBUG nova.compute.manager [req-c50d8c43-21fc-4753-9e38-aa7b1120a0b8 req-0ba46a07-0513-4825-b099-cba3384fcc57 service nova] [instance: d03d1626-e18b-4b15-a679-4543f7641ed7] No waiting events found dispatching network-vif-unplugged-fe6f8481-fb71-49fa-a9e7-b38adbf8e4fc {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:29:56 user nova-compute[73572]: DEBUG nova.compute.manager [req-c50d8c43-21fc-4753-9e38-aa7b1120a0b8 req-0ba46a07-0513-4825-b099-cba3384fcc57 service nova] [instance: d03d1626-e18b-4b15-a679-4543f7641ed7] Received event network-vif-unplugged-fe6f8481-fb71-49fa-a9e7-b38adbf8e4fc for instance with task_state deleting. {{(pid=73572) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 10:29:57 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:29:57 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:29:57 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:29:57 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:29:57 user nova-compute[73572]: INFO nova.virt.libvirt.driver [-] [instance: d03d1626-e18b-4b15-a679-4543f7641ed7] Instance destroyed successfully.
Aug 26 10:29:57 user nova-compute[73572]: DEBUG nova.objects.instance [None req-f84ef7b3-d511-4051-aff3-3471805f1ceb tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Lazy-loading 'resources' on Instance uuid d03d1626-e18b-4b15-a679-4543f7641ed7 {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:29:57 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:29:57 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-f84ef7b3-d511-4051-aff3-3471805f1ceb tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T10:26:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-807874306',display_name='tempest-AttachVolumeNegativeTest-server-807874306',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-807874306',id=39,image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCAWN3unneGTMRpIZHWWOhbC+4DsCjaqSbGq2slHT7n6C3jFRAt+pYBiom0cpZNH0I0KkQYOXOxbZwIS+umHn0Hhjp6RtQvJh3LSwuHgiwpgutKW6kkKa6pNrlOKA/kdMg==',key_name='tempest-keypair-1894762750',keypairs=<?>,launch_index=0,launched_at=2023-08-26T10:26:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='47abd6293c07465389c379e3b5061164',ramdisk_id='',reservation_id='r-dj280qr0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-608798758',owner_user_name='tempest-AttachVolumeNegativeTest-608798758-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T10:26:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c7cf9c8d529d49149141add20c2b2af2',uuid=d03d1626-e18b-4b15-a679-4543f7641ed7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fe6f8481-fb71-49fa-a9e7-b38adbf8e4fc", "address": "fa:16:3e:8a:47:4e", "network": {"id": "880aa066-8f77-469b-a0c4-e4e94ae31e1a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-313654920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47abd6293c07465389c379e3b5061164", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe6f8481-fb", "ovs_interfaceid": "fe6f8481-fb71-49fa-a9e7-b38adbf8e4fc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 10:29:57 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-f84ef7b3-d511-4051-aff3-3471805f1ceb tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Converting VIF {"id": "fe6f8481-fb71-49fa-a9e7-b38adbf8e4fc", "address": "fa:16:3e:8a:47:4e", "network": {"id": "880aa066-8f77-469b-a0c4-e4e94ae31e1a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-313654920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47abd6293c07465389c379e3b5061164", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe6f8481-fb", "ovs_interfaceid": "fe6f8481-fb71-49fa-a9e7-b38adbf8e4fc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:29:57 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-f84ef7b3-d511-4051-aff3-3471805f1ceb tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8a:47:4e,bridge_name='br-int',has_traffic_filtering=True,id=fe6f8481-fb71-49fa-a9e7-b38adbf8e4fc,network=Network(880aa066-8f77-469b-a0c4-e4e94ae31e1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe6f8481-fb') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:29:57 user nova-compute[73572]: DEBUG os_vif [None req-f84ef7b3-d511-4051-aff3-3471805f1ceb tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8a:47:4e,bridge_name='br-int',has_traffic_filtering=True,id=fe6f8481-fb71-49fa-a9e7-b38adbf8e4fc,network=Network(880aa066-8f77-469b-a0c4-e4e94ae31e1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe6f8481-fb') {{(pid=73572) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 10:29:57 user nova-compute[73572]: INFO nova.virt.libvirt.driver [-] [instance: 1c8e780d-0a13-4484-bf18-ac0879db263a] Instance destroyed successfully.
Aug 26 10:29:57 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:29:57 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfe6f8481-fb, bridge=br-int, if_exists=True) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:29:57 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:29:57 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:29:57 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-c94ae9c9-0b8f-4ae1-bc2d-9555452fd83a tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] [instance: 1c8e780d-0a13-4484-bf18-ac0879db263a] Attempting rescue
Aug 26 10:29:57 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-c94ae9c9-0b8f-4ae1-bc2d-9555452fd83a tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=73572) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 26 10:29:57 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:29:57 user nova-compute[73572]: INFO os_vif [None req-f84ef7b3-d511-4051-aff3-3471805f1ceb tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8a:47:4e,bridge_name='br-int',has_traffic_filtering=True,id=fe6f8481-fb71-49fa-a9e7-b38adbf8e4fc,network=Network(880aa066-8f77-469b-a0c4-e4e94ae31e1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe6f8481-fb')
Aug 26 10:29:57 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-f84ef7b3-d511-4051-aff3-3471805f1ceb tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] [instance: d03d1626-e18b-4b15-a679-4543f7641ed7] Deleting instance files /opt/stack/data/nova/instances/d03d1626-e18b-4b15-a679-4543f7641ed7_del
Aug 26 10:29:57 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-f84ef7b3-d511-4051-aff3-3471805f1ceb tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] [instance: d03d1626-e18b-4b15-a679-4543f7641ed7] Deletion of /opt/stack/data/nova/instances/d03d1626-e18b-4b15-a679-4543f7641ed7_del complete
Aug 26 10:29:57 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:29:57 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-c94ae9c9-0b8f-4ae1-bc2d-9555452fd83a tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] [instance: 1c8e780d-0a13-4484-bf18-ac0879db263a] Instance directory exists: not creating {{(pid=73572) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 26 10:29:57 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-c94ae9c9-0b8f-4ae1-bc2d-9555452fd83a tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] [instance: 1c8e780d-0a13-4484-bf18-ac0879db263a] Creating image(s)
Aug 26 10:29:57 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-c94ae9c9-0b8f-4ae1-bc2d-9555452fd83a tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Acquiring lock "/opt/stack/data/nova/instances/1c8e780d-0a13-4484-bf18-ac0879db263a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:29:57 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-c94ae9c9-0b8f-4ae1-bc2d-9555452fd83a tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Lock "/opt/stack/data/nova/instances/1c8e780d-0a13-4484-bf18-ac0879db263a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:29:57 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-c94ae9c9-0b8f-4ae1-bc2d-9555452fd83a tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Lock "/opt/stack/data/nova/instances/1c8e780d-0a13-4484-bf18-ac0879db263a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:29:57 user nova-compute[73572]: DEBUG nova.objects.instance [None req-c94ae9c9-0b8f-4ae1-bc2d-9555452fd83a tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Lazy-loading 'trusted_certs' on Instance uuid 1c8e780d-0a13-4484-bf18-ac0879db263a {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:29:57 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-c94ae9c9-0b8f-4ae1-bc2d-9555452fd83a tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Acquiring lock "2099350d6f3bcd0de9471c73862d4fe75b049801" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:29:57 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-c94ae9c9-0b8f-4ae1-bc2d-9555452fd83a tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Lock "2099350d6f3bcd0de9471c73862d4fe75b049801" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:29:57 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-c94ae9c9-0b8f-4ae1-bc2d-9555452fd83a tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:29:57 user nova-compute[73572]: INFO nova.compute.manager [None req-f84ef7b3-d511-4051-aff3-3471805f1ceb tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] [instance: d03d1626-e18b-4b15-a679-4543f7641ed7] Took 1.33 seconds to destroy the instance on the hypervisor.
Aug 26 10:29:57 user nova-compute[73572]: DEBUG oslo.service.loopingcall [None req-f84ef7b3-d511-4051-aff3-3471805f1ceb tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73572) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 10:29:57 user nova-compute[73572]: DEBUG nova.compute.manager [-] [instance: d03d1626-e18b-4b15-a679-4543f7641ed7] Deallocating network for instance {{(pid=73572) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 10:29:57 user nova-compute[73572]: DEBUG nova.network.neutron [-] [instance: d03d1626-e18b-4b15-a679-4543f7641ed7] deallocate_for_instance() {{(pid=73572) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 10:29:57 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:29:57 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:29:57 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-c94ae9c9-0b8f-4ae1-bc2d-9555452fd83a tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json" returned: 0 in 0.213s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:29:57 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-c94ae9c9-0b8f-4ae1-bc2d-9555452fd83a tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801,backing_fmt=raw /opt/stack/data/nova/instances/1c8e780d-0a13-4484-bf18-ac0879db263a/disk.rescue {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:29:57 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-c94ae9c9-0b8f-4ae1-bc2d-9555452fd83a tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801,backing_fmt=raw /opt/stack/data/nova/instances/1c8e780d-0a13-4484-bf18-ac0879db263a/disk.rescue" returned: 0 in 0.119s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:29:57 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-c94ae9c9-0b8f-4ae1-bc2d-9555452fd83a tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Lock "2099350d6f3bcd0de9471c73862d4fe75b049801" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.340s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:29:57 user nova-compute[73572]: DEBUG nova.objects.instance [None req-c94ae9c9-0b8f-4ae1-bc2d-9555452fd83a tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Lazy-loading 'migration_context' on Instance uuid 1c8e780d-0a13-4484-bf18-ac0879db263a {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:29:57 user nova-compute[73572]: DEBUG nova.objects.base [None req-c94ae9c9-0b8f-4ae1-bc2d-9555452fd83a tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Object Instance<1c8e780d-0a13-4484-bf18-ac0879db263a> lazy-loaded attributes: trusted_certs,migration_context {{(pid=73572) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 10:29:57 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-c94ae9c9-0b8f-4ae1-bc2d-9555452fd83a tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] [instance: 1c8e780d-0a13-4484-bf18-ac0879db263a] Created local disks {{(pid=73572) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 10:29:57 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-c94ae9c9-0b8f-4ae1-bc2d-9555452fd83a tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] [instance: 1c8e780d-0a13-4484-bf18-ac0879db263a] Start _get_guest_xml network_info=[{"id": "d03460b0-e0b9-4c39-a8a6-12cb80aca6bc", "address": "fa:16:3e:c2:0f:20", "network": {"id": "757e71b4-5177-45a5-8ef5-9b27f42092f1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1765327616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1765327616-network", "vif_mac": "fa:16:3e:c2:0f:20"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1bff48d66894950ac6690e1fd0e79b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd03460b0-e0", "ovs_interfaceid": "d03460b0-e0b9-4c39-a8a6-12cb80aca6bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T10:07:33Z,direct_url=<?>,disk_format='qcow2',id=299da0c9-e1c4-48f0-be55-fbe20dd06bc9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5c995f8bbbab4368b67a253e0df3971a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T10:07:34Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '299da0c9-e1c4-48f0-be55-fbe20dd06bc9', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=73572) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 10:29:57 user nova-compute[73572]: DEBUG nova.objects.instance [None req-c94ae9c9-0b8f-4ae1-bc2d-9555452fd83a tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Lazy-loading 'resources' on Instance uuid 1c8e780d-0a13-4484-bf18-ac0879db263a {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:29:57 user nova-compute[73572]: DEBUG nova.objects.base [None req-c94ae9c9-0b8f-4ae1-bc2d-9555452fd83a tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Object Instance<1c8e780d-0a13-4484-bf18-ac0879db263a> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=73572) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 10:29:57 user nova-compute[73572]: DEBUG nova.objects.instance [None req-c94ae9c9-0b8f-4ae1-bc2d-9555452fd83a tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Lazy-loading 'numa_topology' on Instance uuid 1c8e780d-0a13-4484-bf18-ac0879db263a {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:29:58 user nova-compute[73572]: DEBUG nova.objects.base [None req-c94ae9c9-0b8f-4ae1-bc2d-9555452fd83a tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Object Instance<1c8e780d-0a13-4484-bf18-ac0879db263a> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=73572) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 10:29:58 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-c94ae9c9-0b8f-4ae1-bc2d-9555452fd83a tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:29:58 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-c94ae9c9-0b8f-4ae1-bc2d-9555452fd83a tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:29:58 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-c94ae9c9-0b8f-4ae1-bc2d-9555452fd83a tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73572) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 10:29:58 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-c94ae9c9-0b8f-4ae1-bc2d-9555452fd83a tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] CPU controller missing on host. {{(pid=73572) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 10:29:58 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-c94ae9c9-0b8f-4ae1-bc2d-9555452fd83a tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73572) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 10:29:58 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-c94ae9c9-0b8f-4ae1-bc2d-9555452fd83a tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] CPU controller found on host. {{(pid=73572) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 10:29:58 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-c94ae9c9-0b8f-4ae1-bc2d-9555452fd83a tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73572) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 10:29:58 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-c94ae9c9-0b8f-4ae1-bc2d-9555452fd83a tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T10:07:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T10:07:33Z,direct_url=<?>,disk_format='qcow2',id=299da0c9-e1c4-48f0-be55-fbe20dd06bc9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5c995f8bbbab4368b67a253e0df3971a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T10:07:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 10:29:58 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-c94ae9c9-0b8f-4ae1-bc2d-9555452fd83a tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Flavor limits 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 10:29:58 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-c94ae9c9-0b8f-4ae1-bc2d-9555452fd83a tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Image limits 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 10:29:58 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-c94ae9c9-0b8f-4ae1-bc2d-9555452fd83a tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Flavor pref 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 10:29:58 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-c94ae9c9-0b8f-4ae1-bc2d-9555452fd83a tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Image pref 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 10:29:58 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-c94ae9c9-0b8f-4ae1-bc2d-9555452fd83a tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 10:29:58 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-c94ae9c9-0b8f-4ae1-bc2d-9555452fd83a tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 10:29:58 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-c94ae9c9-0b8f-4ae1-bc2d-9555452fd83a tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73572) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 10:29:58 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-c94ae9c9-0b8f-4ae1-bc2d-9555452fd83a tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Got 1 possible topologies {{(pid=73572) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 10:29:58 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-c94ae9c9-0b8f-4ae1-bc2d-9555452fd83a tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 10:29:58 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-c94ae9c9-0b8f-4ae1-bc2d-9555452fd83a tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 10:29:58 user nova-compute[73572]: DEBUG nova.objects.instance [None req-c94ae9c9-0b8f-4ae1-bc2d-9555452fd83a tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Lazy-loading 'vcpu_model' on Instance uuid 1c8e780d-0a13-4484-bf18-ac0879db263a {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:29:58 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:29:58 user nova-compute[73572]: DEBUG nova.objects.base [None req-c94ae9c9-0b8f-4ae1-bc2d-9555452fd83a tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Object Instance<1c8e780d-0a13-4484-bf18-ac0879db263a> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=73572) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 10:29:58 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-c94ae9c9-0b8f-4ae1-bc2d-9555452fd83a tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T10:27:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-821156998',display_name='tempest-ServerRescueNegativeTestJSON-server-821156998',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-821156998',id=40,image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBdJWXCpcpht4n3qLptinC08jNqNS/A7/DSoqFpXtHq2HTCyjzpcW8MUPvSYgPW74WssX1EyPCLQNLXv88U5ywgbLueToZjk8R5ItyFWItCp9yIBOnN3M8i0e9J/+MVdhA==',key_name='tempest-keypair-1014482907',keypairs=<?>,launch_index=0,launched_at=2023-08-26T10:27:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c1bff48d66894950ac6690e1fd0e79b9',ramdisk_id='',reservation_id='r-wv0dakc2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1710547876',owner_user_name='tempest-ServerRescueNegativeTestJSON-1710547876-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T10:27:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='099462c61dcc4816b17d2d0155823873',uuid=1c8e780d-0a13-4484-bf18-ac0879db263a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d03460b0-e0b9-4c39-a8a6-12cb80aca6bc", "address": "fa:16:3e:c2:0f:20", "network": {"id": "757e71b4-5177-45a5-8ef5-9b27f42092f1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1765327616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1765327616-network", "vif_mac": "fa:16:3e:c2:0f:20"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1bff48d66894950ac6690e1fd0e79b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd03460b0-e0", "ovs_interfaceid": "d03460b0-e0b9-4c39-a8a6-12cb80aca6bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73572) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 10:29:58 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-c94ae9c9-0b8f-4ae1-bc2d-9555452fd83a tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Converting VIF {"id": "d03460b0-e0b9-4c39-a8a6-12cb80aca6bc", "address": "fa:16:3e:c2:0f:20", "network": {"id": "757e71b4-5177-45a5-8ef5-9b27f42092f1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1765327616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1765327616-network", "vif_mac": "fa:16:3e:c2:0f:20"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1bff48d66894950ac6690e1fd0e79b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd03460b0-e0", "ovs_interfaceid": "d03460b0-e0b9-4c39-a8a6-12cb80aca6bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:29:58 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-c94ae9c9-0b8f-4ae1-bc2d-9555452fd83a tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c2:0f:20,bridge_name='br-int',has_traffic_filtering=True,id=d03460b0-e0b9-4c39-a8a6-12cb80aca6bc,network=Network(757e71b4-5177-45a5-8ef5-9b27f42092f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd03460b0-e0') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:29:58 user nova-compute[73572]: DEBUG nova.objects.instance [None req-c94ae9c9-0b8f-4ae1-bc2d-9555452fd83a tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Lazy-loading 'pci_devices' on Instance uuid 1c8e780d-0a13-4484-bf18-ac0879db263a {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:29:58 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:29:58 user nova-compute[73572]: DEBUG nova.objects.base [None req-c94ae9c9-0b8f-4ae1-bc2d-9555452fd83a tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Object Instance<1c8e780d-0a13-4484-bf18-ac0879db263a> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=73572) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 10:29:58 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-c94ae9c9-0b8f-4ae1-bc2d-9555452fd83a tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] [instance: 1c8e780d-0a13-4484-bf18-ac0879db263a] End _get_guest_xml xml=<domain type="kvm">
Aug 26 10:29:58 user nova-compute[73572]:   <uuid>1c8e780d-0a13-4484-bf18-ac0879db263a</uuid>
Aug 26 10:29:58 user nova-compute[73572]:   <name>instance-00000028</name>
Aug 26 10:29:58 user nova-compute[73572]:   <memory>524288</memory>
Aug 26 10:29:58 user nova-compute[73572]:   <vcpu>1</vcpu>
Aug 26 10:29:58 user nova-compute[73572]:   <metadata>
Aug 26 10:29:58 user nova-compute[73572]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 10:29:58 user nova-compute[73572]:       <nova:package version="0.0.0"/>
Aug 26 10:29:58 user nova-compute[73572]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-821156998</nova:name>
Aug 26 10:29:58 user nova-compute[73572]:       <nova:creationTime>2023-08-26 10:29:58</nova:creationTime>
Aug 26 10:29:58 user nova-compute[73572]:       <nova:flavor name="m1.tiny">
Aug 26 10:29:58 user nova-compute[73572]:         <nova:memory>512</nova:memory>
Aug 26 10:29:58 user nova-compute[73572]:         <nova:disk>1</nova:disk>
Aug 26 10:29:58 user nova-compute[73572]:         <nova:swap>0</nova:swap>
Aug 26 10:29:58 user nova-compute[73572]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 10:29:58 user nova-compute[73572]:         <nova:vcpus>1</nova:vcpus>
Aug 26 10:29:58 user nova-compute[73572]:       </nova:flavor>
Aug 26 10:29:58 user nova-compute[73572]:       <nova:owner>
Aug 26 10:29:58 user nova-compute[73572]:         <nova:user uuid="099462c61dcc4816b17d2d0155823873">tempest-ServerRescueNegativeTestJSON-1710547876-project-member</nova:user>
Aug 26 10:29:58 user nova-compute[73572]:         <nova:project uuid="c1bff48d66894950ac6690e1fd0e79b9">tempest-ServerRescueNegativeTestJSON-1710547876</nova:project>
Aug 26 10:29:58 user nova-compute[73572]:       </nova:owner>
Aug 26 10:29:58 user nova-compute[73572]:       <nova:root type="image" uuid="299da0c9-e1c4-48f0-be55-fbe20dd06bc9"/>
Aug 26 10:29:58 user nova-compute[73572]:       <nova:ports>
Aug 26 10:29:58 user nova-compute[73572]:         <nova:port uuid="d03460b0-e0b9-4c39-a8a6-12cb80aca6bc">
Aug 26 10:29:58 user nova-compute[73572]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 26 10:29:58 user nova-compute[73572]:         </nova:port>
Aug 26 10:29:58 user nova-compute[73572]:       </nova:ports>
Aug 26 10:29:58 user nova-compute[73572]:     </nova:instance>
Aug 26 10:29:58 user nova-compute[73572]:   </metadata>
Aug 26 10:29:58 user nova-compute[73572]:   <sysinfo type="smbios">
Aug 26 10:29:58 user nova-compute[73572]:     <system>
Aug 26 10:29:58 user nova-compute[73572]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 10:29:58 user nova-compute[73572]:       <entry name="product">OpenStack Nova</entry>
Aug 26 10:29:58 user nova-compute[73572]:       <entry name="version">0.0.0</entry>
Aug 26 10:29:58 user nova-compute[73572]:       <entry name="serial">1c8e780d-0a13-4484-bf18-ac0879db263a</entry>
Aug 26 10:29:58 user nova-compute[73572]:       <entry name="uuid">1c8e780d-0a13-4484-bf18-ac0879db263a</entry>
Aug 26 10:29:58 user nova-compute[73572]:       <entry name="family">Virtual Machine</entry>
Aug 26 10:29:58 user nova-compute[73572]:     </system>
Aug 26 10:29:58 user nova-compute[73572]:   </sysinfo>
Aug 26 10:29:58 user nova-compute[73572]:   <os>
Aug 26 10:29:58 user nova-compute[73572]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 10:29:58 user nova-compute[73572]:     <smbios mode="sysinfo"/>
Aug 26 10:29:58 user nova-compute[73572]:   </os>
Aug 26 10:29:58 user nova-compute[73572]:   <features>
Aug 26 10:29:58 user nova-compute[73572]:     <acpi/>
Aug 26 10:29:58 user nova-compute[73572]:     <apic/>
Aug 26 10:29:58 user nova-compute[73572]:     <vmcoreinfo/>
Aug 26 10:29:58 user nova-compute[73572]:   </features>
Aug 26 10:29:58 user nova-compute[73572]:   <clock offset="utc">
Aug 26 10:29:58 user nova-compute[73572]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 10:29:58 user nova-compute[73572]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 10:29:58 user nova-compute[73572]:     <timer name="hpet" present="no"/>
Aug 26 10:29:58 user nova-compute[73572]:   </clock>
Aug 26 10:29:58 user nova-compute[73572]:   <cpu mode="custom" match="exact">
Aug 26 10:29:58 user nova-compute[73572]:     <model>Nehalem</model>
Aug 26 10:29:58 user nova-compute[73572]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 10:29:58 user nova-compute[73572]:   </cpu>
Aug 26 10:29:58 user nova-compute[73572]:   <devices>
Aug 26 10:29:58 user nova-compute[73572]:     <disk type="file" device="disk">
Aug 26 10:29:58 user nova-compute[73572]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 10:29:58 user nova-compute[73572]:       <source file="/opt/stack/data/nova/instances/1c8e780d-0a13-4484-bf18-ac0879db263a/disk.rescue"/>
Aug 26 10:29:58 user nova-compute[73572]:       <target dev="vda" bus="virtio"/>
Aug 26 10:29:58 user nova-compute[73572]:     </disk>
Aug 26 10:29:58 user nova-compute[73572]:     <disk type="file" device="disk">
Aug 26 10:29:58 user nova-compute[73572]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 10:29:58 user nova-compute[73572]:       <source file="/opt/stack/data/nova/instances/1c8e780d-0a13-4484-bf18-ac0879db263a/disk"/>
Aug 26 10:29:58 user nova-compute[73572]:       <target dev="vdb" bus="virtio"/>
Aug 26 10:29:58 user nova-compute[73572]:     </disk>
Aug 26 10:29:58 user nova-compute[73572]:     <interface type="ethernet">
Aug 26 10:29:58 user nova-compute[73572]:       <mac address="fa:16:3e:c2:0f:20"/>
Aug 26 10:29:58 user nova-compute[73572]:       <model type="virtio"/>
Aug 26 10:29:58 user nova-compute[73572]:       <mtu size="1442"/>
Aug 26 10:29:58 user nova-compute[73572]:       <target dev="tapd03460b0-e0"/>
Aug 26 10:29:58 user nova-compute[73572]:     </interface>
Aug 26 10:29:58 user nova-compute[73572]:     <serial type="pty">
Aug 26 10:29:58 user nova-compute[73572]:       <log file="/opt/stack/data/nova/instances/1c8e780d-0a13-4484-bf18-ac0879db263a/console.log" append="off"/>
Aug 26 10:29:58 user nova-compute[73572]:     </serial>
Aug 26 10:29:58 user nova-compute[73572]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 10:29:58 user nova-compute[73572]:     <video>
Aug 26 10:29:58 user nova-compute[73572]:       <model type="virtio"/>
Aug 26 10:29:58 user nova-compute[73572]:     </video>
Aug 26 10:29:58 user nova-compute[73572]:     <rng model="virtio">
Aug 26 10:29:58 user nova-compute[73572]:       <backend model="random">/dev/urandom</backend>
Aug 26 10:29:58 user nova-compute[73572]:     </rng>
Aug 26 10:29:58 user nova-compute[73572]:     <controller type="usb" index="0" model="none"/>
Aug 26 10:29:58 user nova-compute[73572]:     <memballoon model="virtio">
Aug 26 10:29:58 user nova-compute[73572]:       <stats period="10"/>
Aug 26 10:29:58 user nova-compute[73572]:     </memballoon>
Aug 26 10:29:58 user nova-compute[73572]:   </devices>
Aug 26 10:29:58 user nova-compute[73572]: </domain>
Aug 26 10:29:58 user nova-compute[73572]:  {{(pid=73572) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 10:29:58 user nova-compute[73572]: INFO nova.virt.libvirt.driver [-] [instance: 1c8e780d-0a13-4484-bf18-ac0879db263a] Instance destroyed successfully.
Aug 26 10:29:58 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-c94ae9c9-0b8f-4ae1-bc2d-9555452fd83a tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] No BDM found with device name vda, not building metadata. {{(pid=73572) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 10:29:58 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-c94ae9c9-0b8f-4ae1-bc2d-9555452fd83a tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73572) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 10:29:58 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-c94ae9c9-0b8f-4ae1-bc2d-9555452fd83a tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] No VIF found with MAC fa:16:3e:c2:0f:20, not building metadata {{(pid=73572) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 10:29:58 user nova-compute[73572]: DEBUG nova.compute.manager [req-28bb4f9a-e5ff-49af-a66e-76230f47f6e1 req-c4cdc993-dc6f-4b27-88d5-ae93828a883d service nova] [instance: d03d1626-e18b-4b15-a679-4543f7641ed7] Received event network-vif-plugged-fe6f8481-fb71-49fa-a9e7-b38adbf8e4fc {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:29:58 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-28bb4f9a-e5ff-49af-a66e-76230f47f6e1 req-c4cdc993-dc6f-4b27-88d5-ae93828a883d service nova] Acquiring lock "d03d1626-e18b-4b15-a679-4543f7641ed7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:29:58 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-28bb4f9a-e5ff-49af-a66e-76230f47f6e1 req-c4cdc993-dc6f-4b27-88d5-ae93828a883d service nova] Lock "d03d1626-e18b-4b15-a679-4543f7641ed7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:29:58 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-28bb4f9a-e5ff-49af-a66e-76230f47f6e1 req-c4cdc993-dc6f-4b27-88d5-ae93828a883d service nova] Lock "d03d1626-e18b-4b15-a679-4543f7641ed7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:29:58 user nova-compute[73572]: DEBUG nova.compute.manager [req-28bb4f9a-e5ff-49af-a66e-76230f47f6e1 req-c4cdc993-dc6f-4b27-88d5-ae93828a883d service nova] [instance: d03d1626-e18b-4b15-a679-4543f7641ed7] No waiting events found dispatching network-vif-plugged-fe6f8481-fb71-49fa-a9e7-b38adbf8e4fc {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:29:58 user nova-compute[73572]: WARNING nova.compute.manager [req-28bb4f9a-e5ff-49af-a66e-76230f47f6e1 req-c4cdc993-dc6f-4b27-88d5-ae93828a883d service nova] [instance: d03d1626-e18b-4b15-a679-4543f7641ed7] Received unexpected event network-vif-plugged-fe6f8481-fb71-49fa-a9e7-b38adbf8e4fc for instance with vm_state active and task_state deleting.
Aug 26 10:29:59 user nova-compute[73572]: DEBUG nova.network.neutron [-] [instance: d03d1626-e18b-4b15-a679-4543f7641ed7] Updating instance_info_cache with network_info: [] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:29:59 user nova-compute[73572]: INFO nova.compute.manager [-] [instance: d03d1626-e18b-4b15-a679-4543f7641ed7] Took 1.77 seconds to deallocate network for instance.
Aug 26 10:29:59 user nova-compute[73572]: DEBUG nova.compute.manager [req-87e549e3-be98-4ed8-a48c-6fec494cacdb req-0f6c09de-fc03-4699-9dd0-cbbeafcf1e95 service nova] [instance: d03d1626-e18b-4b15-a679-4543f7641ed7] Received event network-vif-deleted-fe6f8481-fb71-49fa-a9e7-b38adbf8e4fc {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:29:59 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:29:59 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:29:59 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-f84ef7b3-d511-4051-aff3-3471805f1ceb tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:29:59 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-f84ef7b3-d511-4051-aff3-3471805f1ceb tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:29:59 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:29:59 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:29:59 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:30:00 user nova-compute[73572]: DEBUG nova.compute.provider_tree [None req-f84ef7b3-d511-4051-aff3-3471805f1ceb tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Inventory has not changed in ProviderTree for provider: e2cec974-59b2-4c77-a53d-a7f4e5a30d75 {{(pid=73572) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 10:30:00 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-f84ef7b3-d511-4051-aff3-3471805f1ceb tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Inventory has not changed for provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73572) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 10:30:00 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-f84ef7b3-d511-4051-aff3-3471805f1ceb tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.601s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:30:00 user nova-compute[73572]: INFO nova.scheduler.client.report [None req-f84ef7b3-d511-4051-aff3-3471805f1ceb tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Deleted allocations for instance d03d1626-e18b-4b15-a679-4543f7641ed7
Aug 26 10:30:00 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:30:00 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-f84ef7b3-d511-4051-aff3-3471805f1ceb tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Lock "d03d1626-e18b-4b15-a679-4543f7641ed7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.981s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:30:01 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-0e0f00ad-8cc6-4abc-a0bc-85984ccb09c4 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Acquiring lock "6b2d5f4e-37af-438c-859b-d4ca803b7d08" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:30:01 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-0e0f00ad-8cc6-4abc-a0bc-85984ccb09c4 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Lock "6b2d5f4e-37af-438c-859b-d4ca803b7d08" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:30:01 user nova-compute[73572]: INFO nova.compute.manager [None req-0e0f00ad-8cc6-4abc-a0bc-85984ccb09c4 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] [instance: 6b2d5f4e-37af-438c-859b-d4ca803b7d08] Detaching volume 8f8ad7ba-4084-4cd7-920f-8f7948de4212
Aug 26 10:30:01 user nova-compute[73572]: INFO nova.virt.block_device [None req-0e0f00ad-8cc6-4abc-a0bc-85984ccb09c4 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] [instance: 6b2d5f4e-37af-438c-859b-d4ca803b7d08] Attempting to driver detach volume 8f8ad7ba-4084-4cd7-920f-8f7948de4212 from mountpoint /dev/vdb
Aug 26 10:30:01 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-0e0f00ad-8cc6-4abc-a0bc-85984ccb09c4 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Attempting to detach device vdb from instance 6b2d5f4e-37af-438c-859b-d4ca803b7d08 from the persistent domain config. {{(pid=73572) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 10:30:01 user nova-compute[73572]: DEBUG nova.virt.libvirt.guest [None req-0e0f00ad-8cc6-4abc-a0bc-85984ccb09c4 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 10:30:01 user nova-compute[73572]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 10:30:01 user nova-compute[73572]:   <source dev="/dev/sdc"/>
Aug 26 10:30:01 user nova-compute[73572]:   <target dev="vdb" bus="virtio"/>
Aug 26 10:30:01 user nova-compute[73572]:   <serial>8f8ad7ba-4084-4cd7-920f-8f7948de4212</serial>
Aug 26 10:30:01 user nova-compute[73572]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 26 10:30:01 user nova-compute[73572]: </disk>
Aug 26 10:30:01 user nova-compute[73572]:  {{(pid=73572) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 10:30:01 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-0e0f00ad-8cc6-4abc-a0bc-85984ccb09c4 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Successfully detached device vdb from instance 6b2d5f4e-37af-438c-859b-d4ca803b7d08 from the persistent domain config.
Aug 26 10:30:01 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-0e0f00ad-8cc6-4abc-a0bc-85984ccb09c4 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 6b2d5f4e-37af-438c-859b-d4ca803b7d08 from the live domain config. {{(pid=73572) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 10:30:01 user nova-compute[73572]: DEBUG nova.virt.libvirt.guest [None req-0e0f00ad-8cc6-4abc-a0bc-85984ccb09c4 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 10:30:01 user nova-compute[73572]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 10:30:01 user nova-compute[73572]:   <source dev="/dev/sdc"/>
Aug 26 10:30:01 user nova-compute[73572]:   <target dev="vdb" bus="virtio"/>
Aug 26 10:30:01 user nova-compute[73572]:   <serial>8f8ad7ba-4084-4cd7-920f-8f7948de4212</serial>
Aug 26 10:30:01 user nova-compute[73572]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 26 10:30:01 user nova-compute[73572]: </disk>
Aug 26 10:30:01 user nova-compute[73572]:  {{(pid=73572) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 10:30:02 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Removed pending event for 1c8e780d-0a13-4484-bf18-ac0879db263a due to event {{(pid=73572) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 26 10:30:02 user nova-compute[73572]: DEBUG nova.virt.driver [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Emitting event <LifecycleEvent: 1693045802.0991168, 1c8e780d-0a13-4484-bf18-ac0879db263a => Resumed> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:30:02 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 1c8e780d-0a13-4484-bf18-ac0879db263a] VM Resumed (Lifecycle Event)
Aug 26 10:30:02 user nova-compute[73572]: DEBUG nova.compute.manager [None req-c94ae9c9-0b8f-4ae1-bc2d-9555452fd83a tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] [instance: 1c8e780d-0a13-4484-bf18-ac0879db263a] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:30:02 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-0e0f00ad-8cc6-4abc-a0bc-85984ccb09c4 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 6b2d5f4e-37af-438c-859b-d4ca803b7d08 {{(pid=73572) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 10:30:02 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 1c8e780d-0a13-4484-bf18-ac0879db263a] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:30:02 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 1c8e780d-0a13-4484-bf18-ac0879db263a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73572) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 10:30:02 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 1c8e780d-0a13-4484-bf18-ac0879db263a] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 26 10:30:02 user nova-compute[73572]: DEBUG nova.virt.driver [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Emitting event <LifecycleEvent: 1693045802.100769, 1c8e780d-0a13-4484-bf18-ac0879db263a => Started> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:30:02 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 1c8e780d-0a13-4484-bf18-ac0879db263a] VM Started (Lifecycle Event)
Aug 26 10:30:02 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 1c8e780d-0a13-4484-bf18-ac0879db263a] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:30:02 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 1c8e780d-0a13-4484-bf18-ac0879db263a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73572) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 10:30:02 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Received event <DeviceRemovedEvent: 1693045802.113278, 6b2d5f4e-37af-438c-859b-d4ca803b7d08 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73572) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 10:30:02 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-0e0f00ad-8cc6-4abc-a0bc-85984ccb09c4 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Successfully detached device vdb from instance 6b2d5f4e-37af-438c-859b-d4ca803b7d08 from the live domain config.
Aug 26 10:30:02 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0e0f00ad-8cc6-4abc-a0bc-85984ccb09c4 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] [instance: 6b2d5f4e-37af-438c-859b-d4ca803b7d08] calling os-brick to detach iSCSI Volume {{(pid=73572) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 10:30:02 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e0f00ad-8cc6-4abc-a0bc-85984ccb09c4 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc89c3d6a10>, {'target_iqns': ['iqn.2010-10.org.openstack:8f8ad7ba-4084-4cd7-920f-8f7948de4212'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IicowWqU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 10:30:02 user nova-compute[73572]: WARNING os_brick.initiator.connectors.base [None req-0e0f00ad-8cc6-4abc-a0bc-85984ccb09c4 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 10:30:02 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-0e0f00ad-8cc6-4abc-a0bc-85984ccb09c4 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 10:30:02 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-0e0f00ad-8cc6-4abc-a0bc-85984ccb09c4 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 10:30:02 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e0f00ad-8cc6-4abc-a0bc-85984ccb09c4 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8f8ad7ba-4084-4cd7-920f-8f7948de4212', 0)] {{(pid=73572) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 10:30:02 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:30:02 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.028s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:30:02 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[29f7bac6-3d21-4102-a847-e7a3c0095dcd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0b5f9f26-8454-44d8-aa18-724b5d18938e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:448cd30a-3852-471f-903f-a2e5abc34b55\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8c7946b2-965a-4156-9a34-72518f8596f0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8f8ad7ba-4084-4cd7-920f-8f7948de4212\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d8aa6fc0-ce50-4db6-8d7d-9f37eae07207\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:30:02 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:30:02 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:30:02 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b57a856-4020-432b-b331-c1061feeff76]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:448cd30a-3852-471f-903f-a2e5abc34b55 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f8ad7ba-4084-4cd7-920f-8f7948de4212 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c7946b2-965a-4156-9a34-72518f8596f0 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b5f9f26-8454-44d8-aa18-724b5d18938e (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8aa6fc0-ce50-4db6-8d7d-9f37eae07207 (non-flash)\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:30:02 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e0f00ad-8cc6-4abc-a0bc-85984ccb09c4 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)
Aug 26 10:30:02 user nova-compute[73572]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:448cd30a-3852-471f-903f-a2e5abc34b55 (non-flash)
Aug 26 10:30:02 user nova-compute[73572]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f8ad7ba-4084-4cd7-920f-8f7948de4212 (non-flash)
Aug 26 10:30:02 user nova-compute[73572]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c7946b2-965a-4156-9a34-72518f8596f0 (non-flash)
Aug 26 10:30:02 user nova-compute[73572]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b5f9f26-8454-44d8-aa18-724b5d18938e (non-flash)
Aug 26 10:30:02 user nova-compute[73572]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8aa6fc0-ce50-4db6-8d7d-9f37eae07207 (non-flash)
Aug 26 10:30:02 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 10:30:02 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e0f00ad-8cc6-4abc-a0bc-85984ccb09c4 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)
Aug 26 10:30:02 user nova-compute[73572]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:448cd30a-3852-471f-903f-a2e5abc34b55 (non-flash)
Aug 26 10:30:02 user nova-compute[73572]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f8ad7ba-4084-4cd7-920f-8f7948de4212 (non-flash)
Aug 26 10:30:02 user nova-compute[73572]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c7946b2-965a-4156-9a34-72518f8596f0 (non-flash)
Aug 26 10:30:02 user nova-compute[73572]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b5f9f26-8454-44d8-aa18-724b5d18938e (non-flash)
Aug 26 10:30:02 user nova-compute[73572]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8aa6fc0-ce50-4db6-8d7d-9f37eae07207 (non-flash)
Aug 26 10:30:02 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 10:30:02 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e0f00ad-8cc6-4abc-a0bc-85984ccb09c4 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc8cb9d80d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8f8ad7ba-4084-4cd7-920f-8f7948de4212'): ({'sdc'}, set())}) {{(pid=73572) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 10:30:02 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-0e0f00ad-8cc6-4abc-a0bc-85984ccb09c4 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Removing single pathed devices sdc {{(pid=73572) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 10:30:02 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:30:02 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:30:02 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[60087def-6724-43f5-8275-fb7ea7670479]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:30:02 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:30:02 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.027s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:30:02 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[01d50182-d18b-4cdb-bb42-dce0c459ab47]: (4, ('ok\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:30:02 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-0e0f00ad-8cc6-4abc-a0bc-85984ccb09c4 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Flushing IO for device /dev/sdc {{(pid=73572) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 10:30:02 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:30:02 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:30:02 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[90129537-ba04-4c1d-8372-8d1fa02497b0]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:30:02 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-0e0f00ad-8cc6-4abc-a0bc-85984ccb09c4 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73572) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 10:30:02 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:30:02 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.053s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:30:02 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9089b6d-cad4-4948-bf7f-0a9ce8571e8a]: (4, ('1', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:30:02 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-0e0f00ad-8cc6-4abc-a0bc-85984ccb09c4 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73572) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 10:30:02 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-0e0f00ad-8cc6-4abc-a0bc-85984ccb09c4 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] SCSI volumes sdc have been removed. {{(pid=73572) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 10:30:02 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e0f00ad-8cc6-4abc-a0bc-85984ccb09c4 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8f8ad7ba-4084-4cd7-920f-8f7948de4212')] {{(pid=73572) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 10:30:02 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f8ad7ba-4084-4cd7-920f-8f7948de4212 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:30:02 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f8ad7ba-4084-4cd7-920f-8f7948de4212 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:30:02 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f20cf77-8036-48ae-a20b-4882a17e9301]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:30:02 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e0f00ad-8cc6-4abc-a0bc-85984ccb09c4 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:30:02 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f8ad7ba-4084-4cd7-920f-8f7948de4212 -p 172.16.0.220:3260 --logout {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:30:02 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:30:02 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f8ad7ba-4084-4cd7-920f-8f7948de4212 -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:30:02 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[acf3bca2-398b-41dc-9df8-5dc9a38f4ae5]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:8f8ad7ba-4084-4cd7-920f-8f7948de4212, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:8f8ad7ba-4084-4cd7-920f-8f7948de4212, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:30:02 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e0f00ad-8cc6-4abc-a0bc-85984ccb09c4 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:8f8ad7ba-4084-4cd7-920f-8f7948de4212, portal: 172.16.0.220,3260]
Aug 26 10:30:02 user nova-compute[73572]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:8f8ad7ba-4084-4cd7-920f-8f7948de4212, portal: 172.16.0.220,3260] successful.
Aug 26 10:30:02 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:30:02 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f8ad7ba-4084-4cd7-920f-8f7948de4212 -p 172.16.0.220:3260 --op delete {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:30:02 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f8ad7ba-4084-4cd7-920f-8f7948de4212 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.047s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:30:02 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9686f22-c179-4860-9c5d-dfc346f3f51b]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:30:02 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e0f00ad-8cc6-4abc-a0bc-85984ccb09c4 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:30:02 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-0e0f00ad-8cc6-4abc-a0bc-85984ccb09c4 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.384s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 10:30:02 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e0f00ad-8cc6-4abc-a0bc-85984ccb09c4 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] <== disconnect_volume: return (387ms) None {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 10:30:02 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0e0f00ad-8cc6-4abc-a0bc-85984ccb09c4 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] [instance: 6b2d5f4e-37af-438c-859b-d4ca803b7d08] Disconnected iSCSI Volume {{(pid=73572) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 10:30:03 user nova-compute[73572]: DEBUG nova.compute.manager [req-ffaf6d52-1cb4-436a-8340-967ca298d83e req-c3cb2093-6ea3-4c14-a02c-5ce66de5f5fc service nova] [instance: 1c8e780d-0a13-4484-bf18-ac0879db263a] Received event network-vif-unplugged-d03460b0-e0b9-4c39-a8a6-12cb80aca6bc {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:30:03 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-ffaf6d52-1cb4-436a-8340-967ca298d83e req-c3cb2093-6ea3-4c14-a02c-5ce66de5f5fc service nova] Acquiring lock "1c8e780d-0a13-4484-bf18-ac0879db263a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:30:03 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-ffaf6d52-1cb4-436a-8340-967ca298d83e req-c3cb2093-6ea3-4c14-a02c-5ce66de5f5fc service nova] Lock "1c8e780d-0a13-4484-bf18-ac0879db263a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:30:03 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-ffaf6d52-1cb4-436a-8340-967ca298d83e req-c3cb2093-6ea3-4c14-a02c-5ce66de5f5fc service nova] Lock "1c8e780d-0a13-4484-bf18-ac0879db263a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:30:03 user nova-compute[73572]: DEBUG nova.compute.manager [req-ffaf6d52-1cb4-436a-8340-967ca298d83e req-c3cb2093-6ea3-4c14-a02c-5ce66de5f5fc service nova] [instance: 1c8e780d-0a13-4484-bf18-ac0879db263a] No waiting events found dispatching network-vif-unplugged-d03460b0-e0b9-4c39-a8a6-12cb80aca6bc {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:30:03 user nova-compute[73572]: WARNING nova.compute.manager [req-ffaf6d52-1cb4-436a-8340-967ca298d83e req-c3cb2093-6ea3-4c14-a02c-5ce66de5f5fc service nova] [instance: 1c8e780d-0a13-4484-bf18-ac0879db263a] Received unexpected event network-vif-unplugged-d03460b0-e0b9-4c39-a8a6-12cb80aca6bc for instance with vm_state rescued and task_state None.
Aug 26 10:30:03 user nova-compute[73572]: DEBUG nova.objects.instance [None req-0e0f00ad-8cc6-4abc-a0bc-85984ccb09c4 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Lazy-loading 'flavor' on Instance uuid 6b2d5f4e-37af-438c-859b-d4ca803b7d08 {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:30:03 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-0e0f00ad-8cc6-4abc-a0bc-85984ccb09c4 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Lock "6b2d5f4e-37af-438c-859b-d4ca803b7d08" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.610s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:30:05 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:30:05 user nova-compute[73572]: DEBUG nova.compute.manager [req-f92e975a-f59c-4f44-9964-aa84411abd63 req-4f110d10-0d64-4dca-bbf8-8fb135f5b4c2 service nova] [instance: 1c8e780d-0a13-4484-bf18-ac0879db263a] Received event network-vif-plugged-d03460b0-e0b9-4c39-a8a6-12cb80aca6bc {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:30:05 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-f92e975a-f59c-4f44-9964-aa84411abd63 req-4f110d10-0d64-4dca-bbf8-8fb135f5b4c2 service nova] Acquiring lock "1c8e780d-0a13-4484-bf18-ac0879db263a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:30:05 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-f92e975a-f59c-4f44-9964-aa84411abd63 req-4f110d10-0d64-4dca-bbf8-8fb135f5b4c2 service nova] Lock "1c8e780d-0a13-4484-bf18-ac0879db263a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:30:05 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-f92e975a-f59c-4f44-9964-aa84411abd63 req-4f110d10-0d64-4dca-bbf8-8fb135f5b4c2 service nova] Lock "1c8e780d-0a13-4484-bf18-ac0879db263a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:30:05 user nova-compute[73572]: DEBUG nova.compute.manager [req-f92e975a-f59c-4f44-9964-aa84411abd63 req-4f110d10-0d64-4dca-bbf8-8fb135f5b4c2 service nova] [instance: 1c8e780d-0a13-4484-bf18-ac0879db263a] No waiting events found dispatching network-vif-plugged-d03460b0-e0b9-4c39-a8a6-12cb80aca6bc {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:30:05 user nova-compute[73572]: WARNING nova.compute.manager [req-f92e975a-f59c-4f44-9964-aa84411abd63 req-4f110d10-0d64-4dca-bbf8-8fb135f5b4c2 service nova] [instance: 1c8e780d-0a13-4484-bf18-ac0879db263a] Received unexpected event network-vif-plugged-d03460b0-e0b9-4c39-a8a6-12cb80aca6bc for instance with vm_state rescued and task_state None.
Aug 26 10:30:05 user nova-compute[73572]: DEBUG nova.compute.manager [req-f92e975a-f59c-4f44-9964-aa84411abd63 req-4f110d10-0d64-4dca-bbf8-8fb135f5b4c2 service nova] [instance: 1c8e780d-0a13-4484-bf18-ac0879db263a] Received event network-vif-plugged-d03460b0-e0b9-4c39-a8a6-12cb80aca6bc {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:30:05 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-f92e975a-f59c-4f44-9964-aa84411abd63 req-4f110d10-0d64-4dca-bbf8-8fb135f5b4c2 service nova] Acquiring lock "1c8e780d-0a13-4484-bf18-ac0879db263a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:30:05 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-f92e975a-f59c-4f44-9964-aa84411abd63 req-4f110d10-0d64-4dca-bbf8-8fb135f5b4c2 service nova] Lock "1c8e780d-0a13-4484-bf18-ac0879db263a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:30:05 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-f92e975a-f59c-4f44-9964-aa84411abd63 req-4f110d10-0d64-4dca-bbf8-8fb135f5b4c2 service nova] Lock "1c8e780d-0a13-4484-bf18-ac0879db263a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:30:05 user nova-compute[73572]: DEBUG nova.compute.manager [req-f92e975a-f59c-4f44-9964-aa84411abd63 req-4f110d10-0d64-4dca-bbf8-8fb135f5b4c2 service nova] [instance: 1c8e780d-0a13-4484-bf18-ac0879db263a] No waiting events found dispatching network-vif-plugged-d03460b0-e0b9-4c39-a8a6-12cb80aca6bc {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:30:05 user nova-compute[73572]: WARNING nova.compute.manager [req-f92e975a-f59c-4f44-9964-aa84411abd63 req-4f110d10-0d64-4dca-bbf8-8fb135f5b4c2 service nova] [instance: 1c8e780d-0a13-4484-bf18-ac0879db263a] Received unexpected event network-vif-plugged-d03460b0-e0b9-4c39-a8a6-12cb80aca6bc for instance with vm_state rescued and task_state None.
Aug 26 10:30:05 user nova-compute[73572]: DEBUG nova.compute.manager [req-f92e975a-f59c-4f44-9964-aa84411abd63 req-4f110d10-0d64-4dca-bbf8-8fb135f5b4c2 service nova] [instance: 1c8e780d-0a13-4484-bf18-ac0879db263a] Received event network-vif-plugged-d03460b0-e0b9-4c39-a8a6-12cb80aca6bc {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:30:05 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-f92e975a-f59c-4f44-9964-aa84411abd63 req-4f110d10-0d64-4dca-bbf8-8fb135f5b4c2 service nova] Acquiring lock "1c8e780d-0a13-4484-bf18-ac0879db263a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:30:05 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-f92e975a-f59c-4f44-9964-aa84411abd63 req-4f110d10-0d64-4dca-bbf8-8fb135f5b4c2 service nova] Lock "1c8e780d-0a13-4484-bf18-ac0879db263a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:30:05 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-f92e975a-f59c-4f44-9964-aa84411abd63 req-4f110d10-0d64-4dca-bbf8-8fb135f5b4c2 service nova] Lock "1c8e780d-0a13-4484-bf18-ac0879db263a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:30:05 user nova-compute[73572]: DEBUG nova.compute.manager [req-f92e975a-f59c-4f44-9964-aa84411abd63 req-4f110d10-0d64-4dca-bbf8-8fb135f5b4c2 service nova] [instance: 1c8e780d-0a13-4484-bf18-ac0879db263a] No waiting events found dispatching network-vif-plugged-d03460b0-e0b9-4c39-a8a6-12cb80aca6bc {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:30:05 user nova-compute[73572]: WARNING nova.compute.manager [req-f92e975a-f59c-4f44-9964-aa84411abd63 req-4f110d10-0d64-4dca-bbf8-8fb135f5b4c2 service nova] [instance: 1c8e780d-0a13-4484-bf18-ac0879db263a] Received unexpected event network-vif-plugged-d03460b0-e0b9-4c39-a8a6-12cb80aca6bc for instance with vm_state rescued and task_state None.
Aug 26 10:30:05 user nova-compute[73572]: DEBUG nova.compute.manager [req-f92e975a-f59c-4f44-9964-aa84411abd63 req-4f110d10-0d64-4dca-bbf8-8fb135f5b4c2 service nova] [instance: 1c8e780d-0a13-4484-bf18-ac0879db263a] Received event network-vif-unplugged-d03460b0-e0b9-4c39-a8a6-12cb80aca6bc {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:30:05 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-f92e975a-f59c-4f44-9964-aa84411abd63 req-4f110d10-0d64-4dca-bbf8-8fb135f5b4c2 service nova] Acquiring lock "1c8e780d-0a13-4484-bf18-ac0879db263a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:30:05 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-f92e975a-f59c-4f44-9964-aa84411abd63 req-4f110d10-0d64-4dca-bbf8-8fb135f5b4c2 service nova] Lock "1c8e780d-0a13-4484-bf18-ac0879db263a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:30:05 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-f92e975a-f59c-4f44-9964-aa84411abd63 req-4f110d10-0d64-4dca-bbf8-8fb135f5b4c2 service nova] Lock "1c8e780d-0a13-4484-bf18-ac0879db263a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:30:05 user nova-compute[73572]: DEBUG nova.compute.manager [req-f92e975a-f59c-4f44-9964-aa84411abd63 req-4f110d10-0d64-4dca-bbf8-8fb135f5b4c2 service nova] [instance: 1c8e780d-0a13-4484-bf18-ac0879db263a] No waiting events found dispatching network-vif-unplugged-d03460b0-e0b9-4c39-a8a6-12cb80aca6bc {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:30:05 user nova-compute[73572]: WARNING nova.compute.manager [req-f92e975a-f59c-4f44-9964-aa84411abd63 req-4f110d10-0d64-4dca-bbf8-8fb135f5b4c2 service nova] [instance: 1c8e780d-0a13-4484-bf18-ac0879db263a] Received unexpected event network-vif-unplugged-d03460b0-e0b9-4c39-a8a6-12cb80aca6bc for instance with vm_state rescued and task_state None.
Aug 26 10:30:05 user nova-compute[73572]: DEBUG nova.compute.manager [req-f92e975a-f59c-4f44-9964-aa84411abd63 req-4f110d10-0d64-4dca-bbf8-8fb135f5b4c2 service nova] [instance: 1c8e780d-0a13-4484-bf18-ac0879db263a] Received event network-vif-plugged-d03460b0-e0b9-4c39-a8a6-12cb80aca6bc {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:30:05 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-f92e975a-f59c-4f44-9964-aa84411abd63 req-4f110d10-0d64-4dca-bbf8-8fb135f5b4c2 service nova] Acquiring lock "1c8e780d-0a13-4484-bf18-ac0879db263a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:30:05 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-f92e975a-f59c-4f44-9964-aa84411abd63 req-4f110d10-0d64-4dca-bbf8-8fb135f5b4c2 service nova] Lock "1c8e780d-0a13-4484-bf18-ac0879db263a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:30:05 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-f92e975a-f59c-4f44-9964-aa84411abd63 req-4f110d10-0d64-4dca-bbf8-8fb135f5b4c2 service nova] Lock "1c8e780d-0a13-4484-bf18-ac0879db263a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:30:05 user nova-compute[73572]: DEBUG nova.compute.manager [req-f92e975a-f59c-4f44-9964-aa84411abd63 req-4f110d10-0d64-4dca-bbf8-8fb135f5b4c2 service nova] [instance: 1c8e780d-0a13-4484-bf18-ac0879db263a] No waiting events found dispatching network-vif-plugged-d03460b0-e0b9-4c39-a8a6-12cb80aca6bc {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:30:05 user nova-compute[73572]: WARNING nova.compute.manager [req-f92e975a-f59c-4f44-9964-aa84411abd63 req-4f110d10-0d64-4dca-bbf8-8fb135f5b4c2 service nova] [instance: 1c8e780d-0a13-4484-bf18-ac0879db263a] Received unexpected event network-vif-plugged-d03460b0-e0b9-4c39-a8a6-12cb80aca6bc for instance with vm_state rescued and task_state None.
Aug 26 10:30:05 user nova-compute[73572]: DEBUG nova.compute.manager [req-f92e975a-f59c-4f44-9964-aa84411abd63 req-4f110d10-0d64-4dca-bbf8-8fb135f5b4c2 service nova] [instance: 1c8e780d-0a13-4484-bf18-ac0879db263a] Received event network-vif-plugged-d03460b0-e0b9-4c39-a8a6-12cb80aca6bc {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:30:05 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-f92e975a-f59c-4f44-9964-aa84411abd63 req-4f110d10-0d64-4dca-bbf8-8fb135f5b4c2 service nova] Acquiring lock "1c8e780d-0a13-4484-bf18-ac0879db263a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:30:05 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-f92e975a-f59c-4f44-9964-aa84411abd63 req-4f110d10-0d64-4dca-bbf8-8fb135f5b4c2 service nova] Lock "1c8e780d-0a13-4484-bf18-ac0879db263a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:30:05 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-f92e975a-f59c-4f44-9964-aa84411abd63 req-4f110d10-0d64-4dca-bbf8-8fb135f5b4c2 service nova] Lock "1c8e780d-0a13-4484-bf18-ac0879db263a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:30:05 user nova-compute[73572]: DEBUG nova.compute.manager [req-f92e975a-f59c-4f44-9964-aa84411abd63 req-4f110d10-0d64-4dca-bbf8-8fb135f5b4c2 service nova] [instance: 1c8e780d-0a13-4484-bf18-ac0879db263a] No waiting events found dispatching network-vif-plugged-d03460b0-e0b9-4c39-a8a6-12cb80aca6bc {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:30:05 user nova-compute[73572]: WARNING nova.compute.manager [req-f92e975a-f59c-4f44-9964-aa84411abd63 req-4f110d10-0d64-4dca-bbf8-8fb135f5b4c2 service nova] [instance: 1c8e780d-0a13-4484-bf18-ac0879db263a] Received unexpected event network-vif-plugged-d03460b0-e0b9-4c39-a8a6-12cb80aca6bc for instance with vm_state rescued and task_state None.
Aug 26 10:30:05 user nova-compute[73572]: DEBUG nova.compute.manager [req-f92e975a-f59c-4f44-9964-aa84411abd63 req-4f110d10-0d64-4dca-bbf8-8fb135f5b4c2 service nova] [instance: 1c8e780d-0a13-4484-bf18-ac0879db263a] Received event network-vif-plugged-d03460b0-e0b9-4c39-a8a6-12cb80aca6bc {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:30:05 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-f92e975a-f59c-4f44-9964-aa84411abd63 req-4f110d10-0d64-4dca-bbf8-8fb135f5b4c2 service nova] Acquiring lock "1c8e780d-0a13-4484-bf18-ac0879db263a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:30:05 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-f92e975a-f59c-4f44-9964-aa84411abd63 req-4f110d10-0d64-4dca-bbf8-8fb135f5b4c2 service nova] Lock "1c8e780d-0a13-4484-bf18-ac0879db263a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:30:05 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-f92e975a-f59c-4f44-9964-aa84411abd63 req-4f110d10-0d64-4dca-bbf8-8fb135f5b4c2 service nova] Lock "1c8e780d-0a13-4484-bf18-ac0879db263a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:30:05 user nova-compute[73572]: DEBUG nova.compute.manager [req-f92e975a-f59c-4f44-9964-aa84411abd63 req-4f110d10-0d64-4dca-bbf8-8fb135f5b4c2 service nova] [instance: 1c8e780d-0a13-4484-bf18-ac0879db263a] No waiting events found dispatching network-vif-plugged-d03460b0-e0b9-4c39-a8a6-12cb80aca6bc {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:30:05 user nova-compute[73572]: WARNING nova.compute.manager [req-f92e975a-f59c-4f44-9964-aa84411abd63 req-4f110d10-0d64-4dca-bbf8-8fb135f5b4c2 service nova] [instance: 1c8e780d-0a13-4484-bf18-ac0879db263a] Received unexpected event network-vif-plugged-d03460b0-e0b9-4c39-a8a6-12cb80aca6bc for instance with vm_state rescued and task_state None.
Aug 26 10:30:07 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:30:10 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:30:11 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-f6e19c3a-7a83-45da-8ba6-2a2584e05951 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Acquiring lock "e468b473-515f-41ad-a75c-65d4c6d575c8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:30:11 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-f6e19c3a-7a83-45da-8ba6-2a2584e05951 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Lock "e468b473-515f-41ad-a75c-65d4c6d575c8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:30:11 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-f6e19c3a-7a83-45da-8ba6-2a2584e05951 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Acquiring lock "e468b473-515f-41ad-a75c-65d4c6d575c8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:30:11 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-f6e19c3a-7a83-45da-8ba6-2a2584e05951 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Lock "e468b473-515f-41ad-a75c-65d4c6d575c8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:30:11 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-f6e19c3a-7a83-45da-8ba6-2a2584e05951 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Lock "e468b473-515f-41ad-a75c-65d4c6d575c8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:30:11 user nova-compute[73572]: INFO nova.compute.manager [None req-f6e19c3a-7a83-45da-8ba6-2a2584e05951 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: e468b473-515f-41ad-a75c-65d4c6d575c8] Terminating instance
Aug 26 10:30:11 user nova-compute[73572]: DEBUG nova.compute.manager [None req-f6e19c3a-7a83-45da-8ba6-2a2584e05951 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: e468b473-515f-41ad-a75c-65d4c6d575c8] Start destroying the instance on the hypervisor. {{(pid=73572) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 10:30:11 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:30:11 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:30:12 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-6dd928ce-b70a-4c41-a0c3-178b88ecdc9d tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] Acquiring lock "3a4c9522-9723-4ad4-8630-17a3aba70c98" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:30:12 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-6dd928ce-b70a-4c41-a0c3-178b88ecdc9d tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] Lock "3a4c9522-9723-4ad4-8630-17a3aba70c98" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:30:12 user nova-compute[73572]: DEBUG nova.compute.manager [None req-6dd928ce-b70a-4c41-a0c3-178b88ecdc9d tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] [instance: 3a4c9522-9723-4ad4-8630-17a3aba70c98] Starting instance... {{(pid=73572) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 10:30:12 user nova-compute[73572]: DEBUG nova.compute.manager [req-0c60c116-7c59-4f36-adc4-6f94ce6ed08a req-8a882f86-5cee-4fec-8740-eb3401547cc7 service nova] [instance: e468b473-515f-41ad-a75c-65d4c6d575c8] Received event network-vif-unplugged-fa77d8f8-b250-421f-a410-34f61a42bd83 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:30:12 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-0c60c116-7c59-4f36-adc4-6f94ce6ed08a req-8a882f86-5cee-4fec-8740-eb3401547cc7 service nova] Acquiring lock "e468b473-515f-41ad-a75c-65d4c6d575c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:30:12 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-0c60c116-7c59-4f36-adc4-6f94ce6ed08a req-8a882f86-5cee-4fec-8740-eb3401547cc7 service nova] Lock "e468b473-515f-41ad-a75c-65d4c6d575c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:30:12 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-0c60c116-7c59-4f36-adc4-6f94ce6ed08a req-8a882f86-5cee-4fec-8740-eb3401547cc7 service nova] Lock "e468b473-515f-41ad-a75c-65d4c6d575c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:30:12 user nova-compute[73572]: DEBUG nova.compute.manager [req-0c60c116-7c59-4f36-adc4-6f94ce6ed08a req-8a882f86-5cee-4fec-8740-eb3401547cc7 service nova] [instance: e468b473-515f-41ad-a75c-65d4c6d575c8] No waiting events found dispatching network-vif-unplugged-fa77d8f8-b250-421f-a410-34f61a42bd83 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:30:12 user nova-compute[73572]: DEBUG nova.compute.manager [req-0c60c116-7c59-4f36-adc4-6f94ce6ed08a req-8a882f86-5cee-4fec-8740-eb3401547cc7 service nova] [instance: e468b473-515f-41ad-a75c-65d4c6d575c8] Received event network-vif-unplugged-fa77d8f8-b250-421f-a410-34f61a42bd83 for instance with task_state deleting. {{(pid=73572) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 10:30:12 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:30:12 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:30:12 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-6dd928ce-b70a-4c41-a0c3-178b88ecdc9d tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:30:12 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-6dd928ce-b70a-4c41-a0c3-178b88ecdc9d tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:30:12 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-6dd928ce-b70a-4c41-a0c3-178b88ecdc9d tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73572) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 10:30:12 user nova-compute[73572]: INFO nova.compute.claims [None req-6dd928ce-b70a-4c41-a0c3-178b88ecdc9d tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] [instance: 3a4c9522-9723-4ad4-8630-17a3aba70c98] Claim successful on node user
Aug 26 10:30:12 user nova-compute[73572]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693045797.3974648, d03d1626-e18b-4b15-a679-4543f7641ed7 => Stopped> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:30:12 user nova-compute[73572]: INFO nova.compute.manager [-] [instance: d03d1626-e18b-4b15-a679-4543f7641ed7] VM Stopped (Lifecycle Event)
Aug 26 10:30:12 user nova-compute[73572]: DEBUG nova.compute.manager [None req-3f47233c-d5b9-4f51-8529-327800bafaa0 None None] [instance: d03d1626-e18b-4b15-a679-4543f7641ed7] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:30:12 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:30:12 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:30:12 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:30:12 user nova-compute[73572]: INFO nova.virt.libvirt.driver [-] [instance: e468b473-515f-41ad-a75c-65d4c6d575c8] Instance destroyed successfully.
Aug 26 10:30:12 user nova-compute[73572]: DEBUG nova.objects.instance [None req-f6e19c3a-7a83-45da-8ba6-2a2584e05951 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Lazy-loading 'resources' on Instance uuid e468b473-515f-41ad-a75c-65d4c6d575c8 {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:30:12 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-f6e19c3a-7a83-45da-8ba6-2a2584e05951 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T10:20:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-33222',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-33222',id=28,image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T10:20:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4636f93c5bfc4653804de097aed2882c',ramdisk_id='',reservation_id='r-256xrr5s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-665602868',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T10:22:47Z,user_data=None,user_id='07f3538038a14713af3bbe420f1fb03a',uuid=e468b473-515f-41ad-a75c-65d4c6d575c8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fa77d8f8-b250-421f-a410-34f61a42bd83", "address": "fa:16:3e:29:89:56", "network": {"id": "991b9dff-5173-4456-a530-b1f7eb5cfa4a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1845930297-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4636f93c5bfc4653804de097aed2882c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa77d8f8-b2", "ovs_interfaceid": "fa77d8f8-b250-421f-a410-34f61a42bd83", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 10:30:12 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-f6e19c3a-7a83-45da-8ba6-2a2584e05951 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Converting VIF {"id": "fa77d8f8-b250-421f-a410-34f61a42bd83", "address": "fa:16:3e:29:89:56", "network": {"id": "991b9dff-5173-4456-a530-b1f7eb5cfa4a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1845930297-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4636f93c5bfc4653804de097aed2882c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa77d8f8-b2", "ovs_interfaceid": "fa77d8f8-b250-421f-a410-34f61a42bd83", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:30:12 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-f6e19c3a-7a83-45da-8ba6-2a2584e05951 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:29:89:56,bridge_name='br-int',has_traffic_filtering=True,id=fa77d8f8-b250-421f-a410-34f61a42bd83,network=Network(991b9dff-5173-4456-a530-b1f7eb5cfa4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa77d8f8-b2') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:30:12 user nova-compute[73572]: DEBUG os_vif [None req-f6e19c3a-7a83-45da-8ba6-2a2584e05951 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:29:89:56,bridge_name='br-int',has_traffic_filtering=True,id=fa77d8f8-b250-421f-a410-34f61a42bd83,network=Network(991b9dff-5173-4456-a530-b1f7eb5cfa4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa77d8f8-b2') {{(pid=73572) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 10:30:12 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:30:12 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfa77d8f8-b2, bridge=br-int, if_exists=True) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:30:12 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:30:12 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:30:12 user nova-compute[73572]: INFO os_vif [None req-f6e19c3a-7a83-45da-8ba6-2a2584e05951 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:29:89:56,bridge_name='br-int',has_traffic_filtering=True,id=fa77d8f8-b250-421f-a410-34f61a42bd83,network=Network(991b9dff-5173-4456-a530-b1f7eb5cfa4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa77d8f8-b2')
Aug 26 10:30:12 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-f6e19c3a-7a83-45da-8ba6-2a2584e05951 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: e468b473-515f-41ad-a75c-65d4c6d575c8] Deleting instance files /opt/stack/data/nova/instances/e468b473-515f-41ad-a75c-65d4c6d575c8_del
Aug 26 10:30:12 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-f6e19c3a-7a83-45da-8ba6-2a2584e05951 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: e468b473-515f-41ad-a75c-65d4c6d575c8] Deletion of /opt/stack/data/nova/instances/e468b473-515f-41ad-a75c-65d4c6d575c8_del complete
Aug 26 10:30:12 user nova-compute[73572]: INFO nova.compute.manager [None req-f6e19c3a-7a83-45da-8ba6-2a2584e05951 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: e468b473-515f-41ad-a75c-65d4c6d575c8] Took 0.93 seconds to destroy the instance on the hypervisor.
Aug 26 10:30:12 user nova-compute[73572]: DEBUG oslo.service.loopingcall [None req-f6e19c3a-7a83-45da-8ba6-2a2584e05951 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73572) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 10:30:12 user nova-compute[73572]: DEBUG nova.compute.manager [-] [instance: e468b473-515f-41ad-a75c-65d4c6d575c8] Deallocating network for instance {{(pid=73572) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 10:30:12 user nova-compute[73572]: DEBUG nova.network.neutron [-] [instance: e468b473-515f-41ad-a75c-65d4c6d575c8] deallocate_for_instance() {{(pid=73572) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 10:30:12 user nova-compute[73572]: DEBUG nova.compute.provider_tree [None req-6dd928ce-b70a-4c41-a0c3-178b88ecdc9d tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] Inventory has not changed in ProviderTree for provider: e2cec974-59b2-4c77-a53d-a7f4e5a30d75 {{(pid=73572) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 10:30:12 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-6dd928ce-b70a-4c41-a0c3-178b88ecdc9d tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] Inventory has not changed for provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73572) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 10:30:12 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-6dd928ce-b70a-4c41-a0c3-178b88ecdc9d tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.621s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:30:12 user nova-compute[73572]: DEBUG nova.compute.manager [None req-6dd928ce-b70a-4c41-a0c3-178b88ecdc9d tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] [instance: 3a4c9522-9723-4ad4-8630-17a3aba70c98] Start building networks asynchronously for instance. {{(pid=73572) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 10:30:12 user nova-compute[73572]: DEBUG nova.compute.manager [None req-6dd928ce-b70a-4c41-a0c3-178b88ecdc9d tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] [instance: 3a4c9522-9723-4ad4-8630-17a3aba70c98] Allocating IP information in the background. {{(pid=73572) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 10:30:12 user nova-compute[73572]: DEBUG nova.network.neutron [None req-6dd928ce-b70a-4c41-a0c3-178b88ecdc9d tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] [instance: 3a4c9522-9723-4ad4-8630-17a3aba70c98] allocate_for_instance() {{(pid=73572) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 10:30:13 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-6dd928ce-b70a-4c41-a0c3-178b88ecdc9d tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] [instance: 3a4c9522-9723-4ad4-8630-17a3aba70c98] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 10:30:13 user nova-compute[73572]: DEBUG nova.compute.manager [None req-6dd928ce-b70a-4c41-a0c3-178b88ecdc9d tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] [instance: 3a4c9522-9723-4ad4-8630-17a3aba70c98] Start building block device mappings for instance. {{(pid=73572) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 10:30:13 user nova-compute[73572]: DEBUG nova.policy [None req-6dd928ce-b70a-4c41-a0c3-178b88ecdc9d tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6d0074f39a8141119bd94ffa83bd80aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51eaa92831e54ba6bd3d71db1a4e24e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73572) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 10:30:13 user nova-compute[73572]: INFO nova.virt.block_device [None req-6dd928ce-b70a-4c41-a0c3-178b88ecdc9d tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] [instance: 3a4c9522-9723-4ad4-8630-17a3aba70c98] Booting with volume ec96ec24-bf73-4f38-ac9f-eb2699d0a661 at /dev/vda
Aug 26 10:30:13 user nova-compute[73572]: DEBUG os_brick.utils [None req-6dd928ce-b70a-4c41-a0c3-178b88ecdc9d tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 10:30:13 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:30:13 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:30:13 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[61ad5be3-cbf4-4d79-8ae5-59e170e0e05e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:de8a79ed912\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:30:13 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:30:13 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:30:13 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[03b655c8-aff5-42aa-9c65-db1225fb87ec]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:30:13 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:30:13 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:30:13 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[d19dd89e-25b3-47ea-a7b8-3669879eb9eb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:30:13 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff8d787d-6907-4fdc-9b2e-ed7a7fb0424a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:30:13 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-6dd928ce-b70a-4c41-a0c3-178b88ecdc9d tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] Running cmd (subprocess): nvme version {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:30:13 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-6dd928ce-b70a-4c41-a0c3-178b88ecdc9d tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] 'nvme version' failed. Not Retrying. {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 10:30:13 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6dd928ce-b70a-4c41-a0c3-178b88ecdc9d tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] nvme not present on system {{(pid=73572) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 10:30:13 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:30:13 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 10:30:13 user nova-compute[73572]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 10:30:13 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fd21ce4-48f0-40d7-91d4-d7ba8a24e956]: (4, '') {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:30:13 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.lightos [None req-6dd928ce-b70a-4c41-a0c3-178b88ecdc9d tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73572) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 10:30:13 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.lightos [None req-6dd928ce-b70a-4c41-a0c3-178b88ecdc9d tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73572) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 10:30:13 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.lightos [None req-6dd928ce-b70a-4c41-a0c3-178b88ecdc9d tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] LIGHTOS: no hostnqn found. {{(pid=73572) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 10:30:13 user nova-compute[73572]: DEBUG os_brick.utils [None req-6dd928ce-b70a-4c41-a0c3-178b88ecdc9d tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] <== get_connector_properties: return (148ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:de8a79ed912', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 10:30:13 user nova-compute[73572]: DEBUG nova.virt.block_device [None req-6dd928ce-b70a-4c41-a0c3-178b88ecdc9d tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] [instance: 3a4c9522-9723-4ad4-8630-17a3aba70c98] Updating existing volume attachment record: c30761ca-2089-4a7e-aa70-c70e8929117a {{(pid=73572) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 10:30:13 user nova-compute[73572]: DEBUG nova.network.neutron [-] [instance: e468b473-515f-41ad-a75c-65d4c6d575c8] Updating instance_info_cache with network_info: [] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:30:13 user nova-compute[73572]: INFO nova.compute.manager [-] [instance: e468b473-515f-41ad-a75c-65d4c6d575c8] Took 0.69 seconds to deallocate network for instance.
Aug 26 10:30:13 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-f6e19c3a-7a83-45da-8ba6-2a2584e05951 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:30:13 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-f6e19c3a-7a83-45da-8ba6-2a2584e05951 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:30:13 user nova-compute[73572]: DEBUG nova.compute.provider_tree [None req-f6e19c3a-7a83-45da-8ba6-2a2584e05951 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Inventory has not changed in ProviderTree for provider: e2cec974-59b2-4c77-a53d-a7f4e5a30d75 {{(pid=73572) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 10:30:13 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-f6e19c3a-7a83-45da-8ba6-2a2584e05951 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Inventory has not changed for provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73572) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 10:30:13 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-f6e19c3a-7a83-45da-8ba6-2a2584e05951 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.457s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:30:14 user nova-compute[73572]: INFO nova.scheduler.client.report [None req-f6e19c3a-7a83-45da-8ba6-2a2584e05951 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Deleted allocations for instance e468b473-515f-41ad-a75c-65d4c6d575c8
Aug 26 10:30:14 user nova-compute[73572]: DEBUG nova.network.neutron [None req-6dd928ce-b70a-4c41-a0c3-178b88ecdc9d tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] [instance: 3a4c9522-9723-4ad4-8630-17a3aba70c98] Successfully created port: 663db499-c552-478e-bad7-938b2f65c619 {{(pid=73572) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 10:30:14 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-f6e19c3a-7a83-45da-8ba6-2a2584e05951 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Lock "e468b473-515f-41ad-a75c-65d4c6d575c8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.358s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:30:14 user nova-compute[73572]: DEBUG nova.compute.manager [req-2c625a62-b740-4a37-9226-a0112a2ab6a7 req-9f0e52d7-f117-4a1f-8b5a-11e3b9b6e683 service nova] [instance: e468b473-515f-41ad-a75c-65d4c6d575c8] Received event network-vif-plugged-fa77d8f8-b250-421f-a410-34f61a42bd83 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:30:14 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-2c625a62-b740-4a37-9226-a0112a2ab6a7 req-9f0e52d7-f117-4a1f-8b5a-11e3b9b6e683 service nova] Acquiring lock "e468b473-515f-41ad-a75c-65d4c6d575c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:30:14 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-2c625a62-b740-4a37-9226-a0112a2ab6a7 req-9f0e52d7-f117-4a1f-8b5a-11e3b9b6e683 service nova] Lock "e468b473-515f-41ad-a75c-65d4c6d575c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:30:14 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-2c625a62-b740-4a37-9226-a0112a2ab6a7 req-9f0e52d7-f117-4a1f-8b5a-11e3b9b6e683 service nova] Lock "e468b473-515f-41ad-a75c-65d4c6d575c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:30:14 user nova-compute[73572]: DEBUG nova.compute.manager [req-2c625a62-b740-4a37-9226-a0112a2ab6a7 req-9f0e52d7-f117-4a1f-8b5a-11e3b9b6e683 service nova] [instance: e468b473-515f-41ad-a75c-65d4c6d575c8] No waiting events found dispatching network-vif-plugged-fa77d8f8-b250-421f-a410-34f61a42bd83 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:30:14 user nova-compute[73572]: WARNING nova.compute.manager [req-2c625a62-b740-4a37-9226-a0112a2ab6a7 req-9f0e52d7-f117-4a1f-8b5a-11e3b9b6e683 service nova] [instance: e468b473-515f-41ad-a75c-65d4c6d575c8] Received unexpected event network-vif-plugged-fa77d8f8-b250-421f-a410-34f61a42bd83 for instance with vm_state deleted and task_state None.
Aug 26 10:30:14 user nova-compute[73572]: DEBUG nova.compute.manager [req-2c625a62-b740-4a37-9226-a0112a2ab6a7 req-9f0e52d7-f117-4a1f-8b5a-11e3b9b6e683 service nova] [instance: e468b473-515f-41ad-a75c-65d4c6d575c8] Received event network-vif-deleted-fa77d8f8-b250-421f-a410-34f61a42bd83 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:30:14 user nova-compute[73572]: DEBUG nova.network.neutron [None req-6dd928ce-b70a-4c41-a0c3-178b88ecdc9d tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] [instance: 3a4c9522-9723-4ad4-8630-17a3aba70c98] Successfully updated port: 663db499-c552-478e-bad7-938b2f65c619 {{(pid=73572) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 10:30:14 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-6dd928ce-b70a-4c41-a0c3-178b88ecdc9d tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] Acquiring lock "refresh_cache-3a4c9522-9723-4ad4-8630-17a3aba70c98" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:30:14 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-6dd928ce-b70a-4c41-a0c3-178b88ecdc9d tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] Acquired lock "refresh_cache-3a4c9522-9723-4ad4-8630-17a3aba70c98" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:30:14 user nova-compute[73572]: DEBUG nova.network.neutron [None req-6dd928ce-b70a-4c41-a0c3-178b88ecdc9d tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] [instance: 3a4c9522-9723-4ad4-8630-17a3aba70c98] Building network info cache for instance {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 10:30:14 user nova-compute[73572]: DEBUG nova.compute.manager [req-c012157b-e00d-4400-b6f9-a5597983d772 req-38cd0ca0-b307-4993-96f7-c2fbc677c338 service nova] [instance: 3a4c9522-9723-4ad4-8630-17a3aba70c98] Received event network-changed-663db499-c552-478e-bad7-938b2f65c619 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:30:14 user nova-compute[73572]: DEBUG nova.compute.manager [req-c012157b-e00d-4400-b6f9-a5597983d772 req-38cd0ca0-b307-4993-96f7-c2fbc677c338 service nova] [instance: 3a4c9522-9723-4ad4-8630-17a3aba70c98] Refreshing instance network info cache due to event network-changed-663db499-c552-478e-bad7-938b2f65c619. {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 10:30:14 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-c012157b-e00d-4400-b6f9-a5597983d772 req-38cd0ca0-b307-4993-96f7-c2fbc677c338 service nova] Acquiring lock "refresh_cache-3a4c9522-9723-4ad4-8630-17a3aba70c98" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:30:14 user nova-compute[73572]: DEBUG nova.network.neutron [None req-6dd928ce-b70a-4c41-a0c3-178b88ecdc9d tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] [instance: 3a4c9522-9723-4ad4-8630-17a3aba70c98] Instance cache missing network info. {{(pid=73572) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 10:30:15 user nova-compute[73572]: DEBUG nova.network.neutron [None req-6dd928ce-b70a-4c41-a0c3-178b88ecdc9d tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] [instance: 3a4c9522-9723-4ad4-8630-17a3aba70c98] Updating instance_info_cache with network_info: [{"id": "663db499-c552-478e-bad7-938b2f65c619", "address": "fa:16:3e:fd:54:35", "network": {"id": "6bec7255-9e3a-43e3-aaf3-913e171ee99d", "bridge": "br-int", "label": "tempest-TestShelveInstance-1279582697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51eaa92831e54ba6bd3d71db1a4e24e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap663db499-c5", "ovs_interfaceid": "663db499-c552-478e-bad7-938b2f65c619", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:30:15 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-6dd928ce-b70a-4c41-a0c3-178b88ecdc9d tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] Releasing lock "refresh_cache-3a4c9522-9723-4ad4-8630-17a3aba70c98" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:30:15 user nova-compute[73572]: DEBUG nova.compute.manager [None req-6dd928ce-b70a-4c41-a0c3-178b88ecdc9d tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] [instance: 3a4c9522-9723-4ad4-8630-17a3aba70c98] Instance network_info: |[{"id": "663db499-c552-478e-bad7-938b2f65c619", "address": "fa:16:3e:fd:54:35", "network": {"id": "6bec7255-9e3a-43e3-aaf3-913e171ee99d", "bridge": "br-int", "label": "tempest-TestShelveInstance-1279582697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51eaa92831e54ba6bd3d71db1a4e24e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap663db499-c5", "ovs_interfaceid": "663db499-c552-478e-bad7-938b2f65c619", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73572) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 10:30:15 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-c012157b-e00d-4400-b6f9-a5597983d772 req-38cd0ca0-b307-4993-96f7-c2fbc677c338 service nova] Acquired lock "refresh_cache-3a4c9522-9723-4ad4-8630-17a3aba70c98" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:30:15 user nova-compute[73572]: DEBUG nova.network.neutron [req-c012157b-e00d-4400-b6f9-a5597983d772 req-38cd0ca0-b307-4993-96f7-c2fbc677c338 service nova] [instance: 3a4c9522-9723-4ad4-8630-17a3aba70c98] Refreshing network info cache for port 663db499-c552-478e-bad7-938b2f65c619 {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 10:30:15 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:30:15 user nova-compute[73572]: DEBUG nova.network.neutron [req-c012157b-e00d-4400-b6f9-a5597983d772 req-38cd0ca0-b307-4993-96f7-c2fbc677c338 service nova] [instance: 3a4c9522-9723-4ad4-8630-17a3aba70c98] Updated VIF entry in instance network info cache for port 663db499-c552-478e-bad7-938b2f65c619. {{(pid=73572) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 10:30:15 user nova-compute[73572]: DEBUG nova.network.neutron [req-c012157b-e00d-4400-b6f9-a5597983d772 req-38cd0ca0-b307-4993-96f7-c2fbc677c338 service nova] [instance: 3a4c9522-9723-4ad4-8630-17a3aba70c98] Updating instance_info_cache with network_info: [{"id": "663db499-c552-478e-bad7-938b2f65c619", "address": "fa:16:3e:fd:54:35", "network": {"id": "6bec7255-9e3a-43e3-aaf3-913e171ee99d", "bridge": "br-int", "label": "tempest-TestShelveInstance-1279582697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51eaa92831e54ba6bd3d71db1a4e24e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap663db499-c5", "ovs_interfaceid": "663db499-c552-478e-bad7-938b2f65c619", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:30:15 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-c012157b-e00d-4400-b6f9-a5597983d772 req-38cd0ca0-b307-4993-96f7-c2fbc677c338 service nova] Releasing lock "refresh_cache-3a4c9522-9723-4ad4-8630-17a3aba70c98" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:30:17 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:30:18 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:30:18 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Starting heal instance info cache {{(pid=73572) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 10:30:18 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquiring lock "refresh_cache-68613b1e-c45c-4fd9-834c-3630ed0f456a" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:30:18 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquired lock "refresh_cache-68613b1e-c45c-4fd9-834c-3630ed0f456a" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:30:18 user nova-compute[73572]: DEBUG nova.network.neutron [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] [instance: 68613b1e-c45c-4fd9-834c-3630ed0f456a] Forcefully refreshing network info cache for instance {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 10:30:19 user nova-compute[73572]: DEBUG nova.network.neutron [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] [instance: 68613b1e-c45c-4fd9-834c-3630ed0f456a] Updating instance_info_cache with network_info: [{"id": "aa5ef0b6-0379-4e59-a2c7-e7f1ecd3c7cb", "address": "fa:16:3e:30:8b:7a", "network": {"id": "43215883-3d00-4be7-8c40-bdaf3f01bef9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1088544153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7935bccc360b46b589fd57d53f334595", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa5ef0b6-03", "ovs_interfaceid": "aa5ef0b6-0379-4e59-a2c7-e7f1ecd3c7cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:30:19 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Releasing lock "refresh_cache-68613b1e-c45c-4fd9-834c-3630ed0f456a" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:30:19 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] [instance: 68613b1e-c45c-4fd9-834c-3630ed0f456a] Updated the network info_cache for instance {{(pid=73572) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 10:30:20 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:30:21 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:30:22 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:30:22 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:30:22 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:30:22 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73572) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 10:30:24 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:30:25 user nova-compute[73572]: DEBUG nova.compute.manager [None req-6dd928ce-b70a-4c41-a0c3-178b88ecdc9d tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] [instance: 3a4c9522-9723-4ad4-8630-17a3aba70c98] Start spawning the instance on the hypervisor. {{(pid=73572) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 10:30:25 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-6dd928ce-b70a-4c41-a0c3-178b88ecdc9d tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] [instance: 3a4c9522-9723-4ad4-8630-17a3aba70c98] Creating instance directory {{(pid=73572) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 10:30:25 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-6dd928ce-b70a-4c41-a0c3-178b88ecdc9d tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] [instance: 3a4c9522-9723-4ad4-8630-17a3aba70c98] Creating image(s)
Aug 26 10:30:25 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-6dd928ce-b70a-4c41-a0c3-178b88ecdc9d tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] [instance: 3a4c9522-9723-4ad4-8630-17a3aba70c98] Did not create local disks {{(pid=73572) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 26 10:30:25 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-6dd928ce-b70a-4c41-a0c3-178b88ecdc9d tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] [instance: 3a4c9522-9723-4ad4-8630-17a3aba70c98] Ensure instance console log exists: /opt/stack/data/nova/instances/3a4c9522-9723-4ad4-8630-17a3aba70c98/console.log {{(pid=73572) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 10:30:25 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-6dd928ce-b70a-4c41-a0c3-178b88ecdc9d tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:30:25 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-6dd928ce-b70a-4c41-a0c3-178b88ecdc9d tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:30:25 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-6dd928ce-b70a-4c41-a0c3-178b88ecdc9d tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:30:25 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-6dd928ce-b70a-4c41-a0c3-178b88ecdc9d tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] [instance: 3a4c9522-9723-4ad4-8630-17a3aba70c98] Start _get_guest_xml network_info=[{"id": "663db499-c552-478e-bad7-938b2f65c619", "address": "fa:16:3e:fd:54:35", "network": {"id": "6bec7255-9e3a-43e3-aaf3-913e171ee99d", "bridge": "br-int", "label": "tempest-TestShelveInstance-1279582697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51eaa92831e54ba6bd3d71db1a4e24e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap663db499-c5", "ovs_interfaceid": "663db499-c552-478e-bad7-938b2f65c619", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'disk_bus': 'virtio', 'boot_index': 0, 'mount_device': '/dev/vda', 'attachment_id': 'c30761ca-2089-4a7e-aa70-c70e8929117a', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:ec96ec24-bf73-4f38-ac9f-eb2699d0a661'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tqbEgzCT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '3a4c9522-9723-4ad4-8630-17a3aba70c98', 'attached_at': '', 'detached_at': '', 'volume_id': 'ec96ec24-bf73-4f38-ac9f-eb2699d0a661', 'serial': 'ec96ec24-bf73-4f38-ac9f-eb2699d0a661'}, 'guest_format': None, 'device_type': 'disk', 'volume_type': None} {{(pid=73572) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 10:30:25 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-6dd928ce-b70a-4c41-a0c3-178b88ecdc9d tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:30:25 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-6dd928ce-b70a-4c41-a0c3-178b88ecdc9d tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:30:25 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-6dd928ce-b70a-4c41-a0c3-178b88ecdc9d tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73572) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 10:30:25 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-6dd928ce-b70a-4c41-a0c3-178b88ecdc9d tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] CPU controller missing on host. {{(pid=73572) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 10:30:25 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-6dd928ce-b70a-4c41-a0c3-178b88ecdc9d tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73572) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 10:30:25 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-6dd928ce-b70a-4c41-a0c3-178b88ecdc9d tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] CPU controller found on host. {{(pid=73572) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 10:30:25 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-6dd928ce-b70a-4c41-a0c3-178b88ecdc9d tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73572) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 10:30:25 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-6dd928ce-b70a-4c41-a0c3-178b88ecdc9d tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T10:07:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 10:30:25 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-6dd928ce-b70a-4c41-a0c3-178b88ecdc9d tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] Flavor limits 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 10:30:25 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-6dd928ce-b70a-4c41-a0c3-178b88ecdc9d tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] Image limits 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 10:30:25 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-6dd928ce-b70a-4c41-a0c3-178b88ecdc9d tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] Flavor pref 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 10:30:25 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-6dd928ce-b70a-4c41-a0c3-178b88ecdc9d tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] Image pref 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 10:30:25 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-6dd928ce-b70a-4c41-a0c3-178b88ecdc9d tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 10:30:25 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-6dd928ce-b70a-4c41-a0c3-178b88ecdc9d tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 10:30:25 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-6dd928ce-b70a-4c41-a0c3-178b88ecdc9d tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73572) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 10:30:25 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-6dd928ce-b70a-4c41-a0c3-178b88ecdc9d tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] Got 1 possible topologies {{(pid=73572) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 10:30:25 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-6dd928ce-b70a-4c41-a0c3-178b88ecdc9d tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 10:30:25 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-6dd928ce-b70a-4c41-a0c3-178b88ecdc9d tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 10:30:25 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6dd928ce-b70a-4c41-a0c3-178b88ecdc9d tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] [instance: 3a4c9522-9723-4ad4-8630-17a3aba70c98] Calling os-brick to attach iSCSI Volume {{(pid=73572) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 10:30:25 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dd928ce-b70a-4c41-a0c3-178b88ecdc9d tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc89c3d6a10>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:ec96ec24-bf73-4f38-ac9f-eb2699d0a661'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tqbEgzCT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 10:30:25 user nova-compute[73572]: WARNING os_brick.initiator.connectors.base [None req-6dd928ce-b70a-4c41-a0c3-178b88ecdc9d tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 10:30:25 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-6dd928ce-b70a-4c41-a0c3-178b88ecdc9d tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 10:30:25 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-6dd928ce-b70a-4c41-a0c3-178b88ecdc9d tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 10:30:25 user nova-compute[73572]: WARNING os_brick.initiator.connectors.base [None req-6dd928ce-b70a-4c41-a0c3-178b88ecdc9d tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 10:30:25 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-6dd928ce-b70a-4c41-a0c3-178b88ecdc9d tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ec96ec24-bf73-4f38-ac9f-eb2699d0a661" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 10:30:25 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-6dd928ce-b70a-4c41-a0c3-178b88ecdc9d tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ec96ec24-bf73-4f38-ac9f-eb2699d0a661" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 10:30:25 user nova-compute[73572]: INFO os_brick.initiator.connectors.iscsi [None req-6dd928ce-b70a-4c41-a0c3-178b88ecdc9d tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 10:30:25 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec96ec24-bf73-4f38-ac9f-eb2699d0a661 -p 172.16.0.220:3260 {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:30:25 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec96ec24-bf73-4f38-ac9f-eb2699d0a661 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:30:25 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[b32c62a0-1c59-4bf1-a87a-a7aae785db70]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:30:25 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dd928ce-b70a-4c41-a0c3-178b88ecdc9d tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 10:30:25 user nova-compute[73572]:  {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:30:25 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec96ec24-bf73-4f38-ac9f-eb2699d0a661 -p 172.16.0.220:3260 --interface default --op new {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:30:25 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:30:25 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec96ec24-bf73-4f38-ac9f-eb2699d0a661 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:30:25 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6e64a6e-d170-4f7b-947c-3ebf5b3b204c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ec96ec24-bf73-4f38-ac9f-eb2699d0a661] added\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:30:25 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dd928ce-b70a-4c41-a0c3-178b88ecdc9d tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ec96ec24-bf73-4f38-ac9f-eb2699d0a661] added
Aug 26 10:30:25 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:30:25 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec96ec24-bf73-4f38-ac9f-eb2699d0a661 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:30:25 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec96ec24-bf73-4f38-ac9f-eb2699d0a661 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:30:25 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[df6777bb-bcab-46bc-b396-8961cc4934b5]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:30:25 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dd928ce-b70a-4c41-a0c3-178b88ecdc9d tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:30:25 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec96ec24-bf73-4f38-ac9f-eb2699d0a661 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:30:25 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec96ec24-bf73-4f38-ac9f-eb2699d0a661 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:30:25 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b7fe5b9-4a40-4489-b681-da680c48b0b1]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:30:25 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dd928ce-b70a-4c41-a0c3-178b88ecdc9d tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:30:25 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec96ec24-bf73-4f38-ac9f-eb2699d0a661 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tqbEgzCT {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:30:25 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec96ec24-bf73-4f38-ac9f-eb2699d0a661 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tqbEgzCT" returned: 0 in 0.018s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:30:25 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[19b7c397-5f43-44b6-a75d-d726505b9367]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:30:25 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dd928ce-b70a-4c41-a0c3-178b88ecdc9d tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tqbEgzCT'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:30:25 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec96ec24-bf73-4f38-ac9f-eb2699d0a661 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:30:25 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec96ec24-bf73-4f38-ac9f-eb2699d0a661 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:30:25 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[2557e514-a227-4bad-a5f9-b2a4812568f2]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:30:25 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dd928ce-b70a-4c41-a0c3-178b88ecdc9d tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:30:25 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:30:25 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:30:25 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[e793af55-52b1-41e4-8ac0-45a85046435c]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:448cd30a-3852-471f-903f-a2e5abc34b55 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c7946b2-965a-4156-9a34-72518f8596f0 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b5f9f26-8454-44d8-aa18-724b5d18938e (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8aa6fc0-ce50-4db6-8d7d-9f37eae07207 (non-flash)\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:30:25 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dd928ce-b70a-4c41-a0c3-178b88ecdc9d tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)
Aug 26 10:30:25 user nova-compute[73572]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:448cd30a-3852-471f-903f-a2e5abc34b55 (non-flash)
Aug 26 10:30:25 user nova-compute[73572]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c7946b2-965a-4156-9a34-72518f8596f0 (non-flash)
Aug 26 10:30:25 user nova-compute[73572]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b5f9f26-8454-44d8-aa18-724b5d18938e (non-flash)
Aug 26 10:30:25 user nova-compute[73572]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8aa6fc0-ce50-4db6-8d7d-9f37eae07207 (non-flash)
Aug 26 10:30:25 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 10:30:25 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dd928ce-b70a-4c41-a0c3-178b88ecdc9d tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)
Aug 26 10:30:25 user nova-compute[73572]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:448cd30a-3852-471f-903f-a2e5abc34b55 (non-flash)
Aug 26 10:30:25 user nova-compute[73572]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c7946b2-965a-4156-9a34-72518f8596f0 (non-flash)
Aug 26 10:30:25 user nova-compute[73572]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b5f9f26-8454-44d8-aa18-724b5d18938e (non-flash)
Aug 26 10:30:25 user nova-compute[73572]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8aa6fc0-ce50-4db6-8d7d-9f37eae07207 (non-flash)
Aug 26 10:30:25 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 10:30:25 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec96ec24-bf73-4f38-ac9f-eb2699d0a661 -p 172.16.0.220:3260 --login {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:30:25 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec96ec24-bf73-4f38-ac9f-eb2699d0a661 -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:30:25 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[262448a8-8bde-4093-b3db-c2c19cc18f74]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ec96ec24-bf73-4f38-ac9f-eb2699d0a661, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ec96ec24-bf73-4f38-ac9f-eb2699d0a661, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:30:25 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dd928ce-b70a-4c41-a0c3-178b88ecdc9d tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ec96ec24-bf73-4f38-ac9f-eb2699d0a661, portal: 172.16.0.220,3260]
Aug 26 10:30:25 user nova-compute[73572]: Login to [iface: default, target: iqn.2010-10.org.openstack:ec96ec24-bf73-4f38-ac9f-eb2699d0a661, portal: 172.16.0.220,3260] successful.
Aug 26 10:30:25 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:30:25 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec96ec24-bf73-4f38-ac9f-eb2699d0a661 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:30:25 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec96ec24-bf73-4f38-ac9f-eb2699d0a661 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:30:25 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[92a1855c-d33f-4dd1-9e87-59279d80e6c4]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:30:25 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dd928ce-b70a-4c41-a0c3-178b88ecdc9d tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:30:25 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:30:25 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:30:25 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[e79bf3e4-f421-4131-ac66-8c3f25ffef2e]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:448cd30a-3852-471f-903f-a2e5abc34b55 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c7946b2-965a-4156-9a34-72518f8596f0 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b5f9f26-8454-44d8-aa18-724b5d18938e (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8aa6fc0-ce50-4db6-8d7d-9f37eae07207 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec96ec24-bf73-4f38-ac9f-eb2699d0a661 (non-flash)\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:30:25 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dd928ce-b70a-4c41-a0c3-178b88ecdc9d tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)
Aug 26 10:30:25 user nova-compute[73572]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:448cd30a-3852-471f-903f-a2e5abc34b55 (non-flash)
Aug 26 10:30:25 user nova-compute[73572]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c7946b2-965a-4156-9a34-72518f8596f0 (non-flash)
Aug 26 10:30:25 user nova-compute[73572]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b5f9f26-8454-44d8-aa18-724b5d18938e (non-flash)
Aug 26 10:30:25 user nova-compute[73572]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8aa6fc0-ce50-4db6-8d7d-9f37eae07207 (non-flash)
Aug 26 10:30:25 user nova-compute[73572]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec96ec24-bf73-4f38-ac9f-eb2699d0a661 (non-flash)
Aug 26 10:30:25 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 10:30:25 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dd928ce-b70a-4c41-a0c3-178b88ecdc9d tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)
Aug 26 10:30:25 user nova-compute[73572]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:448cd30a-3852-471f-903f-a2e5abc34b55 (non-flash)
Aug 26 10:30:25 user nova-compute[73572]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c7946b2-965a-4156-9a34-72518f8596f0 (non-flash)
Aug 26 10:30:25 user nova-compute[73572]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b5f9f26-8454-44d8-aa18-724b5d18938e (non-flash)
Aug 26 10:30:25 user nova-compute[73572]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8aa6fc0-ce50-4db6-8d7d-9f37eae07207 (non-flash)
Aug 26 10:30:25 user nova-compute[73572]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec96ec24-bf73-4f38-ac9f-eb2699d0a661 (non-flash)
Aug 26 10:30:25 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 10:30:25 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-6dd928ce-b70a-4c41-a0c3-178b88ecdc9d tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ec96ec24-bf73-4f38-ac9f-eb2699d0a661" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.310s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 10:30:25 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dd928ce-b70a-4c41-a0c3-178b88ecdc9d tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] Connected to 172.16.0.220:3260 {{(pid=73572) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 10:30:25 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-6dd928ce-b70a-4c41-a0c3-178b88ecdc9d tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] HCTL ('34', '-', '-', 0) found on session 46 with lun 0 {{(pid=73572) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 10:30:25 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-6dd928ce-b70a-4c41-a0c3-178b88ecdc9d tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73572) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 10:30:25 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:30:25 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:30:25 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[73afc0ad-a517-4bfb-9098-0f00d5d84e7a]: (4, ('- - 0', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:30:25 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-6dd928ce-b70a-4c41-a0c3-178b88ecdc9d tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] Searching for a device in session 46 and hctl ['34', '*', '*', 0] yield: None {{(pid=73572) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 10:30:26 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-6dd928ce-b70a-4c41-a0c3-178b88ecdc9d tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] Searching for a device in session 46 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73572) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 10:30:26 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dd928ce-b70a-4c41-a0c3-178b88ecdc9d tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tqbEgzCT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73572) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 10:30:26 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-6dd928ce-b70a-4c41-a0c3-178b88ecdc9d tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.342s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 10:30:26 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dd928ce-b70a-4c41-a0c3-178b88ecdc9d tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] <== connect_volume: return (1343ms) {'type': 'block', 'scsi_wwn': '26136623632336631', 'path': '/dev/sdc'} {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 10:30:26 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6dd928ce-b70a-4c41-a0c3-178b88ecdc9d tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] [instance: 3a4c9522-9723-4ad4-8630-17a3aba70c98] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26136623632336631', 'path': '/dev/sdc'} {{(pid=73572) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 10:30:26 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-6dd928ce-b70a-4c41-a0c3-178b88ecdc9d tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T10:30:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-2038663999',display_name='tempest-TestShelveInstance-server-2038663999',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-2038663999',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJMZDyaM/+VCFQG3701Z0FaBkgWoaji0UPFWpQswT1wZzAYHJZTlb5cmnzgNgUoUdDBH0mAV39s4kCVhnK3UsUjQb2bImpxYDfN7ddzW4ZDHjoplOmZ53CGkaz6SnTlrhg==',key_name='tempest-TestShelveInstance-188411046',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='51eaa92831e54ba6bd3d71db1a4e24e0',ramdisk_id='',reservation_id='r-yp88ce4a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-912363172',owner_user_name='tempest-TestShelveInstance-912363172-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T10:30:13Z,user_data=None,user_id='6d0074f39a8141119bd94ffa83bd80aa',uuid=3a4c9522-9723-4ad4-8630-17a3aba70c98,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "663db499-c552-478e-bad7-938b2f65c619", "address": "fa:16:3e:fd:54:35", "network": {"id": "6bec7255-9e3a-43e3-aaf3-913e171ee99d", "bridge": "br-int", "label": "tempest-TestShelveInstance-1279582697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51eaa92831e54ba6bd3d71db1a4e24e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap663db499-c5", "ovs_interfaceid": "663db499-c552-478e-bad7-938b2f65c619", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73572) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 10:30:26 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-6dd928ce-b70a-4c41-a0c3-178b88ecdc9d tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] Converting VIF {"id": "663db499-c552-478e-bad7-938b2f65c619", "address": "fa:16:3e:fd:54:35", "network": {"id": "6bec7255-9e3a-43e3-aaf3-913e171ee99d", "bridge": "br-int", "label": "tempest-TestShelveInstance-1279582697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51eaa92831e54ba6bd3d71db1a4e24e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap663db499-c5", "ovs_interfaceid": "663db499-c552-478e-bad7-938b2f65c619", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:30:26 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-6dd928ce-b70a-4c41-a0c3-178b88ecdc9d tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:54:35,bridge_name='br-int',has_traffic_filtering=True,id=663db499-c552-478e-bad7-938b2f65c619,network=Network(6bec7255-9e3a-43e3-aaf3-913e171ee99d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap663db499-c5') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:30:26 user nova-compute[73572]: DEBUG nova.objects.instance [None req-6dd928ce-b70a-4c41-a0c3-178b88ecdc9d tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] Lazy-loading 'pci_devices' on Instance uuid 3a4c9522-9723-4ad4-8630-17a3aba70c98 {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:30:26 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-6dd928ce-b70a-4c41-a0c3-178b88ecdc9d tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] [instance: 3a4c9522-9723-4ad4-8630-17a3aba70c98] End _get_guest_xml xml=<domain type="kvm">
Aug 26 10:30:26 user nova-compute[73572]:   <uuid>3a4c9522-9723-4ad4-8630-17a3aba70c98</uuid>
Aug 26 10:30:26 user nova-compute[73572]:   <name>instance-0000002a</name>
Aug 26 10:30:26 user nova-compute[73572]:   <memory>524288</memory>
Aug 26 10:30:26 user nova-compute[73572]:   <vcpu>1</vcpu>
Aug 26 10:30:26 user nova-compute[73572]:   <metadata>
Aug 26 10:30:26 user nova-compute[73572]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 10:30:26 user nova-compute[73572]:       <nova:package version="0.0.0"/>
Aug 26 10:30:26 user nova-compute[73572]:       <nova:name>tempest-TestShelveInstance-server-2038663999</nova:name>
Aug 26 10:30:26 user nova-compute[73572]:       <nova:creationTime>2023-08-26 10:30:25</nova:creationTime>
Aug 26 10:30:26 user nova-compute[73572]:       <nova:flavor name="m1.tiny">
Aug 26 10:30:26 user nova-compute[73572]:         <nova:memory>512</nova:memory>
Aug 26 10:30:26 user nova-compute[73572]:         <nova:disk>1</nova:disk>
Aug 26 10:30:26 user nova-compute[73572]:         <nova:swap>0</nova:swap>
Aug 26 10:30:26 user nova-compute[73572]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 10:30:26 user nova-compute[73572]:         <nova:vcpus>1</nova:vcpus>
Aug 26 10:30:26 user nova-compute[73572]:       </nova:flavor>
Aug 26 10:30:26 user nova-compute[73572]:       <nova:owner>
Aug 26 10:30:26 user nova-compute[73572]:         <nova:user uuid="6d0074f39a8141119bd94ffa83bd80aa">tempest-TestShelveInstance-912363172-project-member</nova:user>
Aug 26 10:30:26 user nova-compute[73572]:         <nova:project uuid="51eaa92831e54ba6bd3d71db1a4e24e0">tempest-TestShelveInstance-912363172</nova:project>
Aug 26 10:30:26 user nova-compute[73572]:       </nova:owner>
Aug 26 10:30:26 user nova-compute[73572]:       <nova:ports>
Aug 26 10:30:26 user nova-compute[73572]:         <nova:port uuid="663db499-c552-478e-bad7-938b2f65c619">
Aug 26 10:30:26 user nova-compute[73572]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 26 10:30:26 user nova-compute[73572]:         </nova:port>
Aug 26 10:30:26 user nova-compute[73572]:       </nova:ports>
Aug 26 10:30:26 user nova-compute[73572]:     </nova:instance>
Aug 26 10:30:26 user nova-compute[73572]:   </metadata>
Aug 26 10:30:26 user nova-compute[73572]:   <sysinfo type="smbios">
Aug 26 10:30:26 user nova-compute[73572]:     <system>
Aug 26 10:30:26 user nova-compute[73572]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 10:30:26 user nova-compute[73572]:       <entry name="product">OpenStack Nova</entry>
Aug 26 10:30:26 user nova-compute[73572]:       <entry name="version">0.0.0</entry>
Aug 26 10:30:26 user nova-compute[73572]:       <entry name="serial">3a4c9522-9723-4ad4-8630-17a3aba70c98</entry>
Aug 26 10:30:26 user nova-compute[73572]:       <entry name="uuid">3a4c9522-9723-4ad4-8630-17a3aba70c98</entry>
Aug 26 10:30:26 user nova-compute[73572]:       <entry name="family">Virtual Machine</entry>
Aug 26 10:30:26 user nova-compute[73572]:     </system>
Aug 26 10:30:26 user nova-compute[73572]:   </sysinfo>
Aug 26 10:30:26 user nova-compute[73572]:   <os>
Aug 26 10:30:26 user nova-compute[73572]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 10:30:26 user nova-compute[73572]:     <boot dev="hd"/>
Aug 26 10:30:26 user nova-compute[73572]:     <smbios mode="sysinfo"/>
Aug 26 10:30:26 user nova-compute[73572]:   </os>
Aug 26 10:30:26 user nova-compute[73572]:   <features>
Aug 26 10:30:26 user nova-compute[73572]:     <acpi/>
Aug 26 10:30:26 user nova-compute[73572]:     <apic/>
Aug 26 10:30:26 user nova-compute[73572]:     <vmcoreinfo/>
Aug 26 10:30:26 user nova-compute[73572]:   </features>
Aug 26 10:30:26 user nova-compute[73572]:   <clock offset="utc">
Aug 26 10:30:26 user nova-compute[73572]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 10:30:26 user nova-compute[73572]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 10:30:26 user nova-compute[73572]:     <timer name="hpet" present="no"/>
Aug 26 10:30:26 user nova-compute[73572]:   </clock>
Aug 26 10:30:26 user nova-compute[73572]:   <cpu mode="custom" match="exact">
Aug 26 10:30:26 user nova-compute[73572]:     <model>Nehalem</model>
Aug 26 10:30:26 user nova-compute[73572]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 10:30:26 user nova-compute[73572]:   </cpu>
Aug 26 10:30:26 user nova-compute[73572]:   <devices>
Aug 26 10:30:26 user nova-compute[73572]:     <disk type="block" device="disk">
Aug 26 10:30:26 user nova-compute[73572]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 10:30:26 user nova-compute[73572]:       <source dev="/dev/sdc"/>
Aug 26 10:30:26 user nova-compute[73572]:       <target dev="vda" bus="virtio"/>
Aug 26 10:30:26 user nova-compute[73572]:       <serial>ec96ec24-bf73-4f38-ac9f-eb2699d0a661</serial>
Aug 26 10:30:26 user nova-compute[73572]:     </disk>
Aug 26 10:30:26 user nova-compute[73572]:     <interface type="ethernet">
Aug 26 10:30:26 user nova-compute[73572]:       <mac address="fa:16:3e:fd:54:35"/>
Aug 26 10:30:26 user nova-compute[73572]:       <model type="virtio"/>
Aug 26 10:30:26 user nova-compute[73572]:       <mtu size="1442"/>
Aug 26 10:30:26 user nova-compute[73572]:       <target dev="tap663db499-c5"/>
Aug 26 10:30:26 user nova-compute[73572]:     </interface>
Aug 26 10:30:26 user nova-compute[73572]:     <serial type="pty">
Aug 26 10:30:26 user nova-compute[73572]:       <log file="/opt/stack/data/nova/instances/3a4c9522-9723-4ad4-8630-17a3aba70c98/console.log" append="off"/>
Aug 26 10:30:26 user nova-compute[73572]:     </serial>
Aug 26 10:30:26 user nova-compute[73572]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 10:30:26 user nova-compute[73572]:     <video>
Aug 26 10:30:26 user nova-compute[73572]:       <model type="virtio"/>
Aug 26 10:30:26 user nova-compute[73572]:     </video>
Aug 26 10:30:26 user nova-compute[73572]:     <rng model="virtio">
Aug 26 10:30:26 user nova-compute[73572]:       <backend model="random">/dev/urandom</backend>
Aug 26 10:30:26 user nova-compute[73572]:     </rng>
Aug 26 10:30:26 user nova-compute[73572]:     <controller type="usb" index="0" model="none"/>
Aug 26 10:30:26 user nova-compute[73572]:     <memballoon model="virtio">
Aug 26 10:30:26 user nova-compute[73572]:       <stats period="10"/>
Aug 26 10:30:26 user nova-compute[73572]:     </memballoon>
Aug 26 10:30:26 user nova-compute[73572]:   </devices>
Aug 26 10:30:26 user nova-compute[73572]: </domain>
Aug 26 10:30:26 user nova-compute[73572]:  {{(pid=73572) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 10:30:26 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-6dd928ce-b70a-4c41-a0c3-178b88ecdc9d tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T10:30:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-2038663999',display_name='tempest-TestShelveInstance-server-2038663999',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-2038663999',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJMZDyaM/+VCFQG3701Z0FaBkgWoaji0UPFWpQswT1wZzAYHJZTlb5cmnzgNgUoUdDBH0mAV39s4kCVhnK3UsUjQb2bImpxYDfN7ddzW4ZDHjoplOmZ53CGkaz6SnTlrhg==',key_name='tempest-TestShelveInstance-188411046',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='51eaa92831e54ba6bd3d71db1a4e24e0',ramdisk_id='',reservation_id='r-yp88ce4a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-912363172',owner_user_name='tempest-TestShelveInstance-912363172-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T10:30:13Z,user_data=None,user_id='6d0074f39a8141119bd94ffa83bd80aa',uuid=3a4c9522-9723-4ad4-8630-17a3aba70c98,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "663db499-c552-478e-bad7-938b2f65c619", "address": "fa:16:3e:fd:54:35", "network": {"id": "6bec7255-9e3a-43e3-aaf3-913e171ee99d", "bridge": "br-int", "label": "tempest-TestShelveInstance-1279582697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51eaa92831e54ba6bd3d71db1a4e24e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap663db499-c5", "ovs_interfaceid": "663db499-c552-478e-bad7-938b2f65c619", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 10:30:26 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-6dd928ce-b70a-4c41-a0c3-178b88ecdc9d tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] Converting VIF {"id": "663db499-c552-478e-bad7-938b2f65c619", "address": "fa:16:3e:fd:54:35", "network": {"id": "6bec7255-9e3a-43e3-aaf3-913e171ee99d", "bridge": "br-int", "label": "tempest-TestShelveInstance-1279582697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51eaa92831e54ba6bd3d71db1a4e24e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap663db499-c5", "ovs_interfaceid": "663db499-c552-478e-bad7-938b2f65c619", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:30:26 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-6dd928ce-b70a-4c41-a0c3-178b88ecdc9d tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:54:35,bridge_name='br-int',has_traffic_filtering=True,id=663db499-c552-478e-bad7-938b2f65c619,network=Network(6bec7255-9e3a-43e3-aaf3-913e171ee99d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap663db499-c5') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:30:26 user nova-compute[73572]: DEBUG os_vif [None req-6dd928ce-b70a-4c41-a0c3-178b88ecdc9d tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:54:35,bridge_name='br-int',has_traffic_filtering=True,id=663db499-c552-478e-bad7-938b2f65c619,network=Network(6bec7255-9e3a-43e3-aaf3-913e171ee99d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap663db499-c5') {{(pid=73572) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 10:30:26 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:30:26 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:30:26 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 10:30:26 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:30:26 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap663db499-c5, may_exist=True, interface_attrs={}) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:30:26 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap663db499-c5, col_values=(('external_ids', {'iface-id': '663db499-c552-478e-bad7-938b2f65c619', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fd:54:35', 'vm-uuid': '3a4c9522-9723-4ad4-8630-17a3aba70c98'}),), if_exists=True) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:30:26 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:30:26 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:30:26 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:30:26 user nova-compute[73572]: INFO os_vif [None req-6dd928ce-b70a-4c41-a0c3-178b88ecdc9d tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:54:35,bridge_name='br-int',has_traffic_filtering=True,id=663db499-c552-478e-bad7-938b2f65c619,network=Network(6bec7255-9e3a-43e3-aaf3-913e171ee99d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap663db499-c5')
Aug 26 10:30:26 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-6dd928ce-b70a-4c41-a0c3-178b88ecdc9d tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] No BDM found with device name vda, not building metadata. {{(pid=73572) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 10:30:26 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-6dd928ce-b70a-4c41-a0c3-178b88ecdc9d tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] No VIF found with MAC fa:16:3e:fd:54:35, not building metadata {{(pid=73572) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 10:30:27 user nova-compute[73572]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693045812.5971754, e468b473-515f-41ad-a75c-65d4c6d575c8 => Stopped> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:30:27 user nova-compute[73572]: INFO nova.compute.manager [-] [instance: e468b473-515f-41ad-a75c-65d4c6d575c8] VM Stopped (Lifecycle Event)
Aug 26 10:30:27 user nova-compute[73572]: DEBUG nova.compute.manager [None req-3cfaa111-d370-4a4e-8c3e-0de6e1ffa381 None None] [instance: e468b473-515f-41ad-a75c-65d4c6d575c8] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:30:28 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:30:28 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:30:28 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:30:28 user nova-compute[73572]: DEBUG nova.compute.manager [req-7573384e-9730-4014-977e-4c275abf367d req-fc0c0547-3626-4e79-a445-d8aa186851e7 service nova] [instance: 3a4c9522-9723-4ad4-8630-17a3aba70c98] Received event network-vif-plugged-663db499-c552-478e-bad7-938b2f65c619 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:30:28 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-7573384e-9730-4014-977e-4c275abf367d req-fc0c0547-3626-4e79-a445-d8aa186851e7 service nova] Acquiring lock "3a4c9522-9723-4ad4-8630-17a3aba70c98-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:30:28 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-7573384e-9730-4014-977e-4c275abf367d req-fc0c0547-3626-4e79-a445-d8aa186851e7 service nova] Lock "3a4c9522-9723-4ad4-8630-17a3aba70c98-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:30:28 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-7573384e-9730-4014-977e-4c275abf367d req-fc0c0547-3626-4e79-a445-d8aa186851e7 service nova] Lock "3a4c9522-9723-4ad4-8630-17a3aba70c98-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:30:28 user nova-compute[73572]: DEBUG nova.compute.manager [req-7573384e-9730-4014-977e-4c275abf367d req-fc0c0547-3626-4e79-a445-d8aa186851e7 service nova] [instance: 3a4c9522-9723-4ad4-8630-17a3aba70c98] No waiting events found dispatching network-vif-plugged-663db499-c552-478e-bad7-938b2f65c619 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:30:28 user nova-compute[73572]: WARNING nova.compute.manager [req-7573384e-9730-4014-977e-4c275abf367d req-fc0c0547-3626-4e79-a445-d8aa186851e7 service nova] [instance: 3a4c9522-9723-4ad4-8630-17a3aba70c98] Received unexpected event network-vif-plugged-663db499-c552-478e-bad7-938b2f65c619 for instance with vm_state building and task_state spawning.
Aug 26 10:30:28 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:30:28 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:30:28 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:30:28 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:30:28 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:30:30 user nova-compute[73572]: DEBUG nova.virt.driver [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Emitting event <LifecycleEvent: 1693045830.1592653, 3a4c9522-9723-4ad4-8630-17a3aba70c98 => Resumed> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:30:30 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 3a4c9522-9723-4ad4-8630-17a3aba70c98] VM Resumed (Lifecycle Event)
Aug 26 10:30:30 user nova-compute[73572]: DEBUG nova.compute.manager [None req-6dd928ce-b70a-4c41-a0c3-178b88ecdc9d tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] [instance: 3a4c9522-9723-4ad4-8630-17a3aba70c98] Instance event wait completed in 0 seconds for  {{(pid=73572) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 10:30:30 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-6dd928ce-b70a-4c41-a0c3-178b88ecdc9d tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] [instance: 3a4c9522-9723-4ad4-8630-17a3aba70c98] Guest created on hypervisor {{(pid=73572) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 10:30:30 user nova-compute[73572]: INFO nova.virt.libvirt.driver [-] [instance: 3a4c9522-9723-4ad4-8630-17a3aba70c98] Instance spawned successfully.
Aug 26 10:30:30 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-6dd928ce-b70a-4c41-a0c3-178b88ecdc9d tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] [instance: 3a4c9522-9723-4ad4-8630-17a3aba70c98] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 10:30:30 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 3a4c9522-9723-4ad4-8630-17a3aba70c98] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:30:30 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 3a4c9522-9723-4ad4-8630-17a3aba70c98] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73572) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 10:30:30 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-6dd928ce-b70a-4c41-a0c3-178b88ecdc9d tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] [instance: 3a4c9522-9723-4ad4-8630-17a3aba70c98] Found default for hw_cdrom_bus of ide {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:30:30 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-6dd928ce-b70a-4c41-a0c3-178b88ecdc9d tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] [instance: 3a4c9522-9723-4ad4-8630-17a3aba70c98] Found default for hw_disk_bus of virtio {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:30:30 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-6dd928ce-b70a-4c41-a0c3-178b88ecdc9d tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] [instance: 3a4c9522-9723-4ad4-8630-17a3aba70c98] Found default for hw_input_bus of None {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:30:30 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-6dd928ce-b70a-4c41-a0c3-178b88ecdc9d tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] [instance: 3a4c9522-9723-4ad4-8630-17a3aba70c98] Found default for hw_pointer_model of None {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:30:30 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-6dd928ce-b70a-4c41-a0c3-178b88ecdc9d tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] [instance: 3a4c9522-9723-4ad4-8630-17a3aba70c98] Found default for hw_video_model of virtio {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:30:30 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-6dd928ce-b70a-4c41-a0c3-178b88ecdc9d tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] [instance: 3a4c9522-9723-4ad4-8630-17a3aba70c98] Found default for hw_vif_model of virtio {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:30:30 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 3a4c9522-9723-4ad4-8630-17a3aba70c98] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 10:30:30 user nova-compute[73572]: DEBUG nova.virt.driver [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Emitting event <LifecycleEvent: 1693045830.1624641, 3a4c9522-9723-4ad4-8630-17a3aba70c98 => Started> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:30:30 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 3a4c9522-9723-4ad4-8630-17a3aba70c98] VM Started (Lifecycle Event)
Aug 26 10:30:30 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 3a4c9522-9723-4ad4-8630-17a3aba70c98] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:30:30 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 3a4c9522-9723-4ad4-8630-17a3aba70c98] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73572) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 10:30:30 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 3a4c9522-9723-4ad4-8630-17a3aba70c98] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 10:30:30 user nova-compute[73572]: INFO nova.compute.manager [None req-6dd928ce-b70a-4c41-a0c3-178b88ecdc9d tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] [instance: 3a4c9522-9723-4ad4-8630-17a3aba70c98] Took 5.04 seconds to spawn the instance on the hypervisor.
Aug 26 10:30:30 user nova-compute[73572]: DEBUG nova.compute.manager [None req-6dd928ce-b70a-4c41-a0c3-178b88ecdc9d tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] [instance: 3a4c9522-9723-4ad4-8630-17a3aba70c98] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:30:30 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:30:30 user nova-compute[73572]: INFO nova.compute.manager [None req-6dd928ce-b70a-4c41-a0c3-178b88ecdc9d tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] [instance: 3a4c9522-9723-4ad4-8630-17a3aba70c98] Took 18.11 seconds to build instance.
Aug 26 10:30:30 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-6dd928ce-b70a-4c41-a0c3-178b88ecdc9d tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] Lock "3a4c9522-9723-4ad4-8630-17a3aba70c98" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.225s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:30:30 user nova-compute[73572]: DEBUG nova.compute.manager [req-72acfba7-9094-4bfc-94ea-9d95eb5e9533 req-a867b472-f297-4fbe-a86e-19251d549ae1 service nova] [instance: 3a4c9522-9723-4ad4-8630-17a3aba70c98] Received event network-vif-plugged-663db499-c552-478e-bad7-938b2f65c619 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:30:30 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-72acfba7-9094-4bfc-94ea-9d95eb5e9533 req-a867b472-f297-4fbe-a86e-19251d549ae1 service nova] Acquiring lock "3a4c9522-9723-4ad4-8630-17a3aba70c98-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:30:30 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-72acfba7-9094-4bfc-94ea-9d95eb5e9533 req-a867b472-f297-4fbe-a86e-19251d549ae1 service nova] Lock "3a4c9522-9723-4ad4-8630-17a3aba70c98-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:30:30 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-72acfba7-9094-4bfc-94ea-9d95eb5e9533 req-a867b472-f297-4fbe-a86e-19251d549ae1 service nova] Lock "3a4c9522-9723-4ad4-8630-17a3aba70c98-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:30:30 user nova-compute[73572]: DEBUG nova.compute.manager [req-72acfba7-9094-4bfc-94ea-9d95eb5e9533 req-a867b472-f297-4fbe-a86e-19251d549ae1 service nova] [instance: 3a4c9522-9723-4ad4-8630-17a3aba70c98] No waiting events found dispatching network-vif-plugged-663db499-c552-478e-bad7-938b2f65c619 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:30:30 user nova-compute[73572]: WARNING nova.compute.manager [req-72acfba7-9094-4bfc-94ea-9d95eb5e9533 req-a867b472-f297-4fbe-a86e-19251d549ae1 service nova] [instance: 3a4c9522-9723-4ad4-8630-17a3aba70c98] Received unexpected event network-vif-plugged-663db499-c552-478e-bad7-938b2f65c619 for instance with vm_state active and task_state None.
Aug 26 10:30:30 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:30:30 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:30:30 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:30:30 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:30:30 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Auditing locally available compute resources for user (node: user) {{(pid=73572) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 10:30:31 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b2d5f4e-37af-438c-859b-d4ca803b7d08/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:30:31 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b2d5f4e-37af-438c-859b-d4ca803b7d08/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:30:31 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b2d5f4e-37af-438c-859b-d4ca803b7d08/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:30:31 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b2d5f4e-37af-438c-859b-d4ca803b7d08/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:30:31 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86923c1a-89a5-4e7a-b488-8bf3a013bf83/disk.rescue --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:30:31 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86923c1a-89a5-4e7a-b488-8bf3a013bf83/disk.rescue --force-share --output=json" returned: 0 in 0.215s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:30:31 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86923c1a-89a5-4e7a-b488-8bf3a013bf83/disk.rescue --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:30:31 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:30:31 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86923c1a-89a5-4e7a-b488-8bf3a013bf83/disk.rescue --force-share --output=json" returned: 0 in 0.235s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:30:31 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86923c1a-89a5-4e7a-b488-8bf3a013bf83/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:30:32 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86923c1a-89a5-4e7a-b488-8bf3a013bf83/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:30:32 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86923c1a-89a5-4e7a-b488-8bf3a013bf83/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:30:32 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86923c1a-89a5-4e7a-b488-8bf3a013bf83/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:30:32 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c785b609-0068-442f-91f5-d26e888a993f/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:30:32 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c785b609-0068-442f-91f5-d26e888a993f/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:30:32 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c785b609-0068-442f-91f5-d26e888a993f/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:30:32 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c785b609-0068-442f-91f5-d26e888a993f/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:30:32 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73572) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 10:30:32 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=73572) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 10:30:32 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68613b1e-c45c-4fd9-834c-3630ed0f456a/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:30:32 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68613b1e-c45c-4fd9-834c-3630ed0f456a/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:30:32 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68613b1e-c45c-4fd9-834c-3630ed0f456a/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:30:33 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68613b1e-c45c-4fd9-834c-3630ed0f456a/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:30:33 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2eaea7c2-a5c0-4950-b033-0012b5cec0ee/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:30:33 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2eaea7c2-a5c0-4950-b033-0012b5cec0ee/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:30:33 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2eaea7c2-a5c0-4950-b033-0012b5cec0ee/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:30:33 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2eaea7c2-a5c0-4950-b033-0012b5cec0ee/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:30:33 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6004b15a-be01-42eb-92ba-ae9d93dab708/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:30:33 user nova-compute[73572]: DEBUG nova.compute.manager [req-0ff226a6-6f72-441f-a687-358ba2444604 req-2732ed6b-22e6-4712-a6c1-681a9d8c4b37 service nova] [instance: 6076ed21-24d2-4921-b47e-f70702b0adf1] Received event network-changed-49381412-2deb-4ed5-9b1c-3c693fefec38 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:30:33 user nova-compute[73572]: DEBUG nova.compute.manager [req-0ff226a6-6f72-441f-a687-358ba2444604 req-2732ed6b-22e6-4712-a6c1-681a9d8c4b37 service nova] [instance: 6076ed21-24d2-4921-b47e-f70702b0adf1] Refreshing instance network info cache due to event network-changed-49381412-2deb-4ed5-9b1c-3c693fefec38. {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 10:30:33 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-0ff226a6-6f72-441f-a687-358ba2444604 req-2732ed6b-22e6-4712-a6c1-681a9d8c4b37 service nova] Acquiring lock "refresh_cache-6076ed21-24d2-4921-b47e-f70702b0adf1" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:30:33 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-0ff226a6-6f72-441f-a687-358ba2444604 req-2732ed6b-22e6-4712-a6c1-681a9d8c4b37 service nova] Acquired lock "refresh_cache-6076ed21-24d2-4921-b47e-f70702b0adf1" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:30:33 user nova-compute[73572]: DEBUG nova.network.neutron [req-0ff226a6-6f72-441f-a687-358ba2444604 req-2732ed6b-22e6-4712-a6c1-681a9d8c4b37 service nova] [instance: 6076ed21-24d2-4921-b47e-f70702b0adf1] Refreshing network info cache for port 49381412-2deb-4ed5-9b1c-3c693fefec38 {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 10:30:33 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6004b15a-be01-42eb-92ba-ae9d93dab708/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:30:33 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6004b15a-be01-42eb-92ba-ae9d93dab708/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:30:33 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6004b15a-be01-42eb-92ba-ae9d93dab708/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:30:33 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=73572) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 10:30:33 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73572) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 10:30:33 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73572) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 10:30:33 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c8e780d-0a13-4484-bf18-ac0879db263a/disk.rescue --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:30:34 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c8e780d-0a13-4484-bf18-ac0879db263a/disk.rescue --force-share --output=json" returned: 0 in 0.214s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:30:34 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c8e780d-0a13-4484-bf18-ac0879db263a/disk.rescue --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:30:34 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-f7b85c12-12af-4c22-bff6-95d30e9bf010 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Acquiring lock "6076ed21-24d2-4921-b47e-f70702b0adf1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:30:34 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-f7b85c12-12af-4c22-bff6-95d30e9bf010 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Lock "6076ed21-24d2-4921-b47e-f70702b0adf1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:30:34 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-f7b85c12-12af-4c22-bff6-95d30e9bf010 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Acquiring lock "6076ed21-24d2-4921-b47e-f70702b0adf1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:30:34 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-f7b85c12-12af-4c22-bff6-95d30e9bf010 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Lock "6076ed21-24d2-4921-b47e-f70702b0adf1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:30:34 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-f7b85c12-12af-4c22-bff6-95d30e9bf010 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Lock "6076ed21-24d2-4921-b47e-f70702b0adf1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:30:34 user nova-compute[73572]: INFO nova.compute.manager [None req-f7b85c12-12af-4c22-bff6-95d30e9bf010 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 6076ed21-24d2-4921-b47e-f70702b0adf1] Terminating instance
Aug 26 10:30:34 user nova-compute[73572]: DEBUG nova.compute.manager [None req-f7b85c12-12af-4c22-bff6-95d30e9bf010 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 6076ed21-24d2-4921-b47e-f70702b0adf1] Start destroying the instance on the hypervisor. {{(pid=73572) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 10:30:34 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:30:34 user nova-compute[73572]: DEBUG nova.network.neutron [req-0ff226a6-6f72-441f-a687-358ba2444604 req-2732ed6b-22e6-4712-a6c1-681a9d8c4b37 service nova] [instance: 6076ed21-24d2-4921-b47e-f70702b0adf1] Updated VIF entry in instance network info cache for port 49381412-2deb-4ed5-9b1c-3c693fefec38. {{(pid=73572) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 10:30:34 user nova-compute[73572]: DEBUG nova.network.neutron [req-0ff226a6-6f72-441f-a687-358ba2444604 req-2732ed6b-22e6-4712-a6c1-681a9d8c4b37 service nova] [instance: 6076ed21-24d2-4921-b47e-f70702b0adf1] Updating instance_info_cache with network_info: [{"id": "49381412-2deb-4ed5-9b1c-3c693fefec38", "address": "fa:16:3e:6f:f9:b8", "network": {"id": "c520ee18-34a7-4781-bc97-419e9a702d40", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-280196989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfc130586d9f4581953f1b8ae1c4465e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49381412-2d", "ovs_interfaceid": "49381412-2deb-4ed5-9b1c-3c693fefec38", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:30:34 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c8e780d-0a13-4484-bf18-ac0879db263a/disk.rescue --force-share --output=json" returned: 0 in 0.254s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:30:34 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] skipping disk /opt/stack/data/nova/instances/1c8e780d-0a13-4484-bf18-ac0879db263a/disk (vdb) as it is a volume {{(pid=73572) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 10:30:34 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:30:34 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-0ff226a6-6f72-441f-a687-358ba2444604 req-2732ed6b-22e6-4712-a6c1-681a9d8c4b37 service nova] Releasing lock "refresh_cache-6076ed21-24d2-4921-b47e-f70702b0adf1" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:30:34 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:30:34 user nova-compute[73572]: DEBUG nova.compute.manager [req-d737d475-c1a0-4a24-baed-d8dab7e5c922 req-7533e89d-be1f-42cb-a220-dde22ca32a55 service nova] [instance: 6076ed21-24d2-4921-b47e-f70702b0adf1] Received event network-vif-unplugged-49381412-2deb-4ed5-9b1c-3c693fefec38 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:30:34 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-d737d475-c1a0-4a24-baed-d8dab7e5c922 req-7533e89d-be1f-42cb-a220-dde22ca32a55 service nova] Acquiring lock "6076ed21-24d2-4921-b47e-f70702b0adf1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:30:34 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-d737d475-c1a0-4a24-baed-d8dab7e5c922 req-7533e89d-be1f-42cb-a220-dde22ca32a55 service nova] Lock "6076ed21-24d2-4921-b47e-f70702b0adf1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:30:34 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-d737d475-c1a0-4a24-baed-d8dab7e5c922 req-7533e89d-be1f-42cb-a220-dde22ca32a55 service nova] Lock "6076ed21-24d2-4921-b47e-f70702b0adf1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:30:34 user nova-compute[73572]: DEBUG nova.compute.manager [req-d737d475-c1a0-4a24-baed-d8dab7e5c922 req-7533e89d-be1f-42cb-a220-dde22ca32a55 service nova] [instance: 6076ed21-24d2-4921-b47e-f70702b0adf1] No waiting events found dispatching network-vif-unplugged-49381412-2deb-4ed5-9b1c-3c693fefec38 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:30:34 user nova-compute[73572]: DEBUG nova.compute.manager [req-d737d475-c1a0-4a24-baed-d8dab7e5c922 req-7533e89d-be1f-42cb-a220-dde22ca32a55 service nova] [instance: 6076ed21-24d2-4921-b47e-f70702b0adf1] Received event network-vif-unplugged-49381412-2deb-4ed5-9b1c-3c693fefec38 for instance with task_state deleting. {{(pid=73572) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 10:30:34 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:30:34 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:30:34 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Hypervisor/Node resource view: name=user free_ram=7447MB free_disk=25.060752868652344GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=73572) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 10:30:34 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:30:34 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:30:35 user nova-compute[73572]: INFO nova.virt.libvirt.driver [-] [instance: 6076ed21-24d2-4921-b47e-f70702b0adf1] Instance destroyed successfully.
Aug 26 10:30:35 user nova-compute[73572]: DEBUG nova.objects.instance [None req-f7b85c12-12af-4c22-bff6-95d30e9bf010 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Lazy-loading 'resources' on Instance uuid 6076ed21-24d2-4921-b47e-f70702b0adf1 {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:30:35 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-f7b85c12-12af-4c22-bff6-95d30e9bf010 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T10:28:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1191607855',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1191607855',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1191607855',id=41,image_ref='544ae7de-0284-42c0-9bfe-65adf5523670',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHFSJE2g2PjDiDqwewJpsXro8A5LPvfdKpVqM1E/P47SmR9F9iooXILdAPkSmVUPBnQDNFAeGEbTvljBE84bSsovPui5kFoS1RXOhZtS7jbSiwoC5/V92HY7HEr92ASF1Q==',key_name='tempest-keypair-1121287772',keypairs=<?>,launch_index=0,launched_at=2023-08-26T10:29:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cfc130586d9f4581953f1b8ae1c4465e',ramdisk_id='',reservation_id='r-eh9ofgkx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-73786062',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-73786062-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-73786062',owner_user_name='tempest-TestVolumeBootPattern-73786062-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T10:29:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e1e80942e5db41c782bda686b10e2e4b',uuid=6076ed21-24d2-4921-b47e-f70702b0adf1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "49381412-2deb-4ed5-9b1c-3c693fefec38", "address": "fa:16:3e:6f:f9:b8", "network": {"id": "c520ee18-34a7-4781-bc97-419e9a702d40", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-280196989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfc130586d9f4581953f1b8ae1c4465e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49381412-2d", "ovs_interfaceid": "49381412-2deb-4ed5-9b1c-3c693fefec38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 10:30:35 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-f7b85c12-12af-4c22-bff6-95d30e9bf010 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Converting VIF {"id": "49381412-2deb-4ed5-9b1c-3c693fefec38", "address": "fa:16:3e:6f:f9:b8", "network": {"id": "c520ee18-34a7-4781-bc97-419e9a702d40", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-280196989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfc130586d9f4581953f1b8ae1c4465e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49381412-2d", "ovs_interfaceid": "49381412-2deb-4ed5-9b1c-3c693fefec38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:30:35 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-f7b85c12-12af-4c22-bff6-95d30e9bf010 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6f:f9:b8,bridge_name='br-int',has_traffic_filtering=True,id=49381412-2deb-4ed5-9b1c-3c693fefec38,network=Network(c520ee18-34a7-4781-bc97-419e9a702d40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49381412-2d') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:30:35 user nova-compute[73572]: DEBUG os_vif [None req-f7b85c12-12af-4c22-bff6-95d30e9bf010 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:f9:b8,bridge_name='br-int',has_traffic_filtering=True,id=49381412-2deb-4ed5-9b1c-3c693fefec38,network=Network(c520ee18-34a7-4781-bc97-419e9a702d40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49381412-2d') {{(pid=73572) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 10:30:35 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:30:35 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap49381412-2d, bridge=br-int, if_exists=True) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:30:35 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:30:35 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:30:35 user nova-compute[73572]: INFO os_vif [None req-f7b85c12-12af-4c22-bff6-95d30e9bf010 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:f9:b8,bridge_name='br-int',has_traffic_filtering=True,id=49381412-2deb-4ed5-9b1c-3c693fefec38,network=Network(c520ee18-34a7-4781-bc97-419e9a702d40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49381412-2d')
Aug 26 10:30:35 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7b85c12-12af-4c22-bff6-95d30e9bf010 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 6076ed21-24d2-4921-b47e-f70702b0adf1] calling os-brick to detach iSCSI Volume {{(pid=73572) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 10:30:35 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7b85c12-12af-4c22-bff6-95d30e9bf010 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc89c3d6a10>, {'target_iqns': ['iqn.2010-10.org.openstack:8c7946b2-965a-4156-9a34-72518f8596f0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UPnqyzCY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 10:30:35 user nova-compute[73572]: WARNING os_brick.initiator.connectors.base [None req-f7b85c12-12af-4c22-bff6-95d30e9bf010 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 10:30:35 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-f7b85c12-12af-4c22-bff6-95d30e9bf010 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 10:30:35 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-f7b85c12-12af-4c22-bff6-95d30e9bf010 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 10:30:35 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7b85c12-12af-4c22-bff6-95d30e9bf010 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8c7946b2-965a-4156-9a34-72518f8596f0', 0)] {{(pid=73572) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 10:30:35 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:30:35 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:30:35 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[93f5276e-2372-4b62-8c54-cbdc6a0a1c84]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0b5f9f26-8454-44d8-aa18-724b5d18938e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:448cd30a-3852-471f-903f-a2e5abc34b55\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8c7946b2-965a-4156-9a34-72518f8596f0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d8aa6fc0-ce50-4db6-8d7d-9f37eae07207\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ec96ec24-bf73-4f38-ac9f-eb2699d0a661\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:30:35 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:30:35 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance c785b609-0068-442f-91f5-d26e888a993f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:30:35 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance 14fab12e-52be-4fe6-8777-bc7ebf3c25f1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:30:35 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance 2eaea7c2-a5c0-4950-b033-0012b5cec0ee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:30:35 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance 86923c1a-89a5-4e7a-b488-8bf3a013bf83 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:30:35 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance 68613b1e-c45c-4fd9-834c-3630ed0f456a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:30:35 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance 6b2d5f4e-37af-438c-859b-d4ca803b7d08 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:30:35 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance f3fe3865-3d85-46cf-b24f-10b07e23aeff actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:30:35 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance 1c8e780d-0a13-4484-bf18-ac0879db263a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:30:35 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance 6076ed21-24d2-4921-b47e-f70702b0adf1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:30:35 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance 6004b15a-be01-42eb-92ba-ae9d93dab708 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:30:35 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance 3a4c9522-9723-4ad4-8630-17a3aba70c98 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:30:35 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=73572) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 10:30:35 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=73572) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 10:30:35 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:30:35 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[39cc8bbb-3713-4495-b699-f368d5ed49fc]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:448cd30a-3852-471f-903f-a2e5abc34b55 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c7946b2-965a-4156-9a34-72518f8596f0 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b5f9f26-8454-44d8-aa18-724b5d18938e (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8aa6fc0-ce50-4db6-8d7d-9f37eae07207 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec96ec24-bf73-4f38-ac9f-eb2699d0a661 (non-flash)\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:30:35 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7b85c12-12af-4c22-bff6-95d30e9bf010 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)
Aug 26 10:30:35 user nova-compute[73572]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:448cd30a-3852-471f-903f-a2e5abc34b55 (non-flash)
Aug 26 10:30:35 user nova-compute[73572]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c7946b2-965a-4156-9a34-72518f8596f0 (non-flash)
Aug 26 10:30:35 user nova-compute[73572]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b5f9f26-8454-44d8-aa18-724b5d18938e (non-flash)
Aug 26 10:30:35 user nova-compute[73572]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8aa6fc0-ce50-4db6-8d7d-9f37eae07207 (non-flash)
Aug 26 10:30:35 user nova-compute[73572]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec96ec24-bf73-4f38-ac9f-eb2699d0a661 (non-flash)
Aug 26 10:30:35 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 10:30:35 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7b85c12-12af-4c22-bff6-95d30e9bf010 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)
Aug 26 10:30:35 user nova-compute[73572]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:448cd30a-3852-471f-903f-a2e5abc34b55 (non-flash)
Aug 26 10:30:35 user nova-compute[73572]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c7946b2-965a-4156-9a34-72518f8596f0 (non-flash)
Aug 26 10:30:35 user nova-compute[73572]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b5f9f26-8454-44d8-aa18-724b5d18938e (non-flash)
Aug 26 10:30:35 user nova-compute[73572]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8aa6fc0-ce50-4db6-8d7d-9f37eae07207 (non-flash)
Aug 26 10:30:35 user nova-compute[73572]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec96ec24-bf73-4f38-ac9f-eb2699d0a661 (non-flash)
Aug 26 10:30:35 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 10:30:35 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7b85c12-12af-4c22-bff6-95d30e9bf010 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc878c08160>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8c7946b2-965a-4156-9a34-72518f8596f0'): ({'sdd'}, set())}) {{(pid=73572) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 10:30:35 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-f7b85c12-12af-4c22-bff6-95d30e9bf010 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Removing single pathed devices sdd {{(pid=73572) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 10:30:35 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:30:35 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:30:35 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c6fc2cd-4873-436d-93a2-0e760bccbe74]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:30:35 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:30:35 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.027s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:30:35 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4cb9e35-a118-47c2-8877-aef3fae295d0]: (4, ('ok\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:30:35 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-f7b85c12-12af-4c22-bff6-95d30e9bf010 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Flushing IO for device /dev/sdd {{(pid=73572) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 10:30:35 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:30:35 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:30:35 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.065s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:30:35 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[db0c250c-ab62-49f5-b31d-2d9c6a6f3865]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:30:35 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-f7b85c12-12af-4c22-bff6-95d30e9bf010 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73572) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 10:30:35 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:30:35 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.056s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:30:35 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[630b4482-0868-4a1d-806d-1b4b47fa9e87]: (4, ('1', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:30:35 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-f7b85c12-12af-4c22-bff6-95d30e9bf010 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73572) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 10:30:35 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-f7b85c12-12af-4c22-bff6-95d30e9bf010 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] SCSI volumes sdd have been removed. {{(pid=73572) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 10:30:35 user nova-compute[73572]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_99d0e4be', '/dev/disk/by-id/scsi-1SCST_BIO99d0e4be-b3517ac657ddfda5', '/dev/disk/by-id/scsi-26233353137616336') {{(pid=84543) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 26 10:30:35 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[8577984b-31c4-4cae-b3f2-5eae3967c52a]: (4, None) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:30:35 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7b85c12-12af-4c22-bff6-95d30e9bf010 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8c7946b2-965a-4156-9a34-72518f8596f0')] {{(pid=73572) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 10:30:35 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c7946b2-965a-4156-9a34-72518f8596f0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:30:35 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c7946b2-965a-4156-9a34-72518f8596f0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:30:35 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[224de95d-fda0-49a9-84c7-7f88f0264426]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:30:35 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7b85c12-12af-4c22-bff6-95d30e9bf010 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:30:35 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c7946b2-965a-4156-9a34-72518f8596f0 -p 172.16.0.220:3260 --logout {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:30:35 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c7946b2-965a-4156-9a34-72518f8596f0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.113s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:30:35 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[040d55cc-fde1-42c9-a1e5-2e0c93105332]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:8c7946b2-965a-4156-9a34-72518f8596f0, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:8c7946b2-965a-4156-9a34-72518f8596f0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:30:35 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7b85c12-12af-4c22-bff6-95d30e9bf010 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:8c7946b2-965a-4156-9a34-72518f8596f0, portal: 172.16.0.220,3260]
Aug 26 10:30:35 user nova-compute[73572]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:8c7946b2-965a-4156-9a34-72518f8596f0, portal: 172.16.0.220,3260] successful.
Aug 26 10:30:35 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:30:35 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c7946b2-965a-4156-9a34-72518f8596f0 -p 172.16.0.220:3260 --op delete {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:30:35 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c7946b2-965a-4156-9a34-72518f8596f0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:30:35 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[f002d16a-26cb-4706-9608-77facb39f74e]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:30:35 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7b85c12-12af-4c22-bff6-95d30e9bf010 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:30:35 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-f7b85c12-12af-4c22-bff6-95d30e9bf010 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.465s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 10:30:35 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7b85c12-12af-4c22-bff6-95d30e9bf010 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] <== disconnect_volume: return (466ms) None {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 10:30:35 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7b85c12-12af-4c22-bff6-95d30e9bf010 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 6076ed21-24d2-4921-b47e-f70702b0adf1] Disconnected iSCSI Volume {{(pid=73572) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 10:30:35 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-f7b85c12-12af-4c22-bff6-95d30e9bf010 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 6076ed21-24d2-4921-b47e-f70702b0adf1] Deleting instance files /opt/stack/data/nova/instances/6076ed21-24d2-4921-b47e-f70702b0adf1_del
Aug 26 10:30:35 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-f7b85c12-12af-4c22-bff6-95d30e9bf010 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 6076ed21-24d2-4921-b47e-f70702b0adf1] Deletion of /opt/stack/data/nova/instances/6076ed21-24d2-4921-b47e-f70702b0adf1_del complete
Aug 26 10:30:35 user nova-compute[73572]: INFO nova.compute.manager [None req-f7b85c12-12af-4c22-bff6-95d30e9bf010 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 6076ed21-24d2-4921-b47e-f70702b0adf1] Took 1.38 seconds to destroy the instance on the hypervisor.
Aug 26 10:30:35 user nova-compute[73572]: DEBUG oslo.service.loopingcall [None req-f7b85c12-12af-4c22-bff6-95d30e9bf010 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73572) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 10:30:35 user nova-compute[73572]: DEBUG nova.compute.manager [-] [instance: 6076ed21-24d2-4921-b47e-f70702b0adf1] Deallocating network for instance {{(pid=73572) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 10:30:35 user nova-compute[73572]: DEBUG nova.network.neutron [-] [instance: 6076ed21-24d2-4921-b47e-f70702b0adf1] deallocate_for_instance() {{(pid=73572) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 10:30:35 user nova-compute[73572]: DEBUG nova.compute.provider_tree [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Inventory has not changed in ProviderTree for provider: e2cec974-59b2-4c77-a53d-a7f4e5a30d75 {{(pid=73572) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 10:30:35 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Inventory has not changed for provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73572) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 10:30:35 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Compute_service record updated for user:user {{(pid=73572) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 10:30:35 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.757s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:30:36 user nova-compute[73572]: DEBUG nova.compute.manager [req-bc4cb302-2056-4731-bd79-e06e0c040012 req-cfdb6938-8df8-4dc5-8b85-6f9ed2fc5937 service nova] [instance: 6076ed21-24d2-4921-b47e-f70702b0adf1] Received event network-vif-plugged-49381412-2deb-4ed5-9b1c-3c693fefec38 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:30:36 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-bc4cb302-2056-4731-bd79-e06e0c040012 req-cfdb6938-8df8-4dc5-8b85-6f9ed2fc5937 service nova] Acquiring lock "6076ed21-24d2-4921-b47e-f70702b0adf1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:30:36 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-bc4cb302-2056-4731-bd79-e06e0c040012 req-cfdb6938-8df8-4dc5-8b85-6f9ed2fc5937 service nova] Lock "6076ed21-24d2-4921-b47e-f70702b0adf1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:30:36 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-bc4cb302-2056-4731-bd79-e06e0c040012 req-cfdb6938-8df8-4dc5-8b85-6f9ed2fc5937 service nova] Lock "6076ed21-24d2-4921-b47e-f70702b0adf1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:30:36 user nova-compute[73572]: DEBUG nova.compute.manager [req-bc4cb302-2056-4731-bd79-e06e0c040012 req-cfdb6938-8df8-4dc5-8b85-6f9ed2fc5937 service nova] [instance: 6076ed21-24d2-4921-b47e-f70702b0adf1] No waiting events found dispatching network-vif-plugged-49381412-2deb-4ed5-9b1c-3c693fefec38 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:30:36 user nova-compute[73572]: WARNING nova.compute.manager [req-bc4cb302-2056-4731-bd79-e06e0c040012 req-cfdb6938-8df8-4dc5-8b85-6f9ed2fc5937 service nova] [instance: 6076ed21-24d2-4921-b47e-f70702b0adf1] Received unexpected event network-vif-plugged-49381412-2deb-4ed5-9b1c-3c693fefec38 for instance with vm_state active and task_state deleting.
Aug 26 10:30:36 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:30:36 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:30:37 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:30:37 user nova-compute[73572]: DEBUG nova.network.neutron [-] [instance: 6076ed21-24d2-4921-b47e-f70702b0adf1] Updating instance_info_cache with network_info: [] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:30:37 user nova-compute[73572]: INFO nova.compute.manager [-] [instance: 6076ed21-24d2-4921-b47e-f70702b0adf1] Took 1.74 seconds to deallocate network for instance.
Aug 26 10:30:37 user nova-compute[73572]: DEBUG nova.compute.manager [req-a4ca78c5-3487-44e5-90bf-ed91a6e90cdc req-21992817-66e0-45e4-8124-7dc6d83ce5ed service nova] [instance: 6076ed21-24d2-4921-b47e-f70702b0adf1] Received event network-vif-deleted-49381412-2deb-4ed5-9b1c-3c693fefec38 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:30:38 user nova-compute[73572]: INFO nova.compute.manager [None req-f7b85c12-12af-4c22-bff6-95d30e9bf010 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 6076ed21-24d2-4921-b47e-f70702b0adf1] Took 0.76 seconds to detach 1 volumes for instance.
Aug 26 10:30:38 user nova-compute[73572]: DEBUG nova.compute.manager [None req-f7b85c12-12af-4c22-bff6-95d30e9bf010 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 6076ed21-24d2-4921-b47e-f70702b0adf1] Deleting volume: 8c7946b2-965a-4156-9a34-72518f8596f0 {{(pid=73572) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 26 10:30:38 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-f7b85c12-12af-4c22-bff6-95d30e9bf010 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:30:38 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-f7b85c12-12af-4c22-bff6-95d30e9bf010 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:30:38 user nova-compute[73572]: DEBUG nova.compute.provider_tree [None req-f7b85c12-12af-4c22-bff6-95d30e9bf010 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Inventory has not changed in ProviderTree for provider: e2cec974-59b2-4c77-a53d-a7f4e5a30d75 {{(pid=73572) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 10:30:38 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-f7b85c12-12af-4c22-bff6-95d30e9bf010 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Inventory has not changed for provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73572) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 10:30:38 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-f7b85c12-12af-4c22-bff6-95d30e9bf010 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.457s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:30:38 user nova-compute[73572]: INFO nova.scheduler.client.report [None req-f7b85c12-12af-4c22-bff6-95d30e9bf010 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Deleted allocations for instance 6076ed21-24d2-4921-b47e-f70702b0adf1
Aug 26 10:30:38 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-f7b85c12-12af-4c22-bff6-95d30e9bf010 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Lock "6076ed21-24d2-4921-b47e-f70702b0adf1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.636s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:30:40 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:30:40 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:30:45 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:30:45 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:30:50 user nova-compute[73572]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693045835.053559, 6076ed21-24d2-4921-b47e-f70702b0adf1 => Stopped> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:30:50 user nova-compute[73572]: INFO nova.compute.manager [-] [instance: 6076ed21-24d2-4921-b47e-f70702b0adf1] VM Stopped (Lifecycle Event)
Aug 26 10:30:50 user nova-compute[73572]: DEBUG nova.compute.manager [None req-c264503c-0c83-4117-a346-3165b8a10a64 None None] [instance: 6076ed21-24d2-4921-b47e-f70702b0adf1] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:30:50 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:30:50 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:30:51 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-5fd6f453-e42d-433e-8f77-e40738bdb6c5 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Acquiring lock "773c7bf7-a911-4b80-9cef-5cc563257b7b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:30:51 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-5fd6f453-e42d-433e-8f77-e40738bdb6c5 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Lock "773c7bf7-a911-4b80-9cef-5cc563257b7b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:30:51 user nova-compute[73572]: DEBUG nova.compute.manager [None req-5fd6f453-e42d-433e-8f77-e40738bdb6c5 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] [instance: 773c7bf7-a911-4b80-9cef-5cc563257b7b] Starting instance... {{(pid=73572) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 10:30:51 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-5fd6f453-e42d-433e-8f77-e40738bdb6c5 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:30:51 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-5fd6f453-e42d-433e-8f77-e40738bdb6c5 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:30:51 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-5fd6f453-e42d-433e-8f77-e40738bdb6c5 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73572) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 10:30:51 user nova-compute[73572]: INFO nova.compute.claims [None req-5fd6f453-e42d-433e-8f77-e40738bdb6c5 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] [instance: 773c7bf7-a911-4b80-9cef-5cc563257b7b] Claim successful on node user
Aug 26 10:30:51 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-2a23c8a0-95df-4dd6-b8eb-cc2ec9fbc5fb tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Acquiring lock "6b2d5f4e-37af-438c-859b-d4ca803b7d08" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:30:51 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-2a23c8a0-95df-4dd6-b8eb-cc2ec9fbc5fb tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Lock "6b2d5f4e-37af-438c-859b-d4ca803b7d08" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:30:51 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-2a23c8a0-95df-4dd6-b8eb-cc2ec9fbc5fb tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Acquiring lock "6b2d5f4e-37af-438c-859b-d4ca803b7d08-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:30:51 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-2a23c8a0-95df-4dd6-b8eb-cc2ec9fbc5fb tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Lock "6b2d5f4e-37af-438c-859b-d4ca803b7d08-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:30:51 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-2a23c8a0-95df-4dd6-b8eb-cc2ec9fbc5fb tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Lock "6b2d5f4e-37af-438c-859b-d4ca803b7d08-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:30:51 user nova-compute[73572]: INFO nova.compute.manager [None req-2a23c8a0-95df-4dd6-b8eb-cc2ec9fbc5fb tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] [instance: 6b2d5f4e-37af-438c-859b-d4ca803b7d08] Terminating instance
Aug 26 10:30:51 user nova-compute[73572]: DEBUG nova.compute.manager [None req-2a23c8a0-95df-4dd6-b8eb-cc2ec9fbc5fb tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] [instance: 6b2d5f4e-37af-438c-859b-d4ca803b7d08] Start destroying the instance on the hypervisor. {{(pid=73572) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 10:30:51 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:30:51 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:30:51 user nova-compute[73572]: DEBUG nova.compute.provider_tree [None req-5fd6f453-e42d-433e-8f77-e40738bdb6c5 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Inventory has not changed in ProviderTree for provider: e2cec974-59b2-4c77-a53d-a7f4e5a30d75 {{(pid=73572) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 10:30:51 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-5fd6f453-e42d-433e-8f77-e40738bdb6c5 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Inventory has not changed for provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73572) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 10:30:52 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-5fd6f453-e42d-433e-8f77-e40738bdb6c5 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.474s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:30:52 user nova-compute[73572]: DEBUG nova.compute.manager [None req-5fd6f453-e42d-433e-8f77-e40738bdb6c5 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] [instance: 773c7bf7-a911-4b80-9cef-5cc563257b7b] Start building networks asynchronously for instance. {{(pid=73572) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 10:30:52 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:30:52 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:30:52 user nova-compute[73572]: DEBUG nova.compute.manager [None req-5fd6f453-e42d-433e-8f77-e40738bdb6c5 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] [instance: 773c7bf7-a911-4b80-9cef-5cc563257b7b] Allocating IP information in the background. {{(pid=73572) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 10:30:52 user nova-compute[73572]: DEBUG nova.network.neutron [None req-5fd6f453-e42d-433e-8f77-e40738bdb6c5 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] [instance: 773c7bf7-a911-4b80-9cef-5cc563257b7b] allocate_for_instance() {{(pid=73572) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 10:30:52 user nova-compute[73572]: DEBUG nova.compute.manager [req-53b2c1a0-65c1-4aac-9044-1cc1e2cdef26 req-357dbc73-b56b-472a-958f-b56b24df9197 service nova] [instance: 6b2d5f4e-37af-438c-859b-d4ca803b7d08] Received event network-vif-unplugged-bf886914-b734-4957-9e48-4ef3d65c61f4 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:30:52 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-53b2c1a0-65c1-4aac-9044-1cc1e2cdef26 req-357dbc73-b56b-472a-958f-b56b24df9197 service nova] Acquiring lock "6b2d5f4e-37af-438c-859b-d4ca803b7d08-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:30:52 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-53b2c1a0-65c1-4aac-9044-1cc1e2cdef26 req-357dbc73-b56b-472a-958f-b56b24df9197 service nova] Lock "6b2d5f4e-37af-438c-859b-d4ca803b7d08-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:30:52 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-53b2c1a0-65c1-4aac-9044-1cc1e2cdef26 req-357dbc73-b56b-472a-958f-b56b24df9197 service nova] Lock "6b2d5f4e-37af-438c-859b-d4ca803b7d08-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:30:52 user nova-compute[73572]: DEBUG nova.compute.manager [req-53b2c1a0-65c1-4aac-9044-1cc1e2cdef26 req-357dbc73-b56b-472a-958f-b56b24df9197 service nova] [instance: 6b2d5f4e-37af-438c-859b-d4ca803b7d08] No waiting events found dispatching network-vif-unplugged-bf886914-b734-4957-9e48-4ef3d65c61f4 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:30:52 user nova-compute[73572]: DEBUG nova.compute.manager [req-53b2c1a0-65c1-4aac-9044-1cc1e2cdef26 req-357dbc73-b56b-472a-958f-b56b24df9197 service nova] [instance: 6b2d5f4e-37af-438c-859b-d4ca803b7d08] Received event network-vif-unplugged-bf886914-b734-4957-9e48-4ef3d65c61f4 for instance with task_state deleting. {{(pid=73572) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 10:30:52 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-5fd6f453-e42d-433e-8f77-e40738bdb6c5 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] [instance: 773c7bf7-a911-4b80-9cef-5cc563257b7b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 10:30:52 user nova-compute[73572]: DEBUG nova.compute.manager [None req-5fd6f453-e42d-433e-8f77-e40738bdb6c5 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] [instance: 773c7bf7-a911-4b80-9cef-5cc563257b7b] Start building block device mappings for instance. {{(pid=73572) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 10:30:52 user nova-compute[73572]: DEBUG nova.policy [None req-5fd6f453-e42d-433e-8f77-e40738bdb6c5 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c7cf9c8d529d49149141add20c2b2af2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47abd6293c07465389c379e3b5061164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73572) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 10:30:52 user nova-compute[73572]: DEBUG nova.compute.manager [None req-5fd6f453-e42d-433e-8f77-e40738bdb6c5 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] [instance: 773c7bf7-a911-4b80-9cef-5cc563257b7b] Start spawning the instance on the hypervisor. {{(pid=73572) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 10:30:52 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-5fd6f453-e42d-433e-8f77-e40738bdb6c5 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] [instance: 773c7bf7-a911-4b80-9cef-5cc563257b7b] Creating instance directory {{(pid=73572) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 10:30:52 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-5fd6f453-e42d-433e-8f77-e40738bdb6c5 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] [instance: 773c7bf7-a911-4b80-9cef-5cc563257b7b] Creating image(s)
Aug 26 10:30:52 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-5fd6f453-e42d-433e-8f77-e40738bdb6c5 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Acquiring lock "/opt/stack/data/nova/instances/773c7bf7-a911-4b80-9cef-5cc563257b7b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:30:52 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-5fd6f453-e42d-433e-8f77-e40738bdb6c5 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Lock "/opt/stack/data/nova/instances/773c7bf7-a911-4b80-9cef-5cc563257b7b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:30:52 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-5fd6f453-e42d-433e-8f77-e40738bdb6c5 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Lock "/opt/stack/data/nova/instances/773c7bf7-a911-4b80-9cef-5cc563257b7b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:30:52 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-5fd6f453-e42d-433e-8f77-e40738bdb6c5 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:30:52 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-5fd6f453-e42d-433e-8f77-e40738bdb6c5 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json" returned: 0 in 0.188s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:30:52 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-5fd6f453-e42d-433e-8f77-e40738bdb6c5 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Acquiring lock "2099350d6f3bcd0de9471c73862d4fe75b049801" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:30:52 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-5fd6f453-e42d-433e-8f77-e40738bdb6c5 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Lock "2099350d6f3bcd0de9471c73862d4fe75b049801" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:30:52 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-5fd6f453-e42d-433e-8f77-e40738bdb6c5 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:30:52 user nova-compute[73572]: INFO nova.virt.libvirt.driver [-] [instance: 6b2d5f4e-37af-438c-859b-d4ca803b7d08] Instance destroyed successfully.
Aug 26 10:30:52 user nova-compute[73572]: DEBUG nova.objects.instance [None req-2a23c8a0-95df-4dd6-b8eb-cc2ec9fbc5fb tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Lazy-loading 'resources' on Instance uuid 6b2d5f4e-37af-438c-859b-d4ca803b7d08 {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:30:52 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-2a23c8a0-95df-4dd6-b8eb-cc2ec9fbc5fb tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-26T10:25:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-665480809',display_name='tempest-ServerActionsTestOtherA-server-1892262121',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-665480809',id=35,image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO0nFuNIAmrcfF466dgWUoupbXiGxPDsRpOPU+BV/xU9so0Ahdwm8Jau8//ZWYq9Zw/pxbXy2f1pHOKtRMmBUc3daXPj1Sj1rpkWaf2AN4lE7ndY37vYFGh9kavZVJ2YNQ==',key_name='tempest-keypair-586663623',keypairs=<?>,launch_index=0,launched_at=2023-08-26T10:27:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7935bccc360b46b589fd57d53f334595',ramdisk_id='',reservation_id='r-2h5gmgf0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-203628695',owner_user_name='tempest-ServerActionsTestOtherA-203628695-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T10:27:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='61b6124f6f6e44c5b2fd0202a15da019',uuid=6b2d5f4e-37af-438c-859b-d4ca803b7d08,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bf886914-b734-4957-9e48-4ef3d65c61f4", "address": "fa:16:3e:b4:aa:52", "network": {"id": "43215883-3d00-4be7-8c40-bdaf3f01bef9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1088544153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7935bccc360b46b589fd57d53f334595", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf886914-b7", "ovs_interfaceid": "bf886914-b734-4957-9e48-4ef3d65c61f4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 10:30:52 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-2a23c8a0-95df-4dd6-b8eb-cc2ec9fbc5fb tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Converting VIF {"id": "bf886914-b734-4957-9e48-4ef3d65c61f4", "address": "fa:16:3e:b4:aa:52", "network": {"id": "43215883-3d00-4be7-8c40-bdaf3f01bef9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1088544153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7935bccc360b46b589fd57d53f334595", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf886914-b7", "ovs_interfaceid": "bf886914-b734-4957-9e48-4ef3d65c61f4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:30:52 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-2a23c8a0-95df-4dd6-b8eb-cc2ec9fbc5fb tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b4:aa:52,bridge_name='br-int',has_traffic_filtering=True,id=bf886914-b734-4957-9e48-4ef3d65c61f4,network=Network(43215883-3d00-4be7-8c40-bdaf3f01bef9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf886914-b7') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:30:52 user nova-compute[73572]: DEBUG os_vif [None req-2a23c8a0-95df-4dd6-b8eb-cc2ec9fbc5fb tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b4:aa:52,bridge_name='br-int',has_traffic_filtering=True,id=bf886914-b734-4957-9e48-4ef3d65c61f4,network=Network(43215883-3d00-4be7-8c40-bdaf3f01bef9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf886914-b7') {{(pid=73572) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 10:30:52 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:30:52 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbf886914-b7, bridge=br-int, if_exists=True) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:30:52 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:30:52 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:30:52 user nova-compute[73572]: INFO os_vif [None req-2a23c8a0-95df-4dd6-b8eb-cc2ec9fbc5fb tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b4:aa:52,bridge_name='br-int',has_traffic_filtering=True,id=bf886914-b734-4957-9e48-4ef3d65c61f4,network=Network(43215883-3d00-4be7-8c40-bdaf3f01bef9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf886914-b7')
Aug 26 10:30:52 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-2a23c8a0-95df-4dd6-b8eb-cc2ec9fbc5fb tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] [instance: 6b2d5f4e-37af-438c-859b-d4ca803b7d08] Deleting instance files /opt/stack/data/nova/instances/6b2d5f4e-37af-438c-859b-d4ca803b7d08_del
Aug 26 10:30:52 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-2a23c8a0-95df-4dd6-b8eb-cc2ec9fbc5fb tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] [instance: 6b2d5f4e-37af-438c-859b-d4ca803b7d08] Deletion of /opt/stack/data/nova/instances/6b2d5f4e-37af-438c-859b-d4ca803b7d08_del complete
Aug 26 10:30:52 user nova-compute[73572]: INFO nova.compute.manager [None req-2a23c8a0-95df-4dd6-b8eb-cc2ec9fbc5fb tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] [instance: 6b2d5f4e-37af-438c-859b-d4ca803b7d08] Took 0.94 seconds to destroy the instance on the hypervisor.
Aug 26 10:30:52 user nova-compute[73572]: DEBUG oslo.service.loopingcall [None req-2a23c8a0-95df-4dd6-b8eb-cc2ec9fbc5fb tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73572) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 10:30:52 user nova-compute[73572]: DEBUG nova.compute.manager [-] [instance: 6b2d5f4e-37af-438c-859b-d4ca803b7d08] Deallocating network for instance {{(pid=73572) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 10:30:52 user nova-compute[73572]: DEBUG nova.network.neutron [-] [instance: 6b2d5f4e-37af-438c-859b-d4ca803b7d08] deallocate_for_instance() {{(pid=73572) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 10:30:52 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-5fd6f453-e42d-433e-8f77-e40738bdb6c5 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json" returned: 0 in 0.193s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:30:52 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-5fd6f453-e42d-433e-8f77-e40738bdb6c5 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801,backing_fmt=raw /opt/stack/data/nova/instances/773c7bf7-a911-4b80-9cef-5cc563257b7b/disk 1073741824 {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:30:52 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-5fd6f453-e42d-433e-8f77-e40738bdb6c5 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801,backing_fmt=raw /opt/stack/data/nova/instances/773c7bf7-a911-4b80-9cef-5cc563257b7b/disk 1073741824" returned: 0 in 0.055s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:30:52 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-5fd6f453-e42d-433e-8f77-e40738bdb6c5 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Lock "2099350d6f3bcd0de9471c73862d4fe75b049801" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.253s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:30:52 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-5fd6f453-e42d-433e-8f77-e40738bdb6c5 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:30:52 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-5fd6f453-e42d-433e-8f77-e40738bdb6c5 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json" returned: 0 in 0.191s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:30:52 user nova-compute[73572]: DEBUG nova.virt.disk.api [None req-5fd6f453-e42d-433e-8f77-e40738bdb6c5 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Checking if we can resize image /opt/stack/data/nova/instances/773c7bf7-a911-4b80-9cef-5cc563257b7b/disk. size=1073741824 {{(pid=73572) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 10:30:52 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-5fd6f453-e42d-433e-8f77-e40738bdb6c5 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/773c7bf7-a911-4b80-9cef-5cc563257b7b/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:30:53 user nova-compute[73572]: DEBUG nova.network.neutron [None req-5fd6f453-e42d-433e-8f77-e40738bdb6c5 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] [instance: 773c7bf7-a911-4b80-9cef-5cc563257b7b] Successfully created port: 761ae86a-09b9-4010-8a18-3687cc70a2ef {{(pid=73572) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 10:30:53 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-5fd6f453-e42d-433e-8f77-e40738bdb6c5 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/773c7bf7-a911-4b80-9cef-5cc563257b7b/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:30:53 user nova-compute[73572]: DEBUG nova.virt.disk.api [None req-5fd6f453-e42d-433e-8f77-e40738bdb6c5 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Cannot resize image /opt/stack/data/nova/instances/773c7bf7-a911-4b80-9cef-5cc563257b7b/disk to a smaller size. {{(pid=73572) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 10:30:53 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-5fd6f453-e42d-433e-8f77-e40738bdb6c5 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] [instance: 773c7bf7-a911-4b80-9cef-5cc563257b7b] Created local disks {{(pid=73572) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 10:30:53 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-5fd6f453-e42d-433e-8f77-e40738bdb6c5 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] [instance: 773c7bf7-a911-4b80-9cef-5cc563257b7b] Ensure instance console log exists: /opt/stack/data/nova/instances/773c7bf7-a911-4b80-9cef-5cc563257b7b/console.log {{(pid=73572) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 10:30:53 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-5fd6f453-e42d-433e-8f77-e40738bdb6c5 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:30:53 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-5fd6f453-e42d-433e-8f77-e40738bdb6c5 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:30:53 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-5fd6f453-e42d-433e-8f77-e40738bdb6c5 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:30:53 user nova-compute[73572]: DEBUG nova.network.neutron [-] [instance: 6b2d5f4e-37af-438c-859b-d4ca803b7d08] Updating instance_info_cache with network_info: [] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:30:53 user nova-compute[73572]: INFO nova.compute.manager [-] [instance: 6b2d5f4e-37af-438c-859b-d4ca803b7d08] Took 1.07 seconds to deallocate network for instance.
Aug 26 10:30:53 user nova-compute[73572]: DEBUG nova.compute.manager [req-b9d94f45-c062-4fc1-a526-d9751b5da22b req-21cc7152-69fb-435e-a8ec-ec846b270200 service nova] [instance: 6b2d5f4e-37af-438c-859b-d4ca803b7d08] Received event network-vif-deleted-bf886914-b734-4957-9e48-4ef3d65c61f4 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:30:53 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-2a23c8a0-95df-4dd6-b8eb-cc2ec9fbc5fb tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:30:53 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-2a23c8a0-95df-4dd6-b8eb-cc2ec9fbc5fb tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:30:53 user nova-compute[73572]: DEBUG nova.network.neutron [None req-5fd6f453-e42d-433e-8f77-e40738bdb6c5 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] [instance: 773c7bf7-a911-4b80-9cef-5cc563257b7b] Successfully updated port: 761ae86a-09b9-4010-8a18-3687cc70a2ef {{(pid=73572) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 10:30:53 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-5fd6f453-e42d-433e-8f77-e40738bdb6c5 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Acquiring lock "refresh_cache-773c7bf7-a911-4b80-9cef-5cc563257b7b" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:30:53 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-5fd6f453-e42d-433e-8f77-e40738bdb6c5 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Acquired lock "refresh_cache-773c7bf7-a911-4b80-9cef-5cc563257b7b" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:30:53 user nova-compute[73572]: DEBUG nova.network.neutron [None req-5fd6f453-e42d-433e-8f77-e40738bdb6c5 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] [instance: 773c7bf7-a911-4b80-9cef-5cc563257b7b] Building network info cache for instance {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 10:30:53 user nova-compute[73572]: DEBUG nova.compute.manager [req-f0168a56-bc01-486e-ba92-997fb63a2d61 req-6dcf3fb6-1118-4508-81e9-a7447712c292 service nova] [instance: 773c7bf7-a911-4b80-9cef-5cc563257b7b] Received event network-changed-761ae86a-09b9-4010-8a18-3687cc70a2ef {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:30:53 user nova-compute[73572]: DEBUG nova.compute.manager [req-f0168a56-bc01-486e-ba92-997fb63a2d61 req-6dcf3fb6-1118-4508-81e9-a7447712c292 service nova] [instance: 773c7bf7-a911-4b80-9cef-5cc563257b7b] Refreshing instance network info cache due to event network-changed-761ae86a-09b9-4010-8a18-3687cc70a2ef. {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 10:30:53 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-f0168a56-bc01-486e-ba92-997fb63a2d61 req-6dcf3fb6-1118-4508-81e9-a7447712c292 service nova] Acquiring lock "refresh_cache-773c7bf7-a911-4b80-9cef-5cc563257b7b" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:30:53 user nova-compute[73572]: DEBUG nova.network.neutron [None req-5fd6f453-e42d-433e-8f77-e40738bdb6c5 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] [instance: 773c7bf7-a911-4b80-9cef-5cc563257b7b] Instance cache missing network info. {{(pid=73572) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 10:30:54 user nova-compute[73572]: DEBUG nova.compute.provider_tree [None req-2a23c8a0-95df-4dd6-b8eb-cc2ec9fbc5fb tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Inventory has not changed in ProviderTree for provider: e2cec974-59b2-4c77-a53d-a7f4e5a30d75 {{(pid=73572) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 10:30:54 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-2a23c8a0-95df-4dd6-b8eb-cc2ec9fbc5fb tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Inventory has not changed for provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73572) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 10:30:54 user nova-compute[73572]: DEBUG nova.compute.manager [req-60c20a9a-9f55-41d7-ad49-a303fd27f802 req-5315610c-ceb2-49ab-b7ba-6723d8507ab2 service nova] [instance: 6b2d5f4e-37af-438c-859b-d4ca803b7d08] Received event network-vif-plugged-bf886914-b734-4957-9e48-4ef3d65c61f4 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:30:54 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-60c20a9a-9f55-41d7-ad49-a303fd27f802 req-5315610c-ceb2-49ab-b7ba-6723d8507ab2 service nova] Acquiring lock "6b2d5f4e-37af-438c-859b-d4ca803b7d08-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:30:54 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-60c20a9a-9f55-41d7-ad49-a303fd27f802 req-5315610c-ceb2-49ab-b7ba-6723d8507ab2 service nova] Lock "6b2d5f4e-37af-438c-859b-d4ca803b7d08-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:30:54 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-60c20a9a-9f55-41d7-ad49-a303fd27f802 req-5315610c-ceb2-49ab-b7ba-6723d8507ab2 service nova] Lock "6b2d5f4e-37af-438c-859b-d4ca803b7d08-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:30:54 user nova-compute[73572]: DEBUG nova.compute.manager [req-60c20a9a-9f55-41d7-ad49-a303fd27f802 req-5315610c-ceb2-49ab-b7ba-6723d8507ab2 service nova] [instance: 6b2d5f4e-37af-438c-859b-d4ca803b7d08] No waiting events found dispatching network-vif-plugged-bf886914-b734-4957-9e48-4ef3d65c61f4 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:30:54 user nova-compute[73572]: WARNING nova.compute.manager [req-60c20a9a-9f55-41d7-ad49-a303fd27f802 req-5315610c-ceb2-49ab-b7ba-6723d8507ab2 service nova] [instance: 6b2d5f4e-37af-438c-859b-d4ca803b7d08] Received unexpected event network-vif-plugged-bf886914-b734-4957-9e48-4ef3d65c61f4 for instance with vm_state deleted and task_state None.
Aug 26 10:30:54 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-2a23c8a0-95df-4dd6-b8eb-cc2ec9fbc5fb tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.371s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:30:54 user nova-compute[73572]: DEBUG nova.network.neutron [None req-5fd6f453-e42d-433e-8f77-e40738bdb6c5 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] [instance: 773c7bf7-a911-4b80-9cef-5cc563257b7b] Updating instance_info_cache with network_info: [{"id": "761ae86a-09b9-4010-8a18-3687cc70a2ef", "address": "fa:16:3e:49:ea:41", "network": {"id": "880aa066-8f77-469b-a0c4-e4e94ae31e1a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-313654920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47abd6293c07465389c379e3b5061164", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap761ae86a-09", "ovs_interfaceid": "761ae86a-09b9-4010-8a18-3687cc70a2ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:30:54 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-5fd6f453-e42d-433e-8f77-e40738bdb6c5 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Releasing lock "refresh_cache-773c7bf7-a911-4b80-9cef-5cc563257b7b" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:30:54 user nova-compute[73572]: DEBUG nova.compute.manager [None req-5fd6f453-e42d-433e-8f77-e40738bdb6c5 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] [instance: 773c7bf7-a911-4b80-9cef-5cc563257b7b] Instance network_info: |[{"id": "761ae86a-09b9-4010-8a18-3687cc70a2ef", "address": "fa:16:3e:49:ea:41", "network": {"id": "880aa066-8f77-469b-a0c4-e4e94ae31e1a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-313654920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47abd6293c07465389c379e3b5061164", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap761ae86a-09", "ovs_interfaceid": "761ae86a-09b9-4010-8a18-3687cc70a2ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73572) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 10:30:54 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-f0168a56-bc01-486e-ba92-997fb63a2d61 req-6dcf3fb6-1118-4508-81e9-a7447712c292 service nova] Acquired lock "refresh_cache-773c7bf7-a911-4b80-9cef-5cc563257b7b" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:30:54 user nova-compute[73572]: DEBUG nova.network.neutron [req-f0168a56-bc01-486e-ba92-997fb63a2d61 req-6dcf3fb6-1118-4508-81e9-a7447712c292 service nova] [instance: 773c7bf7-a911-4b80-9cef-5cc563257b7b] Refreshing network info cache for port 761ae86a-09b9-4010-8a18-3687cc70a2ef {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 10:30:54 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-5fd6f453-e42d-433e-8f77-e40738bdb6c5 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] [instance: 773c7bf7-a911-4b80-9cef-5cc563257b7b] Start _get_guest_xml network_info=[{"id": "761ae86a-09b9-4010-8a18-3687cc70a2ef", "address": "fa:16:3e:49:ea:41", "network": {"id": "880aa066-8f77-469b-a0c4-e4e94ae31e1a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-313654920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47abd6293c07465389c379e3b5061164", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap761ae86a-09", "ovs_interfaceid": "761ae86a-09b9-4010-8a18-3687cc70a2ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T10:07:33Z,direct_url=<?>,disk_format='qcow2',id=299da0c9-e1c4-48f0-be55-fbe20dd06bc9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5c995f8bbbab4368b67a253e0df3971a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T10:07:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'guest_format': None, 'size': 0, 'encryption_format': None, 'device_type': 'disk', 'image_id': '299da0c9-e1c4-48f0-be55-fbe20dd06bc9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73572) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 10:30:54 user nova-compute[73572]: INFO nova.scheduler.client.report [None req-2a23c8a0-95df-4dd6-b8eb-cc2ec9fbc5fb tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Deleted allocations for instance 6b2d5f4e-37af-438c-859b-d4ca803b7d08
Aug 26 10:30:54 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-5fd6f453-e42d-433e-8f77-e40738bdb6c5 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:30:54 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-5fd6f453-e42d-433e-8f77-e40738bdb6c5 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:30:54 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-5fd6f453-e42d-433e-8f77-e40738bdb6c5 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73572) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 10:30:54 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-5fd6f453-e42d-433e-8f77-e40738bdb6c5 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] CPU controller missing on host. {{(pid=73572) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 10:30:54 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-5fd6f453-e42d-433e-8f77-e40738bdb6c5 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73572) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 10:30:54 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-5fd6f453-e42d-433e-8f77-e40738bdb6c5 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] CPU controller found on host. {{(pid=73572) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 10:30:54 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-5fd6f453-e42d-433e-8f77-e40738bdb6c5 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73572) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 10:30:54 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-5fd6f453-e42d-433e-8f77-e40738bdb6c5 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T10:07:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T10:07:33Z,direct_url=<?>,disk_format='qcow2',id=299da0c9-e1c4-48f0-be55-fbe20dd06bc9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5c995f8bbbab4368b67a253e0df3971a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T10:07:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 10:30:54 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-5fd6f453-e42d-433e-8f77-e40738bdb6c5 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Flavor limits 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 10:30:54 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-5fd6f453-e42d-433e-8f77-e40738bdb6c5 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Image limits 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 10:30:54 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-5fd6f453-e42d-433e-8f77-e40738bdb6c5 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Flavor pref 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 10:30:54 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-5fd6f453-e42d-433e-8f77-e40738bdb6c5 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Image pref 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 10:30:54 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-5fd6f453-e42d-433e-8f77-e40738bdb6c5 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 10:30:54 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-5fd6f453-e42d-433e-8f77-e40738bdb6c5 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 10:30:54 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-5fd6f453-e42d-433e-8f77-e40738bdb6c5 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73572) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 10:30:54 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-5fd6f453-e42d-433e-8f77-e40738bdb6c5 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Got 1 possible topologies {{(pid=73572) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 10:30:54 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-5fd6f453-e42d-433e-8f77-e40738bdb6c5 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 10:30:54 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-5fd6f453-e42d-433e-8f77-e40738bdb6c5 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 10:30:54 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-5fd6f453-e42d-433e-8f77-e40738bdb6c5 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T10:30:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1348178164',display_name='tempest-AttachVolumeNegativeTest-server-1348178164',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1348178164',id=43,image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO1IyEtqvTht3+0cvY+RFftB+h864Tk7wVXdQJ1zgSM01VRM6rPUKTJUZt5ZumSSWh1WeG7QUN9WXPhwQqS6SUYYtpEPXx6p8KKbLGaHx3/vMWRqhMLk8/ft8BndF0TQyw==',key_name='tempest-keypair-1023132651',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='47abd6293c07465389c379e3b5061164',ramdisk_id='',reservation_id='r-rmg7mk9x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-608798758',owner_user_name='tempest-AttachVolumeNegativeTest-608798758-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T10:30:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c7cf9c8d529d49149141add20c2b2af2',uuid=773c7bf7-a911-4b80-9cef-5cc563257b7b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "761ae86a-09b9-4010-8a18-3687cc70a2ef", "address": "fa:16:3e:49:ea:41", "network": {"id": "880aa066-8f77-469b-a0c4-e4e94ae31e1a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-313654920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47abd6293c07465389c379e3b5061164", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap761ae86a-09", "ovs_interfaceid": "761ae86a-09b9-4010-8a18-3687cc70a2ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73572) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 10:30:54 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-5fd6f453-e42d-433e-8f77-e40738bdb6c5 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Converting VIF {"id": "761ae86a-09b9-4010-8a18-3687cc70a2ef", "address": "fa:16:3e:49:ea:41", "network": {"id": "880aa066-8f77-469b-a0c4-e4e94ae31e1a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-313654920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47abd6293c07465389c379e3b5061164", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap761ae86a-09", "ovs_interfaceid": "761ae86a-09b9-4010-8a18-3687cc70a2ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:30:54 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-5fd6f453-e42d-433e-8f77-e40738bdb6c5 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:49:ea:41,bridge_name='br-int',has_traffic_filtering=True,id=761ae86a-09b9-4010-8a18-3687cc70a2ef,network=Network(880aa066-8f77-469b-a0c4-e4e94ae31e1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap761ae86a-09') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:30:54 user nova-compute[73572]: DEBUG nova.objects.instance [None req-5fd6f453-e42d-433e-8f77-e40738bdb6c5 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Lazy-loading 'pci_devices' on Instance uuid 773c7bf7-a911-4b80-9cef-5cc563257b7b {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:30:54 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-2a23c8a0-95df-4dd6-b8eb-cc2ec9fbc5fb tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Lock "6b2d5f4e-37af-438c-859b-d4ca803b7d08" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.576s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:30:54 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-5fd6f453-e42d-433e-8f77-e40738bdb6c5 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] [instance: 773c7bf7-a911-4b80-9cef-5cc563257b7b] End _get_guest_xml xml=<domain type="kvm">
Aug 26 10:30:54 user nova-compute[73572]:   <uuid>773c7bf7-a911-4b80-9cef-5cc563257b7b</uuid>
Aug 26 10:30:54 user nova-compute[73572]:   <name>instance-0000002b</name>
Aug 26 10:30:54 user nova-compute[73572]:   <memory>524288</memory>
Aug 26 10:30:54 user nova-compute[73572]:   <vcpu>1</vcpu>
Aug 26 10:30:54 user nova-compute[73572]:   <metadata>
Aug 26 10:30:54 user nova-compute[73572]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 10:30:54 user nova-compute[73572]:       <nova:package version="0.0.0"/>
Aug 26 10:30:54 user nova-compute[73572]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1348178164</nova:name>
Aug 26 10:30:54 user nova-compute[73572]:       <nova:creationTime>2023-08-26 10:30:54</nova:creationTime>
Aug 26 10:30:54 user nova-compute[73572]:       <nova:flavor name="m1.tiny">
Aug 26 10:30:54 user nova-compute[73572]:         <nova:memory>512</nova:memory>
Aug 26 10:30:54 user nova-compute[73572]:         <nova:disk>1</nova:disk>
Aug 26 10:30:54 user nova-compute[73572]:         <nova:swap>0</nova:swap>
Aug 26 10:30:54 user nova-compute[73572]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 10:30:54 user nova-compute[73572]:         <nova:vcpus>1</nova:vcpus>
Aug 26 10:30:54 user nova-compute[73572]:       </nova:flavor>
Aug 26 10:30:54 user nova-compute[73572]:       <nova:owner>
Aug 26 10:30:54 user nova-compute[73572]:         <nova:user uuid="c7cf9c8d529d49149141add20c2b2af2">tempest-AttachVolumeNegativeTest-608798758-project-member</nova:user>
Aug 26 10:30:54 user nova-compute[73572]:         <nova:project uuid="47abd6293c07465389c379e3b5061164">tempest-AttachVolumeNegativeTest-608798758</nova:project>
Aug 26 10:30:54 user nova-compute[73572]:       </nova:owner>
Aug 26 10:30:54 user nova-compute[73572]:       <nova:root type="image" uuid="299da0c9-e1c4-48f0-be55-fbe20dd06bc9"/>
Aug 26 10:30:54 user nova-compute[73572]:       <nova:ports>
Aug 26 10:30:54 user nova-compute[73572]:         <nova:port uuid="761ae86a-09b9-4010-8a18-3687cc70a2ef">
Aug 26 10:30:54 user nova-compute[73572]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 26 10:30:54 user nova-compute[73572]:         </nova:port>
Aug 26 10:30:54 user nova-compute[73572]:       </nova:ports>
Aug 26 10:30:54 user nova-compute[73572]:     </nova:instance>
Aug 26 10:30:54 user nova-compute[73572]:   </metadata>
Aug 26 10:30:54 user nova-compute[73572]:   <sysinfo type="smbios">
Aug 26 10:30:54 user nova-compute[73572]:     <system>
Aug 26 10:30:54 user nova-compute[73572]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 10:30:54 user nova-compute[73572]:       <entry name="product">OpenStack Nova</entry>
Aug 26 10:30:54 user nova-compute[73572]:       <entry name="version">0.0.0</entry>
Aug 26 10:30:54 user nova-compute[73572]:       <entry name="serial">773c7bf7-a911-4b80-9cef-5cc563257b7b</entry>
Aug 26 10:30:54 user nova-compute[73572]:       <entry name="uuid">773c7bf7-a911-4b80-9cef-5cc563257b7b</entry>
Aug 26 10:30:54 user nova-compute[73572]:       <entry name="family">Virtual Machine</entry>
Aug 26 10:30:54 user nova-compute[73572]:     </system>
Aug 26 10:30:54 user nova-compute[73572]:   </sysinfo>
Aug 26 10:30:54 user nova-compute[73572]:   <os>
Aug 26 10:30:54 user nova-compute[73572]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 10:30:54 user nova-compute[73572]:     <boot dev="hd"/>
Aug 26 10:30:54 user nova-compute[73572]:     <smbios mode="sysinfo"/>
Aug 26 10:30:54 user nova-compute[73572]:   </os>
Aug 26 10:30:54 user nova-compute[73572]:   <features>
Aug 26 10:30:54 user nova-compute[73572]:     <acpi/>
Aug 26 10:30:54 user nova-compute[73572]:     <apic/>
Aug 26 10:30:54 user nova-compute[73572]:     <vmcoreinfo/>
Aug 26 10:30:54 user nova-compute[73572]:   </features>
Aug 26 10:30:54 user nova-compute[73572]:   <clock offset="utc">
Aug 26 10:30:54 user nova-compute[73572]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 10:30:54 user nova-compute[73572]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 10:30:54 user nova-compute[73572]:     <timer name="hpet" present="no"/>
Aug 26 10:30:54 user nova-compute[73572]:   </clock>
Aug 26 10:30:54 user nova-compute[73572]:   <cpu mode="custom" match="exact">
Aug 26 10:30:54 user nova-compute[73572]:     <model>Nehalem</model>
Aug 26 10:30:54 user nova-compute[73572]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 10:30:54 user nova-compute[73572]:   </cpu>
Aug 26 10:30:54 user nova-compute[73572]:   <devices>
Aug 26 10:30:54 user nova-compute[73572]:     <disk type="file" device="disk">
Aug 26 10:30:54 user nova-compute[73572]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 10:30:54 user nova-compute[73572]:       <source file="/opt/stack/data/nova/instances/773c7bf7-a911-4b80-9cef-5cc563257b7b/disk"/>
Aug 26 10:30:54 user nova-compute[73572]:       <target dev="vda" bus="virtio"/>
Aug 26 10:30:54 user nova-compute[73572]:     </disk>
Aug 26 10:30:54 user nova-compute[73572]:     <interface type="ethernet">
Aug 26 10:30:54 user nova-compute[73572]:       <mac address="fa:16:3e:49:ea:41"/>
Aug 26 10:30:54 user nova-compute[73572]:       <model type="virtio"/>
Aug 26 10:30:54 user nova-compute[73572]:       <mtu size="1442"/>
Aug 26 10:30:54 user nova-compute[73572]:       <target dev="tap761ae86a-09"/>
Aug 26 10:30:54 user nova-compute[73572]:     </interface>
Aug 26 10:30:54 user nova-compute[73572]:     <serial type="pty">
Aug 26 10:30:54 user nova-compute[73572]:       <log file="/opt/stack/data/nova/instances/773c7bf7-a911-4b80-9cef-5cc563257b7b/console.log" append="off"/>
Aug 26 10:30:54 user nova-compute[73572]:     </serial>
Aug 26 10:30:54 user nova-compute[73572]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 10:30:54 user nova-compute[73572]:     <video>
Aug 26 10:30:54 user nova-compute[73572]:       <model type="virtio"/>
Aug 26 10:30:54 user nova-compute[73572]:     </video>
Aug 26 10:30:54 user nova-compute[73572]:     <rng model="virtio">
Aug 26 10:30:54 user nova-compute[73572]:       <backend model="random">/dev/urandom</backend>
Aug 26 10:30:54 user nova-compute[73572]:     </rng>
Aug 26 10:30:54 user nova-compute[73572]:     <controller type="usb" index="0" model="none"/>
Aug 26 10:30:54 user nova-compute[73572]:     <memballoon model="virtio">
Aug 26 10:30:54 user nova-compute[73572]:       <stats period="10"/>
Aug 26 10:30:54 user nova-compute[73572]:     </memballoon>
Aug 26 10:30:54 user nova-compute[73572]:   </devices>
Aug 26 10:30:54 user nova-compute[73572]: </domain>
Aug 26 10:30:54 user nova-compute[73572]:  {{(pid=73572) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 10:30:54 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-5fd6f453-e42d-433e-8f77-e40738bdb6c5 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T10:30:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1348178164',display_name='tempest-AttachVolumeNegativeTest-server-1348178164',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1348178164',id=43,image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO1IyEtqvTht3+0cvY+RFftB+h864Tk7wVXdQJ1zgSM01VRM6rPUKTJUZt5ZumSSWh1WeG7QUN9WXPhwQqS6SUYYtpEPXx6p8KKbLGaHx3/vMWRqhMLk8/ft8BndF0TQyw==',key_name='tempest-keypair-1023132651',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='47abd6293c07465389c379e3b5061164',ramdisk_id='',reservation_id='r-rmg7mk9x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-608798758',owner_user_name='tempest-AttachVolumeNegativeTest-608798758-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T10:30:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c7cf9c8d529d49149141add20c2b2af2',uuid=773c7bf7-a911-4b80-9cef-5cc563257b7b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "761ae86a-09b9-4010-8a18-3687cc70a2ef", "address": "fa:16:3e:49:ea:41", "network": {"id": "880aa066-8f77-469b-a0c4-e4e94ae31e1a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-313654920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47abd6293c07465389c379e3b5061164", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap761ae86a-09", "ovs_interfaceid": "761ae86a-09b9-4010-8a18-3687cc70a2ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 10:30:54 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-5fd6f453-e42d-433e-8f77-e40738bdb6c5 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Converting VIF {"id": "761ae86a-09b9-4010-8a18-3687cc70a2ef", "address": "fa:16:3e:49:ea:41", "network": {"id": "880aa066-8f77-469b-a0c4-e4e94ae31e1a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-313654920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47abd6293c07465389c379e3b5061164", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap761ae86a-09", "ovs_interfaceid": "761ae86a-09b9-4010-8a18-3687cc70a2ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:30:54 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-5fd6f453-e42d-433e-8f77-e40738bdb6c5 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:49:ea:41,bridge_name='br-int',has_traffic_filtering=True,id=761ae86a-09b9-4010-8a18-3687cc70a2ef,network=Network(880aa066-8f77-469b-a0c4-e4e94ae31e1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap761ae86a-09') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:30:54 user nova-compute[73572]: DEBUG os_vif [None req-5fd6f453-e42d-433e-8f77-e40738bdb6c5 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:ea:41,bridge_name='br-int',has_traffic_filtering=True,id=761ae86a-09b9-4010-8a18-3687cc70a2ef,network=Network(880aa066-8f77-469b-a0c4-e4e94ae31e1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap761ae86a-09') {{(pid=73572) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 10:30:54 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:30:54 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:30:54 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 10:30:54 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:30:54 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap761ae86a-09, may_exist=True, interface_attrs={}) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:30:54 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap761ae86a-09, col_values=(('external_ids', {'iface-id': '761ae86a-09b9-4010-8a18-3687cc70a2ef', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:49:ea:41', 'vm-uuid': '773c7bf7-a911-4b80-9cef-5cc563257b7b'}),), if_exists=True) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:30:54 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:30:54 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:30:54 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:30:54 user nova-compute[73572]: INFO os_vif [None req-5fd6f453-e42d-433e-8f77-e40738bdb6c5 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:ea:41,bridge_name='br-int',has_traffic_filtering=True,id=761ae86a-09b9-4010-8a18-3687cc70a2ef,network=Network(880aa066-8f77-469b-a0c4-e4e94ae31e1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap761ae86a-09')
Aug 26 10:30:54 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-5fd6f453-e42d-433e-8f77-e40738bdb6c5 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] No BDM found with device name vda, not building metadata. {{(pid=73572) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 10:30:54 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-5fd6f453-e42d-433e-8f77-e40738bdb6c5 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] No VIF found with MAC fa:16:3e:49:ea:41, not building metadata {{(pid=73572) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 10:30:54 user nova-compute[73572]: DEBUG nova.network.neutron [req-f0168a56-bc01-486e-ba92-997fb63a2d61 req-6dcf3fb6-1118-4508-81e9-a7447712c292 service nova] [instance: 773c7bf7-a911-4b80-9cef-5cc563257b7b] Updated VIF entry in instance network info cache for port 761ae86a-09b9-4010-8a18-3687cc70a2ef. {{(pid=73572) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 10:30:54 user nova-compute[73572]: DEBUG nova.network.neutron [req-f0168a56-bc01-486e-ba92-997fb63a2d61 req-6dcf3fb6-1118-4508-81e9-a7447712c292 service nova] [instance: 773c7bf7-a911-4b80-9cef-5cc563257b7b] Updating instance_info_cache with network_info: [{"id": "761ae86a-09b9-4010-8a18-3687cc70a2ef", "address": "fa:16:3e:49:ea:41", "network": {"id": "880aa066-8f77-469b-a0c4-e4e94ae31e1a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-313654920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47abd6293c07465389c379e3b5061164", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap761ae86a-09", "ovs_interfaceid": "761ae86a-09b9-4010-8a18-3687cc70a2ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:30:54 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-f0168a56-bc01-486e-ba92-997fb63a2d61 req-6dcf3fb6-1118-4508-81e9-a7447712c292 service nova] Releasing lock "refresh_cache-773c7bf7-a911-4b80-9cef-5cc563257b7b" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:30:55 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:30:55 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:30:55 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:30:55 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:30:55 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:30:55 user nova-compute[73572]: DEBUG nova.compute.manager [req-c9f87f82-d48c-4072-ab63-e611a980c779 req-b50f3450-039d-4e2e-a503-bc62f960c9fe service nova] [instance: 773c7bf7-a911-4b80-9cef-5cc563257b7b] Received event network-vif-plugged-761ae86a-09b9-4010-8a18-3687cc70a2ef {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:30:55 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-c9f87f82-d48c-4072-ab63-e611a980c779 req-b50f3450-039d-4e2e-a503-bc62f960c9fe service nova] Acquiring lock "773c7bf7-a911-4b80-9cef-5cc563257b7b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:30:55 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-c9f87f82-d48c-4072-ab63-e611a980c779 req-b50f3450-039d-4e2e-a503-bc62f960c9fe service nova] Lock "773c7bf7-a911-4b80-9cef-5cc563257b7b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:30:55 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-c9f87f82-d48c-4072-ab63-e611a980c779 req-b50f3450-039d-4e2e-a503-bc62f960c9fe service nova] Lock "773c7bf7-a911-4b80-9cef-5cc563257b7b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:30:55 user nova-compute[73572]: DEBUG nova.compute.manager [req-c9f87f82-d48c-4072-ab63-e611a980c779 req-b50f3450-039d-4e2e-a503-bc62f960c9fe service nova] [instance: 773c7bf7-a911-4b80-9cef-5cc563257b7b] No waiting events found dispatching network-vif-plugged-761ae86a-09b9-4010-8a18-3687cc70a2ef {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:30:56 user nova-compute[73572]: WARNING nova.compute.manager [req-c9f87f82-d48c-4072-ab63-e611a980c779 req-b50f3450-039d-4e2e-a503-bc62f960c9fe service nova] [instance: 773c7bf7-a911-4b80-9cef-5cc563257b7b] Received unexpected event network-vif-plugged-761ae86a-09b9-4010-8a18-3687cc70a2ef for instance with vm_state building and task_state spawning.
Aug 26 10:30:56 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:30:56 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:30:57 user nova-compute[73572]: DEBUG nova.virt.driver [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Emitting event <LifecycleEvent: 1693045857.938204, 773c7bf7-a911-4b80-9cef-5cc563257b7b => Resumed> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:30:57 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 773c7bf7-a911-4b80-9cef-5cc563257b7b] VM Resumed (Lifecycle Event)
Aug 26 10:30:57 user nova-compute[73572]: DEBUG nova.compute.manager [None req-5fd6f453-e42d-433e-8f77-e40738bdb6c5 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] [instance: 773c7bf7-a911-4b80-9cef-5cc563257b7b] Instance event wait completed in 0 seconds for  {{(pid=73572) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 10:30:57 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-5fd6f453-e42d-433e-8f77-e40738bdb6c5 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] [instance: 773c7bf7-a911-4b80-9cef-5cc563257b7b] Guest created on hypervisor {{(pid=73572) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 10:30:57 user nova-compute[73572]: INFO nova.virt.libvirt.driver [-] [instance: 773c7bf7-a911-4b80-9cef-5cc563257b7b] Instance spawned successfully.
Aug 26 10:30:57 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-5fd6f453-e42d-433e-8f77-e40738bdb6c5 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] [instance: 773c7bf7-a911-4b80-9cef-5cc563257b7b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 10:30:57 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 773c7bf7-a911-4b80-9cef-5cc563257b7b] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:30:57 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 773c7bf7-a911-4b80-9cef-5cc563257b7b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73572) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 10:30:57 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-5fd6f453-e42d-433e-8f77-e40738bdb6c5 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] [instance: 773c7bf7-a911-4b80-9cef-5cc563257b7b] Found default for hw_cdrom_bus of ide {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:30:57 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-5fd6f453-e42d-433e-8f77-e40738bdb6c5 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] [instance: 773c7bf7-a911-4b80-9cef-5cc563257b7b] Found default for hw_disk_bus of virtio {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:30:57 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-5fd6f453-e42d-433e-8f77-e40738bdb6c5 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] [instance: 773c7bf7-a911-4b80-9cef-5cc563257b7b] Found default for hw_input_bus of None {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:30:57 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-5fd6f453-e42d-433e-8f77-e40738bdb6c5 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] [instance: 773c7bf7-a911-4b80-9cef-5cc563257b7b] Found default for hw_pointer_model of None {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:30:57 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-5fd6f453-e42d-433e-8f77-e40738bdb6c5 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] [instance: 773c7bf7-a911-4b80-9cef-5cc563257b7b] Found default for hw_video_model of virtio {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:30:57 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-5fd6f453-e42d-433e-8f77-e40738bdb6c5 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] [instance: 773c7bf7-a911-4b80-9cef-5cc563257b7b] Found default for hw_vif_model of virtio {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:30:57 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 773c7bf7-a911-4b80-9cef-5cc563257b7b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 10:30:57 user nova-compute[73572]: DEBUG nova.virt.driver [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Emitting event <LifecycleEvent: 1693045857.9415662, 773c7bf7-a911-4b80-9cef-5cc563257b7b => Started> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:30:57 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 773c7bf7-a911-4b80-9cef-5cc563257b7b] VM Started (Lifecycle Event)
Aug 26 10:30:58 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 773c7bf7-a911-4b80-9cef-5cc563257b7b] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:30:58 user nova-compute[73572]: DEBUG nova.compute.manager [req-93e14ce1-ef5f-4464-b700-e7512639c265 req-3ec9de5f-1dd1-40d0-863f-e18a8d1f3edd service nova] [instance: 773c7bf7-a911-4b80-9cef-5cc563257b7b] Received event network-vif-plugged-761ae86a-09b9-4010-8a18-3687cc70a2ef {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:30:58 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-93e14ce1-ef5f-4464-b700-e7512639c265 req-3ec9de5f-1dd1-40d0-863f-e18a8d1f3edd service nova] Acquiring lock "773c7bf7-a911-4b80-9cef-5cc563257b7b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:30:58 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-93e14ce1-ef5f-4464-b700-e7512639c265 req-3ec9de5f-1dd1-40d0-863f-e18a8d1f3edd service nova] Lock "773c7bf7-a911-4b80-9cef-5cc563257b7b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:30:58 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-93e14ce1-ef5f-4464-b700-e7512639c265 req-3ec9de5f-1dd1-40d0-863f-e18a8d1f3edd service nova] Lock "773c7bf7-a911-4b80-9cef-5cc563257b7b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:30:58 user nova-compute[73572]: DEBUG nova.compute.manager [req-93e14ce1-ef5f-4464-b700-e7512639c265 req-3ec9de5f-1dd1-40d0-863f-e18a8d1f3edd service nova] [instance: 773c7bf7-a911-4b80-9cef-5cc563257b7b] No waiting events found dispatching network-vif-plugged-761ae86a-09b9-4010-8a18-3687cc70a2ef {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:30:58 user nova-compute[73572]: WARNING nova.compute.manager [req-93e14ce1-ef5f-4464-b700-e7512639c265 req-3ec9de5f-1dd1-40d0-863f-e18a8d1f3edd service nova] [instance: 773c7bf7-a911-4b80-9cef-5cc563257b7b] Received unexpected event network-vif-plugged-761ae86a-09b9-4010-8a18-3687cc70a2ef for instance with vm_state building and task_state spawning.
Aug 26 10:30:58 user nova-compute[73572]: INFO nova.compute.manager [None req-5fd6f453-e42d-433e-8f77-e40738bdb6c5 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] [instance: 773c7bf7-a911-4b80-9cef-5cc563257b7b] Took 5.83 seconds to spawn the instance on the hypervisor.
Aug 26 10:30:58 user nova-compute[73572]: DEBUG nova.compute.manager [None req-5fd6f453-e42d-433e-8f77-e40738bdb6c5 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] [instance: 773c7bf7-a911-4b80-9cef-5cc563257b7b] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:30:58 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 773c7bf7-a911-4b80-9cef-5cc563257b7b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73572) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 10:30:58 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 773c7bf7-a911-4b80-9cef-5cc563257b7b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 10:30:58 user nova-compute[73572]: INFO nova.compute.manager [None req-5fd6f453-e42d-433e-8f77-e40738bdb6c5 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] [instance: 773c7bf7-a911-4b80-9cef-5cc563257b7b] Took 6.67 seconds to build instance.
Aug 26 10:30:58 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-5fd6f453-e42d-433e-8f77-e40738bdb6c5 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Lock "773c7bf7-a911-4b80-9cef-5cc563257b7b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.803s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:30:59 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:31:00 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:31:02 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-86a137bc-75d4-4aba-9156-11b04c590945 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Acquiring lock "14fab12e-52be-4fe6-8777-bc7ebf3c25f1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:31:02 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-86a137bc-75d4-4aba-9156-11b04c590945 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Lock "14fab12e-52be-4fe6-8777-bc7ebf3c25f1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:31:02 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-86a137bc-75d4-4aba-9156-11b04c590945 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Acquiring lock "14fab12e-52be-4fe6-8777-bc7ebf3c25f1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:31:02 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-86a137bc-75d4-4aba-9156-11b04c590945 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Lock "14fab12e-52be-4fe6-8777-bc7ebf3c25f1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:31:02 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-86a137bc-75d4-4aba-9156-11b04c590945 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Lock "14fab12e-52be-4fe6-8777-bc7ebf3c25f1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:31:02 user nova-compute[73572]: INFO nova.compute.manager [None req-86a137bc-75d4-4aba-9156-11b04c590945 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: 14fab12e-52be-4fe6-8777-bc7ebf3c25f1] Terminating instance
Aug 26 10:31:02 user nova-compute[73572]: DEBUG nova.compute.manager [None req-86a137bc-75d4-4aba-9156-11b04c590945 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: 14fab12e-52be-4fe6-8777-bc7ebf3c25f1] Start destroying the instance on the hypervisor. {{(pid=73572) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 10:31:02 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:31:02 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:31:02 user nova-compute[73572]: DEBUG nova.compute.manager [req-c4185761-9866-4509-9e71-f5d275ee73ff req-5c2a0ff2-09a4-4687-89c6-dd1010d042cc service nova] [instance: 14fab12e-52be-4fe6-8777-bc7ebf3c25f1] Received event network-vif-unplugged-1b2121f4-88b1-4815-9329-3c9e3172a2f6 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:31:02 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-c4185761-9866-4509-9e71-f5d275ee73ff req-5c2a0ff2-09a4-4687-89c6-dd1010d042cc service nova] Acquiring lock "14fab12e-52be-4fe6-8777-bc7ebf3c25f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:31:02 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-c4185761-9866-4509-9e71-f5d275ee73ff req-5c2a0ff2-09a4-4687-89c6-dd1010d042cc service nova] Lock "14fab12e-52be-4fe6-8777-bc7ebf3c25f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:31:02 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-c4185761-9866-4509-9e71-f5d275ee73ff req-5c2a0ff2-09a4-4687-89c6-dd1010d042cc service nova] Lock "14fab12e-52be-4fe6-8777-bc7ebf3c25f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:31:02 user nova-compute[73572]: DEBUG nova.compute.manager [req-c4185761-9866-4509-9e71-f5d275ee73ff req-5c2a0ff2-09a4-4687-89c6-dd1010d042cc service nova] [instance: 14fab12e-52be-4fe6-8777-bc7ebf3c25f1] No waiting events found dispatching network-vif-unplugged-1b2121f4-88b1-4815-9329-3c9e3172a2f6 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:31:02 user nova-compute[73572]: DEBUG nova.compute.manager [req-c4185761-9866-4509-9e71-f5d275ee73ff req-5c2a0ff2-09a4-4687-89c6-dd1010d042cc service nova] [instance: 14fab12e-52be-4fe6-8777-bc7ebf3c25f1] Received event network-vif-unplugged-1b2121f4-88b1-4815-9329-3c9e3172a2f6 for instance with task_state deleting. {{(pid=73572) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 10:31:03 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:31:03 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:31:03 user nova-compute[73572]: INFO nova.virt.libvirt.driver [-] [instance: 14fab12e-52be-4fe6-8777-bc7ebf3c25f1] Instance destroyed successfully.
Aug 26 10:31:03 user nova-compute[73572]: DEBUG nova.objects.instance [None req-86a137bc-75d4-4aba-9156-11b04c590945 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Lazy-loading 'resources' on Instance uuid 14fab12e-52be-4fe6-8777-bc7ebf3c25f1 {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:31:03 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-86a137bc-75d4-4aba-9156-11b04c590945 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T10:15:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1685663078',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1685663078',id=14,image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T10:17:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4636f93c5bfc4653804de097aed2882c',ramdisk_id='',reservation_id='r-5s63bck6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-665602868',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T10:19:04Z,user_data=None,user_id='07f3538038a14713af3bbe420f1fb03a',uuid=14fab12e-52be-4fe6-8777-bc7ebf3c25f1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1b2121f4-88b1-4815-9329-3c9e3172a2f6", "address": "fa:16:3e:b0:35:f5", "network": {"id": "991b9dff-5173-4456-a530-b1f7eb5cfa4a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1845930297-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4636f93c5bfc4653804de097aed2882c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b2121f4-88", "ovs_interfaceid": "1b2121f4-88b1-4815-9329-3c9e3172a2f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 10:31:03 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-86a137bc-75d4-4aba-9156-11b04c590945 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Converting VIF {"id": "1b2121f4-88b1-4815-9329-3c9e3172a2f6", "address": "fa:16:3e:b0:35:f5", "network": {"id": "991b9dff-5173-4456-a530-b1f7eb5cfa4a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1845930297-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4636f93c5bfc4653804de097aed2882c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b2121f4-88", "ovs_interfaceid": "1b2121f4-88b1-4815-9329-3c9e3172a2f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:31:03 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-86a137bc-75d4-4aba-9156-11b04c590945 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b0:35:f5,bridge_name='br-int',has_traffic_filtering=True,id=1b2121f4-88b1-4815-9329-3c9e3172a2f6,network=Network(991b9dff-5173-4456-a530-b1f7eb5cfa4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b2121f4-88') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:31:03 user nova-compute[73572]: DEBUG os_vif [None req-86a137bc-75d4-4aba-9156-11b04c590945 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b0:35:f5,bridge_name='br-int',has_traffic_filtering=True,id=1b2121f4-88b1-4815-9329-3c9e3172a2f6,network=Network(991b9dff-5173-4456-a530-b1f7eb5cfa4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b2121f4-88') {{(pid=73572) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 10:31:03 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:31:03 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1b2121f4-88, bridge=br-int, if_exists=True) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:31:03 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:31:03 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:31:03 user nova-compute[73572]: INFO os_vif [None req-86a137bc-75d4-4aba-9156-11b04c590945 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b0:35:f5,bridge_name='br-int',has_traffic_filtering=True,id=1b2121f4-88b1-4815-9329-3c9e3172a2f6,network=Network(991b9dff-5173-4456-a530-b1f7eb5cfa4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b2121f4-88')
Aug 26 10:31:03 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-86a137bc-75d4-4aba-9156-11b04c590945 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: 14fab12e-52be-4fe6-8777-bc7ebf3c25f1] calling os-brick to detach iSCSI Volume {{(pid=73572) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 10:31:03 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-86a137bc-75d4-4aba-9156-11b04c590945 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc89c3d6a10>, {'target_iqns': ['iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'isVEPGco', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 10:31:03 user nova-compute[73572]: WARNING os_brick.initiator.connectors.base [None req-86a137bc-75d4-4aba-9156-11b04c590945 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 10:31:03 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-86a137bc-75d4-4aba-9156-11b04c590945 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 10:31:03 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-86a137bc-75d4-4aba-9156-11b04c590945 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 10:31:03 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-86a137bc-75d4-4aba-9156-11b04c590945 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81', 0)] {{(pid=73572) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 10:31:03 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:31:03 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:31:03 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[9646616c-db0c-4a26-88fe-90a89918d2f8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0b5f9f26-8454-44d8-aa18-724b5d18938e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:448cd30a-3852-471f-903f-a2e5abc34b55\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d8aa6fc0-ce50-4db6-8d7d-9f37eae07207\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ec96ec24-bf73-4f38-ac9f-eb2699d0a661\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:31:03 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:31:03 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:31:03 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa0a6c13-279a-4fec-bc0d-f1e7fdc9e62d]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:448cd30a-3852-471f-903f-a2e5abc34b55 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b5f9f26-8454-44d8-aa18-724b5d18938e (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8aa6fc0-ce50-4db6-8d7d-9f37eae07207 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec96ec24-bf73-4f38-ac9f-eb2699d0a661 (non-flash)\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:31:03 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-86a137bc-75d4-4aba-9156-11b04c590945 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)
Aug 26 10:31:03 user nova-compute[73572]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:448cd30a-3852-471f-903f-a2e5abc34b55 (non-flash)
Aug 26 10:31:03 user nova-compute[73572]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b5f9f26-8454-44d8-aa18-724b5d18938e (non-flash)
Aug 26 10:31:03 user nova-compute[73572]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8aa6fc0-ce50-4db6-8d7d-9f37eae07207 (non-flash)
Aug 26 10:31:03 user nova-compute[73572]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec96ec24-bf73-4f38-ac9f-eb2699d0a661 (non-flash)
Aug 26 10:31:03 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 10:31:03 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-86a137bc-75d4-4aba-9156-11b04c590945 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 (non-flash)
Aug 26 10:31:03 user nova-compute[73572]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:448cd30a-3852-471f-903f-a2e5abc34b55 (non-flash)
Aug 26 10:31:03 user nova-compute[73572]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b5f9f26-8454-44d8-aa18-724b5d18938e (non-flash)
Aug 26 10:31:03 user nova-compute[73572]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8aa6fc0-ce50-4db6-8d7d-9f37eae07207 (non-flash)
Aug 26 10:31:03 user nova-compute[73572]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec96ec24-bf73-4f38-ac9f-eb2699d0a661 (non-flash)
Aug 26 10:31:03 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 10:31:03 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-86a137bc-75d4-4aba-9156-11b04c590945 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc878dc67a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81'): ({'sdf'}, set())}) {{(pid=73572) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 10:31:03 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-86a137bc-75d4-4aba-9156-11b04c590945 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Removing single pathed devices sdf {{(pid=73572) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 10:31:03 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:31:03 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:31:03 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[2999ab15-cab8-4a50-a47f-9e5dd671a939]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:31:03 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:31:03 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.027s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:31:03 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[93c8ebea-20a6-410d-8f27-10aa17d45ee5]: (4, ('ok\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:31:03 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-86a137bc-75d4-4aba-9156-11b04c590945 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Flushing IO for device /dev/sdf {{(pid=73572) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 10:31:03 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:31:03 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.016s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:31:03 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[083f229a-ff6a-48e9-aa71-94f5c460f8d8]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:31:03 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-86a137bc-75d4-4aba-9156-11b04c590945 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=73572) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 10:31:03 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:31:03 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.038s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:31:03 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3aeacc4-175c-426b-9e29-d758d9945fe7]: (4, ('1', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:31:03 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-86a137bc-75d4-4aba-9156-11b04c590945 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=73572) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 10:31:03 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-86a137bc-75d4-4aba-9156-11b04c590945 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] SCSI volumes sdf have been removed. {{(pid=73572) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 10:31:03 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-86a137bc-75d4-4aba-9156-11b04c590945 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81')] {{(pid=73572) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 10:31:03 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:31:03 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:31:03 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d3f13f4-3a75-41e9-97ee-aa3bfbf19b40]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:31:03 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-86a137bc-75d4-4aba-9156-11b04c590945 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:31:03 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 -p 172.16.0.220:3260 --logout {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:31:03 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:31:03 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[c288cf70-708b-4b52-9bc7-dbe106c20e84]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:31:03 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-86a137bc-75d4-4aba-9156-11b04c590945 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81, portal: 172.16.0.220,3260]
Aug 26 10:31:03 user nova-compute[73572]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81, portal: 172.16.0.220,3260] successful.
Aug 26 10:31:03 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:31:03 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 -p 172.16.0.220:3260 --op delete {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:31:03 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36a9d1a2-4639-41fa-9ffb-7b7ad1cefb81 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:31:03 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[75d4951f-fa1f-4c95-8473-91328affb670]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:31:03 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-86a137bc-75d4-4aba-9156-11b04c590945 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:31:03 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-86a137bc-75d4-4aba-9156-11b04c590945 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.325s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 10:31:03 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-86a137bc-75d4-4aba-9156-11b04c590945 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] <== disconnect_volume: return (326ms) None {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 10:31:03 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-86a137bc-75d4-4aba-9156-11b04c590945 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: 14fab12e-52be-4fe6-8777-bc7ebf3c25f1] Disconnected iSCSI Volume {{(pid=73572) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 10:31:03 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-86a137bc-75d4-4aba-9156-11b04c590945 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: 14fab12e-52be-4fe6-8777-bc7ebf3c25f1] Deleting instance files /opt/stack/data/nova/instances/14fab12e-52be-4fe6-8777-bc7ebf3c25f1_del
Aug 26 10:31:03 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-86a137bc-75d4-4aba-9156-11b04c590945 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: 14fab12e-52be-4fe6-8777-bc7ebf3c25f1] Deletion of /opt/stack/data/nova/instances/14fab12e-52be-4fe6-8777-bc7ebf3c25f1_del complete
Aug 26 10:31:03 user nova-compute[73572]: INFO nova.compute.manager [None req-86a137bc-75d4-4aba-9156-11b04c590945 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: 14fab12e-52be-4fe6-8777-bc7ebf3c25f1] Took 1.22 seconds to destroy the instance on the hypervisor.
Aug 26 10:31:03 user nova-compute[73572]: DEBUG oslo.service.loopingcall [None req-86a137bc-75d4-4aba-9156-11b04c590945 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73572) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 10:31:03 user nova-compute[73572]: DEBUG nova.compute.manager [-] [instance: 14fab12e-52be-4fe6-8777-bc7ebf3c25f1] Deallocating network for instance {{(pid=73572) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 10:31:03 user nova-compute[73572]: DEBUG nova.network.neutron [-] [instance: 14fab12e-52be-4fe6-8777-bc7ebf3c25f1] deallocate_for_instance() {{(pid=73572) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 10:31:04 user nova-compute[73572]: DEBUG nova.network.neutron [-] [instance: 14fab12e-52be-4fe6-8777-bc7ebf3c25f1] Updating instance_info_cache with network_info: [] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:31:04 user nova-compute[73572]: INFO nova.compute.manager [-] [instance: 14fab12e-52be-4fe6-8777-bc7ebf3c25f1] Took 0.61 seconds to deallocate network for instance.
Aug 26 10:31:05 user nova-compute[73572]: DEBUG nova.compute.manager [req-10c20d78-2ab4-42e8-955c-4cdcc5fc3191 req-ecbe16f7-9953-4f1f-8262-14aa0ce0c07d service nova] [instance: 14fab12e-52be-4fe6-8777-bc7ebf3c25f1] Received event network-vif-plugged-1b2121f4-88b1-4815-9329-3c9e3172a2f6 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:31:05 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-10c20d78-2ab4-42e8-955c-4cdcc5fc3191 req-ecbe16f7-9953-4f1f-8262-14aa0ce0c07d service nova] Acquiring lock "14fab12e-52be-4fe6-8777-bc7ebf3c25f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:31:05 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-10c20d78-2ab4-42e8-955c-4cdcc5fc3191 req-ecbe16f7-9953-4f1f-8262-14aa0ce0c07d service nova] Lock "14fab12e-52be-4fe6-8777-bc7ebf3c25f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:31:05 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-10c20d78-2ab4-42e8-955c-4cdcc5fc3191 req-ecbe16f7-9953-4f1f-8262-14aa0ce0c07d service nova] Lock "14fab12e-52be-4fe6-8777-bc7ebf3c25f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:31:05 user nova-compute[73572]: DEBUG nova.compute.manager [req-10c20d78-2ab4-42e8-955c-4cdcc5fc3191 req-ecbe16f7-9953-4f1f-8262-14aa0ce0c07d service nova] [instance: 14fab12e-52be-4fe6-8777-bc7ebf3c25f1] No waiting events found dispatching network-vif-plugged-1b2121f4-88b1-4815-9329-3c9e3172a2f6 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:31:05 user nova-compute[73572]: WARNING nova.compute.manager [req-10c20d78-2ab4-42e8-955c-4cdcc5fc3191 req-ecbe16f7-9953-4f1f-8262-14aa0ce0c07d service nova] [instance: 14fab12e-52be-4fe6-8777-bc7ebf3c25f1] Received unexpected event network-vif-plugged-1b2121f4-88b1-4815-9329-3c9e3172a2f6 for instance with vm_state active and task_state deleting.
Aug 26 10:31:05 user nova-compute[73572]: DEBUG nova.compute.manager [req-10c20d78-2ab4-42e8-955c-4cdcc5fc3191 req-ecbe16f7-9953-4f1f-8262-14aa0ce0c07d service nova] [instance: 14fab12e-52be-4fe6-8777-bc7ebf3c25f1] Received event network-vif-deleted-1b2121f4-88b1-4815-9329-3c9e3172a2f6 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:31:05 user nova-compute[73572]: INFO nova.compute.manager [None req-86a137bc-75d4-4aba-9156-11b04c590945 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: 14fab12e-52be-4fe6-8777-bc7ebf3c25f1] Took 0.77 seconds to detach 1 volumes for instance.
Aug 26 10:31:05 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-86a137bc-75d4-4aba-9156-11b04c590945 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:31:05 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-86a137bc-75d4-4aba-9156-11b04c590945 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:31:05 user nova-compute[73572]: DEBUG nova.compute.provider_tree [None req-86a137bc-75d4-4aba-9156-11b04c590945 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Inventory has not changed in ProviderTree for provider: e2cec974-59b2-4c77-a53d-a7f4e5a30d75 {{(pid=73572) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 10:31:05 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-86a137bc-75d4-4aba-9156-11b04c590945 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Inventory has not changed for provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73572) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 10:31:05 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-86a137bc-75d4-4aba-9156-11b04c590945 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.306s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:31:05 user nova-compute[73572]: INFO nova.scheduler.client.report [None req-86a137bc-75d4-4aba-9156-11b04c590945 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Deleted allocations for instance 14fab12e-52be-4fe6-8777-bc7ebf3c25f1
Aug 26 10:31:05 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-86a137bc-75d4-4aba-9156-11b04c590945 tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Lock "14fab12e-52be-4fe6-8777-bc7ebf3c25f1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.116s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:31:07 user nova-compute[73572]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693045852.5363522, 6b2d5f4e-37af-438c-859b-d4ca803b7d08 => Stopped> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:31:07 user nova-compute[73572]: INFO nova.compute.manager [-] [instance: 6b2d5f4e-37af-438c-859b-d4ca803b7d08] VM Stopped (Lifecycle Event)
Aug 26 10:31:07 user nova-compute[73572]: DEBUG nova.compute.manager [None req-7b4d9830-adf4-48a8-a089-94ba8e2e6633 None None] [instance: 6b2d5f4e-37af-438c-859b-d4ca803b7d08] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:31:08 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:31:13 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:31:15 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:31:18 user nova-compute[73572]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693045863.3864982, 14fab12e-52be-4fe6-8777-bc7ebf3c25f1 => Stopped> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:31:18 user nova-compute[73572]: INFO nova.compute.manager [-] [instance: 14fab12e-52be-4fe6-8777-bc7ebf3c25f1] VM Stopped (Lifecycle Event)
Aug 26 10:31:18 user nova-compute[73572]: DEBUG nova.compute.manager [None req-01c0fc79-a672-4040-a734-f1a200d2d8ac None None] [instance: 14fab12e-52be-4fe6-8777-bc7ebf3c25f1] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:31:18 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:31:19 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-0c95f717-449b-4fc4-b7e1-bae7b94dfe56 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Acquiring lock "6004b15a-be01-42eb-92ba-ae9d93dab708" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:31:19 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-0c95f717-449b-4fc4-b7e1-bae7b94dfe56 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Lock "6004b15a-be01-42eb-92ba-ae9d93dab708" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:31:19 user nova-compute[73572]: INFO nova.compute.manager [None req-0c95f717-449b-4fc4-b7e1-bae7b94dfe56 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] [instance: 6004b15a-be01-42eb-92ba-ae9d93dab708] Detaching volume 0b5f9f26-8454-44d8-aa18-724b5d18938e
Aug 26 10:31:19 user nova-compute[73572]: INFO nova.virt.block_device [None req-0c95f717-449b-4fc4-b7e1-bae7b94dfe56 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] [instance: 6004b15a-be01-42eb-92ba-ae9d93dab708] Attempting to driver detach volume 0b5f9f26-8454-44d8-aa18-724b5d18938e from mountpoint /dev/vdc
Aug 26 10:31:19 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-0c95f717-449b-4fc4-b7e1-bae7b94dfe56 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Attempting to detach device vdc from instance 6004b15a-be01-42eb-92ba-ae9d93dab708 from the persistent domain config. {{(pid=73572) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 10:31:19 user nova-compute[73572]: DEBUG nova.virt.libvirt.guest [None req-0c95f717-449b-4fc4-b7e1-bae7b94dfe56 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 10:31:19 user nova-compute[73572]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 10:31:19 user nova-compute[73572]:   <source dev="/dev/sde"/>
Aug 26 10:31:19 user nova-compute[73572]:   <target dev="vdc" bus="virtio"/>
Aug 26 10:31:19 user nova-compute[73572]:   <serial>0b5f9f26-8454-44d8-aa18-724b5d18938e</serial>
Aug 26 10:31:19 user nova-compute[73572]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 26 10:31:19 user nova-compute[73572]: </disk>
Aug 26 10:31:19 user nova-compute[73572]:  {{(pid=73572) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 10:31:19 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-0c95f717-449b-4fc4-b7e1-bae7b94dfe56 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Successfully detached device vdc from instance 6004b15a-be01-42eb-92ba-ae9d93dab708 from the persistent domain config.
Aug 26 10:31:19 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-0c95f717-449b-4fc4-b7e1-bae7b94dfe56 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 6004b15a-be01-42eb-92ba-ae9d93dab708 from the live domain config. {{(pid=73572) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 10:31:19 user nova-compute[73572]: DEBUG nova.virt.libvirt.guest [None req-0c95f717-449b-4fc4-b7e1-bae7b94dfe56 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 10:31:19 user nova-compute[73572]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 10:31:19 user nova-compute[73572]:   <source dev="/dev/sde"/>
Aug 26 10:31:19 user nova-compute[73572]:   <target dev="vdc" bus="virtio"/>
Aug 26 10:31:19 user nova-compute[73572]:   <serial>0b5f9f26-8454-44d8-aa18-724b5d18938e</serial>
Aug 26 10:31:19 user nova-compute[73572]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 26 10:31:19 user nova-compute[73572]: </disk>
Aug 26 10:31:19 user nova-compute[73572]:  {{(pid=73572) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 10:31:19 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:31:19 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Starting heal instance info cache {{(pid=73572) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 10:31:19 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Received event <DeviceRemovedEvent: 1693045879.8706763, 6004b15a-be01-42eb-92ba-ae9d93dab708 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=73572) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 10:31:19 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Didn't find any instances for network info cache update. {{(pid=73572) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 26 10:31:19 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-0c95f717-449b-4fc4-b7e1-bae7b94dfe56 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 6004b15a-be01-42eb-92ba-ae9d93dab708 {{(pid=73572) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 10:31:19 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-0c95f717-449b-4fc4-b7e1-bae7b94dfe56 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Successfully detached device vdc from instance 6004b15a-be01-42eb-92ba-ae9d93dab708 from the live domain config.
Aug 26 10:31:19 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c95f717-449b-4fc4-b7e1-bae7b94dfe56 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] [instance: 6004b15a-be01-42eb-92ba-ae9d93dab708] calling os-brick to detach iSCSI Volume {{(pid=73572) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 10:31:19 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c95f717-449b-4fc4-b7e1-bae7b94dfe56 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc89c3d6a10>, {'target_iqns': ['iqn.2010-10.org.openstack:0b5f9f26-8454-44d8-aa18-724b5d18938e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EgYoJksa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 10:31:19 user nova-compute[73572]: WARNING os_brick.initiator.connectors.base [None req-0c95f717-449b-4fc4-b7e1-bae7b94dfe56 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 10:31:19 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-0c95f717-449b-4fc4-b7e1-bae7b94dfe56 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 10:31:19 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-0c95f717-449b-4fc4-b7e1-bae7b94dfe56 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 10:31:19 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c95f717-449b-4fc4-b7e1-bae7b94dfe56 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0b5f9f26-8454-44d8-aa18-724b5d18938e', 0)] {{(pid=73572) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 10:31:19 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:31:19 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:31:19 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[130cccb4-7a3d-47cb-834e-09258e40ae5f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0b5f9f26-8454-44d8-aa18-724b5d18938e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:448cd30a-3852-471f-903f-a2e5abc34b55\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d8aa6fc0-ce50-4db6-8d7d-9f37eae07207\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ec96ec24-bf73-4f38-ac9f-eb2699d0a661\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:31:19 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:31:19 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:31:19 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5e8c774-fabe-43af-82e1-2616caa0e1f4]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:448cd30a-3852-471f-903f-a2e5abc34b55 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b5f9f26-8454-44d8-aa18-724b5d18938e (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8aa6fc0-ce50-4db6-8d7d-9f37eae07207 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec96ec24-bf73-4f38-ac9f-eb2699d0a661 (non-flash)\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:31:19 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c95f717-449b-4fc4-b7e1-bae7b94dfe56 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:448cd30a-3852-471f-903f-a2e5abc34b55 (non-flash)
Aug 26 10:31:19 user nova-compute[73572]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b5f9f26-8454-44d8-aa18-724b5d18938e (non-flash)
Aug 26 10:31:19 user nova-compute[73572]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8aa6fc0-ce50-4db6-8d7d-9f37eae07207 (non-flash)
Aug 26 10:31:19 user nova-compute[73572]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec96ec24-bf73-4f38-ac9f-eb2699d0a661 (non-flash)
Aug 26 10:31:19 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 10:31:19 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c95f717-449b-4fc4-b7e1-bae7b94dfe56 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:448cd30a-3852-471f-903f-a2e5abc34b55 (non-flash)
Aug 26 10:31:19 user nova-compute[73572]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b5f9f26-8454-44d8-aa18-724b5d18938e (non-flash)
Aug 26 10:31:19 user nova-compute[73572]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8aa6fc0-ce50-4db6-8d7d-9f37eae07207 (non-flash)
Aug 26 10:31:19 user nova-compute[73572]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec96ec24-bf73-4f38-ac9f-eb2699d0a661 (non-flash)
Aug 26 10:31:19 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 10:31:19 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c95f717-449b-4fc4-b7e1-bae7b94dfe56 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc89c170310>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0b5f9f26-8454-44d8-aa18-724b5d18938e'): ({'sde'}, set())}) {{(pid=73572) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 10:31:19 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-0c95f717-449b-4fc4-b7e1-bae7b94dfe56 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Removing single pathed devices sde {{(pid=73572) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 10:31:19 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:31:19 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:31:19 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[02c93a53-eebf-4390-bb9a-a82a793d4355]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:31:19 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:31:19 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.024s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:31:19 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[951abe15-41ed-4755-ae2a-f0a4dd2047a1]: (4, ('ok\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:31:19 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-0c95f717-449b-4fc4-b7e1-bae7b94dfe56 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Flushing IO for device /dev/sde {{(pid=73572) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 10:31:19 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:31:20 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.017s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:31:20 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[73826c2c-cf90-4c6b-bda0-897179c73233]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:31:20 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-0c95f717-449b-4fc4-b7e1-bae7b94dfe56 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73572) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 10:31:20 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:31:20 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.042s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:31:20 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[41120077-d1ab-4261-8b0b-b0d057361839]: (4, ('1', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:31:20 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-0c95f717-449b-4fc4-b7e1-bae7b94dfe56 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73572) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 10:31:20 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-0c95f717-449b-4fc4-b7e1-bae7b94dfe56 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] SCSI volumes sde have been removed. {{(pid=73572) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 10:31:20 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c95f717-449b-4fc4-b7e1-bae7b94dfe56 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0b5f9f26-8454-44d8-aa18-724b5d18938e')] {{(pid=73572) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 10:31:20 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b5f9f26-8454-44d8-aa18-724b5d18938e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:31:20 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b5f9f26-8454-44d8-aa18-724b5d18938e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:31:20 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c7afe0a-96cb-4509-9ab8-11d1cb1a819f]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:31:20 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c95f717-449b-4fc4-b7e1-bae7b94dfe56 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:31:20 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b5f9f26-8454-44d8-aa18-724b5d18938e -p 172.16.0.220:3260 --logout {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:31:20 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b5f9f26-8454-44d8-aa18-724b5d18938e -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:31:20 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfca903b-1254-4330-a954-6ec5e4e5577b]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:0b5f9f26-8454-44d8-aa18-724b5d18938e, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:0b5f9f26-8454-44d8-aa18-724b5d18938e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:31:20 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c95f717-449b-4fc4-b7e1-bae7b94dfe56 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:0b5f9f26-8454-44d8-aa18-724b5d18938e, portal: 172.16.0.220,3260]
Aug 26 10:31:20 user nova-compute[73572]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:0b5f9f26-8454-44d8-aa18-724b5d18938e, portal: 172.16.0.220,3260] successful.
Aug 26 10:31:20 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:31:20 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b5f9f26-8454-44d8-aa18-724b5d18938e -p 172.16.0.220:3260 --op delete {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:31:20 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b5f9f26-8454-44d8-aa18-724b5d18938e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:31:20 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[26764415-41c8-41eb-b5b5-95dc5f0aae96]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:31:20 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c95f717-449b-4fc4-b7e1-bae7b94dfe56 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:31:20 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-0c95f717-449b-4fc4-b7e1-bae7b94dfe56 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.287s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 10:31:20 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c95f717-449b-4fc4-b7e1-bae7b94dfe56 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] <== disconnect_volume: return (288ms) None {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 10:31:20 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c95f717-449b-4fc4-b7e1-bae7b94dfe56 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] [instance: 6004b15a-be01-42eb-92ba-ae9d93dab708] Disconnected iSCSI Volume {{(pid=73572) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 10:31:20 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:31:20 user nova-compute[73572]: DEBUG nova.objects.instance [None req-0c95f717-449b-4fc4-b7e1-bae7b94dfe56 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Lazy-loading 'flavor' on Instance uuid 6004b15a-be01-42eb-92ba-ae9d93dab708 {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:31:21 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-0c95f717-449b-4fc4-b7e1-bae7b94dfe56 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Lock "6004b15a-be01-42eb-92ba-ae9d93dab708" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.675s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:31:22 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:31:23 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:31:23 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:31:23 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73572) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 10:31:24 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:31:25 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:31:25 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:31:26 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:31:28 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:31:30 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:31:30 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-ec3c98c8-184a-4f9e-acda-7feacbe2628f tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Acquiring lock "f3fe3865-3d85-46cf-b24f-10b07e23aeff" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:31:30 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-ec3c98c8-184a-4f9e-acda-7feacbe2628f tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Lock "f3fe3865-3d85-46cf-b24f-10b07e23aeff" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:31:30 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-ec3c98c8-184a-4f9e-acda-7feacbe2628f tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Acquiring lock "f3fe3865-3d85-46cf-b24f-10b07e23aeff-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:31:30 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-ec3c98c8-184a-4f9e-acda-7feacbe2628f tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Lock "f3fe3865-3d85-46cf-b24f-10b07e23aeff-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:31:30 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-ec3c98c8-184a-4f9e-acda-7feacbe2628f tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Lock "f3fe3865-3d85-46cf-b24f-10b07e23aeff-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:31:30 user nova-compute[73572]: INFO nova.compute.manager [None req-ec3c98c8-184a-4f9e-acda-7feacbe2628f tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: f3fe3865-3d85-46cf-b24f-10b07e23aeff] Terminating instance
Aug 26 10:31:30 user nova-compute[73572]: DEBUG nova.compute.manager [None req-ec3c98c8-184a-4f9e-acda-7feacbe2628f tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: f3fe3865-3d85-46cf-b24f-10b07e23aeff] Start destroying the instance on the hypervisor. {{(pid=73572) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 10:31:31 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:31:31 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:31:31 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:31:31 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:31:31 user nova-compute[73572]: DEBUG nova.compute.manager [req-229b77f4-01eb-42c3-9dd0-ac555edb1115 req-326626aa-ca9a-48ca-9f8d-84cfcc91d621 service nova] [instance: f3fe3865-3d85-46cf-b24f-10b07e23aeff] Received event network-vif-unplugged-38c337db-9e4a-4f1c-ad65-e23f2afa7012 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:31:31 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-229b77f4-01eb-42c3-9dd0-ac555edb1115 req-326626aa-ca9a-48ca-9f8d-84cfcc91d621 service nova] Acquiring lock "f3fe3865-3d85-46cf-b24f-10b07e23aeff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:31:31 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-229b77f4-01eb-42c3-9dd0-ac555edb1115 req-326626aa-ca9a-48ca-9f8d-84cfcc91d621 service nova] Lock "f3fe3865-3d85-46cf-b24f-10b07e23aeff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:31:31 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-229b77f4-01eb-42c3-9dd0-ac555edb1115 req-326626aa-ca9a-48ca-9f8d-84cfcc91d621 service nova] Lock "f3fe3865-3d85-46cf-b24f-10b07e23aeff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:31:31 user nova-compute[73572]: DEBUG nova.compute.manager [req-229b77f4-01eb-42c3-9dd0-ac555edb1115 req-326626aa-ca9a-48ca-9f8d-84cfcc91d621 service nova] [instance: f3fe3865-3d85-46cf-b24f-10b07e23aeff] No waiting events found dispatching network-vif-unplugged-38c337db-9e4a-4f1c-ad65-e23f2afa7012 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:31:31 user nova-compute[73572]: DEBUG nova.compute.manager [req-229b77f4-01eb-42c3-9dd0-ac555edb1115 req-326626aa-ca9a-48ca-9f8d-84cfcc91d621 service nova] [instance: f3fe3865-3d85-46cf-b24f-10b07e23aeff] Received event network-vif-unplugged-38c337db-9e4a-4f1c-ad65-e23f2afa7012 for instance with task_state deleting. {{(pid=73572) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 10:31:31 user nova-compute[73572]: INFO nova.virt.libvirt.driver [-] [instance: f3fe3865-3d85-46cf-b24f-10b07e23aeff] Instance destroyed successfully.
Aug 26 10:31:31 user nova-compute[73572]: DEBUG nova.objects.instance [None req-ec3c98c8-184a-4f9e-acda-7feacbe2628f tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Lazy-loading 'resources' on Instance uuid f3fe3865-3d85-46cf-b24f-10b07e23aeff {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:31:31 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-ec3c98c8-184a-4f9e-acda-7feacbe2628f tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T10:26:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1037838617',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1037838617',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1037838617',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEZK/c9rZSuuTYDFTH3zAABJ2ppblkTN/gB7qzhZcVSvG6RgE695rWpOG3yOm77jO0mCcIiwApLtU2ORv1+K6nGws7GhahZ/JGmAeI9jzNKnTvcM90KkoUFbEmUJiJyGSQ==',key_name='tempest-keypair-1727267876',keypairs=<?>,launch_index=0,launched_at=2023-08-26T10:26:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cfc130586d9f4581953f1b8ae1c4465e',ramdisk_id='',reservation_id='r-0vnd28m0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-73786062',owner_user_name='tempest-TestVolumeBootPattern-73786062-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T10:26:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e1e80942e5db41c782bda686b10e2e4b',uuid=f3fe3865-3d85-46cf-b24f-10b07e23aeff,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "38c337db-9e4a-4f1c-ad65-e23f2afa7012", "address": "fa:16:3e:aa:5c:dc", "network": {"id": "c520ee18-34a7-4781-bc97-419e9a702d40", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-280196989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfc130586d9f4581953f1b8ae1c4465e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38c337db-9e", "ovs_interfaceid": "38c337db-9e4a-4f1c-ad65-e23f2afa7012", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 10:31:31 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-ec3c98c8-184a-4f9e-acda-7feacbe2628f tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Converting VIF {"id": "38c337db-9e4a-4f1c-ad65-e23f2afa7012", "address": "fa:16:3e:aa:5c:dc", "network": {"id": "c520ee18-34a7-4781-bc97-419e9a702d40", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-280196989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfc130586d9f4581953f1b8ae1c4465e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38c337db-9e", "ovs_interfaceid": "38c337db-9e4a-4f1c-ad65-e23f2afa7012", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:31:31 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-ec3c98c8-184a-4f9e-acda-7feacbe2628f tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:aa:5c:dc,bridge_name='br-int',has_traffic_filtering=True,id=38c337db-9e4a-4f1c-ad65-e23f2afa7012,network=Network(c520ee18-34a7-4781-bc97-419e9a702d40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38c337db-9e') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:31:31 user nova-compute[73572]: DEBUG os_vif [None req-ec3c98c8-184a-4f9e-acda-7feacbe2628f tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:aa:5c:dc,bridge_name='br-int',has_traffic_filtering=True,id=38c337db-9e4a-4f1c-ad65-e23f2afa7012,network=Network(c520ee18-34a7-4781-bc97-419e9a702d40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38c337db-9e') {{(pid=73572) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 10:31:31 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:31:31 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap38c337db-9e, bridge=br-int, if_exists=True) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:31:31 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:31:31 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:31:31 user nova-compute[73572]: INFO os_vif [None req-ec3c98c8-184a-4f9e-acda-7feacbe2628f tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:aa:5c:dc,bridge_name='br-int',has_traffic_filtering=True,id=38c337db-9e4a-4f1c-ad65-e23f2afa7012,network=Network(c520ee18-34a7-4781-bc97-419e9a702d40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38c337db-9e')
Aug 26 10:31:31 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ec3c98c8-184a-4f9e-acda-7feacbe2628f tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: f3fe3865-3d85-46cf-b24f-10b07e23aeff] calling os-brick to detach iSCSI Volume {{(pid=73572) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 10:31:31 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec3c98c8-184a-4f9e-acda-7feacbe2628f tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc89c3d6a10>, {'target_iqns': ['iqn.2010-10.org.openstack:448cd30a-3852-471f-903f-a2e5abc34b55'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'igxcACpS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 10:31:31 user nova-compute[73572]: WARNING os_brick.initiator.connectors.base [None req-ec3c98c8-184a-4f9e-acda-7feacbe2628f tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 10:31:31 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-ec3c98c8-184a-4f9e-acda-7feacbe2628f tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 10:31:31 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-ec3c98c8-184a-4f9e-acda-7feacbe2628f tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 10:31:31 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec3c98c8-184a-4f9e-acda-7feacbe2628f tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:448cd30a-3852-471f-903f-a2e5abc34b55', 0)] {{(pid=73572) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 10:31:31 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:31:31 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:31:31 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[319eb245-663c-4dc2-89b2-0caf2ef80c21]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:448cd30a-3852-471f-903f-a2e5abc34b55\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d8aa6fc0-ce50-4db6-8d7d-9f37eae07207\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ec96ec24-bf73-4f38-ac9f-eb2699d0a661\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:31:31 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:31:31 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:31:31 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:31:31 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[01bc458e-e7c7-4805-9194-3ef826bb7c15]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:448cd30a-3852-471f-903f-a2e5abc34b55 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8aa6fc0-ce50-4db6-8d7d-9f37eae07207 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec96ec24-bf73-4f38-ac9f-eb2699d0a661 (non-flash)\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:31:31 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec3c98c8-184a-4f9e-acda-7feacbe2628f tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:448cd30a-3852-471f-903f-a2e5abc34b55 (non-flash)
Aug 26 10:31:31 user nova-compute[73572]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8aa6fc0-ce50-4db6-8d7d-9f37eae07207 (non-flash)
Aug 26 10:31:31 user nova-compute[73572]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec96ec24-bf73-4f38-ac9f-eb2699d0a661 (non-flash)
Aug 26 10:31:31 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 10:31:31 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec3c98c8-184a-4f9e-acda-7feacbe2628f tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:448cd30a-3852-471f-903f-a2e5abc34b55 (non-flash)
Aug 26 10:31:31 user nova-compute[73572]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8aa6fc0-ce50-4db6-8d7d-9f37eae07207 (non-flash)
Aug 26 10:31:31 user nova-compute[73572]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec96ec24-bf73-4f38-ac9f-eb2699d0a661 (non-flash)
Aug 26 10:31:31 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 10:31:31 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec3c98c8-184a-4f9e-acda-7feacbe2628f tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc878bae4d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:448cd30a-3852-471f-903f-a2e5abc34b55'): ({'sdb'}, set())}) {{(pid=73572) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 10:31:31 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-ec3c98c8-184a-4f9e-acda-7feacbe2628f tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Removing single pathed devices sdb {{(pid=73572) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 10:31:31 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:31:31 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:31:31 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f7c41c1-e90a-4c33-8cf8-e9458b28fc9d]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:31:31 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:31:31 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.025s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:31:31 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7c892ed-7ef6-4b13-a8c8-b14b7c14f556]: (4, ('ok\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:31:31 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-ec3c98c8-184a-4f9e-acda-7feacbe2628f tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Flushing IO for device /dev/sdb {{(pid=73572) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 10:31:31 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:31:31 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:31:31 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec33e582-5a24-44a2-9290-dadb3d766d51]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:31:31 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-ec3c98c8-184a-4f9e-acda-7feacbe2628f tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73572) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 10:31:31 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:31:31 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:31:31 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeeef751-bf2d-4610-9ef0-fe64574590b4]: (4, ('1', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:31:31 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-ec3c98c8-184a-4f9e-acda-7feacbe2628f tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73572) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 10:31:31 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-ec3c98c8-184a-4f9e-acda-7feacbe2628f tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] SCSI volumes sdb have been removed. {{(pid=73572) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 10:31:31 user nova-compute[73572]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26237643961393833', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_da81f6e9', '/dev/disk/by-id/scsi-1SCST_BIOda81f6e9-b7d9a983be023b56') {{(pid=84543) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 26 10:31:31 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[902a9215-872d-41e2-8063-ea380e63de75]: (4, None) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:31:31 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec3c98c8-184a-4f9e-acda-7feacbe2628f tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:448cd30a-3852-471f-903f-a2e5abc34b55')] {{(pid=73572) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 10:31:31 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:448cd30a-3852-471f-903f-a2e5abc34b55 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:31:31 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:448cd30a-3852-471f-903f-a2e5abc34b55 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:31:31 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[86dc52ae-7758-4f71-a77a-5b665c52891b]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:31:31 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec3c98c8-184a-4f9e-acda-7feacbe2628f tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:31:31 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:448cd30a-3852-471f-903f-a2e5abc34b55 -p 172.16.0.220:3260 --logout {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:31:32 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:448cd30a-3852-471f-903f-a2e5abc34b55 -p 172.16.0.220:3260 --logout" returned: 0 in 0.046s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:31:32 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7f812eb-7a0f-441d-bd18-7c1cd92a074a]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:448cd30a-3852-471f-903f-a2e5abc34b55, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:448cd30a-3852-471f-903f-a2e5abc34b55, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:31:32 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec3c98c8-184a-4f9e-acda-7feacbe2628f tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:448cd30a-3852-471f-903f-a2e5abc34b55, portal: 172.16.0.220,3260]
Aug 26 10:31:32 user nova-compute[73572]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:448cd30a-3852-471f-903f-a2e5abc34b55, portal: 172.16.0.220,3260] successful.
Aug 26 10:31:32 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:31:32 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:448cd30a-3852-471f-903f-a2e5abc34b55 -p 172.16.0.220:3260 --op delete {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:31:32 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:448cd30a-3852-471f-903f-a2e5abc34b55 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:31:32 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[9adac6e5-8e06-48d1-84c5-5da022c43fc8]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:31:32 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec3c98c8-184a-4f9e-acda-7feacbe2628f tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:31:32 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-ec3c98c8-184a-4f9e-acda-7feacbe2628f tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.294s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 10:31:32 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec3c98c8-184a-4f9e-acda-7feacbe2628f tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] <== disconnect_volume: return (296ms) None {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 10:31:32 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ec3c98c8-184a-4f9e-acda-7feacbe2628f tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: f3fe3865-3d85-46cf-b24f-10b07e23aeff] Disconnected iSCSI Volume {{(pid=73572) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 10:31:32 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-ec3c98c8-184a-4f9e-acda-7feacbe2628f tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: f3fe3865-3d85-46cf-b24f-10b07e23aeff] Deleting instance files /opt/stack/data/nova/instances/f3fe3865-3d85-46cf-b24f-10b07e23aeff_del
Aug 26 10:31:32 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-ec3c98c8-184a-4f9e-acda-7feacbe2628f tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: f3fe3865-3d85-46cf-b24f-10b07e23aeff] Deletion of /opt/stack/data/nova/instances/f3fe3865-3d85-46cf-b24f-10b07e23aeff_del complete
Aug 26 10:31:32 user nova-compute[73572]: INFO nova.compute.manager [None req-ec3c98c8-184a-4f9e-acda-7feacbe2628f tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: f3fe3865-3d85-46cf-b24f-10b07e23aeff] Took 1.16 seconds to destroy the instance on the hypervisor.
Aug 26 10:31:32 user nova-compute[73572]: DEBUG oslo.service.loopingcall [None req-ec3c98c8-184a-4f9e-acda-7feacbe2628f tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73572) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 10:31:32 user nova-compute[73572]: DEBUG nova.compute.manager [-] [instance: f3fe3865-3d85-46cf-b24f-10b07e23aeff] Deallocating network for instance {{(pid=73572) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 10:31:32 user nova-compute[73572]: DEBUG nova.network.neutron [-] [instance: f3fe3865-3d85-46cf-b24f-10b07e23aeff] deallocate_for_instance() {{(pid=73572) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 10:31:32 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:31:32 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:31:32 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:31:32 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:31:32 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Auditing locally available compute resources for user (node: user) {{(pid=73572) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 10:31:32 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86923c1a-89a5-4e7a-b488-8bf3a013bf83/disk.rescue --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:31:33 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86923c1a-89a5-4e7a-b488-8bf3a013bf83/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:31:33 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86923c1a-89a5-4e7a-b488-8bf3a013bf83/disk.rescue --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:31:33 user nova-compute[73572]: DEBUG nova.network.neutron [-] [instance: f3fe3865-3d85-46cf-b24f-10b07e23aeff] Updating instance_info_cache with network_info: [] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:31:33 user nova-compute[73572]: INFO nova.compute.manager [-] [instance: f3fe3865-3d85-46cf-b24f-10b07e23aeff] Took 1.15 seconds to deallocate network for instance.
Aug 26 10:31:33 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86923c1a-89a5-4e7a-b488-8bf3a013bf83/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:31:33 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86923c1a-89a5-4e7a-b488-8bf3a013bf83/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:31:33 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86923c1a-89a5-4e7a-b488-8bf3a013bf83/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:31:33 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86923c1a-89a5-4e7a-b488-8bf3a013bf83/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:31:33 user nova-compute[73572]: DEBUG nova.compute.manager [req-237879de-5f05-487e-943a-756ec3926664 req-157926a0-dd8c-4041-81c3-28a621d0ff7b service nova] [instance: f3fe3865-3d85-46cf-b24f-10b07e23aeff] Received event network-vif-plugged-38c337db-9e4a-4f1c-ad65-e23f2afa7012 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:31:33 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-237879de-5f05-487e-943a-756ec3926664 req-157926a0-dd8c-4041-81c3-28a621d0ff7b service nova] Acquiring lock "f3fe3865-3d85-46cf-b24f-10b07e23aeff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:31:33 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-237879de-5f05-487e-943a-756ec3926664 req-157926a0-dd8c-4041-81c3-28a621d0ff7b service nova] Lock "f3fe3865-3d85-46cf-b24f-10b07e23aeff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:31:33 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-237879de-5f05-487e-943a-756ec3926664 req-157926a0-dd8c-4041-81c3-28a621d0ff7b service nova] Lock "f3fe3865-3d85-46cf-b24f-10b07e23aeff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:31:33 user nova-compute[73572]: DEBUG nova.compute.manager [req-237879de-5f05-487e-943a-756ec3926664 req-157926a0-dd8c-4041-81c3-28a621d0ff7b service nova] [instance: f3fe3865-3d85-46cf-b24f-10b07e23aeff] No waiting events found dispatching network-vif-plugged-38c337db-9e4a-4f1c-ad65-e23f2afa7012 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:31:33 user nova-compute[73572]: WARNING nova.compute.manager [req-237879de-5f05-487e-943a-756ec3926664 req-157926a0-dd8c-4041-81c3-28a621d0ff7b service nova] [instance: f3fe3865-3d85-46cf-b24f-10b07e23aeff] Received unexpected event network-vif-plugged-38c337db-9e4a-4f1c-ad65-e23f2afa7012 for instance with vm_state active and task_state deleting.
Aug 26 10:31:33 user nova-compute[73572]: DEBUG nova.compute.manager [req-237879de-5f05-487e-943a-756ec3926664 req-157926a0-dd8c-4041-81c3-28a621d0ff7b service nova] [instance: f3fe3865-3d85-46cf-b24f-10b07e23aeff] Received event network-vif-deleted-38c337db-9e4a-4f1c-ad65-e23f2afa7012 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:31:33 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86923c1a-89a5-4e7a-b488-8bf3a013bf83/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:31:33 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c785b609-0068-442f-91f5-d26e888a993f/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:31:33 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c785b609-0068-442f-91f5-d26e888a993f/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:31:33 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c785b609-0068-442f-91f5-d26e888a993f/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:31:34 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c785b609-0068-442f-91f5-d26e888a993f/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:31:34 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68613b1e-c45c-4fd9-834c-3630ed0f456a/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:31:34 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68613b1e-c45c-4fd9-834c-3630ed0f456a/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:31:34 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68613b1e-c45c-4fd9-834c-3630ed0f456a/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:31:34 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68613b1e-c45c-4fd9-834c-3630ed0f456a/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:31:34 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2eaea7c2-a5c0-4950-b033-0012b5cec0ee/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:31:34 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2eaea7c2-a5c0-4950-b033-0012b5cec0ee/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:31:34 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2eaea7c2-a5c0-4950-b033-0012b5cec0ee/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:31:34 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2eaea7c2-a5c0-4950-b033-0012b5cec0ee/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:31:34 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6004b15a-be01-42eb-92ba-ae9d93dab708/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:31:35 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6004b15a-be01-42eb-92ba-ae9d93dab708/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:31:35 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6004b15a-be01-42eb-92ba-ae9d93dab708/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:31:35 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6004b15a-be01-42eb-92ba-ae9d93dab708/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:31:35 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/773c7bf7-a911-4b80-9cef-5cc563257b7b/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:31:35 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/773c7bf7-a911-4b80-9cef-5cc563257b7b/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:31:35 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/773c7bf7-a911-4b80-9cef-5cc563257b7b/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:31:35 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/773c7bf7-a911-4b80-9cef-5cc563257b7b/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:31:35 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73572) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 10:31:35 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c8e780d-0a13-4484-bf18-ac0879db263a/disk.rescue --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:31:35 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c8e780d-0a13-4484-bf18-ac0879db263a/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:31:35 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c8e780d-0a13-4484-bf18-ac0879db263a/disk.rescue --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:31:36 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c8e780d-0a13-4484-bf18-ac0879db263a/disk.rescue --force-share --output=json" returned: 0 in 0.228s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:31:36 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] skipping disk /opt/stack/data/nova/instances/1c8e780d-0a13-4484-bf18-ac0879db263a/disk (vdb) as it is a volume {{(pid=73572) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 10:31:36 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:31:36 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:31:36 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Hypervisor/Node resource view: name=user free_ram=7551MB free_disk=25.056716918945312GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=73572) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 10:31:36 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:31:36 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:31:36 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance c785b609-0068-442f-91f5-d26e888a993f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:31:36 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance 2eaea7c2-a5c0-4950-b033-0012b5cec0ee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:31:36 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance 86923c1a-89a5-4e7a-b488-8bf3a013bf83 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:31:36 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance 68613b1e-c45c-4fd9-834c-3630ed0f456a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:31:36 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance f3fe3865-3d85-46cf-b24f-10b07e23aeff actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:31:36 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance 1c8e780d-0a13-4484-bf18-ac0879db263a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:31:36 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance 6004b15a-be01-42eb-92ba-ae9d93dab708 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:31:36 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance 3a4c9522-9723-4ad4-8630-17a3aba70c98 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:31:36 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance 773c7bf7-a911-4b80-9cef-5cc563257b7b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:31:36 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=73572) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 10:31:36 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=73572) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 10:31:36 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:31:36 user nova-compute[73572]: DEBUG nova.compute.provider_tree [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Inventory has not changed in ProviderTree for provider: e2cec974-59b2-4c77-a53d-a7f4e5a30d75 {{(pid=73572) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 10:31:36 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Inventory has not changed for provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73572) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 10:31:36 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Compute_service record updated for user:user {{(pid=73572) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 10:31:36 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.455s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:31:38 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:31:39 user nova-compute[73572]: INFO nova.compute.manager [None req-ec3c98c8-184a-4f9e-acda-7feacbe2628f tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: f3fe3865-3d85-46cf-b24f-10b07e23aeff] Took 5.81 seconds to detach 1 volumes for instance.
Aug 26 10:31:39 user nova-compute[73572]: DEBUG nova.compute.manager [None req-ec3c98c8-184a-4f9e-acda-7feacbe2628f tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: f3fe3865-3d85-46cf-b24f-10b07e23aeff] Deleting volume: 448cd30a-3852-471f-903f-a2e5abc34b55 {{(pid=73572) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 26 10:31:39 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-ec3c98c8-184a-4f9e-acda-7feacbe2628f tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:31:39 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-ec3c98c8-184a-4f9e-acda-7feacbe2628f tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:31:39 user nova-compute[73572]: DEBUG nova.compute.provider_tree [None req-ec3c98c8-184a-4f9e-acda-7feacbe2628f tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Inventory has not changed in ProviderTree for provider: e2cec974-59b2-4c77-a53d-a7f4e5a30d75 {{(pid=73572) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 10:31:39 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-ec3c98c8-184a-4f9e-acda-7feacbe2628f tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Inventory has not changed for provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73572) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 10:31:39 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-ec3c98c8-184a-4f9e-acda-7feacbe2628f tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.278s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:31:39 user nova-compute[73572]: INFO nova.scheduler.client.report [None req-ec3c98c8-184a-4f9e-acda-7feacbe2628f tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Deleted allocations for instance f3fe3865-3d85-46cf-b24f-10b07e23aeff
Aug 26 10:31:39 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-ec3c98c8-184a-4f9e-acda-7feacbe2628f tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Lock "f3fe3865-3d85-46cf-b24f-10b07e23aeff" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 8.642s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:31:41 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:31:41 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:31:41 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73572) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 10:31:41 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73572) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 10:31:41 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73572) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 10:31:41 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:31:42 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:31:46 user nova-compute[73572]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693045891.7051594, f3fe3865-3d85-46cf-b24f-10b07e23aeff => Stopped> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:31:46 user nova-compute[73572]: INFO nova.compute.manager [-] [instance: f3fe3865-3d85-46cf-b24f-10b07e23aeff] VM Stopped (Lifecycle Event)
Aug 26 10:31:46 user nova-compute[73572]: DEBUG nova.compute.manager [None req-19c28caf-5305-43d8-831f-f476dae64b24 None None] [instance: f3fe3865-3d85-46cf-b24f-10b07e23aeff] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:31:46 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:31:47 user nova-compute[73572]: INFO nova.compute.manager [None req-1d8ab9ce-62aa-429e-9db1-9f6529f95f3e tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] [instance: 1c8e780d-0a13-4484-bf18-ac0879db263a] Unrescuing
Aug 26 10:31:47 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-1d8ab9ce-62aa-429e-9db1-9f6529f95f3e tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Acquiring lock "refresh_cache-1c8e780d-0a13-4484-bf18-ac0879db263a" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:31:47 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-1d8ab9ce-62aa-429e-9db1-9f6529f95f3e tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Acquired lock "refresh_cache-1c8e780d-0a13-4484-bf18-ac0879db263a" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:31:47 user nova-compute[73572]: DEBUG nova.network.neutron [None req-1d8ab9ce-62aa-429e-9db1-9f6529f95f3e tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] [instance: 1c8e780d-0a13-4484-bf18-ac0879db263a] Building network info cache for instance {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 10:31:48 user nova-compute[73572]: DEBUG nova.network.neutron [None req-1d8ab9ce-62aa-429e-9db1-9f6529f95f3e tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] [instance: 1c8e780d-0a13-4484-bf18-ac0879db263a] Updating instance_info_cache with network_info: [{"id": "d03460b0-e0b9-4c39-a8a6-12cb80aca6bc", "address": "fa:16:3e:c2:0f:20", "network": {"id": "757e71b4-5177-45a5-8ef5-9b27f42092f1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1765327616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1bff48d66894950ac6690e1fd0e79b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd03460b0-e0", "ovs_interfaceid": "d03460b0-e0b9-4c39-a8a6-12cb80aca6bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:31:48 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-1d8ab9ce-62aa-429e-9db1-9f6529f95f3e tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Releasing lock "refresh_cache-1c8e780d-0a13-4484-bf18-ac0879db263a" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:31:48 user nova-compute[73572]: DEBUG nova.objects.instance [None req-1d8ab9ce-62aa-429e-9db1-9f6529f95f3e tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Lazy-loading 'flavor' on Instance uuid 1c8e780d-0a13-4484-bf18-ac0879db263a {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:31:48 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:31:48 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:31:48 user nova-compute[73572]: DEBUG nova.compute.manager [req-e52c1fd3-0bf8-4f3e-b91a-5be20bbac7c6 req-3c691a2f-cfaf-44a9-8b3f-a8ab0e616098 service nova] [instance: 1c8e780d-0a13-4484-bf18-ac0879db263a] Received event network-vif-unplugged-d03460b0-e0b9-4c39-a8a6-12cb80aca6bc {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:31:48 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-e52c1fd3-0bf8-4f3e-b91a-5be20bbac7c6 req-3c691a2f-cfaf-44a9-8b3f-a8ab0e616098 service nova] Acquiring lock "1c8e780d-0a13-4484-bf18-ac0879db263a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:31:48 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-e52c1fd3-0bf8-4f3e-b91a-5be20bbac7c6 req-3c691a2f-cfaf-44a9-8b3f-a8ab0e616098 service nova] Lock "1c8e780d-0a13-4484-bf18-ac0879db263a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:31:48 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-e52c1fd3-0bf8-4f3e-b91a-5be20bbac7c6 req-3c691a2f-cfaf-44a9-8b3f-a8ab0e616098 service nova] Lock "1c8e780d-0a13-4484-bf18-ac0879db263a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:31:48 user nova-compute[73572]: DEBUG nova.compute.manager [req-e52c1fd3-0bf8-4f3e-b91a-5be20bbac7c6 req-3c691a2f-cfaf-44a9-8b3f-a8ab0e616098 service nova] [instance: 1c8e780d-0a13-4484-bf18-ac0879db263a] No waiting events found dispatching network-vif-unplugged-d03460b0-e0b9-4c39-a8a6-12cb80aca6bc {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:31:48 user nova-compute[73572]: WARNING nova.compute.manager [req-e52c1fd3-0bf8-4f3e-b91a-5be20bbac7c6 req-3c691a2f-cfaf-44a9-8b3f-a8ab0e616098 service nova] [instance: 1c8e780d-0a13-4484-bf18-ac0879db263a] Received unexpected event network-vif-unplugged-d03460b0-e0b9-4c39-a8a6-12cb80aca6bc for instance with vm_state rescued and task_state unrescuing.
Aug 26 10:31:48 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:31:48 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:31:48 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:31:48 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:31:48 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:31:48 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:31:48 user nova-compute[73572]: INFO nova.virt.libvirt.driver [-] [instance: 1c8e780d-0a13-4484-bf18-ac0879db263a] Instance destroyed successfully.
Aug 26 10:31:48 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:31:48 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:31:48 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:31:49 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:31:49 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:31:50 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:31:50 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:31:50 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:31:50 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:31:50 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:31:50 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:31:50 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:31:50 user nova-compute[73572]: DEBUG nova.compute.manager [req-2c153c47-05d5-456f-a567-c3fd0e76ee2e req-641847cb-a401-4202-a075-aa3a76f1866e service nova] [instance: 1c8e780d-0a13-4484-bf18-ac0879db263a] Received event network-vif-plugged-d03460b0-e0b9-4c39-a8a6-12cb80aca6bc {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:31:50 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-2c153c47-05d5-456f-a567-c3fd0e76ee2e req-641847cb-a401-4202-a075-aa3a76f1866e service nova] Acquiring lock "1c8e780d-0a13-4484-bf18-ac0879db263a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:31:50 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-2c153c47-05d5-456f-a567-c3fd0e76ee2e req-641847cb-a401-4202-a075-aa3a76f1866e service nova] Lock "1c8e780d-0a13-4484-bf18-ac0879db263a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:31:50 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-2c153c47-05d5-456f-a567-c3fd0e76ee2e req-641847cb-a401-4202-a075-aa3a76f1866e service nova] Lock "1c8e780d-0a13-4484-bf18-ac0879db263a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:31:50 user nova-compute[73572]: DEBUG nova.compute.manager [req-2c153c47-05d5-456f-a567-c3fd0e76ee2e req-641847cb-a401-4202-a075-aa3a76f1866e service nova] [instance: 1c8e780d-0a13-4484-bf18-ac0879db263a] No waiting events found dispatching network-vif-plugged-d03460b0-e0b9-4c39-a8a6-12cb80aca6bc {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:31:50 user nova-compute[73572]: WARNING nova.compute.manager [req-2c153c47-05d5-456f-a567-c3fd0e76ee2e req-641847cb-a401-4202-a075-aa3a76f1866e service nova] [instance: 1c8e780d-0a13-4484-bf18-ac0879db263a] Received unexpected event network-vif-plugged-d03460b0-e0b9-4c39-a8a6-12cb80aca6bc for instance with vm_state rescued and task_state unrescuing.
Aug 26 10:31:50 user nova-compute[73572]: DEBUG nova.compute.manager [req-2c153c47-05d5-456f-a567-c3fd0e76ee2e req-641847cb-a401-4202-a075-aa3a76f1866e service nova] [instance: 1c8e780d-0a13-4484-bf18-ac0879db263a] Received event network-vif-plugged-d03460b0-e0b9-4c39-a8a6-12cb80aca6bc {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:31:50 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-2c153c47-05d5-456f-a567-c3fd0e76ee2e req-641847cb-a401-4202-a075-aa3a76f1866e service nova] Acquiring lock "1c8e780d-0a13-4484-bf18-ac0879db263a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:31:50 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-2c153c47-05d5-456f-a567-c3fd0e76ee2e req-641847cb-a401-4202-a075-aa3a76f1866e service nova] Lock "1c8e780d-0a13-4484-bf18-ac0879db263a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:31:50 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-2c153c47-05d5-456f-a567-c3fd0e76ee2e req-641847cb-a401-4202-a075-aa3a76f1866e service nova] Lock "1c8e780d-0a13-4484-bf18-ac0879db263a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:31:50 user nova-compute[73572]: DEBUG nova.compute.manager [req-2c153c47-05d5-456f-a567-c3fd0e76ee2e req-641847cb-a401-4202-a075-aa3a76f1866e service nova] [instance: 1c8e780d-0a13-4484-bf18-ac0879db263a] No waiting events found dispatching network-vif-plugged-d03460b0-e0b9-4c39-a8a6-12cb80aca6bc {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:31:50 user nova-compute[73572]: WARNING nova.compute.manager [req-2c153c47-05d5-456f-a567-c3fd0e76ee2e req-641847cb-a401-4202-a075-aa3a76f1866e service nova] [instance: 1c8e780d-0a13-4484-bf18-ac0879db263a] Received unexpected event network-vif-plugged-d03460b0-e0b9-4c39-a8a6-12cb80aca6bc for instance with vm_state rescued and task_state unrescuing.
Aug 26 10:31:50 user nova-compute[73572]: DEBUG nova.compute.manager [req-2c153c47-05d5-456f-a567-c3fd0e76ee2e req-641847cb-a401-4202-a075-aa3a76f1866e service nova] [instance: 1c8e780d-0a13-4484-bf18-ac0879db263a] Received event network-vif-plugged-d03460b0-e0b9-4c39-a8a6-12cb80aca6bc {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:31:50 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-2c153c47-05d5-456f-a567-c3fd0e76ee2e req-641847cb-a401-4202-a075-aa3a76f1866e service nova] Acquiring lock "1c8e780d-0a13-4484-bf18-ac0879db263a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:31:50 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-2c153c47-05d5-456f-a567-c3fd0e76ee2e req-641847cb-a401-4202-a075-aa3a76f1866e service nova] Lock "1c8e780d-0a13-4484-bf18-ac0879db263a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:31:50 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-2c153c47-05d5-456f-a567-c3fd0e76ee2e req-641847cb-a401-4202-a075-aa3a76f1866e service nova] Lock "1c8e780d-0a13-4484-bf18-ac0879db263a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:31:50 user nova-compute[73572]: DEBUG nova.compute.manager [req-2c153c47-05d5-456f-a567-c3fd0e76ee2e req-641847cb-a401-4202-a075-aa3a76f1866e service nova] [instance: 1c8e780d-0a13-4484-bf18-ac0879db263a] No waiting events found dispatching network-vif-plugged-d03460b0-e0b9-4c39-a8a6-12cb80aca6bc {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:31:50 user nova-compute[73572]: WARNING nova.compute.manager [req-2c153c47-05d5-456f-a567-c3fd0e76ee2e req-641847cb-a401-4202-a075-aa3a76f1866e service nova] [instance: 1c8e780d-0a13-4484-bf18-ac0879db263a] Received unexpected event network-vif-plugged-d03460b0-e0b9-4c39-a8a6-12cb80aca6bc for instance with vm_state rescued and task_state unrescuing.
Aug 26 10:31:50 user nova-compute[73572]: DEBUG nova.compute.manager [req-2c153c47-05d5-456f-a567-c3fd0e76ee2e req-641847cb-a401-4202-a075-aa3a76f1866e service nova] [instance: 1c8e780d-0a13-4484-bf18-ac0879db263a] Received event network-vif-unplugged-d03460b0-e0b9-4c39-a8a6-12cb80aca6bc {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:31:50 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-2c153c47-05d5-456f-a567-c3fd0e76ee2e req-641847cb-a401-4202-a075-aa3a76f1866e service nova] Acquiring lock "1c8e780d-0a13-4484-bf18-ac0879db263a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:31:50 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-2c153c47-05d5-456f-a567-c3fd0e76ee2e req-641847cb-a401-4202-a075-aa3a76f1866e service nova] Lock "1c8e780d-0a13-4484-bf18-ac0879db263a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:31:50 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-2c153c47-05d5-456f-a567-c3fd0e76ee2e req-641847cb-a401-4202-a075-aa3a76f1866e service nova] Lock "1c8e780d-0a13-4484-bf18-ac0879db263a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:31:50 user nova-compute[73572]: DEBUG nova.compute.manager [req-2c153c47-05d5-456f-a567-c3fd0e76ee2e req-641847cb-a401-4202-a075-aa3a76f1866e service nova] [instance: 1c8e780d-0a13-4484-bf18-ac0879db263a] No waiting events found dispatching network-vif-unplugged-d03460b0-e0b9-4c39-a8a6-12cb80aca6bc {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:31:50 user nova-compute[73572]: WARNING nova.compute.manager [req-2c153c47-05d5-456f-a567-c3fd0e76ee2e req-641847cb-a401-4202-a075-aa3a76f1866e service nova] [instance: 1c8e780d-0a13-4484-bf18-ac0879db263a] Received unexpected event network-vif-unplugged-d03460b0-e0b9-4c39-a8a6-12cb80aca6bc for instance with vm_state rescued and task_state unrescuing.
Aug 26 10:31:50 user nova-compute[73572]: DEBUG nova.compute.manager [req-2c153c47-05d5-456f-a567-c3fd0e76ee2e req-641847cb-a401-4202-a075-aa3a76f1866e service nova] [instance: 1c8e780d-0a13-4484-bf18-ac0879db263a] Received event network-vif-plugged-d03460b0-e0b9-4c39-a8a6-12cb80aca6bc {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:31:50 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-2c153c47-05d5-456f-a567-c3fd0e76ee2e req-641847cb-a401-4202-a075-aa3a76f1866e service nova] Acquiring lock "1c8e780d-0a13-4484-bf18-ac0879db263a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:31:50 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-2c153c47-05d5-456f-a567-c3fd0e76ee2e req-641847cb-a401-4202-a075-aa3a76f1866e service nova] Lock "1c8e780d-0a13-4484-bf18-ac0879db263a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:31:50 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-2c153c47-05d5-456f-a567-c3fd0e76ee2e req-641847cb-a401-4202-a075-aa3a76f1866e service nova] Lock "1c8e780d-0a13-4484-bf18-ac0879db263a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:31:50 user nova-compute[73572]: DEBUG nova.compute.manager [req-2c153c47-05d5-456f-a567-c3fd0e76ee2e req-641847cb-a401-4202-a075-aa3a76f1866e service nova] [instance: 1c8e780d-0a13-4484-bf18-ac0879db263a] No waiting events found dispatching network-vif-plugged-d03460b0-e0b9-4c39-a8a6-12cb80aca6bc {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:31:50 user nova-compute[73572]: WARNING nova.compute.manager [req-2c153c47-05d5-456f-a567-c3fd0e76ee2e req-641847cb-a401-4202-a075-aa3a76f1866e service nova] [instance: 1c8e780d-0a13-4484-bf18-ac0879db263a] Received unexpected event network-vif-plugged-d03460b0-e0b9-4c39-a8a6-12cb80aca6bc for instance with vm_state rescued and task_state unrescuing.
Aug 26 10:31:51 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:31:52 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Removed pending event for 1c8e780d-0a13-4484-bf18-ac0879db263a due to event {{(pid=73572) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 26 10:31:52 user nova-compute[73572]: DEBUG nova.virt.driver [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Emitting event <LifecycleEvent: 1693045912.293151, 1c8e780d-0a13-4484-bf18-ac0879db263a => Resumed> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:31:52 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 1c8e780d-0a13-4484-bf18-ac0879db263a] VM Resumed (Lifecycle Event)
Aug 26 10:31:52 user nova-compute[73572]: DEBUG nova.compute.manager [None req-1d8ab9ce-62aa-429e-9db1-9f6529f95f3e tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] [instance: 1c8e780d-0a13-4484-bf18-ac0879db263a] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:31:52 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 1c8e780d-0a13-4484-bf18-ac0879db263a] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:31:52 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 1c8e780d-0a13-4484-bf18-ac0879db263a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73572) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 10:31:52 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 1c8e780d-0a13-4484-bf18-ac0879db263a] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 26 10:31:52 user nova-compute[73572]: DEBUG nova.virt.driver [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Emitting event <LifecycleEvent: 1693045912.2964313, 1c8e780d-0a13-4484-bf18-ac0879db263a => Started> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:31:52 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 1c8e780d-0a13-4484-bf18-ac0879db263a] VM Started (Lifecycle Event)
Aug 26 10:31:52 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 1c8e780d-0a13-4484-bf18-ac0879db263a] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:31:52 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 1c8e780d-0a13-4484-bf18-ac0879db263a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73572) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 10:31:52 user nova-compute[73572]: DEBUG nova.compute.manager [req-5fa2b3be-064e-45aa-adc8-2118d05e2ec8 req-b3e95dcf-ca6b-4b0d-afd0-b247b5a3dce1 service nova] [instance: 1c8e780d-0a13-4484-bf18-ac0879db263a] Received event network-vif-plugged-d03460b0-e0b9-4c39-a8a6-12cb80aca6bc {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:31:52 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-5fa2b3be-064e-45aa-adc8-2118d05e2ec8 req-b3e95dcf-ca6b-4b0d-afd0-b247b5a3dce1 service nova] Acquiring lock "1c8e780d-0a13-4484-bf18-ac0879db263a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:31:52 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-5fa2b3be-064e-45aa-adc8-2118d05e2ec8 req-b3e95dcf-ca6b-4b0d-afd0-b247b5a3dce1 service nova] Lock "1c8e780d-0a13-4484-bf18-ac0879db263a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:31:52 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-5fa2b3be-064e-45aa-adc8-2118d05e2ec8 req-b3e95dcf-ca6b-4b0d-afd0-b247b5a3dce1 service nova] Lock "1c8e780d-0a13-4484-bf18-ac0879db263a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:31:52 user nova-compute[73572]: DEBUG nova.compute.manager [req-5fa2b3be-064e-45aa-adc8-2118d05e2ec8 req-b3e95dcf-ca6b-4b0d-afd0-b247b5a3dce1 service nova] [instance: 1c8e780d-0a13-4484-bf18-ac0879db263a] No waiting events found dispatching network-vif-plugged-d03460b0-e0b9-4c39-a8a6-12cb80aca6bc {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:31:52 user nova-compute[73572]: WARNING nova.compute.manager [req-5fa2b3be-064e-45aa-adc8-2118d05e2ec8 req-b3e95dcf-ca6b-4b0d-afd0-b247b5a3dce1 service nova] [instance: 1c8e780d-0a13-4484-bf18-ac0879db263a] Received unexpected event network-vif-plugged-d03460b0-e0b9-4c39-a8a6-12cb80aca6bc for instance with vm_state active and task_state None.
Aug 26 10:31:52 user nova-compute[73572]: DEBUG nova.compute.manager [req-5fa2b3be-064e-45aa-adc8-2118d05e2ec8 req-b3e95dcf-ca6b-4b0d-afd0-b247b5a3dce1 service nova] [instance: 1c8e780d-0a13-4484-bf18-ac0879db263a] Received event network-vif-plugged-d03460b0-e0b9-4c39-a8a6-12cb80aca6bc {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:31:52 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-5fa2b3be-064e-45aa-adc8-2118d05e2ec8 req-b3e95dcf-ca6b-4b0d-afd0-b247b5a3dce1 service nova] Acquiring lock "1c8e780d-0a13-4484-bf18-ac0879db263a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:31:52 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-5fa2b3be-064e-45aa-adc8-2118d05e2ec8 req-b3e95dcf-ca6b-4b0d-afd0-b247b5a3dce1 service nova] Lock "1c8e780d-0a13-4484-bf18-ac0879db263a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:31:52 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-5fa2b3be-064e-45aa-adc8-2118d05e2ec8 req-b3e95dcf-ca6b-4b0d-afd0-b247b5a3dce1 service nova] Lock "1c8e780d-0a13-4484-bf18-ac0879db263a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:31:52 user nova-compute[73572]: DEBUG nova.compute.manager [req-5fa2b3be-064e-45aa-adc8-2118d05e2ec8 req-b3e95dcf-ca6b-4b0d-afd0-b247b5a3dce1 service nova] [instance: 1c8e780d-0a13-4484-bf18-ac0879db263a] No waiting events found dispatching network-vif-plugged-d03460b0-e0b9-4c39-a8a6-12cb80aca6bc {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:31:52 user nova-compute[73572]: WARNING nova.compute.manager [req-5fa2b3be-064e-45aa-adc8-2118d05e2ec8 req-b3e95dcf-ca6b-4b0d-afd0-b247b5a3dce1 service nova] [instance: 1c8e780d-0a13-4484-bf18-ac0879db263a] Received unexpected event network-vif-plugged-d03460b0-e0b9-4c39-a8a6-12cb80aca6bc for instance with vm_state active and task_state None.
Aug 26 10:31:53 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-8de9f560-a554-4ff8-a26c-e4c027f8af6f tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Acquiring lock "c785b609-0068-442f-91f5-d26e888a993f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:31:53 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-8de9f560-a554-4ff8-a26c-e4c027f8af6f tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Lock "c785b609-0068-442f-91f5-d26e888a993f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:31:53 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-8de9f560-a554-4ff8-a26c-e4c027f8af6f tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Acquiring lock "c785b609-0068-442f-91f5-d26e888a993f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:31:53 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-8de9f560-a554-4ff8-a26c-e4c027f8af6f tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Lock "c785b609-0068-442f-91f5-d26e888a993f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:31:53 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-8de9f560-a554-4ff8-a26c-e4c027f8af6f tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Lock "c785b609-0068-442f-91f5-d26e888a993f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:31:53 user nova-compute[73572]: INFO nova.compute.manager [None req-8de9f560-a554-4ff8-a26c-e4c027f8af6f tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: c785b609-0068-442f-91f5-d26e888a993f] Terminating instance
Aug 26 10:31:53 user nova-compute[73572]: DEBUG nova.compute.manager [None req-8de9f560-a554-4ff8-a26c-e4c027f8af6f tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: c785b609-0068-442f-91f5-d26e888a993f] Start destroying the instance on the hypervisor. {{(pid=73572) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 10:31:53 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:31:53 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:31:53 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:31:53 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:31:54 user nova-compute[73572]: INFO nova.virt.libvirt.driver [-] [instance: c785b609-0068-442f-91f5-d26e888a993f] Instance destroyed successfully.
Aug 26 10:31:54 user nova-compute[73572]: DEBUG nova.objects.instance [None req-8de9f560-a554-4ff8-a26c-e4c027f8af6f tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Lazy-loading 'resources' on Instance uuid c785b609-0068-442f-91f5-d26e888a993f {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:31:54 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-8de9f560-a554-4ff8-a26c-e4c027f8af6f tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T10:11:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-146724740',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-146724740',id=2,image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T10:11:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4636f93c5bfc4653804de097aed2882c',ramdisk_id='',reservation_id='r-in137qtn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-665602868',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T10:13:20Z,user_data=None,user_id='07f3538038a14713af3bbe420f1fb03a',uuid=c785b609-0068-442f-91f5-d26e888a993f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f01cdcf9-2430-4eb5-bb2d-3d126756dfc1", "address": "fa:16:3e:fa:6c:bc", "network": {"id": "991b9dff-5173-4456-a530-b1f7eb5cfa4a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1845930297-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4636f93c5bfc4653804de097aed2882c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf01cdcf9-24", "ovs_interfaceid": "f01cdcf9-2430-4eb5-bb2d-3d126756dfc1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 10:31:54 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-8de9f560-a554-4ff8-a26c-e4c027f8af6f tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Converting VIF {"id": "f01cdcf9-2430-4eb5-bb2d-3d126756dfc1", "address": "fa:16:3e:fa:6c:bc", "network": {"id": "991b9dff-5173-4456-a530-b1f7eb5cfa4a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1845930297-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4636f93c5bfc4653804de097aed2882c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf01cdcf9-24", "ovs_interfaceid": "f01cdcf9-2430-4eb5-bb2d-3d126756dfc1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:31:54 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-8de9f560-a554-4ff8-a26c-e4c027f8af6f tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fa:6c:bc,bridge_name='br-int',has_traffic_filtering=True,id=f01cdcf9-2430-4eb5-bb2d-3d126756dfc1,network=Network(991b9dff-5173-4456-a530-b1f7eb5cfa4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf01cdcf9-24') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:31:54 user nova-compute[73572]: DEBUG os_vif [None req-8de9f560-a554-4ff8-a26c-e4c027f8af6f tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fa:6c:bc,bridge_name='br-int',has_traffic_filtering=True,id=f01cdcf9-2430-4eb5-bb2d-3d126756dfc1,network=Network(991b9dff-5173-4456-a530-b1f7eb5cfa4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf01cdcf9-24') {{(pid=73572) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 10:31:54 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:31:54 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf01cdcf9-24, bridge=br-int, if_exists=True) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:31:54 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:31:54 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:31:54 user nova-compute[73572]: INFO os_vif [None req-8de9f560-a554-4ff8-a26c-e4c027f8af6f tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fa:6c:bc,bridge_name='br-int',has_traffic_filtering=True,id=f01cdcf9-2430-4eb5-bb2d-3d126756dfc1,network=Network(991b9dff-5173-4456-a530-b1f7eb5cfa4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf01cdcf9-24')
Aug 26 10:31:54 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-8de9f560-a554-4ff8-a26c-e4c027f8af6f tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: c785b609-0068-442f-91f5-d26e888a993f] Deleting instance files /opt/stack/data/nova/instances/c785b609-0068-442f-91f5-d26e888a993f_del
Aug 26 10:31:54 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-8de9f560-a554-4ff8-a26c-e4c027f8af6f tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: c785b609-0068-442f-91f5-d26e888a993f] Deletion of /opt/stack/data/nova/instances/c785b609-0068-442f-91f5-d26e888a993f_del complete
Aug 26 10:31:54 user nova-compute[73572]: INFO nova.compute.manager [None req-8de9f560-a554-4ff8-a26c-e4c027f8af6f tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] [instance: c785b609-0068-442f-91f5-d26e888a993f] Took 0.97 seconds to destroy the instance on the hypervisor.
Aug 26 10:31:54 user nova-compute[73572]: DEBUG oslo.service.loopingcall [None req-8de9f560-a554-4ff8-a26c-e4c027f8af6f tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73572) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 10:31:54 user nova-compute[73572]: DEBUG nova.compute.manager [-] [instance: c785b609-0068-442f-91f5-d26e888a993f] Deallocating network for instance {{(pid=73572) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 10:31:54 user nova-compute[73572]: DEBUG nova.network.neutron [-] [instance: c785b609-0068-442f-91f5-d26e888a993f] deallocate_for_instance() {{(pid=73572) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 10:31:54 user nova-compute[73572]: DEBUG nova.compute.manager [req-e0f82385-72c1-4c42-bcf9-3f2430a89e45 req-a2aefb44-d368-4129-881b-2e80c616e43f service nova] [instance: c785b609-0068-442f-91f5-d26e888a993f] Received event network-vif-unplugged-f01cdcf9-2430-4eb5-bb2d-3d126756dfc1 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:31:54 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-e0f82385-72c1-4c42-bcf9-3f2430a89e45 req-a2aefb44-d368-4129-881b-2e80c616e43f service nova] Acquiring lock "c785b609-0068-442f-91f5-d26e888a993f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:31:54 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-e0f82385-72c1-4c42-bcf9-3f2430a89e45 req-a2aefb44-d368-4129-881b-2e80c616e43f service nova] Lock "c785b609-0068-442f-91f5-d26e888a993f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:31:54 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-e0f82385-72c1-4c42-bcf9-3f2430a89e45 req-a2aefb44-d368-4129-881b-2e80c616e43f service nova] Lock "c785b609-0068-442f-91f5-d26e888a993f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:31:54 user nova-compute[73572]: DEBUG nova.compute.manager [req-e0f82385-72c1-4c42-bcf9-3f2430a89e45 req-a2aefb44-d368-4129-881b-2e80c616e43f service nova] [instance: c785b609-0068-442f-91f5-d26e888a993f] No waiting events found dispatching network-vif-unplugged-f01cdcf9-2430-4eb5-bb2d-3d126756dfc1 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:31:54 user nova-compute[73572]: DEBUG nova.compute.manager [req-e0f82385-72c1-4c42-bcf9-3f2430a89e45 req-a2aefb44-d368-4129-881b-2e80c616e43f service nova] [instance: c785b609-0068-442f-91f5-d26e888a993f] Received event network-vif-unplugged-f01cdcf9-2430-4eb5-bb2d-3d126756dfc1 for instance with task_state deleting. {{(pid=73572) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 10:31:54 user nova-compute[73572]: DEBUG nova.compute.manager [req-e0f82385-72c1-4c42-bcf9-3f2430a89e45 req-a2aefb44-d368-4129-881b-2e80c616e43f service nova] [instance: c785b609-0068-442f-91f5-d26e888a993f] Received event network-vif-plugged-f01cdcf9-2430-4eb5-bb2d-3d126756dfc1 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:31:54 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-e0f82385-72c1-4c42-bcf9-3f2430a89e45 req-a2aefb44-d368-4129-881b-2e80c616e43f service nova] Acquiring lock "c785b609-0068-442f-91f5-d26e888a993f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:31:54 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-e0f82385-72c1-4c42-bcf9-3f2430a89e45 req-a2aefb44-d368-4129-881b-2e80c616e43f service nova] Lock "c785b609-0068-442f-91f5-d26e888a993f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:31:54 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-e0f82385-72c1-4c42-bcf9-3f2430a89e45 req-a2aefb44-d368-4129-881b-2e80c616e43f service nova] Lock "c785b609-0068-442f-91f5-d26e888a993f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:31:54 user nova-compute[73572]: DEBUG nova.compute.manager [req-e0f82385-72c1-4c42-bcf9-3f2430a89e45 req-a2aefb44-d368-4129-881b-2e80c616e43f service nova] [instance: c785b609-0068-442f-91f5-d26e888a993f] No waiting events found dispatching network-vif-plugged-f01cdcf9-2430-4eb5-bb2d-3d126756dfc1 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:31:54 user nova-compute[73572]: WARNING nova.compute.manager [req-e0f82385-72c1-4c42-bcf9-3f2430a89e45 req-a2aefb44-d368-4129-881b-2e80c616e43f service nova] [instance: c785b609-0068-442f-91f5-d26e888a993f] Received unexpected event network-vif-plugged-f01cdcf9-2430-4eb5-bb2d-3d126756dfc1 for instance with vm_state active and task_state deleting.
Aug 26 10:31:55 user nova-compute[73572]: DEBUG nova.network.neutron [-] [instance: c785b609-0068-442f-91f5-d26e888a993f] Updating instance_info_cache with network_info: [] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:31:55 user nova-compute[73572]: INFO nova.compute.manager [-] [instance: c785b609-0068-442f-91f5-d26e888a993f] Took 0.61 seconds to deallocate network for instance.
Aug 26 10:31:55 user nova-compute[73572]: DEBUG nova.compute.manager [req-323ec294-2160-4ba1-90e2-0fca2f51f003 req-55071981-3801-4e05-8778-6c699295f145 service nova] [instance: c785b609-0068-442f-91f5-d26e888a993f] Received event network-vif-deleted-f01cdcf9-2430-4eb5-bb2d-3d126756dfc1 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:31:55 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-8de9f560-a554-4ff8-a26c-e4c027f8af6f tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:31:55 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-8de9f560-a554-4ff8-a26c-e4c027f8af6f tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:31:55 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:31:55 user nova-compute[73572]: DEBUG nova.compute.provider_tree [None req-8de9f560-a554-4ff8-a26c-e4c027f8af6f tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Inventory has not changed in ProviderTree for provider: e2cec974-59b2-4c77-a53d-a7f4e5a30d75 {{(pid=73572) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 10:31:55 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-8de9f560-a554-4ff8-a26c-e4c027f8af6f tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Inventory has not changed for provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73572) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 10:31:55 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-8de9f560-a554-4ff8-a26c-e4c027f8af6f tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.336s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:31:55 user nova-compute[73572]: INFO nova.scheduler.client.report [None req-8de9f560-a554-4ff8-a26c-e4c027f8af6f tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Deleted allocations for instance c785b609-0068-442f-91f5-d26e888a993f
Aug 26 10:31:55 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-8de9f560-a554-4ff8-a26c-e4c027f8af6f tempest-ServerBootFromVolumeStableRescueTest-665602868 tempest-ServerBootFromVolumeStableRescueTest-665602868-project-member] Lock "c785b609-0068-442f-91f5-d26e888a993f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.143s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:31:59 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:32:04 user nova-compute[73572]: DEBUG nova.compute.manager [req-8f2e23e4-bc1b-4c2c-a97f-43118b57cf5e req-7523ffa8-94d8-46cc-ac7b-3f1f979f9b97 service nova] [instance: 3a4c9522-9723-4ad4-8630-17a3aba70c98] Received event network-changed-663db499-c552-478e-bad7-938b2f65c619 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:32:04 user nova-compute[73572]: DEBUG nova.compute.manager [req-8f2e23e4-bc1b-4c2c-a97f-43118b57cf5e req-7523ffa8-94d8-46cc-ac7b-3f1f979f9b97 service nova] [instance: 3a4c9522-9723-4ad4-8630-17a3aba70c98] Refreshing instance network info cache due to event network-changed-663db499-c552-478e-bad7-938b2f65c619. {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 10:32:04 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-8f2e23e4-bc1b-4c2c-a97f-43118b57cf5e req-7523ffa8-94d8-46cc-ac7b-3f1f979f9b97 service nova] Acquiring lock "refresh_cache-3a4c9522-9723-4ad4-8630-17a3aba70c98" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:32:04 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-8f2e23e4-bc1b-4c2c-a97f-43118b57cf5e req-7523ffa8-94d8-46cc-ac7b-3f1f979f9b97 service nova] Acquired lock "refresh_cache-3a4c9522-9723-4ad4-8630-17a3aba70c98" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:32:04 user nova-compute[73572]: DEBUG nova.network.neutron [req-8f2e23e4-bc1b-4c2c-a97f-43118b57cf5e req-7523ffa8-94d8-46cc-ac7b-3f1f979f9b97 service nova] [instance: 3a4c9522-9723-4ad4-8630-17a3aba70c98] Refreshing network info cache for port 663db499-c552-478e-bad7-938b2f65c619 {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 10:32:04 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:32:04 user nova-compute[73572]: DEBUG nova.network.neutron [req-8f2e23e4-bc1b-4c2c-a97f-43118b57cf5e req-7523ffa8-94d8-46cc-ac7b-3f1f979f9b97 service nova] [instance: 3a4c9522-9723-4ad4-8630-17a3aba70c98] Updated VIF entry in instance network info cache for port 663db499-c552-478e-bad7-938b2f65c619. {{(pid=73572) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 10:32:04 user nova-compute[73572]: DEBUG nova.network.neutron [req-8f2e23e4-bc1b-4c2c-a97f-43118b57cf5e req-7523ffa8-94d8-46cc-ac7b-3f1f979f9b97 service nova] [instance: 3a4c9522-9723-4ad4-8630-17a3aba70c98] Updating instance_info_cache with network_info: [{"id": "663db499-c552-478e-bad7-938b2f65c619", "address": "fa:16:3e:fd:54:35", "network": {"id": "6bec7255-9e3a-43e3-aaf3-913e171ee99d", "bridge": "br-int", "label": "tempest-TestShelveInstance-1279582697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51eaa92831e54ba6bd3d71db1a4e24e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap663db499-c5", "ovs_interfaceid": "663db499-c552-478e-bad7-938b2f65c619", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:32:04 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-8f2e23e4-bc1b-4c2c-a97f-43118b57cf5e req-7523ffa8-94d8-46cc-ac7b-3f1f979f9b97 service nova] Releasing lock "refresh_cache-3a4c9522-9723-4ad4-8630-17a3aba70c98" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:32:04 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-64909495-c12b-4f6d-ac2f-030de1891544 tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] Acquiring lock "3a4c9522-9723-4ad4-8630-17a3aba70c98" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:32:04 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-64909495-c12b-4f6d-ac2f-030de1891544 tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] Lock "3a4c9522-9723-4ad4-8630-17a3aba70c98" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:32:04 user nova-compute[73572]: INFO nova.compute.manager [None req-64909495-c12b-4f6d-ac2f-030de1891544 tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] [instance: 3a4c9522-9723-4ad4-8630-17a3aba70c98] Shelve offloading
Aug 26 10:32:04 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:32:04 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:32:04 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:32:04 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:32:04 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:32:05 user nova-compute[73572]: DEBUG nova.compute.manager [req-10c53473-2f52-4528-815f-624f48af7b38 req-62f59aa1-10b6-4778-8780-b429f2744422 service nova] [instance: 3a4c9522-9723-4ad4-8630-17a3aba70c98] Received event network-vif-unplugged-663db499-c552-478e-bad7-938b2f65c619 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:32:05 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-10c53473-2f52-4528-815f-624f48af7b38 req-62f59aa1-10b6-4778-8780-b429f2744422 service nova] Acquiring lock "3a4c9522-9723-4ad4-8630-17a3aba70c98-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:32:05 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-10c53473-2f52-4528-815f-624f48af7b38 req-62f59aa1-10b6-4778-8780-b429f2744422 service nova] Lock "3a4c9522-9723-4ad4-8630-17a3aba70c98-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:32:05 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-10c53473-2f52-4528-815f-624f48af7b38 req-62f59aa1-10b6-4778-8780-b429f2744422 service nova] Lock "3a4c9522-9723-4ad4-8630-17a3aba70c98-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:32:05 user nova-compute[73572]: DEBUG nova.compute.manager [req-10c53473-2f52-4528-815f-624f48af7b38 req-62f59aa1-10b6-4778-8780-b429f2744422 service nova] [instance: 3a4c9522-9723-4ad4-8630-17a3aba70c98] No waiting events found dispatching network-vif-unplugged-663db499-c552-478e-bad7-938b2f65c619 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:32:05 user nova-compute[73572]: WARNING nova.compute.manager [req-10c53473-2f52-4528-815f-624f48af7b38 req-62f59aa1-10b6-4778-8780-b429f2744422 service nova] [instance: 3a4c9522-9723-4ad4-8630-17a3aba70c98] Received unexpected event network-vif-unplugged-663db499-c552-478e-bad7-938b2f65c619 for instance with vm_state active and task_state shelving.
Aug 26 10:32:05 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:32:05 user nova-compute[73572]: INFO nova.virt.libvirt.driver [-] [instance: 3a4c9522-9723-4ad4-8630-17a3aba70c98] Instance destroyed successfully.
Aug 26 10:32:05 user nova-compute[73572]: DEBUG nova.compute.manager [None req-64909495-c12b-4f6d-ac2f-030de1891544 tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] [instance: 3a4c9522-9723-4ad4-8630-17a3aba70c98] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:32:05 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-64909495-c12b-4f6d-ac2f-030de1891544 tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] Acquiring lock "refresh_cache-3a4c9522-9723-4ad4-8630-17a3aba70c98" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:32:05 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-64909495-c12b-4f6d-ac2f-030de1891544 tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] Acquired lock "refresh_cache-3a4c9522-9723-4ad4-8630-17a3aba70c98" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:32:05 user nova-compute[73572]: DEBUG nova.network.neutron [None req-64909495-c12b-4f6d-ac2f-030de1891544 tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] [instance: 3a4c9522-9723-4ad4-8630-17a3aba70c98] Building network info cache for instance {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 10:32:06 user nova-compute[73572]: DEBUG nova.network.neutron [None req-64909495-c12b-4f6d-ac2f-030de1891544 tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] [instance: 3a4c9522-9723-4ad4-8630-17a3aba70c98] Updating instance_info_cache with network_info: [{"id": "663db499-c552-478e-bad7-938b2f65c619", "address": "fa:16:3e:fd:54:35", "network": {"id": "6bec7255-9e3a-43e3-aaf3-913e171ee99d", "bridge": "br-int", "label": "tempest-TestShelveInstance-1279582697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51eaa92831e54ba6bd3d71db1a4e24e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap663db499-c5", "ovs_interfaceid": "663db499-c552-478e-bad7-938b2f65c619", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:32:06 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-64909495-c12b-4f6d-ac2f-030de1891544 tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] Releasing lock "refresh_cache-3a4c9522-9723-4ad4-8630-17a3aba70c98" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:32:06 user nova-compute[73572]: INFO nova.virt.libvirt.driver [-] [instance: 3a4c9522-9723-4ad4-8630-17a3aba70c98] Instance destroyed successfully.
Aug 26 10:32:06 user nova-compute[73572]: DEBUG nova.objects.instance [None req-64909495-c12b-4f6d-ac2f-030de1891544 tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] Lazy-loading 'resources' on Instance uuid 3a4c9522-9723-4ad4-8630-17a3aba70c98 {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:32:06 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-64909495-c12b-4f6d-ac2f-030de1891544 tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T10:30:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-2038663999',display_name='tempest-TestShelveInstance-server-2038663999',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-2038663999',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJMZDyaM/+VCFQG3701Z0FaBkgWoaji0UPFWpQswT1wZzAYHJZTlb5cmnzgNgUoUdDBH0mAV39s4kCVhnK3UsUjQb2bImpxYDfN7ddzW4ZDHjoplOmZ53CGkaz6SnTlrhg==',key_name='tempest-TestShelveInstance-188411046',keypairs=<?>,launch_index=0,launched_at=2023-08-26T10:30:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='51eaa92831e54ba6bd3d71db1a4e24e0',ramdisk_id='',reservation_id='r-yp88ce4a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-912363172',owner_user_name='tempest-TestShelveInstance-912363172-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T10:30:30Z,user_data=None,user_id='6d0074f39a8141119bd94ffa83bd80aa',uuid=3a4c9522-9723-4ad4-8630-17a3aba70c98,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "663db499-c552-478e-bad7-938b2f65c619", "address": "fa:16:3e:fd:54:35", "network": {"id": "6bec7255-9e3a-43e3-aaf3-913e171ee99d", "bridge": "br-int", "label": "tempest-TestShelveInstance-1279582697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51eaa92831e54ba6bd3d71db1a4e24e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap663db499-c5", "ovs_interfaceid": "663db499-c552-478e-bad7-938b2f65c619", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 10:32:06 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-64909495-c12b-4f6d-ac2f-030de1891544 tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] Converting VIF {"id": "663db499-c552-478e-bad7-938b2f65c619", "address": "fa:16:3e:fd:54:35", "network": {"id": "6bec7255-9e3a-43e3-aaf3-913e171ee99d", "bridge": "br-int", "label": "tempest-TestShelveInstance-1279582697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51eaa92831e54ba6bd3d71db1a4e24e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap663db499-c5", "ovs_interfaceid": "663db499-c552-478e-bad7-938b2f65c619", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:32:06 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-64909495-c12b-4f6d-ac2f-030de1891544 tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:54:35,bridge_name='br-int',has_traffic_filtering=True,id=663db499-c552-478e-bad7-938b2f65c619,network=Network(6bec7255-9e3a-43e3-aaf3-913e171ee99d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap663db499-c5') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:32:06 user nova-compute[73572]: DEBUG os_vif [None req-64909495-c12b-4f6d-ac2f-030de1891544 tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:54:35,bridge_name='br-int',has_traffic_filtering=True,id=663db499-c552-478e-bad7-938b2f65c619,network=Network(6bec7255-9e3a-43e3-aaf3-913e171ee99d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap663db499-c5') {{(pid=73572) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 10:32:06 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:32:06 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap663db499-c5, bridge=br-int, if_exists=True) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:32:06 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:32:06 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:32:06 user nova-compute[73572]: INFO os_vif [None req-64909495-c12b-4f6d-ac2f-030de1891544 tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:54:35,bridge_name='br-int',has_traffic_filtering=True,id=663db499-c552-478e-bad7-938b2f65c619,network=Network(6bec7255-9e3a-43e3-aaf3-913e171ee99d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap663db499-c5')
Aug 26 10:32:06 user nova-compute[73572]: DEBUG nova.compute.manager [req-f02167b1-e1e4-48bf-a362-d92f8d64505c req-de91c339-de58-4dbc-af9f-fa02da3cef20 service nova] [instance: 3a4c9522-9723-4ad4-8630-17a3aba70c98] Received event network-changed-663db499-c552-478e-bad7-938b2f65c619 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:32:06 user nova-compute[73572]: DEBUG nova.compute.manager [req-f02167b1-e1e4-48bf-a362-d92f8d64505c req-de91c339-de58-4dbc-af9f-fa02da3cef20 service nova] [instance: 3a4c9522-9723-4ad4-8630-17a3aba70c98] Refreshing instance network info cache due to event network-changed-663db499-c552-478e-bad7-938b2f65c619. {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 10:32:06 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-f02167b1-e1e4-48bf-a362-d92f8d64505c req-de91c339-de58-4dbc-af9f-fa02da3cef20 service nova] Acquiring lock "refresh_cache-3a4c9522-9723-4ad4-8630-17a3aba70c98" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:32:06 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-f02167b1-e1e4-48bf-a362-d92f8d64505c req-de91c339-de58-4dbc-af9f-fa02da3cef20 service nova] Acquired lock "refresh_cache-3a4c9522-9723-4ad4-8630-17a3aba70c98" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:32:06 user nova-compute[73572]: DEBUG nova.network.neutron [req-f02167b1-e1e4-48bf-a362-d92f8d64505c req-de91c339-de58-4dbc-af9f-fa02da3cef20 service nova] [instance: 3a4c9522-9723-4ad4-8630-17a3aba70c98] Refreshing network info cache for port 663db499-c552-478e-bad7-938b2f65c619 {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 10:32:06 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-64909495-c12b-4f6d-ac2f-030de1891544 tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] [instance: 3a4c9522-9723-4ad4-8630-17a3aba70c98] calling os-brick to detach iSCSI Volume {{(pid=73572) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 10:32:06 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-64909495-c12b-4f6d-ac2f-030de1891544 tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc89c3d6a10>, {'target_iqns': ['iqn.2010-10.org.openstack:ec96ec24-bf73-4f38-ac9f-eb2699d0a661'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tqbEgzCT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 10:32:06 user nova-compute[73572]: WARNING os_brick.initiator.connectors.base [None req-64909495-c12b-4f6d-ac2f-030de1891544 tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 10:32:06 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-64909495-c12b-4f6d-ac2f-030de1891544 tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 10:32:06 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-64909495-c12b-4f6d-ac2f-030de1891544 tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 10:32:06 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-64909495-c12b-4f6d-ac2f-030de1891544 tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ec96ec24-bf73-4f38-ac9f-eb2699d0a661', 0)] {{(pid=73572) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 10:32:06 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:32:06 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:32:06 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[e15c5258-dff2-4a95-858a-341b2d3fa60c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d8aa6fc0-ce50-4db6-8d7d-9f37eae07207\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ec96ec24-bf73-4f38-ac9f-eb2699d0a661\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:32:06 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:32:06 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:32:06 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ef8e498-81a9-46d1-a266-80ac7cc46d19]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8aa6fc0-ce50-4db6-8d7d-9f37eae07207 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec96ec24-bf73-4f38-ac9f-eb2699d0a661 (non-flash)\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:32:06 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-64909495-c12b-4f6d-ac2f-030de1891544 tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8aa6fc0-ce50-4db6-8d7d-9f37eae07207 (non-flash)
Aug 26 10:32:06 user nova-compute[73572]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec96ec24-bf73-4f38-ac9f-eb2699d0a661 (non-flash)
Aug 26 10:32:06 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 10:32:06 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-64909495-c12b-4f6d-ac2f-030de1891544 tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8aa6fc0-ce50-4db6-8d7d-9f37eae07207 (non-flash)
Aug 26 10:32:06 user nova-compute[73572]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec96ec24-bf73-4f38-ac9f-eb2699d0a661 (non-flash)
Aug 26 10:32:06 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 10:32:06 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-64909495-c12b-4f6d-ac2f-030de1891544 tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc878c26dd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ec96ec24-bf73-4f38-ac9f-eb2699d0a661'): ({'sdc'}, set())}) {{(pid=73572) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 10:32:06 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-64909495-c12b-4f6d-ac2f-030de1891544 tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] Removing single pathed devices sdc {{(pid=73572) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 10:32:06 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:32:06 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:32:06 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea32aea2-c135-4b9d-9e92-301156d1d658]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:32:06 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:32:06 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:32:06 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[3df27e3a-033b-49f1-a7df-8a713edb1250]: (4, ('ok\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:32:06 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-64909495-c12b-4f6d-ac2f-030de1891544 tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] Flushing IO for device /dev/sdc {{(pid=73572) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 10:32:06 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:32:06 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:32:06 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[62fd8781-127c-403b-b678-afbae84ec65d]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:32:06 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-64909495-c12b-4f6d-ac2f-030de1891544 tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73572) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 10:32:06 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:32:06 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.040s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:32:06 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6df2d25-f9c0-4913-b859-8b80f93d0c91]: (4, ('1', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:32:06 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-64909495-c12b-4f6d-ac2f-030de1891544 tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73572) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 10:32:06 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-64909495-c12b-4f6d-ac2f-030de1891544 tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] SCSI volumes sdc have been removed. {{(pid=73572) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 10:32:06 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-64909495-c12b-4f6d-ac2f-030de1891544 tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ec96ec24-bf73-4f38-ac9f-eb2699d0a661')] {{(pid=73572) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 10:32:06 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec96ec24-bf73-4f38-ac9f-eb2699d0a661 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:32:06 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec96ec24-bf73-4f38-ac9f-eb2699d0a661 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:32:06 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef60bd24-e803-444a-9fb0-73b789925027]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:32:06 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-64909495-c12b-4f6d-ac2f-030de1891544 tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:32:06 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec96ec24-bf73-4f38-ac9f-eb2699d0a661 -p 172.16.0.220:3260 --logout {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:32:07 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec96ec24-bf73-4f38-ac9f-eb2699d0a661 -p 172.16.0.220:3260 --logout" returned: 0 in 0.208s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:32:07 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[60017ff9-cbfc-4222-b671-dc4dec0d29e6]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:ec96ec24-bf73-4f38-ac9f-eb2699d0a661, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:ec96ec24-bf73-4f38-ac9f-eb2699d0a661, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:32:07 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-64909495-c12b-4f6d-ac2f-030de1891544 tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:ec96ec24-bf73-4f38-ac9f-eb2699d0a661, portal: 172.16.0.220,3260]
Aug 26 10:32:07 user nova-compute[73572]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:ec96ec24-bf73-4f38-ac9f-eb2699d0a661, portal: 172.16.0.220,3260] successful.
Aug 26 10:32:07 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:32:07 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec96ec24-bf73-4f38-ac9f-eb2699d0a661 -p 172.16.0.220:3260 --op delete {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:32:07 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec96ec24-bf73-4f38-ac9f-eb2699d0a661 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.065s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:32:07 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[87c30762-17c8-47a6-8d51-adc20daebb6d]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:32:07 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-64909495-c12b-4f6d-ac2f-030de1891544 tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:32:07 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-64909495-c12b-4f6d-ac2f-030de1891544 tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.468s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 10:32:07 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-64909495-c12b-4f6d-ac2f-030de1891544 tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] <== disconnect_volume: return (470ms) None {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 10:32:07 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-64909495-c12b-4f6d-ac2f-030de1891544 tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] [instance: 3a4c9522-9723-4ad4-8630-17a3aba70c98] Disconnected iSCSI Volume {{(pid=73572) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 10:32:07 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-64909495-c12b-4f6d-ac2f-030de1891544 tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] [instance: 3a4c9522-9723-4ad4-8630-17a3aba70c98] Deleting instance files /opt/stack/data/nova/instances/3a4c9522-9723-4ad4-8630-17a3aba70c98_del
Aug 26 10:32:07 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-64909495-c12b-4f6d-ac2f-030de1891544 tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] [instance: 3a4c9522-9723-4ad4-8630-17a3aba70c98] Deletion of /opt/stack/data/nova/instances/3a4c9522-9723-4ad4-8630-17a3aba70c98_del complete
Aug 26 10:32:07 user nova-compute[73572]: DEBUG nova.compute.manager [req-ad43ce9d-4ae4-4e51-97d1-f83e5fbaf5be req-3348fd22-b5c5-4346-be4f-682f6c7e7951 service nova] [instance: 3a4c9522-9723-4ad4-8630-17a3aba70c98] Received event network-vif-plugged-663db499-c552-478e-bad7-938b2f65c619 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:32:07 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-ad43ce9d-4ae4-4e51-97d1-f83e5fbaf5be req-3348fd22-b5c5-4346-be4f-682f6c7e7951 service nova] Acquiring lock "3a4c9522-9723-4ad4-8630-17a3aba70c98-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:32:07 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-ad43ce9d-4ae4-4e51-97d1-f83e5fbaf5be req-3348fd22-b5c5-4346-be4f-682f6c7e7951 service nova] Lock "3a4c9522-9723-4ad4-8630-17a3aba70c98-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:32:07 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-ad43ce9d-4ae4-4e51-97d1-f83e5fbaf5be req-3348fd22-b5c5-4346-be4f-682f6c7e7951 service nova] Lock "3a4c9522-9723-4ad4-8630-17a3aba70c98-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:32:07 user nova-compute[73572]: DEBUG nova.compute.manager [req-ad43ce9d-4ae4-4e51-97d1-f83e5fbaf5be req-3348fd22-b5c5-4346-be4f-682f6c7e7951 service nova] [instance: 3a4c9522-9723-4ad4-8630-17a3aba70c98] No waiting events found dispatching network-vif-plugged-663db499-c552-478e-bad7-938b2f65c619 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:32:07 user nova-compute[73572]: WARNING nova.compute.manager [req-ad43ce9d-4ae4-4e51-97d1-f83e5fbaf5be req-3348fd22-b5c5-4346-be4f-682f6c7e7951 service nova] [instance: 3a4c9522-9723-4ad4-8630-17a3aba70c98] Received unexpected event network-vif-plugged-663db499-c552-478e-bad7-938b2f65c619 for instance with vm_state active and task_state shelving.
Aug 26 10:32:07 user nova-compute[73572]: DEBUG nova.network.neutron [req-f02167b1-e1e4-48bf-a362-d92f8d64505c req-de91c339-de58-4dbc-af9f-fa02da3cef20 service nova] [instance: 3a4c9522-9723-4ad4-8630-17a3aba70c98] Updated VIF entry in instance network info cache for port 663db499-c552-478e-bad7-938b2f65c619. {{(pid=73572) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 10:32:07 user nova-compute[73572]: DEBUG nova.network.neutron [req-f02167b1-e1e4-48bf-a362-d92f8d64505c req-de91c339-de58-4dbc-af9f-fa02da3cef20 service nova] [instance: 3a4c9522-9723-4ad4-8630-17a3aba70c98] Updating instance_info_cache with network_info: [{"id": "663db499-c552-478e-bad7-938b2f65c619", "address": "fa:16:3e:fd:54:35", "network": {"id": "6bec7255-9e3a-43e3-aaf3-913e171ee99d", "bridge": null, "label": "tempest-TestShelveInstance-1279582697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51eaa92831e54ba6bd3d71db1a4e24e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap663db499-c5", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:32:07 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-f02167b1-e1e4-48bf-a362-d92f8d64505c req-de91c339-de58-4dbc-af9f-fa02da3cef20 service nova] Releasing lock "refresh_cache-3a4c9522-9723-4ad4-8630-17a3aba70c98" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:32:08 user nova-compute[73572]: INFO nova.scheduler.client.report [None req-64909495-c12b-4f6d-ac2f-030de1891544 tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] Deleted allocations for instance 3a4c9522-9723-4ad4-8630-17a3aba70c98
Aug 26 10:32:08 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-64909495-c12b-4f6d-ac2f-030de1891544 tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:32:08 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-64909495-c12b-4f6d-ac2f-030de1891544 tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:32:08 user nova-compute[73572]: DEBUG nova.objects.instance [None req-64909495-c12b-4f6d-ac2f-030de1891544 tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] Lazy-loading 'numa_topology' on Instance uuid 3a4c9522-9723-4ad4-8630-17a3aba70c98 {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:32:08 user nova-compute[73572]: DEBUG nova.objects.base [None req-64909495-c12b-4f6d-ac2f-030de1891544 tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] Object Instance<3a4c9522-9723-4ad4-8630-17a3aba70c98> lazy-loaded attributes: resources,numa_topology {{(pid=73572) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 10:32:08 user nova-compute[73572]: DEBUG nova.compute.provider_tree [None req-64909495-c12b-4f6d-ac2f-030de1891544 tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] Inventory has not changed in ProviderTree for provider: e2cec974-59b2-4c77-a53d-a7f4e5a30d75 {{(pid=73572) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 10:32:08 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-64909495-c12b-4f6d-ac2f-030de1891544 tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] Inventory has not changed for provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73572) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 10:32:08 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-64909495-c12b-4f6d-ac2f-030de1891544 tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.238s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:32:08 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-64909495-c12b-4f6d-ac2f-030de1891544 tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] Lock "3a4c9522-9723-4ad4-8630-17a3aba70c98" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 3.813s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:32:09 user nova-compute[73572]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693045914.3143623, c785b609-0068-442f-91f5-d26e888a993f => Stopped> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:32:09 user nova-compute[73572]: INFO nova.compute.manager [-] [instance: c785b609-0068-442f-91f5-d26e888a993f] VM Stopped (Lifecycle Event)
Aug 26 10:32:09 user nova-compute[73572]: DEBUG nova.compute.manager [None req-4cd6873e-e339-4855-b3eb-b623ca7f63e8 None None] [instance: c785b609-0068-442f-91f5-d26e888a993f] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:32:09 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-27f23582-6208-4759-be6a-c98733d521f7 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Acquiring lock "6004b15a-be01-42eb-92ba-ae9d93dab708" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:32:09 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-27f23582-6208-4759-be6a-c98733d521f7 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Lock "6004b15a-be01-42eb-92ba-ae9d93dab708" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:32:09 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-27f23582-6208-4759-be6a-c98733d521f7 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Acquiring lock "6004b15a-be01-42eb-92ba-ae9d93dab708-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:32:09 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-27f23582-6208-4759-be6a-c98733d521f7 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Lock "6004b15a-be01-42eb-92ba-ae9d93dab708-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:32:09 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-27f23582-6208-4759-be6a-c98733d521f7 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Lock "6004b15a-be01-42eb-92ba-ae9d93dab708-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:32:09 user nova-compute[73572]: INFO nova.compute.manager [None req-27f23582-6208-4759-be6a-c98733d521f7 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] [instance: 6004b15a-be01-42eb-92ba-ae9d93dab708] Terminating instance
Aug 26 10:32:09 user nova-compute[73572]: DEBUG nova.compute.manager [None req-27f23582-6208-4759-be6a-c98733d521f7 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] [instance: 6004b15a-be01-42eb-92ba-ae9d93dab708] Start destroying the instance on the hypervisor. {{(pid=73572) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 10:32:09 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:32:10 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:32:10 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:32:10 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:32:10 user nova-compute[73572]: DEBUG nova.compute.manager [req-776ce944-22b0-40e7-b172-24136b4ad8fd req-11b7d234-4b11-4880-aebe-1c614933f4de service nova] [instance: 6004b15a-be01-42eb-92ba-ae9d93dab708] Received event network-vif-unplugged-8c801229-2284-4cd5-bdce-45c96edfe633 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:32:10 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-776ce944-22b0-40e7-b172-24136b4ad8fd req-11b7d234-4b11-4880-aebe-1c614933f4de service nova] Acquiring lock "6004b15a-be01-42eb-92ba-ae9d93dab708-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:32:10 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-776ce944-22b0-40e7-b172-24136b4ad8fd req-11b7d234-4b11-4880-aebe-1c614933f4de service nova] Lock "6004b15a-be01-42eb-92ba-ae9d93dab708-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:32:10 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-776ce944-22b0-40e7-b172-24136b4ad8fd req-11b7d234-4b11-4880-aebe-1c614933f4de service nova] Lock "6004b15a-be01-42eb-92ba-ae9d93dab708-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:32:10 user nova-compute[73572]: DEBUG nova.compute.manager [req-776ce944-22b0-40e7-b172-24136b4ad8fd req-11b7d234-4b11-4880-aebe-1c614933f4de service nova] [instance: 6004b15a-be01-42eb-92ba-ae9d93dab708] No waiting events found dispatching network-vif-unplugged-8c801229-2284-4cd5-bdce-45c96edfe633 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:32:10 user nova-compute[73572]: DEBUG nova.compute.manager [req-776ce944-22b0-40e7-b172-24136b4ad8fd req-11b7d234-4b11-4880-aebe-1c614933f4de service nova] [instance: 6004b15a-be01-42eb-92ba-ae9d93dab708] Received event network-vif-unplugged-8c801229-2284-4cd5-bdce-45c96edfe633 for instance with task_state deleting. {{(pid=73572) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 10:32:10 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:32:10 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:32:10 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:32:10 user nova-compute[73572]: INFO nova.virt.libvirt.driver [-] [instance: 6004b15a-be01-42eb-92ba-ae9d93dab708] Instance destroyed successfully.
Aug 26 10:32:10 user nova-compute[73572]: DEBUG nova.objects.instance [None req-27f23582-6208-4759-be6a-c98733d521f7 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Lazy-loading 'resources' on Instance uuid 6004b15a-be01-42eb-92ba-ae9d93dab708 {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:32:10 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-27f23582-6208-4759-be6a-c98733d521f7 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-26T10:25:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-166680841',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-166680841',id=36,image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEWBTOS0AHv6z8RWaiABqHulvjrbLaR96xRD15E/r0t/2UB9/kL95/Qkv/M3GvF6W0m+wG/rQ4SeVcwMM5A26UfTmnRR7kQj+Z+7W0aLcHEsnrsN1N0vrrqZEDPZaXipgQ==',key_name='tempest-keypair-1985542231',keypairs=<?>,launch_index=0,launched_at=2023-08-26T10:29:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c7e16843614c451d958e817c832d4cbc',ramdisk_id='',reservation_id='r-xx7zocnt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-706965180',owner_user_name='tempest-AttachVolumeShelveTestJSON-706965180-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T10:29:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='17243251fe57431c9c98195a16239c5f',uuid=6004b15a-be01-42eb-92ba-ae9d93dab708,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8c801229-2284-4cd5-bdce-45c96edfe633", "address": "fa:16:3e:5a:0e:fa", "network": {"id": "317d2681-96ce-4898-b6fb-8892ee6f706d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2049963835-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7e16843614c451d958e817c832d4cbc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c801229-22", "ovs_interfaceid": "8c801229-2284-4cd5-bdce-45c96edfe633", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 10:32:10 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-27f23582-6208-4759-be6a-c98733d521f7 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Converting VIF {"id": "8c801229-2284-4cd5-bdce-45c96edfe633", "address": "fa:16:3e:5a:0e:fa", "network": {"id": "317d2681-96ce-4898-b6fb-8892ee6f706d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2049963835-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7e16843614c451d958e817c832d4cbc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c801229-22", "ovs_interfaceid": "8c801229-2284-4cd5-bdce-45c96edfe633", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:32:10 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-27f23582-6208-4759-be6a-c98733d521f7 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:0e:fa,bridge_name='br-int',has_traffic_filtering=True,id=8c801229-2284-4cd5-bdce-45c96edfe633,network=Network(317d2681-96ce-4898-b6fb-8892ee6f706d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c801229-22') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:32:10 user nova-compute[73572]: DEBUG os_vif [None req-27f23582-6208-4759-be6a-c98733d521f7 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:0e:fa,bridge_name='br-int',has_traffic_filtering=True,id=8c801229-2284-4cd5-bdce-45c96edfe633,network=Network(317d2681-96ce-4898-b6fb-8892ee6f706d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c801229-22') {{(pid=73572) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 10:32:10 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:32:10 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8c801229-22, bridge=br-int, if_exists=True) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:32:10 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:32:10 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:32:10 user nova-compute[73572]: INFO os_vif [None req-27f23582-6208-4759-be6a-c98733d521f7 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:0e:fa,bridge_name='br-int',has_traffic_filtering=True,id=8c801229-2284-4cd5-bdce-45c96edfe633,network=Network(317d2681-96ce-4898-b6fb-8892ee6f706d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c801229-22')
Aug 26 10:32:10 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-27f23582-6208-4759-be6a-c98733d521f7 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] [instance: 6004b15a-be01-42eb-92ba-ae9d93dab708] Deleting instance files /opt/stack/data/nova/instances/6004b15a-be01-42eb-92ba-ae9d93dab708_del
Aug 26 10:32:10 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-27f23582-6208-4759-be6a-c98733d521f7 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] [instance: 6004b15a-be01-42eb-92ba-ae9d93dab708] Deletion of /opt/stack/data/nova/instances/6004b15a-be01-42eb-92ba-ae9d93dab708_del complete
Aug 26 10:32:10 user nova-compute[73572]: INFO nova.compute.manager [None req-27f23582-6208-4759-be6a-c98733d521f7 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] [instance: 6004b15a-be01-42eb-92ba-ae9d93dab708] Took 0.88 seconds to destroy the instance on the hypervisor.
Aug 26 10:32:10 user nova-compute[73572]: DEBUG oslo.service.loopingcall [None req-27f23582-6208-4759-be6a-c98733d521f7 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73572) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 10:32:10 user nova-compute[73572]: DEBUG nova.compute.manager [-] [instance: 6004b15a-be01-42eb-92ba-ae9d93dab708] Deallocating network for instance {{(pid=73572) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 10:32:10 user nova-compute[73572]: DEBUG nova.network.neutron [-] [instance: 6004b15a-be01-42eb-92ba-ae9d93dab708] deallocate_for_instance() {{(pid=73572) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 10:32:11 user nova-compute[73572]: DEBUG nova.network.neutron [-] [instance: 6004b15a-be01-42eb-92ba-ae9d93dab708] Updating instance_info_cache with network_info: [] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:32:11 user nova-compute[73572]: INFO nova.compute.manager [-] [instance: 6004b15a-be01-42eb-92ba-ae9d93dab708] Took 1.10 seconds to deallocate network for instance.
Aug 26 10:32:11 user nova-compute[73572]: DEBUG nova.compute.manager [req-4b455783-3758-4b8e-ad72-581c13d0208a req-56a9eca1-7d6f-4a4a-90d7-3692182d528e service nova] [instance: 6004b15a-be01-42eb-92ba-ae9d93dab708] Received event network-vif-deleted-8c801229-2284-4cd5-bdce-45c96edfe633 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:32:11 user nova-compute[73572]: INFO nova.compute.manager [req-4b455783-3758-4b8e-ad72-581c13d0208a req-56a9eca1-7d6f-4a4a-90d7-3692182d528e service nova] [instance: 6004b15a-be01-42eb-92ba-ae9d93dab708] Neutron deleted interface 8c801229-2284-4cd5-bdce-45c96edfe633; detaching it from the instance and deleting it from the info cache
Aug 26 10:32:11 user nova-compute[73572]: DEBUG nova.network.neutron [req-4b455783-3758-4b8e-ad72-581c13d0208a req-56a9eca1-7d6f-4a4a-90d7-3692182d528e service nova] [instance: 6004b15a-be01-42eb-92ba-ae9d93dab708] Updating instance_info_cache with network_info: [] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:32:11 user nova-compute[73572]: DEBUG nova.compute.manager [req-4b455783-3758-4b8e-ad72-581c13d0208a req-56a9eca1-7d6f-4a4a-90d7-3692182d528e service nova] [instance: 6004b15a-be01-42eb-92ba-ae9d93dab708] Detach interface failed, port_id=8c801229-2284-4cd5-bdce-45c96edfe633, reason: Instance 6004b15a-be01-42eb-92ba-ae9d93dab708 could not be found. {{(pid=73572) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 10:32:11 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-27f23582-6208-4759-be6a-c98733d521f7 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:32:11 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-27f23582-6208-4759-be6a-c98733d521f7 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:32:12 user nova-compute[73572]: DEBUG nova.compute.provider_tree [None req-27f23582-6208-4759-be6a-c98733d521f7 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Inventory has not changed in ProviderTree for provider: e2cec974-59b2-4c77-a53d-a7f4e5a30d75 {{(pid=73572) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 10:32:12 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-27f23582-6208-4759-be6a-c98733d521f7 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Inventory has not changed for provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73572) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 10:32:12 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-27f23582-6208-4759-be6a-c98733d521f7 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.255s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:32:12 user nova-compute[73572]: INFO nova.scheduler.client.report [None req-27f23582-6208-4759-be6a-c98733d521f7 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Deleted allocations for instance 6004b15a-be01-42eb-92ba-ae9d93dab708
Aug 26 10:32:12 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-27f23582-6208-4759-be6a-c98733d521f7 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Lock "6004b15a-be01-42eb-92ba-ae9d93dab708" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.422s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:32:12 user nova-compute[73572]: DEBUG nova.compute.manager [req-88b0a72d-d9b5-41e4-88a3-b69eb208d4bc req-56044d25-d870-40a9-b429-750897c79c30 service nova] [instance: 6004b15a-be01-42eb-92ba-ae9d93dab708] Received event network-vif-plugged-8c801229-2284-4cd5-bdce-45c96edfe633 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:32:12 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-88b0a72d-d9b5-41e4-88a3-b69eb208d4bc req-56044d25-d870-40a9-b429-750897c79c30 service nova] Acquiring lock "6004b15a-be01-42eb-92ba-ae9d93dab708-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:32:12 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-88b0a72d-d9b5-41e4-88a3-b69eb208d4bc req-56044d25-d870-40a9-b429-750897c79c30 service nova] Lock "6004b15a-be01-42eb-92ba-ae9d93dab708-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:32:12 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-88b0a72d-d9b5-41e4-88a3-b69eb208d4bc req-56044d25-d870-40a9-b429-750897c79c30 service nova] Lock "6004b15a-be01-42eb-92ba-ae9d93dab708-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:32:12 user nova-compute[73572]: DEBUG nova.compute.manager [req-88b0a72d-d9b5-41e4-88a3-b69eb208d4bc req-56044d25-d870-40a9-b429-750897c79c30 service nova] [instance: 6004b15a-be01-42eb-92ba-ae9d93dab708] No waiting events found dispatching network-vif-plugged-8c801229-2284-4cd5-bdce-45c96edfe633 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:32:12 user nova-compute[73572]: WARNING nova.compute.manager [req-88b0a72d-d9b5-41e4-88a3-b69eb208d4bc req-56044d25-d870-40a9-b429-750897c79c30 service nova] [instance: 6004b15a-be01-42eb-92ba-ae9d93dab708] Received unexpected event network-vif-plugged-8c801229-2284-4cd5-bdce-45c96edfe633 for instance with vm_state deleted and task_state None.
Aug 26 10:32:15 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:32:15 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:32:20 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:32:20 user nova-compute[73572]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693045925.5322773, 3a4c9522-9723-4ad4-8630-17a3aba70c98 => Stopped> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:32:20 user nova-compute[73572]: INFO nova.compute.manager [-] [instance: 3a4c9522-9723-4ad4-8630-17a3aba70c98] VM Stopped (Lifecycle Event)
Aug 26 10:32:20 user nova-compute[73572]: DEBUG nova.compute.manager [None req-b23fed4c-0da5-46e1-8a2f-57e1b954923c None None] [instance: 3a4c9522-9723-4ad4-8630-17a3aba70c98] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:32:20 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:32:20 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:32:20 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Starting heal instance info cache {{(pid=73572) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 10:32:20 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Rebuilding the list of instances to heal {{(pid=73572) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 10:32:20 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquiring lock "refresh_cache-2eaea7c2-a5c0-4950-b033-0012b5cec0ee" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:32:20 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquired lock "refresh_cache-2eaea7c2-a5c0-4950-b033-0012b5cec0ee" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:32:20 user nova-compute[73572]: DEBUG nova.network.neutron [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] [instance: 2eaea7c2-a5c0-4950-b033-0012b5cec0ee] Forcefully refreshing network info cache for instance {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 10:32:20 user nova-compute[73572]: DEBUG nova.objects.instance [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lazy-loading 'info_cache' on Instance uuid 2eaea7c2-a5c0-4950-b033-0012b5cec0ee {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:32:21 user nova-compute[73572]: DEBUG nova.network.neutron [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] [instance: 2eaea7c2-a5c0-4950-b033-0012b5cec0ee] Updating instance_info_cache with network_info: [{"id": "0b4d66c9-2155-45ae-873a-2ee85776eeb7", "address": "fa:16:3e:69:d4:8e", "network": {"id": "757e71b4-5177-45a5-8ef5-9b27f42092f1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1765327616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1bff48d66894950ac6690e1fd0e79b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b4d66c9-21", "ovs_interfaceid": "0b4d66c9-2155-45ae-873a-2ee85776eeb7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:32:21 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Releasing lock "refresh_cache-2eaea7c2-a5c0-4950-b033-0012b5cec0ee" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:32:21 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] [instance: 2eaea7c2-a5c0-4950-b033-0012b5cec0ee] Updated the network info_cache for instance {{(pid=73572) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 10:32:23 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:32:24 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:32:24 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73572) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 10:32:25 user nova-compute[73572]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693045930.547563, 6004b15a-be01-42eb-92ba-ae9d93dab708 => Stopped> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:32:25 user nova-compute[73572]: INFO nova.compute.manager [-] [instance: 6004b15a-be01-42eb-92ba-ae9d93dab708] VM Stopped (Lifecycle Event)
Aug 26 10:32:25 user nova-compute[73572]: DEBUG nova.compute.manager [None req-27877edf-43ab-42ee-9ee2-b555dc6b0946 None None] [instance: 6004b15a-be01-42eb-92ba-ae9d93dab708] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:32:25 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:32:25 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:32:25 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73572) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 10:32:25 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73572) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 10:32:25 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73572) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 10:32:25 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:32:25 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:32:25 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:32:28 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:32:28 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73572) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 26 10:32:30 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:32:31 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:32:32 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:32:34 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:32:34 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:32:34 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:32:34 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:32:34 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:32:34 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Auditing locally available compute resources for user (node: user) {{(pid=73572) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 10:32:34 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86923c1a-89a5-4e7a-b488-8bf3a013bf83/disk.rescue --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:32:35 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86923c1a-89a5-4e7a-b488-8bf3a013bf83/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:32:35 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86923c1a-89a5-4e7a-b488-8bf3a013bf83/disk.rescue --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:32:35 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86923c1a-89a5-4e7a-b488-8bf3a013bf83/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:32:35 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86923c1a-89a5-4e7a-b488-8bf3a013bf83/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:32:35 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:32:35 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86923c1a-89a5-4e7a-b488-8bf3a013bf83/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:32:35 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86923c1a-89a5-4e7a-b488-8bf3a013bf83/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:32:35 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:32:35 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86923c1a-89a5-4e7a-b488-8bf3a013bf83/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:32:35 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68613b1e-c45c-4fd9-834c-3630ed0f456a/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:32:35 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68613b1e-c45c-4fd9-834c-3630ed0f456a/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:32:35 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68613b1e-c45c-4fd9-834c-3630ed0f456a/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:32:36 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68613b1e-c45c-4fd9-834c-3630ed0f456a/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:32:36 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2eaea7c2-a5c0-4950-b033-0012b5cec0ee/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:32:36 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2eaea7c2-a5c0-4950-b033-0012b5cec0ee/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:32:36 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2eaea7c2-a5c0-4950-b033-0012b5cec0ee/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:32:36 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2eaea7c2-a5c0-4950-b033-0012b5cec0ee/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:32:36 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/773c7bf7-a911-4b80-9cef-5cc563257b7b/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:32:36 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/773c7bf7-a911-4b80-9cef-5cc563257b7b/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:32:36 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/773c7bf7-a911-4b80-9cef-5cc563257b7b/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:32:36 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/773c7bf7-a911-4b80-9cef-5cc563257b7b/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:32:36 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c8e780d-0a13-4484-bf18-ac0879db263a/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:32:37 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c8e780d-0a13-4484-bf18-ac0879db263a/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:32:37 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c8e780d-0a13-4484-bf18-ac0879db263a/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:32:37 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c8e780d-0a13-4484-bf18-ac0879db263a/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:32:37 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=73572) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 10:32:37 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:32:37 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:32:37 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Hypervisor/Node resource view: name=user free_ram=7969MB free_disk=25.198387145996094GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=73572) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 10:32:37 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:32:37 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:32:37 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance 2eaea7c2-a5c0-4950-b033-0012b5cec0ee actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:32:37 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance 86923c1a-89a5-4e7a-b488-8bf3a013bf83 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:32:37 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance 68613b1e-c45c-4fd9-834c-3630ed0f456a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:32:37 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance 1c8e780d-0a13-4484-bf18-ac0879db263a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:32:37 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance 773c7bf7-a911-4b80-9cef-5cc563257b7b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:32:37 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=73572) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 10:32:37 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=73572) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 10:32:37 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Refreshing inventories for resource provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 {{(pid=73572) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 26 10:32:37 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Updating ProviderTree inventory for provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73572) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 26 10:32:37 user nova-compute[73572]: DEBUG nova.compute.provider_tree [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Updating inventory in ProviderTree for provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73572) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 26 10:32:37 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Refreshing aggregate associations for resource provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75, aggregates: None {{(pid=73572) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 26 10:32:37 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Refreshing trait associations for resource provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75, traits: COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSSE3,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE2,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NODE,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_NE2K_PCI {{(pid=73572) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 26 10:32:38 user nova-compute[73572]: DEBUG nova.compute.provider_tree [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Inventory has not changed in ProviderTree for provider: e2cec974-59b2-4c77-a53d-a7f4e5a30d75 {{(pid=73572) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 10:32:38 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Inventory has not changed for provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73572) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 10:32:38 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Compute_service record updated for user:user {{(pid=73572) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 10:32:38 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.531s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:32:40 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:32:42 user nova-compute[73572]: DEBUG nova.compute.manager [req-702c2efe-67b3-49b0-91e9-f4e2d6c739ff req-b80c183b-d85d-4db1-a27b-7771e9fd1d74 service nova] [instance: 773c7bf7-a911-4b80-9cef-5cc563257b7b] Received event network-changed-761ae86a-09b9-4010-8a18-3687cc70a2ef {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:32:42 user nova-compute[73572]: DEBUG nova.compute.manager [req-702c2efe-67b3-49b0-91e9-f4e2d6c739ff req-b80c183b-d85d-4db1-a27b-7771e9fd1d74 service nova] [instance: 773c7bf7-a911-4b80-9cef-5cc563257b7b] Refreshing instance network info cache due to event network-changed-761ae86a-09b9-4010-8a18-3687cc70a2ef. {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 10:32:42 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-702c2efe-67b3-49b0-91e9-f4e2d6c739ff req-b80c183b-d85d-4db1-a27b-7771e9fd1d74 service nova] Acquiring lock "refresh_cache-773c7bf7-a911-4b80-9cef-5cc563257b7b" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:32:42 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-702c2efe-67b3-49b0-91e9-f4e2d6c739ff req-b80c183b-d85d-4db1-a27b-7771e9fd1d74 service nova] Acquired lock "refresh_cache-773c7bf7-a911-4b80-9cef-5cc563257b7b" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:32:42 user nova-compute[73572]: DEBUG nova.network.neutron [req-702c2efe-67b3-49b0-91e9-f4e2d6c739ff req-b80c183b-d85d-4db1-a27b-7771e9fd1d74 service nova] [instance: 773c7bf7-a911-4b80-9cef-5cc563257b7b] Refreshing network info cache for port 761ae86a-09b9-4010-8a18-3687cc70a2ef {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 10:32:42 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:32:42 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Cleaning up deleted instances {{(pid=73572) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 26 10:32:42 user nova-compute[73572]: DEBUG nova.network.neutron [req-702c2efe-67b3-49b0-91e9-f4e2d6c739ff req-b80c183b-d85d-4db1-a27b-7771e9fd1d74 service nova] [instance: 773c7bf7-a911-4b80-9cef-5cc563257b7b] Updated VIF entry in instance network info cache for port 761ae86a-09b9-4010-8a18-3687cc70a2ef. {{(pid=73572) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 10:32:42 user nova-compute[73572]: DEBUG nova.network.neutron [req-702c2efe-67b3-49b0-91e9-f4e2d6c739ff req-b80c183b-d85d-4db1-a27b-7771e9fd1d74 service nova] [instance: 773c7bf7-a911-4b80-9cef-5cc563257b7b] Updating instance_info_cache with network_info: [{"id": "761ae86a-09b9-4010-8a18-3687cc70a2ef", "address": "fa:16:3e:49:ea:41", "network": {"id": "880aa066-8f77-469b-a0c4-e4e94ae31e1a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-313654920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47abd6293c07465389c379e3b5061164", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap761ae86a-09", "ovs_interfaceid": "761ae86a-09b9-4010-8a18-3687cc70a2ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:32:42 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] There are 0 instances to clean {{(pid=73572) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 26 10:32:42 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-702c2efe-67b3-49b0-91e9-f4e2d6c739ff req-b80c183b-d85d-4db1-a27b-7771e9fd1d74 service nova] Releasing lock "refresh_cache-773c7bf7-a911-4b80-9cef-5cc563257b7b" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:32:44 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-c5bdcb4a-d8e4-478f-b9a0-e3320e24bf0b tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Acquiring lock "7e3fd7ab-91ae-48b9-b436-b154c332869c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:32:44 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-c5bdcb4a-d8e4-478f-b9a0-e3320e24bf0b tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Lock "7e3fd7ab-91ae-48b9-b436-b154c332869c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:32:44 user nova-compute[73572]: DEBUG nova.compute.manager [None req-c5bdcb4a-d8e4-478f-b9a0-e3320e24bf0b tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 7e3fd7ab-91ae-48b9-b436-b154c332869c] Starting instance... {{(pid=73572) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 10:32:44 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-c5bdcb4a-d8e4-478f-b9a0-e3320e24bf0b tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:32:44 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-c5bdcb4a-d8e4-478f-b9a0-e3320e24bf0b tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:32:44 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-c5bdcb4a-d8e4-478f-b9a0-e3320e24bf0b tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73572) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 10:32:44 user nova-compute[73572]: INFO nova.compute.claims [None req-c5bdcb4a-d8e4-478f-b9a0-e3320e24bf0b tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 7e3fd7ab-91ae-48b9-b436-b154c332869c] Claim successful on node user
Aug 26 10:32:45 user nova-compute[73572]: DEBUG nova.compute.provider_tree [None req-c5bdcb4a-d8e4-478f-b9a0-e3320e24bf0b tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Inventory has not changed in ProviderTree for provider: e2cec974-59b2-4c77-a53d-a7f4e5a30d75 {{(pid=73572) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 10:32:45 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-c5bdcb4a-d8e4-478f-b9a0-e3320e24bf0b tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Inventory has not changed for provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73572) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 10:32:45 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-c5bdcb4a-d8e4-478f-b9a0-e3320e24bf0b tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.366s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:32:45 user nova-compute[73572]: DEBUG nova.compute.manager [None req-c5bdcb4a-d8e4-478f-b9a0-e3320e24bf0b tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 7e3fd7ab-91ae-48b9-b436-b154c332869c] Start building networks asynchronously for instance. {{(pid=73572) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 10:32:45 user nova-compute[73572]: DEBUG nova.compute.manager [None req-c5bdcb4a-d8e4-478f-b9a0-e3320e24bf0b tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 7e3fd7ab-91ae-48b9-b436-b154c332869c] Allocating IP information in the background. {{(pid=73572) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 10:32:45 user nova-compute[73572]: DEBUG nova.network.neutron [None req-c5bdcb4a-d8e4-478f-b9a0-e3320e24bf0b tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 7e3fd7ab-91ae-48b9-b436-b154c332869c] allocate_for_instance() {{(pid=73572) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 10:32:45 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-c5bdcb4a-d8e4-478f-b9a0-e3320e24bf0b tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 7e3fd7ab-91ae-48b9-b436-b154c332869c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 10:32:45 user nova-compute[73572]: DEBUG nova.compute.manager [None req-c5bdcb4a-d8e4-478f-b9a0-e3320e24bf0b tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 7e3fd7ab-91ae-48b9-b436-b154c332869c] Start building block device mappings for instance. {{(pid=73572) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 10:32:45 user nova-compute[73572]: INFO nova.virt.block_device [None req-c5bdcb4a-d8e4-478f-b9a0-e3320e24bf0b tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 7e3fd7ab-91ae-48b9-b436-b154c332869c] Booting with volume ad1b4b19-ad16-436c-9fa3-e718bea4f540 at /dev/vda
Aug 26 10:32:45 user nova-compute[73572]: DEBUG nova.policy [None req-c5bdcb4a-d8e4-478f-b9a0-e3320e24bf0b tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e1e80942e5db41c782bda686b10e2e4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc130586d9f4581953f1b8ae1c4465e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73572) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 10:32:45 user nova-compute[73572]: DEBUG os_brick.utils [None req-c5bdcb4a-d8e4-478f-b9a0-e3320e24bf0b tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 10:32:45 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:32:45 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:32:45 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[1783b25a-c95e-435e-b291-63a025d9fcbe]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:de8a79ed912\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:32:45 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:32:45 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:32:45 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:32:45 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[d16d59b6-66df-4b98-942b-38e2ae7a7b38]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:32:45 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:32:45 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:32:45 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cabdb49-0723-4c93-b8c8-ffd7f0bb7af8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:32:45 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[4430c6d0-2ce6-40a7-995a-07eb0fe0a54e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:32:45 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-c5bdcb4a-d8e4-478f-b9a0-e3320e24bf0b tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Running cmd (subprocess): nvme version {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:32:45 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-c5bdcb4a-d8e4-478f-b9a0-e3320e24bf0b tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] 'nvme version' failed. Not Retrying. {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 10:32:45 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c5bdcb4a-d8e4-478f-b9a0-e3320e24bf0b tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] nvme not present on system {{(pid=73572) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 10:32:45 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:32:45 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 10:32:45 user nova-compute[73572]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 10:32:45 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[36ec6667-1fec-4ced-a346-4175c5a124ce]: (4, '') {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:32:45 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.lightos [None req-c5bdcb4a-d8e4-478f-b9a0-e3320e24bf0b tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73572) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 10:32:45 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.lightos [None req-c5bdcb4a-d8e4-478f-b9a0-e3320e24bf0b tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73572) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 10:32:45 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.lightos [None req-c5bdcb4a-d8e4-478f-b9a0-e3320e24bf0b tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] LIGHTOS: no hostnqn found. {{(pid=73572) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 10:32:45 user nova-compute[73572]: DEBUG os_brick.utils [None req-c5bdcb4a-d8e4-478f-b9a0-e3320e24bf0b tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:de8a79ed912', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 10:32:45 user nova-compute[73572]: DEBUG nova.virt.block_device [None req-c5bdcb4a-d8e4-478f-b9a0-e3320e24bf0b tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 7e3fd7ab-91ae-48b9-b436-b154c332869c] Updating existing volume attachment record: 298dfb23-7169-4ab5-95f3-86b96ee8f9cb {{(pid=73572) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 10:32:45 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:32:46 user nova-compute[73572]: DEBUG nova.network.neutron [None req-c5bdcb4a-d8e4-478f-b9a0-e3320e24bf0b tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 7e3fd7ab-91ae-48b9-b436-b154c332869c] Successfully created port: 47c9677e-a234-4f8f-8cdc-5f1fdb21c760 {{(pid=73572) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 10:32:47 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-cb9d914e-cdcc-47b5-837e-d2165e9e0e2e tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Acquiring lock "773c7bf7-a911-4b80-9cef-5cc563257b7b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:32:47 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-cb9d914e-cdcc-47b5-837e-d2165e9e0e2e tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Lock "773c7bf7-a911-4b80-9cef-5cc563257b7b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:32:47 user nova-compute[73572]: DEBUG nova.objects.instance [None req-cb9d914e-cdcc-47b5-837e-d2165e9e0e2e tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Lazy-loading 'flavor' on Instance uuid 773c7bf7-a911-4b80-9cef-5cc563257b7b {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:32:47 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-cb9d914e-cdcc-47b5-837e-d2165e9e0e2e tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Lock "773c7bf7-a911-4b80-9cef-5cc563257b7b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:32:47 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-cb9d914e-cdcc-47b5-837e-d2165e9e0e2e tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Acquiring lock "773c7bf7-a911-4b80-9cef-5cc563257b7b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:32:47 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-cb9d914e-cdcc-47b5-837e-d2165e9e0e2e tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Lock "773c7bf7-a911-4b80-9cef-5cc563257b7b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:32:47 user nova-compute[73572]: INFO nova.compute.manager [None req-cb9d914e-cdcc-47b5-837e-d2165e9e0e2e tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] [instance: 773c7bf7-a911-4b80-9cef-5cc563257b7b] Attaching volume fe9111ce-0d30-4114-a070-5849b56f5428 to /dev/vdb
Aug 26 10:32:47 user nova-compute[73572]: DEBUG os_brick.utils [None req-cb9d914e-cdcc-47b5-837e-d2165e9e0e2e tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 10:32:47 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:32:47 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:32:47 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aa09591-ae28-44f2-a0e3-2bc5f34db14f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:de8a79ed912\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:32:47 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:32:47 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:32:47 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:32:47 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0f91daa-980c-4e89-bf56-842d871ddec7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:32:47 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:32:47 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:32:47 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[645e3597-895b-4a30-9f21-4ab7ae0885fa]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:32:47 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5858c47-fd49-42ff-89ee-3d9263f45ca8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:32:47 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-cb9d914e-cdcc-47b5-837e-d2165e9e0e2e tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Running cmd (subprocess): nvme version {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:32:47 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-cb9d914e-cdcc-47b5-837e-d2165e9e0e2e tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] 'nvme version' failed. Not Retrying. {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 10:32:47 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:32:47 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cb9d914e-cdcc-47b5-837e-d2165e9e0e2e tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] nvme not present on system {{(pid=73572) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 10:32:47 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:32:47 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 10:32:47 user nova-compute[73572]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 10:32:47 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[86ae87df-8c2f-4f5e-8406-aea339645870]: (4, '') {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:32:47 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.lightos [None req-cb9d914e-cdcc-47b5-837e-d2165e9e0e2e tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73572) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 10:32:47 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.lightos [None req-cb9d914e-cdcc-47b5-837e-d2165e9e0e2e tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73572) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 10:32:47 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.lightos [None req-cb9d914e-cdcc-47b5-837e-d2165e9e0e2e tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] LIGHTOS: no hostnqn found. {{(pid=73572) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 10:32:47 user nova-compute[73572]: DEBUG os_brick.utils [None req-cb9d914e-cdcc-47b5-837e-d2165e9e0e2e tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] <== get_connector_properties: return (154ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:de8a79ed912', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 10:32:47 user nova-compute[73572]: DEBUG nova.virt.block_device [None req-cb9d914e-cdcc-47b5-837e-d2165e9e0e2e tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] [instance: 773c7bf7-a911-4b80-9cef-5cc563257b7b] Updating existing volume attachment record: a58d6ff0-cfdc-4e18-99e2-f800a495bfcf {{(pid=73572) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 10:32:47 user nova-compute[73572]: DEBUG nova.network.neutron [None req-c5bdcb4a-d8e4-478f-b9a0-e3320e24bf0b tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 7e3fd7ab-91ae-48b9-b436-b154c332869c] Successfully updated port: 47c9677e-a234-4f8f-8cdc-5f1fdb21c760 {{(pid=73572) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 10:32:47 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-c5bdcb4a-d8e4-478f-b9a0-e3320e24bf0b tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Acquiring lock "refresh_cache-7e3fd7ab-91ae-48b9-b436-b154c332869c" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:32:47 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-c5bdcb4a-d8e4-478f-b9a0-e3320e24bf0b tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Acquired lock "refresh_cache-7e3fd7ab-91ae-48b9-b436-b154c332869c" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:32:47 user nova-compute[73572]: DEBUG nova.network.neutron [None req-c5bdcb4a-d8e4-478f-b9a0-e3320e24bf0b tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 7e3fd7ab-91ae-48b9-b436-b154c332869c] Building network info cache for instance {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 10:32:47 user nova-compute[73572]: DEBUG nova.compute.manager [req-ce08bcfa-cce4-4d14-aff9-174b2a1e0b3a req-fed2529c-6d39-4926-ac83-d9e381705238 service nova] [instance: 7e3fd7ab-91ae-48b9-b436-b154c332869c] Received event network-changed-47c9677e-a234-4f8f-8cdc-5f1fdb21c760 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:32:47 user nova-compute[73572]: DEBUG nova.compute.manager [req-ce08bcfa-cce4-4d14-aff9-174b2a1e0b3a req-fed2529c-6d39-4926-ac83-d9e381705238 service nova] [instance: 7e3fd7ab-91ae-48b9-b436-b154c332869c] Refreshing instance network info cache due to event network-changed-47c9677e-a234-4f8f-8cdc-5f1fdb21c760. {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 10:32:47 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-ce08bcfa-cce4-4d14-aff9-174b2a1e0b3a req-fed2529c-6d39-4926-ac83-d9e381705238 service nova] Acquiring lock "refresh_cache-7e3fd7ab-91ae-48b9-b436-b154c332869c" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:32:48 user nova-compute[73572]: DEBUG nova.network.neutron [None req-c5bdcb4a-d8e4-478f-b9a0-e3320e24bf0b tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 7e3fd7ab-91ae-48b9-b436-b154c332869c] Instance cache missing network info. {{(pid=73572) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 10:32:48 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:32:48 user nova-compute[73572]: DEBUG nova.network.neutron [None req-c5bdcb4a-d8e4-478f-b9a0-e3320e24bf0b tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 7e3fd7ab-91ae-48b9-b436-b154c332869c] Updating instance_info_cache with network_info: [{"id": "47c9677e-a234-4f8f-8cdc-5f1fdb21c760", "address": "fa:16:3e:0d:dd:ea", "network": {"id": "c520ee18-34a7-4781-bc97-419e9a702d40", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-280196989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfc130586d9f4581953f1b8ae1c4465e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47c9677e-a2", "ovs_interfaceid": "47c9677e-a234-4f8f-8cdc-5f1fdb21c760", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:32:48 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-c5bdcb4a-d8e4-478f-b9a0-e3320e24bf0b tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Releasing lock "refresh_cache-7e3fd7ab-91ae-48b9-b436-b154c332869c" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:32:48 user nova-compute[73572]: DEBUG nova.compute.manager [None req-c5bdcb4a-d8e4-478f-b9a0-e3320e24bf0b tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 7e3fd7ab-91ae-48b9-b436-b154c332869c] Instance network_info: |[{"id": "47c9677e-a234-4f8f-8cdc-5f1fdb21c760", "address": "fa:16:3e:0d:dd:ea", "network": {"id": "c520ee18-34a7-4781-bc97-419e9a702d40", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-280196989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfc130586d9f4581953f1b8ae1c4465e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47c9677e-a2", "ovs_interfaceid": "47c9677e-a234-4f8f-8cdc-5f1fdb21c760", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73572) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 10:32:48 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-ce08bcfa-cce4-4d14-aff9-174b2a1e0b3a req-fed2529c-6d39-4926-ac83-d9e381705238 service nova] Acquired lock "refresh_cache-7e3fd7ab-91ae-48b9-b436-b154c332869c" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:32:48 user nova-compute[73572]: DEBUG nova.network.neutron [req-ce08bcfa-cce4-4d14-aff9-174b2a1e0b3a req-fed2529c-6d39-4926-ac83-d9e381705238 service nova] [instance: 7e3fd7ab-91ae-48b9-b436-b154c332869c] Refreshing network info cache for port 47c9677e-a234-4f8f-8cdc-5f1fdb21c760 {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 10:32:48 user nova-compute[73572]: DEBUG nova.network.neutron [req-ce08bcfa-cce4-4d14-aff9-174b2a1e0b3a req-fed2529c-6d39-4926-ac83-d9e381705238 service nova] [instance: 7e3fd7ab-91ae-48b9-b436-b154c332869c] Updated VIF entry in instance network info cache for port 47c9677e-a234-4f8f-8cdc-5f1fdb21c760. {{(pid=73572) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 10:32:48 user nova-compute[73572]: DEBUG nova.network.neutron [req-ce08bcfa-cce4-4d14-aff9-174b2a1e0b3a req-fed2529c-6d39-4926-ac83-d9e381705238 service nova] [instance: 7e3fd7ab-91ae-48b9-b436-b154c332869c] Updating instance_info_cache with network_info: [{"id": "47c9677e-a234-4f8f-8cdc-5f1fdb21c760", "address": "fa:16:3e:0d:dd:ea", "network": {"id": "c520ee18-34a7-4781-bc97-419e9a702d40", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-280196989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfc130586d9f4581953f1b8ae1c4465e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47c9677e-a2", "ovs_interfaceid": "47c9677e-a234-4f8f-8cdc-5f1fdb21c760", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:32:48 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-ce08bcfa-cce4-4d14-aff9-174b2a1e0b3a req-fed2529c-6d39-4926-ac83-d9e381705238 service nova] Releasing lock "refresh_cache-7e3fd7ab-91ae-48b9-b436-b154c332869c" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:32:50 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:32:50 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:32:55 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-41398841-72e2-4589-a1c1-b844aa547ba3 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Acquiring lock "c457a41c-2ee2-4821-94cf-69c091589241" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:32:55 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-41398841-72e2-4589-a1c1-b844aa547ba3 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Lock "c457a41c-2ee2-4821-94cf-69c091589241" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:32:55 user nova-compute[73572]: DEBUG nova.compute.manager [None req-41398841-72e2-4589-a1c1-b844aa547ba3 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] [instance: c457a41c-2ee2-4821-94cf-69c091589241] Starting instance... {{(pid=73572) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 10:32:55 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:32:55 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:32:55 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73572) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 10:32:55 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73572) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 10:32:55 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73572) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 10:32:55 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:32:55 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-41398841-72e2-4589-a1c1-b844aa547ba3 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:32:55 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-41398841-72e2-4589-a1c1-b844aa547ba3 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:32:55 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-41398841-72e2-4589-a1c1-b844aa547ba3 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73572) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 10:32:55 user nova-compute[73572]: INFO nova.compute.claims [None req-41398841-72e2-4589-a1c1-b844aa547ba3 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] [instance: c457a41c-2ee2-4821-94cf-69c091589241] Claim successful on node user
Aug 26 10:32:55 user nova-compute[73572]: DEBUG nova.compute.provider_tree [None req-41398841-72e2-4589-a1c1-b844aa547ba3 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Inventory has not changed in ProviderTree for provider: e2cec974-59b2-4c77-a53d-a7f4e5a30d75 {{(pid=73572) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 10:32:55 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-41398841-72e2-4589-a1c1-b844aa547ba3 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Inventory has not changed for provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73572) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 10:32:55 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-41398841-72e2-4589-a1c1-b844aa547ba3 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.343s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:32:55 user nova-compute[73572]: DEBUG nova.compute.manager [None req-41398841-72e2-4589-a1c1-b844aa547ba3 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] [instance: c457a41c-2ee2-4821-94cf-69c091589241] Start building networks asynchronously for instance. {{(pid=73572) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 10:32:56 user nova-compute[73572]: DEBUG nova.compute.manager [None req-41398841-72e2-4589-a1c1-b844aa547ba3 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] [instance: c457a41c-2ee2-4821-94cf-69c091589241] Allocating IP information in the background. {{(pid=73572) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 10:32:56 user nova-compute[73572]: DEBUG nova.network.neutron [None req-41398841-72e2-4589-a1c1-b844aa547ba3 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] [instance: c457a41c-2ee2-4821-94cf-69c091589241] allocate_for_instance() {{(pid=73572) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 10:32:56 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-41398841-72e2-4589-a1c1-b844aa547ba3 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] [instance: c457a41c-2ee2-4821-94cf-69c091589241] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 10:32:56 user nova-compute[73572]: DEBUG nova.compute.manager [None req-41398841-72e2-4589-a1c1-b844aa547ba3 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] [instance: c457a41c-2ee2-4821-94cf-69c091589241] Start building block device mappings for instance. {{(pid=73572) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 10:32:56 user nova-compute[73572]: INFO nova.virt.block_device [None req-41398841-72e2-4589-a1c1-b844aa547ba3 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] [instance: c457a41c-2ee2-4821-94cf-69c091589241] Booting with volume 6c17592e-3227-473f-ac7b-3e911dcb0d56 at /dev/vda
Aug 26 10:32:56 user nova-compute[73572]: DEBUG nova.policy [None req-41398841-72e2-4589-a1c1-b844aa547ba3 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '61b6124f6f6e44c5b2fd0202a15da019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7935bccc360b46b589fd57d53f334595', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73572) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 10:32:56 user nova-compute[73572]: DEBUG os_brick.utils [None req-41398841-72e2-4589-a1c1-b844aa547ba3 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 10:32:56 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:32:56 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:32:56 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a61f4cc-46e6-4de8-8912-80295acbaf95]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:de8a79ed912\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:32:56 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:32:56 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:32:56 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[58ca50fa-c7e4-42bb-a5bf-0bfc6c680fe4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:32:56 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:32:56 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:32:56 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[378f1b75-1415-4658-858b-8f9ae2f19a44]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:32:56 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c130349-0f0b-4dee-b30b-34b76865a7a6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:32:56 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-41398841-72e2-4589-a1c1-b844aa547ba3 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Running cmd (subprocess): nvme version {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:32:56 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-41398841-72e2-4589-a1c1-b844aa547ba3 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] 'nvme version' failed. Not Retrying. {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 10:32:56 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.nvmeof [None req-41398841-72e2-4589-a1c1-b844aa547ba3 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] nvme not present on system {{(pid=73572) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 10:32:56 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:32:56 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 10:32:56 user nova-compute[73572]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 10:32:56 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[10d1f6ee-0df5-4ea2-bb08-ec8ee4b14f1e]: (4, '') {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:32:56 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.lightos [None req-41398841-72e2-4589-a1c1-b844aa547ba3 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73572) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 10:32:56 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.lightos [None req-41398841-72e2-4589-a1c1-b844aa547ba3 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73572) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 10:32:56 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.lightos [None req-41398841-72e2-4589-a1c1-b844aa547ba3 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] LIGHTOS: no hostnqn found. {{(pid=73572) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 10:32:56 user nova-compute[73572]: DEBUG os_brick.utils [None req-41398841-72e2-4589-a1c1-b844aa547ba3 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:de8a79ed912', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 10:32:56 user nova-compute[73572]: DEBUG nova.virt.block_device [None req-41398841-72e2-4589-a1c1-b844aa547ba3 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] [instance: c457a41c-2ee2-4821-94cf-69c091589241] Updating existing volume attachment record: 3bf9b9f7-958a-4db3-be59-e4086a1c5f06 {{(pid=73572) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 10:32:56 user nova-compute[73572]: DEBUG nova.network.neutron [None req-41398841-72e2-4589-a1c1-b844aa547ba3 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] [instance: c457a41c-2ee2-4821-94cf-69c091589241] Successfully created port: deb899b2-ba04-427b-b4ea-a514b8eda260 {{(pid=73572) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 10:32:57 user nova-compute[73572]: DEBUG nova.network.neutron [None req-41398841-72e2-4589-a1c1-b844aa547ba3 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] [instance: c457a41c-2ee2-4821-94cf-69c091589241] Successfully updated port: deb899b2-ba04-427b-b4ea-a514b8eda260 {{(pid=73572) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 10:32:57 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-41398841-72e2-4589-a1c1-b844aa547ba3 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Acquiring lock "refresh_cache-c457a41c-2ee2-4821-94cf-69c091589241" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:32:57 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-41398841-72e2-4589-a1c1-b844aa547ba3 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Acquired lock "refresh_cache-c457a41c-2ee2-4821-94cf-69c091589241" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:32:57 user nova-compute[73572]: DEBUG nova.network.neutron [None req-41398841-72e2-4589-a1c1-b844aa547ba3 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] [instance: c457a41c-2ee2-4821-94cf-69c091589241] Building network info cache for instance {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 10:32:57 user nova-compute[73572]: DEBUG nova.compute.manager [req-81aee633-7bcb-4a1f-bb93-597010bafe59 req-11406b22-d4e0-4165-8082-aa9d0caae3a1 service nova] [instance: c457a41c-2ee2-4821-94cf-69c091589241] Received event network-changed-deb899b2-ba04-427b-b4ea-a514b8eda260 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:32:57 user nova-compute[73572]: DEBUG nova.compute.manager [req-81aee633-7bcb-4a1f-bb93-597010bafe59 req-11406b22-d4e0-4165-8082-aa9d0caae3a1 service nova] [instance: c457a41c-2ee2-4821-94cf-69c091589241] Refreshing instance network info cache due to event network-changed-deb899b2-ba04-427b-b4ea-a514b8eda260. {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 10:32:57 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-81aee633-7bcb-4a1f-bb93-597010bafe59 req-11406b22-d4e0-4165-8082-aa9d0caae3a1 service nova] Acquiring lock "refresh_cache-c457a41c-2ee2-4821-94cf-69c091589241" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:32:57 user nova-compute[73572]: DEBUG nova.network.neutron [None req-41398841-72e2-4589-a1c1-b844aa547ba3 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] [instance: c457a41c-2ee2-4821-94cf-69c091589241] Instance cache missing network info. {{(pid=73572) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 10:32:58 user nova-compute[73572]: DEBUG nova.network.neutron [None req-41398841-72e2-4589-a1c1-b844aa547ba3 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] [instance: c457a41c-2ee2-4821-94cf-69c091589241] Updating instance_info_cache with network_info: [{"id": "deb899b2-ba04-427b-b4ea-a514b8eda260", "address": "fa:16:3e:05:c8:e3", "network": {"id": "43215883-3d00-4be7-8c40-bdaf3f01bef9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1088544153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7935bccc360b46b589fd57d53f334595", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdeb899b2-ba", "ovs_interfaceid": "deb899b2-ba04-427b-b4ea-a514b8eda260", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:32:58 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-41398841-72e2-4589-a1c1-b844aa547ba3 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Releasing lock "refresh_cache-c457a41c-2ee2-4821-94cf-69c091589241" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:32:58 user nova-compute[73572]: DEBUG nova.compute.manager [None req-41398841-72e2-4589-a1c1-b844aa547ba3 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] [instance: c457a41c-2ee2-4821-94cf-69c091589241] Instance network_info: |[{"id": "deb899b2-ba04-427b-b4ea-a514b8eda260", "address": "fa:16:3e:05:c8:e3", "network": {"id": "43215883-3d00-4be7-8c40-bdaf3f01bef9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1088544153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7935bccc360b46b589fd57d53f334595", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdeb899b2-ba", "ovs_interfaceid": "deb899b2-ba04-427b-b4ea-a514b8eda260", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73572) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 10:32:58 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-81aee633-7bcb-4a1f-bb93-597010bafe59 req-11406b22-d4e0-4165-8082-aa9d0caae3a1 service nova] Acquired lock "refresh_cache-c457a41c-2ee2-4821-94cf-69c091589241" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:32:58 user nova-compute[73572]: DEBUG nova.network.neutron [req-81aee633-7bcb-4a1f-bb93-597010bafe59 req-11406b22-d4e0-4165-8082-aa9d0caae3a1 service nova] [instance: c457a41c-2ee2-4821-94cf-69c091589241] Refreshing network info cache for port deb899b2-ba04-427b-b4ea-a514b8eda260 {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 10:32:58 user nova-compute[73572]: DEBUG nova.network.neutron [req-81aee633-7bcb-4a1f-bb93-597010bafe59 req-11406b22-d4e0-4165-8082-aa9d0caae3a1 service nova] [instance: c457a41c-2ee2-4821-94cf-69c091589241] Updated VIF entry in instance network info cache for port deb899b2-ba04-427b-b4ea-a514b8eda260. {{(pid=73572) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 10:32:58 user nova-compute[73572]: DEBUG nova.network.neutron [req-81aee633-7bcb-4a1f-bb93-597010bafe59 req-11406b22-d4e0-4165-8082-aa9d0caae3a1 service nova] [instance: c457a41c-2ee2-4821-94cf-69c091589241] Updating instance_info_cache with network_info: [{"id": "deb899b2-ba04-427b-b4ea-a514b8eda260", "address": "fa:16:3e:05:c8:e3", "network": {"id": "43215883-3d00-4be7-8c40-bdaf3f01bef9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1088544153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7935bccc360b46b589fd57d53f334595", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdeb899b2-ba", "ovs_interfaceid": "deb899b2-ba04-427b-b4ea-a514b8eda260", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:32:58 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-81aee633-7bcb-4a1f-bb93-597010bafe59 req-11406b22-d4e0-4165-8082-aa9d0caae3a1 service nova] Releasing lock "refresh_cache-c457a41c-2ee2-4821-94cf-69c091589241" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:33:00 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:33:00 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:33:02 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cb9d914e-cdcc-47b5-837e-d2165e9e0e2e tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] [instance: 773c7bf7-a911-4b80-9cef-5cc563257b7b] Calling os-brick to attach iSCSI Volume {{(pid=73572) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 10:33:02 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb9d914e-cdcc-47b5-837e-d2165e9e0e2e tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc89c3d6a10>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:fe9111ce-0d30-4114-a070-5849b56f5428'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'teOXKDFY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 10:33:02 user nova-compute[73572]: WARNING os_brick.initiator.connectors.base [None req-cb9d914e-cdcc-47b5-837e-d2165e9e0e2e tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 10:33:02 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-cb9d914e-cdcc-47b5-837e-d2165e9e0e2e tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 10:33:02 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-cb9d914e-cdcc-47b5-837e-d2165e9e0e2e tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 10:33:02 user nova-compute[73572]: WARNING os_brick.initiator.connectors.base [None req-cb9d914e-cdcc-47b5-837e-d2165e9e0e2e tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 10:33:02 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-cb9d914e-cdcc-47b5-837e-d2165e9e0e2e tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fe9111ce-0d30-4114-a070-5849b56f5428" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 10:33:02 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-cb9d914e-cdcc-47b5-837e-d2165e9e0e2e tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fe9111ce-0d30-4114-a070-5849b56f5428" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 10:33:02 user nova-compute[73572]: INFO os_brick.initiator.connectors.iscsi [None req-cb9d914e-cdcc-47b5-837e-d2165e9e0e2e tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 10:33:02 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe9111ce-0d30-4114-a070-5849b56f5428 -p 172.16.0.220:3260 {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:33:02 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe9111ce-0d30-4114-a070-5849b56f5428 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:33:02 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a659bbc-803a-464b-b48f-49a06263b688]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:33:02 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb9d914e-cdcc-47b5-837e-d2165e9e0e2e tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 10:33:02 user nova-compute[73572]:  {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:33:02 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe9111ce-0d30-4114-a070-5849b56f5428 -p 172.16.0.220:3260 --interface default --op new {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:33:02 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe9111ce-0d30-4114-a070-5849b56f5428 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:33:02 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[08bdab30-b14b-4fc8-b901-13bba3fde407]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fe9111ce-0d30-4114-a070-5849b56f5428] added\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:33:02 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb9d914e-cdcc-47b5-837e-d2165e9e0e2e tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fe9111ce-0d30-4114-a070-5849b56f5428] added
Aug 26 10:33:02 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:33:02 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe9111ce-0d30-4114-a070-5849b56f5428 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:33:02 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe9111ce-0d30-4114-a070-5849b56f5428 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.032s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:33:02 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba8bf423-8cc3-40a6-9706-2092d8aa0a6a]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:33:02 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb9d914e-cdcc-47b5-837e-d2165e9e0e2e tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:33:02 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe9111ce-0d30-4114-a070-5849b56f5428 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:33:02 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe9111ce-0d30-4114-a070-5849b56f5428 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:33:02 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[637b2e61-9266-436e-9eee-688eba67a2ff]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:33:02 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb9d914e-cdcc-47b5-837e-d2165e9e0e2e tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:33:02 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe9111ce-0d30-4114-a070-5849b56f5428 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v teOXKDFY {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:33:02 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe9111ce-0d30-4114-a070-5849b56f5428 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v teOXKDFY" returned: 0 in 0.023s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:33:02 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[477ba6fe-00db-46e6-bd62-0ff08ef0e4cf]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:33:02 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb9d914e-cdcc-47b5-837e-d2165e9e0e2e tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'teOXKDFY'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:33:02 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe9111ce-0d30-4114-a070-5849b56f5428 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:33:02 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe9111ce-0d30-4114-a070-5849b56f5428 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:33:02 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[284877cd-068f-419d-a26e-149ca875f080]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:33:02 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb9d914e-cdcc-47b5-837e-d2165e9e0e2e tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:33:02 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:33:02 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:33:02 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e8d8449-b3cf-4b05-b270-213c64547306]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8aa6fc0-ce50-4db6-8d7d-9f37eae07207 (non-flash)\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:33:02 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb9d914e-cdcc-47b5-837e-d2165e9e0e2e tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8aa6fc0-ce50-4db6-8d7d-9f37eae07207 (non-flash)
Aug 26 10:33:02 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 10:33:02 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb9d914e-cdcc-47b5-837e-d2165e9e0e2e tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8aa6fc0-ce50-4db6-8d7d-9f37eae07207 (non-flash)
Aug 26 10:33:02 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 10:33:02 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe9111ce-0d30-4114-a070-5849b56f5428 -p 172.16.0.220:3260 --login {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:33:02 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe9111ce-0d30-4114-a070-5849b56f5428 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:33:02 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[3debe564-dda5-4d8e-a640-b97fa6317c17]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fe9111ce-0d30-4114-a070-5849b56f5428, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fe9111ce-0d30-4114-a070-5849b56f5428, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:33:02 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb9d914e-cdcc-47b5-837e-d2165e9e0e2e tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fe9111ce-0d30-4114-a070-5849b56f5428, portal: 172.16.0.220,3260]
Aug 26 10:33:02 user nova-compute[73572]: Login to [iface: default, target: iqn.2010-10.org.openstack:fe9111ce-0d30-4114-a070-5849b56f5428, portal: 172.16.0.220,3260] successful.
Aug 26 10:33:02 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:33:02 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe9111ce-0d30-4114-a070-5849b56f5428 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:33:02 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe9111ce-0d30-4114-a070-5849b56f5428 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.031s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:33:02 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[86e8f475-06ac-46e6-ac08-30a0a9d4fa0d]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:33:02 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb9d914e-cdcc-47b5-837e-d2165e9e0e2e tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:33:02 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:33:02 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:33:02 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[829b0d13-a225-4a36-aefe-08bdc6c7fbd2]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8aa6fc0-ce50-4db6-8d7d-9f37eae07207 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe9111ce-0d30-4114-a070-5849b56f5428 (non-flash)\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:33:02 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb9d914e-cdcc-47b5-837e-d2165e9e0e2e tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8aa6fc0-ce50-4db6-8d7d-9f37eae07207 (non-flash)
Aug 26 10:33:02 user nova-compute[73572]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe9111ce-0d30-4114-a070-5849b56f5428 (non-flash)
Aug 26 10:33:02 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 10:33:02 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb9d914e-cdcc-47b5-837e-d2165e9e0e2e tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8aa6fc0-ce50-4db6-8d7d-9f37eae07207 (non-flash)
Aug 26 10:33:02 user nova-compute[73572]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe9111ce-0d30-4114-a070-5849b56f5428 (non-flash)
Aug 26 10:33:02 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 10:33:02 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-cb9d914e-cdcc-47b5-837e-d2165e9e0e2e tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fe9111ce-0d30-4114-a070-5849b56f5428" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.333s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 10:33:02 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb9d914e-cdcc-47b5-837e-d2165e9e0e2e tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Connected to 172.16.0.220:3260 {{(pid=73572) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 10:33:02 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-cb9d914e-cdcc-47b5-837e-d2165e9e0e2e tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] HCTL ('33', '-', '-', 0) found on session 47 with lun 0 {{(pid=73572) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 10:33:02 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-cb9d914e-cdcc-47b5-837e-d2165e9e0e2e tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73572) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 10:33:02 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:33:02 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.028s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:33:02 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ea915e0-b504-4eff-ba46-8f62b17090e8]: (4, ('- - 0', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:33:02 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-cb9d914e-cdcc-47b5-837e-d2165e9e0e2e tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Searching for a device in session 47 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73572) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 10:33:02 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb9d914e-cdcc-47b5-837e-d2165e9e0e2e tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'teOXKDFY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73572) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 10:33:03 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-cb9d914e-cdcc-47b5-837e-d2165e9e0e2e tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.377s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 10:33:03 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb9d914e-cdcc-47b5-837e-d2165e9e0e2e tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] <== connect_volume: return (1379ms) {'type': 'block', 'scsi_wwn': '23537636237663336', 'path': '/dev/sdb'} {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 10:33:03 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cb9d914e-cdcc-47b5-837e-d2165e9e0e2e tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] [instance: 773c7bf7-a911-4b80-9cef-5cc563257b7b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23537636237663336', 'path': '/dev/sdb'} {{(pid=73572) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 10:33:03 user nova-compute[73572]: DEBUG nova.objects.instance [None req-cb9d914e-cdcc-47b5-837e-d2165e9e0e2e tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Lazy-loading 'flavor' on Instance uuid 773c7bf7-a911-4b80-9cef-5cc563257b7b {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:33:03 user nova-compute[73572]: DEBUG nova.virt.libvirt.guest [None req-cb9d914e-cdcc-47b5-837e-d2165e9e0e2e tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 10:33:03 user nova-compute[73572]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 10:33:03 user nova-compute[73572]:   <source dev="/dev/sdb"/>
Aug 26 10:33:03 user nova-compute[73572]:   <target dev="vdb" bus="virtio"/>
Aug 26 10:33:03 user nova-compute[73572]:   <serial>fe9111ce-0d30-4114-a070-5849b56f5428</serial>
Aug 26 10:33:03 user nova-compute[73572]: </disk>
Aug 26 10:33:03 user nova-compute[73572]:  {{(pid=73572) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 10:33:04 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-dae57060-9e7c-451a-af7c-c9142d80a5db tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Acquiring lock "d147974d-213d-4aa3-8d03-11b262f59dca" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:33:04 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-dae57060-9e7c-451a-af7c-c9142d80a5db tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Lock "d147974d-213d-4aa3-8d03-11b262f59dca" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:33:04 user nova-compute[73572]: DEBUG nova.compute.manager [None req-dae57060-9e7c-451a-af7c-c9142d80a5db tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] [instance: d147974d-213d-4aa3-8d03-11b262f59dca] Starting instance... {{(pid=73572) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 10:33:04 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-cb9d914e-cdcc-47b5-837e-d2165e9e0e2e tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] No BDM found with device name vda, not building metadata. {{(pid=73572) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 10:33:04 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-cb9d914e-cdcc-47b5-837e-d2165e9e0e2e tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73572) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 10:33:04 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-cb9d914e-cdcc-47b5-837e-d2165e9e0e2e tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] No VIF found with MAC fa:16:3e:49:ea:41, not building metadata {{(pid=73572) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 10:33:04 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-dae57060-9e7c-451a-af7c-c9142d80a5db tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:33:04 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-dae57060-9e7c-451a-af7c-c9142d80a5db tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:33:04 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-dae57060-9e7c-451a-af7c-c9142d80a5db tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73572) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 10:33:04 user nova-compute[73572]: INFO nova.compute.claims [None req-dae57060-9e7c-451a-af7c-c9142d80a5db tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] [instance: d147974d-213d-4aa3-8d03-11b262f59dca] Claim successful on node user
Aug 26 10:33:04 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-cb9d914e-cdcc-47b5-837e-d2165e9e0e2e tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Lock "773c7bf7-a911-4b80-9cef-5cc563257b7b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 16.753s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:33:04 user nova-compute[73572]: DEBUG nova.compute.provider_tree [None req-dae57060-9e7c-451a-af7c-c9142d80a5db tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Inventory has not changed in ProviderTree for provider: e2cec974-59b2-4c77-a53d-a7f4e5a30d75 {{(pid=73572) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 10:33:04 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-dae57060-9e7c-451a-af7c-c9142d80a5db tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Inventory has not changed for provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73572) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 10:33:04 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-dae57060-9e7c-451a-af7c-c9142d80a5db tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.399s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:33:04 user nova-compute[73572]: DEBUG nova.compute.manager [None req-dae57060-9e7c-451a-af7c-c9142d80a5db tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] [instance: d147974d-213d-4aa3-8d03-11b262f59dca] Start building networks asynchronously for instance. {{(pid=73572) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 10:33:04 user nova-compute[73572]: DEBUG nova.compute.manager [None req-dae57060-9e7c-451a-af7c-c9142d80a5db tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] [instance: d147974d-213d-4aa3-8d03-11b262f59dca] Allocating IP information in the background. {{(pid=73572) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 10:33:04 user nova-compute[73572]: DEBUG nova.network.neutron [None req-dae57060-9e7c-451a-af7c-c9142d80a5db tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] [instance: d147974d-213d-4aa3-8d03-11b262f59dca] allocate_for_instance() {{(pid=73572) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 10:33:04 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-dae57060-9e7c-451a-af7c-c9142d80a5db tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] [instance: d147974d-213d-4aa3-8d03-11b262f59dca] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 10:33:04 user nova-compute[73572]: DEBUG nova.compute.manager [None req-dae57060-9e7c-451a-af7c-c9142d80a5db tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] [instance: d147974d-213d-4aa3-8d03-11b262f59dca] Start building block device mappings for instance. {{(pid=73572) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 10:33:04 user nova-compute[73572]: DEBUG nova.policy [None req-dae57060-9e7c-451a-af7c-c9142d80a5db tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '17243251fe57431c9c98195a16239c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7e16843614c451d958e817c832d4cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73572) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 10:33:04 user nova-compute[73572]: DEBUG nova.compute.manager [None req-dae57060-9e7c-451a-af7c-c9142d80a5db tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] [instance: d147974d-213d-4aa3-8d03-11b262f59dca] Start spawning the instance on the hypervisor. {{(pid=73572) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 10:33:04 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-dae57060-9e7c-451a-af7c-c9142d80a5db tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] [instance: d147974d-213d-4aa3-8d03-11b262f59dca] Creating instance directory {{(pid=73572) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 10:33:04 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-dae57060-9e7c-451a-af7c-c9142d80a5db tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] [instance: d147974d-213d-4aa3-8d03-11b262f59dca] Creating image(s)
Aug 26 10:33:04 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-dae57060-9e7c-451a-af7c-c9142d80a5db tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Acquiring lock "/opt/stack/data/nova/instances/d147974d-213d-4aa3-8d03-11b262f59dca/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:33:04 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-dae57060-9e7c-451a-af7c-c9142d80a5db tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Lock "/opt/stack/data/nova/instances/d147974d-213d-4aa3-8d03-11b262f59dca/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:33:04 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-dae57060-9e7c-451a-af7c-c9142d80a5db tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Lock "/opt/stack/data/nova/instances/d147974d-213d-4aa3-8d03-11b262f59dca/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:33:04 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-dae57060-9e7c-451a-af7c-c9142d80a5db tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:33:05 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-dae57060-9e7c-451a-af7c-c9142d80a5db tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json" returned: 0 in 0.194s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:33:05 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-dae57060-9e7c-451a-af7c-c9142d80a5db tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Acquiring lock "2099350d6f3bcd0de9471c73862d4fe75b049801" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:33:05 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-dae57060-9e7c-451a-af7c-c9142d80a5db tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Lock "2099350d6f3bcd0de9471c73862d4fe75b049801" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:33:05 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-dae57060-9e7c-451a-af7c-c9142d80a5db tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:33:05 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-2e9522c5-055c-409b-8904-4b7291d7b53f tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Acquiring lock "773c7bf7-a911-4b80-9cef-5cc563257b7b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:33:05 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-2e9522c5-055c-409b-8904-4b7291d7b53f tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Lock "773c7bf7-a911-4b80-9cef-5cc563257b7b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.005s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:33:05 user nova-compute[73572]: INFO nova.compute.manager [None req-2e9522c5-055c-409b-8904-4b7291d7b53f tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] [instance: 773c7bf7-a911-4b80-9cef-5cc563257b7b] Detaching volume fe9111ce-0d30-4114-a070-5849b56f5428
Aug 26 10:33:05 user nova-compute[73572]: INFO nova.virt.block_device [None req-2e9522c5-055c-409b-8904-4b7291d7b53f tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] [instance: 773c7bf7-a911-4b80-9cef-5cc563257b7b] Attempting to driver detach volume fe9111ce-0d30-4114-a070-5849b56f5428 from mountpoint /dev/vdb
Aug 26 10:33:05 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-2e9522c5-055c-409b-8904-4b7291d7b53f tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Attempting to detach device vdb from instance 773c7bf7-a911-4b80-9cef-5cc563257b7b from the persistent domain config. {{(pid=73572) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 10:33:05 user nova-compute[73572]: DEBUG nova.virt.libvirt.guest [None req-2e9522c5-055c-409b-8904-4b7291d7b53f tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 10:33:05 user nova-compute[73572]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 10:33:05 user nova-compute[73572]:   <source dev="/dev/sdb"/>
Aug 26 10:33:05 user nova-compute[73572]:   <target dev="vdb" bus="virtio"/>
Aug 26 10:33:05 user nova-compute[73572]:   <serial>fe9111ce-0d30-4114-a070-5849b56f5428</serial>
Aug 26 10:33:05 user nova-compute[73572]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 10:33:05 user nova-compute[73572]: </disk>
Aug 26 10:33:05 user nova-compute[73572]:  {{(pid=73572) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 10:33:05 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-2e9522c5-055c-409b-8904-4b7291d7b53f tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Successfully detached device vdb from instance 773c7bf7-a911-4b80-9cef-5cc563257b7b from the persistent domain config.
Aug 26 10:33:05 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-2e9522c5-055c-409b-8904-4b7291d7b53f tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 773c7bf7-a911-4b80-9cef-5cc563257b7b from the live domain config. {{(pid=73572) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 10:33:05 user nova-compute[73572]: DEBUG nova.virt.libvirt.guest [None req-2e9522c5-055c-409b-8904-4b7291d7b53f tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 10:33:05 user nova-compute[73572]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 10:33:05 user nova-compute[73572]:   <source dev="/dev/sdb"/>
Aug 26 10:33:05 user nova-compute[73572]:   <target dev="vdb" bus="virtio"/>
Aug 26 10:33:05 user nova-compute[73572]:   <serial>fe9111ce-0d30-4114-a070-5849b56f5428</serial>
Aug 26 10:33:05 user nova-compute[73572]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 10:33:05 user nova-compute[73572]: </disk>
Aug 26 10:33:05 user nova-compute[73572]:  {{(pid=73572) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 10:33:05 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-dae57060-9e7c-451a-af7c-c9142d80a5db tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json" returned: 0 in 0.200s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:33:05 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-dae57060-9e7c-451a-af7c-c9142d80a5db tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801,backing_fmt=raw /opt/stack/data/nova/instances/d147974d-213d-4aa3-8d03-11b262f59dca/disk 1073741824 {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:33:05 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-dae57060-9e7c-451a-af7c-c9142d80a5db tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801,backing_fmt=raw /opt/stack/data/nova/instances/d147974d-213d-4aa3-8d03-11b262f59dca/disk 1073741824" returned: 0 in 0.049s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:33:05 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-dae57060-9e7c-451a-af7c-c9142d80a5db tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Lock "2099350d6f3bcd0de9471c73862d4fe75b049801" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.255s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:33:05 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-dae57060-9e7c-451a-af7c-c9142d80a5db tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:33:05 user nova-compute[73572]: DEBUG nova.network.neutron [None req-dae57060-9e7c-451a-af7c-c9142d80a5db tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] [instance: d147974d-213d-4aa3-8d03-11b262f59dca] Successfully created port: 8d51de2d-85b6-4a2f-80db-5fe69b8fd11b {{(pid=73572) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 10:33:05 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-dae57060-9e7c-451a-af7c-c9142d80a5db tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json" returned: 0 in 0.186s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:33:05 user nova-compute[73572]: DEBUG nova.virt.disk.api [None req-dae57060-9e7c-451a-af7c-c9142d80a5db tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d147974d-213d-4aa3-8d03-11b262f59dca/disk. size=1073741824 {{(pid=73572) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 10:33:05 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-dae57060-9e7c-451a-af7c-c9142d80a5db tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d147974d-213d-4aa3-8d03-11b262f59dca/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:33:05 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:33:05 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Received event <DeviceRemovedEvent: 1693045985.7240205, 773c7bf7-a911-4b80-9cef-5cc563257b7b => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73572) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 10:33:05 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-dae57060-9e7c-451a-af7c-c9142d80a5db tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d147974d-213d-4aa3-8d03-11b262f59dca/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:33:05 user nova-compute[73572]: DEBUG nova.virt.disk.api [None req-dae57060-9e7c-451a-af7c-c9142d80a5db tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Cannot resize image /opt/stack/data/nova/instances/d147974d-213d-4aa3-8d03-11b262f59dca/disk to a smaller size. {{(pid=73572) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 10:33:05 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-dae57060-9e7c-451a-af7c-c9142d80a5db tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] [instance: d147974d-213d-4aa3-8d03-11b262f59dca] Created local disks {{(pid=73572) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 10:33:05 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-dae57060-9e7c-451a-af7c-c9142d80a5db tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] [instance: d147974d-213d-4aa3-8d03-11b262f59dca] Ensure instance console log exists: /opt/stack/data/nova/instances/d147974d-213d-4aa3-8d03-11b262f59dca/console.log {{(pid=73572) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 10:33:05 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-dae57060-9e7c-451a-af7c-c9142d80a5db tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:33:05 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-dae57060-9e7c-451a-af7c-c9142d80a5db tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:33:05 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-dae57060-9e7c-451a-af7c-c9142d80a5db tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:33:05 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-2e9522c5-055c-409b-8904-4b7291d7b53f tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 773c7bf7-a911-4b80-9cef-5cc563257b7b {{(pid=73572) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 10:33:05 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-2e9522c5-055c-409b-8904-4b7291d7b53f tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Successfully detached device vdb from instance 773c7bf7-a911-4b80-9cef-5cc563257b7b from the live domain config.
Aug 26 10:33:05 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e9522c5-055c-409b-8904-4b7291d7b53f tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] [instance: 773c7bf7-a911-4b80-9cef-5cc563257b7b] calling os-brick to detach iSCSI Volume {{(pid=73572) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 10:33:05 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e9522c5-055c-409b-8904-4b7291d7b53f tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc89c3d6a10>, {'target_iqns': ['iqn.2010-10.org.openstack:fe9111ce-0d30-4114-a070-5849b56f5428'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'teOXKDFY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 10:33:05 user nova-compute[73572]: WARNING os_brick.initiator.connectors.base [None req-2e9522c5-055c-409b-8904-4b7291d7b53f tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 10:33:05 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-2e9522c5-055c-409b-8904-4b7291d7b53f tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 10:33:05 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-2e9522c5-055c-409b-8904-4b7291d7b53f tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 10:33:05 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e9522c5-055c-409b-8904-4b7291d7b53f tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fe9111ce-0d30-4114-a070-5849b56f5428', 0)] {{(pid=73572) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 10:33:05 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:33:05 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:33:05 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0b1ec38-f47e-426e-a2ff-d33a5693c65e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d8aa6fc0-ce50-4db6-8d7d-9f37eae07207\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fe9111ce-0d30-4114-a070-5849b56f5428\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:33:05 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:33:05 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:33:05 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[522f5221-a50c-4d77-b4a0-ca4e95c870ef]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8aa6fc0-ce50-4db6-8d7d-9f37eae07207 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe9111ce-0d30-4114-a070-5849b56f5428 (non-flash)\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:33:05 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e9522c5-055c-409b-8904-4b7291d7b53f tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8aa6fc0-ce50-4db6-8d7d-9f37eae07207 (non-flash)
Aug 26 10:33:05 user nova-compute[73572]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe9111ce-0d30-4114-a070-5849b56f5428 (non-flash)
Aug 26 10:33:05 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 10:33:05 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e9522c5-055c-409b-8904-4b7291d7b53f tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8aa6fc0-ce50-4db6-8d7d-9f37eae07207 (non-flash)
Aug 26 10:33:05 user nova-compute[73572]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe9111ce-0d30-4114-a070-5849b56f5428 (non-flash)
Aug 26 10:33:05 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 10:33:05 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e9522c5-055c-409b-8904-4b7291d7b53f tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc89c48d2d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fe9111ce-0d30-4114-a070-5849b56f5428'): ({'sdb'}, set())}) {{(pid=73572) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 10:33:05 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-2e9522c5-055c-409b-8904-4b7291d7b53f tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Removing single pathed devices sdb {{(pid=73572) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 10:33:05 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:33:05 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:33:05 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f56c502-e960-4647-8427-7c88f1718c93]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:33:05 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:33:05 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:33:05 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[d68211f5-58f2-4f06-a442-bb678d8b1801]: (4, ('ok\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:33:05 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-2e9522c5-055c-409b-8904-4b7291d7b53f tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Flushing IO for device /dev/sdb {{(pid=73572) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 10:33:05 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:33:05 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:33:05 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9f926b9-78e1-4541-a96f-6be726d1f2c3]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:33:05 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-2e9522c5-055c-409b-8904-4b7291d7b53f tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73572) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 10:33:05 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:33:05 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:33:05 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfc9bbbb-c893-46c5-8939-35b30c04decb]: (4, ('1', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:33:05 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-2e9522c5-055c-409b-8904-4b7291d7b53f tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73572) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 10:33:05 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-2e9522c5-055c-409b-8904-4b7291d7b53f tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] SCSI volumes sdb have been removed. {{(pid=73572) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 10:33:05 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e9522c5-055c-409b-8904-4b7291d7b53f tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fe9111ce-0d30-4114-a070-5849b56f5428')] {{(pid=73572) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 10:33:05 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe9111ce-0d30-4114-a070-5849b56f5428 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:33:05 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe9111ce-0d30-4114-a070-5849b56f5428 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:33:05 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bef9cdc-92c2-463b-85f9-f4b62abefdee]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:33:05 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e9522c5-055c-409b-8904-4b7291d7b53f tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:33:05 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe9111ce-0d30-4114-a070-5849b56f5428 -p 172.16.0.220:3260 --logout {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:33:06 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe9111ce-0d30-4114-a070-5849b56f5428 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:33:06 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[903e44b4-3e1a-4324-bd8b-d5c23b7e3261]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:fe9111ce-0d30-4114-a070-5849b56f5428, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:fe9111ce-0d30-4114-a070-5849b56f5428, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:33:06 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e9522c5-055c-409b-8904-4b7291d7b53f tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:fe9111ce-0d30-4114-a070-5849b56f5428, portal: 172.16.0.220,3260]
Aug 26 10:33:06 user nova-compute[73572]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:fe9111ce-0d30-4114-a070-5849b56f5428, portal: 172.16.0.220,3260] successful.
Aug 26 10:33:06 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:33:06 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe9111ce-0d30-4114-a070-5849b56f5428 -p 172.16.0.220:3260 --op delete {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:33:06 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe9111ce-0d30-4114-a070-5849b56f5428 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:33:06 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b564135-8e96-4c11-acef-8ce606c9f7ff]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:33:06 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e9522c5-055c-409b-8904-4b7291d7b53f tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:33:06 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-2e9522c5-055c-409b-8904-4b7291d7b53f tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.296s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 10:33:06 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e9522c5-055c-409b-8904-4b7291d7b53f tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] <== disconnect_volume: return (297ms) None {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 10:33:06 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e9522c5-055c-409b-8904-4b7291d7b53f tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] [instance: 773c7bf7-a911-4b80-9cef-5cc563257b7b] Disconnected iSCSI Volume {{(pid=73572) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 10:33:06 user nova-compute[73572]: DEBUG nova.network.neutron [None req-dae57060-9e7c-451a-af7c-c9142d80a5db tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] [instance: d147974d-213d-4aa3-8d03-11b262f59dca] Successfully updated port: 8d51de2d-85b6-4a2f-80db-5fe69b8fd11b {{(pid=73572) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 10:33:06 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-dae57060-9e7c-451a-af7c-c9142d80a5db tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Acquiring lock "refresh_cache-d147974d-213d-4aa3-8d03-11b262f59dca" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:33:06 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-dae57060-9e7c-451a-af7c-c9142d80a5db tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Acquired lock "refresh_cache-d147974d-213d-4aa3-8d03-11b262f59dca" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:33:06 user nova-compute[73572]: DEBUG nova.network.neutron [None req-dae57060-9e7c-451a-af7c-c9142d80a5db tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] [instance: d147974d-213d-4aa3-8d03-11b262f59dca] Building network info cache for instance {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 10:33:06 user nova-compute[73572]: DEBUG nova.compute.manager [req-2edf53a9-6683-4d95-bf2c-98ea9beed564 req-85f277fa-1435-4aff-8e59-64d2fb1d7ea7 service nova] [instance: d147974d-213d-4aa3-8d03-11b262f59dca] Received event network-changed-8d51de2d-85b6-4a2f-80db-5fe69b8fd11b {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:33:06 user nova-compute[73572]: DEBUG nova.compute.manager [req-2edf53a9-6683-4d95-bf2c-98ea9beed564 req-85f277fa-1435-4aff-8e59-64d2fb1d7ea7 service nova] [instance: d147974d-213d-4aa3-8d03-11b262f59dca] Refreshing instance network info cache due to event network-changed-8d51de2d-85b6-4a2f-80db-5fe69b8fd11b. {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 10:33:06 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-2edf53a9-6683-4d95-bf2c-98ea9beed564 req-85f277fa-1435-4aff-8e59-64d2fb1d7ea7 service nova] Acquiring lock "refresh_cache-d147974d-213d-4aa3-8d03-11b262f59dca" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:33:06 user nova-compute[73572]: DEBUG nova.network.neutron [None req-dae57060-9e7c-451a-af7c-c9142d80a5db tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] [instance: d147974d-213d-4aa3-8d03-11b262f59dca] Instance cache missing network info. {{(pid=73572) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 10:33:06 user nova-compute[73572]: DEBUG nova.network.neutron [None req-dae57060-9e7c-451a-af7c-c9142d80a5db tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] [instance: d147974d-213d-4aa3-8d03-11b262f59dca] Updating instance_info_cache with network_info: [{"id": "8d51de2d-85b6-4a2f-80db-5fe69b8fd11b", "address": "fa:16:3e:e5:90:35", "network": {"id": "317d2681-96ce-4898-b6fb-8892ee6f706d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2049963835-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7e16843614c451d958e817c832d4cbc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d51de2d-85", "ovs_interfaceid": "8d51de2d-85b6-4a2f-80db-5fe69b8fd11b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:33:06 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-dae57060-9e7c-451a-af7c-c9142d80a5db tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Releasing lock "refresh_cache-d147974d-213d-4aa3-8d03-11b262f59dca" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:33:06 user nova-compute[73572]: DEBUG nova.compute.manager [None req-dae57060-9e7c-451a-af7c-c9142d80a5db tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] [instance: d147974d-213d-4aa3-8d03-11b262f59dca] Instance network_info: |[{"id": "8d51de2d-85b6-4a2f-80db-5fe69b8fd11b", "address": "fa:16:3e:e5:90:35", "network": {"id": "317d2681-96ce-4898-b6fb-8892ee6f706d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2049963835-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7e16843614c451d958e817c832d4cbc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d51de2d-85", "ovs_interfaceid": "8d51de2d-85b6-4a2f-80db-5fe69b8fd11b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73572) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 10:33:06 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-2edf53a9-6683-4d95-bf2c-98ea9beed564 req-85f277fa-1435-4aff-8e59-64d2fb1d7ea7 service nova] Acquired lock "refresh_cache-d147974d-213d-4aa3-8d03-11b262f59dca" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:33:06 user nova-compute[73572]: DEBUG nova.network.neutron [req-2edf53a9-6683-4d95-bf2c-98ea9beed564 req-85f277fa-1435-4aff-8e59-64d2fb1d7ea7 service nova] [instance: d147974d-213d-4aa3-8d03-11b262f59dca] Refreshing network info cache for port 8d51de2d-85b6-4a2f-80db-5fe69b8fd11b {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 10:33:06 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-dae57060-9e7c-451a-af7c-c9142d80a5db tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] [instance: d147974d-213d-4aa3-8d03-11b262f59dca] Start _get_guest_xml network_info=[{"id": "8d51de2d-85b6-4a2f-80db-5fe69b8fd11b", "address": "fa:16:3e:e5:90:35", "network": {"id": "317d2681-96ce-4898-b6fb-8892ee6f706d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2049963835-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7e16843614c451d958e817c832d4cbc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d51de2d-85", "ovs_interfaceid": "8d51de2d-85b6-4a2f-80db-5fe69b8fd11b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T10:07:33Z,direct_url=<?>,disk_format='qcow2',id=299da0c9-e1c4-48f0-be55-fbe20dd06bc9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5c995f8bbbab4368b67a253e0df3971a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T10:07:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'guest_format': None, 'size': 0, 'encryption_format': None, 'device_type': 'disk', 'image_id': '299da0c9-e1c4-48f0-be55-fbe20dd06bc9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73572) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 10:33:06 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-dae57060-9e7c-451a-af7c-c9142d80a5db tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:33:06 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-dae57060-9e7c-451a-af7c-c9142d80a5db tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:33:06 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-dae57060-9e7c-451a-af7c-c9142d80a5db tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73572) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 10:33:06 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-dae57060-9e7c-451a-af7c-c9142d80a5db tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] CPU controller missing on host. {{(pid=73572) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 10:33:06 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-dae57060-9e7c-451a-af7c-c9142d80a5db tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73572) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 10:33:06 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-dae57060-9e7c-451a-af7c-c9142d80a5db tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] CPU controller found on host. {{(pid=73572) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 10:33:06 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-dae57060-9e7c-451a-af7c-c9142d80a5db tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73572) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 10:33:06 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-dae57060-9e7c-451a-af7c-c9142d80a5db tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T10:07:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T10:07:33Z,direct_url=<?>,disk_format='qcow2',id=299da0c9-e1c4-48f0-be55-fbe20dd06bc9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5c995f8bbbab4368b67a253e0df3971a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T10:07:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 10:33:06 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-dae57060-9e7c-451a-af7c-c9142d80a5db tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Flavor limits 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 10:33:06 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-dae57060-9e7c-451a-af7c-c9142d80a5db tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Image limits 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 10:33:06 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-dae57060-9e7c-451a-af7c-c9142d80a5db tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Flavor pref 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 10:33:06 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-dae57060-9e7c-451a-af7c-c9142d80a5db tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Image pref 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 10:33:06 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-dae57060-9e7c-451a-af7c-c9142d80a5db tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 10:33:06 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-dae57060-9e7c-451a-af7c-c9142d80a5db tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 10:33:06 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-dae57060-9e7c-451a-af7c-c9142d80a5db tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73572) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 10:33:06 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-dae57060-9e7c-451a-af7c-c9142d80a5db tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Got 1 possible topologies {{(pid=73572) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 10:33:06 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-dae57060-9e7c-451a-af7c-c9142d80a5db tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 10:33:06 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-dae57060-9e7c-451a-af7c-c9142d80a5db tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 10:33:06 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-dae57060-9e7c-451a-af7c-c9142d80a5db tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T10:33:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1735038851',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1735038851',id=46,image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKA2CshH7isyB3vV5ETR93+hSoeCwS760V1xRpFlfuAtq/MqtMJywztpVgxj5rkLJmK+DWulBNDjaP7GLPWX9o0j64jsB+zF5uHZU8M4lTcSCf/Ws/xZAJQf9qx+64vnrA==',key_name='tempest-keypair-1853117673',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c7e16843614c451d958e817c832d4cbc',ramdisk_id='',reservation_id='r-l9pvelsd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-706965180',owner_user_name='tempest-AttachVolumeShelveTestJSON-706965180-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T10:33:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='17243251fe57431c9c98195a16239c5f',uuid=d147974d-213d-4aa3-8d03-11b262f59dca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8d51de2d-85b6-4a2f-80db-5fe69b8fd11b", "address": "fa:16:3e:e5:90:35", "network": {"id": "317d2681-96ce-4898-b6fb-8892ee6f706d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2049963835-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7e16843614c451d958e817c832d4cbc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d51de2d-85", "ovs_interfaceid": "8d51de2d-85b6-4a2f-80db-5fe69b8fd11b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73572) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 10:33:06 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-dae57060-9e7c-451a-af7c-c9142d80a5db tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Converting VIF {"id": "8d51de2d-85b6-4a2f-80db-5fe69b8fd11b", "address": "fa:16:3e:e5:90:35", "network": {"id": "317d2681-96ce-4898-b6fb-8892ee6f706d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2049963835-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7e16843614c451d958e817c832d4cbc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d51de2d-85", "ovs_interfaceid": "8d51de2d-85b6-4a2f-80db-5fe69b8fd11b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:33:06 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-dae57060-9e7c-451a-af7c-c9142d80a5db tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:90:35,bridge_name='br-int',has_traffic_filtering=True,id=8d51de2d-85b6-4a2f-80db-5fe69b8fd11b,network=Network(317d2681-96ce-4898-b6fb-8892ee6f706d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d51de2d-85') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:33:06 user nova-compute[73572]: DEBUG nova.objects.instance [None req-dae57060-9e7c-451a-af7c-c9142d80a5db tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Lazy-loading 'pci_devices' on Instance uuid d147974d-213d-4aa3-8d03-11b262f59dca {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:33:06 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-dae57060-9e7c-451a-af7c-c9142d80a5db tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] [instance: d147974d-213d-4aa3-8d03-11b262f59dca] End _get_guest_xml xml=<domain type="kvm">
Aug 26 10:33:06 user nova-compute[73572]:   <uuid>d147974d-213d-4aa3-8d03-11b262f59dca</uuid>
Aug 26 10:33:06 user nova-compute[73572]:   <name>instance-0000002e</name>
Aug 26 10:33:06 user nova-compute[73572]:   <memory>524288</memory>
Aug 26 10:33:06 user nova-compute[73572]:   <vcpu>1</vcpu>
Aug 26 10:33:06 user nova-compute[73572]:   <metadata>
Aug 26 10:33:06 user nova-compute[73572]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 10:33:06 user nova-compute[73572]:       <nova:package version="0.0.0"/>
Aug 26 10:33:06 user nova-compute[73572]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1735038851</nova:name>
Aug 26 10:33:06 user nova-compute[73572]:       <nova:creationTime>2023-08-26 10:33:06</nova:creationTime>
Aug 26 10:33:06 user nova-compute[73572]:       <nova:flavor name="m1.tiny">
Aug 26 10:33:06 user nova-compute[73572]:         <nova:memory>512</nova:memory>
Aug 26 10:33:06 user nova-compute[73572]:         <nova:disk>1</nova:disk>
Aug 26 10:33:06 user nova-compute[73572]:         <nova:swap>0</nova:swap>
Aug 26 10:33:06 user nova-compute[73572]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 10:33:06 user nova-compute[73572]:         <nova:vcpus>1</nova:vcpus>
Aug 26 10:33:06 user nova-compute[73572]:       </nova:flavor>
Aug 26 10:33:06 user nova-compute[73572]:       <nova:owner>
Aug 26 10:33:06 user nova-compute[73572]:         <nova:user uuid="17243251fe57431c9c98195a16239c5f">tempest-AttachVolumeShelveTestJSON-706965180-project-member</nova:user>
Aug 26 10:33:06 user nova-compute[73572]:         <nova:project uuid="c7e16843614c451d958e817c832d4cbc">tempest-AttachVolumeShelveTestJSON-706965180</nova:project>
Aug 26 10:33:06 user nova-compute[73572]:       </nova:owner>
Aug 26 10:33:06 user nova-compute[73572]:       <nova:root type="image" uuid="299da0c9-e1c4-48f0-be55-fbe20dd06bc9"/>
Aug 26 10:33:06 user nova-compute[73572]:       <nova:ports>
Aug 26 10:33:06 user nova-compute[73572]:         <nova:port uuid="8d51de2d-85b6-4a2f-80db-5fe69b8fd11b">
Aug 26 10:33:06 user nova-compute[73572]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 26 10:33:06 user nova-compute[73572]:         </nova:port>
Aug 26 10:33:06 user nova-compute[73572]:       </nova:ports>
Aug 26 10:33:06 user nova-compute[73572]:     </nova:instance>
Aug 26 10:33:06 user nova-compute[73572]:   </metadata>
Aug 26 10:33:06 user nova-compute[73572]:   <sysinfo type="smbios">
Aug 26 10:33:06 user nova-compute[73572]:     <system>
Aug 26 10:33:06 user nova-compute[73572]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 10:33:06 user nova-compute[73572]:       <entry name="product">OpenStack Nova</entry>
Aug 26 10:33:06 user nova-compute[73572]:       <entry name="version">0.0.0</entry>
Aug 26 10:33:06 user nova-compute[73572]:       <entry name="serial">d147974d-213d-4aa3-8d03-11b262f59dca</entry>
Aug 26 10:33:06 user nova-compute[73572]:       <entry name="uuid">d147974d-213d-4aa3-8d03-11b262f59dca</entry>
Aug 26 10:33:06 user nova-compute[73572]:       <entry name="family">Virtual Machine</entry>
Aug 26 10:33:06 user nova-compute[73572]:     </system>
Aug 26 10:33:06 user nova-compute[73572]:   </sysinfo>
Aug 26 10:33:06 user nova-compute[73572]:   <os>
Aug 26 10:33:06 user nova-compute[73572]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 10:33:06 user nova-compute[73572]:     <boot dev="hd"/>
Aug 26 10:33:06 user nova-compute[73572]:     <smbios mode="sysinfo"/>
Aug 26 10:33:06 user nova-compute[73572]:   </os>
Aug 26 10:33:06 user nova-compute[73572]:   <features>
Aug 26 10:33:06 user nova-compute[73572]:     <acpi/>
Aug 26 10:33:06 user nova-compute[73572]:     <apic/>
Aug 26 10:33:06 user nova-compute[73572]:     <vmcoreinfo/>
Aug 26 10:33:06 user nova-compute[73572]:   </features>
Aug 26 10:33:06 user nova-compute[73572]:   <clock offset="utc">
Aug 26 10:33:06 user nova-compute[73572]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 10:33:06 user nova-compute[73572]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 10:33:06 user nova-compute[73572]:     <timer name="hpet" present="no"/>
Aug 26 10:33:06 user nova-compute[73572]:   </clock>
Aug 26 10:33:06 user nova-compute[73572]:   <cpu mode="custom" match="exact">
Aug 26 10:33:06 user nova-compute[73572]:     <model>Nehalem</model>
Aug 26 10:33:06 user nova-compute[73572]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 10:33:06 user nova-compute[73572]:   </cpu>
Aug 26 10:33:06 user nova-compute[73572]:   <devices>
Aug 26 10:33:06 user nova-compute[73572]:     <disk type="file" device="disk">
Aug 26 10:33:06 user nova-compute[73572]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 10:33:06 user nova-compute[73572]:       <source file="/opt/stack/data/nova/instances/d147974d-213d-4aa3-8d03-11b262f59dca/disk"/>
Aug 26 10:33:06 user nova-compute[73572]:       <target dev="vda" bus="virtio"/>
Aug 26 10:33:06 user nova-compute[73572]:     </disk>
Aug 26 10:33:06 user nova-compute[73572]:     <interface type="ethernet">
Aug 26 10:33:06 user nova-compute[73572]:       <mac address="fa:16:3e:e5:90:35"/>
Aug 26 10:33:06 user nova-compute[73572]:       <model type="virtio"/>
Aug 26 10:33:06 user nova-compute[73572]:       <mtu size="1442"/>
Aug 26 10:33:06 user nova-compute[73572]:       <target dev="tap8d51de2d-85"/>
Aug 26 10:33:06 user nova-compute[73572]:     </interface>
Aug 26 10:33:06 user nova-compute[73572]:     <serial type="pty">
Aug 26 10:33:06 user nova-compute[73572]:       <log file="/opt/stack/data/nova/instances/d147974d-213d-4aa3-8d03-11b262f59dca/console.log" append="off"/>
Aug 26 10:33:06 user nova-compute[73572]:     </serial>
Aug 26 10:33:06 user nova-compute[73572]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 10:33:06 user nova-compute[73572]:     <video>
Aug 26 10:33:06 user nova-compute[73572]:       <model type="virtio"/>
Aug 26 10:33:06 user nova-compute[73572]:     </video>
Aug 26 10:33:06 user nova-compute[73572]:     <rng model="virtio">
Aug 26 10:33:06 user nova-compute[73572]:       <backend model="random">/dev/urandom</backend>
Aug 26 10:33:06 user nova-compute[73572]:     </rng>
Aug 26 10:33:06 user nova-compute[73572]:     <controller type="usb" index="0" model="none"/>
Aug 26 10:33:06 user nova-compute[73572]:     <memballoon model="virtio">
Aug 26 10:33:06 user nova-compute[73572]:       <stats period="10"/>
Aug 26 10:33:06 user nova-compute[73572]:     </memballoon>
Aug 26 10:33:06 user nova-compute[73572]:   </devices>
Aug 26 10:33:06 user nova-compute[73572]: </domain>
Aug 26 10:33:06 user nova-compute[73572]:  {{(pid=73572) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 10:33:06 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-dae57060-9e7c-451a-af7c-c9142d80a5db tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T10:33:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1735038851',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1735038851',id=46,image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKA2CshH7isyB3vV5ETR93+hSoeCwS760V1xRpFlfuAtq/MqtMJywztpVgxj5rkLJmK+DWulBNDjaP7GLPWX9o0j64jsB+zF5uHZU8M4lTcSCf/Ws/xZAJQf9qx+64vnrA==',key_name='tempest-keypair-1853117673',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c7e16843614c451d958e817c832d4cbc',ramdisk_id='',reservation_id='r-l9pvelsd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-706965180',owner_user_name='tempest-AttachVolumeShelveTestJSON-706965180-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T10:33:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='17243251fe57431c9c98195a16239c5f',uuid=d147974d-213d-4aa3-8d03-11b262f59dca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8d51de2d-85b6-4a2f-80db-5fe69b8fd11b", "address": "fa:16:3e:e5:90:35", "network": {"id": "317d2681-96ce-4898-b6fb-8892ee6f706d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2049963835-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7e16843614c451d958e817c832d4cbc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d51de2d-85", "ovs_interfaceid": "8d51de2d-85b6-4a2f-80db-5fe69b8fd11b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 10:33:06 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-dae57060-9e7c-451a-af7c-c9142d80a5db tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Converting VIF {"id": "8d51de2d-85b6-4a2f-80db-5fe69b8fd11b", "address": "fa:16:3e:e5:90:35", "network": {"id": "317d2681-96ce-4898-b6fb-8892ee6f706d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2049963835-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7e16843614c451d958e817c832d4cbc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d51de2d-85", "ovs_interfaceid": "8d51de2d-85b6-4a2f-80db-5fe69b8fd11b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:33:06 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-dae57060-9e7c-451a-af7c-c9142d80a5db tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:90:35,bridge_name='br-int',has_traffic_filtering=True,id=8d51de2d-85b6-4a2f-80db-5fe69b8fd11b,network=Network(317d2681-96ce-4898-b6fb-8892ee6f706d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d51de2d-85') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:33:06 user nova-compute[73572]: DEBUG os_vif [None req-dae57060-9e7c-451a-af7c-c9142d80a5db tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:90:35,bridge_name='br-int',has_traffic_filtering=True,id=8d51de2d-85b6-4a2f-80db-5fe69b8fd11b,network=Network(317d2681-96ce-4898-b6fb-8892ee6f706d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d51de2d-85') {{(pid=73572) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 10:33:06 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:33:06 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:33:06 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 10:33:06 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:33:06 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8d51de2d-85, may_exist=True, interface_attrs={}) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:33:06 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8d51de2d-85, col_values=(('external_ids', {'iface-id': '8d51de2d-85b6-4a2f-80db-5fe69b8fd11b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e5:90:35', 'vm-uuid': 'd147974d-213d-4aa3-8d03-11b262f59dca'}),), if_exists=True) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:33:06 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:33:06 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:33:06 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:33:06 user nova-compute[73572]: INFO os_vif [None req-dae57060-9e7c-451a-af7c-c9142d80a5db tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:90:35,bridge_name='br-int',has_traffic_filtering=True,id=8d51de2d-85b6-4a2f-80db-5fe69b8fd11b,network=Network(317d2681-96ce-4898-b6fb-8892ee6f706d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d51de2d-85')
Aug 26 10:33:06 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-dae57060-9e7c-451a-af7c-c9142d80a5db tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] No BDM found with device name vda, not building metadata. {{(pid=73572) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 10:33:06 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-dae57060-9e7c-451a-af7c-c9142d80a5db tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] No VIF found with MAC fa:16:3e:e5:90:35, not building metadata {{(pid=73572) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 10:33:07 user nova-compute[73572]: DEBUG nova.network.neutron [req-2edf53a9-6683-4d95-bf2c-98ea9beed564 req-85f277fa-1435-4aff-8e59-64d2fb1d7ea7 service nova] [instance: d147974d-213d-4aa3-8d03-11b262f59dca] Updated VIF entry in instance network info cache for port 8d51de2d-85b6-4a2f-80db-5fe69b8fd11b. {{(pid=73572) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 10:33:07 user nova-compute[73572]: DEBUG nova.network.neutron [req-2edf53a9-6683-4d95-bf2c-98ea9beed564 req-85f277fa-1435-4aff-8e59-64d2fb1d7ea7 service nova] [instance: d147974d-213d-4aa3-8d03-11b262f59dca] Updating instance_info_cache with network_info: [{"id": "8d51de2d-85b6-4a2f-80db-5fe69b8fd11b", "address": "fa:16:3e:e5:90:35", "network": {"id": "317d2681-96ce-4898-b6fb-8892ee6f706d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2049963835-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7e16843614c451d958e817c832d4cbc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d51de2d-85", "ovs_interfaceid": "8d51de2d-85b6-4a2f-80db-5fe69b8fd11b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:33:07 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-2edf53a9-6683-4d95-bf2c-98ea9beed564 req-85f277fa-1435-4aff-8e59-64d2fb1d7ea7 service nova] Releasing lock "refresh_cache-d147974d-213d-4aa3-8d03-11b262f59dca" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:33:08 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:33:08 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:33:08 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:33:08 user nova-compute[73572]: DEBUG nova.compute.manager [req-af1eb0ab-fdb9-4717-8cee-c22ff63073b8 req-a26c023c-b1af-4ad7-8c81-dac4a019fb1a service nova] [instance: d147974d-213d-4aa3-8d03-11b262f59dca] Received event network-vif-plugged-8d51de2d-85b6-4a2f-80db-5fe69b8fd11b {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:33:08 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-af1eb0ab-fdb9-4717-8cee-c22ff63073b8 req-a26c023c-b1af-4ad7-8c81-dac4a019fb1a service nova] Acquiring lock "d147974d-213d-4aa3-8d03-11b262f59dca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:33:08 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-af1eb0ab-fdb9-4717-8cee-c22ff63073b8 req-a26c023c-b1af-4ad7-8c81-dac4a019fb1a service nova] Lock "d147974d-213d-4aa3-8d03-11b262f59dca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:33:08 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-af1eb0ab-fdb9-4717-8cee-c22ff63073b8 req-a26c023c-b1af-4ad7-8c81-dac4a019fb1a service nova] Lock "d147974d-213d-4aa3-8d03-11b262f59dca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:33:08 user nova-compute[73572]: DEBUG nova.compute.manager [req-af1eb0ab-fdb9-4717-8cee-c22ff63073b8 req-a26c023c-b1af-4ad7-8c81-dac4a019fb1a service nova] [instance: d147974d-213d-4aa3-8d03-11b262f59dca] No waiting events found dispatching network-vif-plugged-8d51de2d-85b6-4a2f-80db-5fe69b8fd11b {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:33:08 user nova-compute[73572]: WARNING nova.compute.manager [req-af1eb0ab-fdb9-4717-8cee-c22ff63073b8 req-a26c023c-b1af-4ad7-8c81-dac4a019fb1a service nova] [instance: d147974d-213d-4aa3-8d03-11b262f59dca] Received unexpected event network-vif-plugged-8d51de2d-85b6-4a2f-80db-5fe69b8fd11b for instance with vm_state building and task_state spawning.
Aug 26 10:33:08 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:33:08 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:33:08 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:33:08 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:33:10 user nova-compute[73572]: DEBUG nova.virt.driver [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Emitting event <LifecycleEvent: 1693045990.2538471, d147974d-213d-4aa3-8d03-11b262f59dca => Resumed> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:33:10 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: d147974d-213d-4aa3-8d03-11b262f59dca] VM Resumed (Lifecycle Event)
Aug 26 10:33:10 user nova-compute[73572]: DEBUG nova.compute.manager [None req-dae57060-9e7c-451a-af7c-c9142d80a5db tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] [instance: d147974d-213d-4aa3-8d03-11b262f59dca] Instance event wait completed in 0 seconds for  {{(pid=73572) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 10:33:10 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-dae57060-9e7c-451a-af7c-c9142d80a5db tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] [instance: d147974d-213d-4aa3-8d03-11b262f59dca] Guest created on hypervisor {{(pid=73572) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 10:33:10 user nova-compute[73572]: INFO nova.virt.libvirt.driver [-] [instance: d147974d-213d-4aa3-8d03-11b262f59dca] Instance spawned successfully.
Aug 26 10:33:10 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-dae57060-9e7c-451a-af7c-c9142d80a5db tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] [instance: d147974d-213d-4aa3-8d03-11b262f59dca] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 10:33:10 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: d147974d-213d-4aa3-8d03-11b262f59dca] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:33:10 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: d147974d-213d-4aa3-8d03-11b262f59dca] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73572) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 10:33:10 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-dae57060-9e7c-451a-af7c-c9142d80a5db tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] [instance: d147974d-213d-4aa3-8d03-11b262f59dca] Found default for hw_cdrom_bus of ide {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:33:10 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-dae57060-9e7c-451a-af7c-c9142d80a5db tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] [instance: d147974d-213d-4aa3-8d03-11b262f59dca] Found default for hw_disk_bus of virtio {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:33:10 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-dae57060-9e7c-451a-af7c-c9142d80a5db tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] [instance: d147974d-213d-4aa3-8d03-11b262f59dca] Found default for hw_input_bus of None {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:33:10 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-dae57060-9e7c-451a-af7c-c9142d80a5db tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] [instance: d147974d-213d-4aa3-8d03-11b262f59dca] Found default for hw_pointer_model of None {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:33:10 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-dae57060-9e7c-451a-af7c-c9142d80a5db tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] [instance: d147974d-213d-4aa3-8d03-11b262f59dca] Found default for hw_video_model of virtio {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:33:10 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-dae57060-9e7c-451a-af7c-c9142d80a5db tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] [instance: d147974d-213d-4aa3-8d03-11b262f59dca] Found default for hw_vif_model of virtio {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:33:10 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: d147974d-213d-4aa3-8d03-11b262f59dca] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 10:33:10 user nova-compute[73572]: DEBUG nova.virt.driver [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Emitting event <LifecycleEvent: 1693045990.255023, d147974d-213d-4aa3-8d03-11b262f59dca => Started> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:33:10 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: d147974d-213d-4aa3-8d03-11b262f59dca] VM Started (Lifecycle Event)
Aug 26 10:33:10 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: d147974d-213d-4aa3-8d03-11b262f59dca] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:33:10 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: d147974d-213d-4aa3-8d03-11b262f59dca] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73572) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 10:33:10 user nova-compute[73572]: INFO nova.compute.manager [None req-dae57060-9e7c-451a-af7c-c9142d80a5db tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] [instance: d147974d-213d-4aa3-8d03-11b262f59dca] Took 5.47 seconds to spawn the instance on the hypervisor.
Aug 26 10:33:10 user nova-compute[73572]: DEBUG nova.compute.manager [None req-dae57060-9e7c-451a-af7c-c9142d80a5db tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] [instance: d147974d-213d-4aa3-8d03-11b262f59dca] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:33:10 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: d147974d-213d-4aa3-8d03-11b262f59dca] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 10:33:10 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:33:10 user nova-compute[73572]: INFO nova.compute.manager [None req-dae57060-9e7c-451a-af7c-c9142d80a5db tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] [instance: d147974d-213d-4aa3-8d03-11b262f59dca] Took 6.24 seconds to build instance.
Aug 26 10:33:10 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-dae57060-9e7c-451a-af7c-c9142d80a5db tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Lock "d147974d-213d-4aa3-8d03-11b262f59dca" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.352s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:33:10 user nova-compute[73572]: DEBUG nova.compute.manager [req-4f31b1fd-b4f3-4006-818d-4283821f2098 req-3a9dd060-6bf0-48c3-839a-c1cb7df52a64 service nova] [instance: d147974d-213d-4aa3-8d03-11b262f59dca] Received event network-vif-plugged-8d51de2d-85b6-4a2f-80db-5fe69b8fd11b {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:33:10 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-4f31b1fd-b4f3-4006-818d-4283821f2098 req-3a9dd060-6bf0-48c3-839a-c1cb7df52a64 service nova] Acquiring lock "d147974d-213d-4aa3-8d03-11b262f59dca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:33:10 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-4f31b1fd-b4f3-4006-818d-4283821f2098 req-3a9dd060-6bf0-48c3-839a-c1cb7df52a64 service nova] Lock "d147974d-213d-4aa3-8d03-11b262f59dca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:33:10 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-4f31b1fd-b4f3-4006-818d-4283821f2098 req-3a9dd060-6bf0-48c3-839a-c1cb7df52a64 service nova] Lock "d147974d-213d-4aa3-8d03-11b262f59dca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:33:10 user nova-compute[73572]: DEBUG nova.compute.manager [req-4f31b1fd-b4f3-4006-818d-4283821f2098 req-3a9dd060-6bf0-48c3-839a-c1cb7df52a64 service nova] [instance: d147974d-213d-4aa3-8d03-11b262f59dca] No waiting events found dispatching network-vif-plugged-8d51de2d-85b6-4a2f-80db-5fe69b8fd11b {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:33:10 user nova-compute[73572]: WARNING nova.compute.manager [req-4f31b1fd-b4f3-4006-818d-4283821f2098 req-3a9dd060-6bf0-48c3-839a-c1cb7df52a64 service nova] [instance: d147974d-213d-4aa3-8d03-11b262f59dca] Received unexpected event network-vif-plugged-8d51de2d-85b6-4a2f-80db-5fe69b8fd11b for instance with vm_state building and task_state spawning.
Aug 26 10:33:11 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:33:12 user nova-compute[73572]: DEBUG nova.objects.instance [None req-2e9522c5-055c-409b-8904-4b7291d7b53f tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Lazy-loading 'flavor' on Instance uuid 773c7bf7-a911-4b80-9cef-5cc563257b7b {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:33:12 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-2e9522c5-055c-409b-8904-4b7291d7b53f tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Lock "773c7bf7-a911-4b80-9cef-5cc563257b7b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 7.098s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:33:15 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:33:16 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:33:17 user nova-compute[73572]: DEBUG nova.compute.manager [None req-c5bdcb4a-d8e4-478f-b9a0-e3320e24bf0b tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 7e3fd7ab-91ae-48b9-b436-b154c332869c] Start spawning the instance on the hypervisor. {{(pid=73572) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 10:33:17 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-c5bdcb4a-d8e4-478f-b9a0-e3320e24bf0b tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 7e3fd7ab-91ae-48b9-b436-b154c332869c] Creating instance directory {{(pid=73572) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 10:33:17 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-c5bdcb4a-d8e4-478f-b9a0-e3320e24bf0b tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 7e3fd7ab-91ae-48b9-b436-b154c332869c] Creating image(s)
Aug 26 10:33:17 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-c5bdcb4a-d8e4-478f-b9a0-e3320e24bf0b tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 7e3fd7ab-91ae-48b9-b436-b154c332869c] Did not create local disks {{(pid=73572) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 26 10:33:17 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-c5bdcb4a-d8e4-478f-b9a0-e3320e24bf0b tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 7e3fd7ab-91ae-48b9-b436-b154c332869c] Ensure instance console log exists: /opt/stack/data/nova/instances/7e3fd7ab-91ae-48b9-b436-b154c332869c/console.log {{(pid=73572) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 10:33:17 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-c5bdcb4a-d8e4-478f-b9a0-e3320e24bf0b tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:33:17 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-c5bdcb4a-d8e4-478f-b9a0-e3320e24bf0b tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:33:17 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-c5bdcb4a-d8e4-478f-b9a0-e3320e24bf0b tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:33:17 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-c5bdcb4a-d8e4-478f-b9a0-e3320e24bf0b tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 7e3fd7ab-91ae-48b9-b436-b154c332869c] Start _get_guest_xml network_info=[{"id": "47c9677e-a234-4f8f-8cdc-5f1fdb21c760", "address": "fa:16:3e:0d:dd:ea", "network": {"id": "c520ee18-34a7-4781-bc97-419e9a702d40", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-280196989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfc130586d9f4581953f1b8ae1c4465e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47c9677e-a2", "ovs_interfaceid": "47c9677e-a234-4f8f-8cdc-5f1fdb21c760", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'disk_bus': 'virtio', 'boot_index': 0, 'mount_device': '/dev/vda', 'attachment_id': '298dfb23-7169-4ab5-95f3-86b96ee8f9cb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:ad1b4b19-ad16-436c-9fa3-e718bea4f540'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RjYPMhzx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '7e3fd7ab-91ae-48b9-b436-b154c332869c', 'attached_at': '', 'detached_at': '', 'volume_id': 'ad1b4b19-ad16-436c-9fa3-e718bea4f540', 'serial': 'ad1b4b19-ad16-436c-9fa3-e718bea4f540'}, 'guest_format': None, 'device_type': 'disk', 'volume_type': None} {{(pid=73572) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 10:33:17 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-c5bdcb4a-d8e4-478f-b9a0-e3320e24bf0b tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:33:17 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-c5bdcb4a-d8e4-478f-b9a0-e3320e24bf0b tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:33:17 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-c5bdcb4a-d8e4-478f-b9a0-e3320e24bf0b tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73572) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 10:33:17 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-c5bdcb4a-d8e4-478f-b9a0-e3320e24bf0b tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] CPU controller missing on host. {{(pid=73572) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 10:33:17 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-c5bdcb4a-d8e4-478f-b9a0-e3320e24bf0b tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73572) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 10:33:17 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-c5bdcb4a-d8e4-478f-b9a0-e3320e24bf0b tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] CPU controller found on host. {{(pid=73572) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 10:33:17 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-c5bdcb4a-d8e4-478f-b9a0-e3320e24bf0b tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73572) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 10:33:17 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-c5bdcb4a-d8e4-478f-b9a0-e3320e24bf0b tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T10:07:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 10:33:17 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-c5bdcb4a-d8e4-478f-b9a0-e3320e24bf0b tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Flavor limits 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 10:33:17 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-c5bdcb4a-d8e4-478f-b9a0-e3320e24bf0b tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Image limits 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 10:33:17 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-c5bdcb4a-d8e4-478f-b9a0-e3320e24bf0b tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Flavor pref 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 10:33:17 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-c5bdcb4a-d8e4-478f-b9a0-e3320e24bf0b tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Image pref 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 10:33:17 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-c5bdcb4a-d8e4-478f-b9a0-e3320e24bf0b tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 10:33:17 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-c5bdcb4a-d8e4-478f-b9a0-e3320e24bf0b tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 10:33:17 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-c5bdcb4a-d8e4-478f-b9a0-e3320e24bf0b tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73572) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 10:33:17 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-c5bdcb4a-d8e4-478f-b9a0-e3320e24bf0b tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Got 1 possible topologies {{(pid=73572) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 10:33:17 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-c5bdcb4a-d8e4-478f-b9a0-e3320e24bf0b tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 10:33:17 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-c5bdcb4a-d8e4-478f-b9a0-e3320e24bf0b tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 10:33:17 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c5bdcb4a-d8e4-478f-b9a0-e3320e24bf0b tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 7e3fd7ab-91ae-48b9-b436-b154c332869c] Calling os-brick to attach iSCSI Volume {{(pid=73572) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 10:33:17 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5bdcb4a-d8e4-478f-b9a0-e3320e24bf0b tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc89c3d6a10>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:ad1b4b19-ad16-436c-9fa3-e718bea4f540'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RjYPMhzx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 10:33:17 user nova-compute[73572]: WARNING os_brick.initiator.connectors.base [None req-c5bdcb4a-d8e4-478f-b9a0-e3320e24bf0b tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 10:33:17 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-c5bdcb4a-d8e4-478f-b9a0-e3320e24bf0b tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 10:33:17 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-c5bdcb4a-d8e4-478f-b9a0-e3320e24bf0b tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 10:33:17 user nova-compute[73572]: WARNING os_brick.initiator.connectors.base [None req-c5bdcb4a-d8e4-478f-b9a0-e3320e24bf0b tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 10:33:17 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-c5bdcb4a-d8e4-478f-b9a0-e3320e24bf0b tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ad1b4b19-ad16-436c-9fa3-e718bea4f540" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 10:33:17 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-c5bdcb4a-d8e4-478f-b9a0-e3320e24bf0b tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ad1b4b19-ad16-436c-9fa3-e718bea4f540" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 10:33:17 user nova-compute[73572]: INFO os_brick.initiator.connectors.iscsi [None req-c5bdcb4a-d8e4-478f-b9a0-e3320e24bf0b tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 10:33:17 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad1b4b19-ad16-436c-9fa3-e718bea4f540 -p 172.16.0.220:3260 {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:33:17 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad1b4b19-ad16-436c-9fa3-e718bea4f540 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:33:17 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b0a71ac-4133-46ac-a503-a7eadedc1f41]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:33:17 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5bdcb4a-d8e4-478f-b9a0-e3320e24bf0b tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 10:33:17 user nova-compute[73572]:  {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:33:17 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad1b4b19-ad16-436c-9fa3-e718bea4f540 -p 172.16.0.220:3260 --interface default --op new {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:33:17 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad1b4b19-ad16-436c-9fa3-e718bea4f540 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:33:17 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[74c272d9-7cbc-4419-8e52-d5dd6098aece]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ad1b4b19-ad16-436c-9fa3-e718bea4f540] added\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:33:17 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5bdcb4a-d8e4-478f-b9a0-e3320e24bf0b tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ad1b4b19-ad16-436c-9fa3-e718bea4f540] added
Aug 26 10:33:17 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:33:17 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad1b4b19-ad16-436c-9fa3-e718bea4f540 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:33:17 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad1b4b19-ad16-436c-9fa3-e718bea4f540 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.078s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:33:17 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[c83e7a9d-2904-4a51-b8b8-f2992fb27ee1]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:33:17 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5bdcb4a-d8e4-478f-b9a0-e3320e24bf0b tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:33:17 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad1b4b19-ad16-436c-9fa3-e718bea4f540 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:33:17 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad1b4b19-ad16-436c-9fa3-e718bea4f540 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:33:17 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f426295-101f-448b-9814-5f15ecbceecd]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:33:17 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5bdcb4a-d8e4-478f-b9a0-e3320e24bf0b tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:33:17 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad1b4b19-ad16-436c-9fa3-e718bea4f540 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RjYPMhzx {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:33:17 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad1b4b19-ad16-436c-9fa3-e718bea4f540 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RjYPMhzx" returned: 0 in 0.018s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:33:17 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ce58b08-5f34-41ac-a192-bf5941fe7e02]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:33:17 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5bdcb4a-d8e4-478f-b9a0-e3320e24bf0b tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RjYPMhzx'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:33:17 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad1b4b19-ad16-436c-9fa3-e718bea4f540 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:33:17 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad1b4b19-ad16-436c-9fa3-e718bea4f540 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:33:17 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[b39a8bd4-46df-4668-afdc-cff842ce5c96]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:33:17 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5bdcb4a-d8e4-478f-b9a0-e3320e24bf0b tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:33:17 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:33:17 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:33:17 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b7231e6-66fe-478c-b27e-e146a043d052]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8aa6fc0-ce50-4db6-8d7d-9f37eae07207 (non-flash)\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:33:17 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5bdcb4a-d8e4-478f-b9a0-e3320e24bf0b tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8aa6fc0-ce50-4db6-8d7d-9f37eae07207 (non-flash)
Aug 26 10:33:17 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 10:33:17 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5bdcb4a-d8e4-478f-b9a0-e3320e24bf0b tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8aa6fc0-ce50-4db6-8d7d-9f37eae07207 (non-flash)
Aug 26 10:33:17 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 10:33:17 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad1b4b19-ad16-436c-9fa3-e718bea4f540 -p 172.16.0.220:3260 --login {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:33:17 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad1b4b19-ad16-436c-9fa3-e718bea4f540 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:33:17 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[c24b4ad8-51d0-469f-963b-96ceca505398]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ad1b4b19-ad16-436c-9fa3-e718bea4f540, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ad1b4b19-ad16-436c-9fa3-e718bea4f540, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:33:17 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5bdcb4a-d8e4-478f-b9a0-e3320e24bf0b tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ad1b4b19-ad16-436c-9fa3-e718bea4f540, portal: 172.16.0.220,3260]
Aug 26 10:33:17 user nova-compute[73572]: Login to [iface: default, target: iqn.2010-10.org.openstack:ad1b4b19-ad16-436c-9fa3-e718bea4f540, portal: 172.16.0.220,3260] successful.
Aug 26 10:33:17 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:33:17 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad1b4b19-ad16-436c-9fa3-e718bea4f540 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:33:17 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad1b4b19-ad16-436c-9fa3-e718bea4f540 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:33:17 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4c242c2-45ab-4ddc-8b57-bf010e7209e8]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:33:17 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5bdcb4a-d8e4-478f-b9a0-e3320e24bf0b tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:33:17 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:33:17 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:33:17 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[96d1e8ee-a533-4f65-a76f-d6291299afd4]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8aa6fc0-ce50-4db6-8d7d-9f37eae07207 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad1b4b19-ad16-436c-9fa3-e718bea4f540 (non-flash)\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:33:17 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5bdcb4a-d8e4-478f-b9a0-e3320e24bf0b tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8aa6fc0-ce50-4db6-8d7d-9f37eae07207 (non-flash)
Aug 26 10:33:17 user nova-compute[73572]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad1b4b19-ad16-436c-9fa3-e718bea4f540 (non-flash)
Aug 26 10:33:17 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 10:33:17 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5bdcb4a-d8e4-478f-b9a0-e3320e24bf0b tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8aa6fc0-ce50-4db6-8d7d-9f37eae07207 (non-flash)
Aug 26 10:33:17 user nova-compute[73572]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad1b4b19-ad16-436c-9fa3-e718bea4f540 (non-flash)
Aug 26 10:33:17 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 10:33:17 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-c5bdcb4a-d8e4-478f-b9a0-e3320e24bf0b tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ad1b4b19-ad16-436c-9fa3-e718bea4f540" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.330s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 10:33:17 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5bdcb4a-d8e4-478f-b9a0-e3320e24bf0b tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Connected to 172.16.0.220:3260 {{(pid=73572) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 10:33:17 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-c5bdcb4a-d8e4-478f-b9a0-e3320e24bf0b tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] HCTL ('33', '-', '-', 0) found on session 48 with lun 0 {{(pid=73572) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 10:33:17 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-c5bdcb4a-d8e4-478f-b9a0-e3320e24bf0b tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73572) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 10:33:17 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:33:17 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.022s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:33:17 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebda235c-7edc-4046-8777-c212ce0fe14a]: (4, ('- - 0', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:33:17 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-c5bdcb4a-d8e4-478f-b9a0-e3320e24bf0b tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Searching for a device in session 48 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73572) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 10:33:17 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5bdcb4a-d8e4-478f-b9a0-e3320e24bf0b tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RjYPMhzx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73572) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 10:33:18 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-c5bdcb4a-d8e4-478f-b9a0-e3320e24bf0b tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.366s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 10:33:18 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5bdcb4a-d8e4-478f-b9a0-e3320e24bf0b tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] <== connect_volume: return (1367ms) {'type': 'block', 'scsi_wwn': '26462343434393732', 'path': '/dev/sdb'} {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 10:33:18 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c5bdcb4a-d8e4-478f-b9a0-e3320e24bf0b tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 7e3fd7ab-91ae-48b9-b436-b154c332869c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26462343434393732', 'path': '/dev/sdb'} {{(pid=73572) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 10:33:18 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-c5bdcb4a-d8e4-478f-b9a0-e3320e24bf0b tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T10:32:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-269697355',display_name='tempest-TestVolumeBootPattern-server-269697355',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-269697355',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGgJMPcylFVXjDKqyW+etneKzTtQZ3h+rrNV9oGL9oH9Pq5o1BgNVxyCABCwPtuWnsI0hTQA59VGxuIY4NbTGf1rbJaGRZw/AtW9ND3j+IG9u2og6CdZ4G3lJYm/FnK6hA==',key_name='tempest-TestVolumeBootPattern-2036222457',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cfc130586d9f4581953f1b8ae1c4465e',ramdisk_id='',reservation_id='r-9we1oi5o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-73786062',owner_user_name='tempest-TestVolumeBootPattern-73786062-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T10:32:45Z,user_data=None,user_id='e1e80942e5db41c782bda686b10e2e4b',uuid=7e3fd7ab-91ae-48b9-b436-b154c332869c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "47c9677e-a234-4f8f-8cdc-5f1fdb21c760", "address": "fa:16:3e:0d:dd:ea", "network": {"id": "c520ee18-34a7-4781-bc97-419e9a702d40", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-280196989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfc130586d9f4581953f1b8ae1c4465e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47c9677e-a2", "ovs_interfaceid": "47c9677e-a234-4f8f-8cdc-5f1fdb21c760", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73572) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 10:33:18 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-c5bdcb4a-d8e4-478f-b9a0-e3320e24bf0b tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Converting VIF {"id": "47c9677e-a234-4f8f-8cdc-5f1fdb21c760", "address": "fa:16:3e:0d:dd:ea", "network": {"id": "c520ee18-34a7-4781-bc97-419e9a702d40", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-280196989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfc130586d9f4581953f1b8ae1c4465e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47c9677e-a2", "ovs_interfaceid": "47c9677e-a234-4f8f-8cdc-5f1fdb21c760", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:33:18 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-c5bdcb4a-d8e4-478f-b9a0-e3320e24bf0b tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:dd:ea,bridge_name='br-int',has_traffic_filtering=True,id=47c9677e-a234-4f8f-8cdc-5f1fdb21c760,network=Network(c520ee18-34a7-4781-bc97-419e9a702d40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47c9677e-a2') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:33:18 user nova-compute[73572]: DEBUG nova.objects.instance [None req-c5bdcb4a-d8e4-478f-b9a0-e3320e24bf0b tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Lazy-loading 'pci_devices' on Instance uuid 7e3fd7ab-91ae-48b9-b436-b154c332869c {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:33:18 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-c5bdcb4a-d8e4-478f-b9a0-e3320e24bf0b tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 7e3fd7ab-91ae-48b9-b436-b154c332869c] End _get_guest_xml xml=<domain type="kvm">
Aug 26 10:33:18 user nova-compute[73572]:   <uuid>7e3fd7ab-91ae-48b9-b436-b154c332869c</uuid>
Aug 26 10:33:18 user nova-compute[73572]:   <name>instance-0000002c</name>
Aug 26 10:33:18 user nova-compute[73572]:   <memory>524288</memory>
Aug 26 10:33:18 user nova-compute[73572]:   <vcpu>1</vcpu>
Aug 26 10:33:18 user nova-compute[73572]:   <metadata>
Aug 26 10:33:18 user nova-compute[73572]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 10:33:18 user nova-compute[73572]:       <nova:package version="0.0.0"/>
Aug 26 10:33:18 user nova-compute[73572]:       <nova:name>tempest-TestVolumeBootPattern-server-269697355</nova:name>
Aug 26 10:33:18 user nova-compute[73572]:       <nova:creationTime>2023-08-26 10:33:17</nova:creationTime>
Aug 26 10:33:18 user nova-compute[73572]:       <nova:flavor name="m1.tiny">
Aug 26 10:33:18 user nova-compute[73572]:         <nova:memory>512</nova:memory>
Aug 26 10:33:18 user nova-compute[73572]:         <nova:disk>1</nova:disk>
Aug 26 10:33:18 user nova-compute[73572]:         <nova:swap>0</nova:swap>
Aug 26 10:33:18 user nova-compute[73572]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 10:33:18 user nova-compute[73572]:         <nova:vcpus>1</nova:vcpus>
Aug 26 10:33:18 user nova-compute[73572]:       </nova:flavor>
Aug 26 10:33:18 user nova-compute[73572]:       <nova:owner>
Aug 26 10:33:18 user nova-compute[73572]:         <nova:user uuid="e1e80942e5db41c782bda686b10e2e4b">tempest-TestVolumeBootPattern-73786062-project-member</nova:user>
Aug 26 10:33:18 user nova-compute[73572]:         <nova:project uuid="cfc130586d9f4581953f1b8ae1c4465e">tempest-TestVolumeBootPattern-73786062</nova:project>
Aug 26 10:33:18 user nova-compute[73572]:       </nova:owner>
Aug 26 10:33:18 user nova-compute[73572]:       <nova:ports>
Aug 26 10:33:18 user nova-compute[73572]:         <nova:port uuid="47c9677e-a234-4f8f-8cdc-5f1fdb21c760">
Aug 26 10:33:18 user nova-compute[73572]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 26 10:33:18 user nova-compute[73572]:         </nova:port>
Aug 26 10:33:18 user nova-compute[73572]:       </nova:ports>
Aug 26 10:33:18 user nova-compute[73572]:     </nova:instance>
Aug 26 10:33:18 user nova-compute[73572]:   </metadata>
Aug 26 10:33:18 user nova-compute[73572]:   <sysinfo type="smbios">
Aug 26 10:33:18 user nova-compute[73572]:     <system>
Aug 26 10:33:18 user nova-compute[73572]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 10:33:18 user nova-compute[73572]:       <entry name="product">OpenStack Nova</entry>
Aug 26 10:33:18 user nova-compute[73572]:       <entry name="version">0.0.0</entry>
Aug 26 10:33:18 user nova-compute[73572]:       <entry name="serial">7e3fd7ab-91ae-48b9-b436-b154c332869c</entry>
Aug 26 10:33:18 user nova-compute[73572]:       <entry name="uuid">7e3fd7ab-91ae-48b9-b436-b154c332869c</entry>
Aug 26 10:33:18 user nova-compute[73572]:       <entry name="family">Virtual Machine</entry>
Aug 26 10:33:18 user nova-compute[73572]:     </system>
Aug 26 10:33:18 user nova-compute[73572]:   </sysinfo>
Aug 26 10:33:18 user nova-compute[73572]:   <os>
Aug 26 10:33:18 user nova-compute[73572]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 10:33:18 user nova-compute[73572]:     <boot dev="hd"/>
Aug 26 10:33:18 user nova-compute[73572]:     <smbios mode="sysinfo"/>
Aug 26 10:33:18 user nova-compute[73572]:   </os>
Aug 26 10:33:18 user nova-compute[73572]:   <features>
Aug 26 10:33:18 user nova-compute[73572]:     <acpi/>
Aug 26 10:33:18 user nova-compute[73572]:     <apic/>
Aug 26 10:33:18 user nova-compute[73572]:     <vmcoreinfo/>
Aug 26 10:33:18 user nova-compute[73572]:   </features>
Aug 26 10:33:18 user nova-compute[73572]:   <clock offset="utc">
Aug 26 10:33:18 user nova-compute[73572]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 10:33:18 user nova-compute[73572]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 10:33:18 user nova-compute[73572]:     <timer name="hpet" present="no"/>
Aug 26 10:33:18 user nova-compute[73572]:   </clock>
Aug 26 10:33:18 user nova-compute[73572]:   <cpu mode="custom" match="exact">
Aug 26 10:33:18 user nova-compute[73572]:     <model>Nehalem</model>
Aug 26 10:33:18 user nova-compute[73572]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 10:33:18 user nova-compute[73572]:   </cpu>
Aug 26 10:33:18 user nova-compute[73572]:   <devices>
Aug 26 10:33:18 user nova-compute[73572]:     <disk type="block" device="disk">
Aug 26 10:33:18 user nova-compute[73572]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 10:33:18 user nova-compute[73572]:       <source dev="/dev/sdb"/>
Aug 26 10:33:18 user nova-compute[73572]:       <target dev="vda" bus="virtio"/>
Aug 26 10:33:18 user nova-compute[73572]:       <serial>ad1b4b19-ad16-436c-9fa3-e718bea4f540</serial>
Aug 26 10:33:18 user nova-compute[73572]:     </disk>
Aug 26 10:33:18 user nova-compute[73572]:     <interface type="ethernet">
Aug 26 10:33:18 user nova-compute[73572]:       <mac address="fa:16:3e:0d:dd:ea"/>
Aug 26 10:33:18 user nova-compute[73572]:       <model type="virtio"/>
Aug 26 10:33:18 user nova-compute[73572]:       <mtu size="1442"/>
Aug 26 10:33:18 user nova-compute[73572]:       <target dev="tap47c9677e-a2"/>
Aug 26 10:33:18 user nova-compute[73572]:     </interface>
Aug 26 10:33:18 user nova-compute[73572]:     <serial type="pty">
Aug 26 10:33:18 user nova-compute[73572]:       <log file="/opt/stack/data/nova/instances/7e3fd7ab-91ae-48b9-b436-b154c332869c/console.log" append="off"/>
Aug 26 10:33:18 user nova-compute[73572]:     </serial>
Aug 26 10:33:18 user nova-compute[73572]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 10:33:18 user nova-compute[73572]:     <video>
Aug 26 10:33:18 user nova-compute[73572]:       <model type="virtio"/>
Aug 26 10:33:18 user nova-compute[73572]:     </video>
Aug 26 10:33:18 user nova-compute[73572]:     <rng model="virtio">
Aug 26 10:33:18 user nova-compute[73572]:       <backend model="random">/dev/urandom</backend>
Aug 26 10:33:18 user nova-compute[73572]:     </rng>
Aug 26 10:33:18 user nova-compute[73572]:     <controller type="usb" index="0" model="none"/>
Aug 26 10:33:18 user nova-compute[73572]:     <memballoon model="virtio">
Aug 26 10:33:18 user nova-compute[73572]:       <stats period="10"/>
Aug 26 10:33:18 user nova-compute[73572]:     </memballoon>
Aug 26 10:33:18 user nova-compute[73572]:   </devices>
Aug 26 10:33:18 user nova-compute[73572]: </domain>
Aug 26 10:33:18 user nova-compute[73572]:  {{(pid=73572) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 10:33:18 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-c5bdcb4a-d8e4-478f-b9a0-e3320e24bf0b tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T10:32:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-269697355',display_name='tempest-TestVolumeBootPattern-server-269697355',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-269697355',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGgJMPcylFVXjDKqyW+etneKzTtQZ3h+rrNV9oGL9oH9Pq5o1BgNVxyCABCwPtuWnsI0hTQA59VGxuIY4NbTGf1rbJaGRZw/AtW9ND3j+IG9u2og6CdZ4G3lJYm/FnK6hA==',key_name='tempest-TestVolumeBootPattern-2036222457',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cfc130586d9f4581953f1b8ae1c4465e',ramdisk_id='',reservation_id='r-9we1oi5o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-73786062',owner_user_name='tempest-TestVolumeBootPattern-73786062-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T10:32:45Z,user_data=None,user_id='e1e80942e5db41c782bda686b10e2e4b',uuid=7e3fd7ab-91ae-48b9-b436-b154c332869c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "47c9677e-a234-4f8f-8cdc-5f1fdb21c760", "address": "fa:16:3e:0d:dd:ea", "network": {"id": "c520ee18-34a7-4781-bc97-419e9a702d40", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-280196989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfc130586d9f4581953f1b8ae1c4465e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47c9677e-a2", "ovs_interfaceid": "47c9677e-a234-4f8f-8cdc-5f1fdb21c760", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 10:33:18 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-c5bdcb4a-d8e4-478f-b9a0-e3320e24bf0b tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Converting VIF {"id": "47c9677e-a234-4f8f-8cdc-5f1fdb21c760", "address": "fa:16:3e:0d:dd:ea", "network": {"id": "c520ee18-34a7-4781-bc97-419e9a702d40", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-280196989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfc130586d9f4581953f1b8ae1c4465e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47c9677e-a2", "ovs_interfaceid": "47c9677e-a234-4f8f-8cdc-5f1fdb21c760", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:33:18 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-c5bdcb4a-d8e4-478f-b9a0-e3320e24bf0b tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:dd:ea,bridge_name='br-int',has_traffic_filtering=True,id=47c9677e-a234-4f8f-8cdc-5f1fdb21c760,network=Network(c520ee18-34a7-4781-bc97-419e9a702d40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47c9677e-a2') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:33:18 user nova-compute[73572]: DEBUG os_vif [None req-c5bdcb4a-d8e4-478f-b9a0-e3320e24bf0b tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:dd:ea,bridge_name='br-int',has_traffic_filtering=True,id=47c9677e-a234-4f8f-8cdc-5f1fdb21c760,network=Network(c520ee18-34a7-4781-bc97-419e9a702d40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47c9677e-a2') {{(pid=73572) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 10:33:18 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:33:18 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:33:18 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 10:33:18 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:33:18 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap47c9677e-a2, may_exist=True, interface_attrs={}) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:33:18 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap47c9677e-a2, col_values=(('external_ids', {'iface-id': '47c9677e-a234-4f8f-8cdc-5f1fdb21c760', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0d:dd:ea', 'vm-uuid': '7e3fd7ab-91ae-48b9-b436-b154c332869c'}),), if_exists=True) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:33:18 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:33:18 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:33:18 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:33:18 user nova-compute[73572]: INFO os_vif [None req-c5bdcb4a-d8e4-478f-b9a0-e3320e24bf0b tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:dd:ea,bridge_name='br-int',has_traffic_filtering=True,id=47c9677e-a234-4f8f-8cdc-5f1fdb21c760,network=Network(c520ee18-34a7-4781-bc97-419e9a702d40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47c9677e-a2')
Aug 26 10:33:18 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-c5bdcb4a-d8e4-478f-b9a0-e3320e24bf0b tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] No BDM found with device name vda, not building metadata. {{(pid=73572) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 10:33:18 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-c5bdcb4a-d8e4-478f-b9a0-e3320e24bf0b tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] No VIF found with MAC fa:16:3e:0d:dd:ea, not building metadata {{(pid=73572) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 10:33:20 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:33:20 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:33:20 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:33:20 user nova-compute[73572]: DEBUG nova.compute.manager [req-58f3058e-7e1f-4822-9284-62783693727f req-fcb91ca2-641e-4039-bc89-cb7436f3df1d service nova] [instance: 7e3fd7ab-91ae-48b9-b436-b154c332869c] Received event network-vif-plugged-47c9677e-a234-4f8f-8cdc-5f1fdb21c760 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:33:20 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-58f3058e-7e1f-4822-9284-62783693727f req-fcb91ca2-641e-4039-bc89-cb7436f3df1d service nova] Acquiring lock "7e3fd7ab-91ae-48b9-b436-b154c332869c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:33:20 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-58f3058e-7e1f-4822-9284-62783693727f req-fcb91ca2-641e-4039-bc89-cb7436f3df1d service nova] Lock "7e3fd7ab-91ae-48b9-b436-b154c332869c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:33:20 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-58f3058e-7e1f-4822-9284-62783693727f req-fcb91ca2-641e-4039-bc89-cb7436f3df1d service nova] Lock "7e3fd7ab-91ae-48b9-b436-b154c332869c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:33:20 user nova-compute[73572]: DEBUG nova.compute.manager [req-58f3058e-7e1f-4822-9284-62783693727f req-fcb91ca2-641e-4039-bc89-cb7436f3df1d service nova] [instance: 7e3fd7ab-91ae-48b9-b436-b154c332869c] No waiting events found dispatching network-vif-plugged-47c9677e-a234-4f8f-8cdc-5f1fdb21c760 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:33:20 user nova-compute[73572]: WARNING nova.compute.manager [req-58f3058e-7e1f-4822-9284-62783693727f req-fcb91ca2-641e-4039-bc89-cb7436f3df1d service nova] [instance: 7e3fd7ab-91ae-48b9-b436-b154c332869c] Received unexpected event network-vif-plugged-47c9677e-a234-4f8f-8cdc-5f1fdb21c760 for instance with vm_state building and task_state spawning.
Aug 26 10:33:20 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:33:20 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:33:20 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:33:21 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:33:21 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Starting heal instance info cache {{(pid=73572) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 10:33:21 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquiring lock "refresh_cache-86923c1a-89a5-4e7a-b488-8bf3a013bf83" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:33:21 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquired lock "refresh_cache-86923c1a-89a5-4e7a-b488-8bf3a013bf83" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:33:21 user nova-compute[73572]: DEBUG nova.network.neutron [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] [instance: 86923c1a-89a5-4e7a-b488-8bf3a013bf83] Forcefully refreshing network info cache for instance {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 10:33:22 user nova-compute[73572]: DEBUG nova.virt.driver [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Emitting event <LifecycleEvent: 1693046002.337137, 7e3fd7ab-91ae-48b9-b436-b154c332869c => Resumed> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:33:22 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 7e3fd7ab-91ae-48b9-b436-b154c332869c] VM Resumed (Lifecycle Event)
Aug 26 10:33:22 user nova-compute[73572]: DEBUG nova.compute.manager [None req-c5bdcb4a-d8e4-478f-b9a0-e3320e24bf0b tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 7e3fd7ab-91ae-48b9-b436-b154c332869c] Instance event wait completed in 0 seconds for  {{(pid=73572) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 10:33:22 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-c5bdcb4a-d8e4-478f-b9a0-e3320e24bf0b tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 7e3fd7ab-91ae-48b9-b436-b154c332869c] Guest created on hypervisor {{(pid=73572) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 10:33:22 user nova-compute[73572]: INFO nova.virt.libvirt.driver [-] [instance: 7e3fd7ab-91ae-48b9-b436-b154c332869c] Instance spawned successfully.
Aug 26 10:33:22 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-c5bdcb4a-d8e4-478f-b9a0-e3320e24bf0b tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 7e3fd7ab-91ae-48b9-b436-b154c332869c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 10:33:22 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 7e3fd7ab-91ae-48b9-b436-b154c332869c] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:33:22 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 7e3fd7ab-91ae-48b9-b436-b154c332869c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73572) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 10:33:22 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-c5bdcb4a-d8e4-478f-b9a0-e3320e24bf0b tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 7e3fd7ab-91ae-48b9-b436-b154c332869c] Found default for hw_cdrom_bus of ide {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:33:22 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-c5bdcb4a-d8e4-478f-b9a0-e3320e24bf0b tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 7e3fd7ab-91ae-48b9-b436-b154c332869c] Found default for hw_disk_bus of virtio {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:33:22 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-c5bdcb4a-d8e4-478f-b9a0-e3320e24bf0b tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 7e3fd7ab-91ae-48b9-b436-b154c332869c] Found default for hw_input_bus of None {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:33:22 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-c5bdcb4a-d8e4-478f-b9a0-e3320e24bf0b tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 7e3fd7ab-91ae-48b9-b436-b154c332869c] Found default for hw_pointer_model of None {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:33:22 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-c5bdcb4a-d8e4-478f-b9a0-e3320e24bf0b tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 7e3fd7ab-91ae-48b9-b436-b154c332869c] Found default for hw_video_model of virtio {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:33:22 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-c5bdcb4a-d8e4-478f-b9a0-e3320e24bf0b tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 7e3fd7ab-91ae-48b9-b436-b154c332869c] Found default for hw_vif_model of virtio {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:33:22 user nova-compute[73572]: DEBUG nova.network.neutron [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] [instance: 86923c1a-89a5-4e7a-b488-8bf3a013bf83] Updating instance_info_cache with network_info: [{"id": "db682944-8949-4bf9-b9d5-2213f0d507bc", "address": "fa:16:3e:7d:b9:15", "network": {"id": "757e71b4-5177-45a5-8ef5-9b27f42092f1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1765327616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1bff48d66894950ac6690e1fd0e79b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb682944-89", "ovs_interfaceid": "db682944-8949-4bf9-b9d5-2213f0d507bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:33:22 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 7e3fd7ab-91ae-48b9-b436-b154c332869c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 10:33:22 user nova-compute[73572]: DEBUG nova.virt.driver [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Emitting event <LifecycleEvent: 1693046002.3387804, 7e3fd7ab-91ae-48b9-b436-b154c332869c => Started> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:33:22 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 7e3fd7ab-91ae-48b9-b436-b154c332869c] VM Started (Lifecycle Event)
Aug 26 10:33:22 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Releasing lock "refresh_cache-86923c1a-89a5-4e7a-b488-8bf3a013bf83" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:33:22 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] [instance: 86923c1a-89a5-4e7a-b488-8bf3a013bf83] Updated the network info_cache for instance {{(pid=73572) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 10:33:22 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 7e3fd7ab-91ae-48b9-b436-b154c332869c] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:33:22 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 7e3fd7ab-91ae-48b9-b436-b154c332869c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73572) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 10:33:22 user nova-compute[73572]: DEBUG nova.compute.manager [req-6bffcb3a-4ac3-47bd-8b65-6ede7f05840c req-b24d8765-f2ba-45f7-970d-fa2cee4ac40e service nova] [instance: 7e3fd7ab-91ae-48b9-b436-b154c332869c] Received event network-vif-plugged-47c9677e-a234-4f8f-8cdc-5f1fdb21c760 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:33:22 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-6bffcb3a-4ac3-47bd-8b65-6ede7f05840c req-b24d8765-f2ba-45f7-970d-fa2cee4ac40e service nova] Acquiring lock "7e3fd7ab-91ae-48b9-b436-b154c332869c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:33:22 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-6bffcb3a-4ac3-47bd-8b65-6ede7f05840c req-b24d8765-f2ba-45f7-970d-fa2cee4ac40e service nova] Lock "7e3fd7ab-91ae-48b9-b436-b154c332869c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:33:22 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-6bffcb3a-4ac3-47bd-8b65-6ede7f05840c req-b24d8765-f2ba-45f7-970d-fa2cee4ac40e service nova] Lock "7e3fd7ab-91ae-48b9-b436-b154c332869c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:33:22 user nova-compute[73572]: DEBUG nova.compute.manager [req-6bffcb3a-4ac3-47bd-8b65-6ede7f05840c req-b24d8765-f2ba-45f7-970d-fa2cee4ac40e service nova] [instance: 7e3fd7ab-91ae-48b9-b436-b154c332869c] No waiting events found dispatching network-vif-plugged-47c9677e-a234-4f8f-8cdc-5f1fdb21c760 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:33:22 user nova-compute[73572]: WARNING nova.compute.manager [req-6bffcb3a-4ac3-47bd-8b65-6ede7f05840c req-b24d8765-f2ba-45f7-970d-fa2cee4ac40e service nova] [instance: 7e3fd7ab-91ae-48b9-b436-b154c332869c] Received unexpected event network-vif-plugged-47c9677e-a234-4f8f-8cdc-5f1fdb21c760 for instance with vm_state building and task_state spawning.
Aug 26 10:33:22 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 7e3fd7ab-91ae-48b9-b436-b154c332869c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 10:33:22 user nova-compute[73572]: INFO nova.compute.manager [None req-c5bdcb4a-d8e4-478f-b9a0-e3320e24bf0b tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 7e3fd7ab-91ae-48b9-b436-b154c332869c] Took 5.24 seconds to spawn the instance on the hypervisor.
Aug 26 10:33:22 user nova-compute[73572]: DEBUG nova.compute.manager [None req-c5bdcb4a-d8e4-478f-b9a0-e3320e24bf0b tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 7e3fd7ab-91ae-48b9-b436-b154c332869c] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:33:22 user nova-compute[73572]: INFO nova.compute.manager [None req-c5bdcb4a-d8e4-478f-b9a0-e3320e24bf0b tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 7e3fd7ab-91ae-48b9-b436-b154c332869c] Took 37.87 seconds to build instance.
Aug 26 10:33:22 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-c5bdcb4a-d8e4-478f-b9a0-e3320e24bf0b tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Lock "7e3fd7ab-91ae-48b9-b436-b154c332869c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 37.985s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:33:23 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:33:24 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:33:25 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:33:25 user nova-compute[73572]: DEBUG nova.compute.manager [None req-41398841-72e2-4589-a1c1-b844aa547ba3 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] [instance: c457a41c-2ee2-4821-94cf-69c091589241] Start spawning the instance on the hypervisor. {{(pid=73572) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 10:33:25 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-41398841-72e2-4589-a1c1-b844aa547ba3 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] [instance: c457a41c-2ee2-4821-94cf-69c091589241] Creating instance directory {{(pid=73572) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 10:33:25 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-41398841-72e2-4589-a1c1-b844aa547ba3 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] [instance: c457a41c-2ee2-4821-94cf-69c091589241] Creating image(s)
Aug 26 10:33:25 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-41398841-72e2-4589-a1c1-b844aa547ba3 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] [instance: c457a41c-2ee2-4821-94cf-69c091589241] Did not create local disks {{(pid=73572) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 26 10:33:25 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-41398841-72e2-4589-a1c1-b844aa547ba3 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] [instance: c457a41c-2ee2-4821-94cf-69c091589241] Ensure instance console log exists: /opt/stack/data/nova/instances/c457a41c-2ee2-4821-94cf-69c091589241/console.log {{(pid=73572) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 10:33:25 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-41398841-72e2-4589-a1c1-b844aa547ba3 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:33:25 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-41398841-72e2-4589-a1c1-b844aa547ba3 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:33:25 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-41398841-72e2-4589-a1c1-b844aa547ba3 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:33:25 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-41398841-72e2-4589-a1c1-b844aa547ba3 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] [instance: c457a41c-2ee2-4821-94cf-69c091589241] Start _get_guest_xml network_info=[{"id": "deb899b2-ba04-427b-b4ea-a514b8eda260", "address": "fa:16:3e:05:c8:e3", "network": {"id": "43215883-3d00-4be7-8c40-bdaf3f01bef9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1088544153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7935bccc360b46b589fd57d53f334595", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdeb899b2-ba", "ovs_interfaceid": "deb899b2-ba04-427b-b4ea-a514b8eda260", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'disk_bus': 'virtio', 'boot_index': 0, 'mount_device': '/dev/vda', 'attachment_id': '3bf9b9f7-958a-4db3-be59-e4086a1c5f06', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:6c17592e-3227-473f-ac7b-3e911dcb0d56'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QlxWrapc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c457a41c-2ee2-4821-94cf-69c091589241', 'attached_at': '', 'detached_at': '', 'volume_id': '6c17592e-3227-473f-ac7b-3e911dcb0d56', 'serial': '6c17592e-3227-473f-ac7b-3e911dcb0d56'}, 'guest_format': None, 'device_type': 'disk', 'volume_type': None} {{(pid=73572) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 10:33:25 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-41398841-72e2-4589-a1c1-b844aa547ba3 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:33:25 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-41398841-72e2-4589-a1c1-b844aa547ba3 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:33:25 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-41398841-72e2-4589-a1c1-b844aa547ba3 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73572) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 10:33:25 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-41398841-72e2-4589-a1c1-b844aa547ba3 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] CPU controller missing on host. {{(pid=73572) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 10:33:25 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-41398841-72e2-4589-a1c1-b844aa547ba3 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73572) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 10:33:25 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-41398841-72e2-4589-a1c1-b844aa547ba3 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] CPU controller found on host. {{(pid=73572) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 10:33:25 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-41398841-72e2-4589-a1c1-b844aa547ba3 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73572) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 10:33:25 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-41398841-72e2-4589-a1c1-b844aa547ba3 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T10:07:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 10:33:25 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-41398841-72e2-4589-a1c1-b844aa547ba3 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Flavor limits 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 10:33:25 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-41398841-72e2-4589-a1c1-b844aa547ba3 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Image limits 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 10:33:25 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-41398841-72e2-4589-a1c1-b844aa547ba3 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Flavor pref 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 10:33:25 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-41398841-72e2-4589-a1c1-b844aa547ba3 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Image pref 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 10:33:25 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-41398841-72e2-4589-a1c1-b844aa547ba3 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 10:33:25 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-41398841-72e2-4589-a1c1-b844aa547ba3 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 10:33:25 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-41398841-72e2-4589-a1c1-b844aa547ba3 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73572) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 10:33:25 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-41398841-72e2-4589-a1c1-b844aa547ba3 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Got 1 possible topologies {{(pid=73572) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 10:33:25 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-41398841-72e2-4589-a1c1-b844aa547ba3 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 10:33:25 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-41398841-72e2-4589-a1c1-b844aa547ba3 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 10:33:25 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-41398841-72e2-4589-a1c1-b844aa547ba3 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] [instance: c457a41c-2ee2-4821-94cf-69c091589241] Calling os-brick to attach iSCSI Volume {{(pid=73572) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 10:33:25 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-41398841-72e2-4589-a1c1-b844aa547ba3 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc89c3d6a10>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:6c17592e-3227-473f-ac7b-3e911dcb0d56'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QlxWrapc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 10:33:25 user nova-compute[73572]: WARNING os_brick.initiator.connectors.base [None req-41398841-72e2-4589-a1c1-b844aa547ba3 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 10:33:25 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-41398841-72e2-4589-a1c1-b844aa547ba3 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 10:33:25 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-41398841-72e2-4589-a1c1-b844aa547ba3 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 10:33:25 user nova-compute[73572]: WARNING os_brick.initiator.connectors.base [None req-41398841-72e2-4589-a1c1-b844aa547ba3 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 10:33:25 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-41398841-72e2-4589-a1c1-b844aa547ba3 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6c17592e-3227-473f-ac7b-3e911dcb0d56" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 10:33:25 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-41398841-72e2-4589-a1c1-b844aa547ba3 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6c17592e-3227-473f-ac7b-3e911dcb0d56" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 10:33:25 user nova-compute[73572]: INFO os_brick.initiator.connectors.iscsi [None req-41398841-72e2-4589-a1c1-b844aa547ba3 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 10:33:25 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c17592e-3227-473f-ac7b-3e911dcb0d56 -p 172.16.0.220:3260 {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:33:25 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c17592e-3227-473f-ac7b-3e911dcb0d56 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:33:25 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[eac4030c-e53a-4f2c-8ddb-3fbbabb3c5d1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:33:25 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-41398841-72e2-4589-a1c1-b844aa547ba3 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 10:33:25 user nova-compute[73572]:  {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:33:25 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c17592e-3227-473f-ac7b-3e911dcb0d56 -p 172.16.0.220:3260 --interface default --op new {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:33:25 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c17592e-3227-473f-ac7b-3e911dcb0d56 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:33:25 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[129f00a1-bddd-4da3-a460-b65e94a77fc9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6c17592e-3227-473f-ac7b-3e911dcb0d56] added\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:33:25 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-41398841-72e2-4589-a1c1-b844aa547ba3 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6c17592e-3227-473f-ac7b-3e911dcb0d56] added
Aug 26 10:33:25 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:33:25 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c17592e-3227-473f-ac7b-3e911dcb0d56 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:33:25 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c17592e-3227-473f-ac7b-3e911dcb0d56 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:33:25 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b711f28-f46e-4305-a367-a01ff97e49d1]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:33:25 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-41398841-72e2-4589-a1c1-b844aa547ba3 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:33:25 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c17592e-3227-473f-ac7b-3e911dcb0d56 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:33:25 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:33:25 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c17592e-3227-473f-ac7b-3e911dcb0d56 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:33:25 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f14fafa-d238-4c10-8960-cd29b2a67ab8]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:33:25 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-41398841-72e2-4589-a1c1-b844aa547ba3 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:33:25 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c17592e-3227-473f-ac7b-3e911dcb0d56 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QlxWrapc {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:33:25 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c17592e-3227-473f-ac7b-3e911dcb0d56 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QlxWrapc" returned: 0 in 0.019s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:33:25 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f029d50-7220-4809-afed-4758b1074e29]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:33:25 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-41398841-72e2-4589-a1c1-b844aa547ba3 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QlxWrapc'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:33:25 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c17592e-3227-473f-ac7b-3e911dcb0d56 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:33:25 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c17592e-3227-473f-ac7b-3e911dcb0d56 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:33:25 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e64dba8-19c5-481a-892a-e12c18cdc22a]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:33:25 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-41398841-72e2-4589-a1c1-b844aa547ba3 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:33:25 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:33:25 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:33:25 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9a3e98d-0b48-45d7-83c9-a7687515ca90]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8aa6fc0-ce50-4db6-8d7d-9f37eae07207 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad1b4b19-ad16-436c-9fa3-e718bea4f540 (non-flash)\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:33:25 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-41398841-72e2-4589-a1c1-b844aa547ba3 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8aa6fc0-ce50-4db6-8d7d-9f37eae07207 (non-flash)
Aug 26 10:33:25 user nova-compute[73572]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad1b4b19-ad16-436c-9fa3-e718bea4f540 (non-flash)
Aug 26 10:33:25 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 10:33:25 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-41398841-72e2-4589-a1c1-b844aa547ba3 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8aa6fc0-ce50-4db6-8d7d-9f37eae07207 (non-flash)
Aug 26 10:33:25 user nova-compute[73572]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad1b4b19-ad16-436c-9fa3-e718bea4f540 (non-flash)
Aug 26 10:33:25 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 10:33:25 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c17592e-3227-473f-ac7b-3e911dcb0d56 -p 172.16.0.220:3260 --login {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:33:25 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c17592e-3227-473f-ac7b-3e911dcb0d56 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:33:25 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9d3310a-47bf-48b6-8426-b1040051efbe]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6c17592e-3227-473f-ac7b-3e911dcb0d56, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6c17592e-3227-473f-ac7b-3e911dcb0d56, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:33:25 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-41398841-72e2-4589-a1c1-b844aa547ba3 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6c17592e-3227-473f-ac7b-3e911dcb0d56, portal: 172.16.0.220,3260]
Aug 26 10:33:25 user nova-compute[73572]: Login to [iface: default, target: iqn.2010-10.org.openstack:6c17592e-3227-473f-ac7b-3e911dcb0d56, portal: 172.16.0.220,3260] successful.
Aug 26 10:33:25 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:33:25 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c17592e-3227-473f-ac7b-3e911dcb0d56 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:33:25 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c17592e-3227-473f-ac7b-3e911dcb0d56 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:33:25 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa0cf593-7403-4e4b-909a-a659ce5a95e7]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:33:25 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-41398841-72e2-4589-a1c1-b844aa547ba3 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:33:25 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:33:26 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:33:26 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[28c2bc01-0a41-4cd7-a1bd-89a30fc15833]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8aa6fc0-ce50-4db6-8d7d-9f37eae07207 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad1b4b19-ad16-436c-9fa3-e718bea4f540 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c17592e-3227-473f-ac7b-3e911dcb0d56 (non-flash)\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:33:26 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-41398841-72e2-4589-a1c1-b844aa547ba3 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8aa6fc0-ce50-4db6-8d7d-9f37eae07207 (non-flash)
Aug 26 10:33:26 user nova-compute[73572]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad1b4b19-ad16-436c-9fa3-e718bea4f540 (non-flash)
Aug 26 10:33:26 user nova-compute[73572]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c17592e-3227-473f-ac7b-3e911dcb0d56 (non-flash)
Aug 26 10:33:26 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 10:33:26 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-41398841-72e2-4589-a1c1-b844aa547ba3 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8aa6fc0-ce50-4db6-8d7d-9f37eae07207 (non-flash)
Aug 26 10:33:26 user nova-compute[73572]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad1b4b19-ad16-436c-9fa3-e718bea4f540 (non-flash)
Aug 26 10:33:26 user nova-compute[73572]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c17592e-3227-473f-ac7b-3e911dcb0d56 (non-flash)
Aug 26 10:33:26 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 10:33:26 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-41398841-72e2-4589-a1c1-b844aa547ba3 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6c17592e-3227-473f-ac7b-3e911dcb0d56" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.289s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 10:33:26 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-41398841-72e2-4589-a1c1-b844aa547ba3 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Connected to 172.16.0.220:3260 {{(pid=73572) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 10:33:26 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-41398841-72e2-4589-a1c1-b844aa547ba3 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] HCTL ('34', '-', '-', 0) found on session 49 with lun 0 {{(pid=73572) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 10:33:26 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-41398841-72e2-4589-a1c1-b844aa547ba3 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73572) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 10:33:26 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:33:26 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:33:26 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[3527dcef-4903-43d8-bf14-8d194eb56634]: (4, ('- - 0', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:33:26 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-41398841-72e2-4589-a1c1-b844aa547ba3 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Searching for a device in session 49 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73572) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 10:33:26 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-41398841-72e2-4589-a1c1-b844aa547ba3 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QlxWrapc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73572) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 10:33:26 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:33:26 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73572) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 10:33:27 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-41398841-72e2-4589-a1c1-b844aa547ba3 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.322s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 10:33:27 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-41398841-72e2-4589-a1c1-b844aa547ba3 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] <== connect_volume: return (1324ms) {'type': 'block', 'scsi_wwn': '26437336165636364', 'path': '/dev/sdc'} {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 10:33:27 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-41398841-72e2-4589-a1c1-b844aa547ba3 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] [instance: c457a41c-2ee2-4821-94cf-69c091589241] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26437336165636364', 'path': '/dev/sdc'} {{(pid=73572) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 10:33:27 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-41398841-72e2-4589-a1c1-b844aa547ba3 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T10:32:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1008830200',display_name='tempest-ServerActionsTestOtherA-server-1008830200',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1008830200',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAGb4Psy4ujnztu6TKM5Yp0ao9Inx8XINL8TB7yqpPrX8pvyhV645/PRion/tWXE5RcABz76j3Pw1BeejHEQh0n16o5OpRaXWd84Wj12hPmfoj80ST4I1EIx+wC0wImDFQ==',key_name='tempest-keypair-598298583',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7935bccc360b46b589fd57d53f334595',ramdisk_id='',reservation_id='r-dee3c84h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-203628695',owner_user_name='tempest-ServerActionsTestOtherA-203628695-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T10:32:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='61b6124f6f6e44c5b2fd0202a15da019',uuid=c457a41c-2ee2-4821-94cf-69c091589241,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "deb899b2-ba04-427b-b4ea-a514b8eda260", "address": "fa:16:3e:05:c8:e3", "network": {"id": "43215883-3d00-4be7-8c40-bdaf3f01bef9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1088544153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7935bccc360b46b589fd57d53f334595", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdeb899b2-ba", "ovs_interfaceid": "deb899b2-ba04-427b-b4ea-a514b8eda260", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73572) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 10:33:27 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-41398841-72e2-4589-a1c1-b844aa547ba3 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Converting VIF {"id": "deb899b2-ba04-427b-b4ea-a514b8eda260", "address": "fa:16:3e:05:c8:e3", "network": {"id": "43215883-3d00-4be7-8c40-bdaf3f01bef9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1088544153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7935bccc360b46b589fd57d53f334595", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdeb899b2-ba", "ovs_interfaceid": "deb899b2-ba04-427b-b4ea-a514b8eda260", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:33:27 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-41398841-72e2-4589-a1c1-b844aa547ba3 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:c8:e3,bridge_name='br-int',has_traffic_filtering=True,id=deb899b2-ba04-427b-b4ea-a514b8eda260,network=Network(43215883-3d00-4be7-8c40-bdaf3f01bef9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdeb899b2-ba') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:33:27 user nova-compute[73572]: DEBUG nova.objects.instance [None req-41398841-72e2-4589-a1c1-b844aa547ba3 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Lazy-loading 'pci_devices' on Instance uuid c457a41c-2ee2-4821-94cf-69c091589241 {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:33:27 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-41398841-72e2-4589-a1c1-b844aa547ba3 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] [instance: c457a41c-2ee2-4821-94cf-69c091589241] End _get_guest_xml xml=<domain type="kvm">
Aug 26 10:33:27 user nova-compute[73572]:   <uuid>c457a41c-2ee2-4821-94cf-69c091589241</uuid>
Aug 26 10:33:27 user nova-compute[73572]:   <name>instance-0000002d</name>
Aug 26 10:33:27 user nova-compute[73572]:   <memory>524288</memory>
Aug 26 10:33:27 user nova-compute[73572]:   <vcpu>1</vcpu>
Aug 26 10:33:27 user nova-compute[73572]:   <metadata>
Aug 26 10:33:27 user nova-compute[73572]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 10:33:27 user nova-compute[73572]:       <nova:package version="0.0.0"/>
Aug 26 10:33:27 user nova-compute[73572]:       <nova:name>tempest-ServerActionsTestOtherA-server-1008830200</nova:name>
Aug 26 10:33:27 user nova-compute[73572]:       <nova:creationTime>2023-08-26 10:33:25</nova:creationTime>
Aug 26 10:33:27 user nova-compute[73572]:       <nova:flavor name="m1.tiny">
Aug 26 10:33:27 user nova-compute[73572]:         <nova:memory>512</nova:memory>
Aug 26 10:33:27 user nova-compute[73572]:         <nova:disk>1</nova:disk>
Aug 26 10:33:27 user nova-compute[73572]:         <nova:swap>0</nova:swap>
Aug 26 10:33:27 user nova-compute[73572]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 10:33:27 user nova-compute[73572]:         <nova:vcpus>1</nova:vcpus>
Aug 26 10:33:27 user nova-compute[73572]:       </nova:flavor>
Aug 26 10:33:27 user nova-compute[73572]:       <nova:owner>
Aug 26 10:33:27 user nova-compute[73572]:         <nova:user uuid="61b6124f6f6e44c5b2fd0202a15da019">tempest-ServerActionsTestOtherA-203628695-project-member</nova:user>
Aug 26 10:33:27 user nova-compute[73572]:         <nova:project uuid="7935bccc360b46b589fd57d53f334595">tempest-ServerActionsTestOtherA-203628695</nova:project>
Aug 26 10:33:27 user nova-compute[73572]:       </nova:owner>
Aug 26 10:33:27 user nova-compute[73572]:       <nova:ports>
Aug 26 10:33:27 user nova-compute[73572]:         <nova:port uuid="deb899b2-ba04-427b-b4ea-a514b8eda260">
Aug 26 10:33:27 user nova-compute[73572]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 26 10:33:27 user nova-compute[73572]:         </nova:port>
Aug 26 10:33:27 user nova-compute[73572]:       </nova:ports>
Aug 26 10:33:27 user nova-compute[73572]:     </nova:instance>
Aug 26 10:33:27 user nova-compute[73572]:   </metadata>
Aug 26 10:33:27 user nova-compute[73572]:   <sysinfo type="smbios">
Aug 26 10:33:27 user nova-compute[73572]:     <system>
Aug 26 10:33:27 user nova-compute[73572]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 10:33:27 user nova-compute[73572]:       <entry name="product">OpenStack Nova</entry>
Aug 26 10:33:27 user nova-compute[73572]:       <entry name="version">0.0.0</entry>
Aug 26 10:33:27 user nova-compute[73572]:       <entry name="serial">c457a41c-2ee2-4821-94cf-69c091589241</entry>
Aug 26 10:33:27 user nova-compute[73572]:       <entry name="uuid">c457a41c-2ee2-4821-94cf-69c091589241</entry>
Aug 26 10:33:27 user nova-compute[73572]:       <entry name="family">Virtual Machine</entry>
Aug 26 10:33:27 user nova-compute[73572]:     </system>
Aug 26 10:33:27 user nova-compute[73572]:   </sysinfo>
Aug 26 10:33:27 user nova-compute[73572]:   <os>
Aug 26 10:33:27 user nova-compute[73572]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 10:33:27 user nova-compute[73572]:     <boot dev="hd"/>
Aug 26 10:33:27 user nova-compute[73572]:     <smbios mode="sysinfo"/>
Aug 26 10:33:27 user nova-compute[73572]:   </os>
Aug 26 10:33:27 user nova-compute[73572]:   <features>
Aug 26 10:33:27 user nova-compute[73572]:     <acpi/>
Aug 26 10:33:27 user nova-compute[73572]:     <apic/>
Aug 26 10:33:27 user nova-compute[73572]:     <vmcoreinfo/>
Aug 26 10:33:27 user nova-compute[73572]:   </features>
Aug 26 10:33:27 user nova-compute[73572]:   <clock offset="utc">
Aug 26 10:33:27 user nova-compute[73572]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 10:33:27 user nova-compute[73572]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 10:33:27 user nova-compute[73572]:     <timer name="hpet" present="no"/>
Aug 26 10:33:27 user nova-compute[73572]:   </clock>
Aug 26 10:33:27 user nova-compute[73572]:   <cpu mode="custom" match="exact">
Aug 26 10:33:27 user nova-compute[73572]:     <model>Nehalem</model>
Aug 26 10:33:27 user nova-compute[73572]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 10:33:27 user nova-compute[73572]:   </cpu>
Aug 26 10:33:27 user nova-compute[73572]:   <devices>
Aug 26 10:33:27 user nova-compute[73572]:     <disk type="block" device="disk">
Aug 26 10:33:27 user nova-compute[73572]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 10:33:27 user nova-compute[73572]:       <source dev="/dev/sdc"/>
Aug 26 10:33:27 user nova-compute[73572]:       <target dev="vda" bus="virtio"/>
Aug 26 10:33:27 user nova-compute[73572]:       <serial>6c17592e-3227-473f-ac7b-3e911dcb0d56</serial>
Aug 26 10:33:27 user nova-compute[73572]:     </disk>
Aug 26 10:33:27 user nova-compute[73572]:     <interface type="ethernet">
Aug 26 10:33:27 user nova-compute[73572]:       <mac address="fa:16:3e:05:c8:e3"/>
Aug 26 10:33:27 user nova-compute[73572]:       <model type="virtio"/>
Aug 26 10:33:27 user nova-compute[73572]:       <mtu size="1442"/>
Aug 26 10:33:27 user nova-compute[73572]:       <target dev="tapdeb899b2-ba"/>
Aug 26 10:33:27 user nova-compute[73572]:     </interface>
Aug 26 10:33:27 user nova-compute[73572]:     <serial type="pty">
Aug 26 10:33:27 user nova-compute[73572]:       <log file="/opt/stack/data/nova/instances/c457a41c-2ee2-4821-94cf-69c091589241/console.log" append="off"/>
Aug 26 10:33:27 user nova-compute[73572]:     </serial>
Aug 26 10:33:27 user nova-compute[73572]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 10:33:27 user nova-compute[73572]:     <video>
Aug 26 10:33:27 user nova-compute[73572]:       <model type="virtio"/>
Aug 26 10:33:27 user nova-compute[73572]:     </video>
Aug 26 10:33:27 user nova-compute[73572]:     <rng model="virtio">
Aug 26 10:33:27 user nova-compute[73572]:       <backend model="random">/dev/urandom</backend>
Aug 26 10:33:27 user nova-compute[73572]:     </rng>
Aug 26 10:33:27 user nova-compute[73572]:     <controller type="usb" index="0" model="none"/>
Aug 26 10:33:27 user nova-compute[73572]:     <memballoon model="virtio">
Aug 26 10:33:27 user nova-compute[73572]:       <stats period="10"/>
Aug 26 10:33:27 user nova-compute[73572]:     </memballoon>
Aug 26 10:33:27 user nova-compute[73572]:   </devices>
Aug 26 10:33:27 user nova-compute[73572]: </domain>
Aug 26 10:33:27 user nova-compute[73572]:  {{(pid=73572) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 10:33:27 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-41398841-72e2-4589-a1c1-b844aa547ba3 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T10:32:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1008830200',display_name='tempest-ServerActionsTestOtherA-server-1008830200',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1008830200',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAGb4Psy4ujnztu6TKM5Yp0ao9Inx8XINL8TB7yqpPrX8pvyhV645/PRion/tWXE5RcABz76j3Pw1BeejHEQh0n16o5OpRaXWd84Wj12hPmfoj80ST4I1EIx+wC0wImDFQ==',key_name='tempest-keypair-598298583',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7935bccc360b46b589fd57d53f334595',ramdisk_id='',reservation_id='r-dee3c84h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-203628695',owner_user_name='tempest-ServerActionsTestOtherA-203628695-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T10:32:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='61b6124f6f6e44c5b2fd0202a15da019',uuid=c457a41c-2ee2-4821-94cf-69c091589241,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "deb899b2-ba04-427b-b4ea-a514b8eda260", "address": "fa:16:3e:05:c8:e3", "network": {"id": "43215883-3d00-4be7-8c40-bdaf3f01bef9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1088544153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7935bccc360b46b589fd57d53f334595", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdeb899b2-ba", "ovs_interfaceid": "deb899b2-ba04-427b-b4ea-a514b8eda260", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 10:33:27 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-41398841-72e2-4589-a1c1-b844aa547ba3 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Converting VIF {"id": "deb899b2-ba04-427b-b4ea-a514b8eda260", "address": "fa:16:3e:05:c8:e3", "network": {"id": "43215883-3d00-4be7-8c40-bdaf3f01bef9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1088544153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7935bccc360b46b589fd57d53f334595", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdeb899b2-ba", "ovs_interfaceid": "deb899b2-ba04-427b-b4ea-a514b8eda260", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:33:27 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-41398841-72e2-4589-a1c1-b844aa547ba3 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:c8:e3,bridge_name='br-int',has_traffic_filtering=True,id=deb899b2-ba04-427b-b4ea-a514b8eda260,network=Network(43215883-3d00-4be7-8c40-bdaf3f01bef9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdeb899b2-ba') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:33:27 user nova-compute[73572]: DEBUG os_vif [None req-41398841-72e2-4589-a1c1-b844aa547ba3 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:c8:e3,bridge_name='br-int',has_traffic_filtering=True,id=deb899b2-ba04-427b-b4ea-a514b8eda260,network=Network(43215883-3d00-4be7-8c40-bdaf3f01bef9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdeb899b2-ba') {{(pid=73572) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 10:33:27 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:33:27 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:33:27 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 10:33:27 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:33:27 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdeb899b2-ba, may_exist=True, interface_attrs={}) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:33:27 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapdeb899b2-ba, col_values=(('external_ids', {'iface-id': 'deb899b2-ba04-427b-b4ea-a514b8eda260', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:05:c8:e3', 'vm-uuid': 'c457a41c-2ee2-4821-94cf-69c091589241'}),), if_exists=True) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:33:27 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:33:27 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:33:27 user nova-compute[73572]: INFO os_vif [None req-41398841-72e2-4589-a1c1-b844aa547ba3 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:c8:e3,bridge_name='br-int',has_traffic_filtering=True,id=deb899b2-ba04-427b-b4ea-a514b8eda260,network=Network(43215883-3d00-4be7-8c40-bdaf3f01bef9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdeb899b2-ba')
Aug 26 10:33:27 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-41398841-72e2-4589-a1c1-b844aa547ba3 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] No BDM found with device name vda, not building metadata. {{(pid=73572) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 10:33:27 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-41398841-72e2-4589-a1c1-b844aa547ba3 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] No VIF found with MAC fa:16:3e:05:c8:e3, not building metadata {{(pid=73572) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 10:33:27 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:33:28 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:33:28 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:33:28 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:33:28 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:33:28 user nova-compute[73572]: DEBUG nova.compute.manager [req-7ef43afd-5036-4b4b-8c3e-4f62152c0c6c req-e3beeb6b-d734-4c46-a977-4b79c768c599 service nova] [instance: c457a41c-2ee2-4821-94cf-69c091589241] Received event network-vif-plugged-deb899b2-ba04-427b-b4ea-a514b8eda260 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:33:28 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-7ef43afd-5036-4b4b-8c3e-4f62152c0c6c req-e3beeb6b-d734-4c46-a977-4b79c768c599 service nova] Acquiring lock "c457a41c-2ee2-4821-94cf-69c091589241-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:33:28 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-7ef43afd-5036-4b4b-8c3e-4f62152c0c6c req-e3beeb6b-d734-4c46-a977-4b79c768c599 service nova] Lock "c457a41c-2ee2-4821-94cf-69c091589241-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:33:28 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-7ef43afd-5036-4b4b-8c3e-4f62152c0c6c req-e3beeb6b-d734-4c46-a977-4b79c768c599 service nova] Lock "c457a41c-2ee2-4821-94cf-69c091589241-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:33:28 user nova-compute[73572]: DEBUG nova.compute.manager [req-7ef43afd-5036-4b4b-8c3e-4f62152c0c6c req-e3beeb6b-d734-4c46-a977-4b79c768c599 service nova] [instance: c457a41c-2ee2-4821-94cf-69c091589241] No waiting events found dispatching network-vif-plugged-deb899b2-ba04-427b-b4ea-a514b8eda260 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:33:28 user nova-compute[73572]: WARNING nova.compute.manager [req-7ef43afd-5036-4b4b-8c3e-4f62152c0c6c req-e3beeb6b-d734-4c46-a977-4b79c768c599 service nova] [instance: c457a41c-2ee2-4821-94cf-69c091589241] Received unexpected event network-vif-plugged-deb899b2-ba04-427b-b4ea-a514b8eda260 for instance with vm_state building and task_state spawning.
Aug 26 10:33:30 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:33:30 user nova-compute[73572]: DEBUG nova.virt.driver [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Emitting event <LifecycleEvent: 1693046010.812342, c457a41c-2ee2-4821-94cf-69c091589241 => Resumed> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:33:30 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: c457a41c-2ee2-4821-94cf-69c091589241] VM Resumed (Lifecycle Event)
Aug 26 10:33:30 user nova-compute[73572]: DEBUG nova.compute.manager [None req-41398841-72e2-4589-a1c1-b844aa547ba3 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] [instance: c457a41c-2ee2-4821-94cf-69c091589241] Instance event wait completed in 0 seconds for  {{(pid=73572) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 10:33:30 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-41398841-72e2-4589-a1c1-b844aa547ba3 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] [instance: c457a41c-2ee2-4821-94cf-69c091589241] Guest created on hypervisor {{(pid=73572) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 10:33:30 user nova-compute[73572]: INFO nova.virt.libvirt.driver [-] [instance: c457a41c-2ee2-4821-94cf-69c091589241] Instance spawned successfully.
Aug 26 10:33:30 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-41398841-72e2-4589-a1c1-b844aa547ba3 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] [instance: c457a41c-2ee2-4821-94cf-69c091589241] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 10:33:30 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: c457a41c-2ee2-4821-94cf-69c091589241] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:33:30 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: c457a41c-2ee2-4821-94cf-69c091589241] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73572) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 10:33:30 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-41398841-72e2-4589-a1c1-b844aa547ba3 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] [instance: c457a41c-2ee2-4821-94cf-69c091589241] Found default for hw_cdrom_bus of ide {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:33:30 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-41398841-72e2-4589-a1c1-b844aa547ba3 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] [instance: c457a41c-2ee2-4821-94cf-69c091589241] Found default for hw_disk_bus of virtio {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:33:30 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-41398841-72e2-4589-a1c1-b844aa547ba3 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] [instance: c457a41c-2ee2-4821-94cf-69c091589241] Found default for hw_input_bus of None {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:33:30 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-41398841-72e2-4589-a1c1-b844aa547ba3 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] [instance: c457a41c-2ee2-4821-94cf-69c091589241] Found default for hw_pointer_model of None {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:33:30 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-41398841-72e2-4589-a1c1-b844aa547ba3 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] [instance: c457a41c-2ee2-4821-94cf-69c091589241] Found default for hw_video_model of virtio {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:33:30 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-41398841-72e2-4589-a1c1-b844aa547ba3 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] [instance: c457a41c-2ee2-4821-94cf-69c091589241] Found default for hw_vif_model of virtio {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:33:30 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: c457a41c-2ee2-4821-94cf-69c091589241] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 10:33:30 user nova-compute[73572]: DEBUG nova.virt.driver [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Emitting event <LifecycleEvent: 1693046010.814395, c457a41c-2ee2-4821-94cf-69c091589241 => Started> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:33:30 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: c457a41c-2ee2-4821-94cf-69c091589241] VM Started (Lifecycle Event)
Aug 26 10:33:30 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: c457a41c-2ee2-4821-94cf-69c091589241] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:33:30 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: c457a41c-2ee2-4821-94cf-69c091589241] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73572) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 10:33:30 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: c457a41c-2ee2-4821-94cf-69c091589241] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 10:33:30 user nova-compute[73572]: DEBUG nova.compute.manager [req-2b814c1b-d1da-4802-a864-c6e66904d837 req-23ab8dc0-178a-452a-b756-90e2cbc09893 service nova] [instance: c457a41c-2ee2-4821-94cf-69c091589241] Received event network-vif-plugged-deb899b2-ba04-427b-b4ea-a514b8eda260 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:33:30 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-2b814c1b-d1da-4802-a864-c6e66904d837 req-23ab8dc0-178a-452a-b756-90e2cbc09893 service nova] Acquiring lock "c457a41c-2ee2-4821-94cf-69c091589241-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:33:30 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-2b814c1b-d1da-4802-a864-c6e66904d837 req-23ab8dc0-178a-452a-b756-90e2cbc09893 service nova] Lock "c457a41c-2ee2-4821-94cf-69c091589241-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:33:30 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-2b814c1b-d1da-4802-a864-c6e66904d837 req-23ab8dc0-178a-452a-b756-90e2cbc09893 service nova] Lock "c457a41c-2ee2-4821-94cf-69c091589241-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:33:30 user nova-compute[73572]: DEBUG nova.compute.manager [req-2b814c1b-d1da-4802-a864-c6e66904d837 req-23ab8dc0-178a-452a-b756-90e2cbc09893 service nova] [instance: c457a41c-2ee2-4821-94cf-69c091589241] No waiting events found dispatching network-vif-plugged-deb899b2-ba04-427b-b4ea-a514b8eda260 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:33:30 user nova-compute[73572]: WARNING nova.compute.manager [req-2b814c1b-d1da-4802-a864-c6e66904d837 req-23ab8dc0-178a-452a-b756-90e2cbc09893 service nova] [instance: c457a41c-2ee2-4821-94cf-69c091589241] Received unexpected event network-vif-plugged-deb899b2-ba04-427b-b4ea-a514b8eda260 for instance with vm_state building and task_state spawning.
Aug 26 10:33:30 user nova-compute[73572]: INFO nova.compute.manager [None req-41398841-72e2-4589-a1c1-b844aa547ba3 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] [instance: c457a41c-2ee2-4821-94cf-69c091589241] Took 5.35 seconds to spawn the instance on the hypervisor.
Aug 26 10:33:30 user nova-compute[73572]: DEBUG nova.compute.manager [None req-41398841-72e2-4589-a1c1-b844aa547ba3 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] [instance: c457a41c-2ee2-4821-94cf-69c091589241] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:33:31 user nova-compute[73572]: INFO nova.compute.manager [None req-41398841-72e2-4589-a1c1-b844aa547ba3 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] [instance: c457a41c-2ee2-4821-94cf-69c091589241] Took 35.48 seconds to build instance.
Aug 26 10:33:31 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-41398841-72e2-4589-a1c1-b844aa547ba3 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Lock "c457a41c-2ee2-4821-94cf-69c091589241" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 35.606s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:33:31 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:33:32 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:33:33 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:33:33 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:33:35 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:33:36 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:33:36 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:33:36 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:33:36 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:33:36 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:33:36 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Auditing locally available compute resources for user (node: user) {{(pid=73572) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 10:33:37 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73572) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 10:33:37 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86923c1a-89a5-4e7a-b488-8bf3a013bf83/disk.rescue --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:33:37 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:33:37 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86923c1a-89a5-4e7a-b488-8bf3a013bf83/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:33:37 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86923c1a-89a5-4e7a-b488-8bf3a013bf83/disk.rescue --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:33:37 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86923c1a-89a5-4e7a-b488-8bf3a013bf83/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:33:37 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86923c1a-89a5-4e7a-b488-8bf3a013bf83/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:33:37 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86923c1a-89a5-4e7a-b488-8bf3a013bf83/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:33:37 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86923c1a-89a5-4e7a-b488-8bf3a013bf83/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:33:37 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86923c1a-89a5-4e7a-b488-8bf3a013bf83/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:33:37 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73572) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 10:33:37 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d147974d-213d-4aa3-8d03-11b262f59dca/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:33:37 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d147974d-213d-4aa3-8d03-11b262f59dca/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:33:37 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d147974d-213d-4aa3-8d03-11b262f59dca/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:33:38 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d147974d-213d-4aa3-8d03-11b262f59dca/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:33:38 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68613b1e-c45c-4fd9-834c-3630ed0f456a/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:33:38 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68613b1e-c45c-4fd9-834c-3630ed0f456a/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:33:38 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68613b1e-c45c-4fd9-834c-3630ed0f456a/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:33:38 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68613b1e-c45c-4fd9-834c-3630ed0f456a/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:33:38 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2eaea7c2-a5c0-4950-b033-0012b5cec0ee/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:33:38 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2eaea7c2-a5c0-4950-b033-0012b5cec0ee/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:33:38 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2eaea7c2-a5c0-4950-b033-0012b5cec0ee/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:33:38 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2eaea7c2-a5c0-4950-b033-0012b5cec0ee/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:33:38 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/773c7bf7-a911-4b80-9cef-5cc563257b7b/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:33:39 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/773c7bf7-a911-4b80-9cef-5cc563257b7b/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:33:39 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/773c7bf7-a911-4b80-9cef-5cc563257b7b/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:33:39 user nova-compute[73572]: DEBUG nova.compute.manager [req-0c485450-cd08-476f-b110-d3a6dad322ab req-bb7bcec0-44fa-4c75-b6b9-d2eda60393bc service nova] [instance: 1c8e780d-0a13-4484-bf18-ac0879db263a] Received event network-changed-d03460b0-e0b9-4c39-a8a6-12cb80aca6bc {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:33:39 user nova-compute[73572]: DEBUG nova.compute.manager [req-0c485450-cd08-476f-b110-d3a6dad322ab req-bb7bcec0-44fa-4c75-b6b9-d2eda60393bc service nova] [instance: 1c8e780d-0a13-4484-bf18-ac0879db263a] Refreshing instance network info cache due to event network-changed-d03460b0-e0b9-4c39-a8a6-12cb80aca6bc. {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 10:33:39 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-0c485450-cd08-476f-b110-d3a6dad322ab req-bb7bcec0-44fa-4c75-b6b9-d2eda60393bc service nova] Acquiring lock "refresh_cache-1c8e780d-0a13-4484-bf18-ac0879db263a" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:33:39 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-0c485450-cd08-476f-b110-d3a6dad322ab req-bb7bcec0-44fa-4c75-b6b9-d2eda60393bc service nova] Acquired lock "refresh_cache-1c8e780d-0a13-4484-bf18-ac0879db263a" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:33:39 user nova-compute[73572]: DEBUG nova.network.neutron [req-0c485450-cd08-476f-b110-d3a6dad322ab req-bb7bcec0-44fa-4c75-b6b9-d2eda60393bc service nova] [instance: 1c8e780d-0a13-4484-bf18-ac0879db263a] Refreshing network info cache for port d03460b0-e0b9-4c39-a8a6-12cb80aca6bc {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 10:33:39 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/773c7bf7-a911-4b80-9cef-5cc563257b7b/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:33:39 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c8e780d-0a13-4484-bf18-ac0879db263a/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:33:39 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c8e780d-0a13-4484-bf18-ac0879db263a/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:33:39 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c8e780d-0a13-4484-bf18-ac0879db263a/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:33:39 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c8e780d-0a13-4484-bf18-ac0879db263a/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:33:39 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=73572) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 10:33:40 user nova-compute[73572]: DEBUG nova.network.neutron [req-0c485450-cd08-476f-b110-d3a6dad322ab req-bb7bcec0-44fa-4c75-b6b9-d2eda60393bc service nova] [instance: 1c8e780d-0a13-4484-bf18-ac0879db263a] Updated VIF entry in instance network info cache for port d03460b0-e0b9-4c39-a8a6-12cb80aca6bc. {{(pid=73572) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 10:33:40 user nova-compute[73572]: DEBUG nova.network.neutron [req-0c485450-cd08-476f-b110-d3a6dad322ab req-bb7bcec0-44fa-4c75-b6b9-d2eda60393bc service nova] [instance: 1c8e780d-0a13-4484-bf18-ac0879db263a] Updating instance_info_cache with network_info: [{"id": "d03460b0-e0b9-4c39-a8a6-12cb80aca6bc", "address": "fa:16:3e:c2:0f:20", "network": {"id": "757e71b4-5177-45a5-8ef5-9b27f42092f1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1765327616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1bff48d66894950ac6690e1fd0e79b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd03460b0-e0", "ovs_interfaceid": "d03460b0-e0b9-4c39-a8a6-12cb80aca6bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:33:40 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-92c5b0f3-66f2-4c73-b0e5-481e755b9b87 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Acquiring lock "1c8e780d-0a13-4484-bf18-ac0879db263a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:33:40 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-92c5b0f3-66f2-4c73-b0e5-481e755b9b87 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Lock "1c8e780d-0a13-4484-bf18-ac0879db263a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:33:40 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:33:40 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:33:40 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Hypervisor/Node resource view: name=user free_ram=7626MB free_disk=25.16468048095703GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=73572) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 10:33:40 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:33:40 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:33:40 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-0c485450-cd08-476f-b110-d3a6dad322ab req-bb7bcec0-44fa-4c75-b6b9-d2eda60393bc service nova] Releasing lock "refresh_cache-1c8e780d-0a13-4484-bf18-ac0879db263a" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:33:40 user nova-compute[73572]: INFO nova.compute.manager [None req-92c5b0f3-66f2-4c73-b0e5-481e755b9b87 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] [instance: 1c8e780d-0a13-4484-bf18-ac0879db263a] Detaching volume d8aa6fc0-ce50-4db6-8d7d-9f37eae07207
Aug 26 10:33:40 user nova-compute[73572]: INFO nova.virt.block_device [None req-92c5b0f3-66f2-4c73-b0e5-481e755b9b87 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] [instance: 1c8e780d-0a13-4484-bf18-ac0879db263a] Attempting to driver detach volume d8aa6fc0-ce50-4db6-8d7d-9f37eae07207 from mountpoint /dev/vdb
Aug 26 10:33:40 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-92c5b0f3-66f2-4c73-b0e5-481e755b9b87 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Attempting to detach device vdb from instance 1c8e780d-0a13-4484-bf18-ac0879db263a from the persistent domain config. {{(pid=73572) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 10:33:40 user nova-compute[73572]: DEBUG nova.virt.libvirt.guest [None req-92c5b0f3-66f2-4c73-b0e5-481e755b9b87 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 10:33:40 user nova-compute[73572]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 10:33:40 user nova-compute[73572]:   <source dev="/dev/sdg"/>
Aug 26 10:33:40 user nova-compute[73572]:   <target dev="vdb" bus="virtio"/>
Aug 26 10:33:40 user nova-compute[73572]:   <serial>d8aa6fc0-ce50-4db6-8d7d-9f37eae07207</serial>
Aug 26 10:33:40 user nova-compute[73572]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 10:33:40 user nova-compute[73572]: </disk>
Aug 26 10:33:40 user nova-compute[73572]:  {{(pid=73572) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 10:33:40 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-92c5b0f3-66f2-4c73-b0e5-481e755b9b87 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Successfully detached device vdb from instance 1c8e780d-0a13-4484-bf18-ac0879db263a from the persistent domain config.
Aug 26 10:33:40 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-92c5b0f3-66f2-4c73-b0e5-481e755b9b87 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 1c8e780d-0a13-4484-bf18-ac0879db263a from the live domain config. {{(pid=73572) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 10:33:40 user nova-compute[73572]: DEBUG nova.virt.libvirt.guest [None req-92c5b0f3-66f2-4c73-b0e5-481e755b9b87 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 10:33:40 user nova-compute[73572]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 10:33:40 user nova-compute[73572]:   <source dev="/dev/sdg"/>
Aug 26 10:33:40 user nova-compute[73572]:   <target dev="vdb" bus="virtio"/>
Aug 26 10:33:40 user nova-compute[73572]:   <serial>d8aa6fc0-ce50-4db6-8d7d-9f37eae07207</serial>
Aug 26 10:33:40 user nova-compute[73572]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 10:33:40 user nova-compute[73572]: </disk>
Aug 26 10:33:40 user nova-compute[73572]:  {{(pid=73572) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 10:33:40 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance 2eaea7c2-a5c0-4950-b033-0012b5cec0ee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:33:40 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance 86923c1a-89a5-4e7a-b488-8bf3a013bf83 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:33:40 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance 68613b1e-c45c-4fd9-834c-3630ed0f456a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:33:40 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance 1c8e780d-0a13-4484-bf18-ac0879db263a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:33:40 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance 773c7bf7-a911-4b80-9cef-5cc563257b7b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:33:40 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance 7e3fd7ab-91ae-48b9-b436-b154c332869c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:33:40 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance c457a41c-2ee2-4821-94cf-69c091589241 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:33:40 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance d147974d-213d-4aa3-8d03-11b262f59dca actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:33:40 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=73572) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 10:33:40 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=73572) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 10:33:40 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:33:40 user nova-compute[73572]: DEBUG nova.compute.provider_tree [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Inventory has not changed in ProviderTree for provider: e2cec974-59b2-4c77-a53d-a7f4e5a30d75 {{(pid=73572) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 10:33:40 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Inventory has not changed for provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73572) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 10:33:40 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Compute_service record updated for user:user {{(pid=73572) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 10:33:40 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.433s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:33:40 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Received event <DeviceRemovedEvent: 1693046020.7094939, 1c8e780d-0a13-4484-bf18-ac0879db263a => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73572) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 10:33:40 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-92c5b0f3-66f2-4c73-b0e5-481e755b9b87 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 1c8e780d-0a13-4484-bf18-ac0879db263a {{(pid=73572) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 10:33:40 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-92c5b0f3-66f2-4c73-b0e5-481e755b9b87 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Successfully detached device vdb from instance 1c8e780d-0a13-4484-bf18-ac0879db263a from the live domain config.
Aug 26 10:33:40 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-92c5b0f3-66f2-4c73-b0e5-481e755b9b87 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] [instance: 1c8e780d-0a13-4484-bf18-ac0879db263a] calling os-brick to detach iSCSI Volume {{(pid=73572) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 10:33:40 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-92c5b0f3-66f2-4c73-b0e5-481e755b9b87 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc89c3d6a10>, {'target_iqns': ['iqn.2010-10.org.openstack:d8aa6fc0-ce50-4db6-8d7d-9f37eae07207'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'seaDVAkb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 10:33:40 user nova-compute[73572]: WARNING os_brick.initiator.connectors.base [None req-92c5b0f3-66f2-4c73-b0e5-481e755b9b87 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 10:33:40 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-92c5b0f3-66f2-4c73-b0e5-481e755b9b87 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 10:33:40 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-92c5b0f3-66f2-4c73-b0e5-481e755b9b87 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 10:33:40 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-92c5b0f3-66f2-4c73-b0e5-481e755b9b87 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d8aa6fc0-ce50-4db6-8d7d-9f37eae07207', 0)] {{(pid=73572) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 10:33:40 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:33:40 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:33:40 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb11c66f-ed17-4bea-b32e-181f5d3f23a5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6c17592e-3227-473f-ac7b-3e911dcb0d56\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ad1b4b19-ad16-436c-9fa3-e718bea4f540\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d8aa6fc0-ce50-4db6-8d7d-9f37eae07207\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:33:40 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:33:40 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:33:40 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0a03d17-e455-44e1-8519-f1fe8ae22e9d]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8aa6fc0-ce50-4db6-8d7d-9f37eae07207 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad1b4b19-ad16-436c-9fa3-e718bea4f540 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c17592e-3227-473f-ac7b-3e911dcb0d56 (non-flash)\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:33:40 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-92c5b0f3-66f2-4c73-b0e5-481e755b9b87 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8aa6fc0-ce50-4db6-8d7d-9f37eae07207 (non-flash)
Aug 26 10:33:40 user nova-compute[73572]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad1b4b19-ad16-436c-9fa3-e718bea4f540 (non-flash)
Aug 26 10:33:40 user nova-compute[73572]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c17592e-3227-473f-ac7b-3e911dcb0d56 (non-flash)
Aug 26 10:33:40 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 10:33:40 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-92c5b0f3-66f2-4c73-b0e5-481e755b9b87 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8aa6fc0-ce50-4db6-8d7d-9f37eae07207 (non-flash)
Aug 26 10:33:40 user nova-compute[73572]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad1b4b19-ad16-436c-9fa3-e718bea4f540 (non-flash)
Aug 26 10:33:40 user nova-compute[73572]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c17592e-3227-473f-ac7b-3e911dcb0d56 (non-flash)
Aug 26 10:33:40 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 10:33:40 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-92c5b0f3-66f2-4c73-b0e5-481e755b9b87 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc878c25240>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d8aa6fc0-ce50-4db6-8d7d-9f37eae07207'): ({'sdg'}, set())}) {{(pid=73572) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 10:33:40 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-92c5b0f3-66f2-4c73-b0e5-481e755b9b87 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Removing single pathed devices sdg {{(pid=73572) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 10:33:40 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:33:40 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:33:40 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b952e5e-4db1-4fde-a27c-1fac8bf2dd93]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:33:40 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:33:40 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.017s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:33:40 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ffb35df-6f12-49ea-aef7-7025fac016d8]: (4, ('ok\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:33:40 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-92c5b0f3-66f2-4c73-b0e5-481e755b9b87 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Flushing IO for device /dev/sdg {{(pid=73572) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 10:33:40 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:33:40 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.013s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:33:40 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f97f03b-1016-401e-af9b-f04bbd76c878]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:33:40 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-92c5b0f3-66f2-4c73-b0e5-481e755b9b87 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=73572) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 10:33:40 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:33:40 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.040s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:33:40 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3cde63a-3df6-473d-82b3-50315ec6455e]: (4, ('1', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:33:40 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-92c5b0f3-66f2-4c73-b0e5-481e755b9b87 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=73572) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 10:33:40 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-92c5b0f3-66f2-4c73-b0e5-481e755b9b87 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] SCSI volumes sdg have been removed. {{(pid=73572) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 10:33:40 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-92c5b0f3-66f2-4c73-b0e5-481e755b9b87 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d8aa6fc0-ce50-4db6-8d7d-9f37eae07207')] {{(pid=73572) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 10:33:40 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8aa6fc0-ce50-4db6-8d7d-9f37eae07207 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:33:40 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8aa6fc0-ce50-4db6-8d7d-9f37eae07207 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:33:40 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[55904eff-0203-4909-b2f5-eacc83c82e3e]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:33:40 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-92c5b0f3-66f2-4c73-b0e5-481e755b9b87 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:33:40 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8aa6fc0-ce50-4db6-8d7d-9f37eae07207 -p 172.16.0.220:3260 --logout {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:33:40 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8aa6fc0-ce50-4db6-8d7d-9f37eae07207 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:33:40 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa5743de-4939-4834-b57b-e346d97b8708]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:d8aa6fc0-ce50-4db6-8d7d-9f37eae07207, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:d8aa6fc0-ce50-4db6-8d7d-9f37eae07207, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:33:40 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-92c5b0f3-66f2-4c73-b0e5-481e755b9b87 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:d8aa6fc0-ce50-4db6-8d7d-9f37eae07207, portal: 172.16.0.220,3260]
Aug 26 10:33:40 user nova-compute[73572]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:d8aa6fc0-ce50-4db6-8d7d-9f37eae07207, portal: 172.16.0.220,3260] successful.
Aug 26 10:33:40 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:33:40 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8aa6fc0-ce50-4db6-8d7d-9f37eae07207 -p 172.16.0.220:3260 --op delete {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:33:41 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8aa6fc0-ce50-4db6-8d7d-9f37eae07207 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:33:41 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[93224e35-0f41-46d8-baf5-7f6bb53283c4]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:33:41 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-92c5b0f3-66f2-4c73-b0e5-481e755b9b87 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:33:41 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-92c5b0f3-66f2-4c73-b0e5-481e755b9b87 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.276s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 10:33:41 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-92c5b0f3-66f2-4c73-b0e5-481e755b9b87 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] <== disconnect_volume: return (278ms) None {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 10:33:41 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-92c5b0f3-66f2-4c73-b0e5-481e755b9b87 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] [instance: 1c8e780d-0a13-4484-bf18-ac0879db263a] Disconnected iSCSI Volume {{(pid=73572) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 10:33:41 user nova-compute[73572]: DEBUG nova.compute.manager [req-b1f7e9ce-1c39-4f27-b2aa-ba5a1e7faab6 req-a12a083f-7c75-47ec-bb2c-20a8151367f5 service nova] [instance: 1c8e780d-0a13-4484-bf18-ac0879db263a] Received event network-changed-d03460b0-e0b9-4c39-a8a6-12cb80aca6bc {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:33:41 user nova-compute[73572]: DEBUG nova.compute.manager [req-b1f7e9ce-1c39-4f27-b2aa-ba5a1e7faab6 req-a12a083f-7c75-47ec-bb2c-20a8151367f5 service nova] [instance: 1c8e780d-0a13-4484-bf18-ac0879db263a] Refreshing instance network info cache due to event network-changed-d03460b0-e0b9-4c39-a8a6-12cb80aca6bc. {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 10:33:41 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-b1f7e9ce-1c39-4f27-b2aa-ba5a1e7faab6 req-a12a083f-7c75-47ec-bb2c-20a8151367f5 service nova] Acquiring lock "refresh_cache-1c8e780d-0a13-4484-bf18-ac0879db263a" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:33:41 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-b1f7e9ce-1c39-4f27-b2aa-ba5a1e7faab6 req-a12a083f-7c75-47ec-bb2c-20a8151367f5 service nova] Acquired lock "refresh_cache-1c8e780d-0a13-4484-bf18-ac0879db263a" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:33:41 user nova-compute[73572]: DEBUG nova.network.neutron [req-b1f7e9ce-1c39-4f27-b2aa-ba5a1e7faab6 req-a12a083f-7c75-47ec-bb2c-20a8151367f5 service nova] [instance: 1c8e780d-0a13-4484-bf18-ac0879db263a] Refreshing network info cache for port d03460b0-e0b9-4c39-a8a6-12cb80aca6bc {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 10:33:41 user nova-compute[73572]: DEBUG nova.objects.instance [None req-92c5b0f3-66f2-4c73-b0e5-481e755b9b87 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Lazy-loading 'flavor' on Instance uuid 1c8e780d-0a13-4484-bf18-ac0879db263a {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:33:41 user nova-compute[73572]: DEBUG nova.network.neutron [req-b1f7e9ce-1c39-4f27-b2aa-ba5a1e7faab6 req-a12a083f-7c75-47ec-bb2c-20a8151367f5 service nova] [instance: 1c8e780d-0a13-4484-bf18-ac0879db263a] Updated VIF entry in instance network info cache for port d03460b0-e0b9-4c39-a8a6-12cb80aca6bc. {{(pid=73572) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 10:33:41 user nova-compute[73572]: DEBUG nova.network.neutron [req-b1f7e9ce-1c39-4f27-b2aa-ba5a1e7faab6 req-a12a083f-7c75-47ec-bb2c-20a8151367f5 service nova] [instance: 1c8e780d-0a13-4484-bf18-ac0879db263a] Updating instance_info_cache with network_info: [{"id": "d03460b0-e0b9-4c39-a8a6-12cb80aca6bc", "address": "fa:16:3e:c2:0f:20", "network": {"id": "757e71b4-5177-45a5-8ef5-9b27f42092f1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1765327616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1bff48d66894950ac6690e1fd0e79b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd03460b0-e0", "ovs_interfaceid": "d03460b0-e0b9-4c39-a8a6-12cb80aca6bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:33:41 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-b1f7e9ce-1c39-4f27-b2aa-ba5a1e7faab6 req-a12a083f-7c75-47ec-bb2c-20a8151367f5 service nova] Releasing lock "refresh_cache-1c8e780d-0a13-4484-bf18-ac0879db263a" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:33:41 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-92c5b0f3-66f2-4c73-b0e5-481e755b9b87 tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Lock "1c8e780d-0a13-4484-bf18-ac0879db263a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.709s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:33:42 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:33:45 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:33:47 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:33:50 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:33:52 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:33:55 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:33:55 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-a7edcc0b-eae1-47a3-92f6-56b0905e3ef2 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Acquiring lock "773c7bf7-a911-4b80-9cef-5cc563257b7b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:33:55 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-a7edcc0b-eae1-47a3-92f6-56b0905e3ef2 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Lock "773c7bf7-a911-4b80-9cef-5cc563257b7b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:33:55 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-a7edcc0b-eae1-47a3-92f6-56b0905e3ef2 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Acquiring lock "773c7bf7-a911-4b80-9cef-5cc563257b7b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:33:55 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-a7edcc0b-eae1-47a3-92f6-56b0905e3ef2 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Lock "773c7bf7-a911-4b80-9cef-5cc563257b7b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:33:55 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-a7edcc0b-eae1-47a3-92f6-56b0905e3ef2 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Lock "773c7bf7-a911-4b80-9cef-5cc563257b7b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:33:55 user nova-compute[73572]: INFO nova.compute.manager [None req-a7edcc0b-eae1-47a3-92f6-56b0905e3ef2 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] [instance: 773c7bf7-a911-4b80-9cef-5cc563257b7b] Terminating instance
Aug 26 10:33:55 user nova-compute[73572]: DEBUG nova.compute.manager [None req-a7edcc0b-eae1-47a3-92f6-56b0905e3ef2 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] [instance: 773c7bf7-a911-4b80-9cef-5cc563257b7b] Start destroying the instance on the hypervisor. {{(pid=73572) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 10:33:55 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:33:55 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:33:55 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:33:55 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:33:55 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:33:55 user nova-compute[73572]: DEBUG nova.compute.manager [req-e29f65cc-0afb-46d2-800e-d2d90c2dcfcd req-f3bf9c44-0dd0-4dfb-9ec7-821dd96a9f6a service nova] [instance: 773c7bf7-a911-4b80-9cef-5cc563257b7b] Received event network-vif-unplugged-761ae86a-09b9-4010-8a18-3687cc70a2ef {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:33:55 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-e29f65cc-0afb-46d2-800e-d2d90c2dcfcd req-f3bf9c44-0dd0-4dfb-9ec7-821dd96a9f6a service nova] Acquiring lock "773c7bf7-a911-4b80-9cef-5cc563257b7b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:33:55 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-e29f65cc-0afb-46d2-800e-d2d90c2dcfcd req-f3bf9c44-0dd0-4dfb-9ec7-821dd96a9f6a service nova] Lock "773c7bf7-a911-4b80-9cef-5cc563257b7b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:33:55 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-e29f65cc-0afb-46d2-800e-d2d90c2dcfcd req-f3bf9c44-0dd0-4dfb-9ec7-821dd96a9f6a service nova] Lock "773c7bf7-a911-4b80-9cef-5cc563257b7b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:33:55 user nova-compute[73572]: DEBUG nova.compute.manager [req-e29f65cc-0afb-46d2-800e-d2d90c2dcfcd req-f3bf9c44-0dd0-4dfb-9ec7-821dd96a9f6a service nova] [instance: 773c7bf7-a911-4b80-9cef-5cc563257b7b] No waiting events found dispatching network-vif-unplugged-761ae86a-09b9-4010-8a18-3687cc70a2ef {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:33:55 user nova-compute[73572]: DEBUG nova.compute.manager [req-e29f65cc-0afb-46d2-800e-d2d90c2dcfcd req-f3bf9c44-0dd0-4dfb-9ec7-821dd96a9f6a service nova] [instance: 773c7bf7-a911-4b80-9cef-5cc563257b7b] Received event network-vif-unplugged-761ae86a-09b9-4010-8a18-3687cc70a2ef for instance with task_state deleting. {{(pid=73572) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 10:33:56 user nova-compute[73572]: INFO nova.virt.libvirt.driver [-] [instance: 773c7bf7-a911-4b80-9cef-5cc563257b7b] Instance destroyed successfully.
Aug 26 10:33:56 user nova-compute[73572]: DEBUG nova.objects.instance [None req-a7edcc0b-eae1-47a3-92f6-56b0905e3ef2 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Lazy-loading 'resources' on Instance uuid 773c7bf7-a911-4b80-9cef-5cc563257b7b {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:33:56 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-a7edcc0b-eae1-47a3-92f6-56b0905e3ef2 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T10:30:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1348178164',display_name='tempest-AttachVolumeNegativeTest-server-1348178164',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1348178164',id=43,image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO1IyEtqvTht3+0cvY+RFftB+h864Tk7wVXdQJ1zgSM01VRM6rPUKTJUZt5ZumSSWh1WeG7QUN9WXPhwQqS6SUYYtpEPXx6p8KKbLGaHx3/vMWRqhMLk8/ft8BndF0TQyw==',key_name='tempest-keypair-1023132651',keypairs=<?>,launch_index=0,launched_at=2023-08-26T10:30:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='47abd6293c07465389c379e3b5061164',ramdisk_id='',reservation_id='r-rmg7mk9x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-608798758',owner_user_name='tempest-AttachVolumeNegativeTest-608798758-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T10:30:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c7cf9c8d529d49149141add20c2b2af2',uuid=773c7bf7-a911-4b80-9cef-5cc563257b7b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "761ae86a-09b9-4010-8a18-3687cc70a2ef", "address": "fa:16:3e:49:ea:41", "network": {"id": "880aa066-8f77-469b-a0c4-e4e94ae31e1a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-313654920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47abd6293c07465389c379e3b5061164", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap761ae86a-09", "ovs_interfaceid": "761ae86a-09b9-4010-8a18-3687cc70a2ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 10:33:56 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-a7edcc0b-eae1-47a3-92f6-56b0905e3ef2 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Converting VIF {"id": "761ae86a-09b9-4010-8a18-3687cc70a2ef", "address": "fa:16:3e:49:ea:41", "network": {"id": "880aa066-8f77-469b-a0c4-e4e94ae31e1a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-313654920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47abd6293c07465389c379e3b5061164", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap761ae86a-09", "ovs_interfaceid": "761ae86a-09b9-4010-8a18-3687cc70a2ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:33:56 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-a7edcc0b-eae1-47a3-92f6-56b0905e3ef2 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:49:ea:41,bridge_name='br-int',has_traffic_filtering=True,id=761ae86a-09b9-4010-8a18-3687cc70a2ef,network=Network(880aa066-8f77-469b-a0c4-e4e94ae31e1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap761ae86a-09') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:33:56 user nova-compute[73572]: DEBUG os_vif [None req-a7edcc0b-eae1-47a3-92f6-56b0905e3ef2 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:49:ea:41,bridge_name='br-int',has_traffic_filtering=True,id=761ae86a-09b9-4010-8a18-3687cc70a2ef,network=Network(880aa066-8f77-469b-a0c4-e4e94ae31e1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap761ae86a-09') {{(pid=73572) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 10:33:56 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:33:56 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap761ae86a-09, bridge=br-int, if_exists=True) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:33:56 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:33:56 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:33:56 user nova-compute[73572]: INFO os_vif [None req-a7edcc0b-eae1-47a3-92f6-56b0905e3ef2 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:49:ea:41,bridge_name='br-int',has_traffic_filtering=True,id=761ae86a-09b9-4010-8a18-3687cc70a2ef,network=Network(880aa066-8f77-469b-a0c4-e4e94ae31e1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap761ae86a-09')
Aug 26 10:33:56 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-a7edcc0b-eae1-47a3-92f6-56b0905e3ef2 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] [instance: 773c7bf7-a911-4b80-9cef-5cc563257b7b] Deleting instance files /opt/stack/data/nova/instances/773c7bf7-a911-4b80-9cef-5cc563257b7b_del
Aug 26 10:33:56 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-a7edcc0b-eae1-47a3-92f6-56b0905e3ef2 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] [instance: 773c7bf7-a911-4b80-9cef-5cc563257b7b] Deletion of /opt/stack/data/nova/instances/773c7bf7-a911-4b80-9cef-5cc563257b7b_del complete
Aug 26 10:33:56 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-41190658-6f04-441a-9541-b620d0e33daa tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] Acquiring lock "3a4c9522-9723-4ad4-8630-17a3aba70c98" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:33:56 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-41190658-6f04-441a-9541-b620d0e33daa tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] Lock "3a4c9522-9723-4ad4-8630-17a3aba70c98" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:33:56 user nova-compute[73572]: INFO nova.compute.manager [None req-41190658-6f04-441a-9541-b620d0e33daa tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] [instance: 3a4c9522-9723-4ad4-8630-17a3aba70c98] Unshelving
Aug 26 10:33:56 user nova-compute[73572]: INFO nova.compute.manager [None req-a7edcc0b-eae1-47a3-92f6-56b0905e3ef2 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] [instance: 773c7bf7-a911-4b80-9cef-5cc563257b7b] Took 0.89 seconds to destroy the instance on the hypervisor.
Aug 26 10:33:56 user nova-compute[73572]: DEBUG oslo.service.loopingcall [None req-a7edcc0b-eae1-47a3-92f6-56b0905e3ef2 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73572) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 10:33:56 user nova-compute[73572]: DEBUG nova.compute.manager [-] [instance: 773c7bf7-a911-4b80-9cef-5cc563257b7b] Deallocating network for instance {{(pid=73572) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 10:33:56 user nova-compute[73572]: DEBUG nova.network.neutron [-] [instance: 773c7bf7-a911-4b80-9cef-5cc563257b7b] deallocate_for_instance() {{(pid=73572) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 10:33:56 user nova-compute[73572]: INFO nova.virt.block_device [None req-41190658-6f04-441a-9541-b620d0e33daa tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] [instance: 3a4c9522-9723-4ad4-8630-17a3aba70c98] Booting with volume ec96ec24-bf73-4f38-ac9f-eb2699d0a661 at /dev/vda
Aug 26 10:33:56 user nova-compute[73572]: DEBUG os_brick.utils [None req-41190658-6f04-441a-9541-b620d0e33daa tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 10:33:56 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:33:56 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:33:56 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bce3d96-8869-435e-8979-c2dd2add2fdc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:de8a79ed912\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:33:56 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:33:56 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:33:56 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7723b30-1dec-4dae-9e54-fe158c0d9c91]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:33:56 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:33:56 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:33:56 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[d87b713b-c33a-4b74-9b61-e153fae65835]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:33:56 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[1813c20d-f7f6-4289-872d-50eb4e42e0e1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:33:56 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-41190658-6f04-441a-9541-b620d0e33daa tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] Running cmd (subprocess): nvme version {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:33:56 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-41190658-6f04-441a-9541-b620d0e33daa tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] 'nvme version' failed. Not Retrying. {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 10:33:56 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.nvmeof [None req-41190658-6f04-441a-9541-b620d0e33daa tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] nvme not present on system {{(pid=73572) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 10:33:56 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:33:56 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 10:33:56 user nova-compute[73572]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 10:33:56 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7d32933-c862-47a1-bf43-4e38a2c7fc45]: (4, '') {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:33:56 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.lightos [None req-41190658-6f04-441a-9541-b620d0e33daa tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73572) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 10:33:56 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.lightos [None req-41190658-6f04-441a-9541-b620d0e33daa tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73572) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 10:33:56 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.lightos [None req-41190658-6f04-441a-9541-b620d0e33daa tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] LIGHTOS: no hostnqn found. {{(pid=73572) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 10:33:56 user nova-compute[73572]: DEBUG os_brick.utils [None req-41190658-6f04-441a-9541-b620d0e33daa tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:de8a79ed912', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 10:33:56 user nova-compute[73572]: DEBUG nova.virt.block_device [None req-41190658-6f04-441a-9541-b620d0e33daa tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] [instance: 3a4c9522-9723-4ad4-8630-17a3aba70c98] Updating existing volume attachment record: 46b08434-a1a3-496e-a54b-c2f3036a0a87 {{(pid=73572) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 10:33:57 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:33:57 user nova-compute[73572]: DEBUG nova.network.neutron [-] [instance: 773c7bf7-a911-4b80-9cef-5cc563257b7b] Updating instance_info_cache with network_info: [] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:33:57 user nova-compute[73572]: INFO nova.compute.manager [-] [instance: 773c7bf7-a911-4b80-9cef-5cc563257b7b] Took 1.18 seconds to deallocate network for instance.
Aug 26 10:33:57 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-a7edcc0b-eae1-47a3-92f6-56b0905e3ef2 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:33:57 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-a7edcc0b-eae1-47a3-92f6-56b0905e3ef2 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:33:57 user nova-compute[73572]: DEBUG nova.compute.provider_tree [None req-a7edcc0b-eae1-47a3-92f6-56b0905e3ef2 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Inventory has not changed in ProviderTree for provider: e2cec974-59b2-4c77-a53d-a7f4e5a30d75 {{(pid=73572) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 10:33:57 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-a7edcc0b-eae1-47a3-92f6-56b0905e3ef2 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Inventory has not changed for provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73572) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 10:33:57 user nova-compute[73572]: DEBUG nova.compute.manager [req-3289fe6f-6638-4ecf-a2e4-2fbcaf041cfb req-707639a2-846a-4abe-b56a-fb9405a9fc0b service nova] [instance: 773c7bf7-a911-4b80-9cef-5cc563257b7b] Received event network-vif-plugged-761ae86a-09b9-4010-8a18-3687cc70a2ef {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:33:57 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-3289fe6f-6638-4ecf-a2e4-2fbcaf041cfb req-707639a2-846a-4abe-b56a-fb9405a9fc0b service nova] Acquiring lock "773c7bf7-a911-4b80-9cef-5cc563257b7b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:33:57 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-3289fe6f-6638-4ecf-a2e4-2fbcaf041cfb req-707639a2-846a-4abe-b56a-fb9405a9fc0b service nova] Lock "773c7bf7-a911-4b80-9cef-5cc563257b7b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:33:57 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-3289fe6f-6638-4ecf-a2e4-2fbcaf041cfb req-707639a2-846a-4abe-b56a-fb9405a9fc0b service nova] Lock "773c7bf7-a911-4b80-9cef-5cc563257b7b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:33:57 user nova-compute[73572]: DEBUG nova.compute.manager [req-3289fe6f-6638-4ecf-a2e4-2fbcaf041cfb req-707639a2-846a-4abe-b56a-fb9405a9fc0b service nova] [instance: 773c7bf7-a911-4b80-9cef-5cc563257b7b] No waiting events found dispatching network-vif-plugged-761ae86a-09b9-4010-8a18-3687cc70a2ef {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:33:57 user nova-compute[73572]: WARNING nova.compute.manager [req-3289fe6f-6638-4ecf-a2e4-2fbcaf041cfb req-707639a2-846a-4abe-b56a-fb9405a9fc0b service nova] [instance: 773c7bf7-a911-4b80-9cef-5cc563257b7b] Received unexpected event network-vif-plugged-761ae86a-09b9-4010-8a18-3687cc70a2ef for instance with vm_state deleted and task_state None.
Aug 26 10:33:57 user nova-compute[73572]: DEBUG nova.compute.manager [req-3289fe6f-6638-4ecf-a2e4-2fbcaf041cfb req-707639a2-846a-4abe-b56a-fb9405a9fc0b service nova] [instance: 773c7bf7-a911-4b80-9cef-5cc563257b7b] Received event network-vif-deleted-761ae86a-09b9-4010-8a18-3687cc70a2ef {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:33:57 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-a7edcc0b-eae1-47a3-92f6-56b0905e3ef2 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.352s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:33:58 user nova-compute[73572]: INFO nova.scheduler.client.report [None req-a7edcc0b-eae1-47a3-92f6-56b0905e3ef2 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Deleted allocations for instance 773c7bf7-a911-4b80-9cef-5cc563257b7b
Aug 26 10:33:58 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-a7edcc0b-eae1-47a3-92f6-56b0905e3ef2 tempest-AttachVolumeNegativeTest-608798758 tempest-AttachVolumeNegativeTest-608798758-project-member] Lock "773c7bf7-a911-4b80-9cef-5cc563257b7b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.627s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:34:00 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:34:01 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:34:06 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:34:06 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:34:06 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73572) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 10:34:06 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73572) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 10:34:06 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73572) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 10:34:06 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:34:08 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-41190658-6f04-441a-9541-b620d0e33daa tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:34:08 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-41190658-6f04-441a-9541-b620d0e33daa tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:34:08 user nova-compute[73572]: DEBUG nova.objects.instance [None req-41190658-6f04-441a-9541-b620d0e33daa tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] Lazy-loading 'pci_requests' on Instance uuid 3a4c9522-9723-4ad4-8630-17a3aba70c98 {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:34:08 user nova-compute[73572]: DEBUG nova.objects.instance [None req-41190658-6f04-441a-9541-b620d0e33daa tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] Lazy-loading 'numa_topology' on Instance uuid 3a4c9522-9723-4ad4-8630-17a3aba70c98 {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:34:08 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-41190658-6f04-441a-9541-b620d0e33daa tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73572) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 10:34:08 user nova-compute[73572]: INFO nova.compute.claims [None req-41190658-6f04-441a-9541-b620d0e33daa tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] [instance: 3a4c9522-9723-4ad4-8630-17a3aba70c98] Claim successful on node user
Aug 26 10:34:08 user nova-compute[73572]: DEBUG nova.compute.provider_tree [None req-41190658-6f04-441a-9541-b620d0e33daa tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] Inventory has not changed in ProviderTree for provider: e2cec974-59b2-4c77-a53d-a7f4e5a30d75 {{(pid=73572) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 10:34:08 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-41190658-6f04-441a-9541-b620d0e33daa tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] Inventory has not changed for provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73572) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 10:34:08 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-41190658-6f04-441a-9541-b620d0e33daa tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.386s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:34:08 user nova-compute[73572]: INFO nova.network.neutron [None req-41190658-6f04-441a-9541-b620d0e33daa tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] [instance: 3a4c9522-9723-4ad4-8630-17a3aba70c98] Updating port 663db499-c552-478e-bad7-938b2f65c619 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 26 10:34:09 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-41190658-6f04-441a-9541-b620d0e33daa tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] Acquiring lock "refresh_cache-3a4c9522-9723-4ad4-8630-17a3aba70c98" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:34:09 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-41190658-6f04-441a-9541-b620d0e33daa tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] Acquired lock "refresh_cache-3a4c9522-9723-4ad4-8630-17a3aba70c98" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:34:09 user nova-compute[73572]: DEBUG nova.network.neutron [None req-41190658-6f04-441a-9541-b620d0e33daa tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] [instance: 3a4c9522-9723-4ad4-8630-17a3aba70c98] Building network info cache for instance {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 10:34:09 user nova-compute[73572]: DEBUG nova.compute.manager [req-6a6e4d72-f04e-4624-90e7-4de0cec77c98 req-e7bbfa0a-da59-4f2b-8a49-9de3fe6d1896 service nova] [instance: 3a4c9522-9723-4ad4-8630-17a3aba70c98] Received event network-changed-663db499-c552-478e-bad7-938b2f65c619 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:34:09 user nova-compute[73572]: DEBUG nova.compute.manager [req-6a6e4d72-f04e-4624-90e7-4de0cec77c98 req-e7bbfa0a-da59-4f2b-8a49-9de3fe6d1896 service nova] [instance: 3a4c9522-9723-4ad4-8630-17a3aba70c98] Refreshing instance network info cache due to event network-changed-663db499-c552-478e-bad7-938b2f65c619. {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 10:34:09 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-6a6e4d72-f04e-4624-90e7-4de0cec77c98 req-e7bbfa0a-da59-4f2b-8a49-9de3fe6d1896 service nova] Acquiring lock "refresh_cache-3a4c9522-9723-4ad4-8630-17a3aba70c98" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:34:10 user nova-compute[73572]: DEBUG nova.network.neutron [None req-41190658-6f04-441a-9541-b620d0e33daa tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] [instance: 3a4c9522-9723-4ad4-8630-17a3aba70c98] Updating instance_info_cache with network_info: [{"id": "663db499-c552-478e-bad7-938b2f65c619", "address": "fa:16:3e:fd:54:35", "network": {"id": "6bec7255-9e3a-43e3-aaf3-913e171ee99d", "bridge": "br-int", "label": "tempest-TestShelveInstance-1279582697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51eaa92831e54ba6bd3d71db1a4e24e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap663db499-c5", "ovs_interfaceid": "663db499-c552-478e-bad7-938b2f65c619", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:34:10 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-41190658-6f04-441a-9541-b620d0e33daa tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] Releasing lock "refresh_cache-3a4c9522-9723-4ad4-8630-17a3aba70c98" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:34:10 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-41190658-6f04-441a-9541-b620d0e33daa tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] [instance: 3a4c9522-9723-4ad4-8630-17a3aba70c98] Creating instance directory {{(pid=73572) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 10:34:10 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-41190658-6f04-441a-9541-b620d0e33daa tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] [instance: 3a4c9522-9723-4ad4-8630-17a3aba70c98] Creating image(s)
Aug 26 10:34:10 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-41190658-6f04-441a-9541-b620d0e33daa tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] [instance: 3a4c9522-9723-4ad4-8630-17a3aba70c98] Did not create local disks {{(pid=73572) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 26 10:34:10 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-41190658-6f04-441a-9541-b620d0e33daa tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] [instance: 3a4c9522-9723-4ad4-8630-17a3aba70c98] Ensure instance console log exists: /opt/stack/data/nova/instances/3a4c9522-9723-4ad4-8630-17a3aba70c98/console.log {{(pid=73572) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 10:34:10 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-41190658-6f04-441a-9541-b620d0e33daa tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:34:10 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-41190658-6f04-441a-9541-b620d0e33daa tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:34:10 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-41190658-6f04-441a-9541-b620d0e33daa tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:34:10 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-41190658-6f04-441a-9541-b620d0e33daa tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] [instance: 3a4c9522-9723-4ad4-8630-17a3aba70c98] Start _get_guest_xml network_info=[{"id": "663db499-c552-478e-bad7-938b2f65c619", "address": "fa:16:3e:fd:54:35", "network": {"id": "6bec7255-9e3a-43e3-aaf3-913e171ee99d", "bridge": "br-int", "label": "tempest-TestShelveInstance-1279582697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51eaa92831e54ba6bd3d71db1a4e24e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap663db499-c5", "ovs_interfaceid": "663db499-c552-478e-bad7-938b2f65c619", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'disk_bus': 'virtio', 'boot_index': 0, 'mount_device': '/dev/vda', 'attachment_id': '46b08434-a1a3-496e-a54b-c2f3036a0a87', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:ec96ec24-bf73-4f38-ac9f-eb2699d0a661'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tqbEgzCT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '3a4c9522-9723-4ad4-8630-17a3aba70c98', 'attached_at': '', 'detached_at': '', 'volume_id': 'ec96ec24-bf73-4f38-ac9f-eb2699d0a661', 'serial': 'ec96ec24-bf73-4f38-ac9f-eb2699d0a661'}, 'guest_format': None, 'device_type': 'disk', 'volume_type': None} {{(pid=73572) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 10:34:10 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-6a6e4d72-f04e-4624-90e7-4de0cec77c98 req-e7bbfa0a-da59-4f2b-8a49-9de3fe6d1896 service nova] Acquired lock "refresh_cache-3a4c9522-9723-4ad4-8630-17a3aba70c98" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:34:10 user nova-compute[73572]: DEBUG nova.network.neutron [req-6a6e4d72-f04e-4624-90e7-4de0cec77c98 req-e7bbfa0a-da59-4f2b-8a49-9de3fe6d1896 service nova] [instance: 3a4c9522-9723-4ad4-8630-17a3aba70c98] Refreshing network info cache for port 663db499-c552-478e-bad7-938b2f65c619 {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 10:34:10 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-41190658-6f04-441a-9541-b620d0e33daa tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:34:10 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-41190658-6f04-441a-9541-b620d0e33daa tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:34:10 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-41190658-6f04-441a-9541-b620d0e33daa tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73572) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 10:34:10 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-41190658-6f04-441a-9541-b620d0e33daa tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] CPU controller missing on host. {{(pid=73572) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 10:34:10 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-41190658-6f04-441a-9541-b620d0e33daa tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73572) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 10:34:10 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-41190658-6f04-441a-9541-b620d0e33daa tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] CPU controller found on host. {{(pid=73572) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 10:34:10 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-41190658-6f04-441a-9541-b620d0e33daa tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73572) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 10:34:10 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-41190658-6f04-441a-9541-b620d0e33daa tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T10:07:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 10:34:10 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-41190658-6f04-441a-9541-b620d0e33daa tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] Flavor limits 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 10:34:10 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-41190658-6f04-441a-9541-b620d0e33daa tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] Image limits 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 10:34:10 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-41190658-6f04-441a-9541-b620d0e33daa tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] Flavor pref 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 10:34:10 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-41190658-6f04-441a-9541-b620d0e33daa tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] Image pref 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 10:34:10 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-41190658-6f04-441a-9541-b620d0e33daa tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 10:34:10 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-41190658-6f04-441a-9541-b620d0e33daa tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 10:34:10 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-41190658-6f04-441a-9541-b620d0e33daa tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73572) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 10:34:10 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-41190658-6f04-441a-9541-b620d0e33daa tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] Got 1 possible topologies {{(pid=73572) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 10:34:10 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-41190658-6f04-441a-9541-b620d0e33daa tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 10:34:10 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-41190658-6f04-441a-9541-b620d0e33daa tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 10:34:10 user nova-compute[73572]: DEBUG nova.objects.instance [None req-41190658-6f04-441a-9541-b620d0e33daa tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] Lazy-loading 'vcpu_model' on Instance uuid 3a4c9522-9723-4ad4-8630-17a3aba70c98 {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:34:10 user nova-compute[73572]: DEBUG nova.objects.base [None req-41190658-6f04-441a-9541-b620d0e33daa tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] Object Instance<3a4c9522-9723-4ad4-8630-17a3aba70c98> lazy-loaded attributes: pci_requests,vcpu_model {{(pid=73572) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 10:34:10 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-41190658-6f04-441a-9541-b620d0e33daa tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] [instance: 3a4c9522-9723-4ad4-8630-17a3aba70c98] Calling os-brick to attach iSCSI Volume {{(pid=73572) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 10:34:10 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-41190658-6f04-441a-9541-b620d0e33daa tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc89c3d6a10>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:ec96ec24-bf73-4f38-ac9f-eb2699d0a661'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tqbEgzCT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 10:34:10 user nova-compute[73572]: WARNING os_brick.initiator.connectors.base [None req-41190658-6f04-441a-9541-b620d0e33daa tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 10:34:10 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-41190658-6f04-441a-9541-b620d0e33daa tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 10:34:10 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-41190658-6f04-441a-9541-b620d0e33daa tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 10:34:10 user nova-compute[73572]: WARNING os_brick.initiator.connectors.base [None req-41190658-6f04-441a-9541-b620d0e33daa tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 10:34:10 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-41190658-6f04-441a-9541-b620d0e33daa tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ec96ec24-bf73-4f38-ac9f-eb2699d0a661" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 10:34:10 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-41190658-6f04-441a-9541-b620d0e33daa tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ec96ec24-bf73-4f38-ac9f-eb2699d0a661" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 10:34:10 user nova-compute[73572]: INFO os_brick.initiator.connectors.iscsi [None req-41190658-6f04-441a-9541-b620d0e33daa tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 10:34:10 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec96ec24-bf73-4f38-ac9f-eb2699d0a661 -p 172.16.0.220:3260 {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:34:10 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec96ec24-bf73-4f38-ac9f-eb2699d0a661 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:34:10 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[af34d7ca-c525-48c2-a814-56cf54e5db87]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:34:10 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-41190658-6f04-441a-9541-b620d0e33daa tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 10:34:10 user nova-compute[73572]:  {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:34:10 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec96ec24-bf73-4f38-ac9f-eb2699d0a661 -p 172.16.0.220:3260 --interface default --op new {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:34:10 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec96ec24-bf73-4f38-ac9f-eb2699d0a661 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:34:10 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[a914d6d1-eb72-4b75-9872-e0c8ead8e20b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ec96ec24-bf73-4f38-ac9f-eb2699d0a661] added\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:34:10 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-41190658-6f04-441a-9541-b620d0e33daa tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ec96ec24-bf73-4f38-ac9f-eb2699d0a661] added
Aug 26 10:34:10 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:34:10 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec96ec24-bf73-4f38-ac9f-eb2699d0a661 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:34:10 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec96ec24-bf73-4f38-ac9f-eb2699d0a661 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:34:10 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfef35d0-7967-4a91-adf0-4b80f70933dc]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:34:10 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-41190658-6f04-441a-9541-b620d0e33daa tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:34:10 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec96ec24-bf73-4f38-ac9f-eb2699d0a661 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:34:10 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec96ec24-bf73-4f38-ac9f-eb2699d0a661 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:34:10 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[00bd54ed-b0b5-4e67-8815-bd8f15a4181b]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:34:10 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-41190658-6f04-441a-9541-b620d0e33daa tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:34:10 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec96ec24-bf73-4f38-ac9f-eb2699d0a661 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tqbEgzCT {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:34:10 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec96ec24-bf73-4f38-ac9f-eb2699d0a661 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tqbEgzCT" returned: 0 in 0.018s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:34:10 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[c23148b7-1217-4ded-9074-6c824bf28f9e]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:34:10 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-41190658-6f04-441a-9541-b620d0e33daa tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tqbEgzCT'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:34:10 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec96ec24-bf73-4f38-ac9f-eb2699d0a661 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:34:10 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec96ec24-bf73-4f38-ac9f-eb2699d0a661 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:34:10 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cbe925b-24d2-4bae-9090-48221648e0a4]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:34:10 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-41190658-6f04-441a-9541-b620d0e33daa tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:34:10 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:34:10 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:34:10 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[60ee7d04-6200-443c-99c9-0b00cb0275b3]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad1b4b19-ad16-436c-9fa3-e718bea4f540 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c17592e-3227-473f-ac7b-3e911dcb0d56 (non-flash)\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:34:10 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-41190658-6f04-441a-9541-b620d0e33daa tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad1b4b19-ad16-436c-9fa3-e718bea4f540 (non-flash)
Aug 26 10:34:10 user nova-compute[73572]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c17592e-3227-473f-ac7b-3e911dcb0d56 (non-flash)
Aug 26 10:34:10 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 10:34:10 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-41190658-6f04-441a-9541-b620d0e33daa tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad1b4b19-ad16-436c-9fa3-e718bea4f540 (non-flash)
Aug 26 10:34:10 user nova-compute[73572]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c17592e-3227-473f-ac7b-3e911dcb0d56 (non-flash)
Aug 26 10:34:10 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 10:34:10 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec96ec24-bf73-4f38-ac9f-eb2699d0a661 -p 172.16.0.220:3260 --login {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:34:10 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec96ec24-bf73-4f38-ac9f-eb2699d0a661 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:34:10 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[242eb133-a45b-4d00-8f78-45239e758bb9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ec96ec24-bf73-4f38-ac9f-eb2699d0a661, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ec96ec24-bf73-4f38-ac9f-eb2699d0a661, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:34:10 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-41190658-6f04-441a-9541-b620d0e33daa tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ec96ec24-bf73-4f38-ac9f-eb2699d0a661, portal: 172.16.0.220,3260]
Aug 26 10:34:10 user nova-compute[73572]: Login to [iface: default, target: iqn.2010-10.org.openstack:ec96ec24-bf73-4f38-ac9f-eb2699d0a661, portal: 172.16.0.220,3260] successful.
Aug 26 10:34:10 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:34:10 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec96ec24-bf73-4f38-ac9f-eb2699d0a661 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:34:10 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec96ec24-bf73-4f38-ac9f-eb2699d0a661 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:34:10 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fd3a884-e720-4513-aba9-09d3205b61d0]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:34:10 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-41190658-6f04-441a-9541-b620d0e33daa tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:34:10 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:34:10 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:34:10 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[808d8c9e-0d07-4e6c-8eeb-51b3da2f638e]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad1b4b19-ad16-436c-9fa3-e718bea4f540 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c17592e-3227-473f-ac7b-3e911dcb0d56 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec96ec24-bf73-4f38-ac9f-eb2699d0a661 (non-flash)\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:34:10 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-41190658-6f04-441a-9541-b620d0e33daa tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad1b4b19-ad16-436c-9fa3-e718bea4f540 (non-flash)
Aug 26 10:34:10 user nova-compute[73572]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c17592e-3227-473f-ac7b-3e911dcb0d56 (non-flash)
Aug 26 10:34:10 user nova-compute[73572]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec96ec24-bf73-4f38-ac9f-eb2699d0a661 (non-flash)
Aug 26 10:34:10 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 10:34:10 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-41190658-6f04-441a-9541-b620d0e33daa tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad1b4b19-ad16-436c-9fa3-e718bea4f540 (non-flash)
Aug 26 10:34:10 user nova-compute[73572]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c17592e-3227-473f-ac7b-3e911dcb0d56 (non-flash)
Aug 26 10:34:10 user nova-compute[73572]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec96ec24-bf73-4f38-ac9f-eb2699d0a661 (non-flash)
Aug 26 10:34:10 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 10:34:10 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-41190658-6f04-441a-9541-b620d0e33daa tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ec96ec24-bf73-4f38-ac9f-eb2699d0a661" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.296s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 10:34:10 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-41190658-6f04-441a-9541-b620d0e33daa tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] Connected to 172.16.0.220:3260 {{(pid=73572) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 10:34:10 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-41190658-6f04-441a-9541-b620d0e33daa tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] HCTL ('35', '-', '-', 0) found on session 50 with lun 0 {{(pid=73572) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 10:34:10 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-41190658-6f04-441a-9541-b620d0e33daa tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73572) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 10:34:10 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:34:10 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:34:10 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d357bf8-7c3f-46c8-9b9a-242d11d00f7a]: (4, ('- - 0', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:34:10 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-41190658-6f04-441a-9541-b620d0e33daa tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] Searching for a device in session 50 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73572) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 10:34:10 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-41190658-6f04-441a-9541-b620d0e33daa tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tqbEgzCT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73572) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 10:34:10 user nova-compute[73572]: DEBUG nova.network.neutron [req-6a6e4d72-f04e-4624-90e7-4de0cec77c98 req-e7bbfa0a-da59-4f2b-8a49-9de3fe6d1896 service nova] [instance: 3a4c9522-9723-4ad4-8630-17a3aba70c98] Updated VIF entry in instance network info cache for port 663db499-c552-478e-bad7-938b2f65c619. {{(pid=73572) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 10:34:10 user nova-compute[73572]: DEBUG nova.network.neutron [req-6a6e4d72-f04e-4624-90e7-4de0cec77c98 req-e7bbfa0a-da59-4f2b-8a49-9de3fe6d1896 service nova] [instance: 3a4c9522-9723-4ad4-8630-17a3aba70c98] Updating instance_info_cache with network_info: [{"id": "663db499-c552-478e-bad7-938b2f65c619", "address": "fa:16:3e:fd:54:35", "network": {"id": "6bec7255-9e3a-43e3-aaf3-913e171ee99d", "bridge": "br-int", "label": "tempest-TestShelveInstance-1279582697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51eaa92831e54ba6bd3d71db1a4e24e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap663db499-c5", "ovs_interfaceid": "663db499-c552-478e-bad7-938b2f65c619", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:34:10 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-6a6e4d72-f04e-4624-90e7-4de0cec77c98 req-e7bbfa0a-da59-4f2b-8a49-9de3fe6d1896 service nova] Releasing lock "refresh_cache-3a4c9522-9723-4ad4-8630-17a3aba70c98" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:34:11 user nova-compute[73572]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693046036.229921, 773c7bf7-a911-4b80-9cef-5cc563257b7b => Stopped> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:34:11 user nova-compute[73572]: INFO nova.compute.manager [-] [instance: 773c7bf7-a911-4b80-9cef-5cc563257b7b] VM Stopped (Lifecycle Event)
Aug 26 10:34:11 user nova-compute[73572]: DEBUG nova.compute.manager [None req-de753cc2-01ae-43cb-8ab7-f5aae08d60f4 None None] [instance: 773c7bf7-a911-4b80-9cef-5cc563257b7b] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:34:11 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:34:11 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-41190658-6f04-441a-9541-b620d0e33daa tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.329s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 10:34:11 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-41190658-6f04-441a-9541-b620d0e33daa tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] <== connect_volume: return (1331ms) {'type': 'block', 'scsi_wwn': '26136623632336631', 'path': '/dev/sdd'} {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 10:34:11 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-41190658-6f04-441a-9541-b620d0e33daa tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] [instance: 3a4c9522-9723-4ad4-8630-17a3aba70c98] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26136623632336631', 'path': '/dev/sdd'} {{(pid=73572) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 10:34:11 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-41190658-6f04-441a-9541-b620d0e33daa tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-26T10:30:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-2038663999',display_name='tempest-TestShelveInstance-server-2038663999',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-2038663999',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-188411046',keypairs=<?>,launch_index=0,launched_at=2023-08-26T10:30:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='51eaa92831e54ba6bd3d71db1a4e24e0',ramdisk_id='',reservation_id='r-yp88ce4a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-912363172',owner_user_name='tempest-TestShelveInstance-912363172-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T10:33:56Z,user_data=None,user_id='6d0074f39a8141119bd94ffa83bd80aa',uuid=3a4c9522-9723-4ad4-8630-17a3aba70c98,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "663db499-c552-478e-bad7-938b2f65c619", "address": "fa:16:3e:fd:54:35", "network": {"id": "6bec7255-9e3a-43e3-aaf3-913e171ee99d", "bridge": "br-int", "label": "tempest-TestShelveInstance-1279582697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51eaa92831e54ba6bd3d71db1a4e24e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap663db499-c5", "ovs_interfaceid": "663db499-c552-478e-bad7-938b2f65c619", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73572) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 10:34:11 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-41190658-6f04-441a-9541-b620d0e33daa tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] Converting VIF {"id": "663db499-c552-478e-bad7-938b2f65c619", "address": "fa:16:3e:fd:54:35", "network": {"id": "6bec7255-9e3a-43e3-aaf3-913e171ee99d", "bridge": "br-int", "label": "tempest-TestShelveInstance-1279582697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51eaa92831e54ba6bd3d71db1a4e24e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap663db499-c5", "ovs_interfaceid": "663db499-c552-478e-bad7-938b2f65c619", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:34:11 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-41190658-6f04-441a-9541-b620d0e33daa tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:54:35,bridge_name='br-int',has_traffic_filtering=True,id=663db499-c552-478e-bad7-938b2f65c619,network=Network(6bec7255-9e3a-43e3-aaf3-913e171ee99d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap663db499-c5') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:34:11 user nova-compute[73572]: DEBUG nova.objects.instance [None req-41190658-6f04-441a-9541-b620d0e33daa tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] Lazy-loading 'pci_devices' on Instance uuid 3a4c9522-9723-4ad4-8630-17a3aba70c98 {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:34:11 user nova-compute[73572]: DEBUG nova.objects.base [None req-41190658-6f04-441a-9541-b620d0e33daa tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] Object Instance<3a4c9522-9723-4ad4-8630-17a3aba70c98> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices {{(pid=73572) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 10:34:11 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-41190658-6f04-441a-9541-b620d0e33daa tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] [instance: 3a4c9522-9723-4ad4-8630-17a3aba70c98] End _get_guest_xml xml=<domain type="kvm">
Aug 26 10:34:11 user nova-compute[73572]:   <uuid>3a4c9522-9723-4ad4-8630-17a3aba70c98</uuid>
Aug 26 10:34:11 user nova-compute[73572]:   <name>instance-0000002a</name>
Aug 26 10:34:11 user nova-compute[73572]:   <memory>524288</memory>
Aug 26 10:34:11 user nova-compute[73572]:   <vcpu>1</vcpu>
Aug 26 10:34:11 user nova-compute[73572]:   <metadata>
Aug 26 10:34:11 user nova-compute[73572]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 10:34:11 user nova-compute[73572]:       <nova:package version="0.0.0"/>
Aug 26 10:34:11 user nova-compute[73572]:       <nova:name>tempest-TestShelveInstance-server-2038663999</nova:name>
Aug 26 10:34:11 user nova-compute[73572]:       <nova:creationTime>2023-08-26 10:34:10</nova:creationTime>
Aug 26 10:34:11 user nova-compute[73572]:       <nova:flavor name="m1.tiny">
Aug 26 10:34:11 user nova-compute[73572]:         <nova:memory>512</nova:memory>
Aug 26 10:34:11 user nova-compute[73572]:         <nova:disk>1</nova:disk>
Aug 26 10:34:11 user nova-compute[73572]:         <nova:swap>0</nova:swap>
Aug 26 10:34:11 user nova-compute[73572]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 10:34:11 user nova-compute[73572]:         <nova:vcpus>1</nova:vcpus>
Aug 26 10:34:11 user nova-compute[73572]:       </nova:flavor>
Aug 26 10:34:11 user nova-compute[73572]:       <nova:owner>
Aug 26 10:34:11 user nova-compute[73572]:         <nova:user uuid="6d0074f39a8141119bd94ffa83bd80aa">tempest-TestShelveInstance-912363172-project-member</nova:user>
Aug 26 10:34:11 user nova-compute[73572]:         <nova:project uuid="51eaa92831e54ba6bd3d71db1a4e24e0">tempest-TestShelveInstance-912363172</nova:project>
Aug 26 10:34:11 user nova-compute[73572]:       </nova:owner>
Aug 26 10:34:11 user nova-compute[73572]:       <nova:ports>
Aug 26 10:34:11 user nova-compute[73572]:         <nova:port uuid="663db499-c552-478e-bad7-938b2f65c619">
Aug 26 10:34:11 user nova-compute[73572]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 26 10:34:11 user nova-compute[73572]:         </nova:port>
Aug 26 10:34:11 user nova-compute[73572]:       </nova:ports>
Aug 26 10:34:11 user nova-compute[73572]:     </nova:instance>
Aug 26 10:34:11 user nova-compute[73572]:   </metadata>
Aug 26 10:34:11 user nova-compute[73572]:   <sysinfo type="smbios">
Aug 26 10:34:11 user nova-compute[73572]:     <system>
Aug 26 10:34:11 user nova-compute[73572]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 10:34:11 user nova-compute[73572]:       <entry name="product">OpenStack Nova</entry>
Aug 26 10:34:11 user nova-compute[73572]:       <entry name="version">0.0.0</entry>
Aug 26 10:34:11 user nova-compute[73572]:       <entry name="serial">3a4c9522-9723-4ad4-8630-17a3aba70c98</entry>
Aug 26 10:34:11 user nova-compute[73572]:       <entry name="uuid">3a4c9522-9723-4ad4-8630-17a3aba70c98</entry>
Aug 26 10:34:11 user nova-compute[73572]:       <entry name="family">Virtual Machine</entry>
Aug 26 10:34:11 user nova-compute[73572]:     </system>
Aug 26 10:34:11 user nova-compute[73572]:   </sysinfo>
Aug 26 10:34:11 user nova-compute[73572]:   <os>
Aug 26 10:34:11 user nova-compute[73572]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 10:34:11 user nova-compute[73572]:     <boot dev="hd"/>
Aug 26 10:34:11 user nova-compute[73572]:     <smbios mode="sysinfo"/>
Aug 26 10:34:11 user nova-compute[73572]:   </os>
Aug 26 10:34:11 user nova-compute[73572]:   <features>
Aug 26 10:34:11 user nova-compute[73572]:     <acpi/>
Aug 26 10:34:11 user nova-compute[73572]:     <apic/>
Aug 26 10:34:11 user nova-compute[73572]:     <vmcoreinfo/>
Aug 26 10:34:11 user nova-compute[73572]:   </features>
Aug 26 10:34:11 user nova-compute[73572]:   <clock offset="utc">
Aug 26 10:34:11 user nova-compute[73572]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 10:34:11 user nova-compute[73572]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 10:34:11 user nova-compute[73572]:     <timer name="hpet" present="no"/>
Aug 26 10:34:11 user nova-compute[73572]:   </clock>
Aug 26 10:34:11 user nova-compute[73572]:   <cpu mode="custom" match="exact">
Aug 26 10:34:11 user nova-compute[73572]:     <model>Nehalem</model>
Aug 26 10:34:11 user nova-compute[73572]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 10:34:11 user nova-compute[73572]:   </cpu>
Aug 26 10:34:11 user nova-compute[73572]:   <devices>
Aug 26 10:34:11 user nova-compute[73572]:     <disk type="block" device="disk">
Aug 26 10:34:11 user nova-compute[73572]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 10:34:11 user nova-compute[73572]:       <source dev="/dev/sdd"/>
Aug 26 10:34:11 user nova-compute[73572]:       <target dev="vda" bus="virtio"/>
Aug 26 10:34:11 user nova-compute[73572]:       <serial>ec96ec24-bf73-4f38-ac9f-eb2699d0a661</serial>
Aug 26 10:34:11 user nova-compute[73572]:     </disk>
Aug 26 10:34:11 user nova-compute[73572]:     <interface type="ethernet">
Aug 26 10:34:11 user nova-compute[73572]:       <mac address="fa:16:3e:fd:54:35"/>
Aug 26 10:34:11 user nova-compute[73572]:       <model type="virtio"/>
Aug 26 10:34:11 user nova-compute[73572]:       <mtu size="1442"/>
Aug 26 10:34:11 user nova-compute[73572]:       <target dev="tap663db499-c5"/>
Aug 26 10:34:11 user nova-compute[73572]:     </interface>
Aug 26 10:34:11 user nova-compute[73572]:     <serial type="pty">
Aug 26 10:34:11 user nova-compute[73572]:       <log file="/opt/stack/data/nova/instances/3a4c9522-9723-4ad4-8630-17a3aba70c98/console.log" append="off"/>
Aug 26 10:34:11 user nova-compute[73572]:     </serial>
Aug 26 10:34:11 user nova-compute[73572]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 10:34:11 user nova-compute[73572]:     <video>
Aug 26 10:34:11 user nova-compute[73572]:       <model type="virtio"/>
Aug 26 10:34:11 user nova-compute[73572]:     </video>
Aug 26 10:34:11 user nova-compute[73572]:     <rng model="virtio">
Aug 26 10:34:11 user nova-compute[73572]:       <backend model="random">/dev/urandom</backend>
Aug 26 10:34:11 user nova-compute[73572]:     </rng>
Aug 26 10:34:11 user nova-compute[73572]:     <controller type="usb" index="0" model="none"/>
Aug 26 10:34:11 user nova-compute[73572]:     <memballoon model="virtio">
Aug 26 10:34:11 user nova-compute[73572]:       <stats period="10"/>
Aug 26 10:34:11 user nova-compute[73572]:     </memballoon>
Aug 26 10:34:11 user nova-compute[73572]:   </devices>
Aug 26 10:34:11 user nova-compute[73572]: </domain>
Aug 26 10:34:11 user nova-compute[73572]:  {{(pid=73572) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 10:34:11 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-41190658-6f04-441a-9541-b620d0e33daa tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-26T10:30:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-2038663999',display_name='tempest-TestShelveInstance-server-2038663999',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-2038663999',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-188411046',keypairs=<?>,launch_index=0,launched_at=2023-08-26T10:30:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='51eaa92831e54ba6bd3d71db1a4e24e0',ramdisk_id='',reservation_id='r-yp88ce4a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-912363172',owner_user_name='tempest-TestShelveInstance-912363172-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T10:33:56Z,user_data=None,user_id='6d0074f39a8141119bd94ffa83bd80aa',uuid=3a4c9522-9723-4ad4-8630-17a3aba70c98,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "663db499-c552-478e-bad7-938b2f65c619", "address": "fa:16:3e:fd:54:35", "network": {"id": "6bec7255-9e3a-43e3-aaf3-913e171ee99d", "bridge": "br-int", "label": "tempest-TestShelveInstance-1279582697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51eaa92831e54ba6bd3d71db1a4e24e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap663db499-c5", "ovs_interfaceid": "663db499-c552-478e-bad7-938b2f65c619", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 10:34:11 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-41190658-6f04-441a-9541-b620d0e33daa tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] Converting VIF {"id": "663db499-c552-478e-bad7-938b2f65c619", "address": "fa:16:3e:fd:54:35", "network": {"id": "6bec7255-9e3a-43e3-aaf3-913e171ee99d", "bridge": "br-int", "label": "tempest-TestShelveInstance-1279582697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51eaa92831e54ba6bd3d71db1a4e24e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap663db499-c5", "ovs_interfaceid": "663db499-c552-478e-bad7-938b2f65c619", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:34:11 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-41190658-6f04-441a-9541-b620d0e33daa tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:54:35,bridge_name='br-int',has_traffic_filtering=True,id=663db499-c552-478e-bad7-938b2f65c619,network=Network(6bec7255-9e3a-43e3-aaf3-913e171ee99d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap663db499-c5') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:34:11 user nova-compute[73572]: DEBUG os_vif [None req-41190658-6f04-441a-9541-b620d0e33daa tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:54:35,bridge_name='br-int',has_traffic_filtering=True,id=663db499-c552-478e-bad7-938b2f65c619,network=Network(6bec7255-9e3a-43e3-aaf3-913e171ee99d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap663db499-c5') {{(pid=73572) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 10:34:11 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:34:11 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:34:11 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 10:34:11 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:34:11 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap663db499-c5, may_exist=True, interface_attrs={}) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:34:11 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap663db499-c5, col_values=(('external_ids', {'iface-id': '663db499-c552-478e-bad7-938b2f65c619', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fd:54:35', 'vm-uuid': '3a4c9522-9723-4ad4-8630-17a3aba70c98'}),), if_exists=True) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:34:11 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:34:11 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:34:11 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:34:11 user nova-compute[73572]: INFO os_vif [None req-41190658-6f04-441a-9541-b620d0e33daa tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:54:35,bridge_name='br-int',has_traffic_filtering=True,id=663db499-c552-478e-bad7-938b2f65c619,network=Network(6bec7255-9e3a-43e3-aaf3-913e171ee99d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap663db499-c5')
Aug 26 10:34:11 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-41190658-6f04-441a-9541-b620d0e33daa tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] No BDM found with device name vda, not building metadata. {{(pid=73572) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 10:34:11 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-41190658-6f04-441a-9541-b620d0e33daa tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] No VIF found with MAC fa:16:3e:fd:54:35, not building metadata {{(pid=73572) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 10:34:12 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:34:13 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:34:13 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:34:13 user nova-compute[73572]: DEBUG nova.compute.manager [req-135da2d6-0cfc-4db0-93bd-9939458e5d90 req-52354014-5f6c-4cf9-8f4c-b6431fe84d53 service nova] [instance: 3a4c9522-9723-4ad4-8630-17a3aba70c98] Received event network-vif-plugged-663db499-c552-478e-bad7-938b2f65c619 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:34:13 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-135da2d6-0cfc-4db0-93bd-9939458e5d90 req-52354014-5f6c-4cf9-8f4c-b6431fe84d53 service nova] Acquiring lock "3a4c9522-9723-4ad4-8630-17a3aba70c98-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:34:13 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-135da2d6-0cfc-4db0-93bd-9939458e5d90 req-52354014-5f6c-4cf9-8f4c-b6431fe84d53 service nova] Lock "3a4c9522-9723-4ad4-8630-17a3aba70c98-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:34:13 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-135da2d6-0cfc-4db0-93bd-9939458e5d90 req-52354014-5f6c-4cf9-8f4c-b6431fe84d53 service nova] Lock "3a4c9522-9723-4ad4-8630-17a3aba70c98-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:34:13 user nova-compute[73572]: DEBUG nova.compute.manager [req-135da2d6-0cfc-4db0-93bd-9939458e5d90 req-52354014-5f6c-4cf9-8f4c-b6431fe84d53 service nova] [instance: 3a4c9522-9723-4ad4-8630-17a3aba70c98] No waiting events found dispatching network-vif-plugged-663db499-c552-478e-bad7-938b2f65c619 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:34:13 user nova-compute[73572]: WARNING nova.compute.manager [req-135da2d6-0cfc-4db0-93bd-9939458e5d90 req-52354014-5f6c-4cf9-8f4c-b6431fe84d53 service nova] [instance: 3a4c9522-9723-4ad4-8630-17a3aba70c98] Received unexpected event network-vif-plugged-663db499-c552-478e-bad7-938b2f65c619 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 26 10:34:13 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:34:13 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:34:13 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:34:13 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:34:13 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:34:15 user nova-compute[73572]: DEBUG nova.compute.manager [req-f5cd6f37-9a37-46ca-8096-36d38f529edc req-664c4fc5-81ff-40f4-bbb7-c925eac034e9 service nova] [instance: 3a4c9522-9723-4ad4-8630-17a3aba70c98] Received event network-vif-plugged-663db499-c552-478e-bad7-938b2f65c619 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:34:15 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-f5cd6f37-9a37-46ca-8096-36d38f529edc req-664c4fc5-81ff-40f4-bbb7-c925eac034e9 service nova] Acquiring lock "3a4c9522-9723-4ad4-8630-17a3aba70c98-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:34:15 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-f5cd6f37-9a37-46ca-8096-36d38f529edc req-664c4fc5-81ff-40f4-bbb7-c925eac034e9 service nova] Lock "3a4c9522-9723-4ad4-8630-17a3aba70c98-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:34:15 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-f5cd6f37-9a37-46ca-8096-36d38f529edc req-664c4fc5-81ff-40f4-bbb7-c925eac034e9 service nova] Lock "3a4c9522-9723-4ad4-8630-17a3aba70c98-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.004s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:34:15 user nova-compute[73572]: DEBUG nova.compute.manager [req-f5cd6f37-9a37-46ca-8096-36d38f529edc req-664c4fc5-81ff-40f4-bbb7-c925eac034e9 service nova] [instance: 3a4c9522-9723-4ad4-8630-17a3aba70c98] No waiting events found dispatching network-vif-plugged-663db499-c552-478e-bad7-938b2f65c619 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:34:15 user nova-compute[73572]: WARNING nova.compute.manager [req-f5cd6f37-9a37-46ca-8096-36d38f529edc req-664c4fc5-81ff-40f4-bbb7-c925eac034e9 service nova] [instance: 3a4c9522-9723-4ad4-8630-17a3aba70c98] Received unexpected event network-vif-plugged-663db499-c552-478e-bad7-938b2f65c619 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 26 10:34:15 user nova-compute[73572]: DEBUG nova.virt.driver [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Emitting event <LifecycleEvent: 1693046055.3889134, 3a4c9522-9723-4ad4-8630-17a3aba70c98 => Resumed> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:34:15 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 3a4c9522-9723-4ad4-8630-17a3aba70c98] VM Resumed (Lifecycle Event)
Aug 26 10:34:15 user nova-compute[73572]: DEBUG nova.compute.manager [None req-41190658-6f04-441a-9541-b620d0e33daa tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] [instance: 3a4c9522-9723-4ad4-8630-17a3aba70c98] Instance event wait completed in 0 seconds for  {{(pid=73572) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 10:34:15 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-41190658-6f04-441a-9541-b620d0e33daa tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] [instance: 3a4c9522-9723-4ad4-8630-17a3aba70c98] Guest created on hypervisor {{(pid=73572) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 10:34:15 user nova-compute[73572]: INFO nova.virt.libvirt.driver [-] [instance: 3a4c9522-9723-4ad4-8630-17a3aba70c98] Instance spawned successfully.
Aug 26 10:34:15 user nova-compute[73572]: DEBUG nova.compute.manager [None req-41190658-6f04-441a-9541-b620d0e33daa tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] [instance: 3a4c9522-9723-4ad4-8630-17a3aba70c98] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:34:15 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 3a4c9522-9723-4ad4-8630-17a3aba70c98] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:34:15 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 3a4c9522-9723-4ad4-8630-17a3aba70c98] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=73572) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 10:34:15 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 3a4c9522-9723-4ad4-8630-17a3aba70c98] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 10:34:15 user nova-compute[73572]: DEBUG nova.virt.driver [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Emitting event <LifecycleEvent: 1693046055.3934278, 3a4c9522-9723-4ad4-8630-17a3aba70c98 => Started> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:34:15 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 3a4c9522-9723-4ad4-8630-17a3aba70c98] VM Started (Lifecycle Event)
Aug 26 10:34:15 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:34:15 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 3a4c9522-9723-4ad4-8630-17a3aba70c98] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:34:15 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-41190658-6f04-441a-9541-b620d0e33daa tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] Lock "3a4c9522-9723-4ad4-8630-17a3aba70c98" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 19.173s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:34:15 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 3a4c9522-9723-4ad4-8630-17a3aba70c98] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=73572) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 10:34:16 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:34:21 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:34:25 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:34:25 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Starting heal instance info cache {{(pid=73572) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 10:34:25 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquiring lock "refresh_cache-68613b1e-c45c-4fd9-834c-3630ed0f456a" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:34:25 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquired lock "refresh_cache-68613b1e-c45c-4fd9-834c-3630ed0f456a" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:34:25 user nova-compute[73572]: DEBUG nova.network.neutron [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] [instance: 68613b1e-c45c-4fd9-834c-3630ed0f456a] Forcefully refreshing network info cache for instance {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 10:34:26 user nova-compute[73572]: DEBUG nova.network.neutron [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] [instance: 68613b1e-c45c-4fd9-834c-3630ed0f456a] Updating instance_info_cache with network_info: [{"id": "aa5ef0b6-0379-4e59-a2c7-e7f1ecd3c7cb", "address": "fa:16:3e:30:8b:7a", "network": {"id": "43215883-3d00-4be7-8c40-bdaf3f01bef9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1088544153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7935bccc360b46b589fd57d53f334595", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa5ef0b6-03", "ovs_interfaceid": "aa5ef0b6-0379-4e59-a2c7-e7f1ecd3c7cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:34:26 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Releasing lock "refresh_cache-68613b1e-c45c-4fd9-834c-3630ed0f456a" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:34:26 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] [instance: 68613b1e-c45c-4fd9-834c-3630ed0f456a] Updated the network info_cache for instance {{(pid=73572) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 10:34:26 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:34:26 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:34:26 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:34:26 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:34:26 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73572) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 10:34:26 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73572) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 10:34:26 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73572) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 10:34:26 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:34:27 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:34:28 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:34:28 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73572) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 10:34:30 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9f77aeda-a94b-4d58-b920-b8c1a9e3b1ad tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Acquiring lock "1c8e780d-0a13-4484-bf18-ac0879db263a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:34:30 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9f77aeda-a94b-4d58-b920-b8c1a9e3b1ad tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Lock "1c8e780d-0a13-4484-bf18-ac0879db263a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:34:30 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9f77aeda-a94b-4d58-b920-b8c1a9e3b1ad tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Acquiring lock "1c8e780d-0a13-4484-bf18-ac0879db263a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:34:30 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9f77aeda-a94b-4d58-b920-b8c1a9e3b1ad tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Lock "1c8e780d-0a13-4484-bf18-ac0879db263a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:34:30 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9f77aeda-a94b-4d58-b920-b8c1a9e3b1ad tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Lock "1c8e780d-0a13-4484-bf18-ac0879db263a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:34:30 user nova-compute[73572]: INFO nova.compute.manager [None req-9f77aeda-a94b-4d58-b920-b8c1a9e3b1ad tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] [instance: 1c8e780d-0a13-4484-bf18-ac0879db263a] Terminating instance
Aug 26 10:34:30 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9f77aeda-a94b-4d58-b920-b8c1a9e3b1ad tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] [instance: 1c8e780d-0a13-4484-bf18-ac0879db263a] Start destroying the instance on the hypervisor. {{(pid=73572) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 10:34:30 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:34:30 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:34:30 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:34:30 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:34:30 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:34:30 user nova-compute[73572]: DEBUG nova.compute.manager [req-ae21c556-a572-40fd-b84d-1785e9b00e22 req-363642cf-2491-46f5-b261-c3b5e7be28d7 service nova] [instance: 1c8e780d-0a13-4484-bf18-ac0879db263a] Received event network-vif-unplugged-d03460b0-e0b9-4c39-a8a6-12cb80aca6bc {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:34:30 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-ae21c556-a572-40fd-b84d-1785e9b00e22 req-363642cf-2491-46f5-b261-c3b5e7be28d7 service nova] Acquiring lock "1c8e780d-0a13-4484-bf18-ac0879db263a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:34:30 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-ae21c556-a572-40fd-b84d-1785e9b00e22 req-363642cf-2491-46f5-b261-c3b5e7be28d7 service nova] Lock "1c8e780d-0a13-4484-bf18-ac0879db263a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:34:30 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-ae21c556-a572-40fd-b84d-1785e9b00e22 req-363642cf-2491-46f5-b261-c3b5e7be28d7 service nova] Lock "1c8e780d-0a13-4484-bf18-ac0879db263a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:34:30 user nova-compute[73572]: DEBUG nova.compute.manager [req-ae21c556-a572-40fd-b84d-1785e9b00e22 req-363642cf-2491-46f5-b261-c3b5e7be28d7 service nova] [instance: 1c8e780d-0a13-4484-bf18-ac0879db263a] No waiting events found dispatching network-vif-unplugged-d03460b0-e0b9-4c39-a8a6-12cb80aca6bc {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:34:30 user nova-compute[73572]: DEBUG nova.compute.manager [req-ae21c556-a572-40fd-b84d-1785e9b00e22 req-363642cf-2491-46f5-b261-c3b5e7be28d7 service nova] [instance: 1c8e780d-0a13-4484-bf18-ac0879db263a] Received event network-vif-unplugged-d03460b0-e0b9-4c39-a8a6-12cb80aca6bc for instance with task_state deleting. {{(pid=73572) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 10:34:30 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:34:30 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:34:30 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:34:30 user nova-compute[73572]: INFO nova.virt.libvirt.driver [-] [instance: 1c8e780d-0a13-4484-bf18-ac0879db263a] Instance destroyed successfully.
Aug 26 10:34:30 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:34:30 user nova-compute[73572]: DEBUG nova.objects.instance [None req-9f77aeda-a94b-4d58-b920-b8c1a9e3b1ad tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Lazy-loading 'resources' on Instance uuid 1c8e780d-0a13-4484-bf18-ac0879db263a {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:34:30 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-9f77aeda-a94b-4d58-b920-b8c1a9e3b1ad tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T10:27:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-821156998',display_name='tempest-ServerRescueNegativeTestJSON-server-821156998',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-821156998',id=40,image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBdJWXCpcpht4n3qLptinC08jNqNS/A7/DSoqFpXtHq2HTCyjzpcW8MUPvSYgPW74WssX1EyPCLQNLXv88U5ywgbLueToZjk8R5ItyFWItCp9yIBOnN3M8i0e9J/+MVdhA==',key_name='tempest-keypair-1014482907',keypairs=<?>,launch_index=0,launched_at=2023-08-26T10:30:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c1bff48d66894950ac6690e1fd0e79b9',ramdisk_id='',reservation_id='r-wv0dakc2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1710547876',owner_user_name='tempest-ServerRescueNegativeTestJSON-1710547876-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T10:31:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='099462c61dcc4816b17d2d0155823873',uuid=1c8e780d-0a13-4484-bf18-ac0879db263a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d03460b0-e0b9-4c39-a8a6-12cb80aca6bc", "address": "fa:16:3e:c2:0f:20", "network": {"id": "757e71b4-5177-45a5-8ef5-9b27f42092f1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1765327616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1bff48d66894950ac6690e1fd0e79b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd03460b0-e0", "ovs_interfaceid": "d03460b0-e0b9-4c39-a8a6-12cb80aca6bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 10:34:30 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-9f77aeda-a94b-4d58-b920-b8c1a9e3b1ad tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Converting VIF {"id": "d03460b0-e0b9-4c39-a8a6-12cb80aca6bc", "address": "fa:16:3e:c2:0f:20", "network": {"id": "757e71b4-5177-45a5-8ef5-9b27f42092f1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1765327616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1bff48d66894950ac6690e1fd0e79b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd03460b0-e0", "ovs_interfaceid": "d03460b0-e0b9-4c39-a8a6-12cb80aca6bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:34:30 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-9f77aeda-a94b-4d58-b920-b8c1a9e3b1ad tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c2:0f:20,bridge_name='br-int',has_traffic_filtering=True,id=d03460b0-e0b9-4c39-a8a6-12cb80aca6bc,network=Network(757e71b4-5177-45a5-8ef5-9b27f42092f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd03460b0-e0') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:34:30 user nova-compute[73572]: DEBUG os_vif [None req-9f77aeda-a94b-4d58-b920-b8c1a9e3b1ad tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c2:0f:20,bridge_name='br-int',has_traffic_filtering=True,id=d03460b0-e0b9-4c39-a8a6-12cb80aca6bc,network=Network(757e71b4-5177-45a5-8ef5-9b27f42092f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd03460b0-e0') {{(pid=73572) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 10:34:30 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:34:30 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd03460b0-e0, bridge=br-int, if_exists=True) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:34:30 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:34:30 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:34:30 user nova-compute[73572]: INFO os_vif [None req-9f77aeda-a94b-4d58-b920-b8c1a9e3b1ad tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c2:0f:20,bridge_name='br-int',has_traffic_filtering=True,id=d03460b0-e0b9-4c39-a8a6-12cb80aca6bc,network=Network(757e71b4-5177-45a5-8ef5-9b27f42092f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd03460b0-e0')
Aug 26 10:34:30 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-9f77aeda-a94b-4d58-b920-b8c1a9e3b1ad tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] [instance: 1c8e780d-0a13-4484-bf18-ac0879db263a] Deleting instance files /opt/stack/data/nova/instances/1c8e780d-0a13-4484-bf18-ac0879db263a_del
Aug 26 10:34:30 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-9f77aeda-a94b-4d58-b920-b8c1a9e3b1ad tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] [instance: 1c8e780d-0a13-4484-bf18-ac0879db263a] Deletion of /opt/stack/data/nova/instances/1c8e780d-0a13-4484-bf18-ac0879db263a_del complete
Aug 26 10:34:30 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:34:30 user nova-compute[73572]: INFO nova.compute.manager [None req-9f77aeda-a94b-4d58-b920-b8c1a9e3b1ad tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] [instance: 1c8e780d-0a13-4484-bf18-ac0879db263a] Took 0.90 seconds to destroy the instance on the hypervisor.
Aug 26 10:34:30 user nova-compute[73572]: DEBUG oslo.service.loopingcall [None req-9f77aeda-a94b-4d58-b920-b8c1a9e3b1ad tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73572) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 10:34:30 user nova-compute[73572]: DEBUG nova.compute.manager [-] [instance: 1c8e780d-0a13-4484-bf18-ac0879db263a] Deallocating network for instance {{(pid=73572) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 10:34:30 user nova-compute[73572]: DEBUG nova.network.neutron [-] [instance: 1c8e780d-0a13-4484-bf18-ac0879db263a] deallocate_for_instance() {{(pid=73572) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 10:34:31 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:34:31 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:34:31 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:34:31 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:34:32 user nova-compute[73572]: DEBUG nova.network.neutron [-] [instance: 1c8e780d-0a13-4484-bf18-ac0879db263a] Updating instance_info_cache with network_info: [] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:34:32 user nova-compute[73572]: INFO nova.compute.manager [-] [instance: 1c8e780d-0a13-4484-bf18-ac0879db263a] Took 1.43 seconds to deallocate network for instance.
Aug 26 10:34:32 user nova-compute[73572]: DEBUG nova.compute.manager [req-31e35e3b-e283-4806-bb0b-f38276495203 req-e084ddd9-32f6-4193-ae6d-7c820ad34fe2 service nova] [instance: 1c8e780d-0a13-4484-bf18-ac0879db263a] Received event network-vif-deleted-d03460b0-e0b9-4c39-a8a6-12cb80aca6bc {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:34:32 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9f77aeda-a94b-4d58-b920-b8c1a9e3b1ad tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:34:32 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9f77aeda-a94b-4d58-b920-b8c1a9e3b1ad tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:34:32 user nova-compute[73572]: DEBUG nova.compute.manager [req-dcb887b1-098a-4474-8b5b-d99bbe0da981 req-1eb6ebed-fbde-466a-bac5-7888f6560106 service nova] [instance: 1c8e780d-0a13-4484-bf18-ac0879db263a] Received event network-vif-plugged-d03460b0-e0b9-4c39-a8a6-12cb80aca6bc {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:34:32 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-dcb887b1-098a-4474-8b5b-d99bbe0da981 req-1eb6ebed-fbde-466a-bac5-7888f6560106 service nova] Acquiring lock "1c8e780d-0a13-4484-bf18-ac0879db263a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:34:32 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-dcb887b1-098a-4474-8b5b-d99bbe0da981 req-1eb6ebed-fbde-466a-bac5-7888f6560106 service nova] Lock "1c8e780d-0a13-4484-bf18-ac0879db263a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:34:32 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-dcb887b1-098a-4474-8b5b-d99bbe0da981 req-1eb6ebed-fbde-466a-bac5-7888f6560106 service nova] Lock "1c8e780d-0a13-4484-bf18-ac0879db263a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:34:32 user nova-compute[73572]: DEBUG nova.compute.manager [req-dcb887b1-098a-4474-8b5b-d99bbe0da981 req-1eb6ebed-fbde-466a-bac5-7888f6560106 service nova] [instance: 1c8e780d-0a13-4484-bf18-ac0879db263a] No waiting events found dispatching network-vif-plugged-d03460b0-e0b9-4c39-a8a6-12cb80aca6bc {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:34:32 user nova-compute[73572]: WARNING nova.compute.manager [req-dcb887b1-098a-4474-8b5b-d99bbe0da981 req-1eb6ebed-fbde-466a-bac5-7888f6560106 service nova] [instance: 1c8e780d-0a13-4484-bf18-ac0879db263a] Received unexpected event network-vif-plugged-d03460b0-e0b9-4c39-a8a6-12cb80aca6bc for instance with vm_state deleted and task_state None.
Aug 26 10:34:32 user nova-compute[73572]: DEBUG nova.compute.manager [req-dcb887b1-098a-4474-8b5b-d99bbe0da981 req-1eb6ebed-fbde-466a-bac5-7888f6560106 service nova] [instance: 1c8e780d-0a13-4484-bf18-ac0879db263a] Received event network-vif-plugged-d03460b0-e0b9-4c39-a8a6-12cb80aca6bc {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:34:32 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-dcb887b1-098a-4474-8b5b-d99bbe0da981 req-1eb6ebed-fbde-466a-bac5-7888f6560106 service nova] Acquiring lock "1c8e780d-0a13-4484-bf18-ac0879db263a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:34:32 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-dcb887b1-098a-4474-8b5b-d99bbe0da981 req-1eb6ebed-fbde-466a-bac5-7888f6560106 service nova] Lock "1c8e780d-0a13-4484-bf18-ac0879db263a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:34:32 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-dcb887b1-098a-4474-8b5b-d99bbe0da981 req-1eb6ebed-fbde-466a-bac5-7888f6560106 service nova] Lock "1c8e780d-0a13-4484-bf18-ac0879db263a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:34:32 user nova-compute[73572]: DEBUG nova.compute.manager [req-dcb887b1-098a-4474-8b5b-d99bbe0da981 req-1eb6ebed-fbde-466a-bac5-7888f6560106 service nova] [instance: 1c8e780d-0a13-4484-bf18-ac0879db263a] No waiting events found dispatching network-vif-plugged-d03460b0-e0b9-4c39-a8a6-12cb80aca6bc {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:34:32 user nova-compute[73572]: WARNING nova.compute.manager [req-dcb887b1-098a-4474-8b5b-d99bbe0da981 req-1eb6ebed-fbde-466a-bac5-7888f6560106 service nova] [instance: 1c8e780d-0a13-4484-bf18-ac0879db263a] Received unexpected event network-vif-plugged-d03460b0-e0b9-4c39-a8a6-12cb80aca6bc for instance with vm_state deleted and task_state None.
Aug 26 10:34:32 user nova-compute[73572]: DEBUG nova.compute.manager [req-dcb887b1-098a-4474-8b5b-d99bbe0da981 req-1eb6ebed-fbde-466a-bac5-7888f6560106 service nova] [instance: 1c8e780d-0a13-4484-bf18-ac0879db263a] Received event network-vif-plugged-d03460b0-e0b9-4c39-a8a6-12cb80aca6bc {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:34:32 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-dcb887b1-098a-4474-8b5b-d99bbe0da981 req-1eb6ebed-fbde-466a-bac5-7888f6560106 service nova] Acquiring lock "1c8e780d-0a13-4484-bf18-ac0879db263a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:34:32 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-dcb887b1-098a-4474-8b5b-d99bbe0da981 req-1eb6ebed-fbde-466a-bac5-7888f6560106 service nova] Lock "1c8e780d-0a13-4484-bf18-ac0879db263a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:34:32 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-dcb887b1-098a-4474-8b5b-d99bbe0da981 req-1eb6ebed-fbde-466a-bac5-7888f6560106 service nova] Lock "1c8e780d-0a13-4484-bf18-ac0879db263a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:34:32 user nova-compute[73572]: DEBUG nova.compute.manager [req-dcb887b1-098a-4474-8b5b-d99bbe0da981 req-1eb6ebed-fbde-466a-bac5-7888f6560106 service nova] [instance: 1c8e780d-0a13-4484-bf18-ac0879db263a] No waiting events found dispatching network-vif-plugged-d03460b0-e0b9-4c39-a8a6-12cb80aca6bc {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:34:32 user nova-compute[73572]: WARNING nova.compute.manager [req-dcb887b1-098a-4474-8b5b-d99bbe0da981 req-1eb6ebed-fbde-466a-bac5-7888f6560106 service nova] [instance: 1c8e780d-0a13-4484-bf18-ac0879db263a] Received unexpected event network-vif-plugged-d03460b0-e0b9-4c39-a8a6-12cb80aca6bc for instance with vm_state deleted and task_state None.
Aug 26 10:34:32 user nova-compute[73572]: DEBUG nova.compute.manager [req-dcb887b1-098a-4474-8b5b-d99bbe0da981 req-1eb6ebed-fbde-466a-bac5-7888f6560106 service nova] [instance: 1c8e780d-0a13-4484-bf18-ac0879db263a] Received event network-vif-unplugged-d03460b0-e0b9-4c39-a8a6-12cb80aca6bc {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:34:32 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-dcb887b1-098a-4474-8b5b-d99bbe0da981 req-1eb6ebed-fbde-466a-bac5-7888f6560106 service nova] Acquiring lock "1c8e780d-0a13-4484-bf18-ac0879db263a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:34:32 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-dcb887b1-098a-4474-8b5b-d99bbe0da981 req-1eb6ebed-fbde-466a-bac5-7888f6560106 service nova] Lock "1c8e780d-0a13-4484-bf18-ac0879db263a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:34:32 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-dcb887b1-098a-4474-8b5b-d99bbe0da981 req-1eb6ebed-fbde-466a-bac5-7888f6560106 service nova] Lock "1c8e780d-0a13-4484-bf18-ac0879db263a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:34:32 user nova-compute[73572]: DEBUG nova.compute.manager [req-dcb887b1-098a-4474-8b5b-d99bbe0da981 req-1eb6ebed-fbde-466a-bac5-7888f6560106 service nova] [instance: 1c8e780d-0a13-4484-bf18-ac0879db263a] No waiting events found dispatching network-vif-unplugged-d03460b0-e0b9-4c39-a8a6-12cb80aca6bc {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:34:32 user nova-compute[73572]: WARNING nova.compute.manager [req-dcb887b1-098a-4474-8b5b-d99bbe0da981 req-1eb6ebed-fbde-466a-bac5-7888f6560106 service nova] [instance: 1c8e780d-0a13-4484-bf18-ac0879db263a] Received unexpected event network-vif-unplugged-d03460b0-e0b9-4c39-a8a6-12cb80aca6bc for instance with vm_state deleted and task_state None.
Aug 26 10:34:32 user nova-compute[73572]: DEBUG nova.compute.manager [req-dcb887b1-098a-4474-8b5b-d99bbe0da981 req-1eb6ebed-fbde-466a-bac5-7888f6560106 service nova] [instance: 1c8e780d-0a13-4484-bf18-ac0879db263a] Received event network-vif-plugged-d03460b0-e0b9-4c39-a8a6-12cb80aca6bc {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:34:32 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-dcb887b1-098a-4474-8b5b-d99bbe0da981 req-1eb6ebed-fbde-466a-bac5-7888f6560106 service nova] Acquiring lock "1c8e780d-0a13-4484-bf18-ac0879db263a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:34:32 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-dcb887b1-098a-4474-8b5b-d99bbe0da981 req-1eb6ebed-fbde-466a-bac5-7888f6560106 service nova] Lock "1c8e780d-0a13-4484-bf18-ac0879db263a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:34:32 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-dcb887b1-098a-4474-8b5b-d99bbe0da981 req-1eb6ebed-fbde-466a-bac5-7888f6560106 service nova] Lock "1c8e780d-0a13-4484-bf18-ac0879db263a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:34:32 user nova-compute[73572]: DEBUG nova.compute.manager [req-dcb887b1-098a-4474-8b5b-d99bbe0da981 req-1eb6ebed-fbde-466a-bac5-7888f6560106 service nova] [instance: 1c8e780d-0a13-4484-bf18-ac0879db263a] No waiting events found dispatching network-vif-plugged-d03460b0-e0b9-4c39-a8a6-12cb80aca6bc {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:34:32 user nova-compute[73572]: WARNING nova.compute.manager [req-dcb887b1-098a-4474-8b5b-d99bbe0da981 req-1eb6ebed-fbde-466a-bac5-7888f6560106 service nova] [instance: 1c8e780d-0a13-4484-bf18-ac0879db263a] Received unexpected event network-vif-plugged-d03460b0-e0b9-4c39-a8a6-12cb80aca6bc for instance with vm_state deleted and task_state None.
Aug 26 10:34:32 user nova-compute[73572]: DEBUG nova.compute.provider_tree [None req-9f77aeda-a94b-4d58-b920-b8c1a9e3b1ad tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Inventory has not changed in ProviderTree for provider: e2cec974-59b2-4c77-a53d-a7f4e5a30d75 {{(pid=73572) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 10:34:32 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-9f77aeda-a94b-4d58-b920-b8c1a9e3b1ad tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Inventory has not changed for provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73572) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 10:34:32 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9f77aeda-a94b-4d58-b920-b8c1a9e3b1ad tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.320s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:34:32 user nova-compute[73572]: INFO nova.scheduler.client.report [None req-9f77aeda-a94b-4d58-b920-b8c1a9e3b1ad tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Deleted allocations for instance 1c8e780d-0a13-4484-bf18-ac0879db263a
Aug 26 10:34:33 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9f77aeda-a94b-4d58-b920-b8c1a9e3b1ad tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Lock "1c8e780d-0a13-4484-bf18-ac0879db263a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.122s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:34:35 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:34:35 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:34:35 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:34:35 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:34:36 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:34:36 user nova-compute[73572]: DEBUG nova.compute.manager [req-f5aa1628-b25a-490c-b3fe-b991cc264227 req-0c0477b5-4503-460f-ab9b-aea9348fc5b3 service nova] [instance: 7e3fd7ab-91ae-48b9-b436-b154c332869c] Received event network-changed-47c9677e-a234-4f8f-8cdc-5f1fdb21c760 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:34:36 user nova-compute[73572]: DEBUG nova.compute.manager [req-f5aa1628-b25a-490c-b3fe-b991cc264227 req-0c0477b5-4503-460f-ab9b-aea9348fc5b3 service nova] [instance: 7e3fd7ab-91ae-48b9-b436-b154c332869c] Refreshing instance network info cache due to event network-changed-47c9677e-a234-4f8f-8cdc-5f1fdb21c760. {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 10:34:36 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-f5aa1628-b25a-490c-b3fe-b991cc264227 req-0c0477b5-4503-460f-ab9b-aea9348fc5b3 service nova] Acquiring lock "refresh_cache-7e3fd7ab-91ae-48b9-b436-b154c332869c" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:34:36 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-f5aa1628-b25a-490c-b3fe-b991cc264227 req-0c0477b5-4503-460f-ab9b-aea9348fc5b3 service nova] Acquired lock "refresh_cache-7e3fd7ab-91ae-48b9-b436-b154c332869c" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:34:36 user nova-compute[73572]: DEBUG nova.network.neutron [req-f5aa1628-b25a-490c-b3fe-b991cc264227 req-0c0477b5-4503-460f-ab9b-aea9348fc5b3 service nova] [instance: 7e3fd7ab-91ae-48b9-b436-b154c332869c] Refreshing network info cache for port 47c9677e-a234-4f8f-8cdc-5f1fdb21c760 {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 10:34:36 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:34:36 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:34:36 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:34:36 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Auditing locally available compute resources for user (node: user) {{(pid=73572) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 10:34:36 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73572) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 10:34:36 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86923c1a-89a5-4e7a-b488-8bf3a013bf83/disk.rescue --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:34:37 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86923c1a-89a5-4e7a-b488-8bf3a013bf83/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:34:37 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86923c1a-89a5-4e7a-b488-8bf3a013bf83/disk.rescue --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:34:37 user nova-compute[73572]: DEBUG nova.network.neutron [req-f5aa1628-b25a-490c-b3fe-b991cc264227 req-0c0477b5-4503-460f-ab9b-aea9348fc5b3 service nova] [instance: 7e3fd7ab-91ae-48b9-b436-b154c332869c] Updated VIF entry in instance network info cache for port 47c9677e-a234-4f8f-8cdc-5f1fdb21c760. {{(pid=73572) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 10:34:37 user nova-compute[73572]: DEBUG nova.network.neutron [req-f5aa1628-b25a-490c-b3fe-b991cc264227 req-0c0477b5-4503-460f-ab9b-aea9348fc5b3 service nova] [instance: 7e3fd7ab-91ae-48b9-b436-b154c332869c] Updating instance_info_cache with network_info: [{"id": "47c9677e-a234-4f8f-8cdc-5f1fdb21c760", "address": "fa:16:3e:0d:dd:ea", "network": {"id": "c520ee18-34a7-4781-bc97-419e9a702d40", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-280196989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfc130586d9f4581953f1b8ae1c4465e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47c9677e-a2", "ovs_interfaceid": "47c9677e-a234-4f8f-8cdc-5f1fdb21c760", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:34:37 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-f5aa1628-b25a-490c-b3fe-b991cc264227 req-0c0477b5-4503-460f-ab9b-aea9348fc5b3 service nova] Releasing lock "refresh_cache-7e3fd7ab-91ae-48b9-b436-b154c332869c" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:34:37 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86923c1a-89a5-4e7a-b488-8bf3a013bf83/disk.rescue --force-share --output=json" returned: 0 in 0.191s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:34:37 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86923c1a-89a5-4e7a-b488-8bf3a013bf83/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:34:37 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-c54f70ef-216c-4845-940a-459db081c302 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Acquiring lock "7e3fd7ab-91ae-48b9-b436-b154c332869c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:34:37 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-c54f70ef-216c-4845-940a-459db081c302 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Lock "7e3fd7ab-91ae-48b9-b436-b154c332869c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:34:37 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-c54f70ef-216c-4845-940a-459db081c302 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Acquiring lock "7e3fd7ab-91ae-48b9-b436-b154c332869c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:34:37 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-c54f70ef-216c-4845-940a-459db081c302 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Lock "7e3fd7ab-91ae-48b9-b436-b154c332869c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:34:37 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-c54f70ef-216c-4845-940a-459db081c302 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Lock "7e3fd7ab-91ae-48b9-b436-b154c332869c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:34:37 user nova-compute[73572]: INFO nova.compute.manager [None req-c54f70ef-216c-4845-940a-459db081c302 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 7e3fd7ab-91ae-48b9-b436-b154c332869c] Terminating instance
Aug 26 10:34:37 user nova-compute[73572]: DEBUG nova.compute.manager [None req-c54f70ef-216c-4845-940a-459db081c302 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 7e3fd7ab-91ae-48b9-b436-b154c332869c] Start destroying the instance on the hypervisor. {{(pid=73572) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 10:34:37 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:34:37 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:34:37 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:34:37 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86923c1a-89a5-4e7a-b488-8bf3a013bf83/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:34:37 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86923c1a-89a5-4e7a-b488-8bf3a013bf83/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:34:37 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:34:37 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86923c1a-89a5-4e7a-b488-8bf3a013bf83/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:34:37 user nova-compute[73572]: DEBUG nova.compute.manager [req-0b490fc0-bdde-4306-bec4-5095bcb93ae2 req-6eee7f0f-e299-443d-b6aa-0b654ba8ab4c service nova] [instance: 7e3fd7ab-91ae-48b9-b436-b154c332869c] Received event network-vif-unplugged-47c9677e-a234-4f8f-8cdc-5f1fdb21c760 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:34:37 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-0b490fc0-bdde-4306-bec4-5095bcb93ae2 req-6eee7f0f-e299-443d-b6aa-0b654ba8ab4c service nova] Acquiring lock "7e3fd7ab-91ae-48b9-b436-b154c332869c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:34:37 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-0b490fc0-bdde-4306-bec4-5095bcb93ae2 req-6eee7f0f-e299-443d-b6aa-0b654ba8ab4c service nova] Lock "7e3fd7ab-91ae-48b9-b436-b154c332869c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:34:37 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-0b490fc0-bdde-4306-bec4-5095bcb93ae2 req-6eee7f0f-e299-443d-b6aa-0b654ba8ab4c service nova] Lock "7e3fd7ab-91ae-48b9-b436-b154c332869c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:34:37 user nova-compute[73572]: DEBUG nova.compute.manager [req-0b490fc0-bdde-4306-bec4-5095bcb93ae2 req-6eee7f0f-e299-443d-b6aa-0b654ba8ab4c service nova] [instance: 7e3fd7ab-91ae-48b9-b436-b154c332869c] No waiting events found dispatching network-vif-unplugged-47c9677e-a234-4f8f-8cdc-5f1fdb21c760 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:34:37 user nova-compute[73572]: DEBUG nova.compute.manager [req-0b490fc0-bdde-4306-bec4-5095bcb93ae2 req-6eee7f0f-e299-443d-b6aa-0b654ba8ab4c service nova] [instance: 7e3fd7ab-91ae-48b9-b436-b154c332869c] Received event network-vif-unplugged-47c9677e-a234-4f8f-8cdc-5f1fdb21c760 for instance with task_state deleting. {{(pid=73572) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 10:34:37 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73572) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 10:34:37 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d147974d-213d-4aa3-8d03-11b262f59dca/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:34:38 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d147974d-213d-4aa3-8d03-11b262f59dca/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:34:38 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d147974d-213d-4aa3-8d03-11b262f59dca/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:34:38 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:34:38 user nova-compute[73572]: INFO nova.virt.libvirt.driver [-] [instance: 7e3fd7ab-91ae-48b9-b436-b154c332869c] Instance destroyed successfully.
Aug 26 10:34:38 user nova-compute[73572]: DEBUG nova.objects.instance [None req-c54f70ef-216c-4845-940a-459db081c302 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Lazy-loading 'resources' on Instance uuid 7e3fd7ab-91ae-48b9-b436-b154c332869c {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:34:38 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-c54f70ef-216c-4845-940a-459db081c302 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T10:32:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-269697355',display_name='tempest-TestVolumeBootPattern-server-269697355',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-269697355',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGgJMPcylFVXjDKqyW+etneKzTtQZ3h+rrNV9oGL9oH9Pq5o1BgNVxyCABCwPtuWnsI0hTQA59VGxuIY4NbTGf1rbJaGRZw/AtW9ND3j+IG9u2og6CdZ4G3lJYm/FnK6hA==',key_name='tempest-TestVolumeBootPattern-2036222457',keypairs=<?>,launch_index=0,launched_at=2023-08-26T10:33:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cfc130586d9f4581953f1b8ae1c4465e',ramdisk_id='',reservation_id='r-9we1oi5o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-73786062',owner_user_name='tempest-TestVolumeBootPattern-73786062-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T10:33:23Z,user_data=None,user_id='e1e80942e5db41c782bda686b10e2e4b',uuid=7e3fd7ab-91ae-48b9-b436-b154c332869c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "47c9677e-a234-4f8f-8cdc-5f1fdb21c760", "address": "fa:16:3e:0d:dd:ea", "network": {"id": "c520ee18-34a7-4781-bc97-419e9a702d40", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-280196989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfc130586d9f4581953f1b8ae1c4465e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47c9677e-a2", "ovs_interfaceid": "47c9677e-a234-4f8f-8cdc-5f1fdb21c760", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 10:34:38 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-c54f70ef-216c-4845-940a-459db081c302 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Converting VIF {"id": "47c9677e-a234-4f8f-8cdc-5f1fdb21c760", "address": "fa:16:3e:0d:dd:ea", "network": {"id": "c520ee18-34a7-4781-bc97-419e9a702d40", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-280196989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfc130586d9f4581953f1b8ae1c4465e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47c9677e-a2", "ovs_interfaceid": "47c9677e-a234-4f8f-8cdc-5f1fdb21c760", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:34:38 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-c54f70ef-216c-4845-940a-459db081c302 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:dd:ea,bridge_name='br-int',has_traffic_filtering=True,id=47c9677e-a234-4f8f-8cdc-5f1fdb21c760,network=Network(c520ee18-34a7-4781-bc97-419e9a702d40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47c9677e-a2') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:34:38 user nova-compute[73572]: DEBUG os_vif [None req-c54f70ef-216c-4845-940a-459db081c302 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:dd:ea,bridge_name='br-int',has_traffic_filtering=True,id=47c9677e-a234-4f8f-8cdc-5f1fdb21c760,network=Network(c520ee18-34a7-4781-bc97-419e9a702d40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47c9677e-a2') {{(pid=73572) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 10:34:38 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:34:38 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap47c9677e-a2, bridge=br-int, if_exists=True) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:34:38 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d147974d-213d-4aa3-8d03-11b262f59dca/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:34:38 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:34:38 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:34:38 user nova-compute[73572]: INFO os_vif [None req-c54f70ef-216c-4845-940a-459db081c302 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:dd:ea,bridge_name='br-int',has_traffic_filtering=True,id=47c9677e-a234-4f8f-8cdc-5f1fdb21c760,network=Network(c520ee18-34a7-4781-bc97-419e9a702d40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47c9677e-a2')
Aug 26 10:34:38 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68613b1e-c45c-4fd9-834c-3630ed0f456a/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:34:38 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c54f70ef-216c-4845-940a-459db081c302 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 7e3fd7ab-91ae-48b9-b436-b154c332869c] calling os-brick to detach iSCSI Volume {{(pid=73572) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 10:34:38 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-c54f70ef-216c-4845-940a-459db081c302 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc89c3d6a10>, {'target_iqns': ['iqn.2010-10.org.openstack:ad1b4b19-ad16-436c-9fa3-e718bea4f540'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RjYPMhzx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 10:34:38 user nova-compute[73572]: WARNING os_brick.initiator.connectors.base [None req-c54f70ef-216c-4845-940a-459db081c302 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 10:34:38 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-c54f70ef-216c-4845-940a-459db081c302 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 10:34:38 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-c54f70ef-216c-4845-940a-459db081c302 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 10:34:38 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-c54f70ef-216c-4845-940a-459db081c302 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ad1b4b19-ad16-436c-9fa3-e718bea4f540', 0)] {{(pid=73572) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 10:34:38 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:34:38 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:34:38 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5fca691-53b6-41ef-a32f-ff59e2d7c2a6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6c17592e-3227-473f-ac7b-3e911dcb0d56\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ad1b4b19-ad16-436c-9fa3-e718bea4f540\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ec96ec24-bf73-4f38-ac9f-eb2699d0a661\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:34:38 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:34:38 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:34:38 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[09d7e4dd-e5dd-401f-aa30-cd4856c9a681]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad1b4b19-ad16-436c-9fa3-e718bea4f540 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c17592e-3227-473f-ac7b-3e911dcb0d56 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec96ec24-bf73-4f38-ac9f-eb2699d0a661 (non-flash)\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:34:38 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-c54f70ef-216c-4845-940a-459db081c302 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad1b4b19-ad16-436c-9fa3-e718bea4f540 (non-flash)
Aug 26 10:34:38 user nova-compute[73572]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c17592e-3227-473f-ac7b-3e911dcb0d56 (non-flash)
Aug 26 10:34:38 user nova-compute[73572]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec96ec24-bf73-4f38-ac9f-eb2699d0a661 (non-flash)
Aug 26 10:34:38 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 10:34:38 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-c54f70ef-216c-4845-940a-459db081c302 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad1b4b19-ad16-436c-9fa3-e718bea4f540 (non-flash)
Aug 26 10:34:38 user nova-compute[73572]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c17592e-3227-473f-ac7b-3e911dcb0d56 (non-flash)
Aug 26 10:34:38 user nova-compute[73572]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec96ec24-bf73-4f38-ac9f-eb2699d0a661 (non-flash)
Aug 26 10:34:38 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 10:34:38 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-c54f70ef-216c-4845-940a-459db081c302 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc89c172e60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ad1b4b19-ad16-436c-9fa3-e718bea4f540'): ({'sdb'}, set())}) {{(pid=73572) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 10:34:38 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-c54f70ef-216c-4845-940a-459db081c302 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Removing single pathed devices sdb {{(pid=73572) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 10:34:38 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:34:38 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:34:38 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[074b8322-17ce-463d-ba96-d0f1247597ad]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:34:38 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:34:38 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.027s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:34:38 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[696b5153-66d6-4782-bfc6-93611b210f2f]: (4, ('ok\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:34:38 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-c54f70ef-216c-4845-940a-459db081c302 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Flushing IO for device /dev/sdb {{(pid=73572) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 10:34:38 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:34:38 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68613b1e-c45c-4fd9-834c-3630ed0f456a/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:34:38 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68613b1e-c45c-4fd9-834c-3630ed0f456a/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:34:38 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.021s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:34:38 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c6090c1-f0d6-4409-b9c2-fb120c7318f2]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:34:38 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-c54f70ef-216c-4845-940a-459db081c302 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73572) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 10:34:38 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:34:38 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.053s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:34:38 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d4edcd7-7b33-4c11-8214-91628af50f7b]: (4, ('1', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:34:38 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-c54f70ef-216c-4845-940a-459db081c302 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73572) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 10:34:38 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-c54f70ef-216c-4845-940a-459db081c302 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] SCSI volumes sdb have been removed. {{(pid=73572) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 10:34:38 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-c54f70ef-216c-4845-940a-459db081c302 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ad1b4b19-ad16-436c-9fa3-e718bea4f540')] {{(pid=73572) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 10:34:38 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad1b4b19-ad16-436c-9fa3-e718bea4f540 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:34:38 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad1b4b19-ad16-436c-9fa3-e718bea4f540 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:34:38 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[410eda18-9b37-4b57-a449-cc017802167d]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:34:38 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-c54f70ef-216c-4845-940a-459db081c302 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:34:38 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad1b4b19-ad16-436c-9fa3-e718bea4f540 -p 172.16.0.220:3260 --logout {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:34:38 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68613b1e-c45c-4fd9-834c-3630ed0f456a/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:34:38 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2eaea7c2-a5c0-4950-b033-0012b5cec0ee/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:34:38 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad1b4b19-ad16-436c-9fa3-e718bea4f540 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:34:38 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4a2d6d4-f942-4c16-97af-c1bd0ec1d1ac]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:ad1b4b19-ad16-436c-9fa3-e718bea4f540, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:ad1b4b19-ad16-436c-9fa3-e718bea4f540, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:34:38 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-c54f70ef-216c-4845-940a-459db081c302 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:ad1b4b19-ad16-436c-9fa3-e718bea4f540, portal: 172.16.0.220,3260]
Aug 26 10:34:38 user nova-compute[73572]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:ad1b4b19-ad16-436c-9fa3-e718bea4f540, portal: 172.16.0.220,3260] successful.
Aug 26 10:34:38 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:34:38 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad1b4b19-ad16-436c-9fa3-e718bea4f540 -p 172.16.0.220:3260 --op delete {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:34:38 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad1b4b19-ad16-436c-9fa3-e718bea4f540 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:34:38 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[87d2bcdf-7745-4848-83ae-1885f7d59da6]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:34:38 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-c54f70ef-216c-4845-940a-459db081c302 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:34:38 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-c54f70ef-216c-4845-940a-459db081c302 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.395s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 10:34:38 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-c54f70ef-216c-4845-940a-459db081c302 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] <== disconnect_volume: return (398ms) None {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 10:34:38 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c54f70ef-216c-4845-940a-459db081c302 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 7e3fd7ab-91ae-48b9-b436-b154c332869c] Disconnected iSCSI Volume {{(pid=73572) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 10:34:38 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-c54f70ef-216c-4845-940a-459db081c302 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 7e3fd7ab-91ae-48b9-b436-b154c332869c] Deleting instance files /opt/stack/data/nova/instances/7e3fd7ab-91ae-48b9-b436-b154c332869c_del
Aug 26 10:34:38 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-c54f70ef-216c-4845-940a-459db081c302 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 7e3fd7ab-91ae-48b9-b436-b154c332869c] Deletion of /opt/stack/data/nova/instances/7e3fd7ab-91ae-48b9-b436-b154c332869c_del complete
Aug 26 10:34:38 user nova-compute[73572]: INFO nova.compute.manager [None req-c54f70ef-216c-4845-940a-459db081c302 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 7e3fd7ab-91ae-48b9-b436-b154c332869c] Took 1.35 seconds to destroy the instance on the hypervisor.
Aug 26 10:34:38 user nova-compute[73572]: DEBUG oslo.service.loopingcall [None req-c54f70ef-216c-4845-940a-459db081c302 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73572) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 10:34:38 user nova-compute[73572]: DEBUG nova.compute.manager [-] [instance: 7e3fd7ab-91ae-48b9-b436-b154c332869c] Deallocating network for instance {{(pid=73572) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 10:34:38 user nova-compute[73572]: DEBUG nova.network.neutron [-] [instance: 7e3fd7ab-91ae-48b9-b436-b154c332869c] deallocate_for_instance() {{(pid=73572) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 10:34:38 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2eaea7c2-a5c0-4950-b033-0012b5cec0ee/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:34:38 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2eaea7c2-a5c0-4950-b033-0012b5cec0ee/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:34:38 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2eaea7c2-a5c0-4950-b033-0012b5cec0ee/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:34:38 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73572) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 10:34:39 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:34:39 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:34:39 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Hypervisor/Node resource view: name=user free_ram=7621MB free_disk=25.208660125732422GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=73572) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 10:34:39 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:34:39 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:34:39 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance 2eaea7c2-a5c0-4950-b033-0012b5cec0ee actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:34:39 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance 86923c1a-89a5-4e7a-b488-8bf3a013bf83 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:34:39 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance 68613b1e-c45c-4fd9-834c-3630ed0f456a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:34:39 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance 7e3fd7ab-91ae-48b9-b436-b154c332869c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:34:39 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance c457a41c-2ee2-4821-94cf-69c091589241 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:34:39 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance d147974d-213d-4aa3-8d03-11b262f59dca actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:34:39 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance 3a4c9522-9723-4ad4-8630-17a3aba70c98 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:34:39 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=73572) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 10:34:39 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=73572) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 10:34:39 user nova-compute[73572]: DEBUG nova.compute.provider_tree [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Inventory has not changed in ProviderTree for provider: e2cec974-59b2-4c77-a53d-a7f4e5a30d75 {{(pid=73572) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 10:34:39 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Inventory has not changed for provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73572) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 10:34:39 user nova-compute[73572]: DEBUG nova.network.neutron [-] [instance: 7e3fd7ab-91ae-48b9-b436-b154c332869c] Updating instance_info_cache with network_info: [] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:34:39 user nova-compute[73572]: INFO nova.compute.manager [-] [instance: 7e3fd7ab-91ae-48b9-b436-b154c332869c] Took 1.03 seconds to deallocate network for instance.
Aug 26 10:34:39 user nova-compute[73572]: DEBUG nova.compute.manager [req-d2fcec33-d431-4e17-a370-05995d9514fb req-a23704b3-5b9d-455c-b5d2-22dbea412a1d service nova] [instance: 7e3fd7ab-91ae-48b9-b436-b154c332869c] Received event network-vif-deleted-47c9677e-a234-4f8f-8cdc-5f1fdb21c760 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:34:39 user nova-compute[73572]: INFO nova.compute.manager [req-d2fcec33-d431-4e17-a370-05995d9514fb req-a23704b3-5b9d-455c-b5d2-22dbea412a1d service nova] [instance: 7e3fd7ab-91ae-48b9-b436-b154c332869c] Neutron deleted interface 47c9677e-a234-4f8f-8cdc-5f1fdb21c760; detaching it from the instance and deleting it from the info cache
Aug 26 10:34:39 user nova-compute[73572]: DEBUG nova.network.neutron [req-d2fcec33-d431-4e17-a370-05995d9514fb req-a23704b3-5b9d-455c-b5d2-22dbea412a1d service nova] [instance: 7e3fd7ab-91ae-48b9-b436-b154c332869c] Updating instance_info_cache with network_info: [] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:34:39 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Compute_service record updated for user:user {{(pid=73572) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 10:34:39 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.423s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:34:39 user nova-compute[73572]: DEBUG nova.compute.manager [req-cee001b2-6a88-499e-981f-cf2cf6d2d63c req-cca7e281-1f8a-401d-9111-65f3adeb42cc service nova] [instance: 7e3fd7ab-91ae-48b9-b436-b154c332869c] Received event network-vif-plugged-47c9677e-a234-4f8f-8cdc-5f1fdb21c760 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:34:39 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-cee001b2-6a88-499e-981f-cf2cf6d2d63c req-cca7e281-1f8a-401d-9111-65f3adeb42cc service nova] Acquiring lock "7e3fd7ab-91ae-48b9-b436-b154c332869c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:34:39 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-cee001b2-6a88-499e-981f-cf2cf6d2d63c req-cca7e281-1f8a-401d-9111-65f3adeb42cc service nova] Lock "7e3fd7ab-91ae-48b9-b436-b154c332869c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:34:39 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-cee001b2-6a88-499e-981f-cf2cf6d2d63c req-cca7e281-1f8a-401d-9111-65f3adeb42cc service nova] Lock "7e3fd7ab-91ae-48b9-b436-b154c332869c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:34:39 user nova-compute[73572]: DEBUG nova.compute.manager [req-cee001b2-6a88-499e-981f-cf2cf6d2d63c req-cca7e281-1f8a-401d-9111-65f3adeb42cc service nova] [instance: 7e3fd7ab-91ae-48b9-b436-b154c332869c] No waiting events found dispatching network-vif-plugged-47c9677e-a234-4f8f-8cdc-5f1fdb21c760 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:34:39 user nova-compute[73572]: WARNING nova.compute.manager [req-cee001b2-6a88-499e-981f-cf2cf6d2d63c req-cca7e281-1f8a-401d-9111-65f3adeb42cc service nova] [instance: 7e3fd7ab-91ae-48b9-b436-b154c332869c] Received unexpected event network-vif-plugged-47c9677e-a234-4f8f-8cdc-5f1fdb21c760 for instance with vm_state active and task_state deleting.
Aug 26 10:34:39 user nova-compute[73572]: DEBUG nova.compute.manager [req-d2fcec33-d431-4e17-a370-05995d9514fb req-a23704b3-5b9d-455c-b5d2-22dbea412a1d service nova] [instance: 7e3fd7ab-91ae-48b9-b436-b154c332869c] Detach interface failed, port_id=47c9677e-a234-4f8f-8cdc-5f1fdb21c760, reason: Instance 7e3fd7ab-91ae-48b9-b436-b154c332869c could not be found. {{(pid=73572) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 10:34:40 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:34:40 user nova-compute[73572]: INFO nova.compute.manager [None req-c54f70ef-216c-4845-940a-459db081c302 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 7e3fd7ab-91ae-48b9-b436-b154c332869c] Took 0.98 seconds to detach 1 volumes for instance.
Aug 26 10:34:40 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-c54f70ef-216c-4845-940a-459db081c302 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:34:40 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-c54f70ef-216c-4845-940a-459db081c302 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:34:41 user nova-compute[73572]: DEBUG nova.compute.provider_tree [None req-c54f70ef-216c-4845-940a-459db081c302 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Inventory has not changed in ProviderTree for provider: e2cec974-59b2-4c77-a53d-a7f4e5a30d75 {{(pid=73572) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 10:34:41 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-c54f70ef-216c-4845-940a-459db081c302 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Inventory has not changed for provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73572) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 10:34:41 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-c54f70ef-216c-4845-940a-459db081c302 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.258s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:34:41 user nova-compute[73572]: INFO nova.scheduler.client.report [None req-c54f70ef-216c-4845-940a-459db081c302 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Deleted allocations for instance 7e3fd7ab-91ae-48b9-b436-b154c332869c
Aug 26 10:34:41 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-c54f70ef-216c-4845-940a-459db081c302 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Lock "7e3fd7ab-91ae-48b9-b436-b154c332869c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.811s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:34:41 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:34:43 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:34:45 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:34:45 user nova-compute[73572]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693046070.8194838, 1c8e780d-0a13-4484-bf18-ac0879db263a => Stopped> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:34:45 user nova-compute[73572]: INFO nova.compute.manager [-] [instance: 1c8e780d-0a13-4484-bf18-ac0879db263a] VM Stopped (Lifecycle Event)
Aug 26 10:34:45 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9e0ceb70-430e-419f-8ade-71a22a72bd57 None None] [instance: 1c8e780d-0a13-4484-bf18-ac0879db263a] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:34:47 user nova-compute[73572]: DEBUG nova.compute.manager [req-22f04da8-4694-4b02-9e7b-30cc102dec1b req-f3948b3f-d8ad-4a70-a63e-203a02baf068 service nova] [instance: 68613b1e-c45c-4fd9-834c-3630ed0f456a] Received event network-changed-aa5ef0b6-0379-4e59-a2c7-e7f1ecd3c7cb {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:34:47 user nova-compute[73572]: DEBUG nova.compute.manager [req-22f04da8-4694-4b02-9e7b-30cc102dec1b req-f3948b3f-d8ad-4a70-a63e-203a02baf068 service nova] [instance: 68613b1e-c45c-4fd9-834c-3630ed0f456a] Refreshing instance network info cache due to event network-changed-aa5ef0b6-0379-4e59-a2c7-e7f1ecd3c7cb. {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 10:34:47 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-22f04da8-4694-4b02-9e7b-30cc102dec1b req-f3948b3f-d8ad-4a70-a63e-203a02baf068 service nova] Acquiring lock "refresh_cache-68613b1e-c45c-4fd9-834c-3630ed0f456a" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:34:47 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-22f04da8-4694-4b02-9e7b-30cc102dec1b req-f3948b3f-d8ad-4a70-a63e-203a02baf068 service nova] Acquired lock "refresh_cache-68613b1e-c45c-4fd9-834c-3630ed0f456a" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:34:47 user nova-compute[73572]: DEBUG nova.network.neutron [req-22f04da8-4694-4b02-9e7b-30cc102dec1b req-f3948b3f-d8ad-4a70-a63e-203a02baf068 service nova] [instance: 68613b1e-c45c-4fd9-834c-3630ed0f456a] Refreshing network info cache for port aa5ef0b6-0379-4e59-a2c7-e7f1ecd3c7cb {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 10:34:47 user nova-compute[73572]: DEBUG nova.network.neutron [req-22f04da8-4694-4b02-9e7b-30cc102dec1b req-f3948b3f-d8ad-4a70-a63e-203a02baf068 service nova] [instance: 68613b1e-c45c-4fd9-834c-3630ed0f456a] Updated VIF entry in instance network info cache for port aa5ef0b6-0379-4e59-a2c7-e7f1ecd3c7cb. {{(pid=73572) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 10:34:47 user nova-compute[73572]: DEBUG nova.network.neutron [req-22f04da8-4694-4b02-9e7b-30cc102dec1b req-f3948b3f-d8ad-4a70-a63e-203a02baf068 service nova] [instance: 68613b1e-c45c-4fd9-834c-3630ed0f456a] Updating instance_info_cache with network_info: [{"id": "aa5ef0b6-0379-4e59-a2c7-e7f1ecd3c7cb", "address": "fa:16:3e:30:8b:7a", "network": {"id": "43215883-3d00-4be7-8c40-bdaf3f01bef9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1088544153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7935bccc360b46b589fd57d53f334595", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa5ef0b6-03", "ovs_interfaceid": "aa5ef0b6-0379-4e59-a2c7-e7f1ecd3c7cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:34:47 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-22f04da8-4694-4b02-9e7b-30cc102dec1b req-f3948b3f-d8ad-4a70-a63e-203a02baf068 service nova] Releasing lock "refresh_cache-68613b1e-c45c-4fd9-834c-3630ed0f456a" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:34:48 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:34:49 user nova-compute[73572]: DEBUG nova.compute.manager [None req-6c49c27a-bae3-4942-987a-44276340ff51 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] [instance: c457a41c-2ee2-4821-94cf-69c091589241] Stashing vm_state: active {{(pid=73572) _prep_resize /opt/stack/nova/nova/compute/manager.py:5535}}
Aug 26 10:34:49 user nova-compute[73572]: DEBUG nova.compute.manager [req-2150c0ce-ce3b-49d3-93c8-15c2af3e564e req-7d5a7e9c-5192-4ae8-9028-31cd2e58750e service nova] [instance: c457a41c-2ee2-4821-94cf-69c091589241] Received event network-changed-deb899b2-ba04-427b-b4ea-a514b8eda260 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:34:49 user nova-compute[73572]: DEBUG nova.compute.manager [req-2150c0ce-ce3b-49d3-93c8-15c2af3e564e req-7d5a7e9c-5192-4ae8-9028-31cd2e58750e service nova] [instance: c457a41c-2ee2-4821-94cf-69c091589241] Refreshing instance network info cache due to event network-changed-deb899b2-ba04-427b-b4ea-a514b8eda260. {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 10:34:49 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-2150c0ce-ce3b-49d3-93c8-15c2af3e564e req-7d5a7e9c-5192-4ae8-9028-31cd2e58750e service nova] Acquiring lock "refresh_cache-c457a41c-2ee2-4821-94cf-69c091589241" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:34:49 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-2150c0ce-ce3b-49d3-93c8-15c2af3e564e req-7d5a7e9c-5192-4ae8-9028-31cd2e58750e service nova] Acquired lock "refresh_cache-c457a41c-2ee2-4821-94cf-69c091589241" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:34:49 user nova-compute[73572]: DEBUG nova.network.neutron [req-2150c0ce-ce3b-49d3-93c8-15c2af3e564e req-7d5a7e9c-5192-4ae8-9028-31cd2e58750e service nova] [instance: c457a41c-2ee2-4821-94cf-69c091589241] Refreshing network info cache for port deb899b2-ba04-427b-b4ea-a514b8eda260 {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 10:34:49 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-6c49c27a-bae3-4942-987a-44276340ff51 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:34:49 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-6c49c27a-bae3-4942-987a-44276340ff51 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:34:49 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-6c49c27a-bae3-4942-987a-44276340ff51 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73572) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 10:34:49 user nova-compute[73572]: INFO nova.compute.claims [None req-6c49c27a-bae3-4942-987a-44276340ff51 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] [instance: c457a41c-2ee2-4821-94cf-69c091589241] Claim successful on node user
Aug 26 10:34:49 user nova-compute[73572]: INFO nova.compute.resource_tracker [None req-6c49c27a-bae3-4942-987a-44276340ff51 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] [instance: c457a41c-2ee2-4821-94cf-69c091589241] Updating resource usage from migration 54257f22-04e0-4bf9-a6a6-cd5b7ab6ceea
Aug 26 10:34:49 user nova-compute[73572]: DEBUG nova.compute.provider_tree [None req-6c49c27a-bae3-4942-987a-44276340ff51 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Inventory has not changed in ProviderTree for provider: e2cec974-59b2-4c77-a53d-a7f4e5a30d75 {{(pid=73572) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 10:34:49 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-6c49c27a-bae3-4942-987a-44276340ff51 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Inventory has not changed for provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73572) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 10:34:49 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-6c49c27a-bae3-4942-987a-44276340ff51 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.344s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:34:49 user nova-compute[73572]: INFO nova.compute.manager [None req-6c49c27a-bae3-4942-987a-44276340ff51 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] [instance: c457a41c-2ee2-4821-94cf-69c091589241] Migrating
Aug 26 10:34:49 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-6c49c27a-bae3-4942-987a-44276340ff51 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Acquiring lock "refresh_cache-c457a41c-2ee2-4821-94cf-69c091589241" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:34:50 user nova-compute[73572]: DEBUG nova.network.neutron [req-2150c0ce-ce3b-49d3-93c8-15c2af3e564e req-7d5a7e9c-5192-4ae8-9028-31cd2e58750e service nova] [instance: c457a41c-2ee2-4821-94cf-69c091589241] Updated VIF entry in instance network info cache for port deb899b2-ba04-427b-b4ea-a514b8eda260. {{(pid=73572) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 10:34:50 user nova-compute[73572]: DEBUG nova.network.neutron [req-2150c0ce-ce3b-49d3-93c8-15c2af3e564e req-7d5a7e9c-5192-4ae8-9028-31cd2e58750e service nova] [instance: c457a41c-2ee2-4821-94cf-69c091589241] Updating instance_info_cache with network_info: [{"id": "deb899b2-ba04-427b-b4ea-a514b8eda260", "address": "fa:16:3e:05:c8:e3", "network": {"id": "43215883-3d00-4be7-8c40-bdaf3f01bef9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1088544153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7935bccc360b46b589fd57d53f334595", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdeb899b2-ba", "ovs_interfaceid": "deb899b2-ba04-427b-b4ea-a514b8eda260", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:34:50 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-2150c0ce-ce3b-49d3-93c8-15c2af3e564e req-7d5a7e9c-5192-4ae8-9028-31cd2e58750e service nova] Releasing lock "refresh_cache-c457a41c-2ee2-4821-94cf-69c091589241" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:34:50 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-6c49c27a-bae3-4942-987a-44276340ff51 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Acquired lock "refresh_cache-c457a41c-2ee2-4821-94cf-69c091589241" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:34:50 user nova-compute[73572]: DEBUG nova.network.neutron [None req-6c49c27a-bae3-4942-987a-44276340ff51 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] [instance: c457a41c-2ee2-4821-94cf-69c091589241] Building network info cache for instance {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 10:34:50 user nova-compute[73572]: DEBUG nova.network.neutron [None req-6c49c27a-bae3-4942-987a-44276340ff51 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] [instance: c457a41c-2ee2-4821-94cf-69c091589241] Updating instance_info_cache with network_info: [{"id": "deb899b2-ba04-427b-b4ea-a514b8eda260", "address": "fa:16:3e:05:c8:e3", "network": {"id": "43215883-3d00-4be7-8c40-bdaf3f01bef9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1088544153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7935bccc360b46b589fd57d53f334595", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdeb899b2-ba", "ovs_interfaceid": "deb899b2-ba04-427b-b4ea-a514b8eda260", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:34:50 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-6c49c27a-bae3-4942-987a-44276340ff51 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Releasing lock "refresh_cache-c457a41c-2ee2-4821-94cf-69c091589241" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:34:50 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-6c49c27a-bae3-4942-987a-44276340ff51 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] [instance: c457a41c-2ee2-4821-94cf-69c091589241] Starting migrate_disk_and_power_off {{(pid=73572) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Aug 26 10:34:50 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:34:50 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:34:51 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:34:51 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:34:51 user nova-compute[73572]: DEBUG nova.compute.manager [req-cfc97aa4-bbd4-4e7a-9c43-7caff45bf2e3 req-01ce55a0-f6e6-4843-a8de-89bd2c7b24c3 service nova] [instance: c457a41c-2ee2-4821-94cf-69c091589241] Received event network-vif-unplugged-deb899b2-ba04-427b-b4ea-a514b8eda260 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:34:51 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-cfc97aa4-bbd4-4e7a-9c43-7caff45bf2e3 req-01ce55a0-f6e6-4843-a8de-89bd2c7b24c3 service nova] Acquiring lock "c457a41c-2ee2-4821-94cf-69c091589241-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:34:51 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-cfc97aa4-bbd4-4e7a-9c43-7caff45bf2e3 req-01ce55a0-f6e6-4843-a8de-89bd2c7b24c3 service nova] Lock "c457a41c-2ee2-4821-94cf-69c091589241-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:34:51 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-cfc97aa4-bbd4-4e7a-9c43-7caff45bf2e3 req-01ce55a0-f6e6-4843-a8de-89bd2c7b24c3 service nova] Lock "c457a41c-2ee2-4821-94cf-69c091589241-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:34:51 user nova-compute[73572]: DEBUG nova.compute.manager [req-cfc97aa4-bbd4-4e7a-9c43-7caff45bf2e3 req-01ce55a0-f6e6-4843-a8de-89bd2c7b24c3 service nova] [instance: c457a41c-2ee2-4821-94cf-69c091589241] No waiting events found dispatching network-vif-unplugged-deb899b2-ba04-427b-b4ea-a514b8eda260 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:34:51 user nova-compute[73572]: WARNING nova.compute.manager [req-cfc97aa4-bbd4-4e7a-9c43-7caff45bf2e3 req-01ce55a0-f6e6-4843-a8de-89bd2c7b24c3 service nova] [instance: c457a41c-2ee2-4821-94cf-69c091589241] Received unexpected event network-vif-unplugged-deb899b2-ba04-427b-b4ea-a514b8eda260 for instance with vm_state active and task_state resize_migrating.
Aug 26 10:34:51 user nova-compute[73572]: INFO nova.virt.libvirt.driver [-] [instance: c457a41c-2ee2-4821-94cf-69c091589241] Instance destroyed successfully.
Aug 26 10:34:51 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-6c49c27a-bae3-4942-987a-44276340ff51 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T10:32:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1008830200',display_name='tempest-ServerActionsTestOtherA-server-1008830200',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1008830200',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAGb4Psy4ujnztu6TKM5Yp0ao9Inx8XINL8TB7yqpPrX8pvyhV645/PRion/tWXE5RcABz76j3Pw1BeejHEQh0n16o5OpRaXWd84Wj12hPmfoj80ST4I1EIx+wC0wImDFQ==',key_name='tempest-keypair-598298583',keypairs=<?>,launch_index=0,launched_at=2023-08-26T10:33:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='7935bccc360b46b589fd57d53f334595',ramdisk_id='',reservation_id='r-dee3c84h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-203628695',owner_user_name='tempest-ServerActionsTestOtherA-203628695-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T10:34:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='61b6124f6f6e44c5b2fd0202a15da019',uuid=c457a41c-2ee2-4821-94cf-69c091589241,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "deb899b2-ba04-427b-b4ea-a514b8eda260", "address": "fa:16:3e:05:c8:e3", "network": {"id": "43215883-3d00-4be7-8c40-bdaf3f01bef9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1088544153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1088544153-network", "vif_mac": "fa:16:3e:05:c8:e3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7935bccc360b46b589fd57d53f334595", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdeb899b2-ba", "ovs_interfaceid": "deb899b2-ba04-427b-b4ea-a514b8eda260", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 10:34:51 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-6c49c27a-bae3-4942-987a-44276340ff51 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Converting VIF {"id": "deb899b2-ba04-427b-b4ea-a514b8eda260", "address": "fa:16:3e:05:c8:e3", "network": {"id": "43215883-3d00-4be7-8c40-bdaf3f01bef9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1088544153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1088544153-network", "vif_mac": "fa:16:3e:05:c8:e3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7935bccc360b46b589fd57d53f334595", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdeb899b2-ba", "ovs_interfaceid": "deb899b2-ba04-427b-b4ea-a514b8eda260", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:34:51 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-6c49c27a-bae3-4942-987a-44276340ff51 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:05:c8:e3,bridge_name='br-int',has_traffic_filtering=True,id=deb899b2-ba04-427b-b4ea-a514b8eda260,network=Network(43215883-3d00-4be7-8c40-bdaf3f01bef9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdeb899b2-ba') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:34:51 user nova-compute[73572]: DEBUG os_vif [None req-6c49c27a-bae3-4942-987a-44276340ff51 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:05:c8:e3,bridge_name='br-int',has_traffic_filtering=True,id=deb899b2-ba04-427b-b4ea-a514b8eda260,network=Network(43215883-3d00-4be7-8c40-bdaf3f01bef9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdeb899b2-ba') {{(pid=73572) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 10:34:51 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:34:51 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdeb899b2-ba, bridge=br-int, if_exists=True) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:34:51 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:34:51 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:34:51 user nova-compute[73572]: INFO os_vif [None req-6c49c27a-bae3-4942-987a-44276340ff51 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:05:c8:e3,bridge_name='br-int',has_traffic_filtering=True,id=deb899b2-ba04-427b-b4ea-a514b8eda260,network=Network(43215883-3d00-4be7-8c40-bdaf3f01bef9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdeb899b2-ba')
Aug 26 10:34:51 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6c49c27a-bae3-4942-987a-44276340ff51 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] [instance: c457a41c-2ee2-4821-94cf-69c091589241] calling os-brick to detach iSCSI Volume {{(pid=73572) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 10:34:51 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c49c27a-bae3-4942-987a-44276340ff51 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc89c3d6a10>, {'target_iqns': ['iqn.2010-10.org.openstack:6c17592e-3227-473f-ac7b-3e911dcb0d56'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QlxWrapc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 10:34:51 user nova-compute[73572]: WARNING os_brick.initiator.connectors.base [None req-6c49c27a-bae3-4942-987a-44276340ff51 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 10:34:51 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-6c49c27a-bae3-4942-987a-44276340ff51 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 10:34:51 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-6c49c27a-bae3-4942-987a-44276340ff51 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 10:34:51 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c49c27a-bae3-4942-987a-44276340ff51 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6c17592e-3227-473f-ac7b-3e911dcb0d56', 0)] {{(pid=73572) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 10:34:51 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:34:51 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:34:51 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[afedebaa-7f5f-4b4b-a6b9-f4fdc1995e81]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6c17592e-3227-473f-ac7b-3e911dcb0d56\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ec96ec24-bf73-4f38-ac9f-eb2699d0a661\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:34:51 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:34:51 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:34:51 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[66a3afe2-815c-43d5-80af-bdb6c1f87e96]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c17592e-3227-473f-ac7b-3e911dcb0d56 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec96ec24-bf73-4f38-ac9f-eb2699d0a661 (non-flash)\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:34:51 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c49c27a-bae3-4942-987a-44276340ff51 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c17592e-3227-473f-ac7b-3e911dcb0d56 (non-flash)
Aug 26 10:34:51 user nova-compute[73572]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec96ec24-bf73-4f38-ac9f-eb2699d0a661 (non-flash)
Aug 26 10:34:51 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 10:34:51 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c49c27a-bae3-4942-987a-44276340ff51 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c17592e-3227-473f-ac7b-3e911dcb0d56 (non-flash)
Aug 26 10:34:51 user nova-compute[73572]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec96ec24-bf73-4f38-ac9f-eb2699d0a661 (non-flash)
Aug 26 10:34:51 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 10:34:51 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c49c27a-bae3-4942-987a-44276340ff51 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc89c3e2d40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6c17592e-3227-473f-ac7b-3e911dcb0d56'): ({'sdc'}, set())}) {{(pid=73572) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 10:34:51 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-6c49c27a-bae3-4942-987a-44276340ff51 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Removing single pathed devices sdc {{(pid=73572) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 10:34:51 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:34:51 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:34:51 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0ab16a0-1a84-44fc-8ae7-269b6223c57d]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:34:51 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:34:51 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:34:51 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bf400b0-08be-434a-bc47-74130d0b6c20]: (4, ('ok\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:34:51 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-6c49c27a-bae3-4942-987a-44276340ff51 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Flushing IO for device /dev/sdc {{(pid=73572) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 10:34:51 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:34:51 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:34:51 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab50c567-bfd1-4537-93ac-b8197995febb]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:34:51 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-6c49c27a-bae3-4942-987a-44276340ff51 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73572) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 10:34:51 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:34:51 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.048s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:34:51 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d8d6562-9c14-4b8a-93d3-8697ac0bfa17]: (4, ('1', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:34:51 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-6c49c27a-bae3-4942-987a-44276340ff51 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73572) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 10:34:51 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-6c49c27a-bae3-4942-987a-44276340ff51 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] SCSI volumes sdc have been removed. {{(pid=73572) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 10:34:51 user nova-compute[73572]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO2c7973b0-d73aeccd6eac26f0', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_2c7973b0', '/dev/disk/by-id/scsi-26437336165636364') {{(pid=84543) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 26 10:34:51 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ed41074-9f7a-4550-acb0-6e4d408b7721]: (4, None) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:34:51 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c49c27a-bae3-4942-987a-44276340ff51 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6c17592e-3227-473f-ac7b-3e911dcb0d56')] {{(pid=73572) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 10:34:51 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c17592e-3227-473f-ac7b-3e911dcb0d56 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:34:51 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c17592e-3227-473f-ac7b-3e911dcb0d56 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:34:51 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[426c6db3-7777-406a-946d-27708d5dfefc]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:34:51 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c49c27a-bae3-4942-987a-44276340ff51 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:34:51 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c17592e-3227-473f-ac7b-3e911dcb0d56 -p 172.16.0.220:3260 --logout {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:34:51 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c17592e-3227-473f-ac7b-3e911dcb0d56 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:34:51 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[19753fcb-c325-4a51-818b-f91b2496653a]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:6c17592e-3227-473f-ac7b-3e911dcb0d56, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:6c17592e-3227-473f-ac7b-3e911dcb0d56, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:34:51 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c49c27a-bae3-4942-987a-44276340ff51 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:6c17592e-3227-473f-ac7b-3e911dcb0d56, portal: 172.16.0.220,3260]
Aug 26 10:34:51 user nova-compute[73572]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:6c17592e-3227-473f-ac7b-3e911dcb0d56, portal: 172.16.0.220,3260] successful.
Aug 26 10:34:51 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:34:51 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c17592e-3227-473f-ac7b-3e911dcb0d56 -p 172.16.0.220:3260 --op delete {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:34:51 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c17592e-3227-473f-ac7b-3e911dcb0d56 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:34:51 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cb32833-5082-42bf-8d99-6a7a88ede07c]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:34:51 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c49c27a-bae3-4942-987a-44276340ff51 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:34:51 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-6c49c27a-bae3-4942-987a-44276340ff51 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.299s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 10:34:51 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c49c27a-bae3-4942-987a-44276340ff51 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] <== disconnect_volume: return (299ms) None {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 10:34:51 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6c49c27a-bae3-4942-987a-44276340ff51 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] [instance: c457a41c-2ee2-4821-94cf-69c091589241] Disconnected iSCSI Volume {{(pid=73572) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 10:34:51 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-6c49c27a-bae3-4942-987a-44276340ff51 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73572) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 10:34:52 user nova-compute[73572]: DEBUG nova.network.neutron [None req-6c49c27a-bae3-4942-987a-44276340ff51 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] [instance: c457a41c-2ee2-4821-94cf-69c091589241] Port deb899b2-ba04-427b-b4ea-a514b8eda260 binding to destination host user is already ACTIVE {{(pid=73572) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 26 10:34:53 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-6c49c27a-bae3-4942-987a-44276340ff51 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Acquiring lock "c457a41c-2ee2-4821-94cf-69c091589241-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:34:53 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-6c49c27a-bae3-4942-987a-44276340ff51 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Lock "c457a41c-2ee2-4821-94cf-69c091589241-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:34:53 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-6c49c27a-bae3-4942-987a-44276340ff51 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Lock "c457a41c-2ee2-4821-94cf-69c091589241-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:34:53 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-6c49c27a-bae3-4942-987a-44276340ff51 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Acquiring lock "refresh_cache-c457a41c-2ee2-4821-94cf-69c091589241" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:34:53 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-6c49c27a-bae3-4942-987a-44276340ff51 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Acquired lock "refresh_cache-c457a41c-2ee2-4821-94cf-69c091589241" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:34:53 user nova-compute[73572]: DEBUG nova.network.neutron [None req-6c49c27a-bae3-4942-987a-44276340ff51 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] [instance: c457a41c-2ee2-4821-94cf-69c091589241] Building network info cache for instance {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 10:34:53 user nova-compute[73572]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693046078.191729, 7e3fd7ab-91ae-48b9-b436-b154c332869c => Stopped> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:34:53 user nova-compute[73572]: INFO nova.compute.manager [-] [instance: 7e3fd7ab-91ae-48b9-b436-b154c332869c] VM Stopped (Lifecycle Event)
Aug 26 10:34:53 user nova-compute[73572]: DEBUG nova.compute.manager [None req-d764ce44-4174-4fee-b22f-79e424aad933 None None] [instance: 7e3fd7ab-91ae-48b9-b436-b154c332869c] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:34:53 user nova-compute[73572]: DEBUG nova.compute.manager [req-d2687c27-a80c-48fa-9bf8-1ba455eada53 req-ba2d8572-76eb-4997-8b27-33c252667d45 service nova] [instance: c457a41c-2ee2-4821-94cf-69c091589241] Received event network-vif-plugged-deb899b2-ba04-427b-b4ea-a514b8eda260 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:34:53 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-d2687c27-a80c-48fa-9bf8-1ba455eada53 req-ba2d8572-76eb-4997-8b27-33c252667d45 service nova] Acquiring lock "c457a41c-2ee2-4821-94cf-69c091589241-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:34:53 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-d2687c27-a80c-48fa-9bf8-1ba455eada53 req-ba2d8572-76eb-4997-8b27-33c252667d45 service nova] Lock "c457a41c-2ee2-4821-94cf-69c091589241-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:34:53 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-d2687c27-a80c-48fa-9bf8-1ba455eada53 req-ba2d8572-76eb-4997-8b27-33c252667d45 service nova] Lock "c457a41c-2ee2-4821-94cf-69c091589241-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:34:53 user nova-compute[73572]: DEBUG nova.compute.manager [req-d2687c27-a80c-48fa-9bf8-1ba455eada53 req-ba2d8572-76eb-4997-8b27-33c252667d45 service nova] [instance: c457a41c-2ee2-4821-94cf-69c091589241] No waiting events found dispatching network-vif-plugged-deb899b2-ba04-427b-b4ea-a514b8eda260 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:34:53 user nova-compute[73572]: WARNING nova.compute.manager [req-d2687c27-a80c-48fa-9bf8-1ba455eada53 req-ba2d8572-76eb-4997-8b27-33c252667d45 service nova] [instance: c457a41c-2ee2-4821-94cf-69c091589241] Received unexpected event network-vif-plugged-deb899b2-ba04-427b-b4ea-a514b8eda260 for instance with vm_state active and task_state resize_migrated.
Aug 26 10:34:53 user nova-compute[73572]: DEBUG nova.network.neutron [None req-6c49c27a-bae3-4942-987a-44276340ff51 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] [instance: c457a41c-2ee2-4821-94cf-69c091589241] Updating instance_info_cache with network_info: [{"id": "deb899b2-ba04-427b-b4ea-a514b8eda260", "address": "fa:16:3e:05:c8:e3", "network": {"id": "43215883-3d00-4be7-8c40-bdaf3f01bef9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1088544153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7935bccc360b46b589fd57d53f334595", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdeb899b2-ba", "ovs_interfaceid": "deb899b2-ba04-427b-b4ea-a514b8eda260", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:34:53 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-6c49c27a-bae3-4942-987a-44276340ff51 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Releasing lock "refresh_cache-c457a41c-2ee2-4821-94cf-69c091589241" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:34:54 user nova-compute[73572]: DEBUG os_brick.utils [None req-6c49c27a-bae3-4942-987a-44276340ff51 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 10:34:54 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:34:54 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:34:54 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[81a373af-8d27-4e73-adbb-409ea2d4855d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:de8a79ed912\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:34:54 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:34:54 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:34:54 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[f23bf1ca-30b0-4ad6-a810-2e727a2f39c7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:34:54 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:34:54 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:34:54 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[13c009df-4ece-4a55-a7fc-6e3baabe93ac]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:34:54 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[bef07541-5b6f-4ca2-872e-18226f144b0e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:34:54 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-6c49c27a-bae3-4942-987a-44276340ff51 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Running cmd (subprocess): nvme version {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:34:54 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-6c49c27a-bae3-4942-987a-44276340ff51 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] 'nvme version' failed. Not Retrying. {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 10:34:54 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6c49c27a-bae3-4942-987a-44276340ff51 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] nvme not present on system {{(pid=73572) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 10:34:54 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:34:54 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 10:34:54 user nova-compute[73572]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 10:34:54 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0eed363-df8b-4ab7-a4f0-eee322cf7521]: (4, '') {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:34:54 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.lightos [None req-6c49c27a-bae3-4942-987a-44276340ff51 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73572) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 10:34:54 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.lightos [None req-6c49c27a-bae3-4942-987a-44276340ff51 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73572) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 10:34:54 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.lightos [None req-6c49c27a-bae3-4942-987a-44276340ff51 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] LIGHTOS: no hostnqn found. {{(pid=73572) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 10:34:54 user nova-compute[73572]: DEBUG os_brick.utils [None req-6c49c27a-bae3-4942-987a-44276340ff51 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:de8a79ed912', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 10:34:55 user nova-compute[73572]: DEBUG nova.compute.manager [req-1f95a936-b7ac-47b6-a1f2-c90110b76ded req-84636068-655f-4fb6-a80a-93d052bf905e service nova] [instance: d147974d-213d-4aa3-8d03-11b262f59dca] Received event network-changed-8d51de2d-85b6-4a2f-80db-5fe69b8fd11b {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:34:55 user nova-compute[73572]: DEBUG nova.compute.manager [req-1f95a936-b7ac-47b6-a1f2-c90110b76ded req-84636068-655f-4fb6-a80a-93d052bf905e service nova] [instance: d147974d-213d-4aa3-8d03-11b262f59dca] Refreshing instance network info cache due to event network-changed-8d51de2d-85b6-4a2f-80db-5fe69b8fd11b. {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 10:34:55 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-1f95a936-b7ac-47b6-a1f2-c90110b76ded req-84636068-655f-4fb6-a80a-93d052bf905e service nova] Acquiring lock "refresh_cache-d147974d-213d-4aa3-8d03-11b262f59dca" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:34:55 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-1f95a936-b7ac-47b6-a1f2-c90110b76ded req-84636068-655f-4fb6-a80a-93d052bf905e service nova] Acquired lock "refresh_cache-d147974d-213d-4aa3-8d03-11b262f59dca" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:34:55 user nova-compute[73572]: DEBUG nova.network.neutron [req-1f95a936-b7ac-47b6-a1f2-c90110b76ded req-84636068-655f-4fb6-a80a-93d052bf905e service nova] [instance: d147974d-213d-4aa3-8d03-11b262f59dca] Refreshing network info cache for port 8d51de2d-85b6-4a2f-80db-5fe69b8fd11b {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 10:34:56 user nova-compute[73572]: DEBUG nova.network.neutron [req-1f95a936-b7ac-47b6-a1f2-c90110b76ded req-84636068-655f-4fb6-a80a-93d052bf905e service nova] [instance: d147974d-213d-4aa3-8d03-11b262f59dca] Updated VIF entry in instance network info cache for port 8d51de2d-85b6-4a2f-80db-5fe69b8fd11b. {{(pid=73572) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 10:34:56 user nova-compute[73572]: DEBUG nova.network.neutron [req-1f95a936-b7ac-47b6-a1f2-c90110b76ded req-84636068-655f-4fb6-a80a-93d052bf905e service nova] [instance: d147974d-213d-4aa3-8d03-11b262f59dca] Updating instance_info_cache with network_info: [{"id": "8d51de2d-85b6-4a2f-80db-5fe69b8fd11b", "address": "fa:16:3e:e5:90:35", "network": {"id": "317d2681-96ce-4898-b6fb-8892ee6f706d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2049963835-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7e16843614c451d958e817c832d4cbc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d51de2d-85", "ovs_interfaceid": "8d51de2d-85b6-4a2f-80db-5fe69b8fd11b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:34:56 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-1f95a936-b7ac-47b6-a1f2-c90110b76ded req-84636068-655f-4fb6-a80a-93d052bf905e service nova] Releasing lock "refresh_cache-d147974d-213d-4aa3-8d03-11b262f59dca" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:34:56 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:35:00 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:35:01 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:35:01 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-5487f5c7-61d6-46a2-bf10-f223141e5b72 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Acquiring lock "d147974d-213d-4aa3-8d03-11b262f59dca" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:35:01 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-5487f5c7-61d6-46a2-bf10-f223141e5b72 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Lock "d147974d-213d-4aa3-8d03-11b262f59dca" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:35:01 user nova-compute[73572]: INFO nova.compute.manager [None req-5487f5c7-61d6-46a2-bf10-f223141e5b72 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] [instance: d147974d-213d-4aa3-8d03-11b262f59dca] Shelving
Aug 26 10:35:01 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:35:01 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:35:01 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:35:01 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:35:02 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:35:02 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:35:02 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:35:02 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:35:02 user nova-compute[73572]: INFO nova.virt.libvirt.driver [-] [instance: d147974d-213d-4aa3-8d03-11b262f59dca] Instance destroyed successfully.
Aug 26 10:35:02 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:35:02 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-5487f5c7-61d6-46a2-bf10-f223141e5b72 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] [instance: d147974d-213d-4aa3-8d03-11b262f59dca] Beginning cold snapshot process
Aug 26 10:35:02 user nova-compute[73572]: DEBUG nova.compute.manager [req-6896fc50-0c4e-45a7-bbd9-f060ad8a7826 req-1b78f05d-0fa9-4a56-ac30-a312e42e6439 service nova] [instance: d147974d-213d-4aa3-8d03-11b262f59dca] Received event network-vif-unplugged-8d51de2d-85b6-4a2f-80db-5fe69b8fd11b {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:35:02 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-6896fc50-0c4e-45a7-bbd9-f060ad8a7826 req-1b78f05d-0fa9-4a56-ac30-a312e42e6439 service nova] Acquiring lock "d147974d-213d-4aa3-8d03-11b262f59dca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:35:02 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-6896fc50-0c4e-45a7-bbd9-f060ad8a7826 req-1b78f05d-0fa9-4a56-ac30-a312e42e6439 service nova] Lock "d147974d-213d-4aa3-8d03-11b262f59dca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:35:02 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-6896fc50-0c4e-45a7-bbd9-f060ad8a7826 req-1b78f05d-0fa9-4a56-ac30-a312e42e6439 service nova] Lock "d147974d-213d-4aa3-8d03-11b262f59dca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:35:02 user nova-compute[73572]: DEBUG nova.compute.manager [req-6896fc50-0c4e-45a7-bbd9-f060ad8a7826 req-1b78f05d-0fa9-4a56-ac30-a312e42e6439 service nova] [instance: d147974d-213d-4aa3-8d03-11b262f59dca] No waiting events found dispatching network-vif-unplugged-8d51de2d-85b6-4a2f-80db-5fe69b8fd11b {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:35:02 user nova-compute[73572]: WARNING nova.compute.manager [req-6896fc50-0c4e-45a7-bbd9-f060ad8a7826 req-1b78f05d-0fa9-4a56-ac30-a312e42e6439 service nova] [instance: d147974d-213d-4aa3-8d03-11b262f59dca] Received unexpected event network-vif-unplugged-8d51de2d-85b6-4a2f-80db-5fe69b8fd11b for instance with vm_state active and task_state shelving.
Aug 26 10:35:02 user nova-compute[73572]: DEBUG nova.privsep.utils [None req-5487f5c7-61d6-46a2-bf10-f223141e5b72 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73572) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 26 10:35:02 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-5487f5c7-61d6-46a2-bf10-f223141e5b72 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/d147974d-213d-4aa3-8d03-11b262f59dca/disk /opt/stack/data/nova/instances/snapshots/tmp5wgvpvr3/4f3b021377f34bb990a8d4241c73b9c7 {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:35:03 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:35:03 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:35:03 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:35:03 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:35:03 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:35:03 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:35:03 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:35:04 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-5487f5c7-61d6-46a2-bf10-f223141e5b72 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/d147974d-213d-4aa3-8d03-11b262f59dca/disk /opt/stack/data/nova/instances/snapshots/tmp5wgvpvr3/4f3b021377f34bb990a8d4241c73b9c7" returned: 0 in 1.250s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:35:04 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-5487f5c7-61d6-46a2-bf10-f223141e5b72 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] [instance: d147974d-213d-4aa3-8d03-11b262f59dca] Snapshot extracted, beginning image upload
Aug 26 10:35:04 user nova-compute[73572]: DEBUG nova.compute.manager [req-67ff3ba7-24cb-4d08-95fa-4aea0da91273 req-bf4cc45e-11cb-486b-97e2-0035a46fefd2 service nova] [instance: d147974d-213d-4aa3-8d03-11b262f59dca] Received event network-vif-plugged-8d51de2d-85b6-4a2f-80db-5fe69b8fd11b {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:35:04 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-67ff3ba7-24cb-4d08-95fa-4aea0da91273 req-bf4cc45e-11cb-486b-97e2-0035a46fefd2 service nova] Acquiring lock "d147974d-213d-4aa3-8d03-11b262f59dca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:35:04 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-67ff3ba7-24cb-4d08-95fa-4aea0da91273 req-bf4cc45e-11cb-486b-97e2-0035a46fefd2 service nova] Lock "d147974d-213d-4aa3-8d03-11b262f59dca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:35:04 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-67ff3ba7-24cb-4d08-95fa-4aea0da91273 req-bf4cc45e-11cb-486b-97e2-0035a46fefd2 service nova] Lock "d147974d-213d-4aa3-8d03-11b262f59dca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:35:04 user nova-compute[73572]: DEBUG nova.compute.manager [req-67ff3ba7-24cb-4d08-95fa-4aea0da91273 req-bf4cc45e-11cb-486b-97e2-0035a46fefd2 service nova] [instance: d147974d-213d-4aa3-8d03-11b262f59dca] No waiting events found dispatching network-vif-plugged-8d51de2d-85b6-4a2f-80db-5fe69b8fd11b {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:35:04 user nova-compute[73572]: WARNING nova.compute.manager [req-67ff3ba7-24cb-4d08-95fa-4aea0da91273 req-bf4cc45e-11cb-486b-97e2-0035a46fefd2 service nova] [instance: d147974d-213d-4aa3-8d03-11b262f59dca] Received unexpected event network-vif-plugged-8d51de2d-85b6-4a2f-80db-5fe69b8fd11b for instance with vm_state active and task_state shelving_image_uploading.
Aug 26 10:35:05 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:35:06 user nova-compute[73572]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693046091.5505316, c457a41c-2ee2-4821-94cf-69c091589241 => Stopped> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:35:06 user nova-compute[73572]: INFO nova.compute.manager [-] [instance: c457a41c-2ee2-4821-94cf-69c091589241] VM Stopped (Lifecycle Event)
Aug 26 10:35:06 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:35:06 user nova-compute[73572]: DEBUG nova.compute.manager [None req-60458598-5ff4-46e4-942a-f20729260165 None None] [instance: c457a41c-2ee2-4821-94cf-69c091589241] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:35:06 user nova-compute[73572]: DEBUG nova.compute.manager [None req-60458598-5ff4-46e4-942a-f20729260165 None None] [instance: c457a41c-2ee2-4821-94cf-69c091589241] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 4 {{(pid=73572) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 10:35:06 user nova-compute[73572]: INFO nova.compute.manager [None req-60458598-5ff4-46e4-942a-f20729260165 None None] [instance: c457a41c-2ee2-4821-94cf-69c091589241] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 26 10:35:06 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-5487f5c7-61d6-46a2-bf10-f223141e5b72 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] [instance: d147974d-213d-4aa3-8d03-11b262f59dca] Snapshot image upload complete
Aug 26 10:35:06 user nova-compute[73572]: DEBUG nova.compute.manager [None req-5487f5c7-61d6-46a2-bf10-f223141e5b72 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] [instance: d147974d-213d-4aa3-8d03-11b262f59dca] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:35:06 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-6c49c27a-bae3-4942-987a-44276340ff51 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] [instance: c457a41c-2ee2-4821-94cf-69c091589241] Starting finish_migration {{(pid=73572) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Aug 26 10:35:06 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-6c49c27a-bae3-4942-987a-44276340ff51 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] [instance: c457a41c-2ee2-4821-94cf-69c091589241] Instance directory exists: not creating {{(pid=73572) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 26 10:35:06 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-6c49c27a-bae3-4942-987a-44276340ff51 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] [instance: c457a41c-2ee2-4821-94cf-69c091589241] Creating image(s)
Aug 26 10:35:06 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-6c49c27a-bae3-4942-987a-44276340ff51 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] [instance: c457a41c-2ee2-4821-94cf-69c091589241] Did not create local disks {{(pid=73572) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 26 10:35:06 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-6c49c27a-bae3-4942-987a-44276340ff51 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] [instance: c457a41c-2ee2-4821-94cf-69c091589241] Ensure instance console log exists: /opt/stack/data/nova/instances/c457a41c-2ee2-4821-94cf-69c091589241/console.log {{(pid=73572) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 10:35:06 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-6c49c27a-bae3-4942-987a-44276340ff51 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:35:06 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-6c49c27a-bae3-4942-987a-44276340ff51 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:35:06 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-6c49c27a-bae3-4942-987a-44276340ff51 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:35:06 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-6c49c27a-bae3-4942-987a-44276340ff51 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] [instance: c457a41c-2ee2-4821-94cf-69c091589241] Start _get_guest_xml network_info=[{"id": "deb899b2-ba04-427b-b4ea-a514b8eda260", "address": "fa:16:3e:05:c8:e3", "network": {"id": "43215883-3d00-4be7-8c40-bdaf3f01bef9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1088544153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1088544153-network", "vif_mac": "fa:16:3e:05:c8:e3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7935bccc360b46b589fd57d53f334595", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdeb899b2-ba", "ovs_interfaceid": "deb899b2-ba04-427b-b4ea-a514b8eda260", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'disk_bus': 'virtio', 'boot_index': 0, 'mount_device': '/dev/vda', 'attachment_id': '41660ca7-2ea6-48c1-bbe8-288e8774434a', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:6c17592e-3227-473f-ac7b-3e911dcb0d56'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QlxWrapc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'c457a41c-2ee2-4821-94cf-69c091589241', 'attached_at': '2023-08-26T10:35:07.000000', 'detached_at': '', 'volume_id': '6c17592e-3227-473f-ac7b-3e911dcb0d56', 'serial': '6c17592e-3227-473f-ac7b-3e911dcb0d56'}, 'guest_format': None, 'device_type': 'disk', 'volume_type': None} {{(pid=73572) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 10:35:06 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-6c49c27a-bae3-4942-987a-44276340ff51 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:35:06 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-6c49c27a-bae3-4942-987a-44276340ff51 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:35:06 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-6c49c27a-bae3-4942-987a-44276340ff51 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73572) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 10:35:06 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-6c49c27a-bae3-4942-987a-44276340ff51 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] CPU controller missing on host. {{(pid=73572) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 10:35:06 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-6c49c27a-bae3-4942-987a-44276340ff51 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73572) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 10:35:06 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-6c49c27a-bae3-4942-987a-44276340ff51 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] CPU controller found on host. {{(pid=73572) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 10:35:06 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-6c49c27a-bae3-4942-987a-44276340ff51 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73572) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 10:35:06 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-6c49c27a-bae3-4942-987a-44276340ff51 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T10:07:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 10:35:06 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-6c49c27a-bae3-4942-987a-44276340ff51 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Flavor limits 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 10:35:06 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-6c49c27a-bae3-4942-987a-44276340ff51 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Image limits 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 10:35:06 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-6c49c27a-bae3-4942-987a-44276340ff51 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Flavor pref 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 10:35:06 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-6c49c27a-bae3-4942-987a-44276340ff51 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Image pref 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 10:35:06 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-6c49c27a-bae3-4942-987a-44276340ff51 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 10:35:06 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-6c49c27a-bae3-4942-987a-44276340ff51 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 10:35:06 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-6c49c27a-bae3-4942-987a-44276340ff51 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73572) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 10:35:06 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-6c49c27a-bae3-4942-987a-44276340ff51 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Got 1 possible topologies {{(pid=73572) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 10:35:06 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-6c49c27a-bae3-4942-987a-44276340ff51 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 10:35:06 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-6c49c27a-bae3-4942-987a-44276340ff51 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 10:35:06 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6c49c27a-bae3-4942-987a-44276340ff51 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] [instance: c457a41c-2ee2-4821-94cf-69c091589241] Calling os-brick to attach iSCSI Volume {{(pid=73572) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 10:35:06 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c49c27a-bae3-4942-987a-44276340ff51 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc89c3d6a10>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:6c17592e-3227-473f-ac7b-3e911dcb0d56'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QlxWrapc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 10:35:06 user nova-compute[73572]: WARNING os_brick.initiator.connectors.base [None req-6c49c27a-bae3-4942-987a-44276340ff51 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 10:35:06 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-6c49c27a-bae3-4942-987a-44276340ff51 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 10:35:06 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-6c49c27a-bae3-4942-987a-44276340ff51 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 10:35:06 user nova-compute[73572]: WARNING os_brick.initiator.connectors.base [None req-6c49c27a-bae3-4942-987a-44276340ff51 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 10:35:06 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-6c49c27a-bae3-4942-987a-44276340ff51 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6c17592e-3227-473f-ac7b-3e911dcb0d56" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 10:35:06 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-6c49c27a-bae3-4942-987a-44276340ff51 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6c17592e-3227-473f-ac7b-3e911dcb0d56" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 10:35:06 user nova-compute[73572]: INFO os_brick.initiator.connectors.iscsi [None req-6c49c27a-bae3-4942-987a-44276340ff51 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 10:35:06 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c17592e-3227-473f-ac7b-3e911dcb0d56 -p 172.16.0.220:3260 {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:35:06 user nova-compute[73572]: INFO nova.compute.manager [None req-5487f5c7-61d6-46a2-bf10-f223141e5b72 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] [instance: d147974d-213d-4aa3-8d03-11b262f59dca] Shelve offloading
Aug 26 10:35:06 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c17592e-3227-473f-ac7b-3e911dcb0d56 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:35:06 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[71d546be-dff0-4ea5-8475-42b1c808b74e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:35:06 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c49c27a-bae3-4942-987a-44276340ff51 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 10:35:06 user nova-compute[73572]:  {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:35:06 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c17592e-3227-473f-ac7b-3e911dcb0d56 -p 172.16.0.220:3260 --interface default --op new {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:35:06 user nova-compute[73572]: INFO nova.virt.libvirt.driver [-] [instance: d147974d-213d-4aa3-8d03-11b262f59dca] Instance destroyed successfully.
Aug 26 10:35:06 user nova-compute[73572]: DEBUG nova.compute.manager [None req-5487f5c7-61d6-46a2-bf10-f223141e5b72 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] [instance: d147974d-213d-4aa3-8d03-11b262f59dca] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:35:06 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-5487f5c7-61d6-46a2-bf10-f223141e5b72 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Acquiring lock "refresh_cache-d147974d-213d-4aa3-8d03-11b262f59dca" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:35:06 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-5487f5c7-61d6-46a2-bf10-f223141e5b72 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Acquired lock "refresh_cache-d147974d-213d-4aa3-8d03-11b262f59dca" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:35:06 user nova-compute[73572]: DEBUG nova.network.neutron [None req-5487f5c7-61d6-46a2-bf10-f223141e5b72 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] [instance: d147974d-213d-4aa3-8d03-11b262f59dca] Building network info cache for instance {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 10:35:06 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c17592e-3227-473f-ac7b-3e911dcb0d56 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:35:06 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[79b3012a-6b1c-4ac0-b012-5ec79d9f4105]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6c17592e-3227-473f-ac7b-3e911dcb0d56] added\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:35:06 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c49c27a-bae3-4942-987a-44276340ff51 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6c17592e-3227-473f-ac7b-3e911dcb0d56] added
Aug 26 10:35:06 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:35:06 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c17592e-3227-473f-ac7b-3e911dcb0d56 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:35:06 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c17592e-3227-473f-ac7b-3e911dcb0d56 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.032s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:35:06 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[66069940-f8b3-48be-84ba-90a703d43695]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:35:06 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c49c27a-bae3-4942-987a-44276340ff51 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:35:06 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c17592e-3227-473f-ac7b-3e911dcb0d56 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:35:06 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c17592e-3227-473f-ac7b-3e911dcb0d56 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:35:06 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[461408c7-796a-4c75-a044-4d0e7a9abc49]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:35:06 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c49c27a-bae3-4942-987a-44276340ff51 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:35:06 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c17592e-3227-473f-ac7b-3e911dcb0d56 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QlxWrapc {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:35:06 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c17592e-3227-473f-ac7b-3e911dcb0d56 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QlxWrapc" returned: 0 in 0.020s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:35:06 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[9826f938-7b7f-4129-a0cd-69145bd057c7]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:35:06 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c49c27a-bae3-4942-987a-44276340ff51 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QlxWrapc'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:35:06 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c17592e-3227-473f-ac7b-3e911dcb0d56 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:35:07 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c17592e-3227-473f-ac7b-3e911dcb0d56 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:35:07 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[a939a5b8-2fd2-4929-aeb8-4ee337db3b14]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:35:07 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c49c27a-bae3-4942-987a-44276340ff51 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:35:07 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:35:07 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:35:07 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f5f618b-e25a-47c2-b390-e6026b41fcb9]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec96ec24-bf73-4f38-ac9f-eb2699d0a661 (non-flash)\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:35:07 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c49c27a-bae3-4942-987a-44276340ff51 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec96ec24-bf73-4f38-ac9f-eb2699d0a661 (non-flash)
Aug 26 10:35:07 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 10:35:07 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c49c27a-bae3-4942-987a-44276340ff51 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec96ec24-bf73-4f38-ac9f-eb2699d0a661 (non-flash)
Aug 26 10:35:07 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 10:35:07 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c17592e-3227-473f-ac7b-3e911dcb0d56 -p 172.16.0.220:3260 --login {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:35:07 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c17592e-3227-473f-ac7b-3e911dcb0d56 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:35:07 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b238453-39e7-4fb0-805f-dee3c8e31bb9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6c17592e-3227-473f-ac7b-3e911dcb0d56, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6c17592e-3227-473f-ac7b-3e911dcb0d56, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:35:07 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c49c27a-bae3-4942-987a-44276340ff51 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6c17592e-3227-473f-ac7b-3e911dcb0d56, portal: 172.16.0.220,3260]
Aug 26 10:35:07 user nova-compute[73572]: Login to [iface: default, target: iqn.2010-10.org.openstack:6c17592e-3227-473f-ac7b-3e911dcb0d56, portal: 172.16.0.220,3260] successful.
Aug 26 10:35:07 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:35:07 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c17592e-3227-473f-ac7b-3e911dcb0d56 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:35:07 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c17592e-3227-473f-ac7b-3e911dcb0d56 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:35:07 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[3040dc17-2ee2-43a4-b6f9-6f0d9310e2c9]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:35:07 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c49c27a-bae3-4942-987a-44276340ff51 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:35:07 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:35:07 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:35:07 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[2872b079-eae0-4808-9f56-2ba650faf8a9]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec96ec24-bf73-4f38-ac9f-eb2699d0a661 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c17592e-3227-473f-ac7b-3e911dcb0d56 (non-flash)\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:35:07 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c49c27a-bae3-4942-987a-44276340ff51 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec96ec24-bf73-4f38-ac9f-eb2699d0a661 (non-flash)
Aug 26 10:35:07 user nova-compute[73572]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c17592e-3227-473f-ac7b-3e911dcb0d56 (non-flash)
Aug 26 10:35:07 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 10:35:07 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c49c27a-bae3-4942-987a-44276340ff51 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec96ec24-bf73-4f38-ac9f-eb2699d0a661 (non-flash)
Aug 26 10:35:07 user nova-compute[73572]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c17592e-3227-473f-ac7b-3e911dcb0d56 (non-flash)
Aug 26 10:35:07 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 10:35:07 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-6c49c27a-bae3-4942-987a-44276340ff51 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6c17592e-3227-473f-ac7b-3e911dcb0d56" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.295s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 10:35:07 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c49c27a-bae3-4942-987a-44276340ff51 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Connected to 172.16.0.220:3260 {{(pid=73572) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 10:35:07 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-6c49c27a-bae3-4942-987a-44276340ff51 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] HCTL ('33', '-', '-', 0) found on session 52 with lun 0 {{(pid=73572) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 10:35:07 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-6c49c27a-bae3-4942-987a-44276340ff51 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73572) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 10:35:07 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:35:07 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:35:07 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[7534ab7f-4504-41cd-a609-f0661b5bef47]: (4, ('- - 0', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:35:07 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-6c49c27a-bae3-4942-987a-44276340ff51 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Searching for a device in session 52 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73572) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 10:35:07 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c49c27a-bae3-4942-987a-44276340ff51 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QlxWrapc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73572) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 10:35:07 user nova-compute[73572]: DEBUG nova.network.neutron [None req-5487f5c7-61d6-46a2-bf10-f223141e5b72 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] [instance: d147974d-213d-4aa3-8d03-11b262f59dca] Updating instance_info_cache with network_info: [{"id": "8d51de2d-85b6-4a2f-80db-5fe69b8fd11b", "address": "fa:16:3e:e5:90:35", "network": {"id": "317d2681-96ce-4898-b6fb-8892ee6f706d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2049963835-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7e16843614c451d958e817c832d4cbc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d51de2d-85", "ovs_interfaceid": "8d51de2d-85b6-4a2f-80db-5fe69b8fd11b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:35:07 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-5487f5c7-61d6-46a2-bf10-f223141e5b72 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Releasing lock "refresh_cache-d147974d-213d-4aa3-8d03-11b262f59dca" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:35:08 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-6c49c27a-bae3-4942-987a-44276340ff51 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.330s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 10:35:08 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c49c27a-bae3-4942-987a-44276340ff51 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] <== connect_volume: return (1331ms) {'type': 'block', 'scsi_wwn': '26437336165636364', 'path': '/dev/sdb'} {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 10:35:08 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6c49c27a-bae3-4942-987a-44276340ff51 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] [instance: c457a41c-2ee2-4821-94cf-69c091589241] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26437336165636364', 'path': '/dev/sdb'} {{(pid=73572) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 10:35:08 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-6c49c27a-bae3-4942-987a-44276340ff51 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T10:32:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1008830200',display_name='tempest-ServerActionsTestOtherA-server-1008830200',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1008830200',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAGb4Psy4ujnztu6TKM5Yp0ao9Inx8XINL8TB7yqpPrX8pvyhV645/PRion/tWXE5RcABz76j3Pw1BeejHEQh0n16o5OpRaXWd84Wj12hPmfoj80ST4I1EIx+wC0wImDFQ==',key_name='tempest-keypair-598298583',keypairs=<?>,launch_index=0,launched_at=2023-08-26T10:33:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='7935bccc360b46b589fd57d53f334595',ramdisk_id='',reservation_id='r-dee3c84h',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-203628695',owner_user_name='tempest-ServerActionsTestOtherA-203628695-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T10:34:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='61b6124f6f6e44c5b2fd0202a15da019',uuid=c457a41c-2ee2-4821-94cf-69c091589241,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "deb899b2-ba04-427b-b4ea-a514b8eda260", "address": "fa:16:3e:05:c8:e3", "network": {"id": "43215883-3d00-4be7-8c40-bdaf3f01bef9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1088544153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1088544153-network", "vif_mac": "fa:16:3e:05:c8:e3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7935bccc360b46b589fd57d53f334595", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdeb899b2-ba", "ovs_interfaceid": "deb899b2-ba04-427b-b4ea-a514b8eda260", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73572) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 10:35:08 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-6c49c27a-bae3-4942-987a-44276340ff51 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Converting VIF {"id": "deb899b2-ba04-427b-b4ea-a514b8eda260", "address": "fa:16:3e:05:c8:e3", "network": {"id": "43215883-3d00-4be7-8c40-bdaf3f01bef9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1088544153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1088544153-network", "vif_mac": "fa:16:3e:05:c8:e3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7935bccc360b46b589fd57d53f334595", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdeb899b2-ba", "ovs_interfaceid": "deb899b2-ba04-427b-b4ea-a514b8eda260", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:35:08 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-6c49c27a-bae3-4942-987a-44276340ff51 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:c8:e3,bridge_name='br-int',has_traffic_filtering=True,id=deb899b2-ba04-427b-b4ea-a514b8eda260,network=Network(43215883-3d00-4be7-8c40-bdaf3f01bef9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdeb899b2-ba') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:35:08 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-6c49c27a-bae3-4942-987a-44276340ff51 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] [instance: c457a41c-2ee2-4821-94cf-69c091589241] End _get_guest_xml xml=<domain type="kvm">
Aug 26 10:35:08 user nova-compute[73572]:   <uuid>c457a41c-2ee2-4821-94cf-69c091589241</uuid>
Aug 26 10:35:08 user nova-compute[73572]:   <name>instance-0000002d</name>
Aug 26 10:35:08 user nova-compute[73572]:   <memory>2097152</memory>
Aug 26 10:35:08 user nova-compute[73572]:   <vcpu>1</vcpu>
Aug 26 10:35:08 user nova-compute[73572]:   <metadata>
Aug 26 10:35:08 user nova-compute[73572]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 10:35:08 user nova-compute[73572]:       <nova:package version="0.0.0"/>
Aug 26 10:35:08 user nova-compute[73572]:       <nova:name>tempest-ServerActionsTestOtherA-server-1008830200</nova:name>
Aug 26 10:35:08 user nova-compute[73572]:       <nova:creationTime>2023-08-26 10:35:06</nova:creationTime>
Aug 26 10:35:08 user nova-compute[73572]:       <nova:flavor name="m1.small">
Aug 26 10:35:08 user nova-compute[73572]:         <nova:memory>2048</nova:memory>
Aug 26 10:35:08 user nova-compute[73572]:         <nova:disk>20</nova:disk>
Aug 26 10:35:08 user nova-compute[73572]:         <nova:swap>0</nova:swap>
Aug 26 10:35:08 user nova-compute[73572]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 10:35:08 user nova-compute[73572]:         <nova:vcpus>1</nova:vcpus>
Aug 26 10:35:08 user nova-compute[73572]:       </nova:flavor>
Aug 26 10:35:08 user nova-compute[73572]:       <nova:owner>
Aug 26 10:35:08 user nova-compute[73572]:         <nova:user uuid="61b6124f6f6e44c5b2fd0202a15da019">tempest-ServerActionsTestOtherA-203628695-project-member</nova:user>
Aug 26 10:35:08 user nova-compute[73572]:         <nova:project uuid="7935bccc360b46b589fd57d53f334595">tempest-ServerActionsTestOtherA-203628695</nova:project>
Aug 26 10:35:08 user nova-compute[73572]:       </nova:owner>
Aug 26 10:35:08 user nova-compute[73572]:       <nova:ports>
Aug 26 10:35:08 user nova-compute[73572]:         <nova:port uuid="deb899b2-ba04-427b-b4ea-a514b8eda260">
Aug 26 10:35:08 user nova-compute[73572]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 26 10:35:08 user nova-compute[73572]:         </nova:port>
Aug 26 10:35:08 user nova-compute[73572]:       </nova:ports>
Aug 26 10:35:08 user nova-compute[73572]:     </nova:instance>
Aug 26 10:35:08 user nova-compute[73572]:   </metadata>
Aug 26 10:35:08 user nova-compute[73572]:   <sysinfo type="smbios">
Aug 26 10:35:08 user nova-compute[73572]:     <system>
Aug 26 10:35:08 user nova-compute[73572]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 10:35:08 user nova-compute[73572]:       <entry name="product">OpenStack Nova</entry>
Aug 26 10:35:08 user nova-compute[73572]:       <entry name="version">0.0.0</entry>
Aug 26 10:35:08 user nova-compute[73572]:       <entry name="serial">c457a41c-2ee2-4821-94cf-69c091589241</entry>
Aug 26 10:35:08 user nova-compute[73572]:       <entry name="uuid">c457a41c-2ee2-4821-94cf-69c091589241</entry>
Aug 26 10:35:08 user nova-compute[73572]:       <entry name="family">Virtual Machine</entry>
Aug 26 10:35:08 user nova-compute[73572]:     </system>
Aug 26 10:35:08 user nova-compute[73572]:   </sysinfo>
Aug 26 10:35:08 user nova-compute[73572]:   <os>
Aug 26 10:35:08 user nova-compute[73572]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 10:35:08 user nova-compute[73572]:     <boot dev="hd"/>
Aug 26 10:35:08 user nova-compute[73572]:     <smbios mode="sysinfo"/>
Aug 26 10:35:08 user nova-compute[73572]:   </os>
Aug 26 10:35:08 user nova-compute[73572]:   <features>
Aug 26 10:35:08 user nova-compute[73572]:     <acpi/>
Aug 26 10:35:08 user nova-compute[73572]:     <apic/>
Aug 26 10:35:08 user nova-compute[73572]:     <vmcoreinfo/>
Aug 26 10:35:08 user nova-compute[73572]:   </features>
Aug 26 10:35:08 user nova-compute[73572]:   <clock offset="utc">
Aug 26 10:35:08 user nova-compute[73572]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 10:35:08 user nova-compute[73572]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 10:35:08 user nova-compute[73572]:     <timer name="hpet" present="no"/>
Aug 26 10:35:08 user nova-compute[73572]:   </clock>
Aug 26 10:35:08 user nova-compute[73572]:   <cpu mode="custom" match="exact">
Aug 26 10:35:08 user nova-compute[73572]:     <model>Nehalem</model>
Aug 26 10:35:08 user nova-compute[73572]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 10:35:08 user nova-compute[73572]:   </cpu>
Aug 26 10:35:08 user nova-compute[73572]:   <devices>
Aug 26 10:35:08 user nova-compute[73572]:     <disk type="block" device="disk">
Aug 26 10:35:08 user nova-compute[73572]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 10:35:08 user nova-compute[73572]:       <source dev="/dev/sdb"/>
Aug 26 10:35:08 user nova-compute[73572]:       <target dev="vda" bus="virtio"/>
Aug 26 10:35:08 user nova-compute[73572]:       <serial>6c17592e-3227-473f-ac7b-3e911dcb0d56</serial>
Aug 26 10:35:08 user nova-compute[73572]:     </disk>
Aug 26 10:35:08 user nova-compute[73572]:     <interface type="ethernet">
Aug 26 10:35:08 user nova-compute[73572]:       <mac address="fa:16:3e:05:c8:e3"/>
Aug 26 10:35:08 user nova-compute[73572]:       <model type="virtio"/>
Aug 26 10:35:08 user nova-compute[73572]:       <mtu size="1442"/>
Aug 26 10:35:08 user nova-compute[73572]:       <target dev="tapdeb899b2-ba"/>
Aug 26 10:35:08 user nova-compute[73572]:     </interface>
Aug 26 10:35:08 user nova-compute[73572]:     <serial type="pty">
Aug 26 10:35:08 user nova-compute[73572]:       <log file="/opt/stack/data/nova/instances/c457a41c-2ee2-4821-94cf-69c091589241/console.log" append="off"/>
Aug 26 10:35:08 user nova-compute[73572]:     </serial>
Aug 26 10:35:08 user nova-compute[73572]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 10:35:08 user nova-compute[73572]:     <video>
Aug 26 10:35:08 user nova-compute[73572]:       <model type="virtio"/>
Aug 26 10:35:08 user nova-compute[73572]:     </video>
Aug 26 10:35:08 user nova-compute[73572]:     <rng model="virtio">
Aug 26 10:35:08 user nova-compute[73572]:       <backend model="random">/dev/urandom</backend>
Aug 26 10:35:08 user nova-compute[73572]:     </rng>
Aug 26 10:35:08 user nova-compute[73572]:     <controller type="usb" index="0" model="none"/>
Aug 26 10:35:08 user nova-compute[73572]:     <memballoon model="virtio">
Aug 26 10:35:08 user nova-compute[73572]:       <stats period="10"/>
Aug 26 10:35:08 user nova-compute[73572]:     </memballoon>
Aug 26 10:35:08 user nova-compute[73572]:   </devices>
Aug 26 10:35:08 user nova-compute[73572]: </domain>
Aug 26 10:35:08 user nova-compute[73572]:  {{(pid=73572) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 10:35:08 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-6c49c27a-bae3-4942-987a-44276340ff51 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T10:32:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1008830200',display_name='tempest-ServerActionsTestOtherA-server-1008830200',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1008830200',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAGb4Psy4ujnztu6TKM5Yp0ao9Inx8XINL8TB7yqpPrX8pvyhV645/PRion/tWXE5RcABz76j3Pw1BeejHEQh0n16o5OpRaXWd84Wj12hPmfoj80ST4I1EIx+wC0wImDFQ==',key_name='tempest-keypair-598298583',keypairs=<?>,launch_index=0,launched_at=2023-08-26T10:33:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='7935bccc360b46b589fd57d53f334595',ramdisk_id='',reservation_id='r-dee3c84h',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-203628695',owner_user_name='tempest-ServerActionsTestOtherA-203628695-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T10:34:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='61b6124f6f6e44c5b2fd0202a15da019',uuid=c457a41c-2ee2-4821-94cf-69c091589241,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "deb899b2-ba04-427b-b4ea-a514b8eda260", "address": "fa:16:3e:05:c8:e3", "network": {"id": "43215883-3d00-4be7-8c40-bdaf3f01bef9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1088544153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1088544153-network", "vif_mac": "fa:16:3e:05:c8:e3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7935bccc360b46b589fd57d53f334595", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdeb899b2-ba", "ovs_interfaceid": "deb899b2-ba04-427b-b4ea-a514b8eda260", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 10:35:08 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-6c49c27a-bae3-4942-987a-44276340ff51 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Converting VIF {"id": "deb899b2-ba04-427b-b4ea-a514b8eda260", "address": "fa:16:3e:05:c8:e3", "network": {"id": "43215883-3d00-4be7-8c40-bdaf3f01bef9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1088544153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1088544153-network", "vif_mac": "fa:16:3e:05:c8:e3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7935bccc360b46b589fd57d53f334595", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdeb899b2-ba", "ovs_interfaceid": "deb899b2-ba04-427b-b4ea-a514b8eda260", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:35:08 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-6c49c27a-bae3-4942-987a-44276340ff51 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:c8:e3,bridge_name='br-int',has_traffic_filtering=True,id=deb899b2-ba04-427b-b4ea-a514b8eda260,network=Network(43215883-3d00-4be7-8c40-bdaf3f01bef9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdeb899b2-ba') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:35:08 user nova-compute[73572]: DEBUG os_vif [None req-6c49c27a-bae3-4942-987a-44276340ff51 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:c8:e3,bridge_name='br-int',has_traffic_filtering=True,id=deb899b2-ba04-427b-b4ea-a514b8eda260,network=Network(43215883-3d00-4be7-8c40-bdaf3f01bef9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdeb899b2-ba') {{(pid=73572) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 10:35:08 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:35:08 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:35:08 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 10:35:08 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:35:08 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdeb899b2-ba, may_exist=True, interface_attrs={}) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:35:08 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapdeb899b2-ba, col_values=(('external_ids', {'iface-id': 'deb899b2-ba04-427b-b4ea-a514b8eda260', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:05:c8:e3', 'vm-uuid': 'c457a41c-2ee2-4821-94cf-69c091589241'}),), if_exists=True) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:35:08 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:35:08 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:35:08 user nova-compute[73572]: INFO nova.virt.libvirt.driver [-] [instance: d147974d-213d-4aa3-8d03-11b262f59dca] Instance destroyed successfully.
Aug 26 10:35:08 user nova-compute[73572]: DEBUG nova.objects.instance [None req-5487f5c7-61d6-46a2-bf10-f223141e5b72 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Lazy-loading 'resources' on Instance uuid d147974d-213d-4aa3-8d03-11b262f59dca {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:35:08 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:35:08 user nova-compute[73572]: INFO os_vif [None req-6c49c27a-bae3-4942-987a-44276340ff51 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:c8:e3,bridge_name='br-int',has_traffic_filtering=True,id=deb899b2-ba04-427b-b4ea-a514b8eda260,network=Network(43215883-3d00-4be7-8c40-bdaf3f01bef9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdeb899b2-ba')
Aug 26 10:35:08 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-5487f5c7-61d6-46a2-bf10-f223141e5b72 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T10:33:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1735038851',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1735038851',id=46,image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKA2CshH7isyB3vV5ETR93+hSoeCwS760V1xRpFlfuAtq/MqtMJywztpVgxj5rkLJmK+DWulBNDjaP7GLPWX9o0j64jsB+zF5uHZU8M4lTcSCf/Ws/xZAJQf9qx+64vnrA==',key_name='tempest-keypair-1853117673',keypairs=<?>,launch_index=0,launched_at=2023-08-26T10:33:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='c7e16843614c451d958e817c832d4cbc',ramdisk_id='',reservation_id='r-l9pvelsd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-706965180',owner_user_name='tempest-AttachVolumeShelveTestJSON-706965180-project-member',shelved_at='2023-08-26T10:35:06.774972',shelved_host='user',shelved_image_id='30629c2c-3606-4f8d-beb8-01f7e6597977'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T10:35:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='17243251fe57431c9c98195a16239c5f',uuid=d147974d-213d-4aa3-8d03-11b262f59dca,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "8d51de2d-85b6-4a2f-80db-5fe69b8fd11b", "address": "fa:16:3e:e5:90:35", "network": {"id": "317d2681-96ce-4898-b6fb-8892ee6f706d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2049963835-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7e16843614c451d958e817c832d4cbc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d51de2d-85", "ovs_interfaceid": "8d51de2d-85b6-4a2f-80db-5fe69b8fd11b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 10:35:08 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-5487f5c7-61d6-46a2-bf10-f223141e5b72 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Converting VIF {"id": "8d51de2d-85b6-4a2f-80db-5fe69b8fd11b", "address": "fa:16:3e:e5:90:35", "network": {"id": "317d2681-96ce-4898-b6fb-8892ee6f706d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2049963835-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7e16843614c451d958e817c832d4cbc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d51de2d-85", "ovs_interfaceid": "8d51de2d-85b6-4a2f-80db-5fe69b8fd11b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:35:08 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-5487f5c7-61d6-46a2-bf10-f223141e5b72 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:90:35,bridge_name='br-int',has_traffic_filtering=True,id=8d51de2d-85b6-4a2f-80db-5fe69b8fd11b,network=Network(317d2681-96ce-4898-b6fb-8892ee6f706d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d51de2d-85') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:35:08 user nova-compute[73572]: DEBUG os_vif [None req-5487f5c7-61d6-46a2-bf10-f223141e5b72 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:90:35,bridge_name='br-int',has_traffic_filtering=True,id=8d51de2d-85b6-4a2f-80db-5fe69b8fd11b,network=Network(317d2681-96ce-4898-b6fb-8892ee6f706d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d51de2d-85') {{(pid=73572) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 10:35:08 user nova-compute[73572]: DEBUG nova.compute.manager [req-984ece81-4afa-48c4-8349-2f4e807b1cab req-b09d7d0d-a337-4536-a02d-240d63a9ea65 service nova] [instance: d147974d-213d-4aa3-8d03-11b262f59dca] Received event network-changed-8d51de2d-85b6-4a2f-80db-5fe69b8fd11b {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:35:08 user nova-compute[73572]: DEBUG nova.compute.manager [req-984ece81-4afa-48c4-8349-2f4e807b1cab req-b09d7d0d-a337-4536-a02d-240d63a9ea65 service nova] [instance: d147974d-213d-4aa3-8d03-11b262f59dca] Refreshing instance network info cache due to event network-changed-8d51de2d-85b6-4a2f-80db-5fe69b8fd11b. {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 10:35:08 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-984ece81-4afa-48c4-8349-2f4e807b1cab req-b09d7d0d-a337-4536-a02d-240d63a9ea65 service nova] Acquiring lock "refresh_cache-d147974d-213d-4aa3-8d03-11b262f59dca" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:35:08 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-984ece81-4afa-48c4-8349-2f4e807b1cab req-b09d7d0d-a337-4536-a02d-240d63a9ea65 service nova] Acquired lock "refresh_cache-d147974d-213d-4aa3-8d03-11b262f59dca" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:35:08 user nova-compute[73572]: DEBUG nova.network.neutron [req-984ece81-4afa-48c4-8349-2f4e807b1cab req-b09d7d0d-a337-4536-a02d-240d63a9ea65 service nova] [instance: d147974d-213d-4aa3-8d03-11b262f59dca] Refreshing network info cache for port 8d51de2d-85b6-4a2f-80db-5fe69b8fd11b {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 10:35:08 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:35:08 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8d51de2d-85, bridge=br-int, if_exists=True) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:35:08 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:35:08 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:35:08 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:35:08 user nova-compute[73572]: INFO os_vif [None req-5487f5c7-61d6-46a2-bf10-f223141e5b72 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:90:35,bridge_name='br-int',has_traffic_filtering=True,id=8d51de2d-85b6-4a2f-80db-5fe69b8fd11b,network=Network(317d2681-96ce-4898-b6fb-8892ee6f706d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d51de2d-85')
Aug 26 10:35:08 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-5487f5c7-61d6-46a2-bf10-f223141e5b72 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] [instance: d147974d-213d-4aa3-8d03-11b262f59dca] Deleting instance files /opt/stack/data/nova/instances/d147974d-213d-4aa3-8d03-11b262f59dca_del
Aug 26 10:35:08 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-5487f5c7-61d6-46a2-bf10-f223141e5b72 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] [instance: d147974d-213d-4aa3-8d03-11b262f59dca] Deletion of /opt/stack/data/nova/instances/d147974d-213d-4aa3-8d03-11b262f59dca_del complete
Aug 26 10:35:08 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-6c49c27a-bae3-4942-987a-44276340ff51 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] No BDM found with device name vda, not building metadata. {{(pid=73572) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 10:35:08 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-6c49c27a-bae3-4942-987a-44276340ff51 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] No VIF found with MAC fa:16:3e:05:c8:e3, not building metadata {{(pid=73572) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 10:35:08 user nova-compute[73572]: INFO nova.scheduler.client.report [None req-5487f5c7-61d6-46a2-bf10-f223141e5b72 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Deleted allocations for instance d147974d-213d-4aa3-8d03-11b262f59dca
Aug 26 10:35:08 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-5487f5c7-61d6-46a2-bf10-f223141e5b72 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:35:08 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-5487f5c7-61d6-46a2-bf10-f223141e5b72 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:35:08 user nova-compute[73572]: DEBUG nova.objects.instance [None req-5487f5c7-61d6-46a2-bf10-f223141e5b72 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Lazy-loading 'numa_topology' on Instance uuid d147974d-213d-4aa3-8d03-11b262f59dca {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:35:08 user nova-compute[73572]: DEBUG nova.objects.base [None req-5487f5c7-61d6-46a2-bf10-f223141e5b72 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Object Instance<d147974d-213d-4aa3-8d03-11b262f59dca> lazy-loaded attributes: resources,numa_topology {{(pid=73572) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 10:35:08 user nova-compute[73572]: DEBUG nova.compute.provider_tree [None req-5487f5c7-61d6-46a2-bf10-f223141e5b72 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Inventory has not changed in ProviderTree for provider: e2cec974-59b2-4c77-a53d-a7f4e5a30d75 {{(pid=73572) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 10:35:08 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-5487f5c7-61d6-46a2-bf10-f223141e5b72 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Inventory has not changed for provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73572) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 10:35:08 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-5487f5c7-61d6-46a2-bf10-f223141e5b72 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.290s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:35:08 user nova-compute[73572]: DEBUG nova.network.neutron [req-984ece81-4afa-48c4-8349-2f4e807b1cab req-b09d7d0d-a337-4536-a02d-240d63a9ea65 service nova] [instance: d147974d-213d-4aa3-8d03-11b262f59dca] Updated VIF entry in instance network info cache for port 8d51de2d-85b6-4a2f-80db-5fe69b8fd11b. {{(pid=73572) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 10:35:08 user nova-compute[73572]: DEBUG nova.network.neutron [req-984ece81-4afa-48c4-8349-2f4e807b1cab req-b09d7d0d-a337-4536-a02d-240d63a9ea65 service nova] [instance: d147974d-213d-4aa3-8d03-11b262f59dca] Updating instance_info_cache with network_info: [{"id": "8d51de2d-85b6-4a2f-80db-5fe69b8fd11b", "address": "fa:16:3e:e5:90:35", "network": {"id": "317d2681-96ce-4898-b6fb-8892ee6f706d", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-2049963835-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7e16843614c451d958e817c832d4cbc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap8d51de2d-85", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:35:08 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-984ece81-4afa-48c4-8349-2f4e807b1cab req-b09d7d0d-a337-4536-a02d-240d63a9ea65 service nova] Releasing lock "refresh_cache-d147974d-213d-4aa3-8d03-11b262f59dca" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:35:08 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-5487f5c7-61d6-46a2-bf10-f223141e5b72 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Lock "d147974d-213d-4aa3-8d03-11b262f59dca" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 7.280s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:35:09 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:35:09 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:35:10 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:35:10 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:35:10 user nova-compute[73572]: DEBUG nova.compute.manager [req-cc23e499-04a1-4b68-ab2c-0acfe39e54a8 req-c5dcdf02-c7a7-4f1e-b718-680c72c34fb2 service nova] [instance: c457a41c-2ee2-4821-94cf-69c091589241] Received event network-vif-plugged-deb899b2-ba04-427b-b4ea-a514b8eda260 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:35:10 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-cc23e499-04a1-4b68-ab2c-0acfe39e54a8 req-c5dcdf02-c7a7-4f1e-b718-680c72c34fb2 service nova] Acquiring lock "c457a41c-2ee2-4821-94cf-69c091589241-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:35:10 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-cc23e499-04a1-4b68-ab2c-0acfe39e54a8 req-c5dcdf02-c7a7-4f1e-b718-680c72c34fb2 service nova] Lock "c457a41c-2ee2-4821-94cf-69c091589241-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:35:10 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-cc23e499-04a1-4b68-ab2c-0acfe39e54a8 req-c5dcdf02-c7a7-4f1e-b718-680c72c34fb2 service nova] Lock "c457a41c-2ee2-4821-94cf-69c091589241-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:35:10 user nova-compute[73572]: DEBUG nova.compute.manager [req-cc23e499-04a1-4b68-ab2c-0acfe39e54a8 req-c5dcdf02-c7a7-4f1e-b718-680c72c34fb2 service nova] [instance: c457a41c-2ee2-4821-94cf-69c091589241] No waiting events found dispatching network-vif-plugged-deb899b2-ba04-427b-b4ea-a514b8eda260 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:35:10 user nova-compute[73572]: WARNING nova.compute.manager [req-cc23e499-04a1-4b68-ab2c-0acfe39e54a8 req-c5dcdf02-c7a7-4f1e-b718-680c72c34fb2 service nova] [instance: c457a41c-2ee2-4821-94cf-69c091589241] Received unexpected event network-vif-plugged-deb899b2-ba04-427b-b4ea-a514b8eda260 for instance with vm_state active and task_state resize_finish.
Aug 26 10:35:10 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:35:10 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:35:10 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:35:12 user nova-compute[73572]: DEBUG nova.virt.driver [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Emitting event <LifecycleEvent: 1693046112.1322298, c457a41c-2ee2-4821-94cf-69c091589241 => Resumed> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:35:12 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: c457a41c-2ee2-4821-94cf-69c091589241] VM Resumed (Lifecycle Event)
Aug 26 10:35:12 user nova-compute[73572]: DEBUG nova.compute.manager [None req-6c49c27a-bae3-4942-987a-44276340ff51 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] [instance: c457a41c-2ee2-4821-94cf-69c091589241] Instance event wait completed in 0 seconds for  {{(pid=73572) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 10:35:12 user nova-compute[73572]: INFO nova.virt.libvirt.driver [-] [instance: c457a41c-2ee2-4821-94cf-69c091589241] Instance running successfully.
Aug 26 10:35:12 user nova-compute[73572]: DEBUG nova.virt.libvirt.guest [None req-6c49c27a-bae3-4942-987a-44276340ff51 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] [instance: c457a41c-2ee2-4821-94cf-69c091589241] Failed to set time: agent not configured {{(pid=73572) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Aug 26 10:35:12 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-6c49c27a-bae3-4942-987a-44276340ff51 tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] [instance: c457a41c-2ee2-4821-94cf-69c091589241] finish_migration finished successfully. {{(pid=73572) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Aug 26 10:35:12 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: c457a41c-2ee2-4821-94cf-69c091589241] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:35:12 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: c457a41c-2ee2-4821-94cf-69c091589241] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=73572) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 10:35:12 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: c457a41c-2ee2-4821-94cf-69c091589241] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 26 10:35:12 user nova-compute[73572]: DEBUG nova.virt.driver [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Emitting event <LifecycleEvent: 1693046112.134372, c457a41c-2ee2-4821-94cf-69c091589241 => Started> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:35:12 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: c457a41c-2ee2-4821-94cf-69c091589241] VM Started (Lifecycle Event)
Aug 26 10:35:12 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: c457a41c-2ee2-4821-94cf-69c091589241] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:35:12 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: c457a41c-2ee2-4821-94cf-69c091589241] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=73572) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 10:35:12 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: c457a41c-2ee2-4821-94cf-69c091589241] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 26 10:35:12 user nova-compute[73572]: DEBUG nova.compute.manager [req-249b4b69-2dc8-4797-8115-0668f4c66684 req-b7bfd514-c253-4f88-9cd4-c43f15221c60 service nova] [instance: c457a41c-2ee2-4821-94cf-69c091589241] Received event network-vif-plugged-deb899b2-ba04-427b-b4ea-a514b8eda260 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:35:12 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-249b4b69-2dc8-4797-8115-0668f4c66684 req-b7bfd514-c253-4f88-9cd4-c43f15221c60 service nova] Acquiring lock "c457a41c-2ee2-4821-94cf-69c091589241-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:35:12 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-249b4b69-2dc8-4797-8115-0668f4c66684 req-b7bfd514-c253-4f88-9cd4-c43f15221c60 service nova] Lock "c457a41c-2ee2-4821-94cf-69c091589241-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:35:12 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-249b4b69-2dc8-4797-8115-0668f4c66684 req-b7bfd514-c253-4f88-9cd4-c43f15221c60 service nova] Lock "c457a41c-2ee2-4821-94cf-69c091589241-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:35:12 user nova-compute[73572]: DEBUG nova.compute.manager [req-249b4b69-2dc8-4797-8115-0668f4c66684 req-b7bfd514-c253-4f88-9cd4-c43f15221c60 service nova] [instance: c457a41c-2ee2-4821-94cf-69c091589241] No waiting events found dispatching network-vif-plugged-deb899b2-ba04-427b-b4ea-a514b8eda260 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:35:12 user nova-compute[73572]: WARNING nova.compute.manager [req-249b4b69-2dc8-4797-8115-0668f4c66684 req-b7bfd514-c253-4f88-9cd4-c43f15221c60 service nova] [instance: c457a41c-2ee2-4821-94cf-69c091589241] Received unexpected event network-vif-plugged-deb899b2-ba04-427b-b4ea-a514b8eda260 for instance with vm_state active and task_state resize_finish.
Aug 26 10:35:13 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:35:15 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:35:17 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:35:17 user nova-compute[73572]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693046102.501282, d147974d-213d-4aa3-8d03-11b262f59dca => Stopped> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:35:17 user nova-compute[73572]: INFO nova.compute.manager [-] [instance: d147974d-213d-4aa3-8d03-11b262f59dca] VM Stopped (Lifecycle Event)
Aug 26 10:35:17 user nova-compute[73572]: DEBUG nova.compute.manager [None req-c904a9d7-7b5e-436f-8f91-1e33324f791a None None] [instance: d147974d-213d-4aa3-8d03-11b262f59dca] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:35:18 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:35:23 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:35:23 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:35:23 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Starting heal instance info cache {{(pid=73572) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 10:35:23 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Didn't find any instances for network info cache update. {{(pid=73572) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 26 10:35:26 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:35:26 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:35:28 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:35:29 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-eff87890-6c33-440c-afbe-07aae85672ac tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Acquiring lock "4039a8aa-b1a7-497d-b12c-6fcc12ab2b0a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:35:29 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-eff87890-6c33-440c-afbe-07aae85672ac tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Lock "4039a8aa-b1a7-497d-b12c-6fcc12ab2b0a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:35:29 user nova-compute[73572]: DEBUG nova.compute.manager [None req-eff87890-6c33-440c-afbe-07aae85672ac tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 4039a8aa-b1a7-497d-b12c-6fcc12ab2b0a] Starting instance... {{(pid=73572) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 10:35:29 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-eff87890-6c33-440c-afbe-07aae85672ac tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:35:29 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-eff87890-6c33-440c-afbe-07aae85672ac tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:35:29 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-eff87890-6c33-440c-afbe-07aae85672ac tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73572) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 10:35:29 user nova-compute[73572]: INFO nova.compute.claims [None req-eff87890-6c33-440c-afbe-07aae85672ac tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 4039a8aa-b1a7-497d-b12c-6fcc12ab2b0a] Claim successful on node user
Aug 26 10:35:29 user nova-compute[73572]: DEBUG nova.compute.provider_tree [None req-eff87890-6c33-440c-afbe-07aae85672ac tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Inventory has not changed in ProviderTree for provider: e2cec974-59b2-4c77-a53d-a7f4e5a30d75 {{(pid=73572) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 10:35:29 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-eff87890-6c33-440c-afbe-07aae85672ac tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Inventory has not changed for provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73572) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 10:35:29 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-eff87890-6c33-440c-afbe-07aae85672ac tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.497s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:35:29 user nova-compute[73572]: DEBUG nova.compute.manager [None req-eff87890-6c33-440c-afbe-07aae85672ac tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 4039a8aa-b1a7-497d-b12c-6fcc12ab2b0a] Start building networks asynchronously for instance. {{(pid=73572) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 10:35:29 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:35:29 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:35:29 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73572) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 10:35:29 user nova-compute[73572]: DEBUG nova.compute.manager [None req-eff87890-6c33-440c-afbe-07aae85672ac tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 4039a8aa-b1a7-497d-b12c-6fcc12ab2b0a] Allocating IP information in the background. {{(pid=73572) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 10:35:29 user nova-compute[73572]: DEBUG nova.network.neutron [None req-eff87890-6c33-440c-afbe-07aae85672ac tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 4039a8aa-b1a7-497d-b12c-6fcc12ab2b0a] allocate_for_instance() {{(pid=73572) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 10:35:29 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-eff87890-6c33-440c-afbe-07aae85672ac tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 4039a8aa-b1a7-497d-b12c-6fcc12ab2b0a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 10:35:29 user nova-compute[73572]: DEBUG nova.compute.manager [None req-eff87890-6c33-440c-afbe-07aae85672ac tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 4039a8aa-b1a7-497d-b12c-6fcc12ab2b0a] Start building block device mappings for instance. {{(pid=73572) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 10:35:29 user nova-compute[73572]: INFO nova.virt.block_device [None req-eff87890-6c33-440c-afbe-07aae85672ac tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 4039a8aa-b1a7-497d-b12c-6fcc12ab2b0a] Booting with volume ad1b4b19-ad16-436c-9fa3-e718bea4f540 at /dev/vda
Aug 26 10:35:29 user nova-compute[73572]: DEBUG nova.policy [None req-eff87890-6c33-440c-afbe-07aae85672ac tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e1e80942e5db41c782bda686b10e2e4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc130586d9f4581953f1b8ae1c4465e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73572) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 10:35:30 user nova-compute[73572]: DEBUG os_brick.utils [None req-eff87890-6c33-440c-afbe-07aae85672ac tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 10:35:30 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:35:30 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:35:30 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d51d833-1201-4111-95fa-743f0f207cb8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:de8a79ed912\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:35:30 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:35:30 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:35:30 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[a753990f-5e08-4974-8469-949d61c4e72a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:35:30 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:35:30 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:35:30 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[919d2898-d6bc-4c55-8bfe-6a8ddffaf3c6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:35:30 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[04383a58-75c4-4b16-a30b-730eaec880af]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:35:30 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-eff87890-6c33-440c-afbe-07aae85672ac tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Running cmd (subprocess): nvme version {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:35:30 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-eff87890-6c33-440c-afbe-07aae85672ac tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] 'nvme version' failed. Not Retrying. {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 10:35:30 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.nvmeof [None req-eff87890-6c33-440c-afbe-07aae85672ac tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] nvme not present on system {{(pid=73572) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 10:35:30 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:35:30 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 10:35:30 user nova-compute[73572]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 10:35:30 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fdc332d-f178-4444-853b-d4f49b590883]: (4, '') {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:35:30 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.lightos [None req-eff87890-6c33-440c-afbe-07aae85672ac tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73572) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 10:35:30 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.lightos [None req-eff87890-6c33-440c-afbe-07aae85672ac tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73572) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 10:35:30 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.lightos [None req-eff87890-6c33-440c-afbe-07aae85672ac tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] LIGHTOS: no hostnqn found. {{(pid=73572) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 10:35:30 user nova-compute[73572]: DEBUG os_brick.utils [None req-eff87890-6c33-440c-afbe-07aae85672ac tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:de8a79ed912', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 10:35:30 user nova-compute[73572]: DEBUG nova.virt.block_device [None req-eff87890-6c33-440c-afbe-07aae85672ac tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 4039a8aa-b1a7-497d-b12c-6fcc12ab2b0a] Updating existing volume attachment record: 002ccc08-f46b-4eb0-9843-571f7bb48e29 {{(pid=73572) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 10:35:30 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:35:30 user nova-compute[73572]: DEBUG nova.network.neutron [None req-eff87890-6c33-440c-afbe-07aae85672ac tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 4039a8aa-b1a7-497d-b12c-6fcc12ab2b0a] Successfully created port: 316fd822-b966-44d8-8147-5025d918f270 {{(pid=73572) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 10:35:31 user nova-compute[73572]: DEBUG nova.network.neutron [None req-eff87890-6c33-440c-afbe-07aae85672ac tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 4039a8aa-b1a7-497d-b12c-6fcc12ab2b0a] Successfully updated port: 316fd822-b966-44d8-8147-5025d918f270 {{(pid=73572) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 10:35:31 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-eff87890-6c33-440c-afbe-07aae85672ac tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Acquiring lock "refresh_cache-4039a8aa-b1a7-497d-b12c-6fcc12ab2b0a" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:35:31 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-eff87890-6c33-440c-afbe-07aae85672ac tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Acquired lock "refresh_cache-4039a8aa-b1a7-497d-b12c-6fcc12ab2b0a" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:35:31 user nova-compute[73572]: DEBUG nova.network.neutron [None req-eff87890-6c33-440c-afbe-07aae85672ac tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 4039a8aa-b1a7-497d-b12c-6fcc12ab2b0a] Building network info cache for instance {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 10:35:31 user nova-compute[73572]: DEBUG nova.compute.manager [req-7aa0a741-be8a-411e-9ae0-2098d851d0b6 req-8b194535-cf7f-4335-b209-5aaf68e1b551 service nova] [instance: 4039a8aa-b1a7-497d-b12c-6fcc12ab2b0a] Received event network-changed-316fd822-b966-44d8-8147-5025d918f270 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:35:31 user nova-compute[73572]: DEBUG nova.compute.manager [req-7aa0a741-be8a-411e-9ae0-2098d851d0b6 req-8b194535-cf7f-4335-b209-5aaf68e1b551 service nova] [instance: 4039a8aa-b1a7-497d-b12c-6fcc12ab2b0a] Refreshing instance network info cache due to event network-changed-316fd822-b966-44d8-8147-5025d918f270. {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 10:35:31 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-7aa0a741-be8a-411e-9ae0-2098d851d0b6 req-8b194535-cf7f-4335-b209-5aaf68e1b551 service nova] Acquiring lock "refresh_cache-4039a8aa-b1a7-497d-b12c-6fcc12ab2b0a" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:35:31 user nova-compute[73572]: DEBUG nova.network.neutron [None req-eff87890-6c33-440c-afbe-07aae85672ac tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 4039a8aa-b1a7-497d-b12c-6fcc12ab2b0a] Instance cache missing network info. {{(pid=73572) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 10:35:32 user nova-compute[73572]: DEBUG nova.network.neutron [None req-eff87890-6c33-440c-afbe-07aae85672ac tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 4039a8aa-b1a7-497d-b12c-6fcc12ab2b0a] Updating instance_info_cache with network_info: [{"id": "316fd822-b966-44d8-8147-5025d918f270", "address": "fa:16:3e:0f:a1:92", "network": {"id": "c520ee18-34a7-4781-bc97-419e9a702d40", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-280196989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfc130586d9f4581953f1b8ae1c4465e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap316fd822-b9", "ovs_interfaceid": "316fd822-b966-44d8-8147-5025d918f270", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:35:32 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-eff87890-6c33-440c-afbe-07aae85672ac tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Releasing lock "refresh_cache-4039a8aa-b1a7-497d-b12c-6fcc12ab2b0a" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:35:32 user nova-compute[73572]: DEBUG nova.compute.manager [None req-eff87890-6c33-440c-afbe-07aae85672ac tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 4039a8aa-b1a7-497d-b12c-6fcc12ab2b0a] Instance network_info: |[{"id": "316fd822-b966-44d8-8147-5025d918f270", "address": "fa:16:3e:0f:a1:92", "network": {"id": "c520ee18-34a7-4781-bc97-419e9a702d40", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-280196989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfc130586d9f4581953f1b8ae1c4465e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap316fd822-b9", "ovs_interfaceid": "316fd822-b966-44d8-8147-5025d918f270", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73572) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 10:35:32 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-7aa0a741-be8a-411e-9ae0-2098d851d0b6 req-8b194535-cf7f-4335-b209-5aaf68e1b551 service nova] Acquired lock "refresh_cache-4039a8aa-b1a7-497d-b12c-6fcc12ab2b0a" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:35:32 user nova-compute[73572]: DEBUG nova.network.neutron [req-7aa0a741-be8a-411e-9ae0-2098d851d0b6 req-8b194535-cf7f-4335-b209-5aaf68e1b551 service nova] [instance: 4039a8aa-b1a7-497d-b12c-6fcc12ab2b0a] Refreshing network info cache for port 316fd822-b966-44d8-8147-5025d918f270 {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 10:35:32 user nova-compute[73572]: DEBUG nova.network.neutron [req-7aa0a741-be8a-411e-9ae0-2098d851d0b6 req-8b194535-cf7f-4335-b209-5aaf68e1b551 service nova] [instance: 4039a8aa-b1a7-497d-b12c-6fcc12ab2b0a] Updated VIF entry in instance network info cache for port 316fd822-b966-44d8-8147-5025d918f270. {{(pid=73572) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 10:35:32 user nova-compute[73572]: DEBUG nova.network.neutron [req-7aa0a741-be8a-411e-9ae0-2098d851d0b6 req-8b194535-cf7f-4335-b209-5aaf68e1b551 service nova] [instance: 4039a8aa-b1a7-497d-b12c-6fcc12ab2b0a] Updating instance_info_cache with network_info: [{"id": "316fd822-b966-44d8-8147-5025d918f270", "address": "fa:16:3e:0f:a1:92", "network": {"id": "c520ee18-34a7-4781-bc97-419e9a702d40", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-280196989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfc130586d9f4581953f1b8ae1c4465e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap316fd822-b9", "ovs_interfaceid": "316fd822-b966-44d8-8147-5025d918f270", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:35:32 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-7aa0a741-be8a-411e-9ae0-2098d851d0b6 req-8b194535-cf7f-4335-b209-5aaf68e1b551 service nova] Releasing lock "refresh_cache-4039a8aa-b1a7-497d-b12c-6fcc12ab2b0a" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:35:33 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:35:34 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:35:35 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:35:36 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:35:36 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:35:36 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:35:36 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:35:36 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:35:36 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Auditing locally available compute resources for user (node: user) {{(pid=73572) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 10:35:36 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-c16ee3db-7724-457c-841e-8c172a1cff6f tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Acquiring lock "86923c1a-89a5-4e7a-b488-8bf3a013bf83" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:35:36 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-c16ee3db-7724-457c-841e-8c172a1cff6f tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Lock "86923c1a-89a5-4e7a-b488-8bf3a013bf83" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:35:36 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-c16ee3db-7724-457c-841e-8c172a1cff6f tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Acquiring lock "86923c1a-89a5-4e7a-b488-8bf3a013bf83-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:35:36 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-c16ee3db-7724-457c-841e-8c172a1cff6f tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Lock "86923c1a-89a5-4e7a-b488-8bf3a013bf83-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:35:36 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-c16ee3db-7724-457c-841e-8c172a1cff6f tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Lock "86923c1a-89a5-4e7a-b488-8bf3a013bf83-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:35:36 user nova-compute[73572]: INFO nova.compute.manager [None req-c16ee3db-7724-457c-841e-8c172a1cff6f tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] [instance: 86923c1a-89a5-4e7a-b488-8bf3a013bf83] Terminating instance
Aug 26 10:35:36 user nova-compute[73572]: DEBUG nova.compute.manager [None req-c16ee3db-7724-457c-841e-8c172a1cff6f tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] [instance: 86923c1a-89a5-4e7a-b488-8bf3a013bf83] Start destroying the instance on the hypervisor. {{(pid=73572) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 10:35:36 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:35:37 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:35:37 user nova-compute[73572]: DEBUG nova.compute.manager [req-c906d881-31f6-4a7a-bf39-bbf6d696c3fe req-ba3b4e28-fba0-4fff-916f-8912b5a1aae4 service nova] [instance: 86923c1a-89a5-4e7a-b488-8bf3a013bf83] Received event network-vif-unplugged-db682944-8949-4bf9-b9d5-2213f0d507bc {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:35:37 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-c906d881-31f6-4a7a-bf39-bbf6d696c3fe req-ba3b4e28-fba0-4fff-916f-8912b5a1aae4 service nova] Acquiring lock "86923c1a-89a5-4e7a-b488-8bf3a013bf83-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:35:37 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-c906d881-31f6-4a7a-bf39-bbf6d696c3fe req-ba3b4e28-fba0-4fff-916f-8912b5a1aae4 service nova] Lock "86923c1a-89a5-4e7a-b488-8bf3a013bf83-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:35:37 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-c906d881-31f6-4a7a-bf39-bbf6d696c3fe req-ba3b4e28-fba0-4fff-916f-8912b5a1aae4 service nova] Lock "86923c1a-89a5-4e7a-b488-8bf3a013bf83-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:35:37 user nova-compute[73572]: DEBUG nova.compute.manager [req-c906d881-31f6-4a7a-bf39-bbf6d696c3fe req-ba3b4e28-fba0-4fff-916f-8912b5a1aae4 service nova] [instance: 86923c1a-89a5-4e7a-b488-8bf3a013bf83] No waiting events found dispatching network-vif-unplugged-db682944-8949-4bf9-b9d5-2213f0d507bc {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:35:37 user nova-compute[73572]: DEBUG nova.compute.manager [req-c906d881-31f6-4a7a-bf39-bbf6d696c3fe req-ba3b4e28-fba0-4fff-916f-8912b5a1aae4 service nova] [instance: 86923c1a-89a5-4e7a-b488-8bf3a013bf83] Received event network-vif-unplugged-db682944-8949-4bf9-b9d5-2213f0d507bc for instance with task_state deleting. {{(pid=73572) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 10:35:37 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:35:37 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:35:37 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:35:37 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:35:37 user nova-compute[73572]: INFO nova.virt.libvirt.driver [-] [instance: 86923c1a-89a5-4e7a-b488-8bf3a013bf83] Instance destroyed successfully.
Aug 26 10:35:37 user nova-compute[73572]: DEBUG nova.objects.instance [None req-c16ee3db-7724-457c-841e-8c172a1cff6f tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Lazy-loading 'resources' on Instance uuid 86923c1a-89a5-4e7a-b488-8bf3a013bf83 {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:35:37 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:35:37 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-c16ee3db-7724-457c-841e-8c172a1cff6f tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T10:19:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1567915986',display_name='tempest-ServerRescueNegativeTestJSON-server-1567915986',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1567915986',id=25,image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T10:21:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c1bff48d66894950ac6690e1fd0e79b9',ramdisk_id='',reservation_id='r-btw4ruhw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1710547876',owner_user_name='tempest-ServerRescueNegativeTestJSON-1710547876-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T10:21:07Z,user_data=None,user_id='099462c61dcc4816b17d2d0155823873',uuid=86923c1a-89a5-4e7a-b488-8bf3a013bf83,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "db682944-8949-4bf9-b9d5-2213f0d507bc", "address": "fa:16:3e:7d:b9:15", "network": {"id": "757e71b4-5177-45a5-8ef5-9b27f42092f1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1765327616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1bff48d66894950ac6690e1fd0e79b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb682944-89", "ovs_interfaceid": "db682944-8949-4bf9-b9d5-2213f0d507bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 10:35:37 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-c16ee3db-7724-457c-841e-8c172a1cff6f tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Converting VIF {"id": "db682944-8949-4bf9-b9d5-2213f0d507bc", "address": "fa:16:3e:7d:b9:15", "network": {"id": "757e71b4-5177-45a5-8ef5-9b27f42092f1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1765327616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1bff48d66894950ac6690e1fd0e79b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb682944-89", "ovs_interfaceid": "db682944-8949-4bf9-b9d5-2213f0d507bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:35:37 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-c16ee3db-7724-457c-841e-8c172a1cff6f tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7d:b9:15,bridge_name='br-int',has_traffic_filtering=True,id=db682944-8949-4bf9-b9d5-2213f0d507bc,network=Network(757e71b4-5177-45a5-8ef5-9b27f42092f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb682944-89') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:35:37 user nova-compute[73572]: DEBUG os_vif [None req-c16ee3db-7724-457c-841e-8c172a1cff6f tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7d:b9:15,bridge_name='br-int',has_traffic_filtering=True,id=db682944-8949-4bf9-b9d5-2213f0d507bc,network=Network(757e71b4-5177-45a5-8ef5-9b27f42092f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb682944-89') {{(pid=73572) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 10:35:37 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:35:37 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdb682944-89, bridge=br-int, if_exists=True) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:35:37 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:35:37 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:35:37 user nova-compute[73572]: INFO os_vif [None req-c16ee3db-7724-457c-841e-8c172a1cff6f tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7d:b9:15,bridge_name='br-int',has_traffic_filtering=True,id=db682944-8949-4bf9-b9d5-2213f0d507bc,network=Network(757e71b4-5177-45a5-8ef5-9b27f42092f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb682944-89')
Aug 26 10:35:37 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-c16ee3db-7724-457c-841e-8c172a1cff6f tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] [instance: 86923c1a-89a5-4e7a-b488-8bf3a013bf83] Deleting instance files /opt/stack/data/nova/instances/86923c1a-89a5-4e7a-b488-8bf3a013bf83_del
Aug 26 10:35:37 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-c16ee3db-7724-457c-841e-8c172a1cff6f tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] [instance: 86923c1a-89a5-4e7a-b488-8bf3a013bf83] Deletion of /opt/stack/data/nova/instances/86923c1a-89a5-4e7a-b488-8bf3a013bf83_del complete
Aug 26 10:35:37 user nova-compute[73572]: INFO nova.compute.manager [None req-c16ee3db-7724-457c-841e-8c172a1cff6f tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] [instance: 86923c1a-89a5-4e7a-b488-8bf3a013bf83] Took 0.95 seconds to destroy the instance on the hypervisor.
Aug 26 10:35:37 user nova-compute[73572]: DEBUG oslo.service.loopingcall [None req-c16ee3db-7724-457c-841e-8c172a1cff6f tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73572) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 10:35:37 user nova-compute[73572]: DEBUG nova.compute.manager [-] [instance: 86923c1a-89a5-4e7a-b488-8bf3a013bf83] Deallocating network for instance {{(pid=73572) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 10:35:37 user nova-compute[73572]: DEBUG nova.network.neutron [-] [instance: 86923c1a-89a5-4e7a-b488-8bf3a013bf83] deallocate_for_instance() {{(pid=73572) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 10:35:37 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73572) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 10:35:37 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Error from libvirt while getting description of instance-00000019: [Error Code 42] Domain not found: no domain with matching uuid '86923c1a-89a5-4e7a-b488-8bf3a013bf83' (instance-00000019): libvirt.libvirtError: Domain not found: no domain with matching uuid '86923c1a-89a5-4e7a-b488-8bf3a013bf83' (instance-00000019)
Aug 26 10:35:37 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68613b1e-c45c-4fd9-834c-3630ed0f456a/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:35:37 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:35:38 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68613b1e-c45c-4fd9-834c-3630ed0f456a/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:35:38 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68613b1e-c45c-4fd9-834c-3630ed0f456a/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:35:38 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:35:38 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68613b1e-c45c-4fd9-834c-3630ed0f456a/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:35:38 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2eaea7c2-a5c0-4950-b033-0012b5cec0ee/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:35:38 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2eaea7c2-a5c0-4950-b033-0012b5cec0ee/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:35:38 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2eaea7c2-a5c0-4950-b033-0012b5cec0ee/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:35:38 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2eaea7c2-a5c0-4950-b033-0012b5cec0ee/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:35:38 user nova-compute[73572]: DEBUG nova.network.neutron [-] [instance: 86923c1a-89a5-4e7a-b488-8bf3a013bf83] Updating instance_info_cache with network_info: [] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:35:38 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73572) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 10:35:38 user nova-compute[73572]: INFO nova.compute.manager [-] [instance: 86923c1a-89a5-4e7a-b488-8bf3a013bf83] Took 0.91 seconds to deallocate network for instance.
Aug 26 10:35:39 user nova-compute[73572]: DEBUG nova.compute.manager [req-0fa03cd9-c2c7-4f51-a5aa-b4b255174cd7 req-a241ea36-1615-4943-b4b3-cb9c48cb8319 service nova] [instance: 86923c1a-89a5-4e7a-b488-8bf3a013bf83] Received event network-vif-plugged-db682944-8949-4bf9-b9d5-2213f0d507bc {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:35:39 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-0fa03cd9-c2c7-4f51-a5aa-b4b255174cd7 req-a241ea36-1615-4943-b4b3-cb9c48cb8319 service nova] Acquiring lock "86923c1a-89a5-4e7a-b488-8bf3a013bf83-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:35:39 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-0fa03cd9-c2c7-4f51-a5aa-b4b255174cd7 req-a241ea36-1615-4943-b4b3-cb9c48cb8319 service nova] Lock "86923c1a-89a5-4e7a-b488-8bf3a013bf83-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:35:39 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-0fa03cd9-c2c7-4f51-a5aa-b4b255174cd7 req-a241ea36-1615-4943-b4b3-cb9c48cb8319 service nova] Lock "86923c1a-89a5-4e7a-b488-8bf3a013bf83-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:35:39 user nova-compute[73572]: DEBUG nova.compute.manager [req-0fa03cd9-c2c7-4f51-a5aa-b4b255174cd7 req-a241ea36-1615-4943-b4b3-cb9c48cb8319 service nova] [instance: 86923c1a-89a5-4e7a-b488-8bf3a013bf83] No waiting events found dispatching network-vif-plugged-db682944-8949-4bf9-b9d5-2213f0d507bc {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:35:39 user nova-compute[73572]: WARNING nova.compute.manager [req-0fa03cd9-c2c7-4f51-a5aa-b4b255174cd7 req-a241ea36-1615-4943-b4b3-cb9c48cb8319 service nova] [instance: 86923c1a-89a5-4e7a-b488-8bf3a013bf83] Received unexpected event network-vif-plugged-db682944-8949-4bf9-b9d5-2213f0d507bc for instance with vm_state deleted and task_state None.
Aug 26 10:35:39 user nova-compute[73572]: DEBUG nova.compute.manager [req-0fa03cd9-c2c7-4f51-a5aa-b4b255174cd7 req-a241ea36-1615-4943-b4b3-cb9c48cb8319 service nova] [instance: 86923c1a-89a5-4e7a-b488-8bf3a013bf83] Received event network-vif-plugged-db682944-8949-4bf9-b9d5-2213f0d507bc {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:35:39 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-0fa03cd9-c2c7-4f51-a5aa-b4b255174cd7 req-a241ea36-1615-4943-b4b3-cb9c48cb8319 service nova] Acquiring lock "86923c1a-89a5-4e7a-b488-8bf3a013bf83-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:35:39 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-0fa03cd9-c2c7-4f51-a5aa-b4b255174cd7 req-a241ea36-1615-4943-b4b3-cb9c48cb8319 service nova] Lock "86923c1a-89a5-4e7a-b488-8bf3a013bf83-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:35:39 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-0fa03cd9-c2c7-4f51-a5aa-b4b255174cd7 req-a241ea36-1615-4943-b4b3-cb9c48cb8319 service nova] Lock "86923c1a-89a5-4e7a-b488-8bf3a013bf83-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:35:39 user nova-compute[73572]: DEBUG nova.compute.manager [req-0fa03cd9-c2c7-4f51-a5aa-b4b255174cd7 req-a241ea36-1615-4943-b4b3-cb9c48cb8319 service nova] [instance: 86923c1a-89a5-4e7a-b488-8bf3a013bf83] No waiting events found dispatching network-vif-plugged-db682944-8949-4bf9-b9d5-2213f0d507bc {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:35:39 user nova-compute[73572]: WARNING nova.compute.manager [req-0fa03cd9-c2c7-4f51-a5aa-b4b255174cd7 req-a241ea36-1615-4943-b4b3-cb9c48cb8319 service nova] [instance: 86923c1a-89a5-4e7a-b488-8bf3a013bf83] Received unexpected event network-vif-plugged-db682944-8949-4bf9-b9d5-2213f0d507bc for instance with vm_state deleted and task_state None.
Aug 26 10:35:39 user nova-compute[73572]: DEBUG nova.compute.manager [req-0fa03cd9-c2c7-4f51-a5aa-b4b255174cd7 req-a241ea36-1615-4943-b4b3-cb9c48cb8319 service nova] [instance: 86923c1a-89a5-4e7a-b488-8bf3a013bf83] Received event network-vif-plugged-db682944-8949-4bf9-b9d5-2213f0d507bc {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:35:39 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-0fa03cd9-c2c7-4f51-a5aa-b4b255174cd7 req-a241ea36-1615-4943-b4b3-cb9c48cb8319 service nova] Acquiring lock "86923c1a-89a5-4e7a-b488-8bf3a013bf83-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:35:39 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-0fa03cd9-c2c7-4f51-a5aa-b4b255174cd7 req-a241ea36-1615-4943-b4b3-cb9c48cb8319 service nova] Lock "86923c1a-89a5-4e7a-b488-8bf3a013bf83-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:35:39 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-0fa03cd9-c2c7-4f51-a5aa-b4b255174cd7 req-a241ea36-1615-4943-b4b3-cb9c48cb8319 service nova] Lock "86923c1a-89a5-4e7a-b488-8bf3a013bf83-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:35:39 user nova-compute[73572]: DEBUG nova.compute.manager [req-0fa03cd9-c2c7-4f51-a5aa-b4b255174cd7 req-a241ea36-1615-4943-b4b3-cb9c48cb8319 service nova] [instance: 86923c1a-89a5-4e7a-b488-8bf3a013bf83] No waiting events found dispatching network-vif-plugged-db682944-8949-4bf9-b9d5-2213f0d507bc {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:35:39 user nova-compute[73572]: WARNING nova.compute.manager [req-0fa03cd9-c2c7-4f51-a5aa-b4b255174cd7 req-a241ea36-1615-4943-b4b3-cb9c48cb8319 service nova] [instance: 86923c1a-89a5-4e7a-b488-8bf3a013bf83] Received unexpected event network-vif-plugged-db682944-8949-4bf9-b9d5-2213f0d507bc for instance with vm_state deleted and task_state None.
Aug 26 10:35:39 user nova-compute[73572]: DEBUG nova.compute.manager [req-0fa03cd9-c2c7-4f51-a5aa-b4b255174cd7 req-a241ea36-1615-4943-b4b3-cb9c48cb8319 service nova] [instance: 86923c1a-89a5-4e7a-b488-8bf3a013bf83] Received event network-vif-plugged-db682944-8949-4bf9-b9d5-2213f0d507bc {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:35:39 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-0fa03cd9-c2c7-4f51-a5aa-b4b255174cd7 req-a241ea36-1615-4943-b4b3-cb9c48cb8319 service nova] Acquiring lock "86923c1a-89a5-4e7a-b488-8bf3a013bf83-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:35:39 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-0fa03cd9-c2c7-4f51-a5aa-b4b255174cd7 req-a241ea36-1615-4943-b4b3-cb9c48cb8319 service nova] Lock "86923c1a-89a5-4e7a-b488-8bf3a013bf83-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:35:39 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-0fa03cd9-c2c7-4f51-a5aa-b4b255174cd7 req-a241ea36-1615-4943-b4b3-cb9c48cb8319 service nova] Lock "86923c1a-89a5-4e7a-b488-8bf3a013bf83-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:35:39 user nova-compute[73572]: DEBUG nova.compute.manager [req-0fa03cd9-c2c7-4f51-a5aa-b4b255174cd7 req-a241ea36-1615-4943-b4b3-cb9c48cb8319 service nova] [instance: 86923c1a-89a5-4e7a-b488-8bf3a013bf83] No waiting events found dispatching network-vif-plugged-db682944-8949-4bf9-b9d5-2213f0d507bc {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:35:39 user nova-compute[73572]: WARNING nova.compute.manager [req-0fa03cd9-c2c7-4f51-a5aa-b4b255174cd7 req-a241ea36-1615-4943-b4b3-cb9c48cb8319 service nova] [instance: 86923c1a-89a5-4e7a-b488-8bf3a013bf83] Received unexpected event network-vif-plugged-db682944-8949-4bf9-b9d5-2213f0d507bc for instance with vm_state deleted and task_state None.
Aug 26 10:35:39 user nova-compute[73572]: DEBUG nova.compute.manager [req-0fa03cd9-c2c7-4f51-a5aa-b4b255174cd7 req-a241ea36-1615-4943-b4b3-cb9c48cb8319 service nova] [instance: 86923c1a-89a5-4e7a-b488-8bf3a013bf83] Received event network-vif-deleted-db682944-8949-4bf9-b9d5-2213f0d507bc {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:35:39 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-c16ee3db-7724-457c-841e-8c172a1cff6f tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:35:39 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-c16ee3db-7724-457c-841e-8c172a1cff6f tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:35:39 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:35:39 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:35:39 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Hypervisor/Node resource view: name=user free_ram=7980MB free_disk=25.166305541992188GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=73572) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 10:35:39 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:35:39 user nova-compute[73572]: DEBUG nova.compute.provider_tree [None req-c16ee3db-7724-457c-841e-8c172a1cff6f tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Inventory has not changed in ProviderTree for provider: e2cec974-59b2-4c77-a53d-a7f4e5a30d75 {{(pid=73572) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 10:35:39 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-c16ee3db-7724-457c-841e-8c172a1cff6f tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Inventory has not changed for provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73572) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 10:35:39 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-c16ee3db-7724-457c-841e-8c172a1cff6f tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.268s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:35:39 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.256s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:35:39 user nova-compute[73572]: INFO nova.scheduler.client.report [None req-c16ee3db-7724-457c-841e-8c172a1cff6f tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Deleted allocations for instance 86923c1a-89a5-4e7a-b488-8bf3a013bf83
Aug 26 10:35:39 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Applying migration context for instance c457a41c-2ee2-4821-94cf-69c091589241 as it has an incoming, in-progress migration 54257f22-04e0-4bf9-a6a6-cd5b7ab6ceea. Migration status is finished {{(pid=73572) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 26 10:35:39 user nova-compute[73572]: INFO nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] [instance: c457a41c-2ee2-4821-94cf-69c091589241] Updating resource usage from migration 54257f22-04e0-4bf9-a6a6-cd5b7ab6ceea
Aug 26 10:35:39 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-c16ee3db-7724-457c-841e-8c172a1cff6f tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Lock "86923c1a-89a5-4e7a-b488-8bf3a013bf83" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.826s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:35:39 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance 2eaea7c2-a5c0-4950-b033-0012b5cec0ee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:35:39 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance 68613b1e-c45c-4fd9-834c-3630ed0f456a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:35:39 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance 3a4c9522-9723-4ad4-8630-17a3aba70c98 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:35:39 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Migration 54257f22-04e0-4bf9-a6a6-cd5b7ab6ceea is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 26 10:35:39 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance c457a41c-2ee2-4821-94cf-69c091589241 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:35:39 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance 4039a8aa-b1a7-497d-b12c-6fcc12ab2b0a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:35:39 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=73572) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 10:35:39 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=73572) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 10:35:39 user nova-compute[73572]: DEBUG nova.compute.provider_tree [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Inventory has not changed in ProviderTree for provider: e2cec974-59b2-4c77-a53d-a7f4e5a30d75 {{(pid=73572) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 10:35:39 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Inventory has not changed for provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73572) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 10:35:39 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Compute_service record updated for user:user {{(pid=73572) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 10:35:39 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.378s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:35:40 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:35:40 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:35:40 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:35:41 user nova-compute[73572]: DEBUG nova.compute.manager [None req-eff87890-6c33-440c-afbe-07aae85672ac tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 4039a8aa-b1a7-497d-b12c-6fcc12ab2b0a] Start spawning the instance on the hypervisor. {{(pid=73572) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 10:35:41 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-eff87890-6c33-440c-afbe-07aae85672ac tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 4039a8aa-b1a7-497d-b12c-6fcc12ab2b0a] Creating instance directory {{(pid=73572) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 10:35:41 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-eff87890-6c33-440c-afbe-07aae85672ac tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 4039a8aa-b1a7-497d-b12c-6fcc12ab2b0a] Creating image(s)
Aug 26 10:35:41 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-eff87890-6c33-440c-afbe-07aae85672ac tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 4039a8aa-b1a7-497d-b12c-6fcc12ab2b0a] Did not create local disks {{(pid=73572) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 26 10:35:41 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-eff87890-6c33-440c-afbe-07aae85672ac tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 4039a8aa-b1a7-497d-b12c-6fcc12ab2b0a] Ensure instance console log exists: /opt/stack/data/nova/instances/4039a8aa-b1a7-497d-b12c-6fcc12ab2b0a/console.log {{(pid=73572) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 10:35:41 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-eff87890-6c33-440c-afbe-07aae85672ac tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:35:41 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-eff87890-6c33-440c-afbe-07aae85672ac tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:35:41 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-eff87890-6c33-440c-afbe-07aae85672ac tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:35:41 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-eff87890-6c33-440c-afbe-07aae85672ac tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 4039a8aa-b1a7-497d-b12c-6fcc12ab2b0a] Start _get_guest_xml network_info=[{"id": "316fd822-b966-44d8-8147-5025d918f270", "address": "fa:16:3e:0f:a1:92", "network": {"id": "c520ee18-34a7-4781-bc97-419e9a702d40", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-280196989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfc130586d9f4581953f1b8ae1c4465e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap316fd822-b9", "ovs_interfaceid": "316fd822-b966-44d8-8147-5025d918f270", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'disk_bus': 'virtio', 'boot_index': 0, 'mount_device': '/dev/vda', 'attachment_id': '002ccc08-f46b-4eb0-9843-571f7bb48e29', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:ad1b4b19-ad16-436c-9fa3-e718bea4f540'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RjYPMhzx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '4039a8aa-b1a7-497d-b12c-6fcc12ab2b0a', 'attached_at': '', 'detached_at': '', 'volume_id': 'ad1b4b19-ad16-436c-9fa3-e718bea4f540', 'serial': 'ad1b4b19-ad16-436c-9fa3-e718bea4f540'}, 'guest_format': None, 'device_type': 'disk', 'volume_type': None} {{(pid=73572) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 10:35:41 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-eff87890-6c33-440c-afbe-07aae85672ac tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:35:41 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-eff87890-6c33-440c-afbe-07aae85672ac tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:35:41 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-eff87890-6c33-440c-afbe-07aae85672ac tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73572) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 10:35:41 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-eff87890-6c33-440c-afbe-07aae85672ac tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] CPU controller missing on host. {{(pid=73572) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 10:35:41 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-eff87890-6c33-440c-afbe-07aae85672ac tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73572) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 10:35:41 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-eff87890-6c33-440c-afbe-07aae85672ac tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] CPU controller found on host. {{(pid=73572) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 10:35:41 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-eff87890-6c33-440c-afbe-07aae85672ac tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73572) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 10:35:41 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-eff87890-6c33-440c-afbe-07aae85672ac tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T10:07:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 10:35:41 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-eff87890-6c33-440c-afbe-07aae85672ac tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Flavor limits 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 10:35:41 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-eff87890-6c33-440c-afbe-07aae85672ac tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Image limits 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 10:35:41 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-eff87890-6c33-440c-afbe-07aae85672ac tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Flavor pref 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 10:35:41 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-eff87890-6c33-440c-afbe-07aae85672ac tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Image pref 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 10:35:41 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-eff87890-6c33-440c-afbe-07aae85672ac tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 10:35:41 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-eff87890-6c33-440c-afbe-07aae85672ac tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 10:35:41 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-eff87890-6c33-440c-afbe-07aae85672ac tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73572) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 10:35:41 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-eff87890-6c33-440c-afbe-07aae85672ac tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Got 1 possible topologies {{(pid=73572) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 10:35:41 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-eff87890-6c33-440c-afbe-07aae85672ac tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 10:35:41 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-eff87890-6c33-440c-afbe-07aae85672ac tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 10:35:41 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eff87890-6c33-440c-afbe-07aae85672ac tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 4039a8aa-b1a7-497d-b12c-6fcc12ab2b0a] Calling os-brick to attach iSCSI Volume {{(pid=73572) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 10:35:41 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-eff87890-6c33-440c-afbe-07aae85672ac tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc89c3d6a10>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:ad1b4b19-ad16-436c-9fa3-e718bea4f540'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RjYPMhzx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 10:35:41 user nova-compute[73572]: WARNING os_brick.initiator.connectors.base [None req-eff87890-6c33-440c-afbe-07aae85672ac tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 10:35:41 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-eff87890-6c33-440c-afbe-07aae85672ac tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 10:35:41 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-eff87890-6c33-440c-afbe-07aae85672ac tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 10:35:41 user nova-compute[73572]: WARNING os_brick.initiator.connectors.base [None req-eff87890-6c33-440c-afbe-07aae85672ac tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 10:35:41 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-eff87890-6c33-440c-afbe-07aae85672ac tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ad1b4b19-ad16-436c-9fa3-e718bea4f540" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 10:35:41 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-eff87890-6c33-440c-afbe-07aae85672ac tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ad1b4b19-ad16-436c-9fa3-e718bea4f540" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 10:35:41 user nova-compute[73572]: INFO os_brick.initiator.connectors.iscsi [None req-eff87890-6c33-440c-afbe-07aae85672ac tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 10:35:41 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad1b4b19-ad16-436c-9fa3-e718bea4f540 -p 172.16.0.220:3260 {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:35:42 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad1b4b19-ad16-436c-9fa3-e718bea4f540 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:35:42 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[7af4ceb7-799d-48ba-b9eb-569add702b23]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:35:42 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-eff87890-6c33-440c-afbe-07aae85672ac tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 10:35:42 user nova-compute[73572]:  {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:35:42 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad1b4b19-ad16-436c-9fa3-e718bea4f540 -p 172.16.0.220:3260 --interface default --op new {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:35:42 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad1b4b19-ad16-436c-9fa3-e718bea4f540 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:35:42 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f3e72d1-04c3-454b-8b6d-25228d937e37]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ad1b4b19-ad16-436c-9fa3-e718bea4f540] added\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:35:42 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-eff87890-6c33-440c-afbe-07aae85672ac tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ad1b4b19-ad16-436c-9fa3-e718bea4f540] added
Aug 26 10:35:42 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:35:42 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad1b4b19-ad16-436c-9fa3-e718bea4f540 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:35:42 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad1b4b19-ad16-436c-9fa3-e718bea4f540 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:35:42 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[27a55d2c-32ca-44f6-a241-c64e13055c97]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:35:42 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-eff87890-6c33-440c-afbe-07aae85672ac tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:35:42 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad1b4b19-ad16-436c-9fa3-e718bea4f540 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:35:42 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad1b4b19-ad16-436c-9fa3-e718bea4f540 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:35:42 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a1b296b-f55b-458f-9a6c-a7e761292c6e]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:35:42 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-eff87890-6c33-440c-afbe-07aae85672ac tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:35:42 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad1b4b19-ad16-436c-9fa3-e718bea4f540 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RjYPMhzx {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:35:42 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad1b4b19-ad16-436c-9fa3-e718bea4f540 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RjYPMhzx" returned: 0 in 0.023s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:35:42 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3cf9b3e-04c4-4569-99b7-1c70890245e3]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:35:42 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-eff87890-6c33-440c-afbe-07aae85672ac tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RjYPMhzx'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:35:42 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad1b4b19-ad16-436c-9fa3-e718bea4f540 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:35:42 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad1b4b19-ad16-436c-9fa3-e718bea4f540 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:35:42 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf8bc8f7-be8b-4a19-a2fc-3a387e215cd1]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:35:42 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-eff87890-6c33-440c-afbe-07aae85672ac tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:35:42 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:35:42 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:35:42 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[e394259b-033f-4e91-98e4-33e0a150358b]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec96ec24-bf73-4f38-ac9f-eb2699d0a661 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c17592e-3227-473f-ac7b-3e911dcb0d56 (non-flash)\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:35:42 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-eff87890-6c33-440c-afbe-07aae85672ac tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec96ec24-bf73-4f38-ac9f-eb2699d0a661 (non-flash)
Aug 26 10:35:42 user nova-compute[73572]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c17592e-3227-473f-ac7b-3e911dcb0d56 (non-flash)
Aug 26 10:35:42 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 10:35:42 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-eff87890-6c33-440c-afbe-07aae85672ac tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec96ec24-bf73-4f38-ac9f-eb2699d0a661 (non-flash)
Aug 26 10:35:42 user nova-compute[73572]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c17592e-3227-473f-ac7b-3e911dcb0d56 (non-flash)
Aug 26 10:35:42 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 10:35:42 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad1b4b19-ad16-436c-9fa3-e718bea4f540 -p 172.16.0.220:3260 --login {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:35:42 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad1b4b19-ad16-436c-9fa3-e718bea4f540 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:35:42 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eec2f73-02cd-4685-900d-cc8f970f4786]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ad1b4b19-ad16-436c-9fa3-e718bea4f540, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ad1b4b19-ad16-436c-9fa3-e718bea4f540, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:35:42 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-eff87890-6c33-440c-afbe-07aae85672ac tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ad1b4b19-ad16-436c-9fa3-e718bea4f540, portal: 172.16.0.220,3260]
Aug 26 10:35:42 user nova-compute[73572]: Login to [iface: default, target: iqn.2010-10.org.openstack:ad1b4b19-ad16-436c-9fa3-e718bea4f540, portal: 172.16.0.220,3260] successful.
Aug 26 10:35:42 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:35:42 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad1b4b19-ad16-436c-9fa3-e718bea4f540 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:35:42 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad1b4b19-ad16-436c-9fa3-e718bea4f540 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:35:42 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[db0ee664-fd63-4d59-887e-8ed8be0ae803]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:35:42 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-eff87890-6c33-440c-afbe-07aae85672ac tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:35:42 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:35:42 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:35:42 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e2e6b17-4c65-4407-a327-a0f614a0f2af]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec96ec24-bf73-4f38-ac9f-eb2699d0a661 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c17592e-3227-473f-ac7b-3e911dcb0d56 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad1b4b19-ad16-436c-9fa3-e718bea4f540 (non-flash)\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:35:42 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-eff87890-6c33-440c-afbe-07aae85672ac tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec96ec24-bf73-4f38-ac9f-eb2699d0a661 (non-flash)
Aug 26 10:35:42 user nova-compute[73572]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c17592e-3227-473f-ac7b-3e911dcb0d56 (non-flash)
Aug 26 10:35:42 user nova-compute[73572]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad1b4b19-ad16-436c-9fa3-e718bea4f540 (non-flash)
Aug 26 10:35:42 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 10:35:42 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-eff87890-6c33-440c-afbe-07aae85672ac tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec96ec24-bf73-4f38-ac9f-eb2699d0a661 (non-flash)
Aug 26 10:35:42 user nova-compute[73572]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c17592e-3227-473f-ac7b-3e911dcb0d56 (non-flash)
Aug 26 10:35:42 user nova-compute[73572]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad1b4b19-ad16-436c-9fa3-e718bea4f540 (non-flash)
Aug 26 10:35:42 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 10:35:42 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-eff87890-6c33-440c-afbe-07aae85672ac tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ad1b4b19-ad16-436c-9fa3-e718bea4f540" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.280s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 10:35:42 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-eff87890-6c33-440c-afbe-07aae85672ac tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Connected to 172.16.0.220:3260 {{(pid=73572) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 10:35:42 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-eff87890-6c33-440c-afbe-07aae85672ac tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] HCTL ('34', '-', '-', 0) found on session 53 with lun 0 {{(pid=73572) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 10:35:42 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-eff87890-6c33-440c-afbe-07aae85672ac tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73572) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 10:35:42 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:35:42 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:35:42 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[83d5d149-7971-4c23-b76e-84b5ef651a08]: (4, ('- - 0', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:35:42 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-eff87890-6c33-440c-afbe-07aae85672ac tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Searching for a device in session 53 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73572) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 10:35:42 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-eff87890-6c33-440c-afbe-07aae85672ac tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RjYPMhzx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73572) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 10:35:42 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:35:43 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-eff87890-6c33-440c-afbe-07aae85672ac tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.311s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 10:35:43 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-eff87890-6c33-440c-afbe-07aae85672ac tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] <== connect_volume: return (1313ms) {'type': 'block', 'scsi_wwn': '26462343434393732', 'path': '/dev/sdc'} {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 10:35:43 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eff87890-6c33-440c-afbe-07aae85672ac tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 4039a8aa-b1a7-497d-b12c-6fcc12ab2b0a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26462343434393732', 'path': '/dev/sdc'} {{(pid=73572) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 10:35:43 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-eff87890-6c33-440c-afbe-07aae85672ac tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T10:35:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1854182938',display_name='tempest-TestVolumeBootPattern-server-1854182938',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1854182938',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGgJMPcylFVXjDKqyW+etneKzTtQZ3h+rrNV9oGL9oH9Pq5o1BgNVxyCABCwPtuWnsI0hTQA59VGxuIY4NbTGf1rbJaGRZw/AtW9ND3j+IG9u2og6CdZ4G3lJYm/FnK6hA==',key_name='tempest-TestVolumeBootPattern-2036222457',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cfc130586d9f4581953f1b8ae1c4465e',ramdisk_id='',reservation_id='r-754anb10',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-73786062',owner_user_name='tempest-TestVolumeBootPattern-73786062-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T10:35:30Z,user_data=None,user_id='e1e80942e5db41c782bda686b10e2e4b',uuid=4039a8aa-b1a7-497d-b12c-6fcc12ab2b0a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "316fd822-b966-44d8-8147-5025d918f270", "address": "fa:16:3e:0f:a1:92", "network": {"id": "c520ee18-34a7-4781-bc97-419e9a702d40", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-280196989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfc130586d9f4581953f1b8ae1c4465e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap316fd822-b9", "ovs_interfaceid": "316fd822-b966-44d8-8147-5025d918f270", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73572) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 10:35:43 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-eff87890-6c33-440c-afbe-07aae85672ac tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Converting VIF {"id": "316fd822-b966-44d8-8147-5025d918f270", "address": "fa:16:3e:0f:a1:92", "network": {"id": "c520ee18-34a7-4781-bc97-419e9a702d40", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-280196989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfc130586d9f4581953f1b8ae1c4465e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap316fd822-b9", "ovs_interfaceid": "316fd822-b966-44d8-8147-5025d918f270", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:35:43 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-eff87890-6c33-440c-afbe-07aae85672ac tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:a1:92,bridge_name='br-int',has_traffic_filtering=True,id=316fd822-b966-44d8-8147-5025d918f270,network=Network(c520ee18-34a7-4781-bc97-419e9a702d40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap316fd822-b9') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:35:43 user nova-compute[73572]: DEBUG nova.objects.instance [None req-eff87890-6c33-440c-afbe-07aae85672ac tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Lazy-loading 'pci_devices' on Instance uuid 4039a8aa-b1a7-497d-b12c-6fcc12ab2b0a {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:35:43 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-eff87890-6c33-440c-afbe-07aae85672ac tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 4039a8aa-b1a7-497d-b12c-6fcc12ab2b0a] End _get_guest_xml xml=<domain type="kvm">
Aug 26 10:35:43 user nova-compute[73572]:   <uuid>4039a8aa-b1a7-497d-b12c-6fcc12ab2b0a</uuid>
Aug 26 10:35:43 user nova-compute[73572]:   <name>instance-0000002f</name>
Aug 26 10:35:43 user nova-compute[73572]:   <memory>524288</memory>
Aug 26 10:35:43 user nova-compute[73572]:   <vcpu>1</vcpu>
Aug 26 10:35:43 user nova-compute[73572]:   <metadata>
Aug 26 10:35:43 user nova-compute[73572]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 10:35:43 user nova-compute[73572]:       <nova:package version="0.0.0"/>
Aug 26 10:35:43 user nova-compute[73572]:       <nova:name>tempest-TestVolumeBootPattern-server-1854182938</nova:name>
Aug 26 10:35:43 user nova-compute[73572]:       <nova:creationTime>2023-08-26 10:35:41</nova:creationTime>
Aug 26 10:35:43 user nova-compute[73572]:       <nova:flavor name="m1.tiny">
Aug 26 10:35:43 user nova-compute[73572]:         <nova:memory>512</nova:memory>
Aug 26 10:35:43 user nova-compute[73572]:         <nova:disk>1</nova:disk>
Aug 26 10:35:43 user nova-compute[73572]:         <nova:swap>0</nova:swap>
Aug 26 10:35:43 user nova-compute[73572]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 10:35:43 user nova-compute[73572]:         <nova:vcpus>1</nova:vcpus>
Aug 26 10:35:43 user nova-compute[73572]:       </nova:flavor>
Aug 26 10:35:43 user nova-compute[73572]:       <nova:owner>
Aug 26 10:35:43 user nova-compute[73572]:         <nova:user uuid="e1e80942e5db41c782bda686b10e2e4b">tempest-TestVolumeBootPattern-73786062-project-member</nova:user>
Aug 26 10:35:43 user nova-compute[73572]:         <nova:project uuid="cfc130586d9f4581953f1b8ae1c4465e">tempest-TestVolumeBootPattern-73786062</nova:project>
Aug 26 10:35:43 user nova-compute[73572]:       </nova:owner>
Aug 26 10:35:43 user nova-compute[73572]:       <nova:ports>
Aug 26 10:35:43 user nova-compute[73572]:         <nova:port uuid="316fd822-b966-44d8-8147-5025d918f270">
Aug 26 10:35:43 user nova-compute[73572]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 26 10:35:43 user nova-compute[73572]:         </nova:port>
Aug 26 10:35:43 user nova-compute[73572]:       </nova:ports>
Aug 26 10:35:43 user nova-compute[73572]:     </nova:instance>
Aug 26 10:35:43 user nova-compute[73572]:   </metadata>
Aug 26 10:35:43 user nova-compute[73572]:   <sysinfo type="smbios">
Aug 26 10:35:43 user nova-compute[73572]:     <system>
Aug 26 10:35:43 user nova-compute[73572]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 10:35:43 user nova-compute[73572]:       <entry name="product">OpenStack Nova</entry>
Aug 26 10:35:43 user nova-compute[73572]:       <entry name="version">0.0.0</entry>
Aug 26 10:35:43 user nova-compute[73572]:       <entry name="serial">4039a8aa-b1a7-497d-b12c-6fcc12ab2b0a</entry>
Aug 26 10:35:43 user nova-compute[73572]:       <entry name="uuid">4039a8aa-b1a7-497d-b12c-6fcc12ab2b0a</entry>
Aug 26 10:35:43 user nova-compute[73572]:       <entry name="family">Virtual Machine</entry>
Aug 26 10:35:43 user nova-compute[73572]:     </system>
Aug 26 10:35:43 user nova-compute[73572]:   </sysinfo>
Aug 26 10:35:43 user nova-compute[73572]:   <os>
Aug 26 10:35:43 user nova-compute[73572]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 10:35:43 user nova-compute[73572]:     <boot dev="hd"/>
Aug 26 10:35:43 user nova-compute[73572]:     <smbios mode="sysinfo"/>
Aug 26 10:35:43 user nova-compute[73572]:   </os>
Aug 26 10:35:43 user nova-compute[73572]:   <features>
Aug 26 10:35:43 user nova-compute[73572]:     <acpi/>
Aug 26 10:35:43 user nova-compute[73572]:     <apic/>
Aug 26 10:35:43 user nova-compute[73572]:     <vmcoreinfo/>
Aug 26 10:35:43 user nova-compute[73572]:   </features>
Aug 26 10:35:43 user nova-compute[73572]:   <clock offset="utc">
Aug 26 10:35:43 user nova-compute[73572]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 10:35:43 user nova-compute[73572]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 10:35:43 user nova-compute[73572]:     <timer name="hpet" present="no"/>
Aug 26 10:35:43 user nova-compute[73572]:   </clock>
Aug 26 10:35:43 user nova-compute[73572]:   <cpu mode="custom" match="exact">
Aug 26 10:35:43 user nova-compute[73572]:     <model>Nehalem</model>
Aug 26 10:35:43 user nova-compute[73572]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 10:35:43 user nova-compute[73572]:   </cpu>
Aug 26 10:35:43 user nova-compute[73572]:   <devices>
Aug 26 10:35:43 user nova-compute[73572]:     <disk type="block" device="disk">
Aug 26 10:35:43 user nova-compute[73572]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 10:35:43 user nova-compute[73572]:       <source dev="/dev/sdc"/>
Aug 26 10:35:43 user nova-compute[73572]:       <target dev="vda" bus="virtio"/>
Aug 26 10:35:43 user nova-compute[73572]:       <serial>ad1b4b19-ad16-436c-9fa3-e718bea4f540</serial>
Aug 26 10:35:43 user nova-compute[73572]:     </disk>
Aug 26 10:35:43 user nova-compute[73572]:     <interface type="ethernet">
Aug 26 10:35:43 user nova-compute[73572]:       <mac address="fa:16:3e:0f:a1:92"/>
Aug 26 10:35:43 user nova-compute[73572]:       <model type="virtio"/>
Aug 26 10:35:43 user nova-compute[73572]:       <mtu size="1442"/>
Aug 26 10:35:43 user nova-compute[73572]:       <target dev="tap316fd822-b9"/>
Aug 26 10:35:43 user nova-compute[73572]:     </interface>
Aug 26 10:35:43 user nova-compute[73572]:     <serial type="pty">
Aug 26 10:35:43 user nova-compute[73572]:       <log file="/opt/stack/data/nova/instances/4039a8aa-b1a7-497d-b12c-6fcc12ab2b0a/console.log" append="off"/>
Aug 26 10:35:43 user nova-compute[73572]:     </serial>
Aug 26 10:35:43 user nova-compute[73572]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 10:35:43 user nova-compute[73572]:     <video>
Aug 26 10:35:43 user nova-compute[73572]:       <model type="virtio"/>
Aug 26 10:35:43 user nova-compute[73572]:     </video>
Aug 26 10:35:43 user nova-compute[73572]:     <rng model="virtio">
Aug 26 10:35:43 user nova-compute[73572]:       <backend model="random">/dev/urandom</backend>
Aug 26 10:35:43 user nova-compute[73572]:     </rng>
Aug 26 10:35:43 user nova-compute[73572]:     <controller type="usb" index="0" model="none"/>
Aug 26 10:35:43 user nova-compute[73572]:     <memballoon model="virtio">
Aug 26 10:35:43 user nova-compute[73572]:       <stats period="10"/>
Aug 26 10:35:43 user nova-compute[73572]:     </memballoon>
Aug 26 10:35:43 user nova-compute[73572]:   </devices>
Aug 26 10:35:43 user nova-compute[73572]: </domain>
Aug 26 10:35:43 user nova-compute[73572]:  {{(pid=73572) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 10:35:43 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-eff87890-6c33-440c-afbe-07aae85672ac tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T10:35:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1854182938',display_name='tempest-TestVolumeBootPattern-server-1854182938',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1854182938',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGgJMPcylFVXjDKqyW+etneKzTtQZ3h+rrNV9oGL9oH9Pq5o1BgNVxyCABCwPtuWnsI0hTQA59VGxuIY4NbTGf1rbJaGRZw/AtW9ND3j+IG9u2og6CdZ4G3lJYm/FnK6hA==',key_name='tempest-TestVolumeBootPattern-2036222457',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cfc130586d9f4581953f1b8ae1c4465e',ramdisk_id='',reservation_id='r-754anb10',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-73786062',owner_user_name='tempest-TestVolumeBootPattern-73786062-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T10:35:30Z,user_data=None,user_id='e1e80942e5db41c782bda686b10e2e4b',uuid=4039a8aa-b1a7-497d-b12c-6fcc12ab2b0a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "316fd822-b966-44d8-8147-5025d918f270", "address": "fa:16:3e:0f:a1:92", "network": {"id": "c520ee18-34a7-4781-bc97-419e9a702d40", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-280196989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfc130586d9f4581953f1b8ae1c4465e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap316fd822-b9", "ovs_interfaceid": "316fd822-b966-44d8-8147-5025d918f270", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 10:35:43 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-eff87890-6c33-440c-afbe-07aae85672ac tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Converting VIF {"id": "316fd822-b966-44d8-8147-5025d918f270", "address": "fa:16:3e:0f:a1:92", "network": {"id": "c520ee18-34a7-4781-bc97-419e9a702d40", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-280196989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfc130586d9f4581953f1b8ae1c4465e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap316fd822-b9", "ovs_interfaceid": "316fd822-b966-44d8-8147-5025d918f270", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:35:43 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-eff87890-6c33-440c-afbe-07aae85672ac tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:a1:92,bridge_name='br-int',has_traffic_filtering=True,id=316fd822-b966-44d8-8147-5025d918f270,network=Network(c520ee18-34a7-4781-bc97-419e9a702d40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap316fd822-b9') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:35:43 user nova-compute[73572]: DEBUG os_vif [None req-eff87890-6c33-440c-afbe-07aae85672ac tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:a1:92,bridge_name='br-int',has_traffic_filtering=True,id=316fd822-b966-44d8-8147-5025d918f270,network=Network(c520ee18-34a7-4781-bc97-419e9a702d40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap316fd822-b9') {{(pid=73572) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 10:35:43 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:35:43 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:35:43 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 10:35:43 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:35:43 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap316fd822-b9, may_exist=True, interface_attrs={}) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:35:43 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap316fd822-b9, col_values=(('external_ids', {'iface-id': '316fd822-b966-44d8-8147-5025d918f270', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0f:a1:92', 'vm-uuid': '4039a8aa-b1a7-497d-b12c-6fcc12ab2b0a'}),), if_exists=True) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:35:43 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:35:43 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:35:43 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:35:43 user nova-compute[73572]: INFO os_vif [None req-eff87890-6c33-440c-afbe-07aae85672ac tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:a1:92,bridge_name='br-int',has_traffic_filtering=True,id=316fd822-b966-44d8-8147-5025d918f270,network=Network(c520ee18-34a7-4781-bc97-419e9a702d40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap316fd822-b9')
Aug 26 10:35:43 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-eff87890-6c33-440c-afbe-07aae85672ac tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] No BDM found with device name vda, not building metadata. {{(pid=73572) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 10:35:43 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-eff87890-6c33-440c-afbe-07aae85672ac tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] No VIF found with MAC fa:16:3e:0f:a1:92, not building metadata {{(pid=73572) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 10:35:44 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:35:44 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:35:44 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:35:44 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:35:44 user nova-compute[73572]: DEBUG nova.compute.manager [req-de111405-4033-4448-ace5-f7b8919f410b req-3c7e3abd-af74-4cec-8782-a4dc9f208ae8 service nova] [instance: 4039a8aa-b1a7-497d-b12c-6fcc12ab2b0a] Received event network-vif-plugged-316fd822-b966-44d8-8147-5025d918f270 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:35:44 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-de111405-4033-4448-ace5-f7b8919f410b req-3c7e3abd-af74-4cec-8782-a4dc9f208ae8 service nova] Acquiring lock "4039a8aa-b1a7-497d-b12c-6fcc12ab2b0a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:35:44 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-de111405-4033-4448-ace5-f7b8919f410b req-3c7e3abd-af74-4cec-8782-a4dc9f208ae8 service nova] Lock "4039a8aa-b1a7-497d-b12c-6fcc12ab2b0a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:35:44 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-de111405-4033-4448-ace5-f7b8919f410b req-3c7e3abd-af74-4cec-8782-a4dc9f208ae8 service nova] Lock "4039a8aa-b1a7-497d-b12c-6fcc12ab2b0a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:35:44 user nova-compute[73572]: DEBUG nova.compute.manager [req-de111405-4033-4448-ace5-f7b8919f410b req-3c7e3abd-af74-4cec-8782-a4dc9f208ae8 service nova] [instance: 4039a8aa-b1a7-497d-b12c-6fcc12ab2b0a] No waiting events found dispatching network-vif-plugged-316fd822-b966-44d8-8147-5025d918f270 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:35:44 user nova-compute[73572]: WARNING nova.compute.manager [req-de111405-4033-4448-ace5-f7b8919f410b req-3c7e3abd-af74-4cec-8782-a4dc9f208ae8 service nova] [instance: 4039a8aa-b1a7-497d-b12c-6fcc12ab2b0a] Received unexpected event network-vif-plugged-316fd822-b966-44d8-8147-5025d918f270 for instance with vm_state building and task_state spawning.
Aug 26 10:35:45 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:35:45 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:35:45 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:35:45 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:35:45 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:35:46 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:35:46 user nova-compute[73572]: DEBUG nova.virt.driver [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Emitting event <LifecycleEvent: 1693046146.8530893, 4039a8aa-b1a7-497d-b12c-6fcc12ab2b0a => Resumed> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:35:46 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 4039a8aa-b1a7-497d-b12c-6fcc12ab2b0a] VM Resumed (Lifecycle Event)
Aug 26 10:35:46 user nova-compute[73572]: DEBUG nova.compute.manager [None req-eff87890-6c33-440c-afbe-07aae85672ac tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 4039a8aa-b1a7-497d-b12c-6fcc12ab2b0a] Instance event wait completed in 0 seconds for  {{(pid=73572) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 10:35:46 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-eff87890-6c33-440c-afbe-07aae85672ac tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 4039a8aa-b1a7-497d-b12c-6fcc12ab2b0a] Guest created on hypervisor {{(pid=73572) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 10:35:46 user nova-compute[73572]: INFO nova.virt.libvirt.driver [-] [instance: 4039a8aa-b1a7-497d-b12c-6fcc12ab2b0a] Instance spawned successfully.
Aug 26 10:35:46 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-eff87890-6c33-440c-afbe-07aae85672ac tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 4039a8aa-b1a7-497d-b12c-6fcc12ab2b0a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 10:35:46 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 4039a8aa-b1a7-497d-b12c-6fcc12ab2b0a] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:35:46 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 4039a8aa-b1a7-497d-b12c-6fcc12ab2b0a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73572) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 10:35:46 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-eff87890-6c33-440c-afbe-07aae85672ac tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 4039a8aa-b1a7-497d-b12c-6fcc12ab2b0a] Found default for hw_cdrom_bus of ide {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:35:46 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-eff87890-6c33-440c-afbe-07aae85672ac tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 4039a8aa-b1a7-497d-b12c-6fcc12ab2b0a] Found default for hw_disk_bus of virtio {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:35:46 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-eff87890-6c33-440c-afbe-07aae85672ac tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 4039a8aa-b1a7-497d-b12c-6fcc12ab2b0a] Found default for hw_input_bus of None {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:35:46 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-eff87890-6c33-440c-afbe-07aae85672ac tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 4039a8aa-b1a7-497d-b12c-6fcc12ab2b0a] Found default for hw_pointer_model of None {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:35:46 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-eff87890-6c33-440c-afbe-07aae85672ac tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 4039a8aa-b1a7-497d-b12c-6fcc12ab2b0a] Found default for hw_video_model of virtio {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:35:46 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-eff87890-6c33-440c-afbe-07aae85672ac tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 4039a8aa-b1a7-497d-b12c-6fcc12ab2b0a] Found default for hw_vif_model of virtio {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:35:46 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 4039a8aa-b1a7-497d-b12c-6fcc12ab2b0a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 10:35:46 user nova-compute[73572]: DEBUG nova.virt.driver [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Emitting event <LifecycleEvent: 1693046146.8567123, 4039a8aa-b1a7-497d-b12c-6fcc12ab2b0a => Started> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:35:46 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 4039a8aa-b1a7-497d-b12c-6fcc12ab2b0a] VM Started (Lifecycle Event)
Aug 26 10:35:46 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 4039a8aa-b1a7-497d-b12c-6fcc12ab2b0a] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:35:46 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 4039a8aa-b1a7-497d-b12c-6fcc12ab2b0a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73572) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 10:35:46 user nova-compute[73572]: DEBUG nova.compute.manager [req-08a5b63f-f1a9-447b-9ffb-5c69971eaf65 req-2d0bd28a-e36c-4070-af86-48e3bdc22f07 service nova] [instance: 4039a8aa-b1a7-497d-b12c-6fcc12ab2b0a] Received event network-vif-plugged-316fd822-b966-44d8-8147-5025d918f270 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:35:46 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-08a5b63f-f1a9-447b-9ffb-5c69971eaf65 req-2d0bd28a-e36c-4070-af86-48e3bdc22f07 service nova] Acquiring lock "4039a8aa-b1a7-497d-b12c-6fcc12ab2b0a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:35:46 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-08a5b63f-f1a9-447b-9ffb-5c69971eaf65 req-2d0bd28a-e36c-4070-af86-48e3bdc22f07 service nova] Lock "4039a8aa-b1a7-497d-b12c-6fcc12ab2b0a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:35:46 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-08a5b63f-f1a9-447b-9ffb-5c69971eaf65 req-2d0bd28a-e36c-4070-af86-48e3bdc22f07 service nova] Lock "4039a8aa-b1a7-497d-b12c-6fcc12ab2b0a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:35:46 user nova-compute[73572]: DEBUG nova.compute.manager [req-08a5b63f-f1a9-447b-9ffb-5c69971eaf65 req-2d0bd28a-e36c-4070-af86-48e3bdc22f07 service nova] [instance: 4039a8aa-b1a7-497d-b12c-6fcc12ab2b0a] No waiting events found dispatching network-vif-plugged-316fd822-b966-44d8-8147-5025d918f270 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:35:46 user nova-compute[73572]: WARNING nova.compute.manager [req-08a5b63f-f1a9-447b-9ffb-5c69971eaf65 req-2d0bd28a-e36c-4070-af86-48e3bdc22f07 service nova] [instance: 4039a8aa-b1a7-497d-b12c-6fcc12ab2b0a] Received unexpected event network-vif-plugged-316fd822-b966-44d8-8147-5025d918f270 for instance with vm_state building and task_state spawning.
Aug 26 10:35:46 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 4039a8aa-b1a7-497d-b12c-6fcc12ab2b0a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 10:35:46 user nova-compute[73572]: INFO nova.compute.manager [None req-eff87890-6c33-440c-afbe-07aae85672ac tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 4039a8aa-b1a7-497d-b12c-6fcc12ab2b0a] Took 5.10 seconds to spawn the instance on the hypervisor.
Aug 26 10:35:46 user nova-compute[73572]: DEBUG nova.compute.manager [None req-eff87890-6c33-440c-afbe-07aae85672ac tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 4039a8aa-b1a7-497d-b12c-6fcc12ab2b0a] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:35:47 user nova-compute[73572]: INFO nova.compute.manager [None req-eff87890-6c33-440c-afbe-07aae85672ac tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 4039a8aa-b1a7-497d-b12c-6fcc12ab2b0a] Took 17.87 seconds to build instance.
Aug 26 10:35:47 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-eff87890-6c33-440c-afbe-07aae85672ac tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Lock "4039a8aa-b1a7-497d-b12c-6fcc12ab2b0a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.981s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:35:47 user nova-compute[73572]: DEBUG nova.compute.manager [req-8972bd44-c412-44b4-b39b-49e33ba9f707 req-58504f7a-57c6-457e-a192-d280450b7d07 service nova] [instance: 3a4c9522-9723-4ad4-8630-17a3aba70c98] Received event network-changed-663db499-c552-478e-bad7-938b2f65c619 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:35:47 user nova-compute[73572]: DEBUG nova.compute.manager [req-8972bd44-c412-44b4-b39b-49e33ba9f707 req-58504f7a-57c6-457e-a192-d280450b7d07 service nova] [instance: 3a4c9522-9723-4ad4-8630-17a3aba70c98] Refreshing instance network info cache due to event network-changed-663db499-c552-478e-bad7-938b2f65c619. {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 10:35:47 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-8972bd44-c412-44b4-b39b-49e33ba9f707 req-58504f7a-57c6-457e-a192-d280450b7d07 service nova] Acquiring lock "refresh_cache-3a4c9522-9723-4ad4-8630-17a3aba70c98" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:35:47 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-8972bd44-c412-44b4-b39b-49e33ba9f707 req-58504f7a-57c6-457e-a192-d280450b7d07 service nova] Acquired lock "refresh_cache-3a4c9522-9723-4ad4-8630-17a3aba70c98" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:35:47 user nova-compute[73572]: DEBUG nova.network.neutron [req-8972bd44-c412-44b4-b39b-49e33ba9f707 req-58504f7a-57c6-457e-a192-d280450b7d07 service nova] [instance: 3a4c9522-9723-4ad4-8630-17a3aba70c98] Refreshing network info cache for port 663db499-c552-478e-bad7-938b2f65c619 {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 10:35:47 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-c1a64256-5ad0-42df-8210-acd1e14d3c4d tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] Acquiring lock "3a4c9522-9723-4ad4-8630-17a3aba70c98" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:35:47 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-c1a64256-5ad0-42df-8210-acd1e14d3c4d tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] Lock "3a4c9522-9723-4ad4-8630-17a3aba70c98" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:35:47 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-c1a64256-5ad0-42df-8210-acd1e14d3c4d tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] Acquiring lock "3a4c9522-9723-4ad4-8630-17a3aba70c98-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:35:47 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-c1a64256-5ad0-42df-8210-acd1e14d3c4d tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] Lock "3a4c9522-9723-4ad4-8630-17a3aba70c98-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:35:47 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-c1a64256-5ad0-42df-8210-acd1e14d3c4d tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] Lock "3a4c9522-9723-4ad4-8630-17a3aba70c98-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:35:47 user nova-compute[73572]: INFO nova.compute.manager [None req-c1a64256-5ad0-42df-8210-acd1e14d3c4d tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] [instance: 3a4c9522-9723-4ad4-8630-17a3aba70c98] Terminating instance
Aug 26 10:35:47 user nova-compute[73572]: DEBUG nova.compute.manager [None req-c1a64256-5ad0-42df-8210-acd1e14d3c4d tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] [instance: 3a4c9522-9723-4ad4-8630-17a3aba70c98] Start destroying the instance on the hypervisor. {{(pid=73572) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 10:35:47 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:35:47 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:35:47 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:35:48 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:35:48 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:35:48 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:35:48 user nova-compute[73572]: DEBUG nova.network.neutron [req-8972bd44-c412-44b4-b39b-49e33ba9f707 req-58504f7a-57c6-457e-a192-d280450b7d07 service nova] [instance: 3a4c9522-9723-4ad4-8630-17a3aba70c98] Updated VIF entry in instance network info cache for port 663db499-c552-478e-bad7-938b2f65c619. {{(pid=73572) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 10:35:48 user nova-compute[73572]: DEBUG nova.network.neutron [req-8972bd44-c412-44b4-b39b-49e33ba9f707 req-58504f7a-57c6-457e-a192-d280450b7d07 service nova] [instance: 3a4c9522-9723-4ad4-8630-17a3aba70c98] Updating instance_info_cache with network_info: [{"id": "663db499-c552-478e-bad7-938b2f65c619", "address": "fa:16:3e:fd:54:35", "network": {"id": "6bec7255-9e3a-43e3-aaf3-913e171ee99d", "bridge": "br-int", "label": "tempest-TestShelveInstance-1279582697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51eaa92831e54ba6bd3d71db1a4e24e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap663db499-c5", "ovs_interfaceid": "663db499-c552-478e-bad7-938b2f65c619", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:35:48 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-8972bd44-c412-44b4-b39b-49e33ba9f707 req-58504f7a-57c6-457e-a192-d280450b7d07 service nova] Releasing lock "refresh_cache-3a4c9522-9723-4ad4-8630-17a3aba70c98" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:35:48 user nova-compute[73572]: INFO nova.virt.libvirt.driver [-] [instance: 3a4c9522-9723-4ad4-8630-17a3aba70c98] Instance destroyed successfully.
Aug 26 10:35:48 user nova-compute[73572]: DEBUG nova.objects.instance [None req-c1a64256-5ad0-42df-8210-acd1e14d3c4d tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] Lazy-loading 'resources' on Instance uuid 3a4c9522-9723-4ad4-8630-17a3aba70c98 {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:35:48 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-c1a64256-5ad0-42df-8210-acd1e14d3c4d tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-26T10:30:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-2038663999',display_name='tempest-TestShelveInstance-server-2038663999',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-2038663999',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJMZDyaM/+VCFQG3701Z0FaBkgWoaji0UPFWpQswT1wZzAYHJZTlb5cmnzgNgUoUdDBH0mAV39s4kCVhnK3UsUjQb2bImpxYDfN7ddzW4ZDHjoplOmZ53CGkaz6SnTlrhg==',key_name='tempest-TestShelveInstance-188411046',keypairs=<?>,launch_index=0,launched_at=2023-08-26T10:34:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='51eaa92831e54ba6bd3d71db1a4e24e0',ramdisk_id='',reservation_id='r-yp88ce4a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-912363172',owner_user_name='tempest-TestShelveInstance-912363172-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T10:34:15Z,user_data=None,user_id='6d0074f39a8141119bd94ffa83bd80aa',uuid=3a4c9522-9723-4ad4-8630-17a3aba70c98,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "663db499-c552-478e-bad7-938b2f65c619", "address": "fa:16:3e:fd:54:35", "network": {"id": "6bec7255-9e3a-43e3-aaf3-913e171ee99d", "bridge": "br-int", "label": "tempest-TestShelveInstance-1279582697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51eaa92831e54ba6bd3d71db1a4e24e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap663db499-c5", "ovs_interfaceid": "663db499-c552-478e-bad7-938b2f65c619", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 10:35:48 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-c1a64256-5ad0-42df-8210-acd1e14d3c4d tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] Converting VIF {"id": "663db499-c552-478e-bad7-938b2f65c619", "address": "fa:16:3e:fd:54:35", "network": {"id": "6bec7255-9e3a-43e3-aaf3-913e171ee99d", "bridge": "br-int", "label": "tempest-TestShelveInstance-1279582697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51eaa92831e54ba6bd3d71db1a4e24e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap663db499-c5", "ovs_interfaceid": "663db499-c552-478e-bad7-938b2f65c619", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:35:48 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-c1a64256-5ad0-42df-8210-acd1e14d3c4d tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:54:35,bridge_name='br-int',has_traffic_filtering=True,id=663db499-c552-478e-bad7-938b2f65c619,network=Network(6bec7255-9e3a-43e3-aaf3-913e171ee99d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap663db499-c5') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:35:48 user nova-compute[73572]: DEBUG os_vif [None req-c1a64256-5ad0-42df-8210-acd1e14d3c4d tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:54:35,bridge_name='br-int',has_traffic_filtering=True,id=663db499-c552-478e-bad7-938b2f65c619,network=Network(6bec7255-9e3a-43e3-aaf3-913e171ee99d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap663db499-c5') {{(pid=73572) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 10:35:48 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:35:48 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap663db499-c5, bridge=br-int, if_exists=True) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:35:48 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:35:48 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:35:48 user nova-compute[73572]: INFO os_vif [None req-c1a64256-5ad0-42df-8210-acd1e14d3c4d tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:54:35,bridge_name='br-int',has_traffic_filtering=True,id=663db499-c552-478e-bad7-938b2f65c619,network=Network(6bec7255-9e3a-43e3-aaf3-913e171ee99d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap663db499-c5')
Aug 26 10:35:48 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c1a64256-5ad0-42df-8210-acd1e14d3c4d tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] [instance: 3a4c9522-9723-4ad4-8630-17a3aba70c98] calling os-brick to detach iSCSI Volume {{(pid=73572) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 10:35:48 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1a64256-5ad0-42df-8210-acd1e14d3c4d tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc89c3d6a10>, {'target_iqns': ['iqn.2010-10.org.openstack:ec96ec24-bf73-4f38-ac9f-eb2699d0a661'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tqbEgzCT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 10:35:48 user nova-compute[73572]: WARNING os_brick.initiator.connectors.base [None req-c1a64256-5ad0-42df-8210-acd1e14d3c4d tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 10:35:48 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-c1a64256-5ad0-42df-8210-acd1e14d3c4d tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 10:35:48 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-c1a64256-5ad0-42df-8210-acd1e14d3c4d tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 10:35:48 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1a64256-5ad0-42df-8210-acd1e14d3c4d tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ec96ec24-bf73-4f38-ac9f-eb2699d0a661', 0)] {{(pid=73572) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 10:35:48 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:35:48 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:35:48 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[d38ce3a6-a450-43b7-a0ea-3a114419bbd9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6c17592e-3227-473f-ac7b-3e911dcb0d56\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ad1b4b19-ad16-436c-9fa3-e718bea4f540\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ec96ec24-bf73-4f38-ac9f-eb2699d0a661\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:35:48 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:35:48 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:35:48 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b2d7316-f34c-4cfb-ad8d-08a746e31375]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec96ec24-bf73-4f38-ac9f-eb2699d0a661 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c17592e-3227-473f-ac7b-3e911dcb0d56 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad1b4b19-ad16-436c-9fa3-e718bea4f540 (non-flash)\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:35:48 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1a64256-5ad0-42df-8210-acd1e14d3c4d tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec96ec24-bf73-4f38-ac9f-eb2699d0a661 (non-flash)
Aug 26 10:35:48 user nova-compute[73572]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c17592e-3227-473f-ac7b-3e911dcb0d56 (non-flash)
Aug 26 10:35:48 user nova-compute[73572]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad1b4b19-ad16-436c-9fa3-e718bea4f540 (non-flash)
Aug 26 10:35:48 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 10:35:48 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1a64256-5ad0-42df-8210-acd1e14d3c4d tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec96ec24-bf73-4f38-ac9f-eb2699d0a661 (non-flash)
Aug 26 10:35:48 user nova-compute[73572]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c17592e-3227-473f-ac7b-3e911dcb0d56 (non-flash)
Aug 26 10:35:48 user nova-compute[73572]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad1b4b19-ad16-436c-9fa3-e718bea4f540 (non-flash)
Aug 26 10:35:48 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 10:35:48 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1a64256-5ad0-42df-8210-acd1e14d3c4d tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc89c56b9a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ec96ec24-bf73-4f38-ac9f-eb2699d0a661'): ({'sdd'}, set())}) {{(pid=73572) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 10:35:48 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-c1a64256-5ad0-42df-8210-acd1e14d3c4d tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] Removing single pathed devices sdd {{(pid=73572) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 10:35:48 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:35:48 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:35:48 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa5bb667-7067-40b3-8d3d-0da2037a1029]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:35:48 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:35:48 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:35:48 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[2594f9a2-5b43-486f-8a16-176432bc6b64]: (4, ('ok\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:35:48 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-c1a64256-5ad0-42df-8210-acd1e14d3c4d tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] Flushing IO for device /dev/sdd {{(pid=73572) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 10:35:48 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:35:48 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:35:48 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[3026cc80-30c9-40fd-b27e-1930084a0264]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:35:48 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-c1a64256-5ad0-42df-8210-acd1e14d3c4d tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73572) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 10:35:48 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:35:48 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.054s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:35:48 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[97e6833f-0d43-4322-acfa-fe824ace54b8]: (4, ('1', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:35:48 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-c1a64256-5ad0-42df-8210-acd1e14d3c4d tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73572) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 10:35:48 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-c1a64256-5ad0-42df-8210-acd1e14d3c4d tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] SCSI volumes sdd have been removed. {{(pid=73572) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 10:35:48 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1a64256-5ad0-42df-8210-acd1e14d3c4d tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ec96ec24-bf73-4f38-ac9f-eb2699d0a661')] {{(pid=73572) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 10:35:48 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec96ec24-bf73-4f38-ac9f-eb2699d0a661 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:35:48 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec96ec24-bf73-4f38-ac9f-eb2699d0a661 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:35:48 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[8994a7c6-6197-4724-a1ad-1707ce976a9f]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:35:48 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1a64256-5ad0-42df-8210-acd1e14d3c4d tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:35:48 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec96ec24-bf73-4f38-ac9f-eb2699d0a661 -p 172.16.0.220:3260 --logout {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:35:49 user nova-compute[73572]: DEBUG nova.compute.manager [req-da42bcb2-5b96-4d59-9e61-9c540f91983d req-f47b286c-0af1-472d-b186-3bcc1aa85943 service nova] [instance: 3a4c9522-9723-4ad4-8630-17a3aba70c98] Received event network-vif-unplugged-663db499-c552-478e-bad7-938b2f65c619 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:35:49 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-da42bcb2-5b96-4d59-9e61-9c540f91983d req-f47b286c-0af1-472d-b186-3bcc1aa85943 service nova] Acquiring lock "3a4c9522-9723-4ad4-8630-17a3aba70c98-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:35:49 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-da42bcb2-5b96-4d59-9e61-9c540f91983d req-f47b286c-0af1-472d-b186-3bcc1aa85943 service nova] Lock "3a4c9522-9723-4ad4-8630-17a3aba70c98-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:35:49 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-da42bcb2-5b96-4d59-9e61-9c540f91983d req-f47b286c-0af1-472d-b186-3bcc1aa85943 service nova] Lock "3a4c9522-9723-4ad4-8630-17a3aba70c98-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:35:49 user nova-compute[73572]: DEBUG nova.compute.manager [req-da42bcb2-5b96-4d59-9e61-9c540f91983d req-f47b286c-0af1-472d-b186-3bcc1aa85943 service nova] [instance: 3a4c9522-9723-4ad4-8630-17a3aba70c98] No waiting events found dispatching network-vif-unplugged-663db499-c552-478e-bad7-938b2f65c619 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:35:49 user nova-compute[73572]: DEBUG nova.compute.manager [req-da42bcb2-5b96-4d59-9e61-9c540f91983d req-f47b286c-0af1-472d-b186-3bcc1aa85943 service nova] [instance: 3a4c9522-9723-4ad4-8630-17a3aba70c98] Received event network-vif-unplugged-663db499-c552-478e-bad7-938b2f65c619 for instance with task_state deleting. {{(pid=73572) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 10:35:49 user nova-compute[73572]: DEBUG nova.compute.manager [req-da42bcb2-5b96-4d59-9e61-9c540f91983d req-f47b286c-0af1-472d-b186-3bcc1aa85943 service nova] [instance: 3a4c9522-9723-4ad4-8630-17a3aba70c98] Received event network-vif-plugged-663db499-c552-478e-bad7-938b2f65c619 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:35:49 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-da42bcb2-5b96-4d59-9e61-9c540f91983d req-f47b286c-0af1-472d-b186-3bcc1aa85943 service nova] Acquiring lock "3a4c9522-9723-4ad4-8630-17a3aba70c98-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:35:49 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-da42bcb2-5b96-4d59-9e61-9c540f91983d req-f47b286c-0af1-472d-b186-3bcc1aa85943 service nova] Lock "3a4c9522-9723-4ad4-8630-17a3aba70c98-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:35:49 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-da42bcb2-5b96-4d59-9e61-9c540f91983d req-f47b286c-0af1-472d-b186-3bcc1aa85943 service nova] Lock "3a4c9522-9723-4ad4-8630-17a3aba70c98-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:35:49 user nova-compute[73572]: DEBUG nova.compute.manager [req-da42bcb2-5b96-4d59-9e61-9c540f91983d req-f47b286c-0af1-472d-b186-3bcc1aa85943 service nova] [instance: 3a4c9522-9723-4ad4-8630-17a3aba70c98] No waiting events found dispatching network-vif-plugged-663db499-c552-478e-bad7-938b2f65c619 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:35:49 user nova-compute[73572]: WARNING nova.compute.manager [req-da42bcb2-5b96-4d59-9e61-9c540f91983d req-f47b286c-0af1-472d-b186-3bcc1aa85943 service nova] [instance: 3a4c9522-9723-4ad4-8630-17a3aba70c98] Received unexpected event network-vif-plugged-663db499-c552-478e-bad7-938b2f65c619 for instance with vm_state active and task_state deleting.
Aug 26 10:35:49 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec96ec24-bf73-4f38-ac9f-eb2699d0a661 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:35:49 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c73b5d0-fff4-4f6d-aedd-bfd44165d5d7]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:ec96ec24-bf73-4f38-ac9f-eb2699d0a661, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:ec96ec24-bf73-4f38-ac9f-eb2699d0a661, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:35:49 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1a64256-5ad0-42df-8210-acd1e14d3c4d tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:ec96ec24-bf73-4f38-ac9f-eb2699d0a661, portal: 172.16.0.220,3260]
Aug 26 10:35:49 user nova-compute[73572]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:ec96ec24-bf73-4f38-ac9f-eb2699d0a661, portal: 172.16.0.220,3260] successful.
Aug 26 10:35:49 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:35:49 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec96ec24-bf73-4f38-ac9f-eb2699d0a661 -p 172.16.0.220:3260 --op delete {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:35:49 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec96ec24-bf73-4f38-ac9f-eb2699d0a661 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:35:49 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3bd820d-e2ce-4f86-8d0a-923f01ddd916]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:35:49 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1a64256-5ad0-42df-8210-acd1e14d3c4d tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:35:49 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-c1a64256-5ad0-42df-8210-acd1e14d3c4d tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.338s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 10:35:49 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1a64256-5ad0-42df-8210-acd1e14d3c4d tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] <== disconnect_volume: return (339ms) None {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 10:35:49 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c1a64256-5ad0-42df-8210-acd1e14d3c4d tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] [instance: 3a4c9522-9723-4ad4-8630-17a3aba70c98] Disconnected iSCSI Volume {{(pid=73572) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 10:35:49 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-c1a64256-5ad0-42df-8210-acd1e14d3c4d tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] [instance: 3a4c9522-9723-4ad4-8630-17a3aba70c98] Deleting instance files /opt/stack/data/nova/instances/3a4c9522-9723-4ad4-8630-17a3aba70c98_del
Aug 26 10:35:49 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-c1a64256-5ad0-42df-8210-acd1e14d3c4d tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] [instance: 3a4c9522-9723-4ad4-8630-17a3aba70c98] Deletion of /opt/stack/data/nova/instances/3a4c9522-9723-4ad4-8630-17a3aba70c98_del complete
Aug 26 10:35:49 user nova-compute[73572]: INFO nova.compute.manager [None req-c1a64256-5ad0-42df-8210-acd1e14d3c4d tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] [instance: 3a4c9522-9723-4ad4-8630-17a3aba70c98] Took 1.31 seconds to destroy the instance on the hypervisor.
Aug 26 10:35:49 user nova-compute[73572]: DEBUG oslo.service.loopingcall [None req-c1a64256-5ad0-42df-8210-acd1e14d3c4d tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73572) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 10:35:49 user nova-compute[73572]: DEBUG nova.compute.manager [-] [instance: 3a4c9522-9723-4ad4-8630-17a3aba70c98] Deallocating network for instance {{(pid=73572) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 10:35:49 user nova-compute[73572]: DEBUG nova.network.neutron [-] [instance: 3a4c9522-9723-4ad4-8630-17a3aba70c98] deallocate_for_instance() {{(pid=73572) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 10:35:49 user nova-compute[73572]: DEBUG nova.network.neutron [-] [instance: 3a4c9522-9723-4ad4-8630-17a3aba70c98] Updating instance_info_cache with network_info: [] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:35:49 user nova-compute[73572]: INFO nova.compute.manager [-] [instance: 3a4c9522-9723-4ad4-8630-17a3aba70c98] Took 0.70 seconds to deallocate network for instance.
Aug 26 10:35:49 user nova-compute[73572]: DEBUG nova.compute.manager [req-9f6ab617-2310-49d4-ab8f-10adf9a07249 req-b5334b78-c137-4e10-9595-031696f1f968 service nova] [instance: 3a4c9522-9723-4ad4-8630-17a3aba70c98] Received event network-vif-deleted-663db499-c552-478e-bad7-938b2f65c619 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:35:50 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:35:50 user nova-compute[73572]: INFO nova.compute.manager [None req-c1a64256-5ad0-42df-8210-acd1e14d3c4d tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] [instance: 3a4c9522-9723-4ad4-8630-17a3aba70c98] Took 1.02 seconds to detach 1 volumes for instance.
Aug 26 10:35:50 user nova-compute[73572]: DEBUG nova.compute.manager [None req-c1a64256-5ad0-42df-8210-acd1e14d3c4d tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] [instance: 3a4c9522-9723-4ad4-8630-17a3aba70c98] Deleting volume: ec96ec24-bf73-4f38-ac9f-eb2699d0a661 {{(pid=73572) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 26 10:35:51 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-c1a64256-5ad0-42df-8210-acd1e14d3c4d tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:35:51 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-c1a64256-5ad0-42df-8210-acd1e14d3c4d tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:35:51 user nova-compute[73572]: DEBUG nova.compute.provider_tree [None req-c1a64256-5ad0-42df-8210-acd1e14d3c4d tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] Inventory has not changed in ProviderTree for provider: e2cec974-59b2-4c77-a53d-a7f4e5a30d75 {{(pid=73572) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 10:35:51 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-c1a64256-5ad0-42df-8210-acd1e14d3c4d tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] Inventory has not changed for provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73572) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 10:35:51 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-c1a64256-5ad0-42df-8210-acd1e14d3c4d tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.280s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:35:51 user nova-compute[73572]: INFO nova.scheduler.client.report [None req-c1a64256-5ad0-42df-8210-acd1e14d3c4d tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] Deleted allocations for instance 3a4c9522-9723-4ad4-8630-17a3aba70c98
Aug 26 10:35:51 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-c1a64256-5ad0-42df-8210-acd1e14d3c4d tempest-TestShelveInstance-912363172 tempest-TestShelveInstance-912363172-project-member] Lock "3a4c9522-9723-4ad4-8630-17a3aba70c98" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.682s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:35:52 user nova-compute[73572]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693046137.6703494, 86923c1a-89a5-4e7a-b488-8bf3a013bf83 => Stopped> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:35:52 user nova-compute[73572]: INFO nova.compute.manager [-] [instance: 86923c1a-89a5-4e7a-b488-8bf3a013bf83] VM Stopped (Lifecycle Event)
Aug 26 10:35:52 user nova-compute[73572]: DEBUG nova.compute.manager [None req-8194ebd4-4729-42a1-bd0d-45559c64624b None None] [instance: 86923c1a-89a5-4e7a-b488-8bf3a013bf83] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:35:53 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:35:58 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:36:03 user nova-compute[73572]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693046148.6993513, 3a4c9522-9723-4ad4-8630-17a3aba70c98 => Stopped> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:36:03 user nova-compute[73572]: INFO nova.compute.manager [-] [instance: 3a4c9522-9723-4ad4-8630-17a3aba70c98] VM Stopped (Lifecycle Event)
Aug 26 10:36:03 user nova-compute[73572]: DEBUG nova.compute.manager [None req-37ad19fa-8eb5-449b-bf21-f83d1ed323a7 None None] [instance: 3a4c9522-9723-4ad4-8630-17a3aba70c98] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:36:03 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:36:05 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:36:08 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:36:10 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:36:13 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:36:15 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:36:18 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:36:23 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:36:25 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:36:25 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Starting heal instance info cache {{(pid=73572) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 10:36:25 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Rebuilding the list of instances to heal {{(pid=73572) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 10:36:25 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquiring lock "refresh_cache-2eaea7c2-a5c0-4950-b033-0012b5cec0ee" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:36:25 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquired lock "refresh_cache-2eaea7c2-a5c0-4950-b033-0012b5cec0ee" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:36:25 user nova-compute[73572]: DEBUG nova.network.neutron [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] [instance: 2eaea7c2-a5c0-4950-b033-0012b5cec0ee] Forcefully refreshing network info cache for instance {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 10:36:25 user nova-compute[73572]: DEBUG nova.objects.instance [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lazy-loading 'info_cache' on Instance uuid 2eaea7c2-a5c0-4950-b033-0012b5cec0ee {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:36:26 user nova-compute[73572]: DEBUG nova.network.neutron [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] [instance: 2eaea7c2-a5c0-4950-b033-0012b5cec0ee] Updating instance_info_cache with network_info: [{"id": "0b4d66c9-2155-45ae-873a-2ee85776eeb7", "address": "fa:16:3e:69:d4:8e", "network": {"id": "757e71b4-5177-45a5-8ef5-9b27f42092f1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1765327616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1bff48d66894950ac6690e1fd0e79b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b4d66c9-21", "ovs_interfaceid": "0b4d66c9-2155-45ae-873a-2ee85776eeb7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:36:26 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Releasing lock "refresh_cache-2eaea7c2-a5c0-4950-b033-0012b5cec0ee" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:36:26 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] [instance: 2eaea7c2-a5c0-4950-b033-0012b5cec0ee] Updated the network info_cache for instance {{(pid=73572) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 10:36:26 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:36:27 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-e7a17dcc-af55-4acc-babf-76ab3edb472d tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Acquiring lock "2eaea7c2-a5c0-4950-b033-0012b5cec0ee" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:36:27 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-e7a17dcc-af55-4acc-babf-76ab3edb472d tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Lock "2eaea7c2-a5c0-4950-b033-0012b5cec0ee" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:36:27 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-e7a17dcc-af55-4acc-babf-76ab3edb472d tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Acquiring lock "2eaea7c2-a5c0-4950-b033-0012b5cec0ee-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:36:27 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-e7a17dcc-af55-4acc-babf-76ab3edb472d tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Lock "2eaea7c2-a5c0-4950-b033-0012b5cec0ee-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:36:27 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-e7a17dcc-af55-4acc-babf-76ab3edb472d tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Lock "2eaea7c2-a5c0-4950-b033-0012b5cec0ee-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:36:27 user nova-compute[73572]: INFO nova.compute.manager [None req-e7a17dcc-af55-4acc-babf-76ab3edb472d tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] [instance: 2eaea7c2-a5c0-4950-b033-0012b5cec0ee] Terminating instance
Aug 26 10:36:27 user nova-compute[73572]: DEBUG nova.compute.manager [None req-e7a17dcc-af55-4acc-babf-76ab3edb472d tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] [instance: 2eaea7c2-a5c0-4950-b033-0012b5cec0ee] Start destroying the instance on the hypervisor. {{(pid=73572) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 10:36:27 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:36:27 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:36:27 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:36:27 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:36:27 user nova-compute[73572]: DEBUG nova.compute.manager [req-fbb4b2a4-f3f8-40b6-b8b8-2ab4611150ac req-ce13d215-2d89-443a-83b9-353b96e2ef88 service nova] [instance: 2eaea7c2-a5c0-4950-b033-0012b5cec0ee] Received event network-vif-unplugged-0b4d66c9-2155-45ae-873a-2ee85776eeb7 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:36:27 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-fbb4b2a4-f3f8-40b6-b8b8-2ab4611150ac req-ce13d215-2d89-443a-83b9-353b96e2ef88 service nova] Acquiring lock "2eaea7c2-a5c0-4950-b033-0012b5cec0ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:36:27 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-fbb4b2a4-f3f8-40b6-b8b8-2ab4611150ac req-ce13d215-2d89-443a-83b9-353b96e2ef88 service nova] Lock "2eaea7c2-a5c0-4950-b033-0012b5cec0ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:36:27 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-fbb4b2a4-f3f8-40b6-b8b8-2ab4611150ac req-ce13d215-2d89-443a-83b9-353b96e2ef88 service nova] Lock "2eaea7c2-a5c0-4950-b033-0012b5cec0ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:36:27 user nova-compute[73572]: DEBUG nova.compute.manager [req-fbb4b2a4-f3f8-40b6-b8b8-2ab4611150ac req-ce13d215-2d89-443a-83b9-353b96e2ef88 service nova] [instance: 2eaea7c2-a5c0-4950-b033-0012b5cec0ee] No waiting events found dispatching network-vif-unplugged-0b4d66c9-2155-45ae-873a-2ee85776eeb7 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:36:27 user nova-compute[73572]: DEBUG nova.compute.manager [req-fbb4b2a4-f3f8-40b6-b8b8-2ab4611150ac req-ce13d215-2d89-443a-83b9-353b96e2ef88 service nova] [instance: 2eaea7c2-a5c0-4950-b033-0012b5cec0ee] Received event network-vif-unplugged-0b4d66c9-2155-45ae-873a-2ee85776eeb7 for instance with task_state deleting. {{(pid=73572) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 10:36:27 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:36:27 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:36:27 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:36:27 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:36:27 user nova-compute[73572]: INFO nova.virt.libvirt.driver [-] [instance: 2eaea7c2-a5c0-4950-b033-0012b5cec0ee] Instance destroyed successfully.
Aug 26 10:36:27 user nova-compute[73572]: DEBUG nova.objects.instance [None req-e7a17dcc-af55-4acc-babf-76ab3edb472d tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Lazy-loading 'resources' on Instance uuid 2eaea7c2-a5c0-4950-b033-0012b5cec0ee {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:36:28 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-e7a17dcc-af55-4acc-babf-76ab3edb472d tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T10:19:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-743407268',display_name='tempest-ServerRescueNegativeTestJSON-server-743407268',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-743407268',id=24,image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T10:24:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c1bff48d66894950ac6690e1fd0e79b9',ramdisk_id='',reservation_id='r-qoxdscxl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1710547876',owner_user_name='tempest-ServerRescueNegativeTestJSON-1710547876-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T10:25:56Z,user_data=None,user_id='099462c61dcc4816b17d2d0155823873',uuid=2eaea7c2-a5c0-4950-b033-0012b5cec0ee,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0b4d66c9-2155-45ae-873a-2ee85776eeb7", "address": "fa:16:3e:69:d4:8e", "network": {"id": "757e71b4-5177-45a5-8ef5-9b27f42092f1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1765327616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1bff48d66894950ac6690e1fd0e79b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b4d66c9-21", "ovs_interfaceid": "0b4d66c9-2155-45ae-873a-2ee85776eeb7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 10:36:28 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-e7a17dcc-af55-4acc-babf-76ab3edb472d tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Converting VIF {"id": "0b4d66c9-2155-45ae-873a-2ee85776eeb7", "address": "fa:16:3e:69:d4:8e", "network": {"id": "757e71b4-5177-45a5-8ef5-9b27f42092f1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1765327616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1bff48d66894950ac6690e1fd0e79b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b4d66c9-21", "ovs_interfaceid": "0b4d66c9-2155-45ae-873a-2ee85776eeb7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:36:28 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-e7a17dcc-af55-4acc-babf-76ab3edb472d tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:69:d4:8e,bridge_name='br-int',has_traffic_filtering=True,id=0b4d66c9-2155-45ae-873a-2ee85776eeb7,network=Network(757e71b4-5177-45a5-8ef5-9b27f42092f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b4d66c9-21') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:36:28 user nova-compute[73572]: DEBUG os_vif [None req-e7a17dcc-af55-4acc-babf-76ab3edb472d tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:69:d4:8e,bridge_name='br-int',has_traffic_filtering=True,id=0b4d66c9-2155-45ae-873a-2ee85776eeb7,network=Network(757e71b4-5177-45a5-8ef5-9b27f42092f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b4d66c9-21') {{(pid=73572) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 10:36:28 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:36:28 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0b4d66c9-21, bridge=br-int, if_exists=True) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:36:28 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:36:28 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:36:28 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:36:28 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:36:28 user nova-compute[73572]: INFO os_vif [None req-e7a17dcc-af55-4acc-babf-76ab3edb472d tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:69:d4:8e,bridge_name='br-int',has_traffic_filtering=True,id=0b4d66c9-2155-45ae-873a-2ee85776eeb7,network=Network(757e71b4-5177-45a5-8ef5-9b27f42092f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b4d66c9-21')
Aug 26 10:36:28 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-e7a17dcc-af55-4acc-babf-76ab3edb472d tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] [instance: 2eaea7c2-a5c0-4950-b033-0012b5cec0ee] Deleting instance files /opt/stack/data/nova/instances/2eaea7c2-a5c0-4950-b033-0012b5cec0ee_del
Aug 26 10:36:28 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-e7a17dcc-af55-4acc-babf-76ab3edb472d tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] [instance: 2eaea7c2-a5c0-4950-b033-0012b5cec0ee] Deletion of /opt/stack/data/nova/instances/2eaea7c2-a5c0-4950-b033-0012b5cec0ee_del complete
Aug 26 10:36:28 user nova-compute[73572]: INFO nova.compute.manager [None req-e7a17dcc-af55-4acc-babf-76ab3edb472d tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] [instance: 2eaea7c2-a5c0-4950-b033-0012b5cec0ee] Took 0.73 seconds to destroy the instance on the hypervisor.
Aug 26 10:36:28 user nova-compute[73572]: DEBUG oslo.service.loopingcall [None req-e7a17dcc-af55-4acc-babf-76ab3edb472d tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73572) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 10:36:28 user nova-compute[73572]: DEBUG nova.compute.manager [-] [instance: 2eaea7c2-a5c0-4950-b033-0012b5cec0ee] Deallocating network for instance {{(pid=73572) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 10:36:28 user nova-compute[73572]: DEBUG nova.network.neutron [-] [instance: 2eaea7c2-a5c0-4950-b033-0012b5cec0ee] deallocate_for_instance() {{(pid=73572) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 10:36:28 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:36:28 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:36:28 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:36:28 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:36:28 user nova-compute[73572]: DEBUG nova.network.neutron [-] [instance: 2eaea7c2-a5c0-4950-b033-0012b5cec0ee] Updating instance_info_cache with network_info: [] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:36:28 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:36:28 user nova-compute[73572]: INFO nova.compute.manager [-] [instance: 2eaea7c2-a5c0-4950-b033-0012b5cec0ee] Took 0.62 seconds to deallocate network for instance.
Aug 26 10:36:28 user nova-compute[73572]: DEBUG nova.compute.manager [req-9e8f680b-9d48-427a-bf24-29b89c4874e1 req-f556a1a6-c1e4-4dac-9aae-ccd71d2372a4 service nova] [instance: 2eaea7c2-a5c0-4950-b033-0012b5cec0ee] Received event network-vif-deleted-0b4d66c9-2155-45ae-873a-2ee85776eeb7 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:36:28 user nova-compute[73572]: INFO nova.compute.manager [req-9e8f680b-9d48-427a-bf24-29b89c4874e1 req-f556a1a6-c1e4-4dac-9aae-ccd71d2372a4 service nova] [instance: 2eaea7c2-a5c0-4950-b033-0012b5cec0ee] Neutron deleted interface 0b4d66c9-2155-45ae-873a-2ee85776eeb7; detaching it from the instance and deleting it from the info cache
Aug 26 10:36:28 user nova-compute[73572]: DEBUG nova.network.neutron [req-9e8f680b-9d48-427a-bf24-29b89c4874e1 req-f556a1a6-c1e4-4dac-9aae-ccd71d2372a4 service nova] [instance: 2eaea7c2-a5c0-4950-b033-0012b5cec0ee] Updating instance_info_cache with network_info: [] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:36:28 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:36:28 user nova-compute[73572]: DEBUG nova.compute.manager [req-9e8f680b-9d48-427a-bf24-29b89c4874e1 req-f556a1a6-c1e4-4dac-9aae-ccd71d2372a4 service nova] [instance: 2eaea7c2-a5c0-4950-b033-0012b5cec0ee] Detach interface failed, port_id=0b4d66c9-2155-45ae-873a-2ee85776eeb7, reason: Instance 2eaea7c2-a5c0-4950-b033-0012b5cec0ee could not be found. {{(pid=73572) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 10:36:28 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-e7a17dcc-af55-4acc-babf-76ab3edb472d tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:36:28 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-e7a17dcc-af55-4acc-babf-76ab3edb472d tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:36:29 user nova-compute[73572]: DEBUG nova.compute.provider_tree [None req-e7a17dcc-af55-4acc-babf-76ab3edb472d tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Inventory has not changed in ProviderTree for provider: e2cec974-59b2-4c77-a53d-a7f4e5a30d75 {{(pid=73572) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 10:36:29 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-e7a17dcc-af55-4acc-babf-76ab3edb472d tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Inventory has not changed for provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73572) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 10:36:29 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-e7a17dcc-af55-4acc-babf-76ab3edb472d tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.269s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:36:29 user nova-compute[73572]: INFO nova.scheduler.client.report [None req-e7a17dcc-af55-4acc-babf-76ab3edb472d tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Deleted allocations for instance 2eaea7c2-a5c0-4950-b033-0012b5cec0ee
Aug 26 10:36:29 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-e7a17dcc-af55-4acc-babf-76ab3edb472d tempest-ServerRescueNegativeTestJSON-1710547876 tempest-ServerRescueNegativeTestJSON-1710547876-project-member] Lock "2eaea7c2-a5c0-4950-b033-0012b5cec0ee" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.818s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:36:29 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:36:29 user nova-compute[73572]: DEBUG nova.compute.manager [req-ed840985-c993-4f70-abf4-eee734a080fb req-bc5b1c61-b69a-4aa2-8c45-f984eeb340f5 service nova] [instance: 2eaea7c2-a5c0-4950-b033-0012b5cec0ee] Received event network-vif-plugged-0b4d66c9-2155-45ae-873a-2ee85776eeb7 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:36:29 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-ed840985-c993-4f70-abf4-eee734a080fb req-bc5b1c61-b69a-4aa2-8c45-f984eeb340f5 service nova] Acquiring lock "2eaea7c2-a5c0-4950-b033-0012b5cec0ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:36:29 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-ed840985-c993-4f70-abf4-eee734a080fb req-bc5b1c61-b69a-4aa2-8c45-f984eeb340f5 service nova] Lock "2eaea7c2-a5c0-4950-b033-0012b5cec0ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:36:29 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-ed840985-c993-4f70-abf4-eee734a080fb req-bc5b1c61-b69a-4aa2-8c45-f984eeb340f5 service nova] Lock "2eaea7c2-a5c0-4950-b033-0012b5cec0ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:36:29 user nova-compute[73572]: DEBUG nova.compute.manager [req-ed840985-c993-4f70-abf4-eee734a080fb req-bc5b1c61-b69a-4aa2-8c45-f984eeb340f5 service nova] [instance: 2eaea7c2-a5c0-4950-b033-0012b5cec0ee] No waiting events found dispatching network-vif-plugged-0b4d66c9-2155-45ae-873a-2ee85776eeb7 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:36:29 user nova-compute[73572]: WARNING nova.compute.manager [req-ed840985-c993-4f70-abf4-eee734a080fb req-bc5b1c61-b69a-4aa2-8c45-f984eeb340f5 service nova] [instance: 2eaea7c2-a5c0-4950-b033-0012b5cec0ee] Received unexpected event network-vif-plugged-0b4d66c9-2155-45ae-873a-2ee85776eeb7 for instance with vm_state deleted and task_state None.
Aug 26 10:36:29 user nova-compute[73572]: DEBUG nova.compute.manager [req-ed840985-c993-4f70-abf4-eee734a080fb req-bc5b1c61-b69a-4aa2-8c45-f984eeb340f5 service nova] [instance: 2eaea7c2-a5c0-4950-b033-0012b5cec0ee] Received event network-vif-plugged-0b4d66c9-2155-45ae-873a-2ee85776eeb7 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:36:29 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-ed840985-c993-4f70-abf4-eee734a080fb req-bc5b1c61-b69a-4aa2-8c45-f984eeb340f5 service nova] Acquiring lock "2eaea7c2-a5c0-4950-b033-0012b5cec0ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:36:29 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-ed840985-c993-4f70-abf4-eee734a080fb req-bc5b1c61-b69a-4aa2-8c45-f984eeb340f5 service nova] Lock "2eaea7c2-a5c0-4950-b033-0012b5cec0ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:36:29 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-ed840985-c993-4f70-abf4-eee734a080fb req-bc5b1c61-b69a-4aa2-8c45-f984eeb340f5 service nova] Lock "2eaea7c2-a5c0-4950-b033-0012b5cec0ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:36:29 user nova-compute[73572]: DEBUG nova.compute.manager [req-ed840985-c993-4f70-abf4-eee734a080fb req-bc5b1c61-b69a-4aa2-8c45-f984eeb340f5 service nova] [instance: 2eaea7c2-a5c0-4950-b033-0012b5cec0ee] No waiting events found dispatching network-vif-plugged-0b4d66c9-2155-45ae-873a-2ee85776eeb7 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:36:29 user nova-compute[73572]: WARNING nova.compute.manager [req-ed840985-c993-4f70-abf4-eee734a080fb req-bc5b1c61-b69a-4aa2-8c45-f984eeb340f5 service nova] [instance: 2eaea7c2-a5c0-4950-b033-0012b5cec0ee] Received unexpected event network-vif-plugged-0b4d66c9-2155-45ae-873a-2ee85776eeb7 for instance with vm_state deleted and task_state None.
Aug 26 10:36:31 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:36:31 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73572) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 10:36:33 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:36:37 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:36:37 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:36:37 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:36:37 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:36:37 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Auditing locally available compute resources for user (node: user) {{(pid=73572) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 10:36:37 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73572) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 10:36:37 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73572) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 10:36:37 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68613b1e-c45c-4fd9-834c-3630ed0f456a/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:36:38 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:36:38 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:36:38 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5005 ms, sending inactivity probe {{(pid=73572) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 10:36:38 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73572) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 10:36:38 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:36:38 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73572) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 10:36:38 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68613b1e-c45c-4fd9-834c-3630ed0f456a/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:36:38 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68613b1e-c45c-4fd9-834c-3630ed0f456a/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:36:38 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68613b1e-c45c-4fd9-834c-3630ed0f456a/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:36:38 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:36:38 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:36:38 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:36:38 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Hypervisor/Node resource view: name=user free_ram=8184MB free_disk=25.209468841552734GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=73572) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 10:36:38 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:36:38 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:36:38 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-ad8b695b-3931-4e0e-ba6e-29f3795e59ef tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Acquiring lock "c457a41c-2ee2-4821-94cf-69c091589241" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:36:38 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-ad8b695b-3931-4e0e-ba6e-29f3795e59ef tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Lock "c457a41c-2ee2-4821-94cf-69c091589241" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:36:38 user nova-compute[73572]: DEBUG nova.compute.manager [None req-ad8b695b-3931-4e0e-ba6e-29f3795e59ef tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] [instance: c457a41c-2ee2-4821-94cf-69c091589241] Going to confirm migration 2 {{(pid=73572) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4694}}
Aug 26 10:36:38 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Applying migration context for instance c457a41c-2ee2-4821-94cf-69c091589241 as it has an incoming, in-progress migration 54257f22-04e0-4bf9-a6a6-cd5b7ab6ceea. Migration status is confirming {{(pid=73572) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 26 10:36:38 user nova-compute[73572]: INFO nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] [instance: c457a41c-2ee2-4821-94cf-69c091589241] Updating resource usage from migration 54257f22-04e0-4bf9-a6a6-cd5b7ab6ceea
Aug 26 10:36:38 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance 68613b1e-c45c-4fd9-834c-3630ed0f456a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:36:38 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Migration 54257f22-04e0-4bf9-a6a6-cd5b7ab6ceea is active on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 26 10:36:38 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance c457a41c-2ee2-4821-94cf-69c091589241 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:36:38 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance 4039a8aa-b1a7-497d-b12c-6fcc12ab2b0a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:36:38 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=73572) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 10:36:38 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=73572) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 10:36:39 user nova-compute[73572]: DEBUG nova.compute.provider_tree [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Inventory has not changed in ProviderTree for provider: e2cec974-59b2-4c77-a53d-a7f4e5a30d75 {{(pid=73572) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 10:36:39 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Inventory has not changed for provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73572) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 10:36:39 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Compute_service record updated for user:user {{(pid=73572) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 10:36:39 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.410s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:36:39 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-ad8b695b-3931-4e0e-ba6e-29f3795e59ef tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Acquiring lock "refresh_cache-c457a41c-2ee2-4821-94cf-69c091589241" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:36:39 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-ad8b695b-3931-4e0e-ba6e-29f3795e59ef tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Acquired lock "refresh_cache-c457a41c-2ee2-4821-94cf-69c091589241" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:36:39 user nova-compute[73572]: DEBUG nova.network.neutron [None req-ad8b695b-3931-4e0e-ba6e-29f3795e59ef tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] [instance: c457a41c-2ee2-4821-94cf-69c091589241] Building network info cache for instance {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 10:36:39 user nova-compute[73572]: DEBUG nova.objects.instance [None req-ad8b695b-3931-4e0e-ba6e-29f3795e59ef tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Lazy-loading 'info_cache' on Instance uuid c457a41c-2ee2-4821-94cf-69c091589241 {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:36:40 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:36:40 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:36:40 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:36:40 user nova-compute[73572]: DEBUG nova.network.neutron [None req-ad8b695b-3931-4e0e-ba6e-29f3795e59ef tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] [instance: c457a41c-2ee2-4821-94cf-69c091589241] Updating instance_info_cache with network_info: [{"id": "deb899b2-ba04-427b-b4ea-a514b8eda260", "address": "fa:16:3e:05:c8:e3", "network": {"id": "43215883-3d00-4be7-8c40-bdaf3f01bef9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1088544153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7935bccc360b46b589fd57d53f334595", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdeb899b2-ba", "ovs_interfaceid": "deb899b2-ba04-427b-b4ea-a514b8eda260", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:36:40 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-ad8b695b-3931-4e0e-ba6e-29f3795e59ef tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Releasing lock "refresh_cache-c457a41c-2ee2-4821-94cf-69c091589241" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:36:40 user nova-compute[73572]: DEBUG nova.objects.instance [None req-ad8b695b-3931-4e0e-ba6e-29f3795e59ef tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Lazy-loading 'migration_context' on Instance uuid c457a41c-2ee2-4821-94cf-69c091589241 {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:36:40 user nova-compute[73572]: DEBUG nova.objects.base [None req-ad8b695b-3931-4e0e-ba6e-29f3795e59ef tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Object Instance<c457a41c-2ee2-4821-94cf-69c091589241> lazy-loaded attributes: info_cache,migration_context {{(pid=73572) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 10:36:40 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-ad8b695b-3931-4e0e-ba6e-29f3795e59ef tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:36:40 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-ad8b695b-3931-4e0e-ba6e-29f3795e59ef tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:36:40 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:36:40 user nova-compute[73572]: DEBUG nova.compute.provider_tree [None req-ad8b695b-3931-4e0e-ba6e-29f3795e59ef tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Inventory has not changed in ProviderTree for provider: e2cec974-59b2-4c77-a53d-a7f4e5a30d75 {{(pid=73572) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 10:36:40 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-ad8b695b-3931-4e0e-ba6e-29f3795e59ef tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Inventory has not changed for provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73572) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 10:36:40 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-ad8b695b-3931-4e0e-ba6e-29f3795e59ef tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.289s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:36:40 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:36:41 user nova-compute[73572]: INFO nova.scheduler.client.report [None req-ad8b695b-3931-4e0e-ba6e-29f3795e59ef tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Deleted allocation for migration 54257f22-04e0-4bf9-a6a6-cd5b7ab6ceea
Aug 26 10:36:41 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-ad8b695b-3931-4e0e-ba6e-29f3795e59ef tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Lock "c457a41c-2ee2-4821-94cf-69c091589241" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 2.396s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:36:42 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:36:42 user nova-compute[73572]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693046187.986203, 2eaea7c2-a5c0-4950-b033-0012b5cec0ee => Stopped> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:36:42 user nova-compute[73572]: INFO nova.compute.manager [-] [instance: 2eaea7c2-a5c0-4950-b033-0012b5cec0ee] VM Stopped (Lifecycle Event)
Aug 26 10:36:43 user nova-compute[73572]: DEBUG nova.compute.manager [None req-a721e637-39cc-4a82-bb68-2f888c0e5533 None None] [instance: 2eaea7c2-a5c0-4950-b033-0012b5cec0ee] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:36:43 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:36:44 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:36:45 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:36:46 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:36:47 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:36:48 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:36:50 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:36:50 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-72b27798-4fbc-4f4e-9a8b-58e1e2345d03 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member] Acquiring lock "0a8e064c-c6b0-4812-9d3a-04ba52b06bda" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:36:50 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-72b27798-4fbc-4f4e-9a8b-58e1e2345d03 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member] Lock "0a8e064c-c6b0-4812-9d3a-04ba52b06bda" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:36:50 user nova-compute[73572]: DEBUG nova.compute.manager [None req-72b27798-4fbc-4f4e-9a8b-58e1e2345d03 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member] [instance: 0a8e064c-c6b0-4812-9d3a-04ba52b06bda] Starting instance... {{(pid=73572) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 10:36:50 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-72b27798-4fbc-4f4e-9a8b-58e1e2345d03 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:36:50 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-72b27798-4fbc-4f4e-9a8b-58e1e2345d03 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:36:50 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-72b27798-4fbc-4f4e-9a8b-58e1e2345d03 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73572) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 10:36:50 user nova-compute[73572]: INFO nova.compute.claims [None req-72b27798-4fbc-4f4e-9a8b-58e1e2345d03 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member] [instance: 0a8e064c-c6b0-4812-9d3a-04ba52b06bda] Claim successful on node user
Aug 26 10:36:51 user nova-compute[73572]: DEBUG nova.compute.provider_tree [None req-72b27798-4fbc-4f4e-9a8b-58e1e2345d03 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member] Inventory has not changed in ProviderTree for provider: e2cec974-59b2-4c77-a53d-a7f4e5a30d75 {{(pid=73572) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 10:36:51 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-72b27798-4fbc-4f4e-9a8b-58e1e2345d03 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member] Inventory has not changed for provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73572) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 10:36:51 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-72b27798-4fbc-4f4e-9a8b-58e1e2345d03 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.266s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:36:51 user nova-compute[73572]: DEBUG nova.compute.manager [None req-72b27798-4fbc-4f4e-9a8b-58e1e2345d03 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member] [instance: 0a8e064c-c6b0-4812-9d3a-04ba52b06bda] Start building networks asynchronously for instance. {{(pid=73572) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 10:36:51 user nova-compute[73572]: DEBUG nova.compute.manager [None req-72b27798-4fbc-4f4e-9a8b-58e1e2345d03 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member] [instance: 0a8e064c-c6b0-4812-9d3a-04ba52b06bda] Allocating IP information in the background. {{(pid=73572) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 10:36:51 user nova-compute[73572]: DEBUG nova.network.neutron [None req-72b27798-4fbc-4f4e-9a8b-58e1e2345d03 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member] [instance: 0a8e064c-c6b0-4812-9d3a-04ba52b06bda] allocate_for_instance() {{(pid=73572) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 10:36:51 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-72b27798-4fbc-4f4e-9a8b-58e1e2345d03 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member] [instance: 0a8e064c-c6b0-4812-9d3a-04ba52b06bda] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 10:36:51 user nova-compute[73572]: DEBUG nova.compute.manager [None req-72b27798-4fbc-4f4e-9a8b-58e1e2345d03 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member] [instance: 0a8e064c-c6b0-4812-9d3a-04ba52b06bda] Start building block device mappings for instance. {{(pid=73572) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 10:36:51 user nova-compute[73572]: DEBUG nova.policy [None req-72b27798-4fbc-4f4e-9a8b-58e1e2345d03 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '28a22a71368940ab830921214268a1b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54e0a0a3c0f64ed7980570750d7754ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73572) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 10:36:51 user nova-compute[73572]: DEBUG nova.compute.manager [None req-72b27798-4fbc-4f4e-9a8b-58e1e2345d03 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member] [instance: 0a8e064c-c6b0-4812-9d3a-04ba52b06bda] Start spawning the instance on the hypervisor. {{(pid=73572) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 10:36:51 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-72b27798-4fbc-4f4e-9a8b-58e1e2345d03 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member] [instance: 0a8e064c-c6b0-4812-9d3a-04ba52b06bda] Creating instance directory {{(pid=73572) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 10:36:51 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-72b27798-4fbc-4f4e-9a8b-58e1e2345d03 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member] [instance: 0a8e064c-c6b0-4812-9d3a-04ba52b06bda] Creating image(s)
Aug 26 10:36:51 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-72b27798-4fbc-4f4e-9a8b-58e1e2345d03 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member] Acquiring lock "/opt/stack/data/nova/instances/0a8e064c-c6b0-4812-9d3a-04ba52b06bda/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:36:51 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-72b27798-4fbc-4f4e-9a8b-58e1e2345d03 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member] Lock "/opt/stack/data/nova/instances/0a8e064c-c6b0-4812-9d3a-04ba52b06bda/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:36:51 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-72b27798-4fbc-4f4e-9a8b-58e1e2345d03 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member] Lock "/opt/stack/data/nova/instances/0a8e064c-c6b0-4812-9d3a-04ba52b06bda/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:36:51 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-72b27798-4fbc-4f4e-9a8b-58e1e2345d03 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:36:51 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-72b27798-4fbc-4f4e-9a8b-58e1e2345d03 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json" returned: 0 in 0.179s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:36:51 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-72b27798-4fbc-4f4e-9a8b-58e1e2345d03 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member] Acquiring lock "2099350d6f3bcd0de9471c73862d4fe75b049801" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:36:51 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-72b27798-4fbc-4f4e-9a8b-58e1e2345d03 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member] Lock "2099350d6f3bcd0de9471c73862d4fe75b049801" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:36:51 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-72b27798-4fbc-4f4e-9a8b-58e1e2345d03 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:36:51 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-72b27798-4fbc-4f4e-9a8b-58e1e2345d03 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json" returned: 0 in 0.191s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:36:51 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-72b27798-4fbc-4f4e-9a8b-58e1e2345d03 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801,backing_fmt=raw /opt/stack/data/nova/instances/0a8e064c-c6b0-4812-9d3a-04ba52b06bda/disk 1073741824 {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:36:51 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-72b27798-4fbc-4f4e-9a8b-58e1e2345d03 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801,backing_fmt=raw /opt/stack/data/nova/instances/0a8e064c-c6b0-4812-9d3a-04ba52b06bda/disk 1073741824" returned: 0 in 0.053s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:36:51 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-72b27798-4fbc-4f4e-9a8b-58e1e2345d03 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member] Lock "2099350d6f3bcd0de9471c73862d4fe75b049801" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.253s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:36:51 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-72b27798-4fbc-4f4e-9a8b-58e1e2345d03 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:36:52 user nova-compute[73572]: DEBUG nova.network.neutron [None req-72b27798-4fbc-4f4e-9a8b-58e1e2345d03 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member] [instance: 0a8e064c-c6b0-4812-9d3a-04ba52b06bda] Successfully created port: 4a5e5040-9799-4ade-8465-c5ab770d0616 {{(pid=73572) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 10:36:52 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-72b27798-4fbc-4f4e-9a8b-58e1e2345d03 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json" returned: 0 in 0.185s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:36:52 user nova-compute[73572]: DEBUG nova.virt.disk.api [None req-72b27798-4fbc-4f4e-9a8b-58e1e2345d03 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0a8e064c-c6b0-4812-9d3a-04ba52b06bda/disk. size=1073741824 {{(pid=73572) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 10:36:52 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-72b27798-4fbc-4f4e-9a8b-58e1e2345d03 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a8e064c-c6b0-4812-9d3a-04ba52b06bda/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:36:52 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-72b27798-4fbc-4f4e-9a8b-58e1e2345d03 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a8e064c-c6b0-4812-9d3a-04ba52b06bda/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:36:52 user nova-compute[73572]: DEBUG nova.virt.disk.api [None req-72b27798-4fbc-4f4e-9a8b-58e1e2345d03 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member] Cannot resize image /opt/stack/data/nova/instances/0a8e064c-c6b0-4812-9d3a-04ba52b06bda/disk to a smaller size. {{(pid=73572) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 10:36:52 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-72b27798-4fbc-4f4e-9a8b-58e1e2345d03 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member] [instance: 0a8e064c-c6b0-4812-9d3a-04ba52b06bda] Created local disks {{(pid=73572) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 10:36:52 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-72b27798-4fbc-4f4e-9a8b-58e1e2345d03 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member] [instance: 0a8e064c-c6b0-4812-9d3a-04ba52b06bda] Ensure instance console log exists: /opt/stack/data/nova/instances/0a8e064c-c6b0-4812-9d3a-04ba52b06bda/console.log {{(pid=73572) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 10:36:52 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-72b27798-4fbc-4f4e-9a8b-58e1e2345d03 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:36:52 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-72b27798-4fbc-4f4e-9a8b-58e1e2345d03 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:36:52 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-72b27798-4fbc-4f4e-9a8b-58e1e2345d03 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:36:52 user nova-compute[73572]: DEBUG nova.network.neutron [None req-72b27798-4fbc-4f4e-9a8b-58e1e2345d03 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member] [instance: 0a8e064c-c6b0-4812-9d3a-04ba52b06bda] Successfully updated port: 4a5e5040-9799-4ade-8465-c5ab770d0616 {{(pid=73572) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 10:36:52 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-72b27798-4fbc-4f4e-9a8b-58e1e2345d03 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member] Acquiring lock "refresh_cache-0a8e064c-c6b0-4812-9d3a-04ba52b06bda" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:36:52 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-72b27798-4fbc-4f4e-9a8b-58e1e2345d03 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member] Acquired lock "refresh_cache-0a8e064c-c6b0-4812-9d3a-04ba52b06bda" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:36:52 user nova-compute[73572]: DEBUG nova.network.neutron [None req-72b27798-4fbc-4f4e-9a8b-58e1e2345d03 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member] [instance: 0a8e064c-c6b0-4812-9d3a-04ba52b06bda] Building network info cache for instance {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 10:36:52 user nova-compute[73572]: DEBUG nova.compute.manager [req-f9ccba8c-9355-4398-87fa-ead40d7277bb req-e5a6e29e-598e-4222-9da4-45792d728442 service nova] [instance: 0a8e064c-c6b0-4812-9d3a-04ba52b06bda] Received event network-changed-4a5e5040-9799-4ade-8465-c5ab770d0616 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:36:52 user nova-compute[73572]: DEBUG nova.compute.manager [req-f9ccba8c-9355-4398-87fa-ead40d7277bb req-e5a6e29e-598e-4222-9da4-45792d728442 service nova] [instance: 0a8e064c-c6b0-4812-9d3a-04ba52b06bda] Refreshing instance network info cache due to event network-changed-4a5e5040-9799-4ade-8465-c5ab770d0616. {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 10:36:52 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-f9ccba8c-9355-4398-87fa-ead40d7277bb req-e5a6e29e-598e-4222-9da4-45792d728442 service nova] Acquiring lock "refresh_cache-0a8e064c-c6b0-4812-9d3a-04ba52b06bda" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:36:52 user nova-compute[73572]: DEBUG nova.network.neutron [None req-72b27798-4fbc-4f4e-9a8b-58e1e2345d03 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member] [instance: 0a8e064c-c6b0-4812-9d3a-04ba52b06bda] Instance cache missing network info. {{(pid=73572) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 10:36:53 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:36:53 user nova-compute[73572]: DEBUG nova.network.neutron [None req-72b27798-4fbc-4f4e-9a8b-58e1e2345d03 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member] [instance: 0a8e064c-c6b0-4812-9d3a-04ba52b06bda] Updating instance_info_cache with network_info: [{"id": "4a5e5040-9799-4ade-8465-c5ab770d0616", "address": "fa:16:3e:47:ea:be", "network": {"id": "21dd7d4e-3fb2-44d6-99d0-973f9eb5d456", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-222837576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54e0a0a3c0f64ed7980570750d7754ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a5e5040-97", "ovs_interfaceid": "4a5e5040-9799-4ade-8465-c5ab770d0616", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:36:53 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-72b27798-4fbc-4f4e-9a8b-58e1e2345d03 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member] Releasing lock "refresh_cache-0a8e064c-c6b0-4812-9d3a-04ba52b06bda" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:36:53 user nova-compute[73572]: DEBUG nova.compute.manager [None req-72b27798-4fbc-4f4e-9a8b-58e1e2345d03 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member] [instance: 0a8e064c-c6b0-4812-9d3a-04ba52b06bda] Instance network_info: |[{"id": "4a5e5040-9799-4ade-8465-c5ab770d0616", "address": "fa:16:3e:47:ea:be", "network": {"id": "21dd7d4e-3fb2-44d6-99d0-973f9eb5d456", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-222837576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54e0a0a3c0f64ed7980570750d7754ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a5e5040-97", "ovs_interfaceid": "4a5e5040-9799-4ade-8465-c5ab770d0616", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73572) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 10:36:53 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-f9ccba8c-9355-4398-87fa-ead40d7277bb req-e5a6e29e-598e-4222-9da4-45792d728442 service nova] Acquired lock "refresh_cache-0a8e064c-c6b0-4812-9d3a-04ba52b06bda" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:36:53 user nova-compute[73572]: DEBUG nova.network.neutron [req-f9ccba8c-9355-4398-87fa-ead40d7277bb req-e5a6e29e-598e-4222-9da4-45792d728442 service nova] [instance: 0a8e064c-c6b0-4812-9d3a-04ba52b06bda] Refreshing network info cache for port 4a5e5040-9799-4ade-8465-c5ab770d0616 {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 10:36:53 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-72b27798-4fbc-4f4e-9a8b-58e1e2345d03 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member] [instance: 0a8e064c-c6b0-4812-9d3a-04ba52b06bda] Start _get_guest_xml network_info=[{"id": "4a5e5040-9799-4ade-8465-c5ab770d0616", "address": "fa:16:3e:47:ea:be", "network": {"id": "21dd7d4e-3fb2-44d6-99d0-973f9eb5d456", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-222837576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54e0a0a3c0f64ed7980570750d7754ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a5e5040-97", "ovs_interfaceid": "4a5e5040-9799-4ade-8465-c5ab770d0616", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T10:07:33Z,direct_url=<?>,disk_format='qcow2',id=299da0c9-e1c4-48f0-be55-fbe20dd06bc9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5c995f8bbbab4368b67a253e0df3971a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T10:07:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'guest_format': None, 'size': 0, 'encryption_format': None, 'device_type': 'disk', 'image_id': '299da0c9-e1c4-48f0-be55-fbe20dd06bc9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73572) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 10:36:53 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-72b27798-4fbc-4f4e-9a8b-58e1e2345d03 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:36:53 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-72b27798-4fbc-4f4e-9a8b-58e1e2345d03 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:36:53 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-72b27798-4fbc-4f4e-9a8b-58e1e2345d03 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73572) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 10:36:53 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-72b27798-4fbc-4f4e-9a8b-58e1e2345d03 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member] CPU controller missing on host. {{(pid=73572) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 10:36:53 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-72b27798-4fbc-4f4e-9a8b-58e1e2345d03 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73572) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 10:36:53 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-72b27798-4fbc-4f4e-9a8b-58e1e2345d03 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member] CPU controller found on host. {{(pid=73572) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 10:36:53 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-72b27798-4fbc-4f4e-9a8b-58e1e2345d03 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73572) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 10:36:53 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-72b27798-4fbc-4f4e-9a8b-58e1e2345d03 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T10:07:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T10:07:33Z,direct_url=<?>,disk_format='qcow2',id=299da0c9-e1c4-48f0-be55-fbe20dd06bc9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5c995f8bbbab4368b67a253e0df3971a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T10:07:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 10:36:53 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-72b27798-4fbc-4f4e-9a8b-58e1e2345d03 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member] Flavor limits 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 10:36:53 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-72b27798-4fbc-4f4e-9a8b-58e1e2345d03 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member] Image limits 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 10:36:53 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-72b27798-4fbc-4f4e-9a8b-58e1e2345d03 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member] Flavor pref 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 10:36:53 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-72b27798-4fbc-4f4e-9a8b-58e1e2345d03 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member] Image pref 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 10:36:53 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-72b27798-4fbc-4f4e-9a8b-58e1e2345d03 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 10:36:53 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-72b27798-4fbc-4f4e-9a8b-58e1e2345d03 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 10:36:53 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-72b27798-4fbc-4f4e-9a8b-58e1e2345d03 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73572) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 10:36:53 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-72b27798-4fbc-4f4e-9a8b-58e1e2345d03 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member] Got 1 possible topologies {{(pid=73572) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 10:36:53 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-72b27798-4fbc-4f4e-9a8b-58e1e2345d03 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 10:36:53 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-72b27798-4fbc-4f4e-9a8b-58e1e2345d03 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 10:36:53 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-72b27798-4fbc-4f4e-9a8b-58e1e2345d03 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T10:36:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-264759441',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-264759441',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-2647594',id=48,image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKCW3tbmJ/DCwB0Pz3ExNny9URVuz0fsycd79/95q7dLMdFXtVKOtp3SMJeRCHXmVhNqz5c7OWWeDamUjtcucCK5cjeYo56gvos7qH58v+ONOUJa+Pjd3wtU3Muah31kPg==',key_name='tempest-keypair-682558480',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='54e0a0a3c0f64ed7980570750d7754ce',ramdisk_id='',reservation_id='r-4jposz0c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1514114358',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T10:36:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='28a22a71368940ab830921214268a1b9',uuid=0a8e064c-c6b0-4812-9d3a-04ba52b06bda,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4a5e5040-9799-4ade-8465-c5ab770d0616", "address": "fa:16:3e:47:ea:be", "network": {"id": "21dd7d4e-3fb2-44d6-99d0-973f9eb5d456", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-222837576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54e0a0a3c0f64ed7980570750d7754ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a5e5040-97", "ovs_interfaceid": "4a5e5040-9799-4ade-8465-c5ab770d0616", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73572) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 10:36:53 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-72b27798-4fbc-4f4e-9a8b-58e1e2345d03 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member] Converting VIF {"id": "4a5e5040-9799-4ade-8465-c5ab770d0616", "address": "fa:16:3e:47:ea:be", "network": {"id": "21dd7d4e-3fb2-44d6-99d0-973f9eb5d456", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-222837576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54e0a0a3c0f64ed7980570750d7754ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a5e5040-97", "ovs_interfaceid": "4a5e5040-9799-4ade-8465-c5ab770d0616", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:36:53 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-72b27798-4fbc-4f4e-9a8b-58e1e2345d03 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:ea:be,bridge_name='br-int',has_traffic_filtering=True,id=4a5e5040-9799-4ade-8465-c5ab770d0616,network=Network(21dd7d4e-3fb2-44d6-99d0-973f9eb5d456),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a5e5040-97') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:36:53 user nova-compute[73572]: DEBUG nova.objects.instance [None req-72b27798-4fbc-4f4e-9a8b-58e1e2345d03 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member] Lazy-loading 'pci_devices' on Instance uuid 0a8e064c-c6b0-4812-9d3a-04ba52b06bda {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:36:53 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-72b27798-4fbc-4f4e-9a8b-58e1e2345d03 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member] [instance: 0a8e064c-c6b0-4812-9d3a-04ba52b06bda] End _get_guest_xml xml=<domain type="kvm">
Aug 26 10:36:53 user nova-compute[73572]:   <uuid>0a8e064c-c6b0-4812-9d3a-04ba52b06bda</uuid>
Aug 26 10:36:53 user nova-compute[73572]:   <name>instance-00000030</name>
Aug 26 10:36:53 user nova-compute[73572]:   <memory>524288</memory>
Aug 26 10:36:53 user nova-compute[73572]:   <vcpu>1</vcpu>
Aug 26 10:36:53 user nova-compute[73572]:   <metadata>
Aug 26 10:36:53 user nova-compute[73572]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 10:36:53 user nova-compute[73572]:       <nova:package version="0.0.0"/>
Aug 26 10:36:53 user nova-compute[73572]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-264759441</nova:name>
Aug 26 10:36:53 user nova-compute[73572]:       <nova:creationTime>2023-08-26 10:36:53</nova:creationTime>
Aug 26 10:36:53 user nova-compute[73572]:       <nova:flavor name="m1.tiny">
Aug 26 10:36:53 user nova-compute[73572]:         <nova:memory>512</nova:memory>
Aug 26 10:36:53 user nova-compute[73572]:         <nova:disk>1</nova:disk>
Aug 26 10:36:53 user nova-compute[73572]:         <nova:swap>0</nova:swap>
Aug 26 10:36:53 user nova-compute[73572]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 10:36:53 user nova-compute[73572]:         <nova:vcpus>1</nova:vcpus>
Aug 26 10:36:53 user nova-compute[73572]:       </nova:flavor>
Aug 26 10:36:53 user nova-compute[73572]:       <nova:owner>
Aug 26 10:36:53 user nova-compute[73572]:         <nova:user uuid="28a22a71368940ab830921214268a1b9">tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member</nova:user>
Aug 26 10:36:53 user nova-compute[73572]:         <nova:project uuid="54e0a0a3c0f64ed7980570750d7754ce">tempest-TestServerVolumeAttachScenarioOldVersion-1514114358</nova:project>
Aug 26 10:36:53 user nova-compute[73572]:       </nova:owner>
Aug 26 10:36:53 user nova-compute[73572]:       <nova:root type="image" uuid="299da0c9-e1c4-48f0-be55-fbe20dd06bc9"/>
Aug 26 10:36:53 user nova-compute[73572]:       <nova:ports>
Aug 26 10:36:53 user nova-compute[73572]:         <nova:port uuid="4a5e5040-9799-4ade-8465-c5ab770d0616">
Aug 26 10:36:53 user nova-compute[73572]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 26 10:36:53 user nova-compute[73572]:         </nova:port>
Aug 26 10:36:53 user nova-compute[73572]:       </nova:ports>
Aug 26 10:36:53 user nova-compute[73572]:     </nova:instance>
Aug 26 10:36:53 user nova-compute[73572]:   </metadata>
Aug 26 10:36:53 user nova-compute[73572]:   <sysinfo type="smbios">
Aug 26 10:36:53 user nova-compute[73572]:     <system>
Aug 26 10:36:53 user nova-compute[73572]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 10:36:53 user nova-compute[73572]:       <entry name="product">OpenStack Nova</entry>
Aug 26 10:36:53 user nova-compute[73572]:       <entry name="version">0.0.0</entry>
Aug 26 10:36:53 user nova-compute[73572]:       <entry name="serial">0a8e064c-c6b0-4812-9d3a-04ba52b06bda</entry>
Aug 26 10:36:53 user nova-compute[73572]:       <entry name="uuid">0a8e064c-c6b0-4812-9d3a-04ba52b06bda</entry>
Aug 26 10:36:53 user nova-compute[73572]:       <entry name="family">Virtual Machine</entry>
Aug 26 10:36:53 user nova-compute[73572]:     </system>
Aug 26 10:36:53 user nova-compute[73572]:   </sysinfo>
Aug 26 10:36:53 user nova-compute[73572]:   <os>
Aug 26 10:36:53 user nova-compute[73572]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 10:36:53 user nova-compute[73572]:     <boot dev="hd"/>
Aug 26 10:36:53 user nova-compute[73572]:     <smbios mode="sysinfo"/>
Aug 26 10:36:53 user nova-compute[73572]:   </os>
Aug 26 10:36:53 user nova-compute[73572]:   <features>
Aug 26 10:36:53 user nova-compute[73572]:     <acpi/>
Aug 26 10:36:53 user nova-compute[73572]:     <apic/>
Aug 26 10:36:53 user nova-compute[73572]:     <vmcoreinfo/>
Aug 26 10:36:53 user nova-compute[73572]:   </features>
Aug 26 10:36:53 user nova-compute[73572]:   <clock offset="utc">
Aug 26 10:36:53 user nova-compute[73572]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 10:36:53 user nova-compute[73572]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 10:36:53 user nova-compute[73572]:     <timer name="hpet" present="no"/>
Aug 26 10:36:53 user nova-compute[73572]:   </clock>
Aug 26 10:36:53 user nova-compute[73572]:   <cpu mode="custom" match="exact">
Aug 26 10:36:53 user nova-compute[73572]:     <model>Nehalem</model>
Aug 26 10:36:53 user nova-compute[73572]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 10:36:53 user nova-compute[73572]:   </cpu>
Aug 26 10:36:53 user nova-compute[73572]:   <devices>
Aug 26 10:36:53 user nova-compute[73572]:     <disk type="file" device="disk">
Aug 26 10:36:53 user nova-compute[73572]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 10:36:53 user nova-compute[73572]:       <source file="/opt/stack/data/nova/instances/0a8e064c-c6b0-4812-9d3a-04ba52b06bda/disk"/>
Aug 26 10:36:53 user nova-compute[73572]:       <target dev="vda" bus="virtio"/>
Aug 26 10:36:53 user nova-compute[73572]:     </disk>
Aug 26 10:36:53 user nova-compute[73572]:     <interface type="ethernet">
Aug 26 10:36:53 user nova-compute[73572]:       <mac address="fa:16:3e:47:ea:be"/>
Aug 26 10:36:53 user nova-compute[73572]:       <model type="virtio"/>
Aug 26 10:36:53 user nova-compute[73572]:       <mtu size="1442"/>
Aug 26 10:36:53 user nova-compute[73572]:       <target dev="tap4a5e5040-97"/>
Aug 26 10:36:53 user nova-compute[73572]:     </interface>
Aug 26 10:36:53 user nova-compute[73572]:     <serial type="pty">
Aug 26 10:36:53 user nova-compute[73572]:       <log file="/opt/stack/data/nova/instances/0a8e064c-c6b0-4812-9d3a-04ba52b06bda/console.log" append="off"/>
Aug 26 10:36:53 user nova-compute[73572]:     </serial>
Aug 26 10:36:53 user nova-compute[73572]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 10:36:53 user nova-compute[73572]:     <video>
Aug 26 10:36:53 user nova-compute[73572]:       <model type="virtio"/>
Aug 26 10:36:53 user nova-compute[73572]:     </video>
Aug 26 10:36:53 user nova-compute[73572]:     <rng model="virtio">
Aug 26 10:36:53 user nova-compute[73572]:       <backend model="random">/dev/urandom</backend>
Aug 26 10:36:53 user nova-compute[73572]:     </rng>
Aug 26 10:36:53 user nova-compute[73572]:     <controller type="usb" index="0" model="none"/>
Aug 26 10:36:53 user nova-compute[73572]:     <memballoon model="virtio">
Aug 26 10:36:53 user nova-compute[73572]:       <stats period="10"/>
Aug 26 10:36:53 user nova-compute[73572]:     </memballoon>
Aug 26 10:36:53 user nova-compute[73572]:   </devices>
Aug 26 10:36:53 user nova-compute[73572]: </domain>
Aug 26 10:36:53 user nova-compute[73572]:  {{(pid=73572) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 10:36:53 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-72b27798-4fbc-4f4e-9a8b-58e1e2345d03 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T10:36:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-264759441',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-264759441',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-2647594',id=48,image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKCW3tbmJ/DCwB0Pz3ExNny9URVuz0fsycd79/95q7dLMdFXtVKOtp3SMJeRCHXmVhNqz5c7OWWeDamUjtcucCK5cjeYo56gvos7qH58v+ONOUJa+Pjd3wtU3Muah31kPg==',key_name='tempest-keypair-682558480',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='54e0a0a3c0f64ed7980570750d7754ce',ramdisk_id='',reservation_id='r-4jposz0c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1514114358',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T10:36:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='28a22a71368940ab830921214268a1b9',uuid=0a8e064c-c6b0-4812-9d3a-04ba52b06bda,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4a5e5040-9799-4ade-8465-c5ab770d0616", "address": "fa:16:3e:47:ea:be", "network": {"id": "21dd7d4e-3fb2-44d6-99d0-973f9eb5d456", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-222837576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54e0a0a3c0f64ed7980570750d7754ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a5e5040-97", "ovs_interfaceid": "4a5e5040-9799-4ade-8465-c5ab770d0616", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 10:36:53 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-72b27798-4fbc-4f4e-9a8b-58e1e2345d03 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member] Converting VIF {"id": "4a5e5040-9799-4ade-8465-c5ab770d0616", "address": "fa:16:3e:47:ea:be", "network": {"id": "21dd7d4e-3fb2-44d6-99d0-973f9eb5d456", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-222837576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54e0a0a3c0f64ed7980570750d7754ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a5e5040-97", "ovs_interfaceid": "4a5e5040-9799-4ade-8465-c5ab770d0616", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:36:53 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-72b27798-4fbc-4f4e-9a8b-58e1e2345d03 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:ea:be,bridge_name='br-int',has_traffic_filtering=True,id=4a5e5040-9799-4ade-8465-c5ab770d0616,network=Network(21dd7d4e-3fb2-44d6-99d0-973f9eb5d456),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a5e5040-97') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:36:53 user nova-compute[73572]: DEBUG os_vif [None req-72b27798-4fbc-4f4e-9a8b-58e1e2345d03 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:ea:be,bridge_name='br-int',has_traffic_filtering=True,id=4a5e5040-9799-4ade-8465-c5ab770d0616,network=Network(21dd7d4e-3fb2-44d6-99d0-973f9eb5d456),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a5e5040-97') {{(pid=73572) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 10:36:53 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:36:53 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:36:53 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 10:36:53 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:36:53 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4a5e5040-97, may_exist=True, interface_attrs={}) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:36:53 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4a5e5040-97, col_values=(('external_ids', {'iface-id': '4a5e5040-9799-4ade-8465-c5ab770d0616', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:47:ea:be', 'vm-uuid': '0a8e064c-c6b0-4812-9d3a-04ba52b06bda'}),), if_exists=True) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:36:53 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:36:53 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:36:53 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:36:53 user nova-compute[73572]: INFO os_vif [None req-72b27798-4fbc-4f4e-9a8b-58e1e2345d03 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:ea:be,bridge_name='br-int',has_traffic_filtering=True,id=4a5e5040-9799-4ade-8465-c5ab770d0616,network=Network(21dd7d4e-3fb2-44d6-99d0-973f9eb5d456),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a5e5040-97')
Aug 26 10:36:53 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-72b27798-4fbc-4f4e-9a8b-58e1e2345d03 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member] No BDM found with device name vda, not building metadata. {{(pid=73572) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 10:36:53 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-72b27798-4fbc-4f4e-9a8b-58e1e2345d03 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member] No VIF found with MAC fa:16:3e:47:ea:be, not building metadata {{(pid=73572) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 10:36:53 user nova-compute[73572]: DEBUG nova.network.neutron [req-f9ccba8c-9355-4398-87fa-ead40d7277bb req-e5a6e29e-598e-4222-9da4-45792d728442 service nova] [instance: 0a8e064c-c6b0-4812-9d3a-04ba52b06bda] Updated VIF entry in instance network info cache for port 4a5e5040-9799-4ade-8465-c5ab770d0616. {{(pid=73572) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 10:36:53 user nova-compute[73572]: DEBUG nova.network.neutron [req-f9ccba8c-9355-4398-87fa-ead40d7277bb req-e5a6e29e-598e-4222-9da4-45792d728442 service nova] [instance: 0a8e064c-c6b0-4812-9d3a-04ba52b06bda] Updating instance_info_cache with network_info: [{"id": "4a5e5040-9799-4ade-8465-c5ab770d0616", "address": "fa:16:3e:47:ea:be", "network": {"id": "21dd7d4e-3fb2-44d6-99d0-973f9eb5d456", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-222837576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54e0a0a3c0f64ed7980570750d7754ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a5e5040-97", "ovs_interfaceid": "4a5e5040-9799-4ade-8465-c5ab770d0616", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:36:53 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-f9ccba8c-9355-4398-87fa-ead40d7277bb req-e5a6e29e-598e-4222-9da4-45792d728442 service nova] Releasing lock "refresh_cache-0a8e064c-c6b0-4812-9d3a-04ba52b06bda" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:36:54 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:36:54 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:36:54 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:36:55 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-42f92959-e897-4278-ae24-44a21eb007b2 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Acquiring lock "d147974d-213d-4aa3-8d03-11b262f59dca" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:36:55 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-42f92959-e897-4278-ae24-44a21eb007b2 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Lock "d147974d-213d-4aa3-8d03-11b262f59dca" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:36:55 user nova-compute[73572]: INFO nova.compute.manager [None req-42f92959-e897-4278-ae24-44a21eb007b2 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] [instance: d147974d-213d-4aa3-8d03-11b262f59dca] Unshelving
Aug 26 10:36:55 user nova-compute[73572]: DEBUG nova.compute.manager [req-867bf448-fccf-4352-bb93-b92a69341aac req-26b37984-7a25-45bf-9114-bef3f8d206b7 service nova] [instance: 0a8e064c-c6b0-4812-9d3a-04ba52b06bda] Received event network-vif-plugged-4a5e5040-9799-4ade-8465-c5ab770d0616 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:36:55 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-867bf448-fccf-4352-bb93-b92a69341aac req-26b37984-7a25-45bf-9114-bef3f8d206b7 service nova] Acquiring lock "0a8e064c-c6b0-4812-9d3a-04ba52b06bda-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:36:55 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-867bf448-fccf-4352-bb93-b92a69341aac req-26b37984-7a25-45bf-9114-bef3f8d206b7 service nova] Lock "0a8e064c-c6b0-4812-9d3a-04ba52b06bda-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:36:55 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-867bf448-fccf-4352-bb93-b92a69341aac req-26b37984-7a25-45bf-9114-bef3f8d206b7 service nova] Lock "0a8e064c-c6b0-4812-9d3a-04ba52b06bda-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:36:55 user nova-compute[73572]: DEBUG nova.compute.manager [req-867bf448-fccf-4352-bb93-b92a69341aac req-26b37984-7a25-45bf-9114-bef3f8d206b7 service nova] [instance: 0a8e064c-c6b0-4812-9d3a-04ba52b06bda] No waiting events found dispatching network-vif-plugged-4a5e5040-9799-4ade-8465-c5ab770d0616 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:36:55 user nova-compute[73572]: WARNING nova.compute.manager [req-867bf448-fccf-4352-bb93-b92a69341aac req-26b37984-7a25-45bf-9114-bef3f8d206b7 service nova] [instance: 0a8e064c-c6b0-4812-9d3a-04ba52b06bda] Received unexpected event network-vif-plugged-4a5e5040-9799-4ade-8465-c5ab770d0616 for instance with vm_state building and task_state spawning.
Aug 26 10:36:55 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-42f92959-e897-4278-ae24-44a21eb007b2 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:36:55 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-42f92959-e897-4278-ae24-44a21eb007b2 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:36:55 user nova-compute[73572]: DEBUG nova.objects.instance [None req-42f92959-e897-4278-ae24-44a21eb007b2 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Lazy-loading 'pci_requests' on Instance uuid d147974d-213d-4aa3-8d03-11b262f59dca {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:36:55 user nova-compute[73572]: DEBUG nova.objects.instance [None req-42f92959-e897-4278-ae24-44a21eb007b2 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Lazy-loading 'numa_topology' on Instance uuid d147974d-213d-4aa3-8d03-11b262f59dca {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:36:55 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-42f92959-e897-4278-ae24-44a21eb007b2 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73572) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 10:36:55 user nova-compute[73572]: INFO nova.compute.claims [None req-42f92959-e897-4278-ae24-44a21eb007b2 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] [instance: d147974d-213d-4aa3-8d03-11b262f59dca] Claim successful on node user
Aug 26 10:36:55 user nova-compute[73572]: DEBUG nova.compute.provider_tree [None req-42f92959-e897-4278-ae24-44a21eb007b2 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Inventory has not changed in ProviderTree for provider: e2cec974-59b2-4c77-a53d-a7f4e5a30d75 {{(pid=73572) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 10:36:55 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-42f92959-e897-4278-ae24-44a21eb007b2 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Inventory has not changed for provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73572) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 10:36:55 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-42f92959-e897-4278-ae24-44a21eb007b2 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.348s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:36:55 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:36:55 user nova-compute[73572]: INFO nova.network.neutron [None req-42f92959-e897-4278-ae24-44a21eb007b2 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] [instance: d147974d-213d-4aa3-8d03-11b262f59dca] Updating port 8d51de2d-85b6-4a2f-80db-5fe69b8fd11b with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 26 10:36:55 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:36:56 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-42f92959-e897-4278-ae24-44a21eb007b2 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Acquiring lock "refresh_cache-d147974d-213d-4aa3-8d03-11b262f59dca" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:36:56 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-42f92959-e897-4278-ae24-44a21eb007b2 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Acquired lock "refresh_cache-d147974d-213d-4aa3-8d03-11b262f59dca" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:36:56 user nova-compute[73572]: DEBUG nova.network.neutron [None req-42f92959-e897-4278-ae24-44a21eb007b2 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] [instance: d147974d-213d-4aa3-8d03-11b262f59dca] Building network info cache for instance {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 10:36:56 user nova-compute[73572]: DEBUG nova.compute.manager [req-01f7266c-3784-44f9-9158-b4ed9e96d3f9 req-41e28022-0e85-4a9c-a7e8-2c8b1549236b service nova] [instance: d147974d-213d-4aa3-8d03-11b262f59dca] Received event network-changed-8d51de2d-85b6-4a2f-80db-5fe69b8fd11b {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:36:56 user nova-compute[73572]: DEBUG nova.compute.manager [req-01f7266c-3784-44f9-9158-b4ed9e96d3f9 req-41e28022-0e85-4a9c-a7e8-2c8b1549236b service nova] [instance: d147974d-213d-4aa3-8d03-11b262f59dca] Refreshing instance network info cache due to event network-changed-8d51de2d-85b6-4a2f-80db-5fe69b8fd11b. {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 10:36:56 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-01f7266c-3784-44f9-9158-b4ed9e96d3f9 req-41e28022-0e85-4a9c-a7e8-2c8b1549236b service nova] Acquiring lock "refresh_cache-d147974d-213d-4aa3-8d03-11b262f59dca" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:36:57 user nova-compute[73572]: DEBUG nova.network.neutron [None req-42f92959-e897-4278-ae24-44a21eb007b2 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] [instance: d147974d-213d-4aa3-8d03-11b262f59dca] Updating instance_info_cache with network_info: [{"id": "8d51de2d-85b6-4a2f-80db-5fe69b8fd11b", "address": "fa:16:3e:e5:90:35", "network": {"id": "317d2681-96ce-4898-b6fb-8892ee6f706d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2049963835-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7e16843614c451d958e817c832d4cbc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d51de2d-85", "ovs_interfaceid": "8d51de2d-85b6-4a2f-80db-5fe69b8fd11b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:36:57 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-42f92959-e897-4278-ae24-44a21eb007b2 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Releasing lock "refresh_cache-d147974d-213d-4aa3-8d03-11b262f59dca" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:36:57 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-42f92959-e897-4278-ae24-44a21eb007b2 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] [instance: d147974d-213d-4aa3-8d03-11b262f59dca] Creating instance directory {{(pid=73572) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 10:36:57 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-42f92959-e897-4278-ae24-44a21eb007b2 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] [instance: d147974d-213d-4aa3-8d03-11b262f59dca] Creating image(s)
Aug 26 10:36:57 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-42f92959-e897-4278-ae24-44a21eb007b2 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Acquiring lock "/opt/stack/data/nova/instances/d147974d-213d-4aa3-8d03-11b262f59dca/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:36:57 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-42f92959-e897-4278-ae24-44a21eb007b2 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Lock "/opt/stack/data/nova/instances/d147974d-213d-4aa3-8d03-11b262f59dca/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:36:57 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-42f92959-e897-4278-ae24-44a21eb007b2 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Lock "/opt/stack/data/nova/instances/d147974d-213d-4aa3-8d03-11b262f59dca/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:36:57 user nova-compute[73572]: DEBUG nova.objects.instance [None req-42f92959-e897-4278-ae24-44a21eb007b2 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Lazy-loading 'trusted_certs' on Instance uuid d147974d-213d-4aa3-8d03-11b262f59dca {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:36:57 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-01f7266c-3784-44f9-9158-b4ed9e96d3f9 req-41e28022-0e85-4a9c-a7e8-2c8b1549236b service nova] Acquired lock "refresh_cache-d147974d-213d-4aa3-8d03-11b262f59dca" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:36:57 user nova-compute[73572]: DEBUG nova.network.neutron [req-01f7266c-3784-44f9-9158-b4ed9e96d3f9 req-41e28022-0e85-4a9c-a7e8-2c8b1549236b service nova] [instance: d147974d-213d-4aa3-8d03-11b262f59dca] Refreshing network info cache for port 8d51de2d-85b6-4a2f-80db-5fe69b8fd11b {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 10:36:57 user nova-compute[73572]: DEBUG nova.objects.base [None req-42f92959-e897-4278-ae24-44a21eb007b2 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Object Instance<d147974d-213d-4aa3-8d03-11b262f59dca> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=73572) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 10:36:57 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-42f92959-e897-4278-ae24-44a21eb007b2 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Acquiring lock "b7f12b3ebd3b1f7c2c0a0b6854287900df597183" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:36:57 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-42f92959-e897-4278-ae24-44a21eb007b2 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Lock "b7f12b3ebd3b1f7c2c0a0b6854287900df597183" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:36:58 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-42f92959-e897-4278-ae24-44a21eb007b2 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7f12b3ebd3b1f7c2c0a0b6854287900df597183.part --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:36:58 user nova-compute[73572]: DEBUG nova.virt.driver [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Emitting event <LifecycleEvent: 1693046217.2004633, 0a8e064c-c6b0-4812-9d3a-04ba52b06bda => Resumed> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:36:58 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 0a8e064c-c6b0-4812-9d3a-04ba52b06bda] VM Resumed (Lifecycle Event)
Aug 26 10:36:58 user nova-compute[73572]: DEBUG nova.compute.manager [req-1ef4f529-b96d-47d1-8948-8fdd5bf528bd req-358e2437-3294-44e2-a472-f711a3b951b0 service nova] [instance: 0a8e064c-c6b0-4812-9d3a-04ba52b06bda] Received event network-vif-plugged-4a5e5040-9799-4ade-8465-c5ab770d0616 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:36:58 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-1ef4f529-b96d-47d1-8948-8fdd5bf528bd req-358e2437-3294-44e2-a472-f711a3b951b0 service nova] Acquiring lock "0a8e064c-c6b0-4812-9d3a-04ba52b06bda-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:36:58 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-1ef4f529-b96d-47d1-8948-8fdd5bf528bd req-358e2437-3294-44e2-a472-f711a3b951b0 service nova] Lock "0a8e064c-c6b0-4812-9d3a-04ba52b06bda-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:36:58 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-1ef4f529-b96d-47d1-8948-8fdd5bf528bd req-358e2437-3294-44e2-a472-f711a3b951b0 service nova] Lock "0a8e064c-c6b0-4812-9d3a-04ba52b06bda-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:36:58 user nova-compute[73572]: DEBUG nova.compute.manager [req-1ef4f529-b96d-47d1-8948-8fdd5bf528bd req-358e2437-3294-44e2-a472-f711a3b951b0 service nova] [instance: 0a8e064c-c6b0-4812-9d3a-04ba52b06bda] No waiting events found dispatching network-vif-plugged-4a5e5040-9799-4ade-8465-c5ab770d0616 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:36:58 user nova-compute[73572]: WARNING nova.compute.manager [req-1ef4f529-b96d-47d1-8948-8fdd5bf528bd req-358e2437-3294-44e2-a472-f711a3b951b0 service nova] [instance: 0a8e064c-c6b0-4812-9d3a-04ba52b06bda] Received unexpected event network-vif-plugged-4a5e5040-9799-4ade-8465-c5ab770d0616 for instance with vm_state building and task_state spawning.
Aug 26 10:36:58 user nova-compute[73572]: DEBUG nova.compute.manager [None req-72b27798-4fbc-4f4e-9a8b-58e1e2345d03 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member] [instance: 0a8e064c-c6b0-4812-9d3a-04ba52b06bda] Instance event wait completed in 0 seconds for  {{(pid=73572) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 10:36:58 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-72b27798-4fbc-4f4e-9a8b-58e1e2345d03 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member] [instance: 0a8e064c-c6b0-4812-9d3a-04ba52b06bda] Guest created on hypervisor {{(pid=73572) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 10:36:58 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 0a8e064c-c6b0-4812-9d3a-04ba52b06bda] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:36:58 user nova-compute[73572]: INFO nova.virt.libvirt.driver [-] [instance: 0a8e064c-c6b0-4812-9d3a-04ba52b06bda] Instance spawned successfully.
Aug 26 10:36:58 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-72b27798-4fbc-4f4e-9a8b-58e1e2345d03 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member] [instance: 0a8e064c-c6b0-4812-9d3a-04ba52b06bda] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 10:36:58 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 0a8e064c-c6b0-4812-9d3a-04ba52b06bda] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73572) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 10:36:58 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-72b27798-4fbc-4f4e-9a8b-58e1e2345d03 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member] [instance: 0a8e064c-c6b0-4812-9d3a-04ba52b06bda] Found default for hw_cdrom_bus of ide {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:36:58 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-72b27798-4fbc-4f4e-9a8b-58e1e2345d03 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member] [instance: 0a8e064c-c6b0-4812-9d3a-04ba52b06bda] Found default for hw_disk_bus of virtio {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:36:58 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-72b27798-4fbc-4f4e-9a8b-58e1e2345d03 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member] [instance: 0a8e064c-c6b0-4812-9d3a-04ba52b06bda] Found default for hw_input_bus of None {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:36:58 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-72b27798-4fbc-4f4e-9a8b-58e1e2345d03 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member] [instance: 0a8e064c-c6b0-4812-9d3a-04ba52b06bda] Found default for hw_pointer_model of None {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:36:58 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-72b27798-4fbc-4f4e-9a8b-58e1e2345d03 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member] [instance: 0a8e064c-c6b0-4812-9d3a-04ba52b06bda] Found default for hw_video_model of virtio {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:36:58 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-72b27798-4fbc-4f4e-9a8b-58e1e2345d03 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member] [instance: 0a8e064c-c6b0-4812-9d3a-04ba52b06bda] Found default for hw_vif_model of virtio {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:36:58 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 0a8e064c-c6b0-4812-9d3a-04ba52b06bda] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 10:36:58 user nova-compute[73572]: DEBUG nova.virt.driver [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Emitting event <LifecycleEvent: 1693046217.2007751, 0a8e064c-c6b0-4812-9d3a-04ba52b06bda => Started> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:36:58 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 0a8e064c-c6b0-4812-9d3a-04ba52b06bda] VM Started (Lifecycle Event)
Aug 26 10:36:58 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 0a8e064c-c6b0-4812-9d3a-04ba52b06bda] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:36:58 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 0a8e064c-c6b0-4812-9d3a-04ba52b06bda] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73572) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 10:36:58 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 0a8e064c-c6b0-4812-9d3a-04ba52b06bda] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 10:36:58 user nova-compute[73572]: INFO nova.compute.manager [None req-72b27798-4fbc-4f4e-9a8b-58e1e2345d03 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member] [instance: 0a8e064c-c6b0-4812-9d3a-04ba52b06bda] Took 7.00 seconds to spawn the instance on the hypervisor.
Aug 26 10:36:58 user nova-compute[73572]: DEBUG nova.compute.manager [None req-72b27798-4fbc-4f4e-9a8b-58e1e2345d03 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member] [instance: 0a8e064c-c6b0-4812-9d3a-04ba52b06bda] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:36:58 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-42f92959-e897-4278-ae24-44a21eb007b2 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7f12b3ebd3b1f7c2c0a0b6854287900df597183.part --force-share --output=json" returned: 0 in 0.194s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:36:58 user nova-compute[73572]: DEBUG nova.virt.images [None req-42f92959-e897-4278-ae24-44a21eb007b2 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] 30629c2c-3606-4f8d-beb8-01f7e6597977 was qcow2, converting to raw {{(pid=73572) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 26 10:36:58 user nova-compute[73572]: DEBUG nova.privsep.utils [None req-42f92959-e897-4278-ae24-44a21eb007b2 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73572) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 26 10:36:58 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-42f92959-e897-4278-ae24-44a21eb007b2 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b7f12b3ebd3b1f7c2c0a0b6854287900df597183.part /opt/stack/data/nova/instances/_base/b7f12b3ebd3b1f7c2c0a0b6854287900df597183.converted {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:36:58 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:36:58 user nova-compute[73572]: INFO nova.compute.manager [None req-72b27798-4fbc-4f4e-9a8b-58e1e2345d03 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member] [instance: 0a8e064c-c6b0-4812-9d3a-04ba52b06bda] Took 7.77 seconds to build instance.
Aug 26 10:36:58 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-72b27798-4fbc-4f4e-9a8b-58e1e2345d03 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member] Lock "0a8e064c-c6b0-4812-9d3a-04ba52b06bda" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.896s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:36:58 user nova-compute[73572]: DEBUG nova.network.neutron [req-01f7266c-3784-44f9-9158-b4ed9e96d3f9 req-41e28022-0e85-4a9c-a7e8-2c8b1549236b service nova] [instance: d147974d-213d-4aa3-8d03-11b262f59dca] Updated VIF entry in instance network info cache for port 8d51de2d-85b6-4a2f-80db-5fe69b8fd11b. {{(pid=73572) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 10:36:58 user nova-compute[73572]: DEBUG nova.network.neutron [req-01f7266c-3784-44f9-9158-b4ed9e96d3f9 req-41e28022-0e85-4a9c-a7e8-2c8b1549236b service nova] [instance: d147974d-213d-4aa3-8d03-11b262f59dca] Updating instance_info_cache with network_info: [{"id": "8d51de2d-85b6-4a2f-80db-5fe69b8fd11b", "address": "fa:16:3e:e5:90:35", "network": {"id": "317d2681-96ce-4898-b6fb-8892ee6f706d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2049963835-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7e16843614c451d958e817c832d4cbc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d51de2d-85", "ovs_interfaceid": "8d51de2d-85b6-4a2f-80db-5fe69b8fd11b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:36:58 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-01f7266c-3784-44f9-9158-b4ed9e96d3f9 req-41e28022-0e85-4a9c-a7e8-2c8b1549236b service nova] Releasing lock "refresh_cache-d147974d-213d-4aa3-8d03-11b262f59dca" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:36:59 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-42f92959-e897-4278-ae24-44a21eb007b2 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b7f12b3ebd3b1f7c2c0a0b6854287900df597183.part /opt/stack/data/nova/instances/_base/b7f12b3ebd3b1f7c2c0a0b6854287900df597183.converted" returned: 0 in 0.685s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:36:59 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-42f92959-e897-4278-ae24-44a21eb007b2 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7f12b3ebd3b1f7c2c0a0b6854287900df597183.converted --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:36:59 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-42f92959-e897-4278-ae24-44a21eb007b2 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7f12b3ebd3b1f7c2c0a0b6854287900df597183.converted --force-share --output=json" returned: 0 in 0.197s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:36:59 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-42f92959-e897-4278-ae24-44a21eb007b2 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Lock "b7f12b3ebd3b1f7c2c0a0b6854287900df597183" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.269s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:36:59 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-42f92959-e897-4278-ae24-44a21eb007b2 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7f12b3ebd3b1f7c2c0a0b6854287900df597183 --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:36:59 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-42f92959-e897-4278-ae24-44a21eb007b2 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7f12b3ebd3b1f7c2c0a0b6854287900df597183 --force-share --output=json" returned: 0 in 0.180s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:36:59 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-42f92959-e897-4278-ae24-44a21eb007b2 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Acquiring lock "b7f12b3ebd3b1f7c2c0a0b6854287900df597183" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:36:59 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-42f92959-e897-4278-ae24-44a21eb007b2 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Lock "b7f12b3ebd3b1f7c2c0a0b6854287900df597183" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:36:59 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-42f92959-e897-4278-ae24-44a21eb007b2 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7f12b3ebd3b1f7c2c0a0b6854287900df597183 --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:36:59 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-42f92959-e897-4278-ae24-44a21eb007b2 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7f12b3ebd3b1f7c2c0a0b6854287900df597183 --force-share --output=json" returned: 0 in 0.183s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:36:59 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-42f92959-e897-4278-ae24-44a21eb007b2 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b7f12b3ebd3b1f7c2c0a0b6854287900df597183,backing_fmt=raw /opt/stack/data/nova/instances/d147974d-213d-4aa3-8d03-11b262f59dca/disk 1073741824 {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:36:59 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-42f92959-e897-4278-ae24-44a21eb007b2 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b7f12b3ebd3b1f7c2c0a0b6854287900df597183,backing_fmt=raw /opt/stack/data/nova/instances/d147974d-213d-4aa3-8d03-11b262f59dca/disk 1073741824" returned: 0 in 0.050s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:36:59 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-42f92959-e897-4278-ae24-44a21eb007b2 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Lock "b7f12b3ebd3b1f7c2c0a0b6854287900df597183" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.240s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:36:59 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-42f92959-e897-4278-ae24-44a21eb007b2 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7f12b3ebd3b1f7c2c0a0b6854287900df597183 --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:36:59 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-42f92959-e897-4278-ae24-44a21eb007b2 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7f12b3ebd3b1f7c2c0a0b6854287900df597183 --force-share --output=json" returned: 0 in 0.191s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:36:59 user nova-compute[73572]: DEBUG nova.objects.instance [None req-42f92959-e897-4278-ae24-44a21eb007b2 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Lazy-loading 'migration_context' on Instance uuid d147974d-213d-4aa3-8d03-11b262f59dca {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:37:00 user nova-compute[73572]: DEBUG nova.objects.base [None req-42f92959-e897-4278-ae24-44a21eb007b2 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Object Instance<d147974d-213d-4aa3-8d03-11b262f59dca> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=73572) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 10:37:00 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-42f92959-e897-4278-ae24-44a21eb007b2 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] [instance: d147974d-213d-4aa3-8d03-11b262f59dca] Rebasing disk image.
Aug 26 10:37:00 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-42f92959-e897-4278-ae24-44a21eb007b2 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:37:00 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-42f92959-e897-4278-ae24-44a21eb007b2 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json" returned: 0 in 0.223s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:37:00 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-42f92959-e897-4278-ae24-44a21eb007b2 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 -F raw /opt/stack/data/nova/instances/d147974d-213d-4aa3-8d03-11b262f59dca/disk {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:37:00 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:37:02 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-42f92959-e897-4278-ae24-44a21eb007b2 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 -F raw /opt/stack/data/nova/instances/d147974d-213d-4aa3-8d03-11b262f59dca/disk" returned: 0 in 2.517s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:37:02 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-42f92959-e897-4278-ae24-44a21eb007b2 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] [instance: d147974d-213d-4aa3-8d03-11b262f59dca] Created local disks {{(pid=73572) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 10:37:02 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-42f92959-e897-4278-ae24-44a21eb007b2 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] [instance: d147974d-213d-4aa3-8d03-11b262f59dca] Ensure instance console log exists: /opt/stack/data/nova/instances/d147974d-213d-4aa3-8d03-11b262f59dca/console.log {{(pid=73572) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 10:37:02 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-42f92959-e897-4278-ae24-44a21eb007b2 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:37:02 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-42f92959-e897-4278-ae24-44a21eb007b2 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:37:02 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-42f92959-e897-4278-ae24-44a21eb007b2 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:37:02 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-42f92959-e897-4278-ae24-44a21eb007b2 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] [instance: d147974d-213d-4aa3-8d03-11b262f59dca] Start _get_guest_xml network_info=[{"id": "8d51de2d-85b6-4a2f-80db-5fe69b8fd11b", "address": "fa:16:3e:e5:90:35", "network": {"id": "317d2681-96ce-4898-b6fb-8892ee6f706d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2049963835-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7e16843614c451d958e817c832d4cbc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d51de2d-85", "ovs_interfaceid": "8d51de2d-85b6-4a2f-80db-5fe69b8fd11b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='696d1d8e7eeb0dd4d4c0e15939cd43c7',container_format='bare',created_at=2023-08-26T10:35:01Z,direct_url=<?>,disk_format='qcow2',id=30629c2c-3606-4f8d-beb8-01f7e6597977,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1735038851-shelved',owner='c7e16843614c451d958e817c832d4cbc',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-26T10:35:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'guest_format': None, 'size': 0, 'encryption_format': None, 'device_type': 'disk', 'image_id': '299da0c9-e1c4-48f0-be55-fbe20dd06bc9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73572) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 10:37:02 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-42f92959-e897-4278-ae24-44a21eb007b2 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:37:02 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-42f92959-e897-4278-ae24-44a21eb007b2 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:37:02 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-42f92959-e897-4278-ae24-44a21eb007b2 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73572) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 10:37:02 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-42f92959-e897-4278-ae24-44a21eb007b2 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] CPU controller missing on host. {{(pid=73572) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 10:37:02 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-42f92959-e897-4278-ae24-44a21eb007b2 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73572) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 10:37:02 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-42f92959-e897-4278-ae24-44a21eb007b2 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] CPU controller found on host. {{(pid=73572) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 10:37:02 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-42f92959-e897-4278-ae24-44a21eb007b2 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73572) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 10:37:02 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-42f92959-e897-4278-ae24-44a21eb007b2 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T10:07:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='696d1d8e7eeb0dd4d4c0e15939cd43c7',container_format='bare',created_at=2023-08-26T10:35:01Z,direct_url=<?>,disk_format='qcow2',id=30629c2c-3606-4f8d-beb8-01f7e6597977,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1735038851-shelved',owner='c7e16843614c451d958e817c832d4cbc',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-26T10:35:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 10:37:02 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-42f92959-e897-4278-ae24-44a21eb007b2 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Flavor limits 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 10:37:02 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-42f92959-e897-4278-ae24-44a21eb007b2 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Image limits 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 10:37:02 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-42f92959-e897-4278-ae24-44a21eb007b2 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Flavor pref 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 10:37:02 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-42f92959-e897-4278-ae24-44a21eb007b2 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Image pref 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 10:37:02 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-42f92959-e897-4278-ae24-44a21eb007b2 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 10:37:02 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-42f92959-e897-4278-ae24-44a21eb007b2 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 10:37:02 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-42f92959-e897-4278-ae24-44a21eb007b2 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73572) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 10:37:02 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-42f92959-e897-4278-ae24-44a21eb007b2 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Got 1 possible topologies {{(pid=73572) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 10:37:02 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-42f92959-e897-4278-ae24-44a21eb007b2 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 10:37:02 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-42f92959-e897-4278-ae24-44a21eb007b2 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 10:37:02 user nova-compute[73572]: DEBUG nova.objects.instance [None req-42f92959-e897-4278-ae24-44a21eb007b2 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Lazy-loading 'vcpu_model' on Instance uuid d147974d-213d-4aa3-8d03-11b262f59dca {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:37:02 user nova-compute[73572]: DEBUG nova.objects.base [None req-42f92959-e897-4278-ae24-44a21eb007b2 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Object Instance<d147974d-213d-4aa3-8d03-11b262f59dca> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=73572) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 10:37:02 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-42f92959-e897-4278-ae24-44a21eb007b2 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-26T10:33:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1735038851',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1735038851',id=46,image_ref='30629c2c-3606-4f8d-beb8-01f7e6597977',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1853117673',keypairs=<?>,launch_index=0,launched_at=2023-08-26T10:33:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='c7e16843614c451d958e817c832d4cbc',ramdisk_id='',reservation_id='r-l9pvelsd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-706965180',owner_user_name='tempest-AttachVolumeShelveTestJSON-706965180-project-member',shelved_at='2023-08-26T10:35:06.774972',shelved_host='user',shelved_image_id='30629c2c-3606-4f8d-beb8-01f7e6597977'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T10:36:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='17243251fe57431c9c98195a16239c5f',uuid=d147974d-213d-4aa3-8d03-11b262f59dca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "8d51de2d-85b6-4a2f-80db-5fe69b8fd11b", "address": "fa:16:3e:e5:90:35", "network": {"id": "317d2681-96ce-4898-b6fb-8892ee6f706d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2049963835-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7e16843614c451d958e817c832d4cbc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d51de2d-85", "ovs_interfaceid": "8d51de2d-85b6-4a2f-80db-5fe69b8fd11b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73572) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 10:37:02 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-42f92959-e897-4278-ae24-44a21eb007b2 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Converting VIF {"id": "8d51de2d-85b6-4a2f-80db-5fe69b8fd11b", "address": "fa:16:3e:e5:90:35", "network": {"id": "317d2681-96ce-4898-b6fb-8892ee6f706d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2049963835-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7e16843614c451d958e817c832d4cbc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d51de2d-85", "ovs_interfaceid": "8d51de2d-85b6-4a2f-80db-5fe69b8fd11b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:37:02 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-42f92959-e897-4278-ae24-44a21eb007b2 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:90:35,bridge_name='br-int',has_traffic_filtering=True,id=8d51de2d-85b6-4a2f-80db-5fe69b8fd11b,network=Network(317d2681-96ce-4898-b6fb-8892ee6f706d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d51de2d-85') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:37:02 user nova-compute[73572]: DEBUG nova.objects.instance [None req-42f92959-e897-4278-ae24-44a21eb007b2 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Lazy-loading 'pci_devices' on Instance uuid d147974d-213d-4aa3-8d03-11b262f59dca {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:37:02 user nova-compute[73572]: DEBUG nova.objects.base [None req-42f92959-e897-4278-ae24-44a21eb007b2 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Object Instance<d147974d-213d-4aa3-8d03-11b262f59dca> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=73572) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 10:37:02 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-42f92959-e897-4278-ae24-44a21eb007b2 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] [instance: d147974d-213d-4aa3-8d03-11b262f59dca] End _get_guest_xml xml=<domain type="kvm">
Aug 26 10:37:02 user nova-compute[73572]:   <uuid>d147974d-213d-4aa3-8d03-11b262f59dca</uuid>
Aug 26 10:37:02 user nova-compute[73572]:   <name>instance-0000002e</name>
Aug 26 10:37:02 user nova-compute[73572]:   <memory>524288</memory>
Aug 26 10:37:02 user nova-compute[73572]:   <vcpu>1</vcpu>
Aug 26 10:37:02 user nova-compute[73572]:   <metadata>
Aug 26 10:37:02 user nova-compute[73572]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 10:37:02 user nova-compute[73572]:       <nova:package version="0.0.0"/>
Aug 26 10:37:02 user nova-compute[73572]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1735038851</nova:name>
Aug 26 10:37:02 user nova-compute[73572]:       <nova:creationTime>2023-08-26 10:37:02</nova:creationTime>
Aug 26 10:37:02 user nova-compute[73572]:       <nova:flavor name="m1.tiny">
Aug 26 10:37:02 user nova-compute[73572]:         <nova:memory>512</nova:memory>
Aug 26 10:37:02 user nova-compute[73572]:         <nova:disk>1</nova:disk>
Aug 26 10:37:02 user nova-compute[73572]:         <nova:swap>0</nova:swap>
Aug 26 10:37:02 user nova-compute[73572]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 10:37:02 user nova-compute[73572]:         <nova:vcpus>1</nova:vcpus>
Aug 26 10:37:02 user nova-compute[73572]:       </nova:flavor>
Aug 26 10:37:02 user nova-compute[73572]:       <nova:owner>
Aug 26 10:37:02 user nova-compute[73572]:         <nova:user uuid="17243251fe57431c9c98195a16239c5f">tempest-AttachVolumeShelveTestJSON-706965180-project-member</nova:user>
Aug 26 10:37:02 user nova-compute[73572]:         <nova:project uuid="c7e16843614c451d958e817c832d4cbc">tempest-AttachVolumeShelveTestJSON-706965180</nova:project>
Aug 26 10:37:02 user nova-compute[73572]:       </nova:owner>
Aug 26 10:37:02 user nova-compute[73572]:       <nova:root type="image" uuid="30629c2c-3606-4f8d-beb8-01f7e6597977"/>
Aug 26 10:37:02 user nova-compute[73572]:       <nova:ports>
Aug 26 10:37:02 user nova-compute[73572]:         <nova:port uuid="8d51de2d-85b6-4a2f-80db-5fe69b8fd11b">
Aug 26 10:37:02 user nova-compute[73572]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 26 10:37:02 user nova-compute[73572]:         </nova:port>
Aug 26 10:37:02 user nova-compute[73572]:       </nova:ports>
Aug 26 10:37:02 user nova-compute[73572]:     </nova:instance>
Aug 26 10:37:02 user nova-compute[73572]:   </metadata>
Aug 26 10:37:02 user nova-compute[73572]:   <sysinfo type="smbios">
Aug 26 10:37:02 user nova-compute[73572]:     <system>
Aug 26 10:37:02 user nova-compute[73572]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 10:37:02 user nova-compute[73572]:       <entry name="product">OpenStack Nova</entry>
Aug 26 10:37:02 user nova-compute[73572]:       <entry name="version">0.0.0</entry>
Aug 26 10:37:02 user nova-compute[73572]:       <entry name="serial">d147974d-213d-4aa3-8d03-11b262f59dca</entry>
Aug 26 10:37:02 user nova-compute[73572]:       <entry name="uuid">d147974d-213d-4aa3-8d03-11b262f59dca</entry>
Aug 26 10:37:02 user nova-compute[73572]:       <entry name="family">Virtual Machine</entry>
Aug 26 10:37:02 user nova-compute[73572]:     </system>
Aug 26 10:37:02 user nova-compute[73572]:   </sysinfo>
Aug 26 10:37:02 user nova-compute[73572]:   <os>
Aug 26 10:37:02 user nova-compute[73572]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 10:37:02 user nova-compute[73572]:     <boot dev="hd"/>
Aug 26 10:37:02 user nova-compute[73572]:     <smbios mode="sysinfo"/>
Aug 26 10:37:02 user nova-compute[73572]:   </os>
Aug 26 10:37:02 user nova-compute[73572]:   <features>
Aug 26 10:37:02 user nova-compute[73572]:     <acpi/>
Aug 26 10:37:02 user nova-compute[73572]:     <apic/>
Aug 26 10:37:02 user nova-compute[73572]:     <vmcoreinfo/>
Aug 26 10:37:02 user nova-compute[73572]:   </features>
Aug 26 10:37:02 user nova-compute[73572]:   <clock offset="utc">
Aug 26 10:37:02 user nova-compute[73572]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 10:37:02 user nova-compute[73572]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 10:37:02 user nova-compute[73572]:     <timer name="hpet" present="no"/>
Aug 26 10:37:02 user nova-compute[73572]:   </clock>
Aug 26 10:37:02 user nova-compute[73572]:   <cpu mode="custom" match="exact">
Aug 26 10:37:02 user nova-compute[73572]:     <model>Nehalem</model>
Aug 26 10:37:02 user nova-compute[73572]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 10:37:02 user nova-compute[73572]:   </cpu>
Aug 26 10:37:02 user nova-compute[73572]:   <devices>
Aug 26 10:37:02 user nova-compute[73572]:     <disk type="file" device="disk">
Aug 26 10:37:02 user nova-compute[73572]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 10:37:02 user nova-compute[73572]:       <source file="/opt/stack/data/nova/instances/d147974d-213d-4aa3-8d03-11b262f59dca/disk"/>
Aug 26 10:37:02 user nova-compute[73572]:       <target dev="vda" bus="virtio"/>
Aug 26 10:37:02 user nova-compute[73572]:     </disk>
Aug 26 10:37:02 user nova-compute[73572]:     <interface type="ethernet">
Aug 26 10:37:02 user nova-compute[73572]:       <mac address="fa:16:3e:e5:90:35"/>
Aug 26 10:37:02 user nova-compute[73572]:       <model type="virtio"/>
Aug 26 10:37:02 user nova-compute[73572]:       <mtu size="1442"/>
Aug 26 10:37:02 user nova-compute[73572]:       <target dev="tap8d51de2d-85"/>
Aug 26 10:37:02 user nova-compute[73572]:     </interface>
Aug 26 10:37:02 user nova-compute[73572]:     <serial type="pty">
Aug 26 10:37:02 user nova-compute[73572]:       <log file="/opt/stack/data/nova/instances/d147974d-213d-4aa3-8d03-11b262f59dca/console.log" append="off"/>
Aug 26 10:37:02 user nova-compute[73572]:     </serial>
Aug 26 10:37:02 user nova-compute[73572]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 10:37:02 user nova-compute[73572]:     <video>
Aug 26 10:37:02 user nova-compute[73572]:       <model type="virtio"/>
Aug 26 10:37:02 user nova-compute[73572]:     </video>
Aug 26 10:37:02 user nova-compute[73572]:     <rng model="virtio">
Aug 26 10:37:02 user nova-compute[73572]:       <backend model="random">/dev/urandom</backend>
Aug 26 10:37:02 user nova-compute[73572]:     </rng>
Aug 26 10:37:02 user nova-compute[73572]:     <controller type="usb" index="0" model="none"/>
Aug 26 10:37:02 user nova-compute[73572]:     <memballoon model="virtio">
Aug 26 10:37:02 user nova-compute[73572]:       <stats period="10"/>
Aug 26 10:37:02 user nova-compute[73572]:     </memballoon>
Aug 26 10:37:02 user nova-compute[73572]:   </devices>
Aug 26 10:37:02 user nova-compute[73572]: </domain>
Aug 26 10:37:02 user nova-compute[73572]:  {{(pid=73572) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 10:37:02 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-42f92959-e897-4278-ae24-44a21eb007b2 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-26T10:33:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1735038851',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1735038851',id=46,image_ref='30629c2c-3606-4f8d-beb8-01f7e6597977',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1853117673',keypairs=<?>,launch_index=0,launched_at=2023-08-26T10:33:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='c7e16843614c451d958e817c832d4cbc',ramdisk_id='',reservation_id='r-l9pvelsd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-706965180',owner_user_name='tempest-AttachVolumeShelveTestJSON-706965180-project-member',shelved_at='2023-08-26T10:35:06.774972',shelved_host='user',shelved_image_id='30629c2c-3606-4f8d-beb8-01f7e6597977'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T10:36:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='17243251fe57431c9c98195a16239c5f',uuid=d147974d-213d-4aa3-8d03-11b262f59dca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "8d51de2d-85b6-4a2f-80db-5fe69b8fd11b", "address": "fa:16:3e:e5:90:35", "network": {"id": "317d2681-96ce-4898-b6fb-8892ee6f706d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2049963835-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7e16843614c451d958e817c832d4cbc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d51de2d-85", "ovs_interfaceid": "8d51de2d-85b6-4a2f-80db-5fe69b8fd11b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 10:37:02 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-42f92959-e897-4278-ae24-44a21eb007b2 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Converting VIF {"id": "8d51de2d-85b6-4a2f-80db-5fe69b8fd11b", "address": "fa:16:3e:e5:90:35", "network": {"id": "317d2681-96ce-4898-b6fb-8892ee6f706d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2049963835-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7e16843614c451d958e817c832d4cbc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d51de2d-85", "ovs_interfaceid": "8d51de2d-85b6-4a2f-80db-5fe69b8fd11b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:37:02 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-42f92959-e897-4278-ae24-44a21eb007b2 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:90:35,bridge_name='br-int',has_traffic_filtering=True,id=8d51de2d-85b6-4a2f-80db-5fe69b8fd11b,network=Network(317d2681-96ce-4898-b6fb-8892ee6f706d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d51de2d-85') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:37:02 user nova-compute[73572]: DEBUG os_vif [None req-42f92959-e897-4278-ae24-44a21eb007b2 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:90:35,bridge_name='br-int',has_traffic_filtering=True,id=8d51de2d-85b6-4a2f-80db-5fe69b8fd11b,network=Network(317d2681-96ce-4898-b6fb-8892ee6f706d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d51de2d-85') {{(pid=73572) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 10:37:02 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:37:02 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:37:02 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 10:37:02 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:37:02 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8d51de2d-85, may_exist=True, interface_attrs={}) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:37:02 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8d51de2d-85, col_values=(('external_ids', {'iface-id': '8d51de2d-85b6-4a2f-80db-5fe69b8fd11b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e5:90:35', 'vm-uuid': 'd147974d-213d-4aa3-8d03-11b262f59dca'}),), if_exists=True) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:37:02 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:37:02 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:37:02 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:37:02 user nova-compute[73572]: INFO os_vif [None req-42f92959-e897-4278-ae24-44a21eb007b2 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:90:35,bridge_name='br-int',has_traffic_filtering=True,id=8d51de2d-85b6-4a2f-80db-5fe69b8fd11b,network=Network(317d2681-96ce-4898-b6fb-8892ee6f706d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d51de2d-85')
Aug 26 10:37:02 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-42f92959-e897-4278-ae24-44a21eb007b2 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] No BDM found with device name vda, not building metadata. {{(pid=73572) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 10:37:02 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-42f92959-e897-4278-ae24-44a21eb007b2 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] No VIF found with MAC fa:16:3e:e5:90:35, not building metadata {{(pid=73572) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 10:37:04 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:37:04 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:37:04 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:37:04 user nova-compute[73572]: DEBUG nova.compute.manager [req-dabdc931-247c-4d7b-a514-5a9e6cd0a00c req-7bfacf9f-f07e-41f7-a2a5-ca4b8274c159 service nova] [instance: d147974d-213d-4aa3-8d03-11b262f59dca] Received event network-vif-plugged-8d51de2d-85b6-4a2f-80db-5fe69b8fd11b {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:37:04 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-dabdc931-247c-4d7b-a514-5a9e6cd0a00c req-7bfacf9f-f07e-41f7-a2a5-ca4b8274c159 service nova] Acquiring lock "d147974d-213d-4aa3-8d03-11b262f59dca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:37:04 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-dabdc931-247c-4d7b-a514-5a9e6cd0a00c req-7bfacf9f-f07e-41f7-a2a5-ca4b8274c159 service nova] Lock "d147974d-213d-4aa3-8d03-11b262f59dca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:37:04 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-dabdc931-247c-4d7b-a514-5a9e6cd0a00c req-7bfacf9f-f07e-41f7-a2a5-ca4b8274c159 service nova] Lock "d147974d-213d-4aa3-8d03-11b262f59dca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:37:04 user nova-compute[73572]: DEBUG nova.compute.manager [req-dabdc931-247c-4d7b-a514-5a9e6cd0a00c req-7bfacf9f-f07e-41f7-a2a5-ca4b8274c159 service nova] [instance: d147974d-213d-4aa3-8d03-11b262f59dca] No waiting events found dispatching network-vif-plugged-8d51de2d-85b6-4a2f-80db-5fe69b8fd11b {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:37:04 user nova-compute[73572]: WARNING nova.compute.manager [req-dabdc931-247c-4d7b-a514-5a9e6cd0a00c req-7bfacf9f-f07e-41f7-a2a5-ca4b8274c159 service nova] [instance: d147974d-213d-4aa3-8d03-11b262f59dca] Received unexpected event network-vif-plugged-8d51de2d-85b6-4a2f-80db-5fe69b8fd11b for instance with vm_state shelved_offloaded and task_state spawning.
Aug 26 10:37:05 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:37:05 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:37:05 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:37:05 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:37:06 user nova-compute[73572]: DEBUG nova.virt.driver [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Emitting event <LifecycleEvent: 1693046226.6235738, d147974d-213d-4aa3-8d03-11b262f59dca => Resumed> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:37:06 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: d147974d-213d-4aa3-8d03-11b262f59dca] VM Resumed (Lifecycle Event)
Aug 26 10:37:06 user nova-compute[73572]: DEBUG nova.compute.manager [None req-42f92959-e897-4278-ae24-44a21eb007b2 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] [instance: d147974d-213d-4aa3-8d03-11b262f59dca] Instance event wait completed in 0 seconds for  {{(pid=73572) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 10:37:06 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-42f92959-e897-4278-ae24-44a21eb007b2 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] [instance: d147974d-213d-4aa3-8d03-11b262f59dca] Guest created on hypervisor {{(pid=73572) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 10:37:06 user nova-compute[73572]: INFO nova.virt.libvirt.driver [-] [instance: d147974d-213d-4aa3-8d03-11b262f59dca] Instance spawned successfully.
Aug 26 10:37:06 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: d147974d-213d-4aa3-8d03-11b262f59dca] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:37:06 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: d147974d-213d-4aa3-8d03-11b262f59dca] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=73572) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 10:37:06 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: d147974d-213d-4aa3-8d03-11b262f59dca] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 10:37:06 user nova-compute[73572]: DEBUG nova.virt.driver [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Emitting event <LifecycleEvent: 1693046226.625606, d147974d-213d-4aa3-8d03-11b262f59dca => Started> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:37:06 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: d147974d-213d-4aa3-8d03-11b262f59dca] VM Started (Lifecycle Event)
Aug 26 10:37:06 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: d147974d-213d-4aa3-8d03-11b262f59dca] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:37:06 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: d147974d-213d-4aa3-8d03-11b262f59dca] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=73572) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 10:37:06 user nova-compute[73572]: DEBUG nova.compute.manager [req-f9540de0-a5d2-4df3-96f3-c85d04c98150 req-20686c4e-e7ac-4a5c-8efc-6578a85aabf4 service nova] [instance: d147974d-213d-4aa3-8d03-11b262f59dca] Received event network-vif-plugged-8d51de2d-85b6-4a2f-80db-5fe69b8fd11b {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:37:06 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-f9540de0-a5d2-4df3-96f3-c85d04c98150 req-20686c4e-e7ac-4a5c-8efc-6578a85aabf4 service nova] Acquiring lock "d147974d-213d-4aa3-8d03-11b262f59dca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:37:06 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-f9540de0-a5d2-4df3-96f3-c85d04c98150 req-20686c4e-e7ac-4a5c-8efc-6578a85aabf4 service nova] Lock "d147974d-213d-4aa3-8d03-11b262f59dca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:37:06 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-f9540de0-a5d2-4df3-96f3-c85d04c98150 req-20686c4e-e7ac-4a5c-8efc-6578a85aabf4 service nova] Lock "d147974d-213d-4aa3-8d03-11b262f59dca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:37:06 user nova-compute[73572]: DEBUG nova.compute.manager [req-f9540de0-a5d2-4df3-96f3-c85d04c98150 req-20686c4e-e7ac-4a5c-8efc-6578a85aabf4 service nova] [instance: d147974d-213d-4aa3-8d03-11b262f59dca] No waiting events found dispatching network-vif-plugged-8d51de2d-85b6-4a2f-80db-5fe69b8fd11b {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:37:06 user nova-compute[73572]: WARNING nova.compute.manager [req-f9540de0-a5d2-4df3-96f3-c85d04c98150 req-20686c4e-e7ac-4a5c-8efc-6578a85aabf4 service nova] [instance: d147974d-213d-4aa3-8d03-11b262f59dca] Received unexpected event network-vif-plugged-8d51de2d-85b6-4a2f-80db-5fe69b8fd11b for instance with vm_state shelved_offloaded and task_state spawning.
Aug 26 10:37:06 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: d147974d-213d-4aa3-8d03-11b262f59dca] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 10:37:06 user nova-compute[73572]: DEBUG nova.compute.manager [None req-42f92959-e897-4278-ae24-44a21eb007b2 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] [instance: d147974d-213d-4aa3-8d03-11b262f59dca] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:37:06 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-42f92959-e897-4278-ae24-44a21eb007b2 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Lock "d147974d-213d-4aa3-8d03-11b262f59dca" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 11.946s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:37:07 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:37:10 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:37:12 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:37:15 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:37:17 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:37:20 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:37:20 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:37:21 user nova-compute[73572]: DEBUG nova.compute.manager [req-df7edfad-201e-4ad4-aeae-1edd02491e14 req-3cb83a78-894e-4f9f-8efb-b698f33fed49 service nova] [instance: 4039a8aa-b1a7-497d-b12c-6fcc12ab2b0a] Received event network-changed-316fd822-b966-44d8-8147-5025d918f270 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:37:21 user nova-compute[73572]: DEBUG nova.compute.manager [req-df7edfad-201e-4ad4-aeae-1edd02491e14 req-3cb83a78-894e-4f9f-8efb-b698f33fed49 service nova] [instance: 4039a8aa-b1a7-497d-b12c-6fcc12ab2b0a] Refreshing instance network info cache due to event network-changed-316fd822-b966-44d8-8147-5025d918f270. {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 10:37:21 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-df7edfad-201e-4ad4-aeae-1edd02491e14 req-3cb83a78-894e-4f9f-8efb-b698f33fed49 service nova] Acquiring lock "refresh_cache-4039a8aa-b1a7-497d-b12c-6fcc12ab2b0a" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:37:21 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-df7edfad-201e-4ad4-aeae-1edd02491e14 req-3cb83a78-894e-4f9f-8efb-b698f33fed49 service nova] Acquired lock "refresh_cache-4039a8aa-b1a7-497d-b12c-6fcc12ab2b0a" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:37:21 user nova-compute[73572]: DEBUG nova.network.neutron [req-df7edfad-201e-4ad4-aeae-1edd02491e14 req-3cb83a78-894e-4f9f-8efb-b698f33fed49 service nova] [instance: 4039a8aa-b1a7-497d-b12c-6fcc12ab2b0a] Refreshing network info cache for port 316fd822-b966-44d8-8147-5025d918f270 {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 10:37:21 user nova-compute[73572]: DEBUG nova.network.neutron [req-df7edfad-201e-4ad4-aeae-1edd02491e14 req-3cb83a78-894e-4f9f-8efb-b698f33fed49 service nova] [instance: 4039a8aa-b1a7-497d-b12c-6fcc12ab2b0a] Updated VIF entry in instance network info cache for port 316fd822-b966-44d8-8147-5025d918f270. {{(pid=73572) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 10:37:21 user nova-compute[73572]: DEBUG nova.network.neutron [req-df7edfad-201e-4ad4-aeae-1edd02491e14 req-3cb83a78-894e-4f9f-8efb-b698f33fed49 service nova] [instance: 4039a8aa-b1a7-497d-b12c-6fcc12ab2b0a] Updating instance_info_cache with network_info: [{"id": "316fd822-b966-44d8-8147-5025d918f270", "address": "fa:16:3e:0f:a1:92", "network": {"id": "c520ee18-34a7-4781-bc97-419e9a702d40", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-280196989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfc130586d9f4581953f1b8ae1c4465e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap316fd822-b9", "ovs_interfaceid": "316fd822-b966-44d8-8147-5025d918f270", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:37:21 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-df7edfad-201e-4ad4-aeae-1edd02491e14 req-3cb83a78-894e-4f9f-8efb-b698f33fed49 service nova] Releasing lock "refresh_cache-4039a8aa-b1a7-497d-b12c-6fcc12ab2b0a" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:37:22 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:37:25 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:37:26 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:37:26 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Starting heal instance info cache {{(pid=73572) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 10:37:26 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquiring lock "refresh_cache-68613b1e-c45c-4fd9-834c-3630ed0f456a" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:37:26 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquired lock "refresh_cache-68613b1e-c45c-4fd9-834c-3630ed0f456a" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:37:26 user nova-compute[73572]: DEBUG nova.network.neutron [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] [instance: 68613b1e-c45c-4fd9-834c-3630ed0f456a] Forcefully refreshing network info cache for instance {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 10:37:27 user nova-compute[73572]: DEBUG nova.network.neutron [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] [instance: 68613b1e-c45c-4fd9-834c-3630ed0f456a] Updating instance_info_cache with network_info: [{"id": "aa5ef0b6-0379-4e59-a2c7-e7f1ecd3c7cb", "address": "fa:16:3e:30:8b:7a", "network": {"id": "43215883-3d00-4be7-8c40-bdaf3f01bef9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1088544153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7935bccc360b46b589fd57d53f334595", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa5ef0b6-03", "ovs_interfaceid": "aa5ef0b6-0379-4e59-a2c7-e7f1ecd3c7cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:37:27 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Releasing lock "refresh_cache-68613b1e-c45c-4fd9-834c-3630ed0f456a" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:37:27 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] [instance: 68613b1e-c45c-4fd9-834c-3630ed0f456a] Updated the network info_cache for instance {{(pid=73572) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 10:37:27 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:37:27 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:37:29 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:37:30 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:37:30 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:37:32 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:37:33 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:37:33 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73572) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 10:37:35 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:37:36 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:37:37 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:37:37 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:37:38 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-b9733cc7-156f-4800-a566-79fa89544204 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Acquiring lock "59206f70-2a59-44d2-b63a-0659416f2516" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:37:38 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-b9733cc7-156f-4800-a566-79fa89544204 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Lock "59206f70-2a59-44d2-b63a-0659416f2516" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:37:38 user nova-compute[73572]: DEBUG nova.compute.manager [None req-b9733cc7-156f-4800-a566-79fa89544204 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 59206f70-2a59-44d2-b63a-0659416f2516] Starting instance... {{(pid=73572) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 10:37:38 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-b9733cc7-156f-4800-a566-79fa89544204 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:37:38 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-b9733cc7-156f-4800-a566-79fa89544204 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:37:38 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-b9733cc7-156f-4800-a566-79fa89544204 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73572) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 10:37:38 user nova-compute[73572]: INFO nova.compute.claims [None req-b9733cc7-156f-4800-a566-79fa89544204 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 59206f70-2a59-44d2-b63a-0659416f2516] Claim successful on node user
Aug 26 10:37:38 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-b9733cc7-156f-4800-a566-79fa89544204 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Refreshing inventories for resource provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 {{(pid=73572) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 26 10:37:39 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-b9733cc7-156f-4800-a566-79fa89544204 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Updating ProviderTree inventory for provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73572) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 26 10:37:39 user nova-compute[73572]: DEBUG nova.compute.provider_tree [None req-b9733cc7-156f-4800-a566-79fa89544204 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Updating inventory in ProviderTree for provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73572) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 26 10:37:39 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-b9733cc7-156f-4800-a566-79fa89544204 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Refreshing aggregate associations for resource provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75, aggregates: None {{(pid=73572) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 26 10:37:39 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-b9733cc7-156f-4800-a566-79fa89544204 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Refreshing trait associations for resource provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75, traits: COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSSE3,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE2,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NODE,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_NE2K_PCI {{(pid=73572) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 26 10:37:39 user nova-compute[73572]: DEBUG nova.compute.provider_tree [None req-b9733cc7-156f-4800-a566-79fa89544204 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Inventory has not changed in ProviderTree for provider: e2cec974-59b2-4c77-a53d-a7f4e5a30d75 {{(pid=73572) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 10:37:39 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-b9733cc7-156f-4800-a566-79fa89544204 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Inventory has not changed for provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73572) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 10:37:39 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-b9733cc7-156f-4800-a566-79fa89544204 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.660s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:37:39 user nova-compute[73572]: DEBUG nova.compute.manager [None req-b9733cc7-156f-4800-a566-79fa89544204 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 59206f70-2a59-44d2-b63a-0659416f2516] Start building networks asynchronously for instance. {{(pid=73572) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 10:37:39 user nova-compute[73572]: DEBUG nova.compute.manager [None req-b9733cc7-156f-4800-a566-79fa89544204 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 59206f70-2a59-44d2-b63a-0659416f2516] Allocating IP information in the background. {{(pid=73572) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 10:37:39 user nova-compute[73572]: DEBUG nova.network.neutron [None req-b9733cc7-156f-4800-a566-79fa89544204 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 59206f70-2a59-44d2-b63a-0659416f2516] allocate_for_instance() {{(pid=73572) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 10:37:39 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-b9733cc7-156f-4800-a566-79fa89544204 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 59206f70-2a59-44d2-b63a-0659416f2516] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 10:37:39 user nova-compute[73572]: DEBUG nova.compute.manager [None req-b9733cc7-156f-4800-a566-79fa89544204 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 59206f70-2a59-44d2-b63a-0659416f2516] Start building block device mappings for instance. {{(pid=73572) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 10:37:39 user nova-compute[73572]: INFO nova.virt.block_device [None req-b9733cc7-156f-4800-a566-79fa89544204 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 59206f70-2a59-44d2-b63a-0659416f2516] Booting with volume fd0cf5ab-073a-48cc-a05d-6a749cedf3a8 at /dev/vda
Aug 26 10:37:39 user nova-compute[73572]: DEBUG nova.policy [None req-b9733cc7-156f-4800-a566-79fa89544204 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e1e80942e5db41c782bda686b10e2e4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc130586d9f4581953f1b8ae1c4465e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73572) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 10:37:39 user nova-compute[73572]: DEBUG os_brick.utils [None req-b9733cc7-156f-4800-a566-79fa89544204 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 10:37:39 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:37:39 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:37:39 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccab385a-27b9-4374-b735-d1b4e94eb7c8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:de8a79ed912\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:37:39 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:37:39 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:37:39 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe93f36d-e719-4d0b-a491-ed757f49c1bb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:37:39 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:37:39 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:37:39 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[47c932d8-43d7-4ab3-812a-d36b848f88f8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:37:39 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf71fb1b-331c-4c8e-a84f-990ebe333df9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:37:39 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-b9733cc7-156f-4800-a566-79fa89544204 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Running cmd (subprocess): nvme version {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:37:39 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-b9733cc7-156f-4800-a566-79fa89544204 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] 'nvme version' failed. Not Retrying. {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 10:37:39 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b9733cc7-156f-4800-a566-79fa89544204 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] nvme not present on system {{(pid=73572) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 10:37:39 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:37:39 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 10:37:39 user nova-compute[73572]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 10:37:39 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c023230-3d84-48af-badc-9299513232c9]: (4, '') {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:37:39 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:37:39 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.lightos [None req-b9733cc7-156f-4800-a566-79fa89544204 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73572) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 10:37:39 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.lightos [None req-b9733cc7-156f-4800-a566-79fa89544204 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73572) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 10:37:39 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.lightos [None req-b9733cc7-156f-4800-a566-79fa89544204 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] LIGHTOS: no hostnqn found. {{(pid=73572) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 10:37:39 user nova-compute[73572]: DEBUG os_brick.utils [None req-b9733cc7-156f-4800-a566-79fa89544204 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:de8a79ed912', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 10:37:39 user nova-compute[73572]: DEBUG nova.virt.block_device [None req-b9733cc7-156f-4800-a566-79fa89544204 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 59206f70-2a59-44d2-b63a-0659416f2516] Updating existing volume attachment record: 3aaa814d-074d-4c94-982c-fda8c22abcd9 {{(pid=73572) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 10:37:39 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:37:39 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:37:39 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:37:39 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:37:39 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Auditing locally available compute resources for user (node: user) {{(pid=73572) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 10:37:40 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73572) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 10:37:40 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73572) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 10:37:40 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68613b1e-c45c-4fd9-834c-3630ed0f456a/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:37:40 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68613b1e-c45c-4fd9-834c-3630ed0f456a/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:37:40 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68613b1e-c45c-4fd9-834c-3630ed0f456a/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:37:40 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68613b1e-c45c-4fd9-834c-3630ed0f456a/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:37:40 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a8e064c-c6b0-4812-9d3a-04ba52b06bda/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:37:40 user nova-compute[73572]: DEBUG nova.network.neutron [None req-b9733cc7-156f-4800-a566-79fa89544204 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 59206f70-2a59-44d2-b63a-0659416f2516] Successfully created port: 806d0596-a2f5-4dc8-97c0-126349257f2c {{(pid=73572) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 10:37:40 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:37:40 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a8e064c-c6b0-4812-9d3a-04ba52b06bda/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:37:40 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a8e064c-c6b0-4812-9d3a-04ba52b06bda/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:37:40 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a8e064c-c6b0-4812-9d3a-04ba52b06bda/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:37:40 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d147974d-213d-4aa3-8d03-11b262f59dca/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:37:41 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d147974d-213d-4aa3-8d03-11b262f59dca/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:37:41 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d147974d-213d-4aa3-8d03-11b262f59dca/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:37:41 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d147974d-213d-4aa3-8d03-11b262f59dca/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:37:41 user nova-compute[73572]: DEBUG nova.network.neutron [None req-b9733cc7-156f-4800-a566-79fa89544204 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 59206f70-2a59-44d2-b63a-0659416f2516] Successfully updated port: 806d0596-a2f5-4dc8-97c0-126349257f2c {{(pid=73572) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 10:37:41 user nova-compute[73572]: DEBUG nova.compute.manager [req-0d72bded-0a72-42b9-b371-b1343598463a req-d51040aa-7470-47f5-948e-c372aaf1aee5 service nova] [instance: 59206f70-2a59-44d2-b63a-0659416f2516] Received event network-changed-806d0596-a2f5-4dc8-97c0-126349257f2c {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:37:41 user nova-compute[73572]: DEBUG nova.compute.manager [req-0d72bded-0a72-42b9-b371-b1343598463a req-d51040aa-7470-47f5-948e-c372aaf1aee5 service nova] [instance: 59206f70-2a59-44d2-b63a-0659416f2516] Refreshing instance network info cache due to event network-changed-806d0596-a2f5-4dc8-97c0-126349257f2c. {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 10:37:41 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-0d72bded-0a72-42b9-b371-b1343598463a req-d51040aa-7470-47f5-948e-c372aaf1aee5 service nova] Acquiring lock "refresh_cache-59206f70-2a59-44d2-b63a-0659416f2516" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:37:41 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-0d72bded-0a72-42b9-b371-b1343598463a req-d51040aa-7470-47f5-948e-c372aaf1aee5 service nova] Acquired lock "refresh_cache-59206f70-2a59-44d2-b63a-0659416f2516" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:37:41 user nova-compute[73572]: DEBUG nova.network.neutron [req-0d72bded-0a72-42b9-b371-b1343598463a req-d51040aa-7470-47f5-948e-c372aaf1aee5 service nova] [instance: 59206f70-2a59-44d2-b63a-0659416f2516] Refreshing network info cache for port 806d0596-a2f5-4dc8-97c0-126349257f2c {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 10:37:41 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:37:41 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:37:41 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Hypervisor/Node resource view: name=user free_ram=8005MB free_disk=25.143150329589844GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=73572) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 10:37:41 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:37:41 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:37:41 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-b9733cc7-156f-4800-a566-79fa89544204 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Acquiring lock "refresh_cache-59206f70-2a59-44d2-b63a-0659416f2516" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:37:41 user nova-compute[73572]: DEBUG nova.network.neutron [req-0d72bded-0a72-42b9-b371-b1343598463a req-d51040aa-7470-47f5-948e-c372aaf1aee5 service nova] [instance: 59206f70-2a59-44d2-b63a-0659416f2516] Instance cache missing network info. {{(pid=73572) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 10:37:41 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance 68613b1e-c45c-4fd9-834c-3630ed0f456a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:37:41 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance c457a41c-2ee2-4821-94cf-69c091589241 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:37:41 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance 4039a8aa-b1a7-497d-b12c-6fcc12ab2b0a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:37:41 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance 0a8e064c-c6b0-4812-9d3a-04ba52b06bda actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:37:41 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance d147974d-213d-4aa3-8d03-11b262f59dca actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:37:41 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance 59206f70-2a59-44d2-b63a-0659416f2516 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:37:41 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=73572) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 10:37:41 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=73572) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 10:37:42 user nova-compute[73572]: DEBUG nova.compute.provider_tree [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Inventory has not changed in ProviderTree for provider: e2cec974-59b2-4c77-a53d-a7f4e5a30d75 {{(pid=73572) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 10:37:42 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Inventory has not changed for provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73572) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 10:37:42 user nova-compute[73572]: DEBUG nova.network.neutron [req-0d72bded-0a72-42b9-b371-b1343598463a req-d51040aa-7470-47f5-948e-c372aaf1aee5 service nova] [instance: 59206f70-2a59-44d2-b63a-0659416f2516] Updating instance_info_cache with network_info: [] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:37:42 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Compute_service record updated for user:user {{(pid=73572) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 10:37:42 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.367s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:37:42 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:37:42 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73572) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 26 10:37:42 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-0d72bded-0a72-42b9-b371-b1343598463a req-d51040aa-7470-47f5-948e-c372aaf1aee5 service nova] Releasing lock "refresh_cache-59206f70-2a59-44d2-b63a-0659416f2516" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:37:42 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-b9733cc7-156f-4800-a566-79fa89544204 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Acquired lock "refresh_cache-59206f70-2a59-44d2-b63a-0659416f2516" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:37:42 user nova-compute[73572]: DEBUG nova.network.neutron [None req-b9733cc7-156f-4800-a566-79fa89544204 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 59206f70-2a59-44d2-b63a-0659416f2516] Building network info cache for instance {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 10:37:42 user nova-compute[73572]: DEBUG nova.network.neutron [None req-b9733cc7-156f-4800-a566-79fa89544204 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 59206f70-2a59-44d2-b63a-0659416f2516] Instance cache missing network info. {{(pid=73572) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 10:37:42 user nova-compute[73572]: DEBUG nova.network.neutron [None req-b9733cc7-156f-4800-a566-79fa89544204 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 59206f70-2a59-44d2-b63a-0659416f2516] Updating instance_info_cache with network_info: [{"id": "806d0596-a2f5-4dc8-97c0-126349257f2c", "address": "fa:16:3e:c0:0c:2a", "network": {"id": "c520ee18-34a7-4781-bc97-419e9a702d40", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-280196989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfc130586d9f4581953f1b8ae1c4465e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap806d0596-a2", "ovs_interfaceid": "806d0596-a2f5-4dc8-97c0-126349257f2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:37:42 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-b9733cc7-156f-4800-a566-79fa89544204 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Releasing lock "refresh_cache-59206f70-2a59-44d2-b63a-0659416f2516" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:37:42 user nova-compute[73572]: DEBUG nova.compute.manager [None req-b9733cc7-156f-4800-a566-79fa89544204 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 59206f70-2a59-44d2-b63a-0659416f2516] Instance network_info: |[{"id": "806d0596-a2f5-4dc8-97c0-126349257f2c", "address": "fa:16:3e:c0:0c:2a", "network": {"id": "c520ee18-34a7-4781-bc97-419e9a702d40", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-280196989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfc130586d9f4581953f1b8ae1c4465e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap806d0596-a2", "ovs_interfaceid": "806d0596-a2f5-4dc8-97c0-126349257f2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73572) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 10:37:42 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:37:43 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:37:43 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:37:47 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:37:50 user nova-compute[73572]: DEBUG nova.compute.manager [None req-b9733cc7-156f-4800-a566-79fa89544204 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 59206f70-2a59-44d2-b63a-0659416f2516] Start spawning the instance on the hypervisor. {{(pid=73572) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 10:37:50 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-b9733cc7-156f-4800-a566-79fa89544204 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 59206f70-2a59-44d2-b63a-0659416f2516] Creating instance directory {{(pid=73572) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 10:37:50 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-b9733cc7-156f-4800-a566-79fa89544204 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 59206f70-2a59-44d2-b63a-0659416f2516] Creating image(s)
Aug 26 10:37:50 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-b9733cc7-156f-4800-a566-79fa89544204 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 59206f70-2a59-44d2-b63a-0659416f2516] Did not create local disks {{(pid=73572) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 26 10:37:50 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-b9733cc7-156f-4800-a566-79fa89544204 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 59206f70-2a59-44d2-b63a-0659416f2516] Ensure instance console log exists: /opt/stack/data/nova/instances/59206f70-2a59-44d2-b63a-0659416f2516/console.log {{(pid=73572) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 10:37:50 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-b9733cc7-156f-4800-a566-79fa89544204 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:37:50 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-b9733cc7-156f-4800-a566-79fa89544204 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:37:50 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-b9733cc7-156f-4800-a566-79fa89544204 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:37:50 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-b9733cc7-156f-4800-a566-79fa89544204 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 59206f70-2a59-44d2-b63a-0659416f2516] Start _get_guest_xml network_info=[{"id": "806d0596-a2f5-4dc8-97c0-126349257f2c", "address": "fa:16:3e:c0:0c:2a", "network": {"id": "c520ee18-34a7-4781-bc97-419e9a702d40", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-280196989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfc130586d9f4581953f1b8ae1c4465e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap806d0596-a2", "ovs_interfaceid": "806d0596-a2f5-4dc8-97c0-126349257f2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'disk_bus': 'virtio', 'boot_index': 0, 'mount_device': '/dev/vda', 'attachment_id': '3aaa814d-074d-4c94-982c-fda8c22abcd9', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:fd0cf5ab-073a-48cc-a05d-6a749cedf3a8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ImoDusjg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '59206f70-2a59-44d2-b63a-0659416f2516', 'attached_at': '', 'detached_at': '', 'volume_id': 'fd0cf5ab-073a-48cc-a05d-6a749cedf3a8', 'serial': 'fd0cf5ab-073a-48cc-a05d-6a749cedf3a8'}, 'guest_format': None, 'device_type': 'disk', 'volume_type': None} {{(pid=73572) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 10:37:50 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-b9733cc7-156f-4800-a566-79fa89544204 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:37:50 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-b9733cc7-156f-4800-a566-79fa89544204 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:37:50 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-b9733cc7-156f-4800-a566-79fa89544204 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73572) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 10:37:50 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-b9733cc7-156f-4800-a566-79fa89544204 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] CPU controller missing on host. {{(pid=73572) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 10:37:50 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-b9733cc7-156f-4800-a566-79fa89544204 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73572) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 10:37:50 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-b9733cc7-156f-4800-a566-79fa89544204 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] CPU controller found on host. {{(pid=73572) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 10:37:50 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-b9733cc7-156f-4800-a566-79fa89544204 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73572) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 10:37:50 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-b9733cc7-156f-4800-a566-79fa89544204 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T10:07:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 10:37:50 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-b9733cc7-156f-4800-a566-79fa89544204 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Flavor limits 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 10:37:50 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-b9733cc7-156f-4800-a566-79fa89544204 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Image limits 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 10:37:50 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-b9733cc7-156f-4800-a566-79fa89544204 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Flavor pref 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 10:37:50 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-b9733cc7-156f-4800-a566-79fa89544204 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Image pref 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 10:37:50 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-b9733cc7-156f-4800-a566-79fa89544204 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 10:37:50 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-b9733cc7-156f-4800-a566-79fa89544204 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 10:37:50 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-b9733cc7-156f-4800-a566-79fa89544204 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73572) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 10:37:50 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-b9733cc7-156f-4800-a566-79fa89544204 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Got 1 possible topologies {{(pid=73572) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 10:37:50 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-b9733cc7-156f-4800-a566-79fa89544204 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 10:37:50 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-b9733cc7-156f-4800-a566-79fa89544204 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 10:37:50 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b9733cc7-156f-4800-a566-79fa89544204 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 59206f70-2a59-44d2-b63a-0659416f2516] Calling os-brick to attach iSCSI Volume {{(pid=73572) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 10:37:50 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9733cc7-156f-4800-a566-79fa89544204 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc89c3d6a10>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:fd0cf5ab-073a-48cc-a05d-6a749cedf3a8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ImoDusjg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 10:37:50 user nova-compute[73572]: WARNING os_brick.initiator.connectors.base [None req-b9733cc7-156f-4800-a566-79fa89544204 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 10:37:50 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-b9733cc7-156f-4800-a566-79fa89544204 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 10:37:50 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-b9733cc7-156f-4800-a566-79fa89544204 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 10:37:50 user nova-compute[73572]: WARNING os_brick.initiator.connectors.base [None req-b9733cc7-156f-4800-a566-79fa89544204 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 10:37:50 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-b9733cc7-156f-4800-a566-79fa89544204 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fd0cf5ab-073a-48cc-a05d-6a749cedf3a8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 10:37:50 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-b9733cc7-156f-4800-a566-79fa89544204 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fd0cf5ab-073a-48cc-a05d-6a749cedf3a8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 10:37:50 user nova-compute[73572]: INFO os_brick.initiator.connectors.iscsi [None req-b9733cc7-156f-4800-a566-79fa89544204 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 10:37:50 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd0cf5ab-073a-48cc-a05d-6a749cedf3a8 -p 172.16.0.220:3260 {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:37:51 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd0cf5ab-073a-48cc-a05d-6a749cedf3a8 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:37:51 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[114e721c-52c3-498a-8548-8ad2a633c391]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:37:51 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9733cc7-156f-4800-a566-79fa89544204 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 10:37:51 user nova-compute[73572]:  {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:37:51 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd0cf5ab-073a-48cc-a05d-6a749cedf3a8 -p 172.16.0.220:3260 --interface default --op new {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:37:51 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd0cf5ab-073a-48cc-a05d-6a749cedf3a8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:37:51 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[d437e988-038c-4e42-8f0a-d73de443ec10]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fd0cf5ab-073a-48cc-a05d-6a749cedf3a8] added\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:37:51 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9733cc7-156f-4800-a566-79fa89544204 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fd0cf5ab-073a-48cc-a05d-6a749cedf3a8] added
Aug 26 10:37:51 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:37:51 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd0cf5ab-073a-48cc-a05d-6a749cedf3a8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:37:51 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd0cf5ab-073a-48cc-a05d-6a749cedf3a8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:37:51 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[448590c2-07a2-44bd-bf9a-0a48c3aa2eb9]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:37:51 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9733cc7-156f-4800-a566-79fa89544204 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:37:51 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd0cf5ab-073a-48cc-a05d-6a749cedf3a8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:37:51 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd0cf5ab-073a-48cc-a05d-6a749cedf3a8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:37:51 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[d36b95f2-6464-4cf0-8ebc-249d586d6cee]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:37:51 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9733cc7-156f-4800-a566-79fa89544204 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:37:51 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd0cf5ab-073a-48cc-a05d-6a749cedf3a8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ImoDusjg {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:37:51 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd0cf5ab-073a-48cc-a05d-6a749cedf3a8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ImoDusjg" returned: 0 in 0.018s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:37:51 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dc38640-fbca-4e71-a516-957c48e70e8f]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:37:51 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9733cc7-156f-4800-a566-79fa89544204 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ImoDusjg'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:37:51 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd0cf5ab-073a-48cc-a05d-6a749cedf3a8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:37:51 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd0cf5ab-073a-48cc-a05d-6a749cedf3a8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:37:51 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b8ed7b1-db81-49ce-a91a-5cd519ca529c]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:37:51 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9733cc7-156f-4800-a566-79fa89544204 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:37:51 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:37:51 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:37:51 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[98caa145-f8d5-4c08-87f2-9fef1b026cd6]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c17592e-3227-473f-ac7b-3e911dcb0d56 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad1b4b19-ad16-436c-9fa3-e718bea4f540 (non-flash)\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:37:51 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9733cc7-156f-4800-a566-79fa89544204 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c17592e-3227-473f-ac7b-3e911dcb0d56 (non-flash)
Aug 26 10:37:51 user nova-compute[73572]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad1b4b19-ad16-436c-9fa3-e718bea4f540 (non-flash)
Aug 26 10:37:51 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 10:37:51 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9733cc7-156f-4800-a566-79fa89544204 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c17592e-3227-473f-ac7b-3e911dcb0d56 (non-flash)
Aug 26 10:37:51 user nova-compute[73572]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad1b4b19-ad16-436c-9fa3-e718bea4f540 (non-flash)
Aug 26 10:37:51 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 10:37:51 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd0cf5ab-073a-48cc-a05d-6a749cedf3a8 -p 172.16.0.220:3260 --login {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:37:51 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd0cf5ab-073a-48cc-a05d-6a749cedf3a8 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:37:51 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[86e557cc-d337-428b-9ba9-bb69f18ac9fe]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fd0cf5ab-073a-48cc-a05d-6a749cedf3a8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fd0cf5ab-073a-48cc-a05d-6a749cedf3a8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:37:51 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9733cc7-156f-4800-a566-79fa89544204 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fd0cf5ab-073a-48cc-a05d-6a749cedf3a8, portal: 172.16.0.220,3260]
Aug 26 10:37:51 user nova-compute[73572]: Login to [iface: default, target: iqn.2010-10.org.openstack:fd0cf5ab-073a-48cc-a05d-6a749cedf3a8, portal: 172.16.0.220,3260] successful.
Aug 26 10:37:51 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:37:51 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd0cf5ab-073a-48cc-a05d-6a749cedf3a8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:37:51 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd0cf5ab-073a-48cc-a05d-6a749cedf3a8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:37:51 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[998ad329-9c13-4ef2-aa1c-8ada1fbabcbb]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:37:51 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9733cc7-156f-4800-a566-79fa89544204 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:37:51 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:37:51 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:37:51 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[d636004a-a2b6-4367-9fa7-089891b0e837]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c17592e-3227-473f-ac7b-3e911dcb0d56 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad1b4b19-ad16-436c-9fa3-e718bea4f540 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd0cf5ab-073a-48cc-a05d-6a749cedf3a8 (non-flash)\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:37:51 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9733cc7-156f-4800-a566-79fa89544204 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c17592e-3227-473f-ac7b-3e911dcb0d56 (non-flash)
Aug 26 10:37:51 user nova-compute[73572]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad1b4b19-ad16-436c-9fa3-e718bea4f540 (non-flash)
Aug 26 10:37:51 user nova-compute[73572]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd0cf5ab-073a-48cc-a05d-6a749cedf3a8 (non-flash)
Aug 26 10:37:51 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 10:37:51 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9733cc7-156f-4800-a566-79fa89544204 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c17592e-3227-473f-ac7b-3e911dcb0d56 (non-flash)
Aug 26 10:37:51 user nova-compute[73572]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad1b4b19-ad16-436c-9fa3-e718bea4f540 (non-flash)
Aug 26 10:37:51 user nova-compute[73572]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd0cf5ab-073a-48cc-a05d-6a749cedf3a8 (non-flash)
Aug 26 10:37:51 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 10:37:51 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-b9733cc7-156f-4800-a566-79fa89544204 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fd0cf5ab-073a-48cc-a05d-6a749cedf3a8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.271s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 10:37:51 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9733cc7-156f-4800-a566-79fa89544204 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Connected to 172.16.0.220:3260 {{(pid=73572) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 10:37:51 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-b9733cc7-156f-4800-a566-79fa89544204 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] HCTL ('35', '-', '-', 0) found on session 56 with lun 0 {{(pid=73572) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 10:37:51 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-b9733cc7-156f-4800-a566-79fa89544204 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73572) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 10:37:51 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:37:51 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:37:51 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[63c5f59e-4d4e-4dd9-9445-a1a7df9491b6]: (4, ('- - 0', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:37:51 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-b9733cc7-156f-4800-a566-79fa89544204 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Searching for a device in session 56 and hctl ['35', '*', '*', 0] yield: None {{(pid=73572) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 10:37:52 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-b9733cc7-156f-4800-a566-79fa89544204 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Searching for a device in session 56 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73572) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 10:37:52 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9733cc7-156f-4800-a566-79fa89544204 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ImoDusjg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73572) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 10:37:52 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-b9733cc7-156f-4800-a566-79fa89544204 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.300s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 10:37:52 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9733cc7-156f-4800-a566-79fa89544204 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] <== connect_volume: return (1302ms) {'type': 'block', 'scsi_wwn': '23664613763323363', 'path': '/dev/sdd'} {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 10:37:52 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b9733cc7-156f-4800-a566-79fa89544204 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 59206f70-2a59-44d2-b63a-0659416f2516] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23664613763323363', 'path': '/dev/sdd'} {{(pid=73572) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 10:37:52 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-b9733cc7-156f-4800-a566-79fa89544204 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T10:37:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-978021940',display_name='tempest-TestVolumeBootPattern-server-978021940',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-978021940',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGgJMPcylFVXjDKqyW+etneKzTtQZ3h+rrNV9oGL9oH9Pq5o1BgNVxyCABCwPtuWnsI0hTQA59VGxuIY4NbTGf1rbJaGRZw/AtW9ND3j+IG9u2og6CdZ4G3lJYm/FnK6hA==',key_name='tempest-TestVolumeBootPattern-2036222457',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cfc130586d9f4581953f1b8ae1c4465e',ramdisk_id='',reservation_id='r-fv9n299q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-73786062',owner_user_name='tempest-TestVolumeBootPattern-73786062-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T10:37:40Z,user_data=None,user_id='e1e80942e5db41c782bda686b10e2e4b',uuid=59206f70-2a59-44d2-b63a-0659416f2516,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "806d0596-a2f5-4dc8-97c0-126349257f2c", "address": "fa:16:3e:c0:0c:2a", "network": {"id": "c520ee18-34a7-4781-bc97-419e9a702d40", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-280196989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfc130586d9f4581953f1b8ae1c4465e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap806d0596-a2", "ovs_interfaceid": "806d0596-a2f5-4dc8-97c0-126349257f2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73572) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 10:37:52 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-b9733cc7-156f-4800-a566-79fa89544204 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Converting VIF {"id": "806d0596-a2f5-4dc8-97c0-126349257f2c", "address": "fa:16:3e:c0:0c:2a", "network": {"id": "c520ee18-34a7-4781-bc97-419e9a702d40", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-280196989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfc130586d9f4581953f1b8ae1c4465e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap806d0596-a2", "ovs_interfaceid": "806d0596-a2f5-4dc8-97c0-126349257f2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:37:52 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-b9733cc7-156f-4800-a566-79fa89544204 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c0:0c:2a,bridge_name='br-int',has_traffic_filtering=True,id=806d0596-a2f5-4dc8-97c0-126349257f2c,network=Network(c520ee18-34a7-4781-bc97-419e9a702d40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap806d0596-a2') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:37:52 user nova-compute[73572]: DEBUG nova.objects.instance [None req-b9733cc7-156f-4800-a566-79fa89544204 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Lazy-loading 'pci_devices' on Instance uuid 59206f70-2a59-44d2-b63a-0659416f2516 {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:37:52 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-b9733cc7-156f-4800-a566-79fa89544204 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 59206f70-2a59-44d2-b63a-0659416f2516] End _get_guest_xml xml=<domain type="kvm">
Aug 26 10:37:52 user nova-compute[73572]:   <uuid>59206f70-2a59-44d2-b63a-0659416f2516</uuid>
Aug 26 10:37:52 user nova-compute[73572]:   <name>instance-00000031</name>
Aug 26 10:37:52 user nova-compute[73572]:   <memory>524288</memory>
Aug 26 10:37:52 user nova-compute[73572]:   <vcpu>1</vcpu>
Aug 26 10:37:52 user nova-compute[73572]:   <metadata>
Aug 26 10:37:52 user nova-compute[73572]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 10:37:52 user nova-compute[73572]:       <nova:package version="0.0.0"/>
Aug 26 10:37:52 user nova-compute[73572]:       <nova:name>tempest-TestVolumeBootPattern-server-978021940</nova:name>
Aug 26 10:37:52 user nova-compute[73572]:       <nova:creationTime>2023-08-26 10:37:50</nova:creationTime>
Aug 26 10:37:52 user nova-compute[73572]:       <nova:flavor name="m1.tiny">
Aug 26 10:37:52 user nova-compute[73572]:         <nova:memory>512</nova:memory>
Aug 26 10:37:52 user nova-compute[73572]:         <nova:disk>1</nova:disk>
Aug 26 10:37:52 user nova-compute[73572]:         <nova:swap>0</nova:swap>
Aug 26 10:37:52 user nova-compute[73572]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 10:37:52 user nova-compute[73572]:         <nova:vcpus>1</nova:vcpus>
Aug 26 10:37:52 user nova-compute[73572]:       </nova:flavor>
Aug 26 10:37:52 user nova-compute[73572]:       <nova:owner>
Aug 26 10:37:52 user nova-compute[73572]:         <nova:user uuid="e1e80942e5db41c782bda686b10e2e4b">tempest-TestVolumeBootPattern-73786062-project-member</nova:user>
Aug 26 10:37:52 user nova-compute[73572]:         <nova:project uuid="cfc130586d9f4581953f1b8ae1c4465e">tempest-TestVolumeBootPattern-73786062</nova:project>
Aug 26 10:37:52 user nova-compute[73572]:       </nova:owner>
Aug 26 10:37:52 user nova-compute[73572]:       <nova:ports>
Aug 26 10:37:52 user nova-compute[73572]:         <nova:port uuid="806d0596-a2f5-4dc8-97c0-126349257f2c">
Aug 26 10:37:52 user nova-compute[73572]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 26 10:37:52 user nova-compute[73572]:         </nova:port>
Aug 26 10:37:52 user nova-compute[73572]:       </nova:ports>
Aug 26 10:37:52 user nova-compute[73572]:     </nova:instance>
Aug 26 10:37:52 user nova-compute[73572]:   </metadata>
Aug 26 10:37:52 user nova-compute[73572]:   <sysinfo type="smbios">
Aug 26 10:37:52 user nova-compute[73572]:     <system>
Aug 26 10:37:52 user nova-compute[73572]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 10:37:52 user nova-compute[73572]:       <entry name="product">OpenStack Nova</entry>
Aug 26 10:37:52 user nova-compute[73572]:       <entry name="version">0.0.0</entry>
Aug 26 10:37:52 user nova-compute[73572]:       <entry name="serial">59206f70-2a59-44d2-b63a-0659416f2516</entry>
Aug 26 10:37:52 user nova-compute[73572]:       <entry name="uuid">59206f70-2a59-44d2-b63a-0659416f2516</entry>
Aug 26 10:37:52 user nova-compute[73572]:       <entry name="family">Virtual Machine</entry>
Aug 26 10:37:52 user nova-compute[73572]:     </system>
Aug 26 10:37:52 user nova-compute[73572]:   </sysinfo>
Aug 26 10:37:52 user nova-compute[73572]:   <os>
Aug 26 10:37:52 user nova-compute[73572]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 10:37:52 user nova-compute[73572]:     <boot dev="hd"/>
Aug 26 10:37:52 user nova-compute[73572]:     <smbios mode="sysinfo"/>
Aug 26 10:37:52 user nova-compute[73572]:   </os>
Aug 26 10:37:52 user nova-compute[73572]:   <features>
Aug 26 10:37:52 user nova-compute[73572]:     <acpi/>
Aug 26 10:37:52 user nova-compute[73572]:     <apic/>
Aug 26 10:37:52 user nova-compute[73572]:     <vmcoreinfo/>
Aug 26 10:37:52 user nova-compute[73572]:   </features>
Aug 26 10:37:52 user nova-compute[73572]:   <clock offset="utc">
Aug 26 10:37:52 user nova-compute[73572]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 10:37:52 user nova-compute[73572]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 10:37:52 user nova-compute[73572]:     <timer name="hpet" present="no"/>
Aug 26 10:37:52 user nova-compute[73572]:   </clock>
Aug 26 10:37:52 user nova-compute[73572]:   <cpu mode="custom" match="exact">
Aug 26 10:37:52 user nova-compute[73572]:     <model>Nehalem</model>
Aug 26 10:37:52 user nova-compute[73572]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 10:37:52 user nova-compute[73572]:   </cpu>
Aug 26 10:37:52 user nova-compute[73572]:   <devices>
Aug 26 10:37:52 user nova-compute[73572]:     <disk type="block" device="disk">
Aug 26 10:37:52 user nova-compute[73572]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 10:37:52 user nova-compute[73572]:       <source dev="/dev/sdd"/>
Aug 26 10:37:52 user nova-compute[73572]:       <target dev="vda" bus="virtio"/>
Aug 26 10:37:52 user nova-compute[73572]:       <serial>fd0cf5ab-073a-48cc-a05d-6a749cedf3a8</serial>
Aug 26 10:37:52 user nova-compute[73572]:     </disk>
Aug 26 10:37:52 user nova-compute[73572]:     <interface type="ethernet">
Aug 26 10:37:52 user nova-compute[73572]:       <mac address="fa:16:3e:c0:0c:2a"/>
Aug 26 10:37:52 user nova-compute[73572]:       <model type="virtio"/>
Aug 26 10:37:52 user nova-compute[73572]:       <mtu size="1442"/>
Aug 26 10:37:52 user nova-compute[73572]:       <target dev="tap806d0596-a2"/>
Aug 26 10:37:52 user nova-compute[73572]:     </interface>
Aug 26 10:37:52 user nova-compute[73572]:     <serial type="pty">
Aug 26 10:37:52 user nova-compute[73572]:       <log file="/opt/stack/data/nova/instances/59206f70-2a59-44d2-b63a-0659416f2516/console.log" append="off"/>
Aug 26 10:37:52 user nova-compute[73572]:     </serial>
Aug 26 10:37:52 user nova-compute[73572]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 10:37:52 user nova-compute[73572]:     <video>
Aug 26 10:37:52 user nova-compute[73572]:       <model type="virtio"/>
Aug 26 10:37:52 user nova-compute[73572]:     </video>
Aug 26 10:37:52 user nova-compute[73572]:     <rng model="virtio">
Aug 26 10:37:52 user nova-compute[73572]:       <backend model="random">/dev/urandom</backend>
Aug 26 10:37:52 user nova-compute[73572]:     </rng>
Aug 26 10:37:52 user nova-compute[73572]:     <controller type="usb" index="0" model="none"/>
Aug 26 10:37:52 user nova-compute[73572]:     <memballoon model="virtio">
Aug 26 10:37:52 user nova-compute[73572]:       <stats period="10"/>
Aug 26 10:37:52 user nova-compute[73572]:     </memballoon>
Aug 26 10:37:52 user nova-compute[73572]:   </devices>
Aug 26 10:37:52 user nova-compute[73572]: </domain>
Aug 26 10:37:52 user nova-compute[73572]:  {{(pid=73572) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 10:37:52 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-b9733cc7-156f-4800-a566-79fa89544204 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T10:37:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-978021940',display_name='tempest-TestVolumeBootPattern-server-978021940',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-978021940',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGgJMPcylFVXjDKqyW+etneKzTtQZ3h+rrNV9oGL9oH9Pq5o1BgNVxyCABCwPtuWnsI0hTQA59VGxuIY4NbTGf1rbJaGRZw/AtW9ND3j+IG9u2og6CdZ4G3lJYm/FnK6hA==',key_name='tempest-TestVolumeBootPattern-2036222457',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cfc130586d9f4581953f1b8ae1c4465e',ramdisk_id='',reservation_id='r-fv9n299q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-73786062',owner_user_name='tempest-TestVolumeBootPattern-73786062-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T10:37:40Z,user_data=None,user_id='e1e80942e5db41c782bda686b10e2e4b',uuid=59206f70-2a59-44d2-b63a-0659416f2516,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "806d0596-a2f5-4dc8-97c0-126349257f2c", "address": "fa:16:3e:c0:0c:2a", "network": {"id": "c520ee18-34a7-4781-bc97-419e9a702d40", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-280196989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfc130586d9f4581953f1b8ae1c4465e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap806d0596-a2", "ovs_interfaceid": "806d0596-a2f5-4dc8-97c0-126349257f2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 10:37:52 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-b9733cc7-156f-4800-a566-79fa89544204 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Converting VIF {"id": "806d0596-a2f5-4dc8-97c0-126349257f2c", "address": "fa:16:3e:c0:0c:2a", "network": {"id": "c520ee18-34a7-4781-bc97-419e9a702d40", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-280196989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfc130586d9f4581953f1b8ae1c4465e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap806d0596-a2", "ovs_interfaceid": "806d0596-a2f5-4dc8-97c0-126349257f2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:37:52 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-b9733cc7-156f-4800-a566-79fa89544204 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c0:0c:2a,bridge_name='br-int',has_traffic_filtering=True,id=806d0596-a2f5-4dc8-97c0-126349257f2c,network=Network(c520ee18-34a7-4781-bc97-419e9a702d40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap806d0596-a2') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:37:52 user nova-compute[73572]: DEBUG os_vif [None req-b9733cc7-156f-4800-a566-79fa89544204 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:0c:2a,bridge_name='br-int',has_traffic_filtering=True,id=806d0596-a2f5-4dc8-97c0-126349257f2c,network=Network(c520ee18-34a7-4781-bc97-419e9a702d40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap806d0596-a2') {{(pid=73572) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 10:37:52 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:37:52 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:37:52 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 10:37:52 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:37:52 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap806d0596-a2, may_exist=True, interface_attrs={}) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:37:52 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap806d0596-a2, col_values=(('external_ids', {'iface-id': '806d0596-a2f5-4dc8-97c0-126349257f2c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c0:0c:2a', 'vm-uuid': '59206f70-2a59-44d2-b63a-0659416f2516'}),), if_exists=True) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:37:52 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:37:52 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:37:52 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:37:52 user nova-compute[73572]: INFO os_vif [None req-b9733cc7-156f-4800-a566-79fa89544204 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:0c:2a,bridge_name='br-int',has_traffic_filtering=True,id=806d0596-a2f5-4dc8-97c0-126349257f2c,network=Network(c520ee18-34a7-4781-bc97-419e9a702d40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap806d0596-a2')
Aug 26 10:37:52 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-b9733cc7-156f-4800-a566-79fa89544204 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] No BDM found with device name vda, not building metadata. {{(pid=73572) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 10:37:52 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-b9733cc7-156f-4800-a566-79fa89544204 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] No VIF found with MAC fa:16:3e:c0:0c:2a, not building metadata {{(pid=73572) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 10:37:52 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:37:52 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Cleaning up deleted instances {{(pid=73572) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 26 10:37:52 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] There are 0 instances to clean {{(pid=73572) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 26 10:37:53 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:37:53 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:37:53 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:37:53 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:37:53 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:37:53 user nova-compute[73572]: DEBUG nova.compute.manager [req-2043890c-6bcd-4a89-808d-1ede5bf64b02 req-360794c9-9b55-4941-b2fa-c580c3937e9f service nova] [instance: 59206f70-2a59-44d2-b63a-0659416f2516] Received event network-vif-plugged-806d0596-a2f5-4dc8-97c0-126349257f2c {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:37:53 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-2043890c-6bcd-4a89-808d-1ede5bf64b02 req-360794c9-9b55-4941-b2fa-c580c3937e9f service nova] Acquiring lock "59206f70-2a59-44d2-b63a-0659416f2516-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:37:53 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-2043890c-6bcd-4a89-808d-1ede5bf64b02 req-360794c9-9b55-4941-b2fa-c580c3937e9f service nova] Lock "59206f70-2a59-44d2-b63a-0659416f2516-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:37:53 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-2043890c-6bcd-4a89-808d-1ede5bf64b02 req-360794c9-9b55-4941-b2fa-c580c3937e9f service nova] Lock "59206f70-2a59-44d2-b63a-0659416f2516-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:37:53 user nova-compute[73572]: DEBUG nova.compute.manager [req-2043890c-6bcd-4a89-808d-1ede5bf64b02 req-360794c9-9b55-4941-b2fa-c580c3937e9f service nova] [instance: 59206f70-2a59-44d2-b63a-0659416f2516] No waiting events found dispatching network-vif-plugged-806d0596-a2f5-4dc8-97c0-126349257f2c {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:37:53 user nova-compute[73572]: WARNING nova.compute.manager [req-2043890c-6bcd-4a89-808d-1ede5bf64b02 req-360794c9-9b55-4941-b2fa-c580c3937e9f service nova] [instance: 59206f70-2a59-44d2-b63a-0659416f2516] Received unexpected event network-vif-plugged-806d0596-a2f5-4dc8-97c0-126349257f2c for instance with vm_state building and task_state spawning.
Aug 26 10:37:54 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:37:55 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:37:55 user nova-compute[73572]: DEBUG nova.virt.driver [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Emitting event <LifecycleEvent: 1693046275.8422966, 59206f70-2a59-44d2-b63a-0659416f2516 => Resumed> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:37:55 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 59206f70-2a59-44d2-b63a-0659416f2516] VM Resumed (Lifecycle Event)
Aug 26 10:37:55 user nova-compute[73572]: DEBUG nova.compute.manager [None req-b9733cc7-156f-4800-a566-79fa89544204 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 59206f70-2a59-44d2-b63a-0659416f2516] Instance event wait completed in 0 seconds for  {{(pid=73572) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 10:37:55 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-b9733cc7-156f-4800-a566-79fa89544204 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 59206f70-2a59-44d2-b63a-0659416f2516] Guest created on hypervisor {{(pid=73572) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 10:37:55 user nova-compute[73572]: INFO nova.virt.libvirt.driver [-] [instance: 59206f70-2a59-44d2-b63a-0659416f2516] Instance spawned successfully.
Aug 26 10:37:55 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-b9733cc7-156f-4800-a566-79fa89544204 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 59206f70-2a59-44d2-b63a-0659416f2516] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 10:37:55 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 59206f70-2a59-44d2-b63a-0659416f2516] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:37:55 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 59206f70-2a59-44d2-b63a-0659416f2516] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73572) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 10:37:55 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-b9733cc7-156f-4800-a566-79fa89544204 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 59206f70-2a59-44d2-b63a-0659416f2516] Found default for hw_cdrom_bus of ide {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:37:55 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-b9733cc7-156f-4800-a566-79fa89544204 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 59206f70-2a59-44d2-b63a-0659416f2516] Found default for hw_disk_bus of virtio {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:37:55 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-b9733cc7-156f-4800-a566-79fa89544204 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 59206f70-2a59-44d2-b63a-0659416f2516] Found default for hw_input_bus of None {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:37:55 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-b9733cc7-156f-4800-a566-79fa89544204 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 59206f70-2a59-44d2-b63a-0659416f2516] Found default for hw_pointer_model of None {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:37:55 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-b9733cc7-156f-4800-a566-79fa89544204 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 59206f70-2a59-44d2-b63a-0659416f2516] Found default for hw_video_model of virtio {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:37:55 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-b9733cc7-156f-4800-a566-79fa89544204 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 59206f70-2a59-44d2-b63a-0659416f2516] Found default for hw_vif_model of virtio {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:37:55 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 59206f70-2a59-44d2-b63a-0659416f2516] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 10:37:55 user nova-compute[73572]: DEBUG nova.virt.driver [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Emitting event <LifecycleEvent: 1693046275.845206, 59206f70-2a59-44d2-b63a-0659416f2516 => Started> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:37:55 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 59206f70-2a59-44d2-b63a-0659416f2516] VM Started (Lifecycle Event)
Aug 26 10:37:55 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 59206f70-2a59-44d2-b63a-0659416f2516] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:37:55 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 59206f70-2a59-44d2-b63a-0659416f2516] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73572) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 10:37:55 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 59206f70-2a59-44d2-b63a-0659416f2516] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 10:37:55 user nova-compute[73572]: INFO nova.compute.manager [None req-b9733cc7-156f-4800-a566-79fa89544204 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 59206f70-2a59-44d2-b63a-0659416f2516] Took 5.03 seconds to spawn the instance on the hypervisor.
Aug 26 10:37:55 user nova-compute[73572]: DEBUG nova.compute.manager [None req-b9733cc7-156f-4800-a566-79fa89544204 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 59206f70-2a59-44d2-b63a-0659416f2516] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:37:55 user nova-compute[73572]: DEBUG nova.compute.manager [req-ba586b05-6d54-43a4-9fd4-c807984f0a42 req-85ba7c6f-f310-4751-b98f-eb976e18674b service nova] [instance: 59206f70-2a59-44d2-b63a-0659416f2516] Received event network-vif-plugged-806d0596-a2f5-4dc8-97c0-126349257f2c {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:37:55 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-ba586b05-6d54-43a4-9fd4-c807984f0a42 req-85ba7c6f-f310-4751-b98f-eb976e18674b service nova] Acquiring lock "59206f70-2a59-44d2-b63a-0659416f2516-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:37:55 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-ba586b05-6d54-43a4-9fd4-c807984f0a42 req-85ba7c6f-f310-4751-b98f-eb976e18674b service nova] Lock "59206f70-2a59-44d2-b63a-0659416f2516-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:37:55 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-ba586b05-6d54-43a4-9fd4-c807984f0a42 req-85ba7c6f-f310-4751-b98f-eb976e18674b service nova] Lock "59206f70-2a59-44d2-b63a-0659416f2516-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:37:55 user nova-compute[73572]: DEBUG nova.compute.manager [req-ba586b05-6d54-43a4-9fd4-c807984f0a42 req-85ba7c6f-f310-4751-b98f-eb976e18674b service nova] [instance: 59206f70-2a59-44d2-b63a-0659416f2516] No waiting events found dispatching network-vif-plugged-806d0596-a2f5-4dc8-97c0-126349257f2c {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:37:55 user nova-compute[73572]: WARNING nova.compute.manager [req-ba586b05-6d54-43a4-9fd4-c807984f0a42 req-85ba7c6f-f310-4751-b98f-eb976e18674b service nova] [instance: 59206f70-2a59-44d2-b63a-0659416f2516] Received unexpected event network-vif-plugged-806d0596-a2f5-4dc8-97c0-126349257f2c for instance with vm_state building and task_state spawning.
Aug 26 10:37:56 user nova-compute[73572]: INFO nova.compute.manager [None req-b9733cc7-156f-4800-a566-79fa89544204 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 59206f70-2a59-44d2-b63a-0659416f2516] Took 17.76 seconds to build instance.
Aug 26 10:37:56 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-b9733cc7-156f-4800-a566-79fa89544204 tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Lock "59206f70-2a59-44d2-b63a-0659416f2516" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.850s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:37:57 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:37:59 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:38:02 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:38:07 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:38:07 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:38:07 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73572) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 10:38:07 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73572) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 10:38:07 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73572) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 10:38:07 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:38:10 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:38:12 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:38:15 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:38:17 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:38:20 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._sync_power_states {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:38:20 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Triggering sync for uuid 68613b1e-c45c-4fd9-834c-3630ed0f456a {{(pid=73572) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 10:38:20 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Triggering sync for uuid c457a41c-2ee2-4821-94cf-69c091589241 {{(pid=73572) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 10:38:20 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Triggering sync for uuid d147974d-213d-4aa3-8d03-11b262f59dca {{(pid=73572) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 10:38:20 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Triggering sync for uuid 4039a8aa-b1a7-497d-b12c-6fcc12ab2b0a {{(pid=73572) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 10:38:20 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Triggering sync for uuid 0a8e064c-c6b0-4812-9d3a-04ba52b06bda {{(pid=73572) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 10:38:20 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Triggering sync for uuid 59206f70-2a59-44d2-b63a-0659416f2516 {{(pid=73572) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 10:38:20 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquiring lock "68613b1e-c45c-4fd9-834c-3630ed0f456a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:38:20 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "68613b1e-c45c-4fd9-834c-3630ed0f456a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:38:20 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquiring lock "c457a41c-2ee2-4821-94cf-69c091589241" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:38:20 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "c457a41c-2ee2-4821-94cf-69c091589241" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:38:20 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquiring lock "d147974d-213d-4aa3-8d03-11b262f59dca" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:38:20 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "d147974d-213d-4aa3-8d03-11b262f59dca" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:38:20 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquiring lock "4039a8aa-b1a7-497d-b12c-6fcc12ab2b0a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:38:20 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "4039a8aa-b1a7-497d-b12c-6fcc12ab2b0a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:38:20 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquiring lock "0a8e064c-c6b0-4812-9d3a-04ba52b06bda" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:38:20 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "0a8e064c-c6b0-4812-9d3a-04ba52b06bda" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:38:20 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquiring lock "59206f70-2a59-44d2-b63a-0659416f2516" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:38:20 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "59206f70-2a59-44d2-b63a-0659416f2516" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:38:20 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "68613b1e-c45c-4fd9-834c-3630ed0f456a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.031s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:38:20 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "c457a41c-2ee2-4821-94cf-69c091589241" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.036s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:38:20 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "d147974d-213d-4aa3-8d03-11b262f59dca" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.039s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:38:20 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "4039a8aa-b1a7-497d-b12c-6fcc12ab2b0a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.041s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:38:20 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "59206f70-2a59-44d2-b63a-0659416f2516" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.049s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:38:20 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "0a8e064c-c6b0-4812-9d3a-04ba52b06bda" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.051s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:38:20 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:38:22 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:38:25 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:38:27 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:38:28 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:38:28 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Starting heal instance info cache {{(pid=73572) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 10:38:28 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquiring lock "refresh_cache-c457a41c-2ee2-4821-94cf-69c091589241" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:38:28 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquired lock "refresh_cache-c457a41c-2ee2-4821-94cf-69c091589241" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:38:28 user nova-compute[73572]: DEBUG nova.network.neutron [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] [instance: c457a41c-2ee2-4821-94cf-69c091589241] Forcefully refreshing network info cache for instance {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 10:38:29 user nova-compute[73572]: DEBUG nova.network.neutron [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] [instance: c457a41c-2ee2-4821-94cf-69c091589241] Updating instance_info_cache with network_info: [{"id": "deb899b2-ba04-427b-b4ea-a514b8eda260", "address": "fa:16:3e:05:c8:e3", "network": {"id": "43215883-3d00-4be7-8c40-bdaf3f01bef9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1088544153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7935bccc360b46b589fd57d53f334595", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdeb899b2-ba", "ovs_interfaceid": "deb899b2-ba04-427b-b4ea-a514b8eda260", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:38:29 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Releasing lock "refresh_cache-c457a41c-2ee2-4821-94cf-69c091589241" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:38:29 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] [instance: c457a41c-2ee2-4821-94cf-69c091589241] Updated the network info_cache for instance {{(pid=73572) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 10:38:29 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:38:29 user nova-compute[73572]: INFO nova.compute.manager [None req-d211be6c-9c5a-464f-8905-6fce9ecf9e8e tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] [instance: c457a41c-2ee2-4821-94cf-69c091589241] Get console output
Aug 26 10:38:29 user nova-compute[73572]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Aug 26 10:38:29 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:38:30 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:38:32 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:38:32 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:38:33 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:38:33 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73572) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 10:38:37 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:38:37 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:38:37 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73572) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 10:38:37 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73572) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 10:38:37 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73572) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 10:38:37 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:38:39 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:38:41 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:38:41 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:38:41 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:38:41 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:38:41 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:38:41 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:38:41 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Auditing locally available compute resources for user (node: user) {{(pid=73572) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 10:38:41 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73572) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 10:38:41 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73572) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 10:38:41 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68613b1e-c45c-4fd9-834c-3630ed0f456a/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:38:42 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68613b1e-c45c-4fd9-834c-3630ed0f456a/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:38:42 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68613b1e-c45c-4fd9-834c-3630ed0f456a/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:38:42 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:38:42 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68613b1e-c45c-4fd9-834c-3630ed0f456a/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:38:42 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a8e064c-c6b0-4812-9d3a-04ba52b06bda/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:38:42 user nova-compute[73572]: DEBUG nova.compute.manager [req-d640fa49-95e0-45ef-b56c-6101304af2ca req-15f46ea8-921d-44b1-bfd6-0f577d2aa704 service nova] [instance: 0a8e064c-c6b0-4812-9d3a-04ba52b06bda] Received event network-changed-4a5e5040-9799-4ade-8465-c5ab770d0616 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:38:42 user nova-compute[73572]: DEBUG nova.compute.manager [req-d640fa49-95e0-45ef-b56c-6101304af2ca req-15f46ea8-921d-44b1-bfd6-0f577d2aa704 service nova] [instance: 0a8e064c-c6b0-4812-9d3a-04ba52b06bda] Refreshing instance network info cache due to event network-changed-4a5e5040-9799-4ade-8465-c5ab770d0616. {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 10:38:42 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-d640fa49-95e0-45ef-b56c-6101304af2ca req-15f46ea8-921d-44b1-bfd6-0f577d2aa704 service nova] Acquiring lock "refresh_cache-0a8e064c-c6b0-4812-9d3a-04ba52b06bda" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:38:42 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-d640fa49-95e0-45ef-b56c-6101304af2ca req-15f46ea8-921d-44b1-bfd6-0f577d2aa704 service nova] Acquired lock "refresh_cache-0a8e064c-c6b0-4812-9d3a-04ba52b06bda" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:38:42 user nova-compute[73572]: DEBUG nova.network.neutron [req-d640fa49-95e0-45ef-b56c-6101304af2ca req-15f46ea8-921d-44b1-bfd6-0f577d2aa704 service nova] [instance: 0a8e064c-c6b0-4812-9d3a-04ba52b06bda] Refreshing network info cache for port 4a5e5040-9799-4ade-8465-c5ab770d0616 {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 10:38:42 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a8e064c-c6b0-4812-9d3a-04ba52b06bda/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:38:42 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a8e064c-c6b0-4812-9d3a-04ba52b06bda/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:38:42 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a8e064c-c6b0-4812-9d3a-04ba52b06bda/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:38:42 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73572) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 10:38:42 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d147974d-213d-4aa3-8d03-11b262f59dca/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:38:42 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d147974d-213d-4aa3-8d03-11b262f59dca/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:38:42 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d147974d-213d-4aa3-8d03-11b262f59dca/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:38:43 user nova-compute[73572]: DEBUG nova.network.neutron [req-d640fa49-95e0-45ef-b56c-6101304af2ca req-15f46ea8-921d-44b1-bfd6-0f577d2aa704 service nova] [instance: 0a8e064c-c6b0-4812-9d3a-04ba52b06bda] Updated VIF entry in instance network info cache for port 4a5e5040-9799-4ade-8465-c5ab770d0616. {{(pid=73572) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 10:38:43 user nova-compute[73572]: DEBUG nova.network.neutron [req-d640fa49-95e0-45ef-b56c-6101304af2ca req-15f46ea8-921d-44b1-bfd6-0f577d2aa704 service nova] [instance: 0a8e064c-c6b0-4812-9d3a-04ba52b06bda] Updating instance_info_cache with network_info: [{"id": "4a5e5040-9799-4ade-8465-c5ab770d0616", "address": "fa:16:3e:47:ea:be", "network": {"id": "21dd7d4e-3fb2-44d6-99d0-973f9eb5d456", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-222837576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54e0a0a3c0f64ed7980570750d7754ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a5e5040-97", "ovs_interfaceid": "4a5e5040-9799-4ade-8465-c5ab770d0616", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:38:43 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-d640fa49-95e0-45ef-b56c-6101304af2ca req-15f46ea8-921d-44b1-bfd6-0f577d2aa704 service nova] Releasing lock "refresh_cache-0a8e064c-c6b0-4812-9d3a-04ba52b06bda" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:38:43 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d147974d-213d-4aa3-8d03-11b262f59dca/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:38:43 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:38:43 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:38:43 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Hypervisor/Node resource view: name=user free_ram=7983MB free_disk=25.139636993408203GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=73572) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 10:38:43 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:38:43 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:38:43 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance 68613b1e-c45c-4fd9-834c-3630ed0f456a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:38:43 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance c457a41c-2ee2-4821-94cf-69c091589241 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:38:43 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance 4039a8aa-b1a7-497d-b12c-6fcc12ab2b0a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:38:43 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance 0a8e064c-c6b0-4812-9d3a-04ba52b06bda actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:38:43 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance d147974d-213d-4aa3-8d03-11b262f59dca actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:38:43 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance 59206f70-2a59-44d2-b63a-0659416f2516 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:38:43 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=73572) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 10:38:43 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=73572) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 10:38:43 user nova-compute[73572]: DEBUG nova.compute.provider_tree [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Inventory has not changed in ProviderTree for provider: e2cec974-59b2-4c77-a53d-a7f4e5a30d75 {{(pid=73572) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 10:38:43 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Inventory has not changed for provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73572) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 10:38:43 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Compute_service record updated for user:user {{(pid=73572) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 10:38:43 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.347s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:38:45 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-c3bfb8d1-40d1-4de8-9d6a-5147f0602c85 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Acquiring lock "d147974d-213d-4aa3-8d03-11b262f59dca" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:38:45 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-c3bfb8d1-40d1-4de8-9d6a-5147f0602c85 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Lock "d147974d-213d-4aa3-8d03-11b262f59dca" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:38:45 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-c3bfb8d1-40d1-4de8-9d6a-5147f0602c85 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Acquiring lock "d147974d-213d-4aa3-8d03-11b262f59dca-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:38:45 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-c3bfb8d1-40d1-4de8-9d6a-5147f0602c85 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Lock "d147974d-213d-4aa3-8d03-11b262f59dca-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:38:45 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-c3bfb8d1-40d1-4de8-9d6a-5147f0602c85 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Lock "d147974d-213d-4aa3-8d03-11b262f59dca-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:38:45 user nova-compute[73572]: INFO nova.compute.manager [None req-c3bfb8d1-40d1-4de8-9d6a-5147f0602c85 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] [instance: d147974d-213d-4aa3-8d03-11b262f59dca] Terminating instance
Aug 26 10:38:45 user nova-compute[73572]: DEBUG nova.compute.manager [None req-c3bfb8d1-40d1-4de8-9d6a-5147f0602c85 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] [instance: d147974d-213d-4aa3-8d03-11b262f59dca] Start destroying the instance on the hypervisor. {{(pid=73572) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 10:38:45 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:38:45 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:38:45 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:38:45 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:38:46 user nova-compute[73572]: INFO nova.virt.libvirt.driver [-] [instance: d147974d-213d-4aa3-8d03-11b262f59dca] Instance destroyed successfully.
Aug 26 10:38:46 user nova-compute[73572]: DEBUG nova.objects.instance [None req-c3bfb8d1-40d1-4de8-9d6a-5147f0602c85 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Lazy-loading 'resources' on Instance uuid d147974d-213d-4aa3-8d03-11b262f59dca {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:38:46 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-c3bfb8d1-40d1-4de8-9d6a-5147f0602c85 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-26T10:33:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1735038851',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1735038851',id=46,image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKA2CshH7isyB3vV5ETR93+hSoeCwS760V1xRpFlfuAtq/MqtMJywztpVgxj5rkLJmK+DWulBNDjaP7GLPWX9o0j64jsB+zF5uHZU8M4lTcSCf/Ws/xZAJQf9qx+64vnrA==',key_name='tempest-keypair-1853117673',keypairs=<?>,launch_index=0,launched_at=2023-08-26T10:37:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c7e16843614c451d958e817c832d4cbc',ramdisk_id='',reservation_id='r-l9pvelsd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-706965180',owner_user_name='tempest-AttachVolumeShelveTestJSON-706965180-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T10:37:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='17243251fe57431c9c98195a16239c5f',uuid=d147974d-213d-4aa3-8d03-11b262f59dca,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8d51de2d-85b6-4a2f-80db-5fe69b8fd11b", "address": "fa:16:3e:e5:90:35", "network": {"id": "317d2681-96ce-4898-b6fb-8892ee6f706d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2049963835-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7e16843614c451d958e817c832d4cbc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d51de2d-85", "ovs_interfaceid": "8d51de2d-85b6-4a2f-80db-5fe69b8fd11b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 10:38:46 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-c3bfb8d1-40d1-4de8-9d6a-5147f0602c85 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Converting VIF {"id": "8d51de2d-85b6-4a2f-80db-5fe69b8fd11b", "address": "fa:16:3e:e5:90:35", "network": {"id": "317d2681-96ce-4898-b6fb-8892ee6f706d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2049963835-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7e16843614c451d958e817c832d4cbc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d51de2d-85", "ovs_interfaceid": "8d51de2d-85b6-4a2f-80db-5fe69b8fd11b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:38:46 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-c3bfb8d1-40d1-4de8-9d6a-5147f0602c85 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:90:35,bridge_name='br-int',has_traffic_filtering=True,id=8d51de2d-85b6-4a2f-80db-5fe69b8fd11b,network=Network(317d2681-96ce-4898-b6fb-8892ee6f706d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d51de2d-85') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:38:46 user nova-compute[73572]: DEBUG os_vif [None req-c3bfb8d1-40d1-4de8-9d6a-5147f0602c85 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:90:35,bridge_name='br-int',has_traffic_filtering=True,id=8d51de2d-85b6-4a2f-80db-5fe69b8fd11b,network=Network(317d2681-96ce-4898-b6fb-8892ee6f706d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d51de2d-85') {{(pid=73572) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 10:38:46 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:38:46 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8d51de2d-85, bridge=br-int, if_exists=True) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:38:46 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:38:46 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:38:46 user nova-compute[73572]: INFO os_vif [None req-c3bfb8d1-40d1-4de8-9d6a-5147f0602c85 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:90:35,bridge_name='br-int',has_traffic_filtering=True,id=8d51de2d-85b6-4a2f-80db-5fe69b8fd11b,network=Network(317d2681-96ce-4898-b6fb-8892ee6f706d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d51de2d-85')
Aug 26 10:38:46 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-c3bfb8d1-40d1-4de8-9d6a-5147f0602c85 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] [instance: d147974d-213d-4aa3-8d03-11b262f59dca] Deleting instance files /opt/stack/data/nova/instances/d147974d-213d-4aa3-8d03-11b262f59dca_del
Aug 26 10:38:46 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-c3bfb8d1-40d1-4de8-9d6a-5147f0602c85 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] [instance: d147974d-213d-4aa3-8d03-11b262f59dca] Deletion of /opt/stack/data/nova/instances/d147974d-213d-4aa3-8d03-11b262f59dca_del complete
Aug 26 10:38:46 user nova-compute[73572]: INFO nova.compute.manager [None req-c3bfb8d1-40d1-4de8-9d6a-5147f0602c85 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] [instance: d147974d-213d-4aa3-8d03-11b262f59dca] Took 0.90 seconds to destroy the instance on the hypervisor.
Aug 26 10:38:46 user nova-compute[73572]: DEBUG oslo.service.loopingcall [None req-c3bfb8d1-40d1-4de8-9d6a-5147f0602c85 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73572) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 10:38:46 user nova-compute[73572]: DEBUG nova.compute.manager [-] [instance: d147974d-213d-4aa3-8d03-11b262f59dca] Deallocating network for instance {{(pid=73572) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 10:38:46 user nova-compute[73572]: DEBUG nova.network.neutron [-] [instance: d147974d-213d-4aa3-8d03-11b262f59dca] deallocate_for_instance() {{(pid=73572) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 10:38:46 user nova-compute[73572]: DEBUG nova.compute.manager [req-7968cd1c-2577-4cc5-89c2-0ae5dc066e76 req-2ea1499c-7857-4166-8600-12ffdfffdfc7 service nova] [instance: d147974d-213d-4aa3-8d03-11b262f59dca] Received event network-vif-unplugged-8d51de2d-85b6-4a2f-80db-5fe69b8fd11b {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:38:46 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-7968cd1c-2577-4cc5-89c2-0ae5dc066e76 req-2ea1499c-7857-4166-8600-12ffdfffdfc7 service nova] Acquiring lock "d147974d-213d-4aa3-8d03-11b262f59dca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:38:46 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-7968cd1c-2577-4cc5-89c2-0ae5dc066e76 req-2ea1499c-7857-4166-8600-12ffdfffdfc7 service nova] Lock "d147974d-213d-4aa3-8d03-11b262f59dca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:38:46 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-7968cd1c-2577-4cc5-89c2-0ae5dc066e76 req-2ea1499c-7857-4166-8600-12ffdfffdfc7 service nova] Lock "d147974d-213d-4aa3-8d03-11b262f59dca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:38:46 user nova-compute[73572]: DEBUG nova.compute.manager [req-7968cd1c-2577-4cc5-89c2-0ae5dc066e76 req-2ea1499c-7857-4166-8600-12ffdfffdfc7 service nova] [instance: d147974d-213d-4aa3-8d03-11b262f59dca] No waiting events found dispatching network-vif-unplugged-8d51de2d-85b6-4a2f-80db-5fe69b8fd11b {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:38:46 user nova-compute[73572]: DEBUG nova.compute.manager [req-7968cd1c-2577-4cc5-89c2-0ae5dc066e76 req-2ea1499c-7857-4166-8600-12ffdfffdfc7 service nova] [instance: d147974d-213d-4aa3-8d03-11b262f59dca] Received event network-vif-unplugged-8d51de2d-85b6-4a2f-80db-5fe69b8fd11b for instance with task_state deleting. {{(pid=73572) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 10:38:46 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:38:47 user nova-compute[73572]: DEBUG nova.network.neutron [-] [instance: d147974d-213d-4aa3-8d03-11b262f59dca] Updating instance_info_cache with network_info: [] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:38:47 user nova-compute[73572]: INFO nova.compute.manager [-] [instance: d147974d-213d-4aa3-8d03-11b262f59dca] Took 0.91 seconds to deallocate network for instance.
Aug 26 10:38:47 user nova-compute[73572]: DEBUG nova.compute.manager [req-83ba7f12-2131-4452-b253-3a9a19c4ed72 req-e6b79faa-9c93-4509-ba19-4732cdbaf4f9 service nova] [instance: d147974d-213d-4aa3-8d03-11b262f59dca] Received event network-vif-deleted-8d51de2d-85b6-4a2f-80db-5fe69b8fd11b {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:38:47 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-c3bfb8d1-40d1-4de8-9d6a-5147f0602c85 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:38:47 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-c3bfb8d1-40d1-4de8-9d6a-5147f0602c85 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:38:47 user nova-compute[73572]: DEBUG nova.compute.provider_tree [None req-c3bfb8d1-40d1-4de8-9d6a-5147f0602c85 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Inventory has not changed in ProviderTree for provider: e2cec974-59b2-4c77-a53d-a7f4e5a30d75 {{(pid=73572) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 10:38:47 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-c3bfb8d1-40d1-4de8-9d6a-5147f0602c85 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Inventory has not changed for provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73572) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 10:38:47 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-c3bfb8d1-40d1-4de8-9d6a-5147f0602c85 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.261s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:38:47 user nova-compute[73572]: INFO nova.scheduler.client.report [None req-c3bfb8d1-40d1-4de8-9d6a-5147f0602c85 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Deleted allocations for instance d147974d-213d-4aa3-8d03-11b262f59dca
Aug 26 10:38:47 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-0dbcac4b-fffb-48cb-94fe-76239ba5ab76 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member] Acquiring lock "0a8e064c-c6b0-4812-9d3a-04ba52b06bda" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:38:47 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-0dbcac4b-fffb-48cb-94fe-76239ba5ab76 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member] Lock "0a8e064c-c6b0-4812-9d3a-04ba52b06bda" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:38:47 user nova-compute[73572]: DEBUG nova.objects.instance [None req-0dbcac4b-fffb-48cb-94fe-76239ba5ab76 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member] Lazy-loading 'flavor' on Instance uuid 0a8e064c-c6b0-4812-9d3a-04ba52b06bda {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:38:47 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-c3bfb8d1-40d1-4de8-9d6a-5147f0602c85 tempest-AttachVolumeShelveTestJSON-706965180 tempest-AttachVolumeShelveTestJSON-706965180-project-member] Lock "d147974d-213d-4aa3-8d03-11b262f59dca" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.277s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:38:47 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-0dbcac4b-fffb-48cb-94fe-76239ba5ab76 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member] Lock "0a8e064c-c6b0-4812-9d3a-04ba52b06bda" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.079s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:38:47 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-0dbcac4b-fffb-48cb-94fe-76239ba5ab76 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member] Acquiring lock "0a8e064c-c6b0-4812-9d3a-04ba52b06bda" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:38:47 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-0dbcac4b-fffb-48cb-94fe-76239ba5ab76 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member] Lock "0a8e064c-c6b0-4812-9d3a-04ba52b06bda" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:38:47 user nova-compute[73572]: INFO nova.compute.manager [None req-0dbcac4b-fffb-48cb-94fe-76239ba5ab76 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member] [instance: 0a8e064c-c6b0-4812-9d3a-04ba52b06bda] Attaching volume 296d6d68-1757-43f5-b3d9-84182115b673 to /dev/vdb
Aug 26 10:38:47 user nova-compute[73572]: DEBUG os_brick.utils [None req-0dbcac4b-fffb-48cb-94fe-76239ba5ab76 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 10:38:47 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:38:47 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:38:47 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c144846-df0d-4603-890a-d0bf4ac3499e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:de8a79ed912\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:38:47 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:38:48 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:38:48 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[7910b56e-3e7e-4b0c-8955-d1915c406109]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:38:48 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:38:48 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:38:48 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[e37f1a2a-2181-49f9-adab-3284dff74926]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:38:48 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e567470-9b46-45df-b652-630c6cd154df]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:38:48 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-0dbcac4b-fffb-48cb-94fe-76239ba5ab76 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member] Running cmd (subprocess): nvme version {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:38:48 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-0dbcac4b-fffb-48cb-94fe-76239ba5ab76 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member] 'nvme version' failed. Not Retrying. {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 10:38:48 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0dbcac4b-fffb-48cb-94fe-76239ba5ab76 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member] nvme not present on system {{(pid=73572) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 10:38:48 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:38:48 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 10:38:48 user nova-compute[73572]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 10:38:48 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e1efe4c-000a-42e0-bb7e-48b5313878e6]: (4, '') {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:38:48 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.lightos [None req-0dbcac4b-fffb-48cb-94fe-76239ba5ab76 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73572) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 10:38:48 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.lightos [None req-0dbcac4b-fffb-48cb-94fe-76239ba5ab76 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73572) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 10:38:48 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.lightos [None req-0dbcac4b-fffb-48cb-94fe-76239ba5ab76 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member] LIGHTOS: no hostnqn found. {{(pid=73572) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 10:38:48 user nova-compute[73572]: DEBUG os_brick.utils [None req-0dbcac4b-fffb-48cb-94fe-76239ba5ab76 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member] <== get_connector_properties: return (142ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:de8a79ed912', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 10:38:48 user nova-compute[73572]: DEBUG nova.virt.block_device [None req-0dbcac4b-fffb-48cb-94fe-76239ba5ab76 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member] [instance: 0a8e064c-c6b0-4812-9d3a-04ba52b06bda] Updating existing volume attachment record: 690d57c2-bc8b-4e9e-9b32-5d7aece328dc {{(pid=73572) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 10:38:48 user nova-compute[73572]: DEBUG nova.compute.manager [req-d18efd44-3d10-47fc-be35-74d61cee5989 req-0fb261f4-b1e6-490f-9904-bf04771e34c2 service nova] [instance: d147974d-213d-4aa3-8d03-11b262f59dca] Received event network-vif-plugged-8d51de2d-85b6-4a2f-80db-5fe69b8fd11b {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:38:48 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-d18efd44-3d10-47fc-be35-74d61cee5989 req-0fb261f4-b1e6-490f-9904-bf04771e34c2 service nova] Acquiring lock "d147974d-213d-4aa3-8d03-11b262f59dca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:38:48 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-d18efd44-3d10-47fc-be35-74d61cee5989 req-0fb261f4-b1e6-490f-9904-bf04771e34c2 service nova] Lock "d147974d-213d-4aa3-8d03-11b262f59dca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:38:48 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-d18efd44-3d10-47fc-be35-74d61cee5989 req-0fb261f4-b1e6-490f-9904-bf04771e34c2 service nova] Lock "d147974d-213d-4aa3-8d03-11b262f59dca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:38:48 user nova-compute[73572]: DEBUG nova.compute.manager [req-d18efd44-3d10-47fc-be35-74d61cee5989 req-0fb261f4-b1e6-490f-9904-bf04771e34c2 service nova] [instance: d147974d-213d-4aa3-8d03-11b262f59dca] No waiting events found dispatching network-vif-plugged-8d51de2d-85b6-4a2f-80db-5fe69b8fd11b {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:38:48 user nova-compute[73572]: WARNING nova.compute.manager [req-d18efd44-3d10-47fc-be35-74d61cee5989 req-0fb261f4-b1e6-490f-9904-bf04771e34c2 service nova] [instance: d147974d-213d-4aa3-8d03-11b262f59dca] Received unexpected event network-vif-plugged-8d51de2d-85b6-4a2f-80db-5fe69b8fd11b for instance with vm_state deleted and task_state None.
Aug 26 10:38:50 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:38:51 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:38:56 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:38:58 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0dbcac4b-fffb-48cb-94fe-76239ba5ab76 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member] [instance: 0a8e064c-c6b0-4812-9d3a-04ba52b06bda] Calling os-brick to attach iSCSI Volume {{(pid=73572) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 10:38:58 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dbcac4b-fffb-48cb-94fe-76239ba5ab76 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc89c3d6a10>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:296d6d68-1757-43f5-b3d9-84182115b673'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nauWRohF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 10:38:58 user nova-compute[73572]: WARNING os_brick.initiator.connectors.base [None req-0dbcac4b-fffb-48cb-94fe-76239ba5ab76 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 10:38:58 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-0dbcac4b-fffb-48cb-94fe-76239ba5ab76 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 10:38:58 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-0dbcac4b-fffb-48cb-94fe-76239ba5ab76 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 10:38:58 user nova-compute[73572]: WARNING os_brick.initiator.connectors.base [None req-0dbcac4b-fffb-48cb-94fe-76239ba5ab76 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 10:38:58 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-0dbcac4b-fffb-48cb-94fe-76239ba5ab76 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:296d6d68-1757-43f5-b3d9-84182115b673" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 10:38:58 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-0dbcac4b-fffb-48cb-94fe-76239ba5ab76 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:296d6d68-1757-43f5-b3d9-84182115b673" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 10:38:58 user nova-compute[73572]: INFO os_brick.initiator.connectors.iscsi [None req-0dbcac4b-fffb-48cb-94fe-76239ba5ab76 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 10:38:58 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:296d6d68-1757-43f5-b3d9-84182115b673 -p 172.16.0.220:3260 {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:38:58 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:296d6d68-1757-43f5-b3d9-84182115b673 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:38:58 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9393b24-af20-4d5a-a7cf-bc539cd3de20]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:38:58 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dbcac4b-fffb-48cb-94fe-76239ba5ab76 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 10:38:58 user nova-compute[73572]:  {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:38:58 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:296d6d68-1757-43f5-b3d9-84182115b673 -p 172.16.0.220:3260 --interface default --op new {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:38:58 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:296d6d68-1757-43f5-b3d9-84182115b673 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:38:58 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fc7f868-5b11-45b8-92b2-a1a18fa57fa2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:296d6d68-1757-43f5-b3d9-84182115b673] added\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:38:58 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dbcac4b-fffb-48cb-94fe-76239ba5ab76 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:296d6d68-1757-43f5-b3d9-84182115b673] added
Aug 26 10:38:58 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:38:58 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:296d6d68-1757-43f5-b3d9-84182115b673 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:38:58 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:296d6d68-1757-43f5-b3d9-84182115b673 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:38:58 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc452cc5-bbb0-4db4-bd6f-74cb50d577d3]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:38:58 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dbcac4b-fffb-48cb-94fe-76239ba5ab76 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:38:58 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:296d6d68-1757-43f5-b3d9-84182115b673 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:38:58 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:296d6d68-1757-43f5-b3d9-84182115b673 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:38:58 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[cacc09ac-05ad-45cf-9a25-959c5a5bea25]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:38:58 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dbcac4b-fffb-48cb-94fe-76239ba5ab76 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:38:58 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:296d6d68-1757-43f5-b3d9-84182115b673 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nauWRohF {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:38:59 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:296d6d68-1757-43f5-b3d9-84182115b673 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nauWRohF" returned: 0 in 0.024s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:38:59 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[d64b1df4-9865-4bb6-be27-dbe79e6bfd2e]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:38:59 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dbcac4b-fffb-48cb-94fe-76239ba5ab76 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nauWRohF'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:38:59 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:296d6d68-1757-43f5-b3d9-84182115b673 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:38:59 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:296d6d68-1757-43f5-b3d9-84182115b673 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:38:59 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[55974285-e5cd-4bab-8c6d-2b988fdd6f14]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:38:59 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dbcac4b-fffb-48cb-94fe-76239ba5ab76 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:38:59 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:38:59 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:38:59 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2293512-8a4d-4ea0-842f-c69c23bf331d]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c17592e-3227-473f-ac7b-3e911dcb0d56 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad1b4b19-ad16-436c-9fa3-e718bea4f540 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd0cf5ab-073a-48cc-a05d-6a749cedf3a8 (non-flash)\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:38:59 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dbcac4b-fffb-48cb-94fe-76239ba5ab76 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c17592e-3227-473f-ac7b-3e911dcb0d56 (non-flash)
Aug 26 10:38:59 user nova-compute[73572]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad1b4b19-ad16-436c-9fa3-e718bea4f540 (non-flash)
Aug 26 10:38:59 user nova-compute[73572]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd0cf5ab-073a-48cc-a05d-6a749cedf3a8 (non-flash)
Aug 26 10:38:59 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 10:38:59 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dbcac4b-fffb-48cb-94fe-76239ba5ab76 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c17592e-3227-473f-ac7b-3e911dcb0d56 (non-flash)
Aug 26 10:38:59 user nova-compute[73572]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad1b4b19-ad16-436c-9fa3-e718bea4f540 (non-flash)
Aug 26 10:38:59 user nova-compute[73572]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd0cf5ab-073a-48cc-a05d-6a749cedf3a8 (non-flash)
Aug 26 10:38:59 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 10:38:59 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:296d6d68-1757-43f5-b3d9-84182115b673 -p 172.16.0.220:3260 --login {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:38:59 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:296d6d68-1757-43f5-b3d9-84182115b673 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:38:59 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[b04e665c-5a0c-4797-9135-2f0464ca3439]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:296d6d68-1757-43f5-b3d9-84182115b673, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:296d6d68-1757-43f5-b3d9-84182115b673, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:38:59 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dbcac4b-fffb-48cb-94fe-76239ba5ab76 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:296d6d68-1757-43f5-b3d9-84182115b673, portal: 172.16.0.220,3260]
Aug 26 10:38:59 user nova-compute[73572]: Login to [iface: default, target: iqn.2010-10.org.openstack:296d6d68-1757-43f5-b3d9-84182115b673, portal: 172.16.0.220,3260] successful.
Aug 26 10:38:59 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:38:59 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:296d6d68-1757-43f5-b3d9-84182115b673 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:38:59 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:296d6d68-1757-43f5-b3d9-84182115b673 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:38:59 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa7b5132-64e6-4890-9bbf-07b67ff97593]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:38:59 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dbcac4b-fffb-48cb-94fe-76239ba5ab76 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:38:59 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:38:59 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:38:59 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dc7e7ba-b92d-491c-b5e7-319d7b272674]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c17592e-3227-473f-ac7b-3e911dcb0d56 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad1b4b19-ad16-436c-9fa3-e718bea4f540 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd0cf5ab-073a-48cc-a05d-6a749cedf3a8 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:296d6d68-1757-43f5-b3d9-84182115b673 (non-flash)\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:38:59 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dbcac4b-fffb-48cb-94fe-76239ba5ab76 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c17592e-3227-473f-ac7b-3e911dcb0d56 (non-flash)
Aug 26 10:38:59 user nova-compute[73572]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad1b4b19-ad16-436c-9fa3-e718bea4f540 (non-flash)
Aug 26 10:38:59 user nova-compute[73572]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd0cf5ab-073a-48cc-a05d-6a749cedf3a8 (non-flash)
Aug 26 10:38:59 user nova-compute[73572]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:296d6d68-1757-43f5-b3d9-84182115b673 (non-flash)
Aug 26 10:38:59 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 10:38:59 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dbcac4b-fffb-48cb-94fe-76239ba5ab76 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c17592e-3227-473f-ac7b-3e911dcb0d56 (non-flash)
Aug 26 10:38:59 user nova-compute[73572]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad1b4b19-ad16-436c-9fa3-e718bea4f540 (non-flash)
Aug 26 10:38:59 user nova-compute[73572]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd0cf5ab-073a-48cc-a05d-6a749cedf3a8 (non-flash)
Aug 26 10:38:59 user nova-compute[73572]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:296d6d68-1757-43f5-b3d9-84182115b673 (non-flash)
Aug 26 10:38:59 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 10:38:59 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-0dbcac4b-fffb-48cb-94fe-76239ba5ab76 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:296d6d68-1757-43f5-b3d9-84182115b673" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.308s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 10:38:59 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dbcac4b-fffb-48cb-94fe-76239ba5ab76 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member] Connected to 172.16.0.220:3260 {{(pid=73572) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 10:38:59 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-0dbcac4b-fffb-48cb-94fe-76239ba5ab76 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member] HCTL ('36', '-', '-', 0) found on session 57 with lun 0 {{(pid=73572) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 10:38:59 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-0dbcac4b-fffb-48cb-94fe-76239ba5ab76 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73572) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 10:38:59 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:38:59 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:38:59 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae1c2cc8-47f8-4d7c-aaaf-3716928208ba]: (4, ('- - 0', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:38:59 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-0dbcac4b-fffb-48cb-94fe-76239ba5ab76 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member] Searching for a device in session 57 and hctl ['36', '*', '*', 0] yield: None {{(pid=73572) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 10:39:00 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-0dbcac4b-fffb-48cb-94fe-76239ba5ab76 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member] Searching for a device in session 57 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73572) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 10:39:00 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dbcac4b-fffb-48cb-94fe-76239ba5ab76 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nauWRohF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73572) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 10:39:00 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-0dbcac4b-fffb-48cb-94fe-76239ba5ab76 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.337s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 10:39:00 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dbcac4b-fffb-48cb-94fe-76239ba5ab76 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member] <== connect_volume: return (1338ms) {'type': 'block', 'scsi_wwn': '23830626139373630', 'path': '/dev/sde'} {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 10:39:00 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0dbcac4b-fffb-48cb-94fe-76239ba5ab76 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member] [instance: 0a8e064c-c6b0-4812-9d3a-04ba52b06bda] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23830626139373630', 'path': '/dev/sde'} {{(pid=73572) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 10:39:00 user nova-compute[73572]: DEBUG nova.objects.instance [None req-0dbcac4b-fffb-48cb-94fe-76239ba5ab76 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member] Lazy-loading 'flavor' on Instance uuid 0a8e064c-c6b0-4812-9d3a-04ba52b06bda {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:39:00 user nova-compute[73572]: DEBUG nova.virt.libvirt.guest [None req-0dbcac4b-fffb-48cb-94fe-76239ba5ab76 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 10:39:00 user nova-compute[73572]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 10:39:00 user nova-compute[73572]:   <source dev="/dev/sde"/>
Aug 26 10:39:00 user nova-compute[73572]:   <target dev="vdb" bus="virtio"/>
Aug 26 10:39:00 user nova-compute[73572]:   <serial>296d6d68-1757-43f5-b3d9-84182115b673</serial>
Aug 26 10:39:00 user nova-compute[73572]: </disk>
Aug 26 10:39:00 user nova-compute[73572]:  {{(pid=73572) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 10:39:00 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-0dbcac4b-fffb-48cb-94fe-76239ba5ab76 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member] No BDM found with device name vda, not building metadata. {{(pid=73572) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 10:39:00 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-0dbcac4b-fffb-48cb-94fe-76239ba5ab76 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73572) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 10:39:00 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-0dbcac4b-fffb-48cb-94fe-76239ba5ab76 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member] No VIF found with MAC fa:16:3e:47:ea:be, not building metadata {{(pid=73572) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 10:39:00 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:39:00 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-0dbcac4b-fffb-48cb-94fe-76239ba5ab76 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member] Lock "0a8e064c-c6b0-4812-9d3a-04ba52b06bda" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.907s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:39:01 user nova-compute[73572]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693046326.1958823, d147974d-213d-4aa3-8d03-11b262f59dca => Stopped> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:39:01 user nova-compute[73572]: INFO nova.compute.manager [-] [instance: d147974d-213d-4aa3-8d03-11b262f59dca] VM Stopped (Lifecycle Event)
Aug 26 10:39:01 user nova-compute[73572]: DEBUG nova.compute.manager [None req-725f730d-14fd-4d22-9369-44a1eded6692 None None] [instance: d147974d-213d-4aa3-8d03-11b262f59dca] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:39:01 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:39:03 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-fe99d651-2afb-46bc-a14b-e8d0bd8e8873 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member] Acquiring lock "0a8e064c-c6b0-4812-9d3a-04ba52b06bda" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:39:03 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-fe99d651-2afb-46bc-a14b-e8d0bd8e8873 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member] Lock "0a8e064c-c6b0-4812-9d3a-04ba52b06bda" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:39:03 user nova-compute[73572]: INFO nova.compute.manager [None req-fe99d651-2afb-46bc-a14b-e8d0bd8e8873 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member] [instance: 0a8e064c-c6b0-4812-9d3a-04ba52b06bda] Detaching volume 296d6d68-1757-43f5-b3d9-84182115b673
Aug 26 10:39:03 user nova-compute[73572]: INFO nova.virt.block_device [None req-fe99d651-2afb-46bc-a14b-e8d0bd8e8873 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member] [instance: 0a8e064c-c6b0-4812-9d3a-04ba52b06bda] Attempting to driver detach volume 296d6d68-1757-43f5-b3d9-84182115b673 from mountpoint /dev/vdb
Aug 26 10:39:03 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-fe99d651-2afb-46bc-a14b-e8d0bd8e8873 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member] Attempting to detach device vdb from instance 0a8e064c-c6b0-4812-9d3a-04ba52b06bda from the persistent domain config. {{(pid=73572) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 10:39:03 user nova-compute[73572]: DEBUG nova.virt.libvirt.guest [None req-fe99d651-2afb-46bc-a14b-e8d0bd8e8873 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 10:39:03 user nova-compute[73572]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 10:39:03 user nova-compute[73572]:   <source dev="/dev/sde"/>
Aug 26 10:39:03 user nova-compute[73572]:   <target dev="vdb" bus="virtio"/>
Aug 26 10:39:03 user nova-compute[73572]:   <serial>296d6d68-1757-43f5-b3d9-84182115b673</serial>
Aug 26 10:39:03 user nova-compute[73572]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 10:39:03 user nova-compute[73572]: </disk>
Aug 26 10:39:03 user nova-compute[73572]:  {{(pid=73572) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 10:39:03 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-fe99d651-2afb-46bc-a14b-e8d0bd8e8873 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member] Successfully detached device vdb from instance 0a8e064c-c6b0-4812-9d3a-04ba52b06bda from the persistent domain config.
Aug 26 10:39:03 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-fe99d651-2afb-46bc-a14b-e8d0bd8e8873 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0a8e064c-c6b0-4812-9d3a-04ba52b06bda from the live domain config. {{(pid=73572) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 10:39:03 user nova-compute[73572]: DEBUG nova.virt.libvirt.guest [None req-fe99d651-2afb-46bc-a14b-e8d0bd8e8873 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 10:39:03 user nova-compute[73572]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 10:39:03 user nova-compute[73572]:   <source dev="/dev/sde"/>
Aug 26 10:39:03 user nova-compute[73572]:   <target dev="vdb" bus="virtio"/>
Aug 26 10:39:03 user nova-compute[73572]:   <serial>296d6d68-1757-43f5-b3d9-84182115b673</serial>
Aug 26 10:39:03 user nova-compute[73572]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 10:39:03 user nova-compute[73572]: </disk>
Aug 26 10:39:03 user nova-compute[73572]:  {{(pid=73572) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 10:39:04 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Received event <DeviceRemovedEvent: 1693046344.0848458, 0a8e064c-c6b0-4812-9d3a-04ba52b06bda => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73572) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 10:39:04 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-fe99d651-2afb-46bc-a14b-e8d0bd8e8873 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0a8e064c-c6b0-4812-9d3a-04ba52b06bda {{(pid=73572) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 10:39:04 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-fe99d651-2afb-46bc-a14b-e8d0bd8e8873 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member] Successfully detached device vdb from instance 0a8e064c-c6b0-4812-9d3a-04ba52b06bda from the live domain config.
Aug 26 10:39:04 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fe99d651-2afb-46bc-a14b-e8d0bd8e8873 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member] [instance: 0a8e064c-c6b0-4812-9d3a-04ba52b06bda] calling os-brick to detach iSCSI Volume {{(pid=73572) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 10:39:04 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe99d651-2afb-46bc-a14b-e8d0bd8e8873 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc89c3d6a10>, {'target_iqns': ['iqn.2010-10.org.openstack:296d6d68-1757-43f5-b3d9-84182115b673'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nauWRohF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 10:39:04 user nova-compute[73572]: WARNING os_brick.initiator.connectors.base [None req-fe99d651-2afb-46bc-a14b-e8d0bd8e8873 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 10:39:04 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-fe99d651-2afb-46bc-a14b-e8d0bd8e8873 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 10:39:04 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-fe99d651-2afb-46bc-a14b-e8d0bd8e8873 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 10:39:04 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe99d651-2afb-46bc-a14b-e8d0bd8e8873 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:296d6d68-1757-43f5-b3d9-84182115b673', 0)] {{(pid=73572) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 10:39:04 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:39:04 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:39:04 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[79757d4e-805d-4f94-b9fe-87b02f032054]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:296d6d68-1757-43f5-b3d9-84182115b673\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6c17592e-3227-473f-ac7b-3e911dcb0d56\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ad1b4b19-ad16-436c-9fa3-e718bea4f540\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fd0cf5ab-073a-48cc-a05d-6a749cedf3a8\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:39:04 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:39:04 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:39:04 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[698000d7-1346-4a94-be59-948e7c581bde]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c17592e-3227-473f-ac7b-3e911dcb0d56 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad1b4b19-ad16-436c-9fa3-e718bea4f540 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd0cf5ab-073a-48cc-a05d-6a749cedf3a8 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:296d6d68-1757-43f5-b3d9-84182115b673 (non-flash)\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:39:04 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe99d651-2afb-46bc-a14b-e8d0bd8e8873 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c17592e-3227-473f-ac7b-3e911dcb0d56 (non-flash)
Aug 26 10:39:04 user nova-compute[73572]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad1b4b19-ad16-436c-9fa3-e718bea4f540 (non-flash)
Aug 26 10:39:04 user nova-compute[73572]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd0cf5ab-073a-48cc-a05d-6a749cedf3a8 (non-flash)
Aug 26 10:39:04 user nova-compute[73572]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:296d6d68-1757-43f5-b3d9-84182115b673 (non-flash)
Aug 26 10:39:04 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 10:39:04 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe99d651-2afb-46bc-a14b-e8d0bd8e8873 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c17592e-3227-473f-ac7b-3e911dcb0d56 (non-flash)
Aug 26 10:39:04 user nova-compute[73572]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad1b4b19-ad16-436c-9fa3-e718bea4f540 (non-flash)
Aug 26 10:39:04 user nova-compute[73572]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd0cf5ab-073a-48cc-a05d-6a749cedf3a8 (non-flash)
Aug 26 10:39:04 user nova-compute[73572]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:296d6d68-1757-43f5-b3d9-84182115b673 (non-flash)
Aug 26 10:39:04 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 10:39:04 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe99d651-2afb-46bc-a14b-e8d0bd8e8873 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc89c201240>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:296d6d68-1757-43f5-b3d9-84182115b673'): ({'sde'}, set())}) {{(pid=73572) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 10:39:04 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-fe99d651-2afb-46bc-a14b-e8d0bd8e8873 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member] Removing single pathed devices sde {{(pid=73572) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 10:39:04 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:39:04 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:39:04 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[154b38c1-d033-474f-b389-b5db5c491c46]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:39:04 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:39:04 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:39:04 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b09eb82-3ca6-4b5a-9ca3-3bcc7570f4ba]: (4, ('ok\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:39:04 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-fe99d651-2afb-46bc-a14b-e8d0bd8e8873 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member] Flushing IO for device /dev/sde {{(pid=73572) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 10:39:04 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:39:04 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:39:04 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[a85d4593-c1d2-4ee6-b440-81b8ebc28e9a]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:39:04 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-fe99d651-2afb-46bc-a14b-e8d0bd8e8873 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73572) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 10:39:04 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:39:04 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.027s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:39:04 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[933d4792-b3fb-4c94-92a6-c9d393e42f96]: (4, ('1', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:39:04 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-fe99d651-2afb-46bc-a14b-e8d0bd8e8873 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73572) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 10:39:04 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-fe99d651-2afb-46bc-a14b-e8d0bd8e8873 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member] SCSI volumes sde have been removed. {{(pid=73572) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 10:39:04 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe99d651-2afb-46bc-a14b-e8d0bd8e8873 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:296d6d68-1757-43f5-b3d9-84182115b673')] {{(pid=73572) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 10:39:04 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:296d6d68-1757-43f5-b3d9-84182115b673 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:39:04 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:296d6d68-1757-43f5-b3d9-84182115b673 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:39:04 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[0be34132-cd5d-4157-9c10-e78c274c395b]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:39:04 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe99d651-2afb-46bc-a14b-e8d0bd8e8873 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:39:04 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:296d6d68-1757-43f5-b3d9-84182115b673 -p 172.16.0.220:3260 --logout {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:39:04 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:296d6d68-1757-43f5-b3d9-84182115b673 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:39:04 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2f0bd77-0a84-4a28-b8eb-053b65a41a1f]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:296d6d68-1757-43f5-b3d9-84182115b673, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:296d6d68-1757-43f5-b3d9-84182115b673, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:39:04 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe99d651-2afb-46bc-a14b-e8d0bd8e8873 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:296d6d68-1757-43f5-b3d9-84182115b673, portal: 172.16.0.220,3260]
Aug 26 10:39:04 user nova-compute[73572]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:296d6d68-1757-43f5-b3d9-84182115b673, portal: 172.16.0.220,3260] successful.
Aug 26 10:39:04 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:39:04 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:296d6d68-1757-43f5-b3d9-84182115b673 -p 172.16.0.220:3260 --op delete {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:39:04 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:296d6d68-1757-43f5-b3d9-84182115b673 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:39:04 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc81217b-0d48-41b7-aa94-326f71d561e3]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:39:04 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe99d651-2afb-46bc-a14b-e8d0bd8e8873 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:39:04 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-fe99d651-2afb-46bc-a14b-e8d0bd8e8873 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.268s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 10:39:04 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe99d651-2afb-46bc-a14b-e8d0bd8e8873 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member] <== disconnect_volume: return (270ms) None {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 10:39:04 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fe99d651-2afb-46bc-a14b-e8d0bd8e8873 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member] [instance: 0a8e064c-c6b0-4812-9d3a-04ba52b06bda] Disconnected iSCSI Volume {{(pid=73572) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 10:39:05 user nova-compute[73572]: DEBUG nova.objects.instance [None req-fe99d651-2afb-46bc-a14b-e8d0bd8e8873 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member] Lazy-loading 'flavor' on Instance uuid 0a8e064c-c6b0-4812-9d3a-04ba52b06bda {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:39:05 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-fe99d651-2afb-46bc-a14b-e8d0bd8e8873 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member] Lock "0a8e064c-c6b0-4812-9d3a-04ba52b06bda" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.652s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:39:06 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:39:06 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:39:06 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73572) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 10:39:06 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73572) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 10:39:06 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73572) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 10:39:06 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:39:11 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:39:15 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:39:16 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:39:21 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:39:26 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:39:30 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-41fbb6b8-c102-44d0-99c7-5524393ef48c tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Acquiring lock "c457a41c-2ee2-4821-94cf-69c091589241" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:39:30 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-41fbb6b8-c102-44d0-99c7-5524393ef48c tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Lock "c457a41c-2ee2-4821-94cf-69c091589241" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:39:30 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-41fbb6b8-c102-44d0-99c7-5524393ef48c tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Acquiring lock "c457a41c-2ee2-4821-94cf-69c091589241-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:39:30 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-41fbb6b8-c102-44d0-99c7-5524393ef48c tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Lock "c457a41c-2ee2-4821-94cf-69c091589241-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:39:30 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-41fbb6b8-c102-44d0-99c7-5524393ef48c tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Lock "c457a41c-2ee2-4821-94cf-69c091589241-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:39:30 user nova-compute[73572]: INFO nova.compute.manager [None req-41fbb6b8-c102-44d0-99c7-5524393ef48c tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] [instance: c457a41c-2ee2-4821-94cf-69c091589241] Terminating instance
Aug 26 10:39:30 user nova-compute[73572]: DEBUG nova.compute.manager [None req-41fbb6b8-c102-44d0-99c7-5524393ef48c tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] [instance: c457a41c-2ee2-4821-94cf-69c091589241] Start destroying the instance on the hypervisor. {{(pid=73572) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 10:39:30 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:39:30 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:39:30 user nova-compute[73572]: DEBUG nova.compute.manager [req-7fcb07a0-b900-4776-9f18-147b465bbb92 req-13458efc-dbb0-433a-adc5-d67d2948824d service nova] [instance: 59206f70-2a59-44d2-b63a-0659416f2516] Received event network-changed-806d0596-a2f5-4dc8-97c0-126349257f2c {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:39:30 user nova-compute[73572]: DEBUG nova.compute.manager [req-7fcb07a0-b900-4776-9f18-147b465bbb92 req-13458efc-dbb0-433a-adc5-d67d2948824d service nova] [instance: 59206f70-2a59-44d2-b63a-0659416f2516] Refreshing instance network info cache due to event network-changed-806d0596-a2f5-4dc8-97c0-126349257f2c. {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 10:39:30 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-7fcb07a0-b900-4776-9f18-147b465bbb92 req-13458efc-dbb0-433a-adc5-d67d2948824d service nova] Acquiring lock "refresh_cache-59206f70-2a59-44d2-b63a-0659416f2516" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:39:30 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-7fcb07a0-b900-4776-9f18-147b465bbb92 req-13458efc-dbb0-433a-adc5-d67d2948824d service nova] Acquired lock "refresh_cache-59206f70-2a59-44d2-b63a-0659416f2516" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:39:30 user nova-compute[73572]: DEBUG nova.network.neutron [req-7fcb07a0-b900-4776-9f18-147b465bbb92 req-13458efc-dbb0-433a-adc5-d67d2948824d service nova] [instance: 59206f70-2a59-44d2-b63a-0659416f2516] Refreshing network info cache for port 806d0596-a2f5-4dc8-97c0-126349257f2c {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 10:39:30 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:39:30 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:39:30 user nova-compute[73572]: DEBUG nova.compute.manager [req-c18af152-b1e3-4b9a-8a11-24ab765e8ad1 req-aa72e4f5-95e9-4fe0-9968-29479a7db7e0 service nova] [instance: c457a41c-2ee2-4821-94cf-69c091589241] Received event network-vif-unplugged-deb899b2-ba04-427b-b4ea-a514b8eda260 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:39:30 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-c18af152-b1e3-4b9a-8a11-24ab765e8ad1 req-aa72e4f5-95e9-4fe0-9968-29479a7db7e0 service nova] Acquiring lock "c457a41c-2ee2-4821-94cf-69c091589241-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:39:30 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-c18af152-b1e3-4b9a-8a11-24ab765e8ad1 req-aa72e4f5-95e9-4fe0-9968-29479a7db7e0 service nova] Lock "c457a41c-2ee2-4821-94cf-69c091589241-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:39:30 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-c18af152-b1e3-4b9a-8a11-24ab765e8ad1 req-aa72e4f5-95e9-4fe0-9968-29479a7db7e0 service nova] Lock "c457a41c-2ee2-4821-94cf-69c091589241-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:39:30 user nova-compute[73572]: DEBUG nova.compute.manager [req-c18af152-b1e3-4b9a-8a11-24ab765e8ad1 req-aa72e4f5-95e9-4fe0-9968-29479a7db7e0 service nova] [instance: c457a41c-2ee2-4821-94cf-69c091589241] No waiting events found dispatching network-vif-unplugged-deb899b2-ba04-427b-b4ea-a514b8eda260 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:39:30 user nova-compute[73572]: DEBUG nova.compute.manager [req-c18af152-b1e3-4b9a-8a11-24ab765e8ad1 req-aa72e4f5-95e9-4fe0-9968-29479a7db7e0 service nova] [instance: c457a41c-2ee2-4821-94cf-69c091589241] Received event network-vif-unplugged-deb899b2-ba04-427b-b4ea-a514b8eda260 for instance with task_state deleting. {{(pid=73572) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 10:39:30 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:39:30 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:39:30 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Starting heal instance info cache {{(pid=73572) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 10:39:31 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:39:31 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:39:31 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquiring lock "refresh_cache-4039a8aa-b1a7-497d-b12c-6fcc12ab2b0a" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:39:31 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquired lock "refresh_cache-4039a8aa-b1a7-497d-b12c-6fcc12ab2b0a" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:39:31 user nova-compute[73572]: DEBUG nova.network.neutron [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] [instance: 4039a8aa-b1a7-497d-b12c-6fcc12ab2b0a] Forcefully refreshing network info cache for instance {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 10:39:31 user nova-compute[73572]: INFO nova.virt.libvirt.driver [-] [instance: c457a41c-2ee2-4821-94cf-69c091589241] Instance destroyed successfully.
Aug 26 10:39:31 user nova-compute[73572]: DEBUG nova.objects.instance [None req-41fbb6b8-c102-44d0-99c7-5524393ef48c tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Lazy-loading 'resources' on Instance uuid c457a41c-2ee2-4821-94cf-69c091589241 {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:39:31 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-41fbb6b8-c102-44d0-99c7-5524393ef48c tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T10:32:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1008830200',display_name='tempest-ServerActionsTestOtherA-server-1008830200',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1008830200',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAGb4Psy4ujnztu6TKM5Yp0ao9Inx8XINL8TB7yqpPrX8pvyhV645/PRion/tWXE5RcABz76j3Pw1BeejHEQh0n16o5OpRaXWd84Wj12hPmfoj80ST4I1EIx+wC0wImDFQ==',key_name='tempest-keypair-598298583',keypairs=<?>,launch_index=0,launched_at=2023-08-26T10:35:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7935bccc360b46b589fd57d53f334595',ramdisk_id='',reservation_id='r-dee3c84h',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-203628695',owner_user_name='tempest-ServerActionsTestOtherA-203628695-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T10:36:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='61b6124f6f6e44c5b2fd0202a15da019',uuid=c457a41c-2ee2-4821-94cf-69c091589241,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "deb899b2-ba04-427b-b4ea-a514b8eda260", "address": "fa:16:3e:05:c8:e3", "network": {"id": "43215883-3d00-4be7-8c40-bdaf3f01bef9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1088544153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7935bccc360b46b589fd57d53f334595", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdeb899b2-ba", "ovs_interfaceid": "deb899b2-ba04-427b-b4ea-a514b8eda260", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 10:39:31 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-41fbb6b8-c102-44d0-99c7-5524393ef48c tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Converting VIF {"id": "deb899b2-ba04-427b-b4ea-a514b8eda260", "address": "fa:16:3e:05:c8:e3", "network": {"id": "43215883-3d00-4be7-8c40-bdaf3f01bef9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1088544153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7935bccc360b46b589fd57d53f334595", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdeb899b2-ba", "ovs_interfaceid": "deb899b2-ba04-427b-b4ea-a514b8eda260", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:39:31 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-41fbb6b8-c102-44d0-99c7-5524393ef48c tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:05:c8:e3,bridge_name='br-int',has_traffic_filtering=True,id=deb899b2-ba04-427b-b4ea-a514b8eda260,network=Network(43215883-3d00-4be7-8c40-bdaf3f01bef9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdeb899b2-ba') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:39:31 user nova-compute[73572]: DEBUG os_vif [None req-41fbb6b8-c102-44d0-99c7-5524393ef48c tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:05:c8:e3,bridge_name='br-int',has_traffic_filtering=True,id=deb899b2-ba04-427b-b4ea-a514b8eda260,network=Network(43215883-3d00-4be7-8c40-bdaf3f01bef9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdeb899b2-ba') {{(pid=73572) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 10:39:31 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:39:31 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdeb899b2-ba, bridge=br-int, if_exists=True) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:39:31 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:39:31 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:39:31 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:39:31 user nova-compute[73572]: INFO os_vif [None req-41fbb6b8-c102-44d0-99c7-5524393ef48c tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:05:c8:e3,bridge_name='br-int',has_traffic_filtering=True,id=deb899b2-ba04-427b-b4ea-a514b8eda260,network=Network(43215883-3d00-4be7-8c40-bdaf3f01bef9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdeb899b2-ba')
Aug 26 10:39:31 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-41fbb6b8-c102-44d0-99c7-5524393ef48c tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] [instance: c457a41c-2ee2-4821-94cf-69c091589241] calling os-brick to detach iSCSI Volume {{(pid=73572) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 10:39:31 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-41fbb6b8-c102-44d0-99c7-5524393ef48c tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc89c3d6a10>, {'target_iqns': ['iqn.2010-10.org.openstack:6c17592e-3227-473f-ac7b-3e911dcb0d56'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QlxWrapc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 10:39:31 user nova-compute[73572]: WARNING os_brick.initiator.connectors.base [None req-41fbb6b8-c102-44d0-99c7-5524393ef48c tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 10:39:31 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-41fbb6b8-c102-44d0-99c7-5524393ef48c tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 10:39:31 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-41fbb6b8-c102-44d0-99c7-5524393ef48c tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 10:39:31 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-41fbb6b8-c102-44d0-99c7-5524393ef48c tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6c17592e-3227-473f-ac7b-3e911dcb0d56', 0)] {{(pid=73572) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 10:39:31 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:39:31 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:39:31 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee77ed76-d18c-47fd-87c3-7de0dcca2abd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6c17592e-3227-473f-ac7b-3e911dcb0d56\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ad1b4b19-ad16-436c-9fa3-e718bea4f540\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fd0cf5ab-073a-48cc-a05d-6a749cedf3a8\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:39:31 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:39:31 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:39:31 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[b281d811-43ba-45d9-b5cb-b237963dc5a8]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c17592e-3227-473f-ac7b-3e911dcb0d56 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad1b4b19-ad16-436c-9fa3-e718bea4f540 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd0cf5ab-073a-48cc-a05d-6a749cedf3a8 (non-flash)\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:39:31 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-41fbb6b8-c102-44d0-99c7-5524393ef48c tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c17592e-3227-473f-ac7b-3e911dcb0d56 (non-flash)
Aug 26 10:39:31 user nova-compute[73572]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad1b4b19-ad16-436c-9fa3-e718bea4f540 (non-flash)
Aug 26 10:39:31 user nova-compute[73572]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd0cf5ab-073a-48cc-a05d-6a749cedf3a8 (non-flash)
Aug 26 10:39:31 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 10:39:31 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-41fbb6b8-c102-44d0-99c7-5524393ef48c tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c17592e-3227-473f-ac7b-3e911dcb0d56 (non-flash)
Aug 26 10:39:31 user nova-compute[73572]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad1b4b19-ad16-436c-9fa3-e718bea4f540 (non-flash)
Aug 26 10:39:31 user nova-compute[73572]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd0cf5ab-073a-48cc-a05d-6a749cedf3a8 (non-flash)
Aug 26 10:39:31 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 10:39:31 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-41fbb6b8-c102-44d0-99c7-5524393ef48c tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc878b05d80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6c17592e-3227-473f-ac7b-3e911dcb0d56'): ({'sdb'}, set())}) {{(pid=73572) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 10:39:31 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-41fbb6b8-c102-44d0-99c7-5524393ef48c tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Removing single pathed devices sdb {{(pid=73572) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 10:39:31 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:39:31 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:39:31 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[966481ab-37b7-4265-af08-04c45d6dc6c8]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:39:31 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:39:31 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.031s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:39:31 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7b1f39d-69cb-4148-88f0-17a98e2c0235]: (4, ('ok\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:39:31 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-41fbb6b8-c102-44d0-99c7-5524393ef48c tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Flushing IO for device /dev/sdb {{(pid=73572) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 10:39:31 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:39:31 user nova-compute[73572]: DEBUG nova.network.neutron [req-7fcb07a0-b900-4776-9f18-147b465bbb92 req-13458efc-dbb0-433a-adc5-d67d2948824d service nova] [instance: 59206f70-2a59-44d2-b63a-0659416f2516] Updated VIF entry in instance network info cache for port 806d0596-a2f5-4dc8-97c0-126349257f2c. {{(pid=73572) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 10:39:31 user nova-compute[73572]: DEBUG nova.network.neutron [req-7fcb07a0-b900-4776-9f18-147b465bbb92 req-13458efc-dbb0-433a-adc5-d67d2948824d service nova] [instance: 59206f70-2a59-44d2-b63a-0659416f2516] Updating instance_info_cache with network_info: [{"id": "806d0596-a2f5-4dc8-97c0-126349257f2c", "address": "fa:16:3e:c0:0c:2a", "network": {"id": "c520ee18-34a7-4781-bc97-419e9a702d40", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-280196989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfc130586d9f4581953f1b8ae1c4465e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap806d0596-a2", "ovs_interfaceid": "806d0596-a2f5-4dc8-97c0-126349257f2c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:39:31 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.023s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:39:31 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[a56a5404-0554-4d70-99d3-1d78cbef9514]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:39:31 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-41fbb6b8-c102-44d0-99c7-5524393ef48c tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73572) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 10:39:31 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:39:31 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-7fcb07a0-b900-4776-9f18-147b465bbb92 req-13458efc-dbb0-433a-adc5-d67d2948824d service nova] Releasing lock "refresh_cache-59206f70-2a59-44d2-b63a-0659416f2516" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:39:31 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.069s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:39:31 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e9622c4-f603-4389-83a0-1510563d0172]: (4, ('1', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:39:31 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-41fbb6b8-c102-44d0-99c7-5524393ef48c tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73572) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 10:39:31 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-41fbb6b8-c102-44d0-99c7-5524393ef48c tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] SCSI volumes sdb have been removed. {{(pid=73572) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 10:39:31 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-41fbb6b8-c102-44d0-99c7-5524393ef48c tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6c17592e-3227-473f-ac7b-3e911dcb0d56')] {{(pid=73572) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 10:39:31 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c17592e-3227-473f-ac7b-3e911dcb0d56 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:39:31 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c17592e-3227-473f-ac7b-3e911dcb0d56 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:39:31 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[8febadba-ccc9-4de6-9b08-a0dac6575ed7]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:39:31 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-41fbb6b8-c102-44d0-99c7-5524393ef48c tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:39:31 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c17592e-3227-473f-ac7b-3e911dcb0d56 -p 172.16.0.220:3260 --logout {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:39:31 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c17592e-3227-473f-ac7b-3e911dcb0d56 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:39:31 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd160bf2-94f8-4dc3-bb2d-e881f0419c7d]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:6c17592e-3227-473f-ac7b-3e911dcb0d56, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:6c17592e-3227-473f-ac7b-3e911dcb0d56, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:39:31 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-41fbb6b8-c102-44d0-99c7-5524393ef48c tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:6c17592e-3227-473f-ac7b-3e911dcb0d56, portal: 172.16.0.220,3260]
Aug 26 10:39:31 user nova-compute[73572]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:6c17592e-3227-473f-ac7b-3e911dcb0d56, portal: 172.16.0.220,3260] successful.
Aug 26 10:39:31 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:39:31 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c17592e-3227-473f-ac7b-3e911dcb0d56 -p 172.16.0.220:3260 --op delete {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:39:31 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c17592e-3227-473f-ac7b-3e911dcb0d56 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:39:31 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[2197bb6f-92ee-4980-80db-51c6fada153e]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:39:31 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-41fbb6b8-c102-44d0-99c7-5524393ef48c tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:39:31 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-41fbb6b8-c102-44d0-99c7-5524393ef48c tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.357s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 10:39:31 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-41fbb6b8-c102-44d0-99c7-5524393ef48c tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] <== disconnect_volume: return (359ms) None {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 10:39:31 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-41fbb6b8-c102-44d0-99c7-5524393ef48c tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] [instance: c457a41c-2ee2-4821-94cf-69c091589241] Disconnected iSCSI Volume {{(pid=73572) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 10:39:31 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-41fbb6b8-c102-44d0-99c7-5524393ef48c tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] [instance: c457a41c-2ee2-4821-94cf-69c091589241] Deleting instance files /opt/stack/data/nova/instances/c457a41c-2ee2-4821-94cf-69c091589241_del
Aug 26 10:39:31 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-41fbb6b8-c102-44d0-99c7-5524393ef48c tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] [instance: c457a41c-2ee2-4821-94cf-69c091589241] Deletion of /opt/stack/data/nova/instances/c457a41c-2ee2-4821-94cf-69c091589241_del complete
Aug 26 10:39:31 user nova-compute[73572]: INFO nova.compute.manager [None req-41fbb6b8-c102-44d0-99c7-5524393ef48c tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] [instance: c457a41c-2ee2-4821-94cf-69c091589241] Took 1.28 seconds to destroy the instance on the hypervisor.
Aug 26 10:39:31 user nova-compute[73572]: DEBUG oslo.service.loopingcall [None req-41fbb6b8-c102-44d0-99c7-5524393ef48c tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73572) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 10:39:31 user nova-compute[73572]: DEBUG nova.compute.manager [-] [instance: c457a41c-2ee2-4821-94cf-69c091589241] Deallocating network for instance {{(pid=73572) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 10:39:31 user nova-compute[73572]: DEBUG nova.network.neutron [-] [instance: c457a41c-2ee2-4821-94cf-69c091589241] deallocate_for_instance() {{(pid=73572) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 10:39:31 user nova-compute[73572]: DEBUG nova.network.neutron [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] [instance: 4039a8aa-b1a7-497d-b12c-6fcc12ab2b0a] Updating instance_info_cache with network_info: [{"id": "316fd822-b966-44d8-8147-5025d918f270", "address": "fa:16:3e:0f:a1:92", "network": {"id": "c520ee18-34a7-4781-bc97-419e9a702d40", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-280196989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfc130586d9f4581953f1b8ae1c4465e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap316fd822-b9", "ovs_interfaceid": "316fd822-b966-44d8-8147-5025d918f270", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:39:31 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Releasing lock "refresh_cache-4039a8aa-b1a7-497d-b12c-6fcc12ab2b0a" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:39:31 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] [instance: 4039a8aa-b1a7-497d-b12c-6fcc12ab2b0a] Updated the network info_cache for instance {{(pid=73572) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 10:39:31 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:39:31 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:39:31 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-d442b0ff-0295-4f64-97c2-d69ee8e254dd tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Acquiring lock "59206f70-2a59-44d2-b63a-0659416f2516" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:39:31 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-d442b0ff-0295-4f64-97c2-d69ee8e254dd tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Lock "59206f70-2a59-44d2-b63a-0659416f2516" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:39:31 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-d442b0ff-0295-4f64-97c2-d69ee8e254dd tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Acquiring lock "59206f70-2a59-44d2-b63a-0659416f2516-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:39:31 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-d442b0ff-0295-4f64-97c2-d69ee8e254dd tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Lock "59206f70-2a59-44d2-b63a-0659416f2516-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:39:31 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-d442b0ff-0295-4f64-97c2-d69ee8e254dd tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Lock "59206f70-2a59-44d2-b63a-0659416f2516-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:39:31 user nova-compute[73572]: INFO nova.compute.manager [None req-d442b0ff-0295-4f64-97c2-d69ee8e254dd tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 59206f70-2a59-44d2-b63a-0659416f2516] Terminating instance
Aug 26 10:39:31 user nova-compute[73572]: DEBUG nova.compute.manager [None req-d442b0ff-0295-4f64-97c2-d69ee8e254dd tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 59206f70-2a59-44d2-b63a-0659416f2516] Start destroying the instance on the hypervisor. {{(pid=73572) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 10:39:31 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:39:32 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:39:32 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:39:32 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:39:32 user nova-compute[73572]: DEBUG nova.compute.manager [req-fe6e7af8-0ecc-4eeb-80c6-7b2a47c7c00b req-0a884f14-ee12-4ff4-a016-98a6f842509d service nova] [instance: 59206f70-2a59-44d2-b63a-0659416f2516] Received event network-changed-806d0596-a2f5-4dc8-97c0-126349257f2c {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:39:32 user nova-compute[73572]: DEBUG nova.compute.manager [req-fe6e7af8-0ecc-4eeb-80c6-7b2a47c7c00b req-0a884f14-ee12-4ff4-a016-98a6f842509d service nova] [instance: 59206f70-2a59-44d2-b63a-0659416f2516] Refreshing instance network info cache due to event network-changed-806d0596-a2f5-4dc8-97c0-126349257f2c. {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 10:39:32 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-fe6e7af8-0ecc-4eeb-80c6-7b2a47c7c00b req-0a884f14-ee12-4ff4-a016-98a6f842509d service nova] Acquiring lock "refresh_cache-59206f70-2a59-44d2-b63a-0659416f2516" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:39:32 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-fe6e7af8-0ecc-4eeb-80c6-7b2a47c7c00b req-0a884f14-ee12-4ff4-a016-98a6f842509d service nova] Acquired lock "refresh_cache-59206f70-2a59-44d2-b63a-0659416f2516" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:39:32 user nova-compute[73572]: DEBUG nova.network.neutron [req-fe6e7af8-0ecc-4eeb-80c6-7b2a47c7c00b req-0a884f14-ee12-4ff4-a016-98a6f842509d service nova] [instance: 59206f70-2a59-44d2-b63a-0659416f2516] Refreshing network info cache for port 806d0596-a2f5-4dc8-97c0-126349257f2c {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 10:39:32 user nova-compute[73572]: INFO nova.virt.libvirt.driver [-] [instance: 59206f70-2a59-44d2-b63a-0659416f2516] Instance destroyed successfully.
Aug 26 10:39:32 user nova-compute[73572]: DEBUG nova.objects.instance [None req-d442b0ff-0295-4f64-97c2-d69ee8e254dd tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Lazy-loading 'resources' on Instance uuid 59206f70-2a59-44d2-b63a-0659416f2516 {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:39:32 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-d442b0ff-0295-4f64-97c2-d69ee8e254dd tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T10:37:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-978021940',display_name='tempest-TestVolumeBootPattern-server-978021940',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-978021940',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGgJMPcylFVXjDKqyW+etneKzTtQZ3h+rrNV9oGL9oH9Pq5o1BgNVxyCABCwPtuWnsI0hTQA59VGxuIY4NbTGf1rbJaGRZw/AtW9ND3j+IG9u2og6CdZ4G3lJYm/FnK6hA==',key_name='tempest-TestVolumeBootPattern-2036222457',keypairs=<?>,launch_index=0,launched_at=2023-08-26T10:37:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cfc130586d9f4581953f1b8ae1c4465e',ramdisk_id='',reservation_id='r-fv9n299q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-73786062',owner_user_name='tempest-TestVolumeBootPattern-73786062-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T10:37:56Z,user_data=None,user_id='e1e80942e5db41c782bda686b10e2e4b',uuid=59206f70-2a59-44d2-b63a-0659416f2516,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "806d0596-a2f5-4dc8-97c0-126349257f2c", "address": "fa:16:3e:c0:0c:2a", "network": {"id": "c520ee18-34a7-4781-bc97-419e9a702d40", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-280196989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfc130586d9f4581953f1b8ae1c4465e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap806d0596-a2", "ovs_interfaceid": "806d0596-a2f5-4dc8-97c0-126349257f2c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 10:39:32 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-d442b0ff-0295-4f64-97c2-d69ee8e254dd tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Converting VIF {"id": "806d0596-a2f5-4dc8-97c0-126349257f2c", "address": "fa:16:3e:c0:0c:2a", "network": {"id": "c520ee18-34a7-4781-bc97-419e9a702d40", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-280196989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfc130586d9f4581953f1b8ae1c4465e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap806d0596-a2", "ovs_interfaceid": "806d0596-a2f5-4dc8-97c0-126349257f2c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:39:32 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-d442b0ff-0295-4f64-97c2-d69ee8e254dd tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c0:0c:2a,bridge_name='br-int',has_traffic_filtering=True,id=806d0596-a2f5-4dc8-97c0-126349257f2c,network=Network(c520ee18-34a7-4781-bc97-419e9a702d40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap806d0596-a2') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:39:32 user nova-compute[73572]: DEBUG os_vif [None req-d442b0ff-0295-4f64-97c2-d69ee8e254dd tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c0:0c:2a,bridge_name='br-int',has_traffic_filtering=True,id=806d0596-a2f5-4dc8-97c0-126349257f2c,network=Network(c520ee18-34a7-4781-bc97-419e9a702d40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap806d0596-a2') {{(pid=73572) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 10:39:32 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:39:32 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap806d0596-a2, bridge=br-int, if_exists=True) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:39:32 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:39:32 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:39:32 user nova-compute[73572]: INFO os_vif [None req-d442b0ff-0295-4f64-97c2-d69ee8e254dd tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c0:0c:2a,bridge_name='br-int',has_traffic_filtering=True,id=806d0596-a2f5-4dc8-97c0-126349257f2c,network=Network(c520ee18-34a7-4781-bc97-419e9a702d40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap806d0596-a2')
Aug 26 10:39:32 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d442b0ff-0295-4f64-97c2-d69ee8e254dd tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 59206f70-2a59-44d2-b63a-0659416f2516] calling os-brick to detach iSCSI Volume {{(pid=73572) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 10:39:32 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-d442b0ff-0295-4f64-97c2-d69ee8e254dd tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc89c3d6a10>, {'target_iqns': ['iqn.2010-10.org.openstack:fd0cf5ab-073a-48cc-a05d-6a749cedf3a8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ImoDusjg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 10:39:32 user nova-compute[73572]: WARNING os_brick.initiator.connectors.base [None req-d442b0ff-0295-4f64-97c2-d69ee8e254dd tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 10:39:32 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-d442b0ff-0295-4f64-97c2-d69ee8e254dd tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 10:39:32 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-d442b0ff-0295-4f64-97c2-d69ee8e254dd tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 10:39:32 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-d442b0ff-0295-4f64-97c2-d69ee8e254dd tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fd0cf5ab-073a-48cc-a05d-6a749cedf3a8', 0)] {{(pid=73572) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 10:39:32 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:39:32 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:39:32 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[72116a43-a727-4cde-8118-fadaefe93922]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ad1b4b19-ad16-436c-9fa3-e718bea4f540\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fd0cf5ab-073a-48cc-a05d-6a749cedf3a8\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:39:32 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:39:32 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:39:32 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[437b7d5c-8752-4c2c-9cb3-46a3804c107d]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad1b4b19-ad16-436c-9fa3-e718bea4f540 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd0cf5ab-073a-48cc-a05d-6a749cedf3a8 (non-flash)\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:39:32 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-d442b0ff-0295-4f64-97c2-d69ee8e254dd tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad1b4b19-ad16-436c-9fa3-e718bea4f540 (non-flash)
Aug 26 10:39:32 user nova-compute[73572]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd0cf5ab-073a-48cc-a05d-6a749cedf3a8 (non-flash)
Aug 26 10:39:32 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 10:39:32 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-d442b0ff-0295-4f64-97c2-d69ee8e254dd tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad1b4b19-ad16-436c-9fa3-e718bea4f540 (non-flash)
Aug 26 10:39:32 user nova-compute[73572]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd0cf5ab-073a-48cc-a05d-6a749cedf3a8 (non-flash)
Aug 26 10:39:32 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 10:39:32 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-d442b0ff-0295-4f64-97c2-d69ee8e254dd tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc89c5f7520>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fd0cf5ab-073a-48cc-a05d-6a749cedf3a8'): ({'sdd'}, set())}) {{(pid=73572) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 10:39:32 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-d442b0ff-0295-4f64-97c2-d69ee8e254dd tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Removing single pathed devices sdd {{(pid=73572) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 10:39:32 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:39:32 user nova-compute[73572]: DEBUG nova.compute.manager [req-2a642e6e-2083-456e-b4e3-5a3b07306e2d req-3f432ca5-54e1-4fee-80a8-69f9c47d3e6c service nova] [instance: c457a41c-2ee2-4821-94cf-69c091589241] Received event network-vif-plugged-deb899b2-ba04-427b-b4ea-a514b8eda260 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:39:32 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-2a642e6e-2083-456e-b4e3-5a3b07306e2d req-3f432ca5-54e1-4fee-80a8-69f9c47d3e6c service nova] Acquiring lock "c457a41c-2ee2-4821-94cf-69c091589241-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:39:32 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-2a642e6e-2083-456e-b4e3-5a3b07306e2d req-3f432ca5-54e1-4fee-80a8-69f9c47d3e6c service nova] Lock "c457a41c-2ee2-4821-94cf-69c091589241-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:39:32 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-2a642e6e-2083-456e-b4e3-5a3b07306e2d req-3f432ca5-54e1-4fee-80a8-69f9c47d3e6c service nova] Lock "c457a41c-2ee2-4821-94cf-69c091589241-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:39:32 user nova-compute[73572]: DEBUG nova.compute.manager [req-2a642e6e-2083-456e-b4e3-5a3b07306e2d req-3f432ca5-54e1-4fee-80a8-69f9c47d3e6c service nova] [instance: c457a41c-2ee2-4821-94cf-69c091589241] No waiting events found dispatching network-vif-plugged-deb899b2-ba04-427b-b4ea-a514b8eda260 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:39:32 user nova-compute[73572]: WARNING nova.compute.manager [req-2a642e6e-2083-456e-b4e3-5a3b07306e2d req-3f432ca5-54e1-4fee-80a8-69f9c47d3e6c service nova] [instance: c457a41c-2ee2-4821-94cf-69c091589241] Received unexpected event network-vif-plugged-deb899b2-ba04-427b-b4ea-a514b8eda260 for instance with vm_state active and task_state deleting.
Aug 26 10:39:32 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:39:32 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[53002d79-25c7-4e9f-9126-b10d8ebc7292]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:39:32 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:39:32 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.022s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:39:32 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[610a658b-d8c3-463a-917f-0099d6300897]: (4, ('ok\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:39:32 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-d442b0ff-0295-4f64-97c2-d69ee8e254dd tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Flushing IO for device /dev/sdd {{(pid=73572) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 10:39:32 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:39:32 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:39:32 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b9a890f-cae2-4b4e-9cd7-7bb9a7ac3814]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:39:32 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-d442b0ff-0295-4f64-97c2-d69ee8e254dd tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73572) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 10:39:32 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:39:32 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.062s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:39:32 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[40991ddd-fb13-4b15-805b-06ffcdbdaee4]: (4, ('1', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:39:32 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-d442b0ff-0295-4f64-97c2-d69ee8e254dd tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73572) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 10:39:32 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-d442b0ff-0295-4f64-97c2-d69ee8e254dd tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] SCSI volumes sdd have been removed. {{(pid=73572) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 10:39:32 user nova-compute[73572]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23664613763323363', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_21e060b8', '/dev/disk/by-id/scsi-1SCST_BIO21e060b8-6da7c23c4d2e3dfd') {{(pid=84543) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 26 10:39:32 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[86276f84-1d57-48f7-8ab4-46afd2e861d8]: (4, None) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:39:32 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-d442b0ff-0295-4f64-97c2-d69ee8e254dd tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fd0cf5ab-073a-48cc-a05d-6a749cedf3a8')] {{(pid=73572) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 10:39:32 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd0cf5ab-073a-48cc-a05d-6a749cedf3a8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:39:32 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd0cf5ab-073a-48cc-a05d-6a749cedf3a8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:39:32 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fe7d5c6-55ed-4008-b649-1df398c94535]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:39:32 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-d442b0ff-0295-4f64-97c2-d69ee8e254dd tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:39:32 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd0cf5ab-073a-48cc-a05d-6a749cedf3a8 -p 172.16.0.220:3260 --logout {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:39:33 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd0cf5ab-073a-48cc-a05d-6a749cedf3a8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:39:33 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[f854a113-3b85-40f1-9d19-0856fcc656f9]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:fd0cf5ab-073a-48cc-a05d-6a749cedf3a8, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:fd0cf5ab-073a-48cc-a05d-6a749cedf3a8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:39:33 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-d442b0ff-0295-4f64-97c2-d69ee8e254dd tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:fd0cf5ab-073a-48cc-a05d-6a749cedf3a8, portal: 172.16.0.220,3260]
Aug 26 10:39:33 user nova-compute[73572]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:fd0cf5ab-073a-48cc-a05d-6a749cedf3a8, portal: 172.16.0.220,3260] successful.
Aug 26 10:39:33 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:39:33 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd0cf5ab-073a-48cc-a05d-6a749cedf3a8 -p 172.16.0.220:3260 --op delete {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:39:33 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd0cf5ab-073a-48cc-a05d-6a749cedf3a8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:39:33 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[acdbc781-92e3-4a6c-9a3d-6dd381d3c107]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:39:33 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-d442b0ff-0295-4f64-97c2-d69ee8e254dd tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:39:33 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-d442b0ff-0295-4f64-97c2-d69ee8e254dd tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.328s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 10:39:33 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-d442b0ff-0295-4f64-97c2-d69ee8e254dd tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] <== disconnect_volume: return (329ms) None {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 10:39:33 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d442b0ff-0295-4f64-97c2-d69ee8e254dd tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 59206f70-2a59-44d2-b63a-0659416f2516] Disconnected iSCSI Volume {{(pid=73572) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 10:39:33 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-d442b0ff-0295-4f64-97c2-d69ee8e254dd tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 59206f70-2a59-44d2-b63a-0659416f2516] Deleting instance files /opt/stack/data/nova/instances/59206f70-2a59-44d2-b63a-0659416f2516_del
Aug 26 10:39:33 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-d442b0ff-0295-4f64-97c2-d69ee8e254dd tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 59206f70-2a59-44d2-b63a-0659416f2516] Deletion of /opt/stack/data/nova/instances/59206f70-2a59-44d2-b63a-0659416f2516_del complete
Aug 26 10:39:33 user nova-compute[73572]: DEBUG nova.network.neutron [-] [instance: c457a41c-2ee2-4821-94cf-69c091589241] Updating instance_info_cache with network_info: [] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:39:33 user nova-compute[73572]: INFO nova.compute.manager [-] [instance: c457a41c-2ee2-4821-94cf-69c091589241] Took 1.49 seconds to deallocate network for instance.
Aug 26 10:39:33 user nova-compute[73572]: INFO nova.compute.manager [None req-d442b0ff-0295-4f64-97c2-d69ee8e254dd tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 59206f70-2a59-44d2-b63a-0659416f2516] Took 1.20 seconds to destroy the instance on the hypervisor.
Aug 26 10:39:33 user nova-compute[73572]: DEBUG oslo.service.loopingcall [None req-d442b0ff-0295-4f64-97c2-d69ee8e254dd tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73572) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 10:39:33 user nova-compute[73572]: DEBUG nova.compute.manager [-] [instance: 59206f70-2a59-44d2-b63a-0659416f2516] Deallocating network for instance {{(pid=73572) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 10:39:33 user nova-compute[73572]: DEBUG nova.network.neutron [-] [instance: 59206f70-2a59-44d2-b63a-0659416f2516] deallocate_for_instance() {{(pid=73572) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 10:39:33 user nova-compute[73572]: DEBUG nova.network.neutron [req-fe6e7af8-0ecc-4eeb-80c6-7b2a47c7c00b req-0a884f14-ee12-4ff4-a016-98a6f842509d service nova] [instance: 59206f70-2a59-44d2-b63a-0659416f2516] Updated VIF entry in instance network info cache for port 806d0596-a2f5-4dc8-97c0-126349257f2c. {{(pid=73572) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 10:39:33 user nova-compute[73572]: DEBUG nova.network.neutron [req-fe6e7af8-0ecc-4eeb-80c6-7b2a47c7c00b req-0a884f14-ee12-4ff4-a016-98a6f842509d service nova] [instance: 59206f70-2a59-44d2-b63a-0659416f2516] Updating instance_info_cache with network_info: [{"id": "806d0596-a2f5-4dc8-97c0-126349257f2c", "address": "fa:16:3e:c0:0c:2a", "network": {"id": "c520ee18-34a7-4781-bc97-419e9a702d40", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-280196989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfc130586d9f4581953f1b8ae1c4465e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap806d0596-a2", "ovs_interfaceid": "806d0596-a2f5-4dc8-97c0-126349257f2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:39:33 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-fe6e7af8-0ecc-4eeb-80c6-7b2a47c7c00b req-0a884f14-ee12-4ff4-a016-98a6f842509d service nova] Releasing lock "refresh_cache-59206f70-2a59-44d2-b63a-0659416f2516" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:39:33 user nova-compute[73572]: DEBUG nova.compute.manager [req-fe6e7af8-0ecc-4eeb-80c6-7b2a47c7c00b req-0a884f14-ee12-4ff4-a016-98a6f842509d service nova] [instance: 59206f70-2a59-44d2-b63a-0659416f2516] Received event network-vif-unplugged-806d0596-a2f5-4dc8-97c0-126349257f2c {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:39:33 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-fe6e7af8-0ecc-4eeb-80c6-7b2a47c7c00b req-0a884f14-ee12-4ff4-a016-98a6f842509d service nova] Acquiring lock "59206f70-2a59-44d2-b63a-0659416f2516-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:39:33 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-fe6e7af8-0ecc-4eeb-80c6-7b2a47c7c00b req-0a884f14-ee12-4ff4-a016-98a6f842509d service nova] Lock "59206f70-2a59-44d2-b63a-0659416f2516-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:39:33 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-fe6e7af8-0ecc-4eeb-80c6-7b2a47c7c00b req-0a884f14-ee12-4ff4-a016-98a6f842509d service nova] Lock "59206f70-2a59-44d2-b63a-0659416f2516-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:39:33 user nova-compute[73572]: DEBUG nova.compute.manager [req-fe6e7af8-0ecc-4eeb-80c6-7b2a47c7c00b req-0a884f14-ee12-4ff4-a016-98a6f842509d service nova] [instance: 59206f70-2a59-44d2-b63a-0659416f2516] No waiting events found dispatching network-vif-unplugged-806d0596-a2f5-4dc8-97c0-126349257f2c {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:39:33 user nova-compute[73572]: DEBUG nova.compute.manager [req-fe6e7af8-0ecc-4eeb-80c6-7b2a47c7c00b req-0a884f14-ee12-4ff4-a016-98a6f842509d service nova] [instance: 59206f70-2a59-44d2-b63a-0659416f2516] Received event network-vif-unplugged-806d0596-a2f5-4dc8-97c0-126349257f2c for instance with task_state deleting. {{(pid=73572) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 10:39:33 user nova-compute[73572]: DEBUG nova.network.neutron [-] [instance: 59206f70-2a59-44d2-b63a-0659416f2516] Updating instance_info_cache with network_info: [] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:39:33 user nova-compute[73572]: INFO nova.compute.manager [-] [instance: 59206f70-2a59-44d2-b63a-0659416f2516] Took 0.58 seconds to deallocate network for instance.
Aug 26 10:39:34 user nova-compute[73572]: INFO nova.compute.manager [None req-d442b0ff-0295-4f64-97c2-d69ee8e254dd tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 59206f70-2a59-44d2-b63a-0659416f2516] Took 0.76 seconds to detach 1 volumes for instance.
Aug 26 10:39:34 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-d442b0ff-0295-4f64-97c2-d69ee8e254dd tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:39:34 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-d442b0ff-0295-4f64-97c2-d69ee8e254dd tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:39:34 user nova-compute[73572]: DEBUG nova.compute.manager [req-432d034a-f340-4474-a26a-09b6471aad5b req-eef1891a-db3f-4def-8a68-52981462d6ea service nova] [instance: 59206f70-2a59-44d2-b63a-0659416f2516] Received event network-vif-plugged-806d0596-a2f5-4dc8-97c0-126349257f2c {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:39:34 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-432d034a-f340-4474-a26a-09b6471aad5b req-eef1891a-db3f-4def-8a68-52981462d6ea service nova] Acquiring lock "59206f70-2a59-44d2-b63a-0659416f2516-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:39:34 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-432d034a-f340-4474-a26a-09b6471aad5b req-eef1891a-db3f-4def-8a68-52981462d6ea service nova] Lock "59206f70-2a59-44d2-b63a-0659416f2516-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:39:34 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-432d034a-f340-4474-a26a-09b6471aad5b req-eef1891a-db3f-4def-8a68-52981462d6ea service nova] Lock "59206f70-2a59-44d2-b63a-0659416f2516-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:39:34 user nova-compute[73572]: DEBUG nova.compute.manager [req-432d034a-f340-4474-a26a-09b6471aad5b req-eef1891a-db3f-4def-8a68-52981462d6ea service nova] [instance: 59206f70-2a59-44d2-b63a-0659416f2516] No waiting events found dispatching network-vif-plugged-806d0596-a2f5-4dc8-97c0-126349257f2c {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:39:34 user nova-compute[73572]: WARNING nova.compute.manager [req-432d034a-f340-4474-a26a-09b6471aad5b req-eef1891a-db3f-4def-8a68-52981462d6ea service nova] [instance: 59206f70-2a59-44d2-b63a-0659416f2516] Received unexpected event network-vif-plugged-806d0596-a2f5-4dc8-97c0-126349257f2c for instance with vm_state deleted and task_state None.
Aug 26 10:39:34 user nova-compute[73572]: DEBUG nova.compute.manager [req-432d034a-f340-4474-a26a-09b6471aad5b req-eef1891a-db3f-4def-8a68-52981462d6ea service nova] [instance: c457a41c-2ee2-4821-94cf-69c091589241] Received event network-vif-deleted-deb899b2-ba04-427b-b4ea-a514b8eda260 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:39:34 user nova-compute[73572]: DEBUG nova.compute.manager [req-432d034a-f340-4474-a26a-09b6471aad5b req-eef1891a-db3f-4def-8a68-52981462d6ea service nova] [instance: 59206f70-2a59-44d2-b63a-0659416f2516] Received event network-vif-deleted-806d0596-a2f5-4dc8-97c0-126349257f2c {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:39:34 user nova-compute[73572]: DEBUG nova.compute.provider_tree [None req-d442b0ff-0295-4f64-97c2-d69ee8e254dd tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Inventory has not changed in ProviderTree for provider: e2cec974-59b2-4c77-a53d-a7f4e5a30d75 {{(pid=73572) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 10:39:34 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-d442b0ff-0295-4f64-97c2-d69ee8e254dd tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Inventory has not changed for provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73572) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 10:39:34 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-d442b0ff-0295-4f64-97c2-d69ee8e254dd tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.235s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:39:34 user nova-compute[73572]: INFO nova.scheduler.client.report [None req-d442b0ff-0295-4f64-97c2-d69ee8e254dd tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Deleted allocations for instance 59206f70-2a59-44d2-b63a-0659416f2516
Aug 26 10:39:34 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:39:34 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-d442b0ff-0295-4f64-97c2-d69ee8e254dd tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Lock "59206f70-2a59-44d2-b63a-0659416f2516" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.972s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:39:35 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:39:35 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:39:35 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73572) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 10:39:37 user nova-compute[73572]: INFO nova.compute.manager [None req-41fbb6b8-c102-44d0-99c7-5524393ef48c tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] [instance: c457a41c-2ee2-4821-94cf-69c091589241] Took 4.61 seconds to detach 1 volumes for instance.
Aug 26 10:39:37 user nova-compute[73572]: DEBUG nova.compute.manager [None req-41fbb6b8-c102-44d0-99c7-5524393ef48c tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] [instance: c457a41c-2ee2-4821-94cf-69c091589241] Deleting volume: 6c17592e-3227-473f-ac7b-3e911dcb0d56 {{(pid=73572) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 26 10:39:37 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:39:37 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-41fbb6b8-c102-44d0-99c7-5524393ef48c tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:39:37 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-41fbb6b8-c102-44d0-99c7-5524393ef48c tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:39:37 user nova-compute[73572]: DEBUG nova.compute.provider_tree [None req-41fbb6b8-c102-44d0-99c7-5524393ef48c tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Inventory has not changed in ProviderTree for provider: e2cec974-59b2-4c77-a53d-a7f4e5a30d75 {{(pid=73572) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 10:39:37 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-41fbb6b8-c102-44d0-99c7-5524393ef48c tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Inventory has not changed for provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73572) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 10:39:37 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-41fbb6b8-c102-44d0-99c7-5524393ef48c tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.173s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:39:38 user nova-compute[73572]: INFO nova.scheduler.client.report [None req-41fbb6b8-c102-44d0-99c7-5524393ef48c tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Deleted allocations for instance c457a41c-2ee2-4821-94cf-69c091589241
Aug 26 10:39:38 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-41fbb6b8-c102-44d0-99c7-5524393ef48c tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Lock "c457a41c-2ee2-4821-94cf-69c091589241" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.802s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:39:38 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:39:38 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:39:40 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:39:41 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:39:41 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:39:41 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:39:41 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:39:41 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:39:41 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Auditing locally available compute resources for user (node: user) {{(pid=73572) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 10:39:41 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73572) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 10:39:41 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68613b1e-c45c-4fd9-834c-3630ed0f456a/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:39:42 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68613b1e-c45c-4fd9-834c-3630ed0f456a/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:39:42 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68613b1e-c45c-4fd9-834c-3630ed0f456a/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:39:42 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68613b1e-c45c-4fd9-834c-3630ed0f456a/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:39:42 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a8e064c-c6b0-4812-9d3a-04ba52b06bda/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:39:42 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a8e064c-c6b0-4812-9d3a-04ba52b06bda/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:39:42 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a8e064c-c6b0-4812-9d3a-04ba52b06bda/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:39:42 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:39:42 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a8e064c-c6b0-4812-9d3a-04ba52b06bda/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:39:43 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:39:43 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:39:43 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Hypervisor/Node resource view: name=user free_ram=8383MB free_disk=25.156463623046875GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=73572) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 10:39:43 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:39:43 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:39:43 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance 68613b1e-c45c-4fd9-834c-3630ed0f456a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:39:43 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance 4039a8aa-b1a7-497d-b12c-6fcc12ab2b0a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:39:43 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance 0a8e064c-c6b0-4812-9d3a-04ba52b06bda actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:39:43 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=73572) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 10:39:43 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=73572) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 10:39:43 user nova-compute[73572]: DEBUG nova.compute.provider_tree [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Inventory has not changed in ProviderTree for provider: e2cec974-59b2-4c77-a53d-a7f4e5a30d75 {{(pid=73572) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 10:39:43 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Inventory has not changed for provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73572) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 10:39:43 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Compute_service record updated for user:user {{(pid=73572) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 10:39:43 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.262s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:39:44 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:39:46 user nova-compute[73572]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693046371.0835948, c457a41c-2ee2-4821-94cf-69c091589241 => Stopped> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:39:46 user nova-compute[73572]: INFO nova.compute.manager [-] [instance: c457a41c-2ee2-4821-94cf-69c091589241] VM Stopped (Lifecycle Event)
Aug 26 10:39:46 user nova-compute[73572]: DEBUG nova.compute.manager [None req-5ef6a377-cd1d-41cb-8cea-d6983e36963c None None] [instance: c457a41c-2ee2-4821-94cf-69c091589241] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:39:47 user nova-compute[73572]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693046372.6635113, 59206f70-2a59-44d2-b63a-0659416f2516 => Stopped> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:39:47 user nova-compute[73572]: INFO nova.compute.manager [-] [instance: 59206f70-2a59-44d2-b63a-0659416f2516] VM Stopped (Lifecycle Event)
Aug 26 10:39:47 user nova-compute[73572]: DEBUG nova.compute.manager [None req-8ee52fc3-002f-4266-8a8a-284b14b270ef None None] [instance: 59206f70-2a59-44d2-b63a-0659416f2516] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:39:47 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:39:47 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:39:47 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73572) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 10:39:47 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73572) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 10:39:47 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73572) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 10:39:47 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:39:52 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:39:56 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:39:57 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:40:01 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-062d2785-d351-4529-ac59-585e417702eb tempest-TestServerVolumeAttachScenarioOldVersion-1514114358 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member] Acquiring lock "0a8e064c-c6b0-4812-9d3a-04ba52b06bda" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:40:01 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-062d2785-d351-4529-ac59-585e417702eb tempest-TestServerVolumeAttachScenarioOldVersion-1514114358 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member] Lock "0a8e064c-c6b0-4812-9d3a-04ba52b06bda" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:40:01 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-062d2785-d351-4529-ac59-585e417702eb tempest-TestServerVolumeAttachScenarioOldVersion-1514114358 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member] Acquiring lock "0a8e064c-c6b0-4812-9d3a-04ba52b06bda-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:40:01 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-062d2785-d351-4529-ac59-585e417702eb tempest-TestServerVolumeAttachScenarioOldVersion-1514114358 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member] Lock "0a8e064c-c6b0-4812-9d3a-04ba52b06bda-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:40:01 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-062d2785-d351-4529-ac59-585e417702eb tempest-TestServerVolumeAttachScenarioOldVersion-1514114358 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member] Lock "0a8e064c-c6b0-4812-9d3a-04ba52b06bda-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:40:01 user nova-compute[73572]: INFO nova.compute.manager [None req-062d2785-d351-4529-ac59-585e417702eb tempest-TestServerVolumeAttachScenarioOldVersion-1514114358 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member] [instance: 0a8e064c-c6b0-4812-9d3a-04ba52b06bda] Terminating instance
Aug 26 10:40:01 user nova-compute[73572]: DEBUG nova.compute.manager [None req-062d2785-d351-4529-ac59-585e417702eb tempest-TestServerVolumeAttachScenarioOldVersion-1514114358 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member] [instance: 0a8e064c-c6b0-4812-9d3a-04ba52b06bda] Start destroying the instance on the hypervisor. {{(pid=73572) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 10:40:01 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:40:01 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:40:01 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:40:01 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:40:01 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:40:01 user nova-compute[73572]: DEBUG nova.compute.manager [req-90eb3494-e3a6-4d2c-961c-408d04013231 req-5c829e07-2a50-438f-ae37-97bd891ef6a3 service nova] [instance: 0a8e064c-c6b0-4812-9d3a-04ba52b06bda] Received event network-vif-unplugged-4a5e5040-9799-4ade-8465-c5ab770d0616 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:40:01 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-90eb3494-e3a6-4d2c-961c-408d04013231 req-5c829e07-2a50-438f-ae37-97bd891ef6a3 service nova] Acquiring lock "0a8e064c-c6b0-4812-9d3a-04ba52b06bda-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:40:01 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-90eb3494-e3a6-4d2c-961c-408d04013231 req-5c829e07-2a50-438f-ae37-97bd891ef6a3 service nova] Lock "0a8e064c-c6b0-4812-9d3a-04ba52b06bda-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:40:01 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-90eb3494-e3a6-4d2c-961c-408d04013231 req-5c829e07-2a50-438f-ae37-97bd891ef6a3 service nova] Lock "0a8e064c-c6b0-4812-9d3a-04ba52b06bda-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:40:01 user nova-compute[73572]: DEBUG nova.compute.manager [req-90eb3494-e3a6-4d2c-961c-408d04013231 req-5c829e07-2a50-438f-ae37-97bd891ef6a3 service nova] [instance: 0a8e064c-c6b0-4812-9d3a-04ba52b06bda] No waiting events found dispatching network-vif-unplugged-4a5e5040-9799-4ade-8465-c5ab770d0616 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:40:01 user nova-compute[73572]: DEBUG nova.compute.manager [req-90eb3494-e3a6-4d2c-961c-408d04013231 req-5c829e07-2a50-438f-ae37-97bd891ef6a3 service nova] [instance: 0a8e064c-c6b0-4812-9d3a-04ba52b06bda] Received event network-vif-unplugged-4a5e5040-9799-4ade-8465-c5ab770d0616 for instance with task_state deleting. {{(pid=73572) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 10:40:02 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:40:02 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:40:02 user nova-compute[73572]: INFO nova.virt.libvirt.driver [-] [instance: 0a8e064c-c6b0-4812-9d3a-04ba52b06bda] Instance destroyed successfully.
Aug 26 10:40:02 user nova-compute[73572]: DEBUG nova.objects.instance [None req-062d2785-d351-4529-ac59-585e417702eb tempest-TestServerVolumeAttachScenarioOldVersion-1514114358 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member] Lazy-loading 'resources' on Instance uuid 0a8e064c-c6b0-4812-9d3a-04ba52b06bda {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:40:02 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-062d2785-d351-4529-ac59-585e417702eb tempest-TestServerVolumeAttachScenarioOldVersion-1514114358 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T10:36:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-264759441',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-264759441',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-2647594',id=48,image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKCW3tbmJ/DCwB0Pz3ExNny9URVuz0fsycd79/95q7dLMdFXtVKOtp3SMJeRCHXmVhNqz5c7OWWeDamUjtcucCK5cjeYo56gvos7qH58v+ONOUJa+Pjd3wtU3Muah31kPg==',key_name='tempest-keypair-682558480',keypairs=<?>,launch_index=0,launched_at=2023-08-26T10:36:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='54e0a0a3c0f64ed7980570750d7754ce',ramdisk_id='',reservation_id='r-4jposz0c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1514114358',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T10:36:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='28a22a71368940ab830921214268a1b9',uuid=0a8e064c-c6b0-4812-9d3a-04ba52b06bda,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4a5e5040-9799-4ade-8465-c5ab770d0616", "address": "fa:16:3e:47:ea:be", "network": {"id": "21dd7d4e-3fb2-44d6-99d0-973f9eb5d456", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-222837576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54e0a0a3c0f64ed7980570750d7754ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a5e5040-97", "ovs_interfaceid": "4a5e5040-9799-4ade-8465-c5ab770d0616", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 10:40:02 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-062d2785-d351-4529-ac59-585e417702eb tempest-TestServerVolumeAttachScenarioOldVersion-1514114358 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member] Converting VIF {"id": "4a5e5040-9799-4ade-8465-c5ab770d0616", "address": "fa:16:3e:47:ea:be", "network": {"id": "21dd7d4e-3fb2-44d6-99d0-973f9eb5d456", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-222837576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54e0a0a3c0f64ed7980570750d7754ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a5e5040-97", "ovs_interfaceid": "4a5e5040-9799-4ade-8465-c5ab770d0616", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:40:02 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-062d2785-d351-4529-ac59-585e417702eb tempest-TestServerVolumeAttachScenarioOldVersion-1514114358 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:47:ea:be,bridge_name='br-int',has_traffic_filtering=True,id=4a5e5040-9799-4ade-8465-c5ab770d0616,network=Network(21dd7d4e-3fb2-44d6-99d0-973f9eb5d456),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a5e5040-97') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:40:02 user nova-compute[73572]: DEBUG os_vif [None req-062d2785-d351-4529-ac59-585e417702eb tempest-TestServerVolumeAttachScenarioOldVersion-1514114358 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:47:ea:be,bridge_name='br-int',has_traffic_filtering=True,id=4a5e5040-9799-4ade-8465-c5ab770d0616,network=Network(21dd7d4e-3fb2-44d6-99d0-973f9eb5d456),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a5e5040-97') {{(pid=73572) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 10:40:02 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:40:02 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4a5e5040-97, bridge=br-int, if_exists=True) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:40:02 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:40:02 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:40:02 user nova-compute[73572]: INFO os_vif [None req-062d2785-d351-4529-ac59-585e417702eb tempest-TestServerVolumeAttachScenarioOldVersion-1514114358 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:47:ea:be,bridge_name='br-int',has_traffic_filtering=True,id=4a5e5040-9799-4ade-8465-c5ab770d0616,network=Network(21dd7d4e-3fb2-44d6-99d0-973f9eb5d456),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a5e5040-97')
Aug 26 10:40:02 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-062d2785-d351-4529-ac59-585e417702eb tempest-TestServerVolumeAttachScenarioOldVersion-1514114358 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member] [instance: 0a8e064c-c6b0-4812-9d3a-04ba52b06bda] Deleting instance files /opt/stack/data/nova/instances/0a8e064c-c6b0-4812-9d3a-04ba52b06bda_del
Aug 26 10:40:02 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-062d2785-d351-4529-ac59-585e417702eb tempest-TestServerVolumeAttachScenarioOldVersion-1514114358 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member] [instance: 0a8e064c-c6b0-4812-9d3a-04ba52b06bda] Deletion of /opt/stack/data/nova/instances/0a8e064c-c6b0-4812-9d3a-04ba52b06bda_del complete
Aug 26 10:40:02 user nova-compute[73572]: INFO nova.compute.manager [None req-062d2785-d351-4529-ac59-585e417702eb tempest-TestServerVolumeAttachScenarioOldVersion-1514114358 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member] [instance: 0a8e064c-c6b0-4812-9d3a-04ba52b06bda] Took 0.93 seconds to destroy the instance on the hypervisor.
Aug 26 10:40:02 user nova-compute[73572]: DEBUG oslo.service.loopingcall [None req-062d2785-d351-4529-ac59-585e417702eb tempest-TestServerVolumeAttachScenarioOldVersion-1514114358 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73572) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 10:40:02 user nova-compute[73572]: DEBUG nova.compute.manager [-] [instance: 0a8e064c-c6b0-4812-9d3a-04ba52b06bda] Deallocating network for instance {{(pid=73572) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 10:40:02 user nova-compute[73572]: DEBUG nova.network.neutron [-] [instance: 0a8e064c-c6b0-4812-9d3a-04ba52b06bda] deallocate_for_instance() {{(pid=73572) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 10:40:03 user nova-compute[73572]: DEBUG nova.network.neutron [-] [instance: 0a8e064c-c6b0-4812-9d3a-04ba52b06bda] Updating instance_info_cache with network_info: [] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:40:03 user nova-compute[73572]: INFO nova.compute.manager [-] [instance: 0a8e064c-c6b0-4812-9d3a-04ba52b06bda] Took 1.11 seconds to deallocate network for instance.
Aug 26 10:40:03 user nova-compute[73572]: DEBUG nova.compute.manager [req-d4cbe17f-db77-4227-b4bf-64a44b42281e req-a0e5de77-cacd-49a2-b084-a66738915229 service nova] [instance: 0a8e064c-c6b0-4812-9d3a-04ba52b06bda] Received event network-vif-deleted-4a5e5040-9799-4ade-8465-c5ab770d0616 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:40:03 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-062d2785-d351-4529-ac59-585e417702eb tempest-TestServerVolumeAttachScenarioOldVersion-1514114358 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:40:03 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-062d2785-d351-4529-ac59-585e417702eb tempest-TestServerVolumeAttachScenarioOldVersion-1514114358 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:40:03 user nova-compute[73572]: DEBUG nova.compute.provider_tree [None req-062d2785-d351-4529-ac59-585e417702eb tempest-TestServerVolumeAttachScenarioOldVersion-1514114358 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member] Inventory has not changed in ProviderTree for provider: e2cec974-59b2-4c77-a53d-a7f4e5a30d75 {{(pid=73572) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 10:40:03 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-062d2785-d351-4529-ac59-585e417702eb tempest-TestServerVolumeAttachScenarioOldVersion-1514114358 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member] Inventory has not changed for provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73572) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 10:40:03 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-062d2785-d351-4529-ac59-585e417702eb tempest-TestServerVolumeAttachScenarioOldVersion-1514114358 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.186s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:40:03 user nova-compute[73572]: INFO nova.scheduler.client.report [None req-062d2785-d351-4529-ac59-585e417702eb tempest-TestServerVolumeAttachScenarioOldVersion-1514114358 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member] Deleted allocations for instance 0a8e064c-c6b0-4812-9d3a-04ba52b06bda
Aug 26 10:40:03 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-062d2785-d351-4529-ac59-585e417702eb tempest-TestServerVolumeAttachScenarioOldVersion-1514114358 tempest-TestServerVolumeAttachScenarioOldVersion-1514114358-project-member] Lock "0a8e064c-c6b0-4812-9d3a-04ba52b06bda" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.432s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:40:03 user nova-compute[73572]: DEBUG nova.compute.manager [req-ef2eb851-fe37-4be1-8b0d-9654339219c4 req-caae86d3-1804-4496-a6d0-aa4c6864d79c service nova] [instance: 0a8e064c-c6b0-4812-9d3a-04ba52b06bda] Received event network-vif-plugged-4a5e5040-9799-4ade-8465-c5ab770d0616 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:40:03 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-ef2eb851-fe37-4be1-8b0d-9654339219c4 req-caae86d3-1804-4496-a6d0-aa4c6864d79c service nova] Acquiring lock "0a8e064c-c6b0-4812-9d3a-04ba52b06bda-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:40:03 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-ef2eb851-fe37-4be1-8b0d-9654339219c4 req-caae86d3-1804-4496-a6d0-aa4c6864d79c service nova] Lock "0a8e064c-c6b0-4812-9d3a-04ba52b06bda-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:40:03 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-ef2eb851-fe37-4be1-8b0d-9654339219c4 req-caae86d3-1804-4496-a6d0-aa4c6864d79c service nova] Lock "0a8e064c-c6b0-4812-9d3a-04ba52b06bda-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:40:03 user nova-compute[73572]: DEBUG nova.compute.manager [req-ef2eb851-fe37-4be1-8b0d-9654339219c4 req-caae86d3-1804-4496-a6d0-aa4c6864d79c service nova] [instance: 0a8e064c-c6b0-4812-9d3a-04ba52b06bda] No waiting events found dispatching network-vif-plugged-4a5e5040-9799-4ade-8465-c5ab770d0616 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:40:03 user nova-compute[73572]: WARNING nova.compute.manager [req-ef2eb851-fe37-4be1-8b0d-9654339219c4 req-caae86d3-1804-4496-a6d0-aa4c6864d79c service nova] [instance: 0a8e064c-c6b0-4812-9d3a-04ba52b06bda] Received unexpected event network-vif-plugged-4a5e5040-9799-4ade-8465-c5ab770d0616 for instance with vm_state deleted and task_state None.
Aug 26 10:40:07 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:40:12 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:40:17 user nova-compute[73572]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693046402.228111, 0a8e064c-c6b0-4812-9d3a-04ba52b06bda => Stopped> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:40:17 user nova-compute[73572]: INFO nova.compute.manager [-] [instance: 0a8e064c-c6b0-4812-9d3a-04ba52b06bda] VM Stopped (Lifecycle Event)
Aug 26 10:40:17 user nova-compute[73572]: DEBUG nova.compute.manager [None req-b4f48e9b-4f5c-4c1d-b963-c84cc99fb5d3 None None] [instance: 0a8e064c-c6b0-4812-9d3a-04ba52b06bda] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:40:17 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:40:22 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:40:26 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:40:27 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:40:28 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:40:29 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:40:30 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:40:30 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:40:30 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Starting heal instance info cache {{(pid=73572) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 10:40:30 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Rebuilding the list of instances to heal {{(pid=73572) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 10:40:30 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquiring lock "refresh_cache-68613b1e-c45c-4fd9-834c-3630ed0f456a" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:40:30 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquired lock "refresh_cache-68613b1e-c45c-4fd9-834c-3630ed0f456a" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:40:30 user nova-compute[73572]: DEBUG nova.network.neutron [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] [instance: 68613b1e-c45c-4fd9-834c-3630ed0f456a] Forcefully refreshing network info cache for instance {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 10:40:30 user nova-compute[73572]: DEBUG nova.objects.instance [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lazy-loading 'info_cache' on Instance uuid 68613b1e-c45c-4fd9-834c-3630ed0f456a {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:40:31 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-99c7fefe-6c9f-4374-8e2f-bca6d34efe7e tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Acquiring lock "68613b1e-c45c-4fd9-834c-3630ed0f456a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:40:31 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-99c7fefe-6c9f-4374-8e2f-bca6d34efe7e tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Lock "68613b1e-c45c-4fd9-834c-3630ed0f456a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:40:31 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-99c7fefe-6c9f-4374-8e2f-bca6d34efe7e tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Acquiring lock "68613b1e-c45c-4fd9-834c-3630ed0f456a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:40:31 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-99c7fefe-6c9f-4374-8e2f-bca6d34efe7e tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Lock "68613b1e-c45c-4fd9-834c-3630ed0f456a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:40:31 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-99c7fefe-6c9f-4374-8e2f-bca6d34efe7e tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Lock "68613b1e-c45c-4fd9-834c-3630ed0f456a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:40:31 user nova-compute[73572]: INFO nova.compute.manager [None req-99c7fefe-6c9f-4374-8e2f-bca6d34efe7e tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] [instance: 68613b1e-c45c-4fd9-834c-3630ed0f456a] Terminating instance
Aug 26 10:40:31 user nova-compute[73572]: DEBUG nova.compute.manager [None req-99c7fefe-6c9f-4374-8e2f-bca6d34efe7e tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] [instance: 68613b1e-c45c-4fd9-834c-3630ed0f456a] Start destroying the instance on the hypervisor. {{(pid=73572) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 10:40:31 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:40:31 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:40:31 user nova-compute[73572]: DEBUG nova.network.neutron [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] [instance: 68613b1e-c45c-4fd9-834c-3630ed0f456a] Updating instance_info_cache with network_info: [{"id": "aa5ef0b6-0379-4e59-a2c7-e7f1ecd3c7cb", "address": "fa:16:3e:30:8b:7a", "network": {"id": "43215883-3d00-4be7-8c40-bdaf3f01bef9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1088544153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7935bccc360b46b589fd57d53f334595", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa5ef0b6-03", "ovs_interfaceid": "aa5ef0b6-0379-4e59-a2c7-e7f1ecd3c7cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:40:31 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:40:31 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Releasing lock "refresh_cache-68613b1e-c45c-4fd9-834c-3630ed0f456a" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:40:31 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] [instance: 68613b1e-c45c-4fd9-834c-3630ed0f456a] Updated the network info_cache for instance {{(pid=73572) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 10:40:31 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:40:32 user nova-compute[73572]: DEBUG nova.compute.manager [req-ce630761-f282-4ced-97de-38269470edc5 req-47d418d8-7ab9-4c94-9b47-184e947344c8 service nova] [instance: 68613b1e-c45c-4fd9-834c-3630ed0f456a] Received event network-vif-unplugged-aa5ef0b6-0379-4e59-a2c7-e7f1ecd3c7cb {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:40:32 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-ce630761-f282-4ced-97de-38269470edc5 req-47d418d8-7ab9-4c94-9b47-184e947344c8 service nova] Acquiring lock "68613b1e-c45c-4fd9-834c-3630ed0f456a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:40:32 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-ce630761-f282-4ced-97de-38269470edc5 req-47d418d8-7ab9-4c94-9b47-184e947344c8 service nova] Lock "68613b1e-c45c-4fd9-834c-3630ed0f456a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:40:32 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-ce630761-f282-4ced-97de-38269470edc5 req-47d418d8-7ab9-4c94-9b47-184e947344c8 service nova] Lock "68613b1e-c45c-4fd9-834c-3630ed0f456a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:40:32 user nova-compute[73572]: DEBUG nova.compute.manager [req-ce630761-f282-4ced-97de-38269470edc5 req-47d418d8-7ab9-4c94-9b47-184e947344c8 service nova] [instance: 68613b1e-c45c-4fd9-834c-3630ed0f456a] No waiting events found dispatching network-vif-unplugged-aa5ef0b6-0379-4e59-a2c7-e7f1ecd3c7cb {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:40:32 user nova-compute[73572]: DEBUG nova.compute.manager [req-ce630761-f282-4ced-97de-38269470edc5 req-47d418d8-7ab9-4c94-9b47-184e947344c8 service nova] [instance: 68613b1e-c45c-4fd9-834c-3630ed0f456a] Received event network-vif-unplugged-aa5ef0b6-0379-4e59-a2c7-e7f1ecd3c7cb for instance with task_state deleting. {{(pid=73572) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 10:40:32 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:40:32 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:40:32 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:40:32 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:40:32 user nova-compute[73572]: INFO nova.virt.libvirt.driver [-] [instance: 68613b1e-c45c-4fd9-834c-3630ed0f456a] Instance destroyed successfully.
Aug 26 10:40:32 user nova-compute[73572]: DEBUG nova.objects.instance [None req-99c7fefe-6c9f-4374-8e2f-bca6d34efe7e tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Lazy-loading 'resources' on Instance uuid 68613b1e-c45c-4fd9-834c-3630ed0f456a {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:40:32 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-99c7fefe-6c9f-4374-8e2f-bca6d34efe7e tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T10:21:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-268136854',display_name='tempest-ServerActionsTestOtherA-server-268136854',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-268136854',id=29,image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAGb4Psy4ujnztu6TKM5Yp0ao9Inx8XINL8TB7yqpPrX8pvyhV645/PRion/tWXE5RcABz76j3Pw1BeejHEQh0n16o5OpRaXWd84Wj12hPmfoj80ST4I1EIx+wC0wImDFQ==',key_name='tempest-keypair-598298583',keypairs=<?>,launch_index=0,launched_at=2023-08-26T10:21:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7935bccc360b46b589fd57d53f334595',ramdisk_id='',reservation_id='r-3skv5tuf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-203628695',owner_user_name='tempest-ServerActionsTestOtherA-203628695-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T10:21:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='61b6124f6f6e44c5b2fd0202a15da019',uuid=68613b1e-c45c-4fd9-834c-3630ed0f456a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "aa5ef0b6-0379-4e59-a2c7-e7f1ecd3c7cb", "address": "fa:16:3e:30:8b:7a", "network": {"id": "43215883-3d00-4be7-8c40-bdaf3f01bef9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1088544153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7935bccc360b46b589fd57d53f334595", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa5ef0b6-03", "ovs_interfaceid": "aa5ef0b6-0379-4e59-a2c7-e7f1ecd3c7cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 10:40:32 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-99c7fefe-6c9f-4374-8e2f-bca6d34efe7e tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Converting VIF {"id": "aa5ef0b6-0379-4e59-a2c7-e7f1ecd3c7cb", "address": "fa:16:3e:30:8b:7a", "network": {"id": "43215883-3d00-4be7-8c40-bdaf3f01bef9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1088544153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7935bccc360b46b589fd57d53f334595", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa5ef0b6-03", "ovs_interfaceid": "aa5ef0b6-0379-4e59-a2c7-e7f1ecd3c7cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:40:32 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-99c7fefe-6c9f-4374-8e2f-bca6d34efe7e tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:30:8b:7a,bridge_name='br-int',has_traffic_filtering=True,id=aa5ef0b6-0379-4e59-a2c7-e7f1ecd3c7cb,network=Network(43215883-3d00-4be7-8c40-bdaf3f01bef9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa5ef0b6-03') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:40:32 user nova-compute[73572]: DEBUG os_vif [None req-99c7fefe-6c9f-4374-8e2f-bca6d34efe7e tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:30:8b:7a,bridge_name='br-int',has_traffic_filtering=True,id=aa5ef0b6-0379-4e59-a2c7-e7f1ecd3c7cb,network=Network(43215883-3d00-4be7-8c40-bdaf3f01bef9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa5ef0b6-03') {{(pid=73572) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 10:40:32 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:40:32 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:40:32 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapaa5ef0b6-03, bridge=br-int, if_exists=True) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:40:32 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:40:32 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:40:32 user nova-compute[73572]: INFO os_vif [None req-99c7fefe-6c9f-4374-8e2f-bca6d34efe7e tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:30:8b:7a,bridge_name='br-int',has_traffic_filtering=True,id=aa5ef0b6-0379-4e59-a2c7-e7f1ecd3c7cb,network=Network(43215883-3d00-4be7-8c40-bdaf3f01bef9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa5ef0b6-03')
Aug 26 10:40:32 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-99c7fefe-6c9f-4374-8e2f-bca6d34efe7e tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] [instance: 68613b1e-c45c-4fd9-834c-3630ed0f456a] Deleting instance files /opt/stack/data/nova/instances/68613b1e-c45c-4fd9-834c-3630ed0f456a_del
Aug 26 10:40:32 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-99c7fefe-6c9f-4374-8e2f-bca6d34efe7e tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] [instance: 68613b1e-c45c-4fd9-834c-3630ed0f456a] Deletion of /opt/stack/data/nova/instances/68613b1e-c45c-4fd9-834c-3630ed0f456a_del complete
Aug 26 10:40:32 user nova-compute[73572]: INFO nova.compute.manager [None req-99c7fefe-6c9f-4374-8e2f-bca6d34efe7e tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] [instance: 68613b1e-c45c-4fd9-834c-3630ed0f456a] Took 0.75 seconds to destroy the instance on the hypervisor.
Aug 26 10:40:32 user nova-compute[73572]: DEBUG oslo.service.loopingcall [None req-99c7fefe-6c9f-4374-8e2f-bca6d34efe7e tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73572) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 10:40:32 user nova-compute[73572]: DEBUG nova.compute.manager [-] [instance: 68613b1e-c45c-4fd9-834c-3630ed0f456a] Deallocating network for instance {{(pid=73572) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 10:40:32 user nova-compute[73572]: DEBUG nova.network.neutron [-] [instance: 68613b1e-c45c-4fd9-834c-3630ed0f456a] deallocate_for_instance() {{(pid=73572) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 10:40:32 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:40:33 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:40:33 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:40:33 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:40:33 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:40:33 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:40:33 user nova-compute[73572]: DEBUG nova.network.neutron [-] [instance: 68613b1e-c45c-4fd9-834c-3630ed0f456a] Updating instance_info_cache with network_info: [] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:40:33 user nova-compute[73572]: INFO nova.compute.manager [-] [instance: 68613b1e-c45c-4fd9-834c-3630ed0f456a] Took 1.28 seconds to deallocate network for instance.
Aug 26 10:40:33 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-99c7fefe-6c9f-4374-8e2f-bca6d34efe7e tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:40:33 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-99c7fefe-6c9f-4374-8e2f-bca6d34efe7e tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:40:33 user nova-compute[73572]: DEBUG nova.compute.provider_tree [None req-99c7fefe-6c9f-4374-8e2f-bca6d34efe7e tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Inventory has not changed in ProviderTree for provider: e2cec974-59b2-4c77-a53d-a7f4e5a30d75 {{(pid=73572) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 10:40:34 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-99c7fefe-6c9f-4374-8e2f-bca6d34efe7e tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Inventory has not changed for provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73572) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 10:40:34 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-99c7fefe-6c9f-4374-8e2f-bca6d34efe7e tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.221s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:40:34 user nova-compute[73572]: INFO nova.scheduler.client.report [None req-99c7fefe-6c9f-4374-8e2f-bca6d34efe7e tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Deleted allocations for instance 68613b1e-c45c-4fd9-834c-3630ed0f456a
Aug 26 10:40:34 user nova-compute[73572]: DEBUG nova.compute.manager [req-3ba07ef7-ac3c-4f14-803c-74201613aa59 req-83050560-1e11-4236-b6a8-e1eac0efe9ca service nova] [instance: 68613b1e-c45c-4fd9-834c-3630ed0f456a] Received event network-vif-plugged-aa5ef0b6-0379-4e59-a2c7-e7f1ecd3c7cb {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:40:34 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-3ba07ef7-ac3c-4f14-803c-74201613aa59 req-83050560-1e11-4236-b6a8-e1eac0efe9ca service nova] Acquiring lock "68613b1e-c45c-4fd9-834c-3630ed0f456a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:40:34 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-3ba07ef7-ac3c-4f14-803c-74201613aa59 req-83050560-1e11-4236-b6a8-e1eac0efe9ca service nova] Lock "68613b1e-c45c-4fd9-834c-3630ed0f456a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:40:34 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-3ba07ef7-ac3c-4f14-803c-74201613aa59 req-83050560-1e11-4236-b6a8-e1eac0efe9ca service nova] Lock "68613b1e-c45c-4fd9-834c-3630ed0f456a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:40:34 user nova-compute[73572]: DEBUG nova.compute.manager [req-3ba07ef7-ac3c-4f14-803c-74201613aa59 req-83050560-1e11-4236-b6a8-e1eac0efe9ca service nova] [instance: 68613b1e-c45c-4fd9-834c-3630ed0f456a] No waiting events found dispatching network-vif-plugged-aa5ef0b6-0379-4e59-a2c7-e7f1ecd3c7cb {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:40:34 user nova-compute[73572]: WARNING nova.compute.manager [req-3ba07ef7-ac3c-4f14-803c-74201613aa59 req-83050560-1e11-4236-b6a8-e1eac0efe9ca service nova] [instance: 68613b1e-c45c-4fd9-834c-3630ed0f456a] Received unexpected event network-vif-plugged-aa5ef0b6-0379-4e59-a2c7-e7f1ecd3c7cb for instance with vm_state deleted and task_state None.
Aug 26 10:40:34 user nova-compute[73572]: DEBUG nova.compute.manager [req-3ba07ef7-ac3c-4f14-803c-74201613aa59 req-83050560-1e11-4236-b6a8-e1eac0efe9ca service nova] [instance: 68613b1e-c45c-4fd9-834c-3630ed0f456a] Received event network-vif-plugged-aa5ef0b6-0379-4e59-a2c7-e7f1ecd3c7cb {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:40:34 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-3ba07ef7-ac3c-4f14-803c-74201613aa59 req-83050560-1e11-4236-b6a8-e1eac0efe9ca service nova] Acquiring lock "68613b1e-c45c-4fd9-834c-3630ed0f456a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:40:34 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-3ba07ef7-ac3c-4f14-803c-74201613aa59 req-83050560-1e11-4236-b6a8-e1eac0efe9ca service nova] Lock "68613b1e-c45c-4fd9-834c-3630ed0f456a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:40:34 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-3ba07ef7-ac3c-4f14-803c-74201613aa59 req-83050560-1e11-4236-b6a8-e1eac0efe9ca service nova] Lock "68613b1e-c45c-4fd9-834c-3630ed0f456a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:40:34 user nova-compute[73572]: DEBUG nova.compute.manager [req-3ba07ef7-ac3c-4f14-803c-74201613aa59 req-83050560-1e11-4236-b6a8-e1eac0efe9ca service nova] [instance: 68613b1e-c45c-4fd9-834c-3630ed0f456a] No waiting events found dispatching network-vif-plugged-aa5ef0b6-0379-4e59-a2c7-e7f1ecd3c7cb {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:40:34 user nova-compute[73572]: WARNING nova.compute.manager [req-3ba07ef7-ac3c-4f14-803c-74201613aa59 req-83050560-1e11-4236-b6a8-e1eac0efe9ca service nova] [instance: 68613b1e-c45c-4fd9-834c-3630ed0f456a] Received unexpected event network-vif-plugged-aa5ef0b6-0379-4e59-a2c7-e7f1ecd3c7cb for instance with vm_state deleted and task_state None.
Aug 26 10:40:34 user nova-compute[73572]: DEBUG nova.compute.manager [req-3ba07ef7-ac3c-4f14-803c-74201613aa59 req-83050560-1e11-4236-b6a8-e1eac0efe9ca service nova] [instance: 68613b1e-c45c-4fd9-834c-3630ed0f456a] Received event network-vif-plugged-aa5ef0b6-0379-4e59-a2c7-e7f1ecd3c7cb {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:40:34 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-3ba07ef7-ac3c-4f14-803c-74201613aa59 req-83050560-1e11-4236-b6a8-e1eac0efe9ca service nova] Acquiring lock "68613b1e-c45c-4fd9-834c-3630ed0f456a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:40:34 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-3ba07ef7-ac3c-4f14-803c-74201613aa59 req-83050560-1e11-4236-b6a8-e1eac0efe9ca service nova] Lock "68613b1e-c45c-4fd9-834c-3630ed0f456a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:40:34 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-3ba07ef7-ac3c-4f14-803c-74201613aa59 req-83050560-1e11-4236-b6a8-e1eac0efe9ca service nova] Lock "68613b1e-c45c-4fd9-834c-3630ed0f456a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:40:34 user nova-compute[73572]: DEBUG nova.compute.manager [req-3ba07ef7-ac3c-4f14-803c-74201613aa59 req-83050560-1e11-4236-b6a8-e1eac0efe9ca service nova] [instance: 68613b1e-c45c-4fd9-834c-3630ed0f456a] No waiting events found dispatching network-vif-plugged-aa5ef0b6-0379-4e59-a2c7-e7f1ecd3c7cb {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:40:34 user nova-compute[73572]: WARNING nova.compute.manager [req-3ba07ef7-ac3c-4f14-803c-74201613aa59 req-83050560-1e11-4236-b6a8-e1eac0efe9ca service nova] [instance: 68613b1e-c45c-4fd9-834c-3630ed0f456a] Received unexpected event network-vif-plugged-aa5ef0b6-0379-4e59-a2c7-e7f1ecd3c7cb for instance with vm_state deleted and task_state None.
Aug 26 10:40:34 user nova-compute[73572]: DEBUG nova.compute.manager [req-3ba07ef7-ac3c-4f14-803c-74201613aa59 req-83050560-1e11-4236-b6a8-e1eac0efe9ca service nova] [instance: 68613b1e-c45c-4fd9-834c-3630ed0f456a] Received event network-vif-plugged-aa5ef0b6-0379-4e59-a2c7-e7f1ecd3c7cb {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:40:34 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-3ba07ef7-ac3c-4f14-803c-74201613aa59 req-83050560-1e11-4236-b6a8-e1eac0efe9ca service nova] Acquiring lock "68613b1e-c45c-4fd9-834c-3630ed0f456a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:40:34 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-3ba07ef7-ac3c-4f14-803c-74201613aa59 req-83050560-1e11-4236-b6a8-e1eac0efe9ca service nova] Lock "68613b1e-c45c-4fd9-834c-3630ed0f456a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:40:34 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-3ba07ef7-ac3c-4f14-803c-74201613aa59 req-83050560-1e11-4236-b6a8-e1eac0efe9ca service nova] Lock "68613b1e-c45c-4fd9-834c-3630ed0f456a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:40:34 user nova-compute[73572]: DEBUG nova.compute.manager [req-3ba07ef7-ac3c-4f14-803c-74201613aa59 req-83050560-1e11-4236-b6a8-e1eac0efe9ca service nova] [instance: 68613b1e-c45c-4fd9-834c-3630ed0f456a] No waiting events found dispatching network-vif-plugged-aa5ef0b6-0379-4e59-a2c7-e7f1ecd3c7cb {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:40:34 user nova-compute[73572]: WARNING nova.compute.manager [req-3ba07ef7-ac3c-4f14-803c-74201613aa59 req-83050560-1e11-4236-b6a8-e1eac0efe9ca service nova] [instance: 68613b1e-c45c-4fd9-834c-3630ed0f456a] Received unexpected event network-vif-plugged-aa5ef0b6-0379-4e59-a2c7-e7f1ecd3c7cb for instance with vm_state deleted and task_state None.
Aug 26 10:40:34 user nova-compute[73572]: DEBUG nova.compute.manager [req-3ba07ef7-ac3c-4f14-803c-74201613aa59 req-83050560-1e11-4236-b6a8-e1eac0efe9ca service nova] [instance: 68613b1e-c45c-4fd9-834c-3630ed0f456a] Received event network-vif-deleted-aa5ef0b6-0379-4e59-a2c7-e7f1ecd3c7cb {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:40:34 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-99c7fefe-6c9f-4374-8e2f-bca6d34efe7e tempest-ServerActionsTestOtherA-203628695 tempest-ServerActionsTestOtherA-203628695-project-member] Lock "68613b1e-c45c-4fd9-834c-3630ed0f456a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.465s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:40:34 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:40:35 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:40:36 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:40:37 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:40:37 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:40:37 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:40:37 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73572) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 10:40:39 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:40:40 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:40:41 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-216b485b-54e7-472b-b171-8b5b614072fa tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Acquiring lock "5d100a08-eaf2-4132-87dd-a8dcfe17f68f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:40:41 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-216b485b-54e7-472b-b171-8b5b614072fa tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Lock "5d100a08-eaf2-4132-87dd-a8dcfe17f68f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:40:41 user nova-compute[73572]: DEBUG nova.compute.manager [None req-216b485b-54e7-472b-b171-8b5b614072fa tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] [instance: 5d100a08-eaf2-4132-87dd-a8dcfe17f68f] Starting instance... {{(pid=73572) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 10:40:41 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-216b485b-54e7-472b-b171-8b5b614072fa tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:40:41 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-216b485b-54e7-472b-b171-8b5b614072fa tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:40:41 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-216b485b-54e7-472b-b171-8b5b614072fa tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73572) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 10:40:41 user nova-compute[73572]: INFO nova.compute.claims [None req-216b485b-54e7-472b-b171-8b5b614072fa tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] [instance: 5d100a08-eaf2-4132-87dd-a8dcfe17f68f] Claim successful on node user
Aug 26 10:40:41 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:40:41 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:40:41 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:40:41 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:40:41 user nova-compute[73572]: DEBUG nova.compute.provider_tree [None req-216b485b-54e7-472b-b171-8b5b614072fa tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Inventory has not changed in ProviderTree for provider: e2cec974-59b2-4c77-a53d-a7f4e5a30d75 {{(pid=73572) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 10:40:41 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-216b485b-54e7-472b-b171-8b5b614072fa tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Inventory has not changed for provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73572) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 10:40:42 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-216b485b-54e7-472b-b171-8b5b614072fa tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.269s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:40:42 user nova-compute[73572]: DEBUG nova.compute.manager [None req-216b485b-54e7-472b-b171-8b5b614072fa tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] [instance: 5d100a08-eaf2-4132-87dd-a8dcfe17f68f] Start building networks asynchronously for instance. {{(pid=73572) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 10:40:42 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.199s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:40:42 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:40:42 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Auditing locally available compute resources for user (node: user) {{(pid=73572) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 10:40:42 user nova-compute[73572]: DEBUG nova.compute.manager [None req-216b485b-54e7-472b-b171-8b5b614072fa tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] [instance: 5d100a08-eaf2-4132-87dd-a8dcfe17f68f] Allocating IP information in the background. {{(pid=73572) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 10:40:42 user nova-compute[73572]: DEBUG nova.network.neutron [None req-216b485b-54e7-472b-b171-8b5b614072fa tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] [instance: 5d100a08-eaf2-4132-87dd-a8dcfe17f68f] allocate_for_instance() {{(pid=73572) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 10:40:42 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-216b485b-54e7-472b-b171-8b5b614072fa tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] [instance: 5d100a08-eaf2-4132-87dd-a8dcfe17f68f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 10:40:42 user nova-compute[73572]: DEBUG nova.compute.manager [None req-216b485b-54e7-472b-b171-8b5b614072fa tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] [instance: 5d100a08-eaf2-4132-87dd-a8dcfe17f68f] Start building block device mappings for instance. {{(pid=73572) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 10:40:42 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73572) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 10:40:42 user nova-compute[73572]: DEBUG nova.policy [None req-216b485b-54e7-472b-b171-8b5b614072fa tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3ec14c9df0ff443eb6500d15209e001f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b110acd72c427db0de4e98d05f5e56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73572) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 10:40:42 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:40:42 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:40:42 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:40:42 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Hypervisor/Node resource view: name=user free_ram=8547MB free_disk=25.199844360351562GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=73572) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 10:40:42 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:40:42 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:40:42 user nova-compute[73572]: DEBUG nova.compute.manager [None req-216b485b-54e7-472b-b171-8b5b614072fa tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] [instance: 5d100a08-eaf2-4132-87dd-a8dcfe17f68f] Start spawning the instance on the hypervisor. {{(pid=73572) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 10:40:42 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-216b485b-54e7-472b-b171-8b5b614072fa tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] [instance: 5d100a08-eaf2-4132-87dd-a8dcfe17f68f] Creating instance directory {{(pid=73572) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 10:40:42 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-216b485b-54e7-472b-b171-8b5b614072fa tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] [instance: 5d100a08-eaf2-4132-87dd-a8dcfe17f68f] Creating image(s)
Aug 26 10:40:42 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-216b485b-54e7-472b-b171-8b5b614072fa tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Acquiring lock "/opt/stack/data/nova/instances/5d100a08-eaf2-4132-87dd-a8dcfe17f68f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:40:42 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-216b485b-54e7-472b-b171-8b5b614072fa tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Lock "/opt/stack/data/nova/instances/5d100a08-eaf2-4132-87dd-a8dcfe17f68f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:40:42 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-216b485b-54e7-472b-b171-8b5b614072fa tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Lock "/opt/stack/data/nova/instances/5d100a08-eaf2-4132-87dd-a8dcfe17f68f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:40:42 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-216b485b-54e7-472b-b171-8b5b614072fa tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:40:42 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance 4039a8aa-b1a7-497d-b12c-6fcc12ab2b0a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:40:42 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance 5d100a08-eaf2-4132-87dd-a8dcfe17f68f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:40:42 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=73572) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 10:40:42 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=73572) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 10:40:42 user nova-compute[73572]: DEBUG nova.compute.provider_tree [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Inventory has not changed in ProviderTree for provider: e2cec974-59b2-4c77-a53d-a7f4e5a30d75 {{(pid=73572) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 10:40:42 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Inventory has not changed for provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73572) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 10:40:42 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-216b485b-54e7-472b-b171-8b5b614072fa tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json" returned: 0 in 0.241s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:40:42 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-216b485b-54e7-472b-b171-8b5b614072fa tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Acquiring lock "2099350d6f3bcd0de9471c73862d4fe75b049801" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:40:42 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-216b485b-54e7-472b-b171-8b5b614072fa tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Lock "2099350d6f3bcd0de9471c73862d4fe75b049801" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:40:42 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-216b485b-54e7-472b-b171-8b5b614072fa tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:40:42 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Compute_service record updated for user:user {{(pid=73572) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 10:40:42 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.356s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:40:43 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-216b485b-54e7-472b-b171-8b5b614072fa tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json" returned: 0 in 0.206s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:40:43 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-216b485b-54e7-472b-b171-8b5b614072fa tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801,backing_fmt=raw /opt/stack/data/nova/instances/5d100a08-eaf2-4132-87dd-a8dcfe17f68f/disk 1073741824 {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:40:43 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-216b485b-54e7-472b-b171-8b5b614072fa tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801,backing_fmt=raw /opt/stack/data/nova/instances/5d100a08-eaf2-4132-87dd-a8dcfe17f68f/disk 1073741824" returned: 0 in 0.083s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:40:43 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-216b485b-54e7-472b-b171-8b5b614072fa tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Lock "2099350d6f3bcd0de9471c73862d4fe75b049801" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.296s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:40:43 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-216b485b-54e7-472b-b171-8b5b614072fa tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:40:43 user nova-compute[73572]: DEBUG nova.network.neutron [None req-216b485b-54e7-472b-b171-8b5b614072fa tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] [instance: 5d100a08-eaf2-4132-87dd-a8dcfe17f68f] Successfully created port: efe52e67-0439-4035-988e-daae3acfc823 {{(pid=73572) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 10:40:43 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-216b485b-54e7-472b-b171-8b5b614072fa tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json" returned: 0 in 0.215s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:40:43 user nova-compute[73572]: DEBUG nova.virt.disk.api [None req-216b485b-54e7-472b-b171-8b5b614072fa tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5d100a08-eaf2-4132-87dd-a8dcfe17f68f/disk. size=1073741824 {{(pid=73572) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 10:40:43 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-216b485b-54e7-472b-b171-8b5b614072fa tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d100a08-eaf2-4132-87dd-a8dcfe17f68f/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:40:43 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-216b485b-54e7-472b-b171-8b5b614072fa tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d100a08-eaf2-4132-87dd-a8dcfe17f68f/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:40:43 user nova-compute[73572]: DEBUG nova.virt.disk.api [None req-216b485b-54e7-472b-b171-8b5b614072fa tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Cannot resize image /opt/stack/data/nova/instances/5d100a08-eaf2-4132-87dd-a8dcfe17f68f/disk to a smaller size. {{(pid=73572) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 10:40:43 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-216b485b-54e7-472b-b171-8b5b614072fa tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] [instance: 5d100a08-eaf2-4132-87dd-a8dcfe17f68f] Created local disks {{(pid=73572) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 10:40:43 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-216b485b-54e7-472b-b171-8b5b614072fa tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] [instance: 5d100a08-eaf2-4132-87dd-a8dcfe17f68f] Ensure instance console log exists: /opt/stack/data/nova/instances/5d100a08-eaf2-4132-87dd-a8dcfe17f68f/console.log {{(pid=73572) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 10:40:43 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-216b485b-54e7-472b-b171-8b5b614072fa tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:40:43 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-216b485b-54e7-472b-b171-8b5b614072fa tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:40:43 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-216b485b-54e7-472b-b171-8b5b614072fa tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:40:44 user nova-compute[73572]: DEBUG nova.network.neutron [None req-216b485b-54e7-472b-b171-8b5b614072fa tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] [instance: 5d100a08-eaf2-4132-87dd-a8dcfe17f68f] Successfully updated port: efe52e67-0439-4035-988e-daae3acfc823 {{(pid=73572) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 10:40:44 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-216b485b-54e7-472b-b171-8b5b614072fa tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Acquiring lock "refresh_cache-5d100a08-eaf2-4132-87dd-a8dcfe17f68f" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:40:44 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-216b485b-54e7-472b-b171-8b5b614072fa tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Acquired lock "refresh_cache-5d100a08-eaf2-4132-87dd-a8dcfe17f68f" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:40:44 user nova-compute[73572]: DEBUG nova.network.neutron [None req-216b485b-54e7-472b-b171-8b5b614072fa tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] [instance: 5d100a08-eaf2-4132-87dd-a8dcfe17f68f] Building network info cache for instance {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 10:40:44 user nova-compute[73572]: DEBUG nova.compute.manager [req-4ae23d69-77b8-42ae-89c2-8b9c11cd3723 req-1ad78bd0-5cdb-4799-ae00-812fdd1fafeb service nova] [instance: 5d100a08-eaf2-4132-87dd-a8dcfe17f68f] Received event network-changed-efe52e67-0439-4035-988e-daae3acfc823 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:40:44 user nova-compute[73572]: DEBUG nova.compute.manager [req-4ae23d69-77b8-42ae-89c2-8b9c11cd3723 req-1ad78bd0-5cdb-4799-ae00-812fdd1fafeb service nova] [instance: 5d100a08-eaf2-4132-87dd-a8dcfe17f68f] Refreshing instance network info cache due to event network-changed-efe52e67-0439-4035-988e-daae3acfc823. {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 10:40:44 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-4ae23d69-77b8-42ae-89c2-8b9c11cd3723 req-1ad78bd0-5cdb-4799-ae00-812fdd1fafeb service nova] Acquiring lock "refresh_cache-5d100a08-eaf2-4132-87dd-a8dcfe17f68f" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:40:44 user nova-compute[73572]: DEBUG nova.network.neutron [None req-216b485b-54e7-472b-b171-8b5b614072fa tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] [instance: 5d100a08-eaf2-4132-87dd-a8dcfe17f68f] Instance cache missing network info. {{(pid=73572) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 10:40:44 user nova-compute[73572]: DEBUG nova.network.neutron [None req-216b485b-54e7-472b-b171-8b5b614072fa tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] [instance: 5d100a08-eaf2-4132-87dd-a8dcfe17f68f] Updating instance_info_cache with network_info: [{"id": "efe52e67-0439-4035-988e-daae3acfc823", "address": "fa:16:3e:68:58:83", "network": {"id": "598e1cfa-caaf-470c-ac5a-e91aa2611d1f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1541764581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08b110acd72c427db0de4e98d05f5e56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefe52e67-04", "ovs_interfaceid": "efe52e67-0439-4035-988e-daae3acfc823", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:40:44 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-216b485b-54e7-472b-b171-8b5b614072fa tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Releasing lock "refresh_cache-5d100a08-eaf2-4132-87dd-a8dcfe17f68f" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:40:44 user nova-compute[73572]: DEBUG nova.compute.manager [None req-216b485b-54e7-472b-b171-8b5b614072fa tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] [instance: 5d100a08-eaf2-4132-87dd-a8dcfe17f68f] Instance network_info: |[{"id": "efe52e67-0439-4035-988e-daae3acfc823", "address": "fa:16:3e:68:58:83", "network": {"id": "598e1cfa-caaf-470c-ac5a-e91aa2611d1f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1541764581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08b110acd72c427db0de4e98d05f5e56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefe52e67-04", "ovs_interfaceid": "efe52e67-0439-4035-988e-daae3acfc823", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73572) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 10:40:44 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-4ae23d69-77b8-42ae-89c2-8b9c11cd3723 req-1ad78bd0-5cdb-4799-ae00-812fdd1fafeb service nova] Acquired lock "refresh_cache-5d100a08-eaf2-4132-87dd-a8dcfe17f68f" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:40:44 user nova-compute[73572]: DEBUG nova.network.neutron [req-4ae23d69-77b8-42ae-89c2-8b9c11cd3723 req-1ad78bd0-5cdb-4799-ae00-812fdd1fafeb service nova] [instance: 5d100a08-eaf2-4132-87dd-a8dcfe17f68f] Refreshing network info cache for port efe52e67-0439-4035-988e-daae3acfc823 {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 10:40:44 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-216b485b-54e7-472b-b171-8b5b614072fa tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] [instance: 5d100a08-eaf2-4132-87dd-a8dcfe17f68f] Start _get_guest_xml network_info=[{"id": "efe52e67-0439-4035-988e-daae3acfc823", "address": "fa:16:3e:68:58:83", "network": {"id": "598e1cfa-caaf-470c-ac5a-e91aa2611d1f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1541764581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08b110acd72c427db0de4e98d05f5e56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefe52e67-04", "ovs_interfaceid": "efe52e67-0439-4035-988e-daae3acfc823", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T10:07:33Z,direct_url=<?>,disk_format='qcow2',id=299da0c9-e1c4-48f0-be55-fbe20dd06bc9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5c995f8bbbab4368b67a253e0df3971a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T10:07:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'guest_format': None, 'size': 0, 'encryption_format': None, 'device_type': 'disk', 'image_id': '299da0c9-e1c4-48f0-be55-fbe20dd06bc9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73572) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 10:40:44 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-216b485b-54e7-472b-b171-8b5b614072fa tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:40:44 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-216b485b-54e7-472b-b171-8b5b614072fa tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:40:44 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-216b485b-54e7-472b-b171-8b5b614072fa tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73572) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 10:40:44 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-216b485b-54e7-472b-b171-8b5b614072fa tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] CPU controller missing on host. {{(pid=73572) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 10:40:44 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-216b485b-54e7-472b-b171-8b5b614072fa tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73572) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 10:40:44 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-216b485b-54e7-472b-b171-8b5b614072fa tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] CPU controller found on host. {{(pid=73572) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 10:40:44 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-216b485b-54e7-472b-b171-8b5b614072fa tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73572) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 10:40:44 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-216b485b-54e7-472b-b171-8b5b614072fa tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T10:07:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T10:07:33Z,direct_url=<?>,disk_format='qcow2',id=299da0c9-e1c4-48f0-be55-fbe20dd06bc9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5c995f8bbbab4368b67a253e0df3971a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T10:07:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 10:40:44 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-216b485b-54e7-472b-b171-8b5b614072fa tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Flavor limits 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 10:40:44 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-216b485b-54e7-472b-b171-8b5b614072fa tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Image limits 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 10:40:44 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-216b485b-54e7-472b-b171-8b5b614072fa tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Flavor pref 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 10:40:44 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-216b485b-54e7-472b-b171-8b5b614072fa tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Image pref 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 10:40:44 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-216b485b-54e7-472b-b171-8b5b614072fa tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 10:40:44 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-216b485b-54e7-472b-b171-8b5b614072fa tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 10:40:44 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-216b485b-54e7-472b-b171-8b5b614072fa tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73572) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 10:40:44 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-216b485b-54e7-472b-b171-8b5b614072fa tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Got 1 possible topologies {{(pid=73572) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 10:40:44 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-216b485b-54e7-472b-b171-8b5b614072fa tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 10:40:44 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-216b485b-54e7-472b-b171-8b5b614072fa tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 10:40:44 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-216b485b-54e7-472b-b171-8b5b614072fa tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T10:40:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-2059362283',display_name='tempest-SnapshotDataIntegrityTests-server-2059362283',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-2059362283',id=50,image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBKdEp0w0UXSvbsLXu31QpCjtLT19TQYHlehd0sPp9NdF2G4q72gh7+ChYSu7QWRPROEJWvRQ9nqCuCO81DqgKOI7Wd/69n7M8zXrBQgmGPg0HiA/bfGSCkqga+t1tS25Q==',key_name='tempest-keypair-663370735',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='08b110acd72c427db0de4e98d05f5e56',ramdisk_id='',reservation_id='r-gsabkpwk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1461246978',owner_user_name='tempest-SnapshotDataIntegrityTests-1461246978-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T10:40:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3ec14c9df0ff443eb6500d15209e001f',uuid=5d100a08-eaf2-4132-87dd-a8dcfe17f68f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "efe52e67-0439-4035-988e-daae3acfc823", "address": "fa:16:3e:68:58:83", "network": {"id": "598e1cfa-caaf-470c-ac5a-e91aa2611d1f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1541764581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08b110acd72c427db0de4e98d05f5e56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefe52e67-04", "ovs_interfaceid": "efe52e67-0439-4035-988e-daae3acfc823", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73572) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 10:40:44 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-216b485b-54e7-472b-b171-8b5b614072fa tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Converting VIF {"id": "efe52e67-0439-4035-988e-daae3acfc823", "address": "fa:16:3e:68:58:83", "network": {"id": "598e1cfa-caaf-470c-ac5a-e91aa2611d1f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1541764581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08b110acd72c427db0de4e98d05f5e56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefe52e67-04", "ovs_interfaceid": "efe52e67-0439-4035-988e-daae3acfc823", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:40:44 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-216b485b-54e7-472b-b171-8b5b614072fa tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:68:58:83,bridge_name='br-int',has_traffic_filtering=True,id=efe52e67-0439-4035-988e-daae3acfc823,network=Network(598e1cfa-caaf-470c-ac5a-e91aa2611d1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapefe52e67-04') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:40:44 user nova-compute[73572]: DEBUG nova.objects.instance [None req-216b485b-54e7-472b-b171-8b5b614072fa tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Lazy-loading 'pci_devices' on Instance uuid 5d100a08-eaf2-4132-87dd-a8dcfe17f68f {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:40:44 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-216b485b-54e7-472b-b171-8b5b614072fa tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] [instance: 5d100a08-eaf2-4132-87dd-a8dcfe17f68f] End _get_guest_xml xml=<domain type="kvm">
Aug 26 10:40:44 user nova-compute[73572]:   <uuid>5d100a08-eaf2-4132-87dd-a8dcfe17f68f</uuid>
Aug 26 10:40:44 user nova-compute[73572]:   <name>instance-00000032</name>
Aug 26 10:40:44 user nova-compute[73572]:   <memory>524288</memory>
Aug 26 10:40:44 user nova-compute[73572]:   <vcpu>1</vcpu>
Aug 26 10:40:44 user nova-compute[73572]:   <metadata>
Aug 26 10:40:44 user nova-compute[73572]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 10:40:44 user nova-compute[73572]:       <nova:package version="0.0.0"/>
Aug 26 10:40:44 user nova-compute[73572]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-2059362283</nova:name>
Aug 26 10:40:44 user nova-compute[73572]:       <nova:creationTime>2023-08-26 10:40:44</nova:creationTime>
Aug 26 10:40:44 user nova-compute[73572]:       <nova:flavor name="m1.tiny">
Aug 26 10:40:44 user nova-compute[73572]:         <nova:memory>512</nova:memory>
Aug 26 10:40:44 user nova-compute[73572]:         <nova:disk>1</nova:disk>
Aug 26 10:40:44 user nova-compute[73572]:         <nova:swap>0</nova:swap>
Aug 26 10:40:44 user nova-compute[73572]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 10:40:44 user nova-compute[73572]:         <nova:vcpus>1</nova:vcpus>
Aug 26 10:40:44 user nova-compute[73572]:       </nova:flavor>
Aug 26 10:40:44 user nova-compute[73572]:       <nova:owner>
Aug 26 10:40:44 user nova-compute[73572]:         <nova:user uuid="3ec14c9df0ff443eb6500d15209e001f">tempest-SnapshotDataIntegrityTests-1461246978-project-member</nova:user>
Aug 26 10:40:44 user nova-compute[73572]:         <nova:project uuid="08b110acd72c427db0de4e98d05f5e56">tempest-SnapshotDataIntegrityTests-1461246978</nova:project>
Aug 26 10:40:44 user nova-compute[73572]:       </nova:owner>
Aug 26 10:40:44 user nova-compute[73572]:       <nova:root type="image" uuid="299da0c9-e1c4-48f0-be55-fbe20dd06bc9"/>
Aug 26 10:40:44 user nova-compute[73572]:       <nova:ports>
Aug 26 10:40:44 user nova-compute[73572]:         <nova:port uuid="efe52e67-0439-4035-988e-daae3acfc823">
Aug 26 10:40:44 user nova-compute[73572]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 26 10:40:44 user nova-compute[73572]:         </nova:port>
Aug 26 10:40:44 user nova-compute[73572]:       </nova:ports>
Aug 26 10:40:44 user nova-compute[73572]:     </nova:instance>
Aug 26 10:40:44 user nova-compute[73572]:   </metadata>
Aug 26 10:40:44 user nova-compute[73572]:   <sysinfo type="smbios">
Aug 26 10:40:44 user nova-compute[73572]:     <system>
Aug 26 10:40:44 user nova-compute[73572]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 10:40:44 user nova-compute[73572]:       <entry name="product">OpenStack Nova</entry>
Aug 26 10:40:44 user nova-compute[73572]:       <entry name="version">0.0.0</entry>
Aug 26 10:40:44 user nova-compute[73572]:       <entry name="serial">5d100a08-eaf2-4132-87dd-a8dcfe17f68f</entry>
Aug 26 10:40:44 user nova-compute[73572]:       <entry name="uuid">5d100a08-eaf2-4132-87dd-a8dcfe17f68f</entry>
Aug 26 10:40:44 user nova-compute[73572]:       <entry name="family">Virtual Machine</entry>
Aug 26 10:40:44 user nova-compute[73572]:     </system>
Aug 26 10:40:44 user nova-compute[73572]:   </sysinfo>
Aug 26 10:40:44 user nova-compute[73572]:   <os>
Aug 26 10:40:44 user nova-compute[73572]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 10:40:44 user nova-compute[73572]:     <boot dev="hd"/>
Aug 26 10:40:44 user nova-compute[73572]:     <smbios mode="sysinfo"/>
Aug 26 10:40:44 user nova-compute[73572]:   </os>
Aug 26 10:40:44 user nova-compute[73572]:   <features>
Aug 26 10:40:44 user nova-compute[73572]:     <acpi/>
Aug 26 10:40:44 user nova-compute[73572]:     <apic/>
Aug 26 10:40:44 user nova-compute[73572]:     <vmcoreinfo/>
Aug 26 10:40:44 user nova-compute[73572]:   </features>
Aug 26 10:40:44 user nova-compute[73572]:   <clock offset="utc">
Aug 26 10:40:44 user nova-compute[73572]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 10:40:44 user nova-compute[73572]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 10:40:44 user nova-compute[73572]:     <timer name="hpet" present="no"/>
Aug 26 10:40:44 user nova-compute[73572]:   </clock>
Aug 26 10:40:44 user nova-compute[73572]:   <cpu mode="custom" match="exact">
Aug 26 10:40:44 user nova-compute[73572]:     <model>Nehalem</model>
Aug 26 10:40:44 user nova-compute[73572]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 10:40:44 user nova-compute[73572]:   </cpu>
Aug 26 10:40:44 user nova-compute[73572]:   <devices>
Aug 26 10:40:44 user nova-compute[73572]:     <disk type="file" device="disk">
Aug 26 10:40:44 user nova-compute[73572]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 10:40:44 user nova-compute[73572]:       <source file="/opt/stack/data/nova/instances/5d100a08-eaf2-4132-87dd-a8dcfe17f68f/disk"/>
Aug 26 10:40:44 user nova-compute[73572]:       <target dev="vda" bus="virtio"/>
Aug 26 10:40:44 user nova-compute[73572]:     </disk>
Aug 26 10:40:44 user nova-compute[73572]:     <interface type="ethernet">
Aug 26 10:40:44 user nova-compute[73572]:       <mac address="fa:16:3e:68:58:83"/>
Aug 26 10:40:44 user nova-compute[73572]:       <model type="virtio"/>
Aug 26 10:40:44 user nova-compute[73572]:       <mtu size="1442"/>
Aug 26 10:40:44 user nova-compute[73572]:       <target dev="tapefe52e67-04"/>
Aug 26 10:40:44 user nova-compute[73572]:     </interface>
Aug 26 10:40:44 user nova-compute[73572]:     <serial type="pty">
Aug 26 10:40:44 user nova-compute[73572]:       <log file="/opt/stack/data/nova/instances/5d100a08-eaf2-4132-87dd-a8dcfe17f68f/console.log" append="off"/>
Aug 26 10:40:44 user nova-compute[73572]:     </serial>
Aug 26 10:40:44 user nova-compute[73572]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 10:40:44 user nova-compute[73572]:     <video>
Aug 26 10:40:44 user nova-compute[73572]:       <model type="virtio"/>
Aug 26 10:40:44 user nova-compute[73572]:     </video>
Aug 26 10:40:44 user nova-compute[73572]:     <rng model="virtio">
Aug 26 10:40:44 user nova-compute[73572]:       <backend model="random">/dev/urandom</backend>
Aug 26 10:40:44 user nova-compute[73572]:     </rng>
Aug 26 10:40:44 user nova-compute[73572]:     <controller type="usb" index="0" model="none"/>
Aug 26 10:40:44 user nova-compute[73572]:     <memballoon model="virtio">
Aug 26 10:40:44 user nova-compute[73572]:       <stats period="10"/>
Aug 26 10:40:44 user nova-compute[73572]:     </memballoon>
Aug 26 10:40:44 user nova-compute[73572]:   </devices>
Aug 26 10:40:44 user nova-compute[73572]: </domain>
Aug 26 10:40:44 user nova-compute[73572]:  {{(pid=73572) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 10:40:44 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-216b485b-54e7-472b-b171-8b5b614072fa tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T10:40:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-2059362283',display_name='tempest-SnapshotDataIntegrityTests-server-2059362283',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-2059362283',id=50,image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBKdEp0w0UXSvbsLXu31QpCjtLT19TQYHlehd0sPp9NdF2G4q72gh7+ChYSu7QWRPROEJWvRQ9nqCuCO81DqgKOI7Wd/69n7M8zXrBQgmGPg0HiA/bfGSCkqga+t1tS25Q==',key_name='tempest-keypair-663370735',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='08b110acd72c427db0de4e98d05f5e56',ramdisk_id='',reservation_id='r-gsabkpwk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1461246978',owner_user_name='tempest-SnapshotDataIntegrityTests-1461246978-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T10:40:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3ec14c9df0ff443eb6500d15209e001f',uuid=5d100a08-eaf2-4132-87dd-a8dcfe17f68f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "efe52e67-0439-4035-988e-daae3acfc823", "address": "fa:16:3e:68:58:83", "network": {"id": "598e1cfa-caaf-470c-ac5a-e91aa2611d1f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1541764581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08b110acd72c427db0de4e98d05f5e56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefe52e67-04", "ovs_interfaceid": "efe52e67-0439-4035-988e-daae3acfc823", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 10:40:44 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-216b485b-54e7-472b-b171-8b5b614072fa tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Converting VIF {"id": "efe52e67-0439-4035-988e-daae3acfc823", "address": "fa:16:3e:68:58:83", "network": {"id": "598e1cfa-caaf-470c-ac5a-e91aa2611d1f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1541764581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08b110acd72c427db0de4e98d05f5e56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefe52e67-04", "ovs_interfaceid": "efe52e67-0439-4035-988e-daae3acfc823", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:40:44 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-216b485b-54e7-472b-b171-8b5b614072fa tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:68:58:83,bridge_name='br-int',has_traffic_filtering=True,id=efe52e67-0439-4035-988e-daae3acfc823,network=Network(598e1cfa-caaf-470c-ac5a-e91aa2611d1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapefe52e67-04') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:40:44 user nova-compute[73572]: DEBUG os_vif [None req-216b485b-54e7-472b-b171-8b5b614072fa tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:58:83,bridge_name='br-int',has_traffic_filtering=True,id=efe52e67-0439-4035-988e-daae3acfc823,network=Network(598e1cfa-caaf-470c-ac5a-e91aa2611d1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapefe52e67-04') {{(pid=73572) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 10:40:44 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:40:44 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:40:44 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 10:40:44 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:40:44 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapefe52e67-04, may_exist=True, interface_attrs={}) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:40:44 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapefe52e67-04, col_values=(('external_ids', {'iface-id': 'efe52e67-0439-4035-988e-daae3acfc823', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:68:58:83', 'vm-uuid': '5d100a08-eaf2-4132-87dd-a8dcfe17f68f'}),), if_exists=True) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:40:44 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:40:44 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:40:44 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:40:44 user nova-compute[73572]: INFO os_vif [None req-216b485b-54e7-472b-b171-8b5b614072fa tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:58:83,bridge_name='br-int',has_traffic_filtering=True,id=efe52e67-0439-4035-988e-daae3acfc823,network=Network(598e1cfa-caaf-470c-ac5a-e91aa2611d1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapefe52e67-04')
Aug 26 10:40:45 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-216b485b-54e7-472b-b171-8b5b614072fa tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] No BDM found with device name vda, not building metadata. {{(pid=73572) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 10:40:45 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-216b485b-54e7-472b-b171-8b5b614072fa tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] No VIF found with MAC fa:16:3e:68:58:83, not building metadata {{(pid=73572) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 10:40:45 user nova-compute[73572]: DEBUG nova.network.neutron [req-4ae23d69-77b8-42ae-89c2-8b9c11cd3723 req-1ad78bd0-5cdb-4799-ae00-812fdd1fafeb service nova] [instance: 5d100a08-eaf2-4132-87dd-a8dcfe17f68f] Updated VIF entry in instance network info cache for port efe52e67-0439-4035-988e-daae3acfc823. {{(pid=73572) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 10:40:45 user nova-compute[73572]: DEBUG nova.network.neutron [req-4ae23d69-77b8-42ae-89c2-8b9c11cd3723 req-1ad78bd0-5cdb-4799-ae00-812fdd1fafeb service nova] [instance: 5d100a08-eaf2-4132-87dd-a8dcfe17f68f] Updating instance_info_cache with network_info: [{"id": "efe52e67-0439-4035-988e-daae3acfc823", "address": "fa:16:3e:68:58:83", "network": {"id": "598e1cfa-caaf-470c-ac5a-e91aa2611d1f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1541764581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08b110acd72c427db0de4e98d05f5e56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefe52e67-04", "ovs_interfaceid": "efe52e67-0439-4035-988e-daae3acfc823", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:40:45 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-4ae23d69-77b8-42ae-89c2-8b9c11cd3723 req-1ad78bd0-5cdb-4799-ae00-812fdd1fafeb service nova] Releasing lock "refresh_cache-5d100a08-eaf2-4132-87dd-a8dcfe17f68f" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:40:45 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:40:45 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:40:46 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:40:46 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:40:46 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:40:46 user nova-compute[73572]: DEBUG nova.compute.manager [req-7ebf24d1-bc31-4e6c-8bd2-5e79a543d06e req-2f01225d-eab2-4d45-9885-9370c52066d2 service nova] [instance: 5d100a08-eaf2-4132-87dd-a8dcfe17f68f] Received event network-vif-plugged-efe52e67-0439-4035-988e-daae3acfc823 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:40:46 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-7ebf24d1-bc31-4e6c-8bd2-5e79a543d06e req-2f01225d-eab2-4d45-9885-9370c52066d2 service nova] Acquiring lock "5d100a08-eaf2-4132-87dd-a8dcfe17f68f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:40:46 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-7ebf24d1-bc31-4e6c-8bd2-5e79a543d06e req-2f01225d-eab2-4d45-9885-9370c52066d2 service nova] Lock "5d100a08-eaf2-4132-87dd-a8dcfe17f68f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:40:46 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-7ebf24d1-bc31-4e6c-8bd2-5e79a543d06e req-2f01225d-eab2-4d45-9885-9370c52066d2 service nova] Lock "5d100a08-eaf2-4132-87dd-a8dcfe17f68f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:40:46 user nova-compute[73572]: DEBUG nova.compute.manager [req-7ebf24d1-bc31-4e6c-8bd2-5e79a543d06e req-2f01225d-eab2-4d45-9885-9370c52066d2 service nova] [instance: 5d100a08-eaf2-4132-87dd-a8dcfe17f68f] No waiting events found dispatching network-vif-plugged-efe52e67-0439-4035-988e-daae3acfc823 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:40:46 user nova-compute[73572]: WARNING nova.compute.manager [req-7ebf24d1-bc31-4e6c-8bd2-5e79a543d06e req-2f01225d-eab2-4d45-9885-9370c52066d2 service nova] [instance: 5d100a08-eaf2-4132-87dd-a8dcfe17f68f] Received unexpected event network-vif-plugged-efe52e67-0439-4035-988e-daae3acfc823 for instance with vm_state building and task_state spawning.
Aug 26 10:40:47 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:40:47 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:40:47 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:40:47 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:40:47 user nova-compute[73572]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693046432.3835416, 68613b1e-c45c-4fd9-834c-3630ed0f456a => Stopped> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:40:47 user nova-compute[73572]: INFO nova.compute.manager [-] [instance: 68613b1e-c45c-4fd9-834c-3630ed0f456a] VM Stopped (Lifecycle Event)
Aug 26 10:40:47 user nova-compute[73572]: DEBUG nova.compute.manager [None req-62457dad-1f8a-49a7-b0cf-d589a55b92a0 None None] [instance: 68613b1e-c45c-4fd9-834c-3630ed0f456a] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:40:48 user nova-compute[73572]: DEBUG nova.virt.driver [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Emitting event <LifecycleEvent: 1693046448.4951875, 5d100a08-eaf2-4132-87dd-a8dcfe17f68f => Resumed> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:40:48 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 5d100a08-eaf2-4132-87dd-a8dcfe17f68f] VM Resumed (Lifecycle Event)
Aug 26 10:40:48 user nova-compute[73572]: DEBUG nova.compute.manager [None req-216b485b-54e7-472b-b171-8b5b614072fa tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] [instance: 5d100a08-eaf2-4132-87dd-a8dcfe17f68f] Instance event wait completed in 0 seconds for  {{(pid=73572) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 10:40:48 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-216b485b-54e7-472b-b171-8b5b614072fa tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] [instance: 5d100a08-eaf2-4132-87dd-a8dcfe17f68f] Guest created on hypervisor {{(pid=73572) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 10:40:48 user nova-compute[73572]: INFO nova.virt.libvirt.driver [-] [instance: 5d100a08-eaf2-4132-87dd-a8dcfe17f68f] Instance spawned successfully.
Aug 26 10:40:48 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-216b485b-54e7-472b-b171-8b5b614072fa tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] [instance: 5d100a08-eaf2-4132-87dd-a8dcfe17f68f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 10:40:48 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 5d100a08-eaf2-4132-87dd-a8dcfe17f68f] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:40:48 user nova-compute[73572]: DEBUG nova.compute.manager [req-142e2b6d-3c88-4b00-bc47-41c98ed3e2ad req-143f36e4-5273-4e84-a36d-71e1ace7aefb service nova] [instance: 4039a8aa-b1a7-497d-b12c-6fcc12ab2b0a] Received event network-changed-316fd822-b966-44d8-8147-5025d918f270 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:40:48 user nova-compute[73572]: DEBUG nova.compute.manager [req-142e2b6d-3c88-4b00-bc47-41c98ed3e2ad req-143f36e4-5273-4e84-a36d-71e1ace7aefb service nova] [instance: 4039a8aa-b1a7-497d-b12c-6fcc12ab2b0a] Refreshing instance network info cache due to event network-changed-316fd822-b966-44d8-8147-5025d918f270. {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 10:40:48 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-142e2b6d-3c88-4b00-bc47-41c98ed3e2ad req-143f36e4-5273-4e84-a36d-71e1ace7aefb service nova] Acquiring lock "refresh_cache-4039a8aa-b1a7-497d-b12c-6fcc12ab2b0a" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:40:48 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-142e2b6d-3c88-4b00-bc47-41c98ed3e2ad req-143f36e4-5273-4e84-a36d-71e1ace7aefb service nova] Acquired lock "refresh_cache-4039a8aa-b1a7-497d-b12c-6fcc12ab2b0a" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:40:48 user nova-compute[73572]: DEBUG nova.network.neutron [req-142e2b6d-3c88-4b00-bc47-41c98ed3e2ad req-143f36e4-5273-4e84-a36d-71e1ace7aefb service nova] [instance: 4039a8aa-b1a7-497d-b12c-6fcc12ab2b0a] Refreshing network info cache for port 316fd822-b966-44d8-8147-5025d918f270 {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 10:40:48 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-216b485b-54e7-472b-b171-8b5b614072fa tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] [instance: 5d100a08-eaf2-4132-87dd-a8dcfe17f68f] Found default for hw_cdrom_bus of ide {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:40:48 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-216b485b-54e7-472b-b171-8b5b614072fa tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] [instance: 5d100a08-eaf2-4132-87dd-a8dcfe17f68f] Found default for hw_disk_bus of virtio {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:40:48 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-216b485b-54e7-472b-b171-8b5b614072fa tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] [instance: 5d100a08-eaf2-4132-87dd-a8dcfe17f68f] Found default for hw_input_bus of None {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:40:48 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-216b485b-54e7-472b-b171-8b5b614072fa tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] [instance: 5d100a08-eaf2-4132-87dd-a8dcfe17f68f] Found default for hw_pointer_model of None {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:40:48 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-216b485b-54e7-472b-b171-8b5b614072fa tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] [instance: 5d100a08-eaf2-4132-87dd-a8dcfe17f68f] Found default for hw_video_model of virtio {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:40:48 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-216b485b-54e7-472b-b171-8b5b614072fa tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] [instance: 5d100a08-eaf2-4132-87dd-a8dcfe17f68f] Found default for hw_vif_model of virtio {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:40:48 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 5d100a08-eaf2-4132-87dd-a8dcfe17f68f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73572) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 10:40:48 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 5d100a08-eaf2-4132-87dd-a8dcfe17f68f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 10:40:48 user nova-compute[73572]: DEBUG nova.virt.driver [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Emitting event <LifecycleEvent: 1693046448.498542, 5d100a08-eaf2-4132-87dd-a8dcfe17f68f => Started> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:40:48 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 5d100a08-eaf2-4132-87dd-a8dcfe17f68f] VM Started (Lifecycle Event)
Aug 26 10:40:48 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 5d100a08-eaf2-4132-87dd-a8dcfe17f68f] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:40:48 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 5d100a08-eaf2-4132-87dd-a8dcfe17f68f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73572) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 10:40:48 user nova-compute[73572]: INFO nova.compute.manager [None req-216b485b-54e7-472b-b171-8b5b614072fa tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] [instance: 5d100a08-eaf2-4132-87dd-a8dcfe17f68f] Took 6.01 seconds to spawn the instance on the hypervisor.
Aug 26 10:40:48 user nova-compute[73572]: DEBUG nova.compute.manager [None req-216b485b-54e7-472b-b171-8b5b614072fa tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] [instance: 5d100a08-eaf2-4132-87dd-a8dcfe17f68f] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:40:48 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 5d100a08-eaf2-4132-87dd-a8dcfe17f68f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 10:40:48 user nova-compute[73572]: DEBUG nova.compute.manager [req-73666d7b-6f6a-49cc-b923-072ee38d8ea3 req-74f23ab1-2f58-49e1-bfa5-04b80e4d5b2c service nova] [instance: 5d100a08-eaf2-4132-87dd-a8dcfe17f68f] Received event network-vif-plugged-efe52e67-0439-4035-988e-daae3acfc823 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:40:48 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-73666d7b-6f6a-49cc-b923-072ee38d8ea3 req-74f23ab1-2f58-49e1-bfa5-04b80e4d5b2c service nova] Acquiring lock "5d100a08-eaf2-4132-87dd-a8dcfe17f68f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:40:48 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-73666d7b-6f6a-49cc-b923-072ee38d8ea3 req-74f23ab1-2f58-49e1-bfa5-04b80e4d5b2c service nova] Lock "5d100a08-eaf2-4132-87dd-a8dcfe17f68f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:40:48 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-73666d7b-6f6a-49cc-b923-072ee38d8ea3 req-74f23ab1-2f58-49e1-bfa5-04b80e4d5b2c service nova] Lock "5d100a08-eaf2-4132-87dd-a8dcfe17f68f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:40:48 user nova-compute[73572]: DEBUG nova.compute.manager [req-73666d7b-6f6a-49cc-b923-072ee38d8ea3 req-74f23ab1-2f58-49e1-bfa5-04b80e4d5b2c service nova] [instance: 5d100a08-eaf2-4132-87dd-a8dcfe17f68f] No waiting events found dispatching network-vif-plugged-efe52e67-0439-4035-988e-daae3acfc823 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:40:48 user nova-compute[73572]: WARNING nova.compute.manager [req-73666d7b-6f6a-49cc-b923-072ee38d8ea3 req-74f23ab1-2f58-49e1-bfa5-04b80e4d5b2c service nova] [instance: 5d100a08-eaf2-4132-87dd-a8dcfe17f68f] Received unexpected event network-vif-plugged-efe52e67-0439-4035-988e-daae3acfc823 for instance with vm_state building and task_state spawning.
Aug 26 10:40:48 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-b974799b-b1cc-47a0-a207-6d03417ec41f tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Acquiring lock "4039a8aa-b1a7-497d-b12c-6fcc12ab2b0a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:40:48 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-b974799b-b1cc-47a0-a207-6d03417ec41f tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Lock "4039a8aa-b1a7-497d-b12c-6fcc12ab2b0a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:40:48 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-b974799b-b1cc-47a0-a207-6d03417ec41f tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Acquiring lock "4039a8aa-b1a7-497d-b12c-6fcc12ab2b0a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:40:48 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-b974799b-b1cc-47a0-a207-6d03417ec41f tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Lock "4039a8aa-b1a7-497d-b12c-6fcc12ab2b0a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:40:48 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-b974799b-b1cc-47a0-a207-6d03417ec41f tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Lock "4039a8aa-b1a7-497d-b12c-6fcc12ab2b0a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:40:48 user nova-compute[73572]: INFO nova.compute.manager [None req-b974799b-b1cc-47a0-a207-6d03417ec41f tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 4039a8aa-b1a7-497d-b12c-6fcc12ab2b0a] Terminating instance
Aug 26 10:40:48 user nova-compute[73572]: DEBUG nova.compute.manager [None req-b974799b-b1cc-47a0-a207-6d03417ec41f tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 4039a8aa-b1a7-497d-b12c-6fcc12ab2b0a] Start destroying the instance on the hypervisor. {{(pid=73572) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 10:40:48 user nova-compute[73572]: INFO nova.compute.manager [None req-216b485b-54e7-472b-b171-8b5b614072fa tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] [instance: 5d100a08-eaf2-4132-87dd-a8dcfe17f68f] Took 6.99 seconds to build instance.
Aug 26 10:40:48 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-216b485b-54e7-472b-b171-8b5b614072fa tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Lock "5d100a08-eaf2-4132-87dd-a8dcfe17f68f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.097s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:40:48 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:40:48 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:40:48 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:40:48 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:40:48 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:40:49 user nova-compute[73572]: DEBUG nova.compute.manager [req-e6a53cda-ef9f-4532-ba79-6e49d4f3bf55 req-fa622925-7492-4f11-87d1-48b4042c572d service nova] [instance: 4039a8aa-b1a7-497d-b12c-6fcc12ab2b0a] Received event network-vif-unplugged-316fd822-b966-44d8-8147-5025d918f270 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:40:49 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-e6a53cda-ef9f-4532-ba79-6e49d4f3bf55 req-fa622925-7492-4f11-87d1-48b4042c572d service nova] Acquiring lock "4039a8aa-b1a7-497d-b12c-6fcc12ab2b0a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:40:49 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-e6a53cda-ef9f-4532-ba79-6e49d4f3bf55 req-fa622925-7492-4f11-87d1-48b4042c572d service nova] Lock "4039a8aa-b1a7-497d-b12c-6fcc12ab2b0a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:40:49 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-e6a53cda-ef9f-4532-ba79-6e49d4f3bf55 req-fa622925-7492-4f11-87d1-48b4042c572d service nova] Lock "4039a8aa-b1a7-497d-b12c-6fcc12ab2b0a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:40:49 user nova-compute[73572]: DEBUG nova.compute.manager [req-e6a53cda-ef9f-4532-ba79-6e49d4f3bf55 req-fa622925-7492-4f11-87d1-48b4042c572d service nova] [instance: 4039a8aa-b1a7-497d-b12c-6fcc12ab2b0a] No waiting events found dispatching network-vif-unplugged-316fd822-b966-44d8-8147-5025d918f270 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:40:49 user nova-compute[73572]: DEBUG nova.compute.manager [req-e6a53cda-ef9f-4532-ba79-6e49d4f3bf55 req-fa622925-7492-4f11-87d1-48b4042c572d service nova] [instance: 4039a8aa-b1a7-497d-b12c-6fcc12ab2b0a] Received event network-vif-unplugged-316fd822-b966-44d8-8147-5025d918f270 for instance with task_state deleting. {{(pid=73572) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 10:40:49 user nova-compute[73572]: DEBUG nova.network.neutron [req-142e2b6d-3c88-4b00-bc47-41c98ed3e2ad req-143f36e4-5273-4e84-a36d-71e1ace7aefb service nova] [instance: 4039a8aa-b1a7-497d-b12c-6fcc12ab2b0a] Updated VIF entry in instance network info cache for port 316fd822-b966-44d8-8147-5025d918f270. {{(pid=73572) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 10:40:49 user nova-compute[73572]: DEBUG nova.network.neutron [req-142e2b6d-3c88-4b00-bc47-41c98ed3e2ad req-143f36e4-5273-4e84-a36d-71e1ace7aefb service nova] [instance: 4039a8aa-b1a7-497d-b12c-6fcc12ab2b0a] Updating instance_info_cache with network_info: [{"id": "316fd822-b966-44d8-8147-5025d918f270", "address": "fa:16:3e:0f:a1:92", "network": {"id": "c520ee18-34a7-4781-bc97-419e9a702d40", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-280196989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfc130586d9f4581953f1b8ae1c4465e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap316fd822-b9", "ovs_interfaceid": "316fd822-b966-44d8-8147-5025d918f270", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:40:49 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-142e2b6d-3c88-4b00-bc47-41c98ed3e2ad req-143f36e4-5273-4e84-a36d-71e1ace7aefb service nova] Releasing lock "refresh_cache-4039a8aa-b1a7-497d-b12c-6fcc12ab2b0a" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:40:49 user nova-compute[73572]: INFO nova.virt.libvirt.driver [-] [instance: 4039a8aa-b1a7-497d-b12c-6fcc12ab2b0a] Instance destroyed successfully.
Aug 26 10:40:49 user nova-compute[73572]: DEBUG nova.objects.instance [None req-b974799b-b1cc-47a0-a207-6d03417ec41f tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Lazy-loading 'resources' on Instance uuid 4039a8aa-b1a7-497d-b12c-6fcc12ab2b0a {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:40:49 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-b974799b-b1cc-47a0-a207-6d03417ec41f tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T10:35:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1854182938',display_name='tempest-TestVolumeBootPattern-server-1854182938',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1854182938',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGgJMPcylFVXjDKqyW+etneKzTtQZ3h+rrNV9oGL9oH9Pq5o1BgNVxyCABCwPtuWnsI0hTQA59VGxuIY4NbTGf1rbJaGRZw/AtW9ND3j+IG9u2og6CdZ4G3lJYm/FnK6hA==',key_name='tempest-TestVolumeBootPattern-2036222457',keypairs=<?>,launch_index=0,launched_at=2023-08-26T10:35:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cfc130586d9f4581953f1b8ae1c4465e',ramdisk_id='',reservation_id='r-754anb10',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-73786062',owner_user_name='tempest-TestVolumeBootPattern-73786062-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T10:35:47Z,user_data=None,user_id='e1e80942e5db41c782bda686b10e2e4b',uuid=4039a8aa-b1a7-497d-b12c-6fcc12ab2b0a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "316fd822-b966-44d8-8147-5025d918f270", "address": "fa:16:3e:0f:a1:92", "network": {"id": "c520ee18-34a7-4781-bc97-419e9a702d40", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-280196989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfc130586d9f4581953f1b8ae1c4465e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap316fd822-b9", "ovs_interfaceid": "316fd822-b966-44d8-8147-5025d918f270", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 10:40:49 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-b974799b-b1cc-47a0-a207-6d03417ec41f tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Converting VIF {"id": "316fd822-b966-44d8-8147-5025d918f270", "address": "fa:16:3e:0f:a1:92", "network": {"id": "c520ee18-34a7-4781-bc97-419e9a702d40", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-280196989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfc130586d9f4581953f1b8ae1c4465e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap316fd822-b9", "ovs_interfaceid": "316fd822-b966-44d8-8147-5025d918f270", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:40:49 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-b974799b-b1cc-47a0-a207-6d03417ec41f tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0f:a1:92,bridge_name='br-int',has_traffic_filtering=True,id=316fd822-b966-44d8-8147-5025d918f270,network=Network(c520ee18-34a7-4781-bc97-419e9a702d40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap316fd822-b9') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:40:49 user nova-compute[73572]: DEBUG os_vif [None req-b974799b-b1cc-47a0-a207-6d03417ec41f tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0f:a1:92,bridge_name='br-int',has_traffic_filtering=True,id=316fd822-b966-44d8-8147-5025d918f270,network=Network(c520ee18-34a7-4781-bc97-419e9a702d40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap316fd822-b9') {{(pid=73572) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 10:40:49 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:40:49 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap316fd822-b9, bridge=br-int, if_exists=True) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:40:49 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:40:49 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:40:49 user nova-compute[73572]: INFO os_vif [None req-b974799b-b1cc-47a0-a207-6d03417ec41f tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0f:a1:92,bridge_name='br-int',has_traffic_filtering=True,id=316fd822-b966-44d8-8147-5025d918f270,network=Network(c520ee18-34a7-4781-bc97-419e9a702d40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap316fd822-b9')
Aug 26 10:40:49 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b974799b-b1cc-47a0-a207-6d03417ec41f tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 4039a8aa-b1a7-497d-b12c-6fcc12ab2b0a] calling os-brick to detach iSCSI Volume {{(pid=73572) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 10:40:49 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-b974799b-b1cc-47a0-a207-6d03417ec41f tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc89c3d6a10>, {'target_iqns': ['iqn.2010-10.org.openstack:ad1b4b19-ad16-436c-9fa3-e718bea4f540'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RjYPMhzx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 10:40:49 user nova-compute[73572]: WARNING os_brick.initiator.connectors.base [None req-b974799b-b1cc-47a0-a207-6d03417ec41f tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 10:40:49 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-b974799b-b1cc-47a0-a207-6d03417ec41f tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 10:40:49 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-b974799b-b1cc-47a0-a207-6d03417ec41f tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 10:40:49 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-b974799b-b1cc-47a0-a207-6d03417ec41f tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ad1b4b19-ad16-436c-9fa3-e718bea4f540', 0)] {{(pid=73572) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 10:40:49 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:40:49 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:40:49 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a429b50-5d1e-4fd6-aac9-5dcd4f9c1af2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ad1b4b19-ad16-436c-9fa3-e718bea4f540\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:40:49 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:40:49 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:40:49 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[34c03027-3218-4bd2-8a5d-005fcf46943e]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad1b4b19-ad16-436c-9fa3-e718bea4f540 (non-flash)\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:40:49 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-b974799b-b1cc-47a0-a207-6d03417ec41f tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad1b4b19-ad16-436c-9fa3-e718bea4f540 (non-flash)
Aug 26 10:40:49 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 10:40:49 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-b974799b-b1cc-47a0-a207-6d03417ec41f tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad1b4b19-ad16-436c-9fa3-e718bea4f540 (non-flash)
Aug 26 10:40:49 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 10:40:49 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-b974799b-b1cc-47a0-a207-6d03417ec41f tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc89c170670>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ad1b4b19-ad16-436c-9fa3-e718bea4f540'): ({'sdc'}, set())}) {{(pid=73572) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 10:40:49 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-b974799b-b1cc-47a0-a207-6d03417ec41f tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Removing single pathed devices sdc {{(pid=73572) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 10:40:49 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:40:49 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:40:49 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[89768d2e-cd7f-4478-bc2f-ff1837d70101]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:40:49 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:40:49 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.024s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:40:49 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[6503039d-5f2c-4297-b5b4-49ab5c29826c]: (4, ('ok\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:40:49 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-b974799b-b1cc-47a0-a207-6d03417ec41f tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Flushing IO for device /dev/sdc {{(pid=73572) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 10:40:49 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:40:49 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:40:49 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[342add86-174a-4805-aff5-f083432f8a76]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:40:49 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-b974799b-b1cc-47a0-a207-6d03417ec41f tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73572) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 10:40:49 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:40:49 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.049s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:40:49 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[360a259c-e255-4c27-9c9f-65d8f18aeb16]: (4, ('1', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:40:49 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-b974799b-b1cc-47a0-a207-6d03417ec41f tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73572) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 10:40:49 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-b974799b-b1cc-47a0-a207-6d03417ec41f tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] SCSI volumes sdc have been removed. {{(pid=73572) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 10:40:49 user nova-compute[73572]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_8d2e6963', '/dev/disk/by-id/scsi-26462343434393732', '/dev/disk/by-id/scsi-1SCST_BIO8d2e6963-db444972bba17506') {{(pid=84543) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 26 10:40:49 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c035791-6d70-428d-a3b0-0982a28ff9dc]: (4, None) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:40:49 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-b974799b-b1cc-47a0-a207-6d03417ec41f tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ad1b4b19-ad16-436c-9fa3-e718bea4f540')] {{(pid=73572) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 10:40:49 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad1b4b19-ad16-436c-9fa3-e718bea4f540 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:40:49 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad1b4b19-ad16-436c-9fa3-e718bea4f540 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:40:49 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[0efea0e4-da54-40e5-83ca-bb3545fa9a6e]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:40:49 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-b974799b-b1cc-47a0-a207-6d03417ec41f tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:40:49 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad1b4b19-ad16-436c-9fa3-e718bea4f540 -p 172.16.0.220:3260 --logout {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:40:49 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad1b4b19-ad16-436c-9fa3-e718bea4f540 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:40:49 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[de25303b-dbbf-497a-aadd-0ebc9ebb54ee]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:ad1b4b19-ad16-436c-9fa3-e718bea4f540, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:ad1b4b19-ad16-436c-9fa3-e718bea4f540, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:40:49 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-b974799b-b1cc-47a0-a207-6d03417ec41f tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:ad1b4b19-ad16-436c-9fa3-e718bea4f540, portal: 172.16.0.220,3260]
Aug 26 10:40:49 user nova-compute[73572]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:ad1b4b19-ad16-436c-9fa3-e718bea4f540, portal: 172.16.0.220,3260] successful.
Aug 26 10:40:49 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:40:49 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad1b4b19-ad16-436c-9fa3-e718bea4f540 -p 172.16.0.220:3260 --op delete {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:40:49 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad1b4b19-ad16-436c-9fa3-e718bea4f540 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:40:49 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[d59a7886-da70-484d-9859-69d40244c689]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:40:49 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-b974799b-b1cc-47a0-a207-6d03417ec41f tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:40:49 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-b974799b-b1cc-47a0-a207-6d03417ec41f tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.308s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 10:40:49 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-b974799b-b1cc-47a0-a207-6d03417ec41f tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] <== disconnect_volume: return (309ms) None {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 10:40:49 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b974799b-b1cc-47a0-a207-6d03417ec41f tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 4039a8aa-b1a7-497d-b12c-6fcc12ab2b0a] Disconnected iSCSI Volume {{(pid=73572) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 10:40:49 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-b974799b-b1cc-47a0-a207-6d03417ec41f tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 4039a8aa-b1a7-497d-b12c-6fcc12ab2b0a] Deleting instance files /opt/stack/data/nova/instances/4039a8aa-b1a7-497d-b12c-6fcc12ab2b0a_del
Aug 26 10:40:49 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-b974799b-b1cc-47a0-a207-6d03417ec41f tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 4039a8aa-b1a7-497d-b12c-6fcc12ab2b0a] Deletion of /opt/stack/data/nova/instances/4039a8aa-b1a7-497d-b12c-6fcc12ab2b0a_del complete
Aug 26 10:40:49 user nova-compute[73572]: INFO nova.compute.manager [None req-b974799b-b1cc-47a0-a207-6d03417ec41f tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 4039a8aa-b1a7-497d-b12c-6fcc12ab2b0a] Took 1.16 seconds to destroy the instance on the hypervisor.
Aug 26 10:40:49 user nova-compute[73572]: DEBUG oslo.service.loopingcall [None req-b974799b-b1cc-47a0-a207-6d03417ec41f tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73572) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 10:40:49 user nova-compute[73572]: DEBUG nova.compute.manager [-] [instance: 4039a8aa-b1a7-497d-b12c-6fcc12ab2b0a] Deallocating network for instance {{(pid=73572) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 10:40:49 user nova-compute[73572]: DEBUG nova.network.neutron [-] [instance: 4039a8aa-b1a7-497d-b12c-6fcc12ab2b0a] deallocate_for_instance() {{(pid=73572) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 10:40:50 user nova-compute[73572]: DEBUG nova.network.neutron [-] [instance: 4039a8aa-b1a7-497d-b12c-6fcc12ab2b0a] Updating instance_info_cache with network_info: [] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:40:50 user nova-compute[73572]: INFO nova.compute.manager [-] [instance: 4039a8aa-b1a7-497d-b12c-6fcc12ab2b0a] Took 0.58 seconds to deallocate network for instance.
Aug 26 10:40:50 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:40:50 user nova-compute[73572]: DEBUG nova.compute.manager [req-6e4c1448-7ba9-40d4-b4da-1403a089342c req-11887a3b-6e51-4f73-a670-8f674cb43916 service nova] [instance: 4039a8aa-b1a7-497d-b12c-6fcc12ab2b0a] Received event network-vif-deleted-316fd822-b966-44d8-8147-5025d918f270 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:40:51 user nova-compute[73572]: DEBUG nova.compute.manager [req-9966f95c-49b2-4de9-ae93-94c483107e5e req-c6c834e5-76cc-4be7-83c7-7982f53a22f7 service nova] [instance: 4039a8aa-b1a7-497d-b12c-6fcc12ab2b0a] Received event network-vif-plugged-316fd822-b966-44d8-8147-5025d918f270 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:40:51 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-9966f95c-49b2-4de9-ae93-94c483107e5e req-c6c834e5-76cc-4be7-83c7-7982f53a22f7 service nova] Acquiring lock "4039a8aa-b1a7-497d-b12c-6fcc12ab2b0a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:40:51 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-9966f95c-49b2-4de9-ae93-94c483107e5e req-c6c834e5-76cc-4be7-83c7-7982f53a22f7 service nova] Lock "4039a8aa-b1a7-497d-b12c-6fcc12ab2b0a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:40:51 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-9966f95c-49b2-4de9-ae93-94c483107e5e req-c6c834e5-76cc-4be7-83c7-7982f53a22f7 service nova] Lock "4039a8aa-b1a7-497d-b12c-6fcc12ab2b0a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:40:51 user nova-compute[73572]: DEBUG nova.compute.manager [req-9966f95c-49b2-4de9-ae93-94c483107e5e req-c6c834e5-76cc-4be7-83c7-7982f53a22f7 service nova] [instance: 4039a8aa-b1a7-497d-b12c-6fcc12ab2b0a] No waiting events found dispatching network-vif-plugged-316fd822-b966-44d8-8147-5025d918f270 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:40:51 user nova-compute[73572]: WARNING nova.compute.manager [req-9966f95c-49b2-4de9-ae93-94c483107e5e req-c6c834e5-76cc-4be7-83c7-7982f53a22f7 service nova] [instance: 4039a8aa-b1a7-497d-b12c-6fcc12ab2b0a] Received unexpected event network-vif-plugged-316fd822-b966-44d8-8147-5025d918f270 for instance with vm_state active and task_state deleting.
Aug 26 10:40:51 user nova-compute[73572]: INFO nova.compute.manager [None req-b974799b-b1cc-47a0-a207-6d03417ec41f tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] [instance: 4039a8aa-b1a7-497d-b12c-6fcc12ab2b0a] Took 0.81 seconds to detach 1 volumes for instance.
Aug 26 10:40:51 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-b974799b-b1cc-47a0-a207-6d03417ec41f tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:40:51 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-b974799b-b1cc-47a0-a207-6d03417ec41f tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:40:51 user nova-compute[73572]: DEBUG nova.compute.provider_tree [None req-b974799b-b1cc-47a0-a207-6d03417ec41f tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Inventory has not changed in ProviderTree for provider: e2cec974-59b2-4c77-a53d-a7f4e5a30d75 {{(pid=73572) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 10:40:51 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-b974799b-b1cc-47a0-a207-6d03417ec41f tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Inventory has not changed for provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73572) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 10:40:51 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-b974799b-b1cc-47a0-a207-6d03417ec41f tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.149s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:40:51 user nova-compute[73572]: INFO nova.scheduler.client.report [None req-b974799b-b1cc-47a0-a207-6d03417ec41f tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Deleted allocations for instance 4039a8aa-b1a7-497d-b12c-6fcc12ab2b0a
Aug 26 10:40:51 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-b974799b-b1cc-47a0-a207-6d03417ec41f tempest-TestVolumeBootPattern-73786062 tempest-TestVolumeBootPattern-73786062-project-member] Lock "4039a8aa-b1a7-497d-b12c-6fcc12ab2b0a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.918s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:40:54 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:40:55 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:40:58 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:40:59 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:41:00 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:41:04 user nova-compute[73572]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693046449.436646, 4039a8aa-b1a7-497d-b12c-6fcc12ab2b0a => Stopped> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:41:04 user nova-compute[73572]: INFO nova.compute.manager [-] [instance: 4039a8aa-b1a7-497d-b12c-6fcc12ab2b0a] VM Stopped (Lifecycle Event)
Aug 26 10:41:04 user nova-compute[73572]: DEBUG nova.compute.manager [None req-13d38b59-5ac9-487b-9514-edd295130af2 None None] [instance: 4039a8aa-b1a7-497d-b12c-6fcc12ab2b0a] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:41:04 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:41:05 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:41:09 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:41:10 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:41:14 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:41:15 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:41:19 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:41:20 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:41:24 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:41:26 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:41:29 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:41:31 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:41:32 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:41:32 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Starting heal instance info cache {{(pid=73572) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 10:41:32 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Didn't find any instances for network info cache update. {{(pid=73572) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 26 10:41:32 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:41:34 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:41:34 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:41:34 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73572) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 10:41:34 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73572) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 10:41:34 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73572) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 10:41:34 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:41:36 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:41:38 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:41:39 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:41:39 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:41:39 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73572) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 10:41:39 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73572) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 10:41:39 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73572) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 10:41:39 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:41:39 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:41:39 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:41:39 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73572) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 10:41:42 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:41:42 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:41:42 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:41:42 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:41:42 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:41:42 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Auditing locally available compute resources for user (node: user) {{(pid=73572) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 10:41:42 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d100a08-eaf2-4132-87dd-a8dcfe17f68f/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:41:43 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d100a08-eaf2-4132-87dd-a8dcfe17f68f/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:41:43 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d100a08-eaf2-4132-87dd-a8dcfe17f68f/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:41:43 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d100a08-eaf2-4132-87dd-a8dcfe17f68f/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:41:43 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:41:43 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:41:43 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Hypervisor/Node resource view: name=user free_ram=8591MB free_disk=25.168228149414062GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=73572) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 10:41:43 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:41:43 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:41:43 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance 5d100a08-eaf2-4132-87dd-a8dcfe17f68f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:41:43 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73572) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 10:41:43 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73572) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 10:41:43 user nova-compute[73572]: DEBUG nova.compute.provider_tree [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Inventory has not changed in ProviderTree for provider: e2cec974-59b2-4c77-a53d-a7f4e5a30d75 {{(pid=73572) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 10:41:43 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Inventory has not changed for provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73572) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 10:41:43 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Compute_service record updated for user:user {{(pid=73572) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 10:41:43 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.233s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:41:44 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:41:44 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:41:44 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:41:49 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:41:50 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:41:53 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:41:54 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:41:59 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:42:03 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:42:04 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:42:05 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:42:05 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:42:09 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:42:10 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:42:10 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:42:14 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:42:14 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:42:15 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:42:16 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-c9b9b0d8-244c-4529-9034-736229ec8a4f tempest-VolumesActionsTest-1975068690 tempest-VolumesActionsTest-1975068690-project-member] Acquiring lock "28e0ccc5-be20-4246-afae-3c193eb14433" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:42:16 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-c9b9b0d8-244c-4529-9034-736229ec8a4f tempest-VolumesActionsTest-1975068690 tempest-VolumesActionsTest-1975068690-project-member] Lock "28e0ccc5-be20-4246-afae-3c193eb14433" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:42:16 user nova-compute[73572]: DEBUG nova.compute.manager [None req-c9b9b0d8-244c-4529-9034-736229ec8a4f tempest-VolumesActionsTest-1975068690 tempest-VolumesActionsTest-1975068690-project-member] [instance: 28e0ccc5-be20-4246-afae-3c193eb14433] Starting instance... {{(pid=73572) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 10:42:16 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-c9b9b0d8-244c-4529-9034-736229ec8a4f tempest-VolumesActionsTest-1975068690 tempest-VolumesActionsTest-1975068690-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:42:16 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-c9b9b0d8-244c-4529-9034-736229ec8a4f tempest-VolumesActionsTest-1975068690 tempest-VolumesActionsTest-1975068690-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:42:16 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-c9b9b0d8-244c-4529-9034-736229ec8a4f tempest-VolumesActionsTest-1975068690 tempest-VolumesActionsTest-1975068690-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73572) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 10:42:16 user nova-compute[73572]: INFO nova.compute.claims [None req-c9b9b0d8-244c-4529-9034-736229ec8a4f tempest-VolumesActionsTest-1975068690 tempest-VolumesActionsTest-1975068690-project-member] [instance: 28e0ccc5-be20-4246-afae-3c193eb14433] Claim successful on node user
Aug 26 10:42:16 user nova-compute[73572]: DEBUG nova.compute.provider_tree [None req-c9b9b0d8-244c-4529-9034-736229ec8a4f tempest-VolumesActionsTest-1975068690 tempest-VolumesActionsTest-1975068690-project-member] Inventory has not changed in ProviderTree for provider: e2cec974-59b2-4c77-a53d-a7f4e5a30d75 {{(pid=73572) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 10:42:16 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-c9b9b0d8-244c-4529-9034-736229ec8a4f tempest-VolumesActionsTest-1975068690 tempest-VolumesActionsTest-1975068690-project-member] Inventory has not changed for provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73572) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 10:42:16 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-c9b9b0d8-244c-4529-9034-736229ec8a4f tempest-VolumesActionsTest-1975068690 tempest-VolumesActionsTest-1975068690-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.232s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:42:16 user nova-compute[73572]: DEBUG nova.compute.manager [None req-c9b9b0d8-244c-4529-9034-736229ec8a4f tempest-VolumesActionsTest-1975068690 tempest-VolumesActionsTest-1975068690-project-member] [instance: 28e0ccc5-be20-4246-afae-3c193eb14433] Start building networks asynchronously for instance. {{(pid=73572) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 10:42:16 user nova-compute[73572]: DEBUG nova.compute.manager [None req-c9b9b0d8-244c-4529-9034-736229ec8a4f tempest-VolumesActionsTest-1975068690 tempest-VolumesActionsTest-1975068690-project-member] [instance: 28e0ccc5-be20-4246-afae-3c193eb14433] Allocating IP information in the background. {{(pid=73572) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 10:42:16 user nova-compute[73572]: DEBUG nova.network.neutron [None req-c9b9b0d8-244c-4529-9034-736229ec8a4f tempest-VolumesActionsTest-1975068690 tempest-VolumesActionsTest-1975068690-project-member] [instance: 28e0ccc5-be20-4246-afae-3c193eb14433] allocate_for_instance() {{(pid=73572) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 10:42:16 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-c9b9b0d8-244c-4529-9034-736229ec8a4f tempest-VolumesActionsTest-1975068690 tempest-VolumesActionsTest-1975068690-project-member] [instance: 28e0ccc5-be20-4246-afae-3c193eb14433] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 10:42:16 user nova-compute[73572]: DEBUG nova.compute.manager [None req-c9b9b0d8-244c-4529-9034-736229ec8a4f tempest-VolumesActionsTest-1975068690 tempest-VolumesActionsTest-1975068690-project-member] [instance: 28e0ccc5-be20-4246-afae-3c193eb14433] Start building block device mappings for instance. {{(pid=73572) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 10:42:16 user nova-compute[73572]: DEBUG nova.policy [None req-c9b9b0d8-244c-4529-9034-736229ec8a4f tempest-VolumesActionsTest-1975068690 tempest-VolumesActionsTest-1975068690-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'faa88d2f21684e1a9f4c0ba4b786a795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b4ed9a0f884465bc9ff940aa8d4dba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73572) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 10:42:16 user nova-compute[73572]: DEBUG nova.compute.manager [None req-c9b9b0d8-244c-4529-9034-736229ec8a4f tempest-VolumesActionsTest-1975068690 tempest-VolumesActionsTest-1975068690-project-member] [instance: 28e0ccc5-be20-4246-afae-3c193eb14433] Start spawning the instance on the hypervisor. {{(pid=73572) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 10:42:16 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-c9b9b0d8-244c-4529-9034-736229ec8a4f tempest-VolumesActionsTest-1975068690 tempest-VolumesActionsTest-1975068690-project-member] [instance: 28e0ccc5-be20-4246-afae-3c193eb14433] Creating instance directory {{(pid=73572) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 10:42:16 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-c9b9b0d8-244c-4529-9034-736229ec8a4f tempest-VolumesActionsTest-1975068690 tempest-VolumesActionsTest-1975068690-project-member] [instance: 28e0ccc5-be20-4246-afae-3c193eb14433] Creating image(s)
Aug 26 10:42:16 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-c9b9b0d8-244c-4529-9034-736229ec8a4f tempest-VolumesActionsTest-1975068690 tempest-VolumesActionsTest-1975068690-project-member] Acquiring lock "/opt/stack/data/nova/instances/28e0ccc5-be20-4246-afae-3c193eb14433/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:42:16 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-c9b9b0d8-244c-4529-9034-736229ec8a4f tempest-VolumesActionsTest-1975068690 tempest-VolumesActionsTest-1975068690-project-member] Lock "/opt/stack/data/nova/instances/28e0ccc5-be20-4246-afae-3c193eb14433/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:42:16 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-c9b9b0d8-244c-4529-9034-736229ec8a4f tempest-VolumesActionsTest-1975068690 tempest-VolumesActionsTest-1975068690-project-member] Lock "/opt/stack/data/nova/instances/28e0ccc5-be20-4246-afae-3c193eb14433/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.011s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:42:16 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-c9b9b0d8-244c-4529-9034-736229ec8a4f tempest-VolumesActionsTest-1975068690 tempest-VolumesActionsTest-1975068690-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:42:16 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-c9b9b0d8-244c-4529-9034-736229ec8a4f tempest-VolumesActionsTest-1975068690 tempest-VolumesActionsTest-1975068690-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json" returned: 0 in 0.199s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:42:16 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-c9b9b0d8-244c-4529-9034-736229ec8a4f tempest-VolumesActionsTest-1975068690 tempest-VolumesActionsTest-1975068690-project-member] Acquiring lock "2099350d6f3bcd0de9471c73862d4fe75b049801" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:42:16 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-c9b9b0d8-244c-4529-9034-736229ec8a4f tempest-VolumesActionsTest-1975068690 tempest-VolumesActionsTest-1975068690-project-member] Lock "2099350d6f3bcd0de9471c73862d4fe75b049801" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:42:16 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-c9b9b0d8-244c-4529-9034-736229ec8a4f tempest-VolumesActionsTest-1975068690 tempest-VolumesActionsTest-1975068690-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:42:17 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-c9b9b0d8-244c-4529-9034-736229ec8a4f tempest-VolumesActionsTest-1975068690 tempest-VolumesActionsTest-1975068690-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json" returned: 0 in 0.184s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:42:17 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-c9b9b0d8-244c-4529-9034-736229ec8a4f tempest-VolumesActionsTest-1975068690 tempest-VolumesActionsTest-1975068690-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801,backing_fmt=raw /opt/stack/data/nova/instances/28e0ccc5-be20-4246-afae-3c193eb14433/disk 1073741824 {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:42:17 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-c9b9b0d8-244c-4529-9034-736229ec8a4f tempest-VolumesActionsTest-1975068690 tempest-VolumesActionsTest-1975068690-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801,backing_fmt=raw /opt/stack/data/nova/instances/28e0ccc5-be20-4246-afae-3c193eb14433/disk 1073741824" returned: 0 in 0.053s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:42:17 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-c9b9b0d8-244c-4529-9034-736229ec8a4f tempest-VolumesActionsTest-1975068690 tempest-VolumesActionsTest-1975068690-project-member] Lock "2099350d6f3bcd0de9471c73862d4fe75b049801" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.245s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:42:17 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-c9b9b0d8-244c-4529-9034-736229ec8a4f tempest-VolumesActionsTest-1975068690 tempest-VolumesActionsTest-1975068690-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:42:17 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-c9b9b0d8-244c-4529-9034-736229ec8a4f tempest-VolumesActionsTest-1975068690 tempest-VolumesActionsTest-1975068690-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json" returned: 0 in 0.185s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:42:17 user nova-compute[73572]: DEBUG nova.virt.disk.api [None req-c9b9b0d8-244c-4529-9034-736229ec8a4f tempest-VolumesActionsTest-1975068690 tempest-VolumesActionsTest-1975068690-project-member] Checking if we can resize image /opt/stack/data/nova/instances/28e0ccc5-be20-4246-afae-3c193eb14433/disk. size=1073741824 {{(pid=73572) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 10:42:17 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-c9b9b0d8-244c-4529-9034-736229ec8a4f tempest-VolumesActionsTest-1975068690 tempest-VolumesActionsTest-1975068690-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28e0ccc5-be20-4246-afae-3c193eb14433/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:42:17 user nova-compute[73572]: DEBUG nova.network.neutron [None req-c9b9b0d8-244c-4529-9034-736229ec8a4f tempest-VolumesActionsTest-1975068690 tempest-VolumesActionsTest-1975068690-project-member] [instance: 28e0ccc5-be20-4246-afae-3c193eb14433] Successfully created port: 77e7fd47-0628-44d4-a900-ed772e10c665 {{(pid=73572) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 10:42:17 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-c9b9b0d8-244c-4529-9034-736229ec8a4f tempest-VolumesActionsTest-1975068690 tempest-VolumesActionsTest-1975068690-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28e0ccc5-be20-4246-afae-3c193eb14433/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:42:17 user nova-compute[73572]: DEBUG nova.virt.disk.api [None req-c9b9b0d8-244c-4529-9034-736229ec8a4f tempest-VolumesActionsTest-1975068690 tempest-VolumesActionsTest-1975068690-project-member] Cannot resize image /opt/stack/data/nova/instances/28e0ccc5-be20-4246-afae-3c193eb14433/disk to a smaller size. {{(pid=73572) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 10:42:17 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-c9b9b0d8-244c-4529-9034-736229ec8a4f tempest-VolumesActionsTest-1975068690 tempest-VolumesActionsTest-1975068690-project-member] [instance: 28e0ccc5-be20-4246-afae-3c193eb14433] Created local disks {{(pid=73572) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 10:42:17 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-c9b9b0d8-244c-4529-9034-736229ec8a4f tempest-VolumesActionsTest-1975068690 tempest-VolumesActionsTest-1975068690-project-member] [instance: 28e0ccc5-be20-4246-afae-3c193eb14433] Ensure instance console log exists: /opt/stack/data/nova/instances/28e0ccc5-be20-4246-afae-3c193eb14433/console.log {{(pid=73572) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 10:42:17 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-c9b9b0d8-244c-4529-9034-736229ec8a4f tempest-VolumesActionsTest-1975068690 tempest-VolumesActionsTest-1975068690-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:42:17 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-c9b9b0d8-244c-4529-9034-736229ec8a4f tempest-VolumesActionsTest-1975068690 tempest-VolumesActionsTest-1975068690-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:42:17 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-c9b9b0d8-244c-4529-9034-736229ec8a4f tempest-VolumesActionsTest-1975068690 tempest-VolumesActionsTest-1975068690-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:42:18 user nova-compute[73572]: DEBUG nova.network.neutron [None req-c9b9b0d8-244c-4529-9034-736229ec8a4f tempest-VolumesActionsTest-1975068690 tempest-VolumesActionsTest-1975068690-project-member] [instance: 28e0ccc5-be20-4246-afae-3c193eb14433] Successfully updated port: 77e7fd47-0628-44d4-a900-ed772e10c665 {{(pid=73572) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 10:42:18 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-c9b9b0d8-244c-4529-9034-736229ec8a4f tempest-VolumesActionsTest-1975068690 tempest-VolumesActionsTest-1975068690-project-member] Acquiring lock "refresh_cache-28e0ccc5-be20-4246-afae-3c193eb14433" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:42:18 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-c9b9b0d8-244c-4529-9034-736229ec8a4f tempest-VolumesActionsTest-1975068690 tempest-VolumesActionsTest-1975068690-project-member] Acquired lock "refresh_cache-28e0ccc5-be20-4246-afae-3c193eb14433" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:42:18 user nova-compute[73572]: DEBUG nova.network.neutron [None req-c9b9b0d8-244c-4529-9034-736229ec8a4f tempest-VolumesActionsTest-1975068690 tempest-VolumesActionsTest-1975068690-project-member] [instance: 28e0ccc5-be20-4246-afae-3c193eb14433] Building network info cache for instance {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 10:42:18 user nova-compute[73572]: DEBUG nova.network.neutron [None req-c9b9b0d8-244c-4529-9034-736229ec8a4f tempest-VolumesActionsTest-1975068690 tempest-VolumesActionsTest-1975068690-project-member] [instance: 28e0ccc5-be20-4246-afae-3c193eb14433] Instance cache missing network info. {{(pid=73572) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 10:42:18 user nova-compute[73572]: DEBUG nova.compute.manager [req-9c2ca396-d7d5-40f7-b460-5a74ecc219f8 req-880df5c3-26d7-4ab6-9d69-57f4beaf515b service nova] [instance: 28e0ccc5-be20-4246-afae-3c193eb14433] Received event network-changed-77e7fd47-0628-44d4-a900-ed772e10c665 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:42:18 user nova-compute[73572]: DEBUG nova.compute.manager [req-9c2ca396-d7d5-40f7-b460-5a74ecc219f8 req-880df5c3-26d7-4ab6-9d69-57f4beaf515b service nova] [instance: 28e0ccc5-be20-4246-afae-3c193eb14433] Refreshing instance network info cache due to event network-changed-77e7fd47-0628-44d4-a900-ed772e10c665. {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 10:42:18 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-9c2ca396-d7d5-40f7-b460-5a74ecc219f8 req-880df5c3-26d7-4ab6-9d69-57f4beaf515b service nova] Acquiring lock "refresh_cache-28e0ccc5-be20-4246-afae-3c193eb14433" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:42:18 user nova-compute[73572]: DEBUG nova.network.neutron [None req-c9b9b0d8-244c-4529-9034-736229ec8a4f tempest-VolumesActionsTest-1975068690 tempest-VolumesActionsTest-1975068690-project-member] [instance: 28e0ccc5-be20-4246-afae-3c193eb14433] Updating instance_info_cache with network_info: [{"id": "77e7fd47-0628-44d4-a900-ed772e10c665", "address": "fa:16:3e:5c:82:71", "network": {"id": "0ea23c7b-e740-40ee-80f2-add01d583c33", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1245070125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25b4ed9a0f884465bc9ff940aa8d4dba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77e7fd47-06", "ovs_interfaceid": "77e7fd47-0628-44d4-a900-ed772e10c665", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:42:19 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-c9b9b0d8-244c-4529-9034-736229ec8a4f tempest-VolumesActionsTest-1975068690 tempest-VolumesActionsTest-1975068690-project-member] Releasing lock "refresh_cache-28e0ccc5-be20-4246-afae-3c193eb14433" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:42:19 user nova-compute[73572]: DEBUG nova.compute.manager [None req-c9b9b0d8-244c-4529-9034-736229ec8a4f tempest-VolumesActionsTest-1975068690 tempest-VolumesActionsTest-1975068690-project-member] [instance: 28e0ccc5-be20-4246-afae-3c193eb14433] Instance network_info: |[{"id": "77e7fd47-0628-44d4-a900-ed772e10c665", "address": "fa:16:3e:5c:82:71", "network": {"id": "0ea23c7b-e740-40ee-80f2-add01d583c33", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1245070125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25b4ed9a0f884465bc9ff940aa8d4dba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77e7fd47-06", "ovs_interfaceid": "77e7fd47-0628-44d4-a900-ed772e10c665", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73572) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 10:42:19 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-9c2ca396-d7d5-40f7-b460-5a74ecc219f8 req-880df5c3-26d7-4ab6-9d69-57f4beaf515b service nova] Acquired lock "refresh_cache-28e0ccc5-be20-4246-afae-3c193eb14433" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:42:19 user nova-compute[73572]: DEBUG nova.network.neutron [req-9c2ca396-d7d5-40f7-b460-5a74ecc219f8 req-880df5c3-26d7-4ab6-9d69-57f4beaf515b service nova] [instance: 28e0ccc5-be20-4246-afae-3c193eb14433] Refreshing network info cache for port 77e7fd47-0628-44d4-a900-ed772e10c665 {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 10:42:19 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-c9b9b0d8-244c-4529-9034-736229ec8a4f tempest-VolumesActionsTest-1975068690 tempest-VolumesActionsTest-1975068690-project-member] [instance: 28e0ccc5-be20-4246-afae-3c193eb14433] Start _get_guest_xml network_info=[{"id": "77e7fd47-0628-44d4-a900-ed772e10c665", "address": "fa:16:3e:5c:82:71", "network": {"id": "0ea23c7b-e740-40ee-80f2-add01d583c33", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1245070125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25b4ed9a0f884465bc9ff940aa8d4dba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77e7fd47-06", "ovs_interfaceid": "77e7fd47-0628-44d4-a900-ed772e10c665", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T10:07:33Z,direct_url=<?>,disk_format='qcow2',id=299da0c9-e1c4-48f0-be55-fbe20dd06bc9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5c995f8bbbab4368b67a253e0df3971a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T10:07:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'guest_format': None, 'size': 0, 'encryption_format': None, 'device_type': 'disk', 'image_id': '299da0c9-e1c4-48f0-be55-fbe20dd06bc9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73572) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 10:42:19 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-c9b9b0d8-244c-4529-9034-736229ec8a4f tempest-VolumesActionsTest-1975068690 tempest-VolumesActionsTest-1975068690-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:42:19 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-c9b9b0d8-244c-4529-9034-736229ec8a4f tempest-VolumesActionsTest-1975068690 tempest-VolumesActionsTest-1975068690-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:42:19 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-c9b9b0d8-244c-4529-9034-736229ec8a4f tempest-VolumesActionsTest-1975068690 tempest-VolumesActionsTest-1975068690-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73572) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 10:42:19 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-c9b9b0d8-244c-4529-9034-736229ec8a4f tempest-VolumesActionsTest-1975068690 tempest-VolumesActionsTest-1975068690-project-member] CPU controller missing on host. {{(pid=73572) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 10:42:19 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-c9b9b0d8-244c-4529-9034-736229ec8a4f tempest-VolumesActionsTest-1975068690 tempest-VolumesActionsTest-1975068690-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73572) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 10:42:19 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-c9b9b0d8-244c-4529-9034-736229ec8a4f tempest-VolumesActionsTest-1975068690 tempest-VolumesActionsTest-1975068690-project-member] CPU controller found on host. {{(pid=73572) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 10:42:19 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-c9b9b0d8-244c-4529-9034-736229ec8a4f tempest-VolumesActionsTest-1975068690 tempest-VolumesActionsTest-1975068690-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73572) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 10:42:19 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-c9b9b0d8-244c-4529-9034-736229ec8a4f tempest-VolumesActionsTest-1975068690 tempest-VolumesActionsTest-1975068690-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T10:07:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T10:07:33Z,direct_url=<?>,disk_format='qcow2',id=299da0c9-e1c4-48f0-be55-fbe20dd06bc9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5c995f8bbbab4368b67a253e0df3971a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T10:07:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 10:42:19 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-c9b9b0d8-244c-4529-9034-736229ec8a4f tempest-VolumesActionsTest-1975068690 tempest-VolumesActionsTest-1975068690-project-member] Flavor limits 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 10:42:19 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-c9b9b0d8-244c-4529-9034-736229ec8a4f tempest-VolumesActionsTest-1975068690 tempest-VolumesActionsTest-1975068690-project-member] Image limits 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 10:42:19 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-c9b9b0d8-244c-4529-9034-736229ec8a4f tempest-VolumesActionsTest-1975068690 tempest-VolumesActionsTest-1975068690-project-member] Flavor pref 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 10:42:19 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-c9b9b0d8-244c-4529-9034-736229ec8a4f tempest-VolumesActionsTest-1975068690 tempest-VolumesActionsTest-1975068690-project-member] Image pref 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 10:42:19 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-c9b9b0d8-244c-4529-9034-736229ec8a4f tempest-VolumesActionsTest-1975068690 tempest-VolumesActionsTest-1975068690-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 10:42:19 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-c9b9b0d8-244c-4529-9034-736229ec8a4f tempest-VolumesActionsTest-1975068690 tempest-VolumesActionsTest-1975068690-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 10:42:19 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-c9b9b0d8-244c-4529-9034-736229ec8a4f tempest-VolumesActionsTest-1975068690 tempest-VolumesActionsTest-1975068690-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73572) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 10:42:19 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-c9b9b0d8-244c-4529-9034-736229ec8a4f tempest-VolumesActionsTest-1975068690 tempest-VolumesActionsTest-1975068690-project-member] Got 1 possible topologies {{(pid=73572) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 10:42:19 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-c9b9b0d8-244c-4529-9034-736229ec8a4f tempest-VolumesActionsTest-1975068690 tempest-VolumesActionsTest-1975068690-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 10:42:19 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-c9b9b0d8-244c-4529-9034-736229ec8a4f tempest-VolumesActionsTest-1975068690 tempest-VolumesActionsTest-1975068690-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 10:42:19 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-c9b9b0d8-244c-4529-9034-736229ec8a4f tempest-VolumesActionsTest-1975068690 tempest-VolumesActionsTest-1975068690-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T10:42:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1292918762',display_name='tempest-VolumesActionsTest-instance-1292918762',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1292918762',id=51,image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='25b4ed9a0f884465bc9ff940aa8d4dba',ramdisk_id='',reservation_id='r-7zsb0k0l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1975068690',owner_user_name='tempest-VolumesActionsTest-1975068690-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T10:42:17Z,user_data=None,user_id='faa88d2f21684e1a9f4c0ba4b786a795',uuid=28e0ccc5-be20-4246-afae-3c193eb14433,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "77e7fd47-0628-44d4-a900-ed772e10c665", "address": "fa:16:3e:5c:82:71", "network": {"id": "0ea23c7b-e740-40ee-80f2-add01d583c33", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1245070125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25b4ed9a0f884465bc9ff940aa8d4dba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77e7fd47-06", "ovs_interfaceid": "77e7fd47-0628-44d4-a900-ed772e10c665", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73572) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 10:42:19 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-c9b9b0d8-244c-4529-9034-736229ec8a4f tempest-VolumesActionsTest-1975068690 tempest-VolumesActionsTest-1975068690-project-member] Converting VIF {"id": "77e7fd47-0628-44d4-a900-ed772e10c665", "address": "fa:16:3e:5c:82:71", "network": {"id": "0ea23c7b-e740-40ee-80f2-add01d583c33", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1245070125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25b4ed9a0f884465bc9ff940aa8d4dba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77e7fd47-06", "ovs_interfaceid": "77e7fd47-0628-44d4-a900-ed772e10c665", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:42:19 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-c9b9b0d8-244c-4529-9034-736229ec8a4f tempest-VolumesActionsTest-1975068690 tempest-VolumesActionsTest-1975068690-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:82:71,bridge_name='br-int',has_traffic_filtering=True,id=77e7fd47-0628-44d4-a900-ed772e10c665,network=Network(0ea23c7b-e740-40ee-80f2-add01d583c33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77e7fd47-06') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:42:19 user nova-compute[73572]: DEBUG nova.objects.instance [None req-c9b9b0d8-244c-4529-9034-736229ec8a4f tempest-VolumesActionsTest-1975068690 tempest-VolumesActionsTest-1975068690-project-member] Lazy-loading 'pci_devices' on Instance uuid 28e0ccc5-be20-4246-afae-3c193eb14433 {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:42:19 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-c9b9b0d8-244c-4529-9034-736229ec8a4f tempest-VolumesActionsTest-1975068690 tempest-VolumesActionsTest-1975068690-project-member] [instance: 28e0ccc5-be20-4246-afae-3c193eb14433] End _get_guest_xml xml=<domain type="kvm">
Aug 26 10:42:19 user nova-compute[73572]:   <uuid>28e0ccc5-be20-4246-afae-3c193eb14433</uuid>
Aug 26 10:42:19 user nova-compute[73572]:   <name>instance-00000033</name>
Aug 26 10:42:19 user nova-compute[73572]:   <memory>524288</memory>
Aug 26 10:42:19 user nova-compute[73572]:   <vcpu>1</vcpu>
Aug 26 10:42:19 user nova-compute[73572]:   <metadata>
Aug 26 10:42:19 user nova-compute[73572]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 10:42:19 user nova-compute[73572]:       <nova:package version="0.0.0"/>
Aug 26 10:42:19 user nova-compute[73572]:       <nova:name>tempest-VolumesActionsTest-instance-1292918762</nova:name>
Aug 26 10:42:19 user nova-compute[73572]:       <nova:creationTime>2023-08-26 10:42:19</nova:creationTime>
Aug 26 10:42:19 user nova-compute[73572]:       <nova:flavor name="m1.tiny">
Aug 26 10:42:19 user nova-compute[73572]:         <nova:memory>512</nova:memory>
Aug 26 10:42:19 user nova-compute[73572]:         <nova:disk>1</nova:disk>
Aug 26 10:42:19 user nova-compute[73572]:         <nova:swap>0</nova:swap>
Aug 26 10:42:19 user nova-compute[73572]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 10:42:19 user nova-compute[73572]:         <nova:vcpus>1</nova:vcpus>
Aug 26 10:42:19 user nova-compute[73572]:       </nova:flavor>
Aug 26 10:42:19 user nova-compute[73572]:       <nova:owner>
Aug 26 10:42:19 user nova-compute[73572]:         <nova:user uuid="faa88d2f21684e1a9f4c0ba4b786a795">tempest-VolumesActionsTest-1975068690-project-member</nova:user>
Aug 26 10:42:19 user nova-compute[73572]:         <nova:project uuid="25b4ed9a0f884465bc9ff940aa8d4dba">tempest-VolumesActionsTest-1975068690</nova:project>
Aug 26 10:42:19 user nova-compute[73572]:       </nova:owner>
Aug 26 10:42:19 user nova-compute[73572]:       <nova:root type="image" uuid="299da0c9-e1c4-48f0-be55-fbe20dd06bc9"/>
Aug 26 10:42:19 user nova-compute[73572]:       <nova:ports>
Aug 26 10:42:19 user nova-compute[73572]:         <nova:port uuid="77e7fd47-0628-44d4-a900-ed772e10c665">
Aug 26 10:42:19 user nova-compute[73572]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 26 10:42:19 user nova-compute[73572]:         </nova:port>
Aug 26 10:42:19 user nova-compute[73572]:       </nova:ports>
Aug 26 10:42:19 user nova-compute[73572]:     </nova:instance>
Aug 26 10:42:19 user nova-compute[73572]:   </metadata>
Aug 26 10:42:19 user nova-compute[73572]:   <sysinfo type="smbios">
Aug 26 10:42:19 user nova-compute[73572]:     <system>
Aug 26 10:42:19 user nova-compute[73572]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 10:42:19 user nova-compute[73572]:       <entry name="product">OpenStack Nova</entry>
Aug 26 10:42:19 user nova-compute[73572]:       <entry name="version">0.0.0</entry>
Aug 26 10:42:19 user nova-compute[73572]:       <entry name="serial">28e0ccc5-be20-4246-afae-3c193eb14433</entry>
Aug 26 10:42:19 user nova-compute[73572]:       <entry name="uuid">28e0ccc5-be20-4246-afae-3c193eb14433</entry>
Aug 26 10:42:19 user nova-compute[73572]:       <entry name="family">Virtual Machine</entry>
Aug 26 10:42:19 user nova-compute[73572]:     </system>
Aug 26 10:42:19 user nova-compute[73572]:   </sysinfo>
Aug 26 10:42:19 user nova-compute[73572]:   <os>
Aug 26 10:42:19 user nova-compute[73572]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 10:42:19 user nova-compute[73572]:     <boot dev="hd"/>
Aug 26 10:42:19 user nova-compute[73572]:     <smbios mode="sysinfo"/>
Aug 26 10:42:19 user nova-compute[73572]:   </os>
Aug 26 10:42:19 user nova-compute[73572]:   <features>
Aug 26 10:42:19 user nova-compute[73572]:     <acpi/>
Aug 26 10:42:19 user nova-compute[73572]:     <apic/>
Aug 26 10:42:19 user nova-compute[73572]:     <vmcoreinfo/>
Aug 26 10:42:19 user nova-compute[73572]:   </features>
Aug 26 10:42:19 user nova-compute[73572]:   <clock offset="utc">
Aug 26 10:42:19 user nova-compute[73572]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 10:42:19 user nova-compute[73572]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 10:42:19 user nova-compute[73572]:     <timer name="hpet" present="no"/>
Aug 26 10:42:19 user nova-compute[73572]:   </clock>
Aug 26 10:42:19 user nova-compute[73572]:   <cpu mode="custom" match="exact">
Aug 26 10:42:19 user nova-compute[73572]:     <model>Nehalem</model>
Aug 26 10:42:19 user nova-compute[73572]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 10:42:19 user nova-compute[73572]:   </cpu>
Aug 26 10:42:19 user nova-compute[73572]:   <devices>
Aug 26 10:42:19 user nova-compute[73572]:     <disk type="file" device="disk">
Aug 26 10:42:19 user nova-compute[73572]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 10:42:19 user nova-compute[73572]:       <source file="/opt/stack/data/nova/instances/28e0ccc5-be20-4246-afae-3c193eb14433/disk"/>
Aug 26 10:42:19 user nova-compute[73572]:       <target dev="vda" bus="virtio"/>
Aug 26 10:42:19 user nova-compute[73572]:     </disk>
Aug 26 10:42:19 user nova-compute[73572]:     <interface type="ethernet">
Aug 26 10:42:19 user nova-compute[73572]:       <mac address="fa:16:3e:5c:82:71"/>
Aug 26 10:42:19 user nova-compute[73572]:       <model type="virtio"/>
Aug 26 10:42:19 user nova-compute[73572]:       <mtu size="1442"/>
Aug 26 10:42:19 user nova-compute[73572]:       <target dev="tap77e7fd47-06"/>
Aug 26 10:42:19 user nova-compute[73572]:     </interface>
Aug 26 10:42:19 user nova-compute[73572]:     <serial type="pty">
Aug 26 10:42:19 user nova-compute[73572]:       <log file="/opt/stack/data/nova/instances/28e0ccc5-be20-4246-afae-3c193eb14433/console.log" append="off"/>
Aug 26 10:42:19 user nova-compute[73572]:     </serial>
Aug 26 10:42:19 user nova-compute[73572]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 10:42:19 user nova-compute[73572]:     <video>
Aug 26 10:42:19 user nova-compute[73572]:       <model type="virtio"/>
Aug 26 10:42:19 user nova-compute[73572]:     </video>
Aug 26 10:42:19 user nova-compute[73572]:     <rng model="virtio">
Aug 26 10:42:19 user nova-compute[73572]:       <backend model="random">/dev/urandom</backend>
Aug 26 10:42:19 user nova-compute[73572]:     </rng>
Aug 26 10:42:19 user nova-compute[73572]:     <controller type="usb" index="0" model="none"/>
Aug 26 10:42:19 user nova-compute[73572]:     <memballoon model="virtio">
Aug 26 10:42:19 user nova-compute[73572]:       <stats period="10"/>
Aug 26 10:42:19 user nova-compute[73572]:     </memballoon>
Aug 26 10:42:19 user nova-compute[73572]:   </devices>
Aug 26 10:42:19 user nova-compute[73572]: </domain>
Aug 26 10:42:19 user nova-compute[73572]:  {{(pid=73572) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 10:42:19 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-c9b9b0d8-244c-4529-9034-736229ec8a4f tempest-VolumesActionsTest-1975068690 tempest-VolumesActionsTest-1975068690-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T10:42:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1292918762',display_name='tempest-VolumesActionsTest-instance-1292918762',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1292918762',id=51,image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='25b4ed9a0f884465bc9ff940aa8d4dba',ramdisk_id='',reservation_id='r-7zsb0k0l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1975068690',owner_user_name='tempest-VolumesActionsTest-1975068690-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T10:42:17Z,user_data=None,user_id='faa88d2f21684e1a9f4c0ba4b786a795',uuid=28e0ccc5-be20-4246-afae-3c193eb14433,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "77e7fd47-0628-44d4-a900-ed772e10c665", "address": "fa:16:3e:5c:82:71", "network": {"id": "0ea23c7b-e740-40ee-80f2-add01d583c33", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1245070125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25b4ed9a0f884465bc9ff940aa8d4dba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77e7fd47-06", "ovs_interfaceid": "77e7fd47-0628-44d4-a900-ed772e10c665", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 10:42:19 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-c9b9b0d8-244c-4529-9034-736229ec8a4f tempest-VolumesActionsTest-1975068690 tempest-VolumesActionsTest-1975068690-project-member] Converting VIF {"id": "77e7fd47-0628-44d4-a900-ed772e10c665", "address": "fa:16:3e:5c:82:71", "network": {"id": "0ea23c7b-e740-40ee-80f2-add01d583c33", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1245070125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25b4ed9a0f884465bc9ff940aa8d4dba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77e7fd47-06", "ovs_interfaceid": "77e7fd47-0628-44d4-a900-ed772e10c665", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:42:19 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-c9b9b0d8-244c-4529-9034-736229ec8a4f tempest-VolumesActionsTest-1975068690 tempest-VolumesActionsTest-1975068690-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:82:71,bridge_name='br-int',has_traffic_filtering=True,id=77e7fd47-0628-44d4-a900-ed772e10c665,network=Network(0ea23c7b-e740-40ee-80f2-add01d583c33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77e7fd47-06') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:42:19 user nova-compute[73572]: DEBUG os_vif [None req-c9b9b0d8-244c-4529-9034-736229ec8a4f tempest-VolumesActionsTest-1975068690 tempest-VolumesActionsTest-1975068690-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:82:71,bridge_name='br-int',has_traffic_filtering=True,id=77e7fd47-0628-44d4-a900-ed772e10c665,network=Network(0ea23c7b-e740-40ee-80f2-add01d583c33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77e7fd47-06') {{(pid=73572) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 10:42:19 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:42:19 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:42:19 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 10:42:19 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:42:19 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap77e7fd47-06, may_exist=True, interface_attrs={}) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:42:19 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap77e7fd47-06, col_values=(('external_ids', {'iface-id': '77e7fd47-0628-44d4-a900-ed772e10c665', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5c:82:71', 'vm-uuid': '28e0ccc5-be20-4246-afae-3c193eb14433'}),), if_exists=True) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:42:19 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:42:19 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:42:19 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:42:19 user nova-compute[73572]: INFO os_vif [None req-c9b9b0d8-244c-4529-9034-736229ec8a4f tempest-VolumesActionsTest-1975068690 tempest-VolumesActionsTest-1975068690-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:82:71,bridge_name='br-int',has_traffic_filtering=True,id=77e7fd47-0628-44d4-a900-ed772e10c665,network=Network(0ea23c7b-e740-40ee-80f2-add01d583c33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77e7fd47-06')
Aug 26 10:42:19 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-c9b9b0d8-244c-4529-9034-736229ec8a4f tempest-VolumesActionsTest-1975068690 tempest-VolumesActionsTest-1975068690-project-member] No BDM found with device name vda, not building metadata. {{(pid=73572) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 10:42:19 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-c9b9b0d8-244c-4529-9034-736229ec8a4f tempest-VolumesActionsTest-1975068690 tempest-VolumesActionsTest-1975068690-project-member] No VIF found with MAC fa:16:3e:5c:82:71, not building metadata {{(pid=73572) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 10:42:19 user nova-compute[73572]: DEBUG nova.network.neutron [req-9c2ca396-d7d5-40f7-b460-5a74ecc219f8 req-880df5c3-26d7-4ab6-9d69-57f4beaf515b service nova] [instance: 28e0ccc5-be20-4246-afae-3c193eb14433] Updated VIF entry in instance network info cache for port 77e7fd47-0628-44d4-a900-ed772e10c665. {{(pid=73572) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 10:42:19 user nova-compute[73572]: DEBUG nova.network.neutron [req-9c2ca396-d7d5-40f7-b460-5a74ecc219f8 req-880df5c3-26d7-4ab6-9d69-57f4beaf515b service nova] [instance: 28e0ccc5-be20-4246-afae-3c193eb14433] Updating instance_info_cache with network_info: [{"id": "77e7fd47-0628-44d4-a900-ed772e10c665", "address": "fa:16:3e:5c:82:71", "network": {"id": "0ea23c7b-e740-40ee-80f2-add01d583c33", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1245070125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25b4ed9a0f884465bc9ff940aa8d4dba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77e7fd47-06", "ovs_interfaceid": "77e7fd47-0628-44d4-a900-ed772e10c665", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:42:19 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-9c2ca396-d7d5-40f7-b460-5a74ecc219f8 req-880df5c3-26d7-4ab6-9d69-57f4beaf515b service nova] Releasing lock "refresh_cache-28e0ccc5-be20-4246-afae-3c193eb14433" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:42:20 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:42:20 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:42:20 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:42:20 user nova-compute[73572]: DEBUG nova.compute.manager [req-d1354d5e-0094-4c6e-9847-c9494da64fea req-98d97d6a-d7d7-47bc-ab83-c543d291c90f service nova] [instance: 28e0ccc5-be20-4246-afae-3c193eb14433] Received event network-vif-plugged-77e7fd47-0628-44d4-a900-ed772e10c665 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:42:20 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-d1354d5e-0094-4c6e-9847-c9494da64fea req-98d97d6a-d7d7-47bc-ab83-c543d291c90f service nova] Acquiring lock "28e0ccc5-be20-4246-afae-3c193eb14433-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:42:20 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-d1354d5e-0094-4c6e-9847-c9494da64fea req-98d97d6a-d7d7-47bc-ab83-c543d291c90f service nova] Lock "28e0ccc5-be20-4246-afae-3c193eb14433-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:42:20 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-d1354d5e-0094-4c6e-9847-c9494da64fea req-98d97d6a-d7d7-47bc-ab83-c543d291c90f service nova] Lock "28e0ccc5-be20-4246-afae-3c193eb14433-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:42:20 user nova-compute[73572]: DEBUG nova.compute.manager [req-d1354d5e-0094-4c6e-9847-c9494da64fea req-98d97d6a-d7d7-47bc-ab83-c543d291c90f service nova] [instance: 28e0ccc5-be20-4246-afae-3c193eb14433] No waiting events found dispatching network-vif-plugged-77e7fd47-0628-44d4-a900-ed772e10c665 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:42:20 user nova-compute[73572]: WARNING nova.compute.manager [req-d1354d5e-0094-4c6e-9847-c9494da64fea req-98d97d6a-d7d7-47bc-ab83-c543d291c90f service nova] [instance: 28e0ccc5-be20-4246-afae-3c193eb14433] Received unexpected event network-vif-plugged-77e7fd47-0628-44d4-a900-ed772e10c665 for instance with vm_state building and task_state spawning.
Aug 26 10:42:21 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:42:21 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:42:21 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:42:22 user nova-compute[73572]: DEBUG nova.virt.driver [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Emitting event <LifecycleEvent: 1693046542.7150393, 28e0ccc5-be20-4246-afae-3c193eb14433 => Resumed> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:42:22 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 28e0ccc5-be20-4246-afae-3c193eb14433] VM Resumed (Lifecycle Event)
Aug 26 10:42:22 user nova-compute[73572]: DEBUG nova.compute.manager [None req-c9b9b0d8-244c-4529-9034-736229ec8a4f tempest-VolumesActionsTest-1975068690 tempest-VolumesActionsTest-1975068690-project-member] [instance: 28e0ccc5-be20-4246-afae-3c193eb14433] Instance event wait completed in 0 seconds for  {{(pid=73572) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 10:42:22 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-c9b9b0d8-244c-4529-9034-736229ec8a4f tempest-VolumesActionsTest-1975068690 tempest-VolumesActionsTest-1975068690-project-member] [instance: 28e0ccc5-be20-4246-afae-3c193eb14433] Guest created on hypervisor {{(pid=73572) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 10:42:22 user nova-compute[73572]: INFO nova.virt.libvirt.driver [-] [instance: 28e0ccc5-be20-4246-afae-3c193eb14433] Instance spawned successfully.
Aug 26 10:42:22 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-c9b9b0d8-244c-4529-9034-736229ec8a4f tempest-VolumesActionsTest-1975068690 tempest-VolumesActionsTest-1975068690-project-member] [instance: 28e0ccc5-be20-4246-afae-3c193eb14433] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 10:42:22 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 28e0ccc5-be20-4246-afae-3c193eb14433] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:42:22 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 28e0ccc5-be20-4246-afae-3c193eb14433] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73572) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 10:42:22 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-c9b9b0d8-244c-4529-9034-736229ec8a4f tempest-VolumesActionsTest-1975068690 tempest-VolumesActionsTest-1975068690-project-member] [instance: 28e0ccc5-be20-4246-afae-3c193eb14433] Found default for hw_cdrom_bus of ide {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:42:22 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-c9b9b0d8-244c-4529-9034-736229ec8a4f tempest-VolumesActionsTest-1975068690 tempest-VolumesActionsTest-1975068690-project-member] [instance: 28e0ccc5-be20-4246-afae-3c193eb14433] Found default for hw_disk_bus of virtio {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:42:22 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-c9b9b0d8-244c-4529-9034-736229ec8a4f tempest-VolumesActionsTest-1975068690 tempest-VolumesActionsTest-1975068690-project-member] [instance: 28e0ccc5-be20-4246-afae-3c193eb14433] Found default for hw_input_bus of None {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:42:22 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-c9b9b0d8-244c-4529-9034-736229ec8a4f tempest-VolumesActionsTest-1975068690 tempest-VolumesActionsTest-1975068690-project-member] [instance: 28e0ccc5-be20-4246-afae-3c193eb14433] Found default for hw_pointer_model of None {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:42:22 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-c9b9b0d8-244c-4529-9034-736229ec8a4f tempest-VolumesActionsTest-1975068690 tempest-VolumesActionsTest-1975068690-project-member] [instance: 28e0ccc5-be20-4246-afae-3c193eb14433] Found default for hw_video_model of virtio {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:42:22 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-c9b9b0d8-244c-4529-9034-736229ec8a4f tempest-VolumesActionsTest-1975068690 tempest-VolumesActionsTest-1975068690-project-member] [instance: 28e0ccc5-be20-4246-afae-3c193eb14433] Found default for hw_vif_model of virtio {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:42:22 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 28e0ccc5-be20-4246-afae-3c193eb14433] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 10:42:22 user nova-compute[73572]: DEBUG nova.virt.driver [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Emitting event <LifecycleEvent: 1693046542.7162921, 28e0ccc5-be20-4246-afae-3c193eb14433 => Started> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:42:22 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 28e0ccc5-be20-4246-afae-3c193eb14433] VM Started (Lifecycle Event)
Aug 26 10:42:22 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 28e0ccc5-be20-4246-afae-3c193eb14433] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:42:22 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 28e0ccc5-be20-4246-afae-3c193eb14433] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73572) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 10:42:22 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 28e0ccc5-be20-4246-afae-3c193eb14433] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 10:42:22 user nova-compute[73572]: INFO nova.compute.manager [None req-c9b9b0d8-244c-4529-9034-736229ec8a4f tempest-VolumesActionsTest-1975068690 tempest-VolumesActionsTest-1975068690-project-member] [instance: 28e0ccc5-be20-4246-afae-3c193eb14433] Took 6.12 seconds to spawn the instance on the hypervisor.
Aug 26 10:42:22 user nova-compute[73572]: DEBUG nova.compute.manager [None req-c9b9b0d8-244c-4529-9034-736229ec8a4f tempest-VolumesActionsTest-1975068690 tempest-VolumesActionsTest-1975068690-project-member] [instance: 28e0ccc5-be20-4246-afae-3c193eb14433] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:42:22 user nova-compute[73572]: INFO nova.compute.manager [None req-c9b9b0d8-244c-4529-9034-736229ec8a4f tempest-VolumesActionsTest-1975068690 tempest-VolumesActionsTest-1975068690-project-member] [instance: 28e0ccc5-be20-4246-afae-3c193eb14433] Took 6.71 seconds to build instance.
Aug 26 10:42:22 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-c9b9b0d8-244c-4529-9034-736229ec8a4f tempest-VolumesActionsTest-1975068690 tempest-VolumesActionsTest-1975068690-project-member] Lock "28e0ccc5-be20-4246-afae-3c193eb14433" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.804s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:42:22 user nova-compute[73572]: DEBUG nova.compute.manager [req-db80103c-5385-4a10-aa7f-684a6a590b8c req-7c52017c-48d6-4646-a0a3-306940881b35 service nova] [instance: 28e0ccc5-be20-4246-afae-3c193eb14433] Received event network-vif-plugged-77e7fd47-0628-44d4-a900-ed772e10c665 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:42:22 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-db80103c-5385-4a10-aa7f-684a6a590b8c req-7c52017c-48d6-4646-a0a3-306940881b35 service nova] Acquiring lock "28e0ccc5-be20-4246-afae-3c193eb14433-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:42:22 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-db80103c-5385-4a10-aa7f-684a6a590b8c req-7c52017c-48d6-4646-a0a3-306940881b35 service nova] Lock "28e0ccc5-be20-4246-afae-3c193eb14433-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:42:22 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-db80103c-5385-4a10-aa7f-684a6a590b8c req-7c52017c-48d6-4646-a0a3-306940881b35 service nova] Lock "28e0ccc5-be20-4246-afae-3c193eb14433-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:42:22 user nova-compute[73572]: DEBUG nova.compute.manager [req-db80103c-5385-4a10-aa7f-684a6a590b8c req-7c52017c-48d6-4646-a0a3-306940881b35 service nova] [instance: 28e0ccc5-be20-4246-afae-3c193eb14433] No waiting events found dispatching network-vif-plugged-77e7fd47-0628-44d4-a900-ed772e10c665 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:42:22 user nova-compute[73572]: WARNING nova.compute.manager [req-db80103c-5385-4a10-aa7f-684a6a590b8c req-7c52017c-48d6-4646-a0a3-306940881b35 service nova] [instance: 28e0ccc5-be20-4246-afae-3c193eb14433] Received unexpected event network-vif-plugged-77e7fd47-0628-44d4-a900-ed772e10c665 for instance with vm_state active and task_state None.
Aug 26 10:42:24 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:42:25 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:42:29 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:42:32 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:42:32 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:42:33 user nova-compute[73572]: DEBUG nova.compute.manager [req-91b99649-4600-4af5-981a-d6f42392cf69 req-7faa9d16-3865-4c8f-bc6b-26e7acb291d3 service nova] [instance: 5d100a08-eaf2-4132-87dd-a8dcfe17f68f] Received event network-changed-efe52e67-0439-4035-988e-daae3acfc823 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:42:33 user nova-compute[73572]: DEBUG nova.compute.manager [req-91b99649-4600-4af5-981a-d6f42392cf69 req-7faa9d16-3865-4c8f-bc6b-26e7acb291d3 service nova] [instance: 5d100a08-eaf2-4132-87dd-a8dcfe17f68f] Refreshing instance network info cache due to event network-changed-efe52e67-0439-4035-988e-daae3acfc823. {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 10:42:33 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-91b99649-4600-4af5-981a-d6f42392cf69 req-7faa9d16-3865-4c8f-bc6b-26e7acb291d3 service nova] Acquiring lock "refresh_cache-5d100a08-eaf2-4132-87dd-a8dcfe17f68f" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:42:33 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-91b99649-4600-4af5-981a-d6f42392cf69 req-7faa9d16-3865-4c8f-bc6b-26e7acb291d3 service nova] Acquired lock "refresh_cache-5d100a08-eaf2-4132-87dd-a8dcfe17f68f" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:42:33 user nova-compute[73572]: DEBUG nova.network.neutron [req-91b99649-4600-4af5-981a-d6f42392cf69 req-7faa9d16-3865-4c8f-bc6b-26e7acb291d3 service nova] [instance: 5d100a08-eaf2-4132-87dd-a8dcfe17f68f] Refreshing network info cache for port efe52e67-0439-4035-988e-daae3acfc823 {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 10:42:33 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:42:33 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Starting heal instance info cache {{(pid=73572) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 10:42:33 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Rebuilding the list of instances to heal {{(pid=73572) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 10:42:33 user nova-compute[73572]: DEBUG nova.network.neutron [req-91b99649-4600-4af5-981a-d6f42392cf69 req-7faa9d16-3865-4c8f-bc6b-26e7acb291d3 service nova] [instance: 5d100a08-eaf2-4132-87dd-a8dcfe17f68f] Updated VIF entry in instance network info cache for port efe52e67-0439-4035-988e-daae3acfc823. {{(pid=73572) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 10:42:33 user nova-compute[73572]: DEBUG nova.network.neutron [req-91b99649-4600-4af5-981a-d6f42392cf69 req-7faa9d16-3865-4c8f-bc6b-26e7acb291d3 service nova] [instance: 5d100a08-eaf2-4132-87dd-a8dcfe17f68f] Updating instance_info_cache with network_info: [{"id": "efe52e67-0439-4035-988e-daae3acfc823", "address": "fa:16:3e:68:58:83", "network": {"id": "598e1cfa-caaf-470c-ac5a-e91aa2611d1f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1541764581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08b110acd72c427db0de4e98d05f5e56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefe52e67-04", "ovs_interfaceid": "efe52e67-0439-4035-988e-daae3acfc823", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:42:33 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-91b99649-4600-4af5-981a-d6f42392cf69 req-7faa9d16-3865-4c8f-bc6b-26e7acb291d3 service nova] Releasing lock "refresh_cache-5d100a08-eaf2-4132-87dd-a8dcfe17f68f" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:42:33 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquiring lock "refresh_cache-5d100a08-eaf2-4132-87dd-a8dcfe17f68f" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:42:33 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquired lock "refresh_cache-5d100a08-eaf2-4132-87dd-a8dcfe17f68f" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:42:33 user nova-compute[73572]: DEBUG nova.network.neutron [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] [instance: 5d100a08-eaf2-4132-87dd-a8dcfe17f68f] Forcefully refreshing network info cache for instance {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 10:42:33 user nova-compute[73572]: DEBUG nova.objects.instance [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lazy-loading 'info_cache' on Instance uuid 5d100a08-eaf2-4132-87dd-a8dcfe17f68f {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:42:34 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:42:34 user nova-compute[73572]: DEBUG nova.network.neutron [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] [instance: 5d100a08-eaf2-4132-87dd-a8dcfe17f68f] Updating instance_info_cache with network_info: [{"id": "efe52e67-0439-4035-988e-daae3acfc823", "address": "fa:16:3e:68:58:83", "network": {"id": "598e1cfa-caaf-470c-ac5a-e91aa2611d1f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1541764581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08b110acd72c427db0de4e98d05f5e56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefe52e67-04", "ovs_interfaceid": "efe52e67-0439-4035-988e-daae3acfc823", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:42:34 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Releasing lock "refresh_cache-5d100a08-eaf2-4132-87dd-a8dcfe17f68f" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:42:34 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] [instance: 5d100a08-eaf2-4132-87dd-a8dcfe17f68f] Updated the network info_cache for instance {{(pid=73572) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 10:42:35 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:42:37 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:42:39 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-f9c76ce3-17e7-4d2e-a7dc-ad8d5f185df9 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Acquiring lock "5d100a08-eaf2-4132-87dd-a8dcfe17f68f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:42:39 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-f9c76ce3-17e7-4d2e-a7dc-ad8d5f185df9 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Lock "5d100a08-eaf2-4132-87dd-a8dcfe17f68f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:42:39 user nova-compute[73572]: DEBUG nova.objects.instance [None req-f9c76ce3-17e7-4d2e-a7dc-ad8d5f185df9 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Lazy-loading 'flavor' on Instance uuid 5d100a08-eaf2-4132-87dd-a8dcfe17f68f {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:42:39 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-f9c76ce3-17e7-4d2e-a7dc-ad8d5f185df9 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Lock "5d100a08-eaf2-4132-87dd-a8dcfe17f68f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:42:39 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:42:39 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-f9c76ce3-17e7-4d2e-a7dc-ad8d5f185df9 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Acquiring lock "5d100a08-eaf2-4132-87dd-a8dcfe17f68f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:42:39 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-f9c76ce3-17e7-4d2e-a7dc-ad8d5f185df9 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Lock "5d100a08-eaf2-4132-87dd-a8dcfe17f68f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:42:39 user nova-compute[73572]: INFO nova.compute.manager [None req-f9c76ce3-17e7-4d2e-a7dc-ad8d5f185df9 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] [instance: 5d100a08-eaf2-4132-87dd-a8dcfe17f68f] Attaching volume 27298d3a-d656-400b-ac77-0645cff59ba8 to /dev/vdb
Aug 26 10:42:39 user nova-compute[73572]: DEBUG os_brick.utils [None req-f9c76ce3-17e7-4d2e-a7dc-ad8d5f185df9 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 10:42:39 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:42:39 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:42:39 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[29c25273-3c0d-4044-9c79-7015d3fcf56e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:de8a79ed912\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:42:39 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:42:39 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:42:39 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a05e740-4f43-49fd-b692-29ba7ed21d84]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:42:39 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:42:39 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:42:39 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f6901c5-fdd0-4d50-b6fb-9dce456a09fb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:42:39 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[021365ee-71b2-46ca-ace7-f91726fe000a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:42:39 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-f9c76ce3-17e7-4d2e-a7dc-ad8d5f185df9 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Running cmd (subprocess): nvme version {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:42:39 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-f9c76ce3-17e7-4d2e-a7dc-ad8d5f185df9 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] 'nvme version' failed. Not Retrying. {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 10:42:39 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f9c76ce3-17e7-4d2e-a7dc-ad8d5f185df9 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] nvme not present on system {{(pid=73572) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 10:42:39 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:42:39 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 10:42:39 user nova-compute[73572]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 10:42:39 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[c313a8a8-b822-4f75-a556-68d3d3480679]: (4, '') {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:42:39 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.lightos [None req-f9c76ce3-17e7-4d2e-a7dc-ad8d5f185df9 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73572) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 10:42:39 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.lightos [None req-f9c76ce3-17e7-4d2e-a7dc-ad8d5f185df9 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73572) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 10:42:39 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.lightos [None req-f9c76ce3-17e7-4d2e-a7dc-ad8d5f185df9 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] LIGHTOS: no hostnqn found. {{(pid=73572) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 10:42:39 user nova-compute[73572]: DEBUG os_brick.utils [None req-f9c76ce3-17e7-4d2e-a7dc-ad8d5f185df9 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:de8a79ed912', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 10:42:39 user nova-compute[73572]: DEBUG nova.virt.block_device [None req-f9c76ce3-17e7-4d2e-a7dc-ad8d5f185df9 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] [instance: 5d100a08-eaf2-4132-87dd-a8dcfe17f68f] Updating existing volume attachment record: 0ccbb117-d39f-4156-b63a-18047612f563 {{(pid=73572) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 10:42:40 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:42:40 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:42:40 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73572) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 10:42:42 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:42:42 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:42:42 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:42:42 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:42:42 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Auditing locally available compute resources for user (node: user) {{(pid=73572) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 10:42:42 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d100a08-eaf2-4132-87dd-a8dcfe17f68f/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:42:43 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d100a08-eaf2-4132-87dd-a8dcfe17f68f/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:42:43 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d100a08-eaf2-4132-87dd-a8dcfe17f68f/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:42:43 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d100a08-eaf2-4132-87dd-a8dcfe17f68f/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:42:43 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28e0ccc5-be20-4246-afae-3c193eb14433/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:42:43 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28e0ccc5-be20-4246-afae-3c193eb14433/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:42:43 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28e0ccc5-be20-4246-afae-3c193eb14433/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:42:43 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28e0ccc5-be20-4246-afae-3c193eb14433/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:42:44 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:42:44 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:42:44 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Hypervisor/Node resource view: name=user free_ram=8433MB free_disk=25.128646850585938GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=73572) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 10:42:44 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:42:44 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:42:44 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:42:44 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance 5d100a08-eaf2-4132-87dd-a8dcfe17f68f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:42:44 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance 28e0ccc5-be20-4246-afae-3c193eb14433 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:42:44 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=73572) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 10:42:44 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=73572) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 10:42:44 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Refreshing inventories for resource provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 {{(pid=73572) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 26 10:42:44 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Updating ProviderTree inventory for provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73572) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 26 10:42:44 user nova-compute[73572]: DEBUG nova.compute.provider_tree [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Updating inventory in ProviderTree for provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73572) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 26 10:42:44 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Refreshing aggregate associations for resource provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75, aggregates: None {{(pid=73572) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 26 10:42:44 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Refreshing trait associations for resource provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75, traits: COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSSE3,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE2,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NODE,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_NE2K_PCI {{(pid=73572) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 26 10:42:44 user nova-compute[73572]: DEBUG nova.compute.provider_tree [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Inventory has not changed in ProviderTree for provider: e2cec974-59b2-4c77-a53d-a7f4e5a30d75 {{(pid=73572) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 10:42:44 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Inventory has not changed for provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73572) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 10:42:44 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Compute_service record updated for user:user {{(pid=73572) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 10:42:44 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.504s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:42:45 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:42:46 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:42:46 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:42:46 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:42:49 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:42:49 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f9c76ce3-17e7-4d2e-a7dc-ad8d5f185df9 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] [instance: 5d100a08-eaf2-4132-87dd-a8dcfe17f68f] Calling os-brick to attach iSCSI Volume {{(pid=73572) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 10:42:49 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9c76ce3-17e7-4d2e-a7dc-ad8d5f185df9 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc89c3d6a10>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:27298d3a-d656-400b-ac77-0645cff59ba8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'adRgOeSC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 10:42:49 user nova-compute[73572]: WARNING os_brick.initiator.connectors.base [None req-f9c76ce3-17e7-4d2e-a7dc-ad8d5f185df9 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 10:42:49 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-f9c76ce3-17e7-4d2e-a7dc-ad8d5f185df9 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 10:42:49 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-f9c76ce3-17e7-4d2e-a7dc-ad8d5f185df9 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 10:42:49 user nova-compute[73572]: WARNING os_brick.initiator.connectors.base [None req-f9c76ce3-17e7-4d2e-a7dc-ad8d5f185df9 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 10:42:49 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-f9c76ce3-17e7-4d2e-a7dc-ad8d5f185df9 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:27298d3a-d656-400b-ac77-0645cff59ba8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 10:42:49 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-f9c76ce3-17e7-4d2e-a7dc-ad8d5f185df9 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:27298d3a-d656-400b-ac77-0645cff59ba8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 10:42:49 user nova-compute[73572]: INFO os_brick.initiator.connectors.iscsi [None req-f9c76ce3-17e7-4d2e-a7dc-ad8d5f185df9 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 10:42:49 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27298d3a-d656-400b-ac77-0645cff59ba8 -p 172.16.0.220:3260 {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:42:49 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27298d3a-d656-400b-ac77-0645cff59ba8 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:42:49 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b674dbf-1d66-40f1-ae8e-2fc48d24180f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:42:49 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9c76ce3-17e7-4d2e-a7dc-ad8d5f185df9 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 10:42:49 user nova-compute[73572]:  {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:42:49 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27298d3a-d656-400b-ac77-0645cff59ba8 -p 172.16.0.220:3260 --interface default --op new {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:42:49 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27298d3a-d656-400b-ac77-0645cff59ba8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:42:49 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0825fb6-2341-4bba-8109-1f50359e5b9b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:27298d3a-d656-400b-ac77-0645cff59ba8] added\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:42:49 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9c76ce3-17e7-4d2e-a7dc-ad8d5f185df9 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:27298d3a-d656-400b-ac77-0645cff59ba8] added
Aug 26 10:42:49 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:42:49 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27298d3a-d656-400b-ac77-0645cff59ba8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:42:49 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27298d3a-d656-400b-ac77-0645cff59ba8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:42:49 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[205b31f7-edab-44d1-b64f-97b620876422]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:42:49 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9c76ce3-17e7-4d2e-a7dc-ad8d5f185df9 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:42:49 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27298d3a-d656-400b-ac77-0645cff59ba8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:42:49 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27298d3a-d656-400b-ac77-0645cff59ba8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:42:49 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[c63c9b8b-0e5b-47c9-8441-e2728f181264]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:42:49 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9c76ce3-17e7-4d2e-a7dc-ad8d5f185df9 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:42:49 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27298d3a-d656-400b-ac77-0645cff59ba8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v adRgOeSC {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:42:49 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27298d3a-d656-400b-ac77-0645cff59ba8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v adRgOeSC" returned: 0 in 0.019s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:42:49 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[03dbf678-8040-466e-be8c-968677c79d66]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:42:49 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9c76ce3-17e7-4d2e-a7dc-ad8d5f185df9 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'adRgOeSC'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:42:49 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27298d3a-d656-400b-ac77-0645cff59ba8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:42:49 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27298d3a-d656-400b-ac77-0645cff59ba8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:42:49 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a6f8d0a-8a92-4fc3-ad90-aebf0a4edbf7]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:42:49 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9c76ce3-17e7-4d2e-a7dc-ad8d5f185df9 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:42:49 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:42:49 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:42:49 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f3146bf-bc96-48c0-bfee-4518dc4440d6]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:42:49 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9c76ce3-17e7-4d2e-a7dc-ad8d5f185df9 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 26 10:42:49 user nova-compute[73572]:  {{(pid=73572) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 10:42:49 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9c76ce3-17e7-4d2e-a7dc-ad8d5f185df9 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 26 10:42:49 user nova-compute[73572]:  {{(pid=73572) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 10:42:49 user nova-compute[73572]: WARNING os_brick.initiator.connectors.iscsi [None req-f9c76ce3-17e7-4d2e-a7dc-ad8d5f185df9 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 26 10:42:49 user nova-compute[73572]: 
Aug 26 10:42:49 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27298d3a-d656-400b-ac77-0645cff59ba8 -p 172.16.0.220:3260 --login {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:42:50 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27298d3a-d656-400b-ac77-0645cff59ba8 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:42:50 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[67e13f24-dcc6-4daf-a19e-f62abb215efe]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:27298d3a-d656-400b-ac77-0645cff59ba8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:27298d3a-d656-400b-ac77-0645cff59ba8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:42:50 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9c76ce3-17e7-4d2e-a7dc-ad8d5f185df9 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:27298d3a-d656-400b-ac77-0645cff59ba8, portal: 172.16.0.220,3260]
Aug 26 10:42:50 user nova-compute[73572]: Login to [iface: default, target: iqn.2010-10.org.openstack:27298d3a-d656-400b-ac77-0645cff59ba8, portal: 172.16.0.220,3260] successful.
Aug 26 10:42:50 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:42:50 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27298d3a-d656-400b-ac77-0645cff59ba8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:42:50 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27298d3a-d656-400b-ac77-0645cff59ba8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:42:50 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7d4b0a1-bdc4-4f06-8ac1-95a26611bf62]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:42:50 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9c76ce3-17e7-4d2e-a7dc-ad8d5f185df9 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:42:50 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:42:50 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:42:50 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[831a2782-81f7-4d97-a4c6-3616bc28a4f0]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27298d3a-d656-400b-ac77-0645cff59ba8 (non-flash)\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:42:50 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9c76ce3-17e7-4d2e-a7dc-ad8d5f185df9 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27298d3a-d656-400b-ac77-0645cff59ba8 (non-flash)
Aug 26 10:42:50 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 10:42:50 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9c76ce3-17e7-4d2e-a7dc-ad8d5f185df9 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27298d3a-d656-400b-ac77-0645cff59ba8 (non-flash)
Aug 26 10:42:50 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 10:42:50 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-f9c76ce3-17e7-4d2e-a7dc-ad8d5f185df9 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:27298d3a-d656-400b-ac77-0645cff59ba8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.279s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 10:42:50 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9c76ce3-17e7-4d2e-a7dc-ad8d5f185df9 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Connected to 172.16.0.220:3260 {{(pid=73572) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 10:42:50 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-f9c76ce3-17e7-4d2e-a7dc-ad8d5f185df9 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] HCTL ('33', '-', '-', 0) found on session 58 with lun 0 {{(pid=73572) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 10:42:50 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-f9c76ce3-17e7-4d2e-a7dc-ad8d5f185df9 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73572) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 10:42:50 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:42:50 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:42:50 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[0abb07fe-7661-4c3d-8711-6b4756b1429c]: (4, ('- - 0', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:42:50 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-f9c76ce3-17e7-4d2e-a7dc-ad8d5f185df9 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Searching for a device in session 58 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73572) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 10:42:50 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9c76ce3-17e7-4d2e-a7dc-ad8d5f185df9 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'adRgOeSC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73572) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 10:42:50 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:42:51 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-f9c76ce3-17e7-4d2e-a7dc-ad8d5f185df9 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.312s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 10:42:51 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9c76ce3-17e7-4d2e-a7dc-ad8d5f185df9 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] <== connect_volume: return (1315ms) {'type': 'block', 'scsi_wwn': '26463623838636139', 'path': '/dev/sdb'} {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 10:42:51 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f9c76ce3-17e7-4d2e-a7dc-ad8d5f185df9 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] [instance: 5d100a08-eaf2-4132-87dd-a8dcfe17f68f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26463623838636139', 'path': '/dev/sdb'} {{(pid=73572) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 10:42:51 user nova-compute[73572]: DEBUG nova.objects.instance [None req-f9c76ce3-17e7-4d2e-a7dc-ad8d5f185df9 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Lazy-loading 'flavor' on Instance uuid 5d100a08-eaf2-4132-87dd-a8dcfe17f68f {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:42:51 user nova-compute[73572]: DEBUG nova.virt.libvirt.guest [None req-f9c76ce3-17e7-4d2e-a7dc-ad8d5f185df9 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 10:42:51 user nova-compute[73572]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 10:42:51 user nova-compute[73572]:   <source dev="/dev/sdb"/>
Aug 26 10:42:51 user nova-compute[73572]:   <target dev="vdb" bus="virtio"/>
Aug 26 10:42:51 user nova-compute[73572]:   <serial>27298d3a-d656-400b-ac77-0645cff59ba8</serial>
Aug 26 10:42:51 user nova-compute[73572]: </disk>
Aug 26 10:42:51 user nova-compute[73572]:  {{(pid=73572) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 10:42:51 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-f9c76ce3-17e7-4d2e-a7dc-ad8d5f185df9 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] No BDM found with device name vda, not building metadata. {{(pid=73572) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 10:42:51 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-f9c76ce3-17e7-4d2e-a7dc-ad8d5f185df9 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73572) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 10:42:51 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-f9c76ce3-17e7-4d2e-a7dc-ad8d5f185df9 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] No VIF found with MAC fa:16:3e:68:58:83, not building metadata {{(pid=73572) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 10:42:51 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-f9c76ce3-17e7-4d2e-a7dc-ad8d5f185df9 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Lock "5d100a08-eaf2-4132-87dd-a8dcfe17f68f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.449s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:42:53 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:42:53 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73572) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 26 10:42:54 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:42:55 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:42:59 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:43:01 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:43:01 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Cleaning up deleted instances {{(pid=73572) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 26 10:43:01 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] There are 0 instances to clean {{(pid=73572) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 26 10:43:01 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:43:04 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:43:05 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:43:05 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:43:09 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:43:14 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:43:15 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:43:19 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:43:24 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:43:29 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:43:32 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:43:33 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:43:33 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Starting heal instance info cache {{(pid=73572) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 10:43:33 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquiring lock "refresh_cache-28e0ccc5-be20-4246-afae-3c193eb14433" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:43:33 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquired lock "refresh_cache-28e0ccc5-be20-4246-afae-3c193eb14433" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:43:33 user nova-compute[73572]: DEBUG nova.network.neutron [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] [instance: 28e0ccc5-be20-4246-afae-3c193eb14433] Forcefully refreshing network info cache for instance {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 10:43:34 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:43:34 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-cb23bfb6-8ac5-4577-94df-477efeeb3757 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Acquiring lock "5d100a08-eaf2-4132-87dd-a8dcfe17f68f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:43:34 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-cb23bfb6-8ac5-4577-94df-477efeeb3757 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Lock "5d100a08-eaf2-4132-87dd-a8dcfe17f68f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:43:34 user nova-compute[73572]: INFO nova.compute.manager [None req-cb23bfb6-8ac5-4577-94df-477efeeb3757 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] [instance: 5d100a08-eaf2-4132-87dd-a8dcfe17f68f] Detaching volume 27298d3a-d656-400b-ac77-0645cff59ba8
Aug 26 10:43:34 user nova-compute[73572]: INFO nova.virt.block_device [None req-cb23bfb6-8ac5-4577-94df-477efeeb3757 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] [instance: 5d100a08-eaf2-4132-87dd-a8dcfe17f68f] Attempting to driver detach volume 27298d3a-d656-400b-ac77-0645cff59ba8 from mountpoint /dev/vdb
Aug 26 10:43:34 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-cb23bfb6-8ac5-4577-94df-477efeeb3757 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Attempting to detach device vdb from instance 5d100a08-eaf2-4132-87dd-a8dcfe17f68f from the persistent domain config. {{(pid=73572) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 10:43:34 user nova-compute[73572]: DEBUG nova.virt.libvirt.guest [None req-cb23bfb6-8ac5-4577-94df-477efeeb3757 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 10:43:34 user nova-compute[73572]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 10:43:34 user nova-compute[73572]:   <source dev="/dev/sdb"/>
Aug 26 10:43:34 user nova-compute[73572]:   <target dev="vdb" bus="virtio"/>
Aug 26 10:43:34 user nova-compute[73572]:   <serial>27298d3a-d656-400b-ac77-0645cff59ba8</serial>
Aug 26 10:43:34 user nova-compute[73572]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 10:43:34 user nova-compute[73572]: </disk>
Aug 26 10:43:34 user nova-compute[73572]:  {{(pid=73572) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 10:43:34 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-cb23bfb6-8ac5-4577-94df-477efeeb3757 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Successfully detached device vdb from instance 5d100a08-eaf2-4132-87dd-a8dcfe17f68f from the persistent domain config.
Aug 26 10:43:34 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-cb23bfb6-8ac5-4577-94df-477efeeb3757 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5d100a08-eaf2-4132-87dd-a8dcfe17f68f from the live domain config. {{(pid=73572) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 10:43:34 user nova-compute[73572]: DEBUG nova.virt.libvirt.guest [None req-cb23bfb6-8ac5-4577-94df-477efeeb3757 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 10:43:34 user nova-compute[73572]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 10:43:34 user nova-compute[73572]:   <source dev="/dev/sdb"/>
Aug 26 10:43:34 user nova-compute[73572]:   <target dev="vdb" bus="virtio"/>
Aug 26 10:43:34 user nova-compute[73572]:   <serial>27298d3a-d656-400b-ac77-0645cff59ba8</serial>
Aug 26 10:43:34 user nova-compute[73572]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 10:43:34 user nova-compute[73572]: </disk>
Aug 26 10:43:34 user nova-compute[73572]:  {{(pid=73572) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 10:43:34 user nova-compute[73572]: DEBUG nova.network.neutron [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] [instance: 28e0ccc5-be20-4246-afae-3c193eb14433] Updating instance_info_cache with network_info: [{"id": "77e7fd47-0628-44d4-a900-ed772e10c665", "address": "fa:16:3e:5c:82:71", "network": {"id": "0ea23c7b-e740-40ee-80f2-add01d583c33", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1245070125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25b4ed9a0f884465bc9ff940aa8d4dba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77e7fd47-06", "ovs_interfaceid": "77e7fd47-0628-44d4-a900-ed772e10c665", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:43:34 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Releasing lock "refresh_cache-28e0ccc5-be20-4246-afae-3c193eb14433" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:43:34 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] [instance: 28e0ccc5-be20-4246-afae-3c193eb14433] Updated the network info_cache for instance {{(pid=73572) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 10:43:34 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:43:34 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Received event <DeviceRemovedEvent: 1693046614.925523, 5d100a08-eaf2-4132-87dd-a8dcfe17f68f => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73572) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 10:43:34 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-cb23bfb6-8ac5-4577-94df-477efeeb3757 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5d100a08-eaf2-4132-87dd-a8dcfe17f68f {{(pid=73572) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 10:43:34 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-cb23bfb6-8ac5-4577-94df-477efeeb3757 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Successfully detached device vdb from instance 5d100a08-eaf2-4132-87dd-a8dcfe17f68f from the live domain config.
Aug 26 10:43:34 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cb23bfb6-8ac5-4577-94df-477efeeb3757 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] [instance: 5d100a08-eaf2-4132-87dd-a8dcfe17f68f] calling os-brick to detach iSCSI Volume {{(pid=73572) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 10:43:34 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb23bfb6-8ac5-4577-94df-477efeeb3757 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc89c3d6a10>, {'target_iqns': ['iqn.2010-10.org.openstack:27298d3a-d656-400b-ac77-0645cff59ba8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'adRgOeSC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 10:43:34 user nova-compute[73572]: WARNING os_brick.initiator.connectors.base [None req-cb23bfb6-8ac5-4577-94df-477efeeb3757 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 10:43:34 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-cb23bfb6-8ac5-4577-94df-477efeeb3757 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 10:43:34 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-cb23bfb6-8ac5-4577-94df-477efeeb3757 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 10:43:34 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb23bfb6-8ac5-4577-94df-477efeeb3757 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:27298d3a-d656-400b-ac77-0645cff59ba8', 0)] {{(pid=73572) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 10:43:34 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:43:34 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:43:34 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[e25e7ba8-5b1a-4539-9e42-04cf780807d8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:27298d3a-d656-400b-ac77-0645cff59ba8\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:43:34 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:43:34 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:43:34 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[46256986-130a-4a2b-b62f-eddc99adcdfb]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27298d3a-d656-400b-ac77-0645cff59ba8 (non-flash)\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:43:34 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb23bfb6-8ac5-4577-94df-477efeeb3757 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27298d3a-d656-400b-ac77-0645cff59ba8 (non-flash)
Aug 26 10:43:34 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 10:43:34 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb23bfb6-8ac5-4577-94df-477efeeb3757 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27298d3a-d656-400b-ac77-0645cff59ba8 (non-flash)
Aug 26 10:43:34 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 10:43:34 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb23bfb6-8ac5-4577-94df-477efeeb3757 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc878b05bd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:27298d3a-d656-400b-ac77-0645cff59ba8'): ({'sdb'}, set())}) {{(pid=73572) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 10:43:34 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-cb23bfb6-8ac5-4577-94df-477efeeb3757 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Removing single pathed devices sdb {{(pid=73572) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 10:43:34 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:43:35 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:43:35 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ab53170-9605-45f7-bada-6a0def292af1]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:43:35 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:43:35 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:43:35 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[14a42078-499d-412c-a1db-11c8dab2602c]: (4, ('ok\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:43:35 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-cb23bfb6-8ac5-4577-94df-477efeeb3757 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Flushing IO for device /dev/sdb {{(pid=73572) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 10:43:35 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:43:35 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:43:35 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c66284c-50d9-4182-b2e4-8c0f8b707e77]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:43:35 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-cb23bfb6-8ac5-4577-94df-477efeeb3757 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73572) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 10:43:35 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:43:35 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.035s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:43:35 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1baef8e-8549-426f-b16f-d8435fa53a25]: (4, ('1', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:43:35 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-cb23bfb6-8ac5-4577-94df-477efeeb3757 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73572) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 10:43:35 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-cb23bfb6-8ac5-4577-94df-477efeeb3757 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] SCSI volumes sdb have been removed. {{(pid=73572) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 10:43:35 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb23bfb6-8ac5-4577-94df-477efeeb3757 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:27298d3a-d656-400b-ac77-0645cff59ba8')] {{(pid=73572) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 10:43:35 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27298d3a-d656-400b-ac77-0645cff59ba8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:43:35 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27298d3a-d656-400b-ac77-0645cff59ba8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:43:35 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[0638ca2e-3ce1-4b4e-9f11-5c72f377faac]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:43:35 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb23bfb6-8ac5-4577-94df-477efeeb3757 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:43:35 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27298d3a-d656-400b-ac77-0645cff59ba8 -p 172.16.0.220:3260 --logout {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:43:35 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27298d3a-d656-400b-ac77-0645cff59ba8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.041s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:43:35 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dc10f98-851f-467c-9003-46b1df5a70e1]: (4, ('Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:27298d3a-d656-400b-ac77-0645cff59ba8, portal: 172.16.0.220,3260]\nLogout of [sid: 58, target: iqn.2010-10.org.openstack:27298d3a-d656-400b-ac77-0645cff59ba8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:43:35 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb23bfb6-8ac5-4577-94df-477efeeb3757 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:27298d3a-d656-400b-ac77-0645cff59ba8, portal: 172.16.0.220,3260]
Aug 26 10:43:35 user nova-compute[73572]: Logout of [sid: 58, target: iqn.2010-10.org.openstack:27298d3a-d656-400b-ac77-0645cff59ba8, portal: 172.16.0.220,3260] successful.
Aug 26 10:43:35 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:43:35 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27298d3a-d656-400b-ac77-0645cff59ba8 -p 172.16.0.220:3260 --op delete {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:43:35 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27298d3a-d656-400b-ac77-0645cff59ba8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:43:35 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[7388cb18-c7da-419c-b7df-a860e9185b25]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:43:35 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb23bfb6-8ac5-4577-94df-477efeeb3757 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:43:35 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-cb23bfb6-8ac5-4577-94df-477efeeb3757 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.262s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 10:43:35 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb23bfb6-8ac5-4577-94df-477efeeb3757 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] <== disconnect_volume: return (263ms) None {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 10:43:35 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cb23bfb6-8ac5-4577-94df-477efeeb3757 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] [instance: 5d100a08-eaf2-4132-87dd-a8dcfe17f68f] Disconnected iSCSI Volume {{(pid=73572) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 10:43:35 user nova-compute[73572]: DEBUG nova.objects.instance [None req-cb23bfb6-8ac5-4577-94df-477efeeb3757 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Lazy-loading 'flavor' on Instance uuid 5d100a08-eaf2-4132-87dd-a8dcfe17f68f {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:43:35 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-cb23bfb6-8ac5-4577-94df-477efeeb3757 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Lock "5d100a08-eaf2-4132-87dd-a8dcfe17f68f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.603s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:43:39 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:43:39 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:43:39 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73572) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 10:43:39 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73572) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 10:43:39 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73572) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 10:43:39 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:43:39 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:43:40 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:43:42 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:43:42 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73572) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 10:43:43 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:43:43 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:43:43 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:43:43 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:43:43 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Auditing locally available compute resources for user (node: user) {{(pid=73572) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 10:43:43 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d100a08-eaf2-4132-87dd-a8dcfe17f68f/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:43:44 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d100a08-eaf2-4132-87dd-a8dcfe17f68f/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:43:44 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d100a08-eaf2-4132-87dd-a8dcfe17f68f/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:43:44 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:43:44 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d100a08-eaf2-4132-87dd-a8dcfe17f68f/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:43:44 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28e0ccc5-be20-4246-afae-3c193eb14433/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:43:44 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28e0ccc5-be20-4246-afae-3c193eb14433/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:43:44 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28e0ccc5-be20-4246-afae-3c193eb14433/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:43:44 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28e0ccc5-be20-4246-afae-3c193eb14433/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:43:45 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:43:45 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:43:45 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Hypervisor/Node resource view: name=user free_ram=8576MB free_disk=25.116352081298828GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=73572) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 10:43:45 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:43:45 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:43:45 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance 5d100a08-eaf2-4132-87dd-a8dcfe17f68f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:43:45 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance 28e0ccc5-be20-4246-afae-3c193eb14433 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:43:45 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=73572) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 10:43:45 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=73572) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 10:43:45 user nova-compute[73572]: DEBUG nova.compute.provider_tree [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Inventory has not changed in ProviderTree for provider: e2cec974-59b2-4c77-a53d-a7f4e5a30d75 {{(pid=73572) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 10:43:45 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Inventory has not changed for provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73572) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 10:43:45 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Compute_service record updated for user:user {{(pid=73572) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 10:43:45 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.196s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:43:46 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:43:46 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:43:47 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:43:49 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:43:54 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:43:59 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:44:04 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:44:09 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:44:14 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:44:17 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9ac1579e-a90c-45d8-8a1d-960580986713 tempest-VolumesActionsTest-1975068690 tempest-VolumesActionsTest-1975068690-project-member] Acquiring lock "28e0ccc5-be20-4246-afae-3c193eb14433" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:44:17 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9ac1579e-a90c-45d8-8a1d-960580986713 tempest-VolumesActionsTest-1975068690 tempest-VolumesActionsTest-1975068690-project-member] Lock "28e0ccc5-be20-4246-afae-3c193eb14433" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:44:17 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9ac1579e-a90c-45d8-8a1d-960580986713 tempest-VolumesActionsTest-1975068690 tempest-VolumesActionsTest-1975068690-project-member] Acquiring lock "28e0ccc5-be20-4246-afae-3c193eb14433-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:44:17 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9ac1579e-a90c-45d8-8a1d-960580986713 tempest-VolumesActionsTest-1975068690 tempest-VolumesActionsTest-1975068690-project-member] Lock "28e0ccc5-be20-4246-afae-3c193eb14433-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:44:17 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9ac1579e-a90c-45d8-8a1d-960580986713 tempest-VolumesActionsTest-1975068690 tempest-VolumesActionsTest-1975068690-project-member] Lock "28e0ccc5-be20-4246-afae-3c193eb14433-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:44:17 user nova-compute[73572]: INFO nova.compute.manager [None req-9ac1579e-a90c-45d8-8a1d-960580986713 tempest-VolumesActionsTest-1975068690 tempest-VolumesActionsTest-1975068690-project-member] [instance: 28e0ccc5-be20-4246-afae-3c193eb14433] Terminating instance
Aug 26 10:44:17 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9ac1579e-a90c-45d8-8a1d-960580986713 tempest-VolumesActionsTest-1975068690 tempest-VolumesActionsTest-1975068690-project-member] [instance: 28e0ccc5-be20-4246-afae-3c193eb14433] Start destroying the instance on the hypervisor. {{(pid=73572) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 10:44:17 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:44:17 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:44:17 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:44:17 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:44:17 user nova-compute[73572]: DEBUG nova.compute.manager [req-fd279098-4677-4b14-8543-c5a9acd99ec4 req-cf46942d-670e-424c-9431-32f57fa799be service nova] [instance: 28e0ccc5-be20-4246-afae-3c193eb14433] Received event network-vif-unplugged-77e7fd47-0628-44d4-a900-ed772e10c665 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:44:17 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-fd279098-4677-4b14-8543-c5a9acd99ec4 req-cf46942d-670e-424c-9431-32f57fa799be service nova] Acquiring lock "28e0ccc5-be20-4246-afae-3c193eb14433-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:44:17 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-fd279098-4677-4b14-8543-c5a9acd99ec4 req-cf46942d-670e-424c-9431-32f57fa799be service nova] Lock "28e0ccc5-be20-4246-afae-3c193eb14433-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:44:17 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-fd279098-4677-4b14-8543-c5a9acd99ec4 req-cf46942d-670e-424c-9431-32f57fa799be service nova] Lock "28e0ccc5-be20-4246-afae-3c193eb14433-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:44:17 user nova-compute[73572]: DEBUG nova.compute.manager [req-fd279098-4677-4b14-8543-c5a9acd99ec4 req-cf46942d-670e-424c-9431-32f57fa799be service nova] [instance: 28e0ccc5-be20-4246-afae-3c193eb14433] No waiting events found dispatching network-vif-unplugged-77e7fd47-0628-44d4-a900-ed772e10c665 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:44:17 user nova-compute[73572]: DEBUG nova.compute.manager [req-fd279098-4677-4b14-8543-c5a9acd99ec4 req-cf46942d-670e-424c-9431-32f57fa799be service nova] [instance: 28e0ccc5-be20-4246-afae-3c193eb14433] Received event network-vif-unplugged-77e7fd47-0628-44d4-a900-ed772e10c665 for instance with task_state deleting. {{(pid=73572) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 10:44:17 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:44:17 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:44:18 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:44:18 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:44:18 user nova-compute[73572]: INFO nova.virt.libvirt.driver [-] [instance: 28e0ccc5-be20-4246-afae-3c193eb14433] Instance destroyed successfully.
Aug 26 10:44:18 user nova-compute[73572]: DEBUG nova.objects.instance [None req-9ac1579e-a90c-45d8-8a1d-960580986713 tempest-VolumesActionsTest-1975068690 tempest-VolumesActionsTest-1975068690-project-member] Lazy-loading 'resources' on Instance uuid 28e0ccc5-be20-4246-afae-3c193eb14433 {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:44:18 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-9ac1579e-a90c-45d8-8a1d-960580986713 tempest-VolumesActionsTest-1975068690 tempest-VolumesActionsTest-1975068690-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T10:42:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1292918762',display_name='tempest-VolumesActionsTest-instance-1292918762',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1292918762',id=51,image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T10:42:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='25b4ed9a0f884465bc9ff940aa8d4dba',ramdisk_id='',reservation_id='r-7zsb0k0l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1975068690',owner_user_name='tempest-VolumesActionsTest-1975068690-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T10:42:23Z,user_data=None,user_id='faa88d2f21684e1a9f4c0ba4b786a795',uuid=28e0ccc5-be20-4246-afae-3c193eb14433,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "77e7fd47-0628-44d4-a900-ed772e10c665", "address": "fa:16:3e:5c:82:71", "network": {"id": "0ea23c7b-e740-40ee-80f2-add01d583c33", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1245070125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25b4ed9a0f884465bc9ff940aa8d4dba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77e7fd47-06", "ovs_interfaceid": "77e7fd47-0628-44d4-a900-ed772e10c665", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 10:44:18 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-9ac1579e-a90c-45d8-8a1d-960580986713 tempest-VolumesActionsTest-1975068690 tempest-VolumesActionsTest-1975068690-project-member] Converting VIF {"id": "77e7fd47-0628-44d4-a900-ed772e10c665", "address": "fa:16:3e:5c:82:71", "network": {"id": "0ea23c7b-e740-40ee-80f2-add01d583c33", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1245070125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25b4ed9a0f884465bc9ff940aa8d4dba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77e7fd47-06", "ovs_interfaceid": "77e7fd47-0628-44d4-a900-ed772e10c665", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:44:18 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-9ac1579e-a90c-45d8-8a1d-960580986713 tempest-VolumesActionsTest-1975068690 tempest-VolumesActionsTest-1975068690-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5c:82:71,bridge_name='br-int',has_traffic_filtering=True,id=77e7fd47-0628-44d4-a900-ed772e10c665,network=Network(0ea23c7b-e740-40ee-80f2-add01d583c33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77e7fd47-06') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:44:18 user nova-compute[73572]: DEBUG os_vif [None req-9ac1579e-a90c-45d8-8a1d-960580986713 tempest-VolumesActionsTest-1975068690 tempest-VolumesActionsTest-1975068690-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5c:82:71,bridge_name='br-int',has_traffic_filtering=True,id=77e7fd47-0628-44d4-a900-ed772e10c665,network=Network(0ea23c7b-e740-40ee-80f2-add01d583c33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77e7fd47-06') {{(pid=73572) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 10:44:18 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:44:18 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap77e7fd47-06, bridge=br-int, if_exists=True) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:44:18 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:44:18 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:44:18 user nova-compute[73572]: INFO os_vif [None req-9ac1579e-a90c-45d8-8a1d-960580986713 tempest-VolumesActionsTest-1975068690 tempest-VolumesActionsTest-1975068690-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5c:82:71,bridge_name='br-int',has_traffic_filtering=True,id=77e7fd47-0628-44d4-a900-ed772e10c665,network=Network(0ea23c7b-e740-40ee-80f2-add01d583c33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77e7fd47-06')
Aug 26 10:44:18 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-9ac1579e-a90c-45d8-8a1d-960580986713 tempest-VolumesActionsTest-1975068690 tempest-VolumesActionsTest-1975068690-project-member] [instance: 28e0ccc5-be20-4246-afae-3c193eb14433] Deleting instance files /opt/stack/data/nova/instances/28e0ccc5-be20-4246-afae-3c193eb14433_del
Aug 26 10:44:18 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-9ac1579e-a90c-45d8-8a1d-960580986713 tempest-VolumesActionsTest-1975068690 tempest-VolumesActionsTest-1975068690-project-member] [instance: 28e0ccc5-be20-4246-afae-3c193eb14433] Deletion of /opt/stack/data/nova/instances/28e0ccc5-be20-4246-afae-3c193eb14433_del complete
Aug 26 10:44:18 user nova-compute[73572]: INFO nova.compute.manager [None req-9ac1579e-a90c-45d8-8a1d-960580986713 tempest-VolumesActionsTest-1975068690 tempest-VolumesActionsTest-1975068690-project-member] [instance: 28e0ccc5-be20-4246-afae-3c193eb14433] Took 0.87 seconds to destroy the instance on the hypervisor.
Aug 26 10:44:18 user nova-compute[73572]: DEBUG oslo.service.loopingcall [None req-9ac1579e-a90c-45d8-8a1d-960580986713 tempest-VolumesActionsTest-1975068690 tempest-VolumesActionsTest-1975068690-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73572) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 10:44:18 user nova-compute[73572]: DEBUG nova.compute.manager [-] [instance: 28e0ccc5-be20-4246-afae-3c193eb14433] Deallocating network for instance {{(pid=73572) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 10:44:18 user nova-compute[73572]: DEBUG nova.network.neutron [-] [instance: 28e0ccc5-be20-4246-afae-3c193eb14433] deallocate_for_instance() {{(pid=73572) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 10:44:18 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:44:18 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:44:18 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:44:18 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:44:18 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:44:18 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:44:19 user nova-compute[73572]: DEBUG nova.network.neutron [-] [instance: 28e0ccc5-be20-4246-afae-3c193eb14433] Updating instance_info_cache with network_info: [] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:44:19 user nova-compute[73572]: INFO nova.compute.manager [-] [instance: 28e0ccc5-be20-4246-afae-3c193eb14433] Took 0.91 seconds to deallocate network for instance.
Aug 26 10:44:19 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9ac1579e-a90c-45d8-8a1d-960580986713 tempest-VolumesActionsTest-1975068690 tempest-VolumesActionsTest-1975068690-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:44:19 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9ac1579e-a90c-45d8-8a1d-960580986713 tempest-VolumesActionsTest-1975068690 tempest-VolumesActionsTest-1975068690-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:44:19 user nova-compute[73572]: DEBUG nova.compute.provider_tree [None req-9ac1579e-a90c-45d8-8a1d-960580986713 tempest-VolumesActionsTest-1975068690 tempest-VolumesActionsTest-1975068690-project-member] Inventory has not changed in ProviderTree for provider: e2cec974-59b2-4c77-a53d-a7f4e5a30d75 {{(pid=73572) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 10:44:19 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-9ac1579e-a90c-45d8-8a1d-960580986713 tempest-VolumesActionsTest-1975068690 tempest-VolumesActionsTest-1975068690-project-member] Inventory has not changed for provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73572) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 10:44:19 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9ac1579e-a90c-45d8-8a1d-960580986713 tempest-VolumesActionsTest-1975068690 tempest-VolumesActionsTest-1975068690-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.130s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:44:19 user nova-compute[73572]: INFO nova.scheduler.client.report [None req-9ac1579e-a90c-45d8-8a1d-960580986713 tempest-VolumesActionsTest-1975068690 tempest-VolumesActionsTest-1975068690-project-member] Deleted allocations for instance 28e0ccc5-be20-4246-afae-3c193eb14433
Aug 26 10:44:19 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9ac1579e-a90c-45d8-8a1d-960580986713 tempest-VolumesActionsTest-1975068690 tempest-VolumesActionsTest-1975068690-project-member] Lock "28e0ccc5-be20-4246-afae-3c193eb14433" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.087s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:44:19 user nova-compute[73572]: DEBUG nova.compute.manager [req-7de80017-092d-434b-bb03-7d01d134f9a1 req-70675070-f1ea-458e-ba6e-00f2b1f6b212 service nova] [instance: 28e0ccc5-be20-4246-afae-3c193eb14433] Received event network-vif-plugged-77e7fd47-0628-44d4-a900-ed772e10c665 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:44:19 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-7de80017-092d-434b-bb03-7d01d134f9a1 req-70675070-f1ea-458e-ba6e-00f2b1f6b212 service nova] Acquiring lock "28e0ccc5-be20-4246-afae-3c193eb14433-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:44:19 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-7de80017-092d-434b-bb03-7d01d134f9a1 req-70675070-f1ea-458e-ba6e-00f2b1f6b212 service nova] Lock "28e0ccc5-be20-4246-afae-3c193eb14433-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:44:19 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-7de80017-092d-434b-bb03-7d01d134f9a1 req-70675070-f1ea-458e-ba6e-00f2b1f6b212 service nova] Lock "28e0ccc5-be20-4246-afae-3c193eb14433-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:44:19 user nova-compute[73572]: DEBUG nova.compute.manager [req-7de80017-092d-434b-bb03-7d01d134f9a1 req-70675070-f1ea-458e-ba6e-00f2b1f6b212 service nova] [instance: 28e0ccc5-be20-4246-afae-3c193eb14433] No waiting events found dispatching network-vif-plugged-77e7fd47-0628-44d4-a900-ed772e10c665 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:44:19 user nova-compute[73572]: WARNING nova.compute.manager [req-7de80017-092d-434b-bb03-7d01d134f9a1 req-70675070-f1ea-458e-ba6e-00f2b1f6b212 service nova] [instance: 28e0ccc5-be20-4246-afae-3c193eb14433] Received unexpected event network-vif-plugged-77e7fd47-0628-44d4-a900-ed772e10c665 for instance with vm_state deleted and task_state None.
Aug 26 10:44:19 user nova-compute[73572]: DEBUG nova.compute.manager [req-7de80017-092d-434b-bb03-7d01d134f9a1 req-70675070-f1ea-458e-ba6e-00f2b1f6b212 service nova] [instance: 28e0ccc5-be20-4246-afae-3c193eb14433] Received event network-vif-plugged-77e7fd47-0628-44d4-a900-ed772e10c665 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:44:19 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-7de80017-092d-434b-bb03-7d01d134f9a1 req-70675070-f1ea-458e-ba6e-00f2b1f6b212 service nova] Acquiring lock "28e0ccc5-be20-4246-afae-3c193eb14433-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:44:19 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-7de80017-092d-434b-bb03-7d01d134f9a1 req-70675070-f1ea-458e-ba6e-00f2b1f6b212 service nova] Lock "28e0ccc5-be20-4246-afae-3c193eb14433-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:44:19 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-7de80017-092d-434b-bb03-7d01d134f9a1 req-70675070-f1ea-458e-ba6e-00f2b1f6b212 service nova] Lock "28e0ccc5-be20-4246-afae-3c193eb14433-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:44:19 user nova-compute[73572]: DEBUG nova.compute.manager [req-7de80017-092d-434b-bb03-7d01d134f9a1 req-70675070-f1ea-458e-ba6e-00f2b1f6b212 service nova] [instance: 28e0ccc5-be20-4246-afae-3c193eb14433] No waiting events found dispatching network-vif-plugged-77e7fd47-0628-44d4-a900-ed772e10c665 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:44:19 user nova-compute[73572]: WARNING nova.compute.manager [req-7de80017-092d-434b-bb03-7d01d134f9a1 req-70675070-f1ea-458e-ba6e-00f2b1f6b212 service nova] [instance: 28e0ccc5-be20-4246-afae-3c193eb14433] Received unexpected event network-vif-plugged-77e7fd47-0628-44d4-a900-ed772e10c665 for instance with vm_state deleted and task_state None.
Aug 26 10:44:19 user nova-compute[73572]: DEBUG nova.compute.manager [req-7de80017-092d-434b-bb03-7d01d134f9a1 req-70675070-f1ea-458e-ba6e-00f2b1f6b212 service nova] [instance: 28e0ccc5-be20-4246-afae-3c193eb14433] Received event network-vif-plugged-77e7fd47-0628-44d4-a900-ed772e10c665 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:44:19 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-7de80017-092d-434b-bb03-7d01d134f9a1 req-70675070-f1ea-458e-ba6e-00f2b1f6b212 service nova] Acquiring lock "28e0ccc5-be20-4246-afae-3c193eb14433-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:44:19 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-7de80017-092d-434b-bb03-7d01d134f9a1 req-70675070-f1ea-458e-ba6e-00f2b1f6b212 service nova] Lock "28e0ccc5-be20-4246-afae-3c193eb14433-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:44:19 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-7de80017-092d-434b-bb03-7d01d134f9a1 req-70675070-f1ea-458e-ba6e-00f2b1f6b212 service nova] Lock "28e0ccc5-be20-4246-afae-3c193eb14433-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:44:19 user nova-compute[73572]: DEBUG nova.compute.manager [req-7de80017-092d-434b-bb03-7d01d134f9a1 req-70675070-f1ea-458e-ba6e-00f2b1f6b212 service nova] [instance: 28e0ccc5-be20-4246-afae-3c193eb14433] No waiting events found dispatching network-vif-plugged-77e7fd47-0628-44d4-a900-ed772e10c665 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:44:19 user nova-compute[73572]: WARNING nova.compute.manager [req-7de80017-092d-434b-bb03-7d01d134f9a1 req-70675070-f1ea-458e-ba6e-00f2b1f6b212 service nova] [instance: 28e0ccc5-be20-4246-afae-3c193eb14433] Received unexpected event network-vif-plugged-77e7fd47-0628-44d4-a900-ed772e10c665 for instance with vm_state deleted and task_state None.
Aug 26 10:44:19 user nova-compute[73572]: DEBUG nova.compute.manager [req-7de80017-092d-434b-bb03-7d01d134f9a1 req-70675070-f1ea-458e-ba6e-00f2b1f6b212 service nova] [instance: 28e0ccc5-be20-4246-afae-3c193eb14433] Received event network-vif-plugged-77e7fd47-0628-44d4-a900-ed772e10c665 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:44:19 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-7de80017-092d-434b-bb03-7d01d134f9a1 req-70675070-f1ea-458e-ba6e-00f2b1f6b212 service nova] Acquiring lock "28e0ccc5-be20-4246-afae-3c193eb14433-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:44:19 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-7de80017-092d-434b-bb03-7d01d134f9a1 req-70675070-f1ea-458e-ba6e-00f2b1f6b212 service nova] Lock "28e0ccc5-be20-4246-afae-3c193eb14433-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:44:19 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-7de80017-092d-434b-bb03-7d01d134f9a1 req-70675070-f1ea-458e-ba6e-00f2b1f6b212 service nova] Lock "28e0ccc5-be20-4246-afae-3c193eb14433-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:44:19 user nova-compute[73572]: DEBUG nova.compute.manager [req-7de80017-092d-434b-bb03-7d01d134f9a1 req-70675070-f1ea-458e-ba6e-00f2b1f6b212 service nova] [instance: 28e0ccc5-be20-4246-afae-3c193eb14433] No waiting events found dispatching network-vif-plugged-77e7fd47-0628-44d4-a900-ed772e10c665 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:44:19 user nova-compute[73572]: WARNING nova.compute.manager [req-7de80017-092d-434b-bb03-7d01d134f9a1 req-70675070-f1ea-458e-ba6e-00f2b1f6b212 service nova] [instance: 28e0ccc5-be20-4246-afae-3c193eb14433] Received unexpected event network-vif-plugged-77e7fd47-0628-44d4-a900-ed772e10c665 for instance with vm_state deleted and task_state None.
Aug 26 10:44:19 user nova-compute[73572]: DEBUG nova.compute.manager [req-7de80017-092d-434b-bb03-7d01d134f9a1 req-70675070-f1ea-458e-ba6e-00f2b1f6b212 service nova] [instance: 28e0ccc5-be20-4246-afae-3c193eb14433] Received event network-vif-deleted-77e7fd47-0628-44d4-a900-ed772e10c665 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:44:23 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:44:28 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:44:28 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-e5630701-6f13-4631-979a-c1ba71b794e3 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Acquiring lock "5d100a08-eaf2-4132-87dd-a8dcfe17f68f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:44:28 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-e5630701-6f13-4631-979a-c1ba71b794e3 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Lock "5d100a08-eaf2-4132-87dd-a8dcfe17f68f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:44:28 user nova-compute[73572]: DEBUG nova.objects.instance [None req-e5630701-6f13-4631-979a-c1ba71b794e3 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Lazy-loading 'flavor' on Instance uuid 5d100a08-eaf2-4132-87dd-a8dcfe17f68f {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:44:28 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-e5630701-6f13-4631-979a-c1ba71b794e3 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Lock "5d100a08-eaf2-4132-87dd-a8dcfe17f68f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:44:28 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-e5630701-6f13-4631-979a-c1ba71b794e3 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Acquiring lock "5d100a08-eaf2-4132-87dd-a8dcfe17f68f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:44:28 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-e5630701-6f13-4631-979a-c1ba71b794e3 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Lock "5d100a08-eaf2-4132-87dd-a8dcfe17f68f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:44:28 user nova-compute[73572]: INFO nova.compute.manager [None req-e5630701-6f13-4631-979a-c1ba71b794e3 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] [instance: 5d100a08-eaf2-4132-87dd-a8dcfe17f68f] Attaching volume ce2bd3c5-0363-4948-abfe-d9e3111db641 to /dev/vdb
Aug 26 10:44:28 user nova-compute[73572]: DEBUG os_brick.utils [None req-e5630701-6f13-4631-979a-c1ba71b794e3 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 10:44:28 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:44:28 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:44:28 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[fec4c570-c79e-4551-9b26-46ea13f68e1c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:de8a79ed912\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:44:28 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:44:28 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:44:28 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[88900bd9-fffb-49e4-af31-44749290b5f5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:44:28 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:44:28 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:44:28 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[becba97a-79bf-4af3-9184-d7dc684b667c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:44:28 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[36889b70-f3c4-4279-bc1d-0694492e4c68]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:44:28 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-e5630701-6f13-4631-979a-c1ba71b794e3 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Running cmd (subprocess): nvme version {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:44:28 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-e5630701-6f13-4631-979a-c1ba71b794e3 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] 'nvme version' failed. Not Retrying. {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 10:44:28 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e5630701-6f13-4631-979a-c1ba71b794e3 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] nvme not present on system {{(pid=73572) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 10:44:28 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:44:28 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 10:44:28 user nova-compute[73572]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 10:44:28 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5985f94-0071-46cd-9d7b-947b2cc9ebfe]: (4, '') {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:44:28 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.lightos [None req-e5630701-6f13-4631-979a-c1ba71b794e3 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73572) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 10:44:28 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.lightos [None req-e5630701-6f13-4631-979a-c1ba71b794e3 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73572) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 10:44:28 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.lightos [None req-e5630701-6f13-4631-979a-c1ba71b794e3 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] LIGHTOS: no hostnqn found. {{(pid=73572) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 10:44:28 user nova-compute[73572]: DEBUG os_brick.utils [None req-e5630701-6f13-4631-979a-c1ba71b794e3 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:de8a79ed912', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 10:44:28 user nova-compute[73572]: DEBUG nova.virt.block_device [None req-e5630701-6f13-4631-979a-c1ba71b794e3 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] [instance: 5d100a08-eaf2-4132-87dd-a8dcfe17f68f] Updating existing volume attachment record: 5d0d77db-d420-4656-8b11-fe8503ac03c0 {{(pid=73572) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 10:44:30 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:44:33 user nova-compute[73572]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693046658.0567586, 28e0ccc5-be20-4246-afae-3c193eb14433 => Stopped> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:44:33 user nova-compute[73572]: INFO nova.compute.manager [-] [instance: 28e0ccc5-be20-4246-afae-3c193eb14433] VM Stopped (Lifecycle Event)
Aug 26 10:44:33 user nova-compute[73572]: DEBUG nova.compute.manager [None req-a66615bf-112b-4979-93bd-1143c25d4393 None None] [instance: 28e0ccc5-be20-4246-afae-3c193eb14433] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:44:33 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:44:33 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:44:34 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:44:35 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:44:35 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Starting heal instance info cache {{(pid=73572) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 10:44:35 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Rebuilding the list of instances to heal {{(pid=73572) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 10:44:35 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquiring lock "refresh_cache-5d100a08-eaf2-4132-87dd-a8dcfe17f68f" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:44:35 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquired lock "refresh_cache-5d100a08-eaf2-4132-87dd-a8dcfe17f68f" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:44:35 user nova-compute[73572]: DEBUG nova.network.neutron [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] [instance: 5d100a08-eaf2-4132-87dd-a8dcfe17f68f] Forcefully refreshing network info cache for instance {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 10:44:35 user nova-compute[73572]: DEBUG nova.objects.instance [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lazy-loading 'info_cache' on Instance uuid 5d100a08-eaf2-4132-87dd-a8dcfe17f68f {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:44:36 user nova-compute[73572]: DEBUG nova.network.neutron [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] [instance: 5d100a08-eaf2-4132-87dd-a8dcfe17f68f] Updating instance_info_cache with network_info: [{"id": "efe52e67-0439-4035-988e-daae3acfc823", "address": "fa:16:3e:68:58:83", "network": {"id": "598e1cfa-caaf-470c-ac5a-e91aa2611d1f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1541764581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08b110acd72c427db0de4e98d05f5e56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefe52e67-04", "ovs_interfaceid": "efe52e67-0439-4035-988e-daae3acfc823", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:44:36 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Releasing lock "refresh_cache-5d100a08-eaf2-4132-87dd-a8dcfe17f68f" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:44:36 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] [instance: 5d100a08-eaf2-4132-87dd-a8dcfe17f68f] Updated the network info_cache for instance {{(pid=73572) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 10:44:38 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:44:38 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:44:38 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73572) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 10:44:38 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73572) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 10:44:38 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73572) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 10:44:38 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:44:38 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e5630701-6f13-4631-979a-c1ba71b794e3 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] [instance: 5d100a08-eaf2-4132-87dd-a8dcfe17f68f] Calling os-brick to attach iSCSI Volume {{(pid=73572) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 10:44:38 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5630701-6f13-4631-979a-c1ba71b794e3 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc89c3d6a10>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:ce2bd3c5-0363-4948-abfe-d9e3111db641'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eXwcYCbF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 10:44:38 user nova-compute[73572]: WARNING os_brick.initiator.connectors.base [None req-e5630701-6f13-4631-979a-c1ba71b794e3 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 10:44:38 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-e5630701-6f13-4631-979a-c1ba71b794e3 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 10:44:38 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-e5630701-6f13-4631-979a-c1ba71b794e3 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 10:44:38 user nova-compute[73572]: WARNING os_brick.initiator.connectors.base [None req-e5630701-6f13-4631-979a-c1ba71b794e3 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 10:44:38 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-e5630701-6f13-4631-979a-c1ba71b794e3 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ce2bd3c5-0363-4948-abfe-d9e3111db641" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 10:44:38 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-e5630701-6f13-4631-979a-c1ba71b794e3 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ce2bd3c5-0363-4948-abfe-d9e3111db641" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 10:44:38 user nova-compute[73572]: INFO os_brick.initiator.connectors.iscsi [None req-e5630701-6f13-4631-979a-c1ba71b794e3 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 10:44:38 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce2bd3c5-0363-4948-abfe-d9e3111db641 -p 172.16.0.220:3260 {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:44:38 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce2bd3c5-0363-4948-abfe-d9e3111db641 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:44:38 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bc785e3-cc65-4aa3-bf4f-3b750d6b7d34]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:44:38 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5630701-6f13-4631-979a-c1ba71b794e3 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 10:44:38 user nova-compute[73572]:  {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:44:38 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce2bd3c5-0363-4948-abfe-d9e3111db641 -p 172.16.0.220:3260 --interface default --op new {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:44:38 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce2bd3c5-0363-4948-abfe-d9e3111db641 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:44:38 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[35cbe6f4-70b2-42a4-94ce-d408859820a6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ce2bd3c5-0363-4948-abfe-d9e3111db641] added\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:44:38 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5630701-6f13-4631-979a-c1ba71b794e3 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ce2bd3c5-0363-4948-abfe-d9e3111db641] added
Aug 26 10:44:38 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:44:38 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce2bd3c5-0363-4948-abfe-d9e3111db641 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:44:38 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce2bd3c5-0363-4948-abfe-d9e3111db641 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:44:38 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[888c6f89-121d-4425-9bd1-39815f651cf6]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:44:38 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5630701-6f13-4631-979a-c1ba71b794e3 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:44:38 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce2bd3c5-0363-4948-abfe-d9e3111db641 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:44:38 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce2bd3c5-0363-4948-abfe-d9e3111db641 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:44:38 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[d72fb3dc-659c-4f38-b86e-5ecf49370ef3]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:44:38 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5630701-6f13-4631-979a-c1ba71b794e3 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:44:38 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce2bd3c5-0363-4948-abfe-d9e3111db641 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eXwcYCbF {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:44:38 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce2bd3c5-0363-4948-abfe-d9e3111db641 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eXwcYCbF" returned: 0 in 0.018s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:44:38 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[39d552dd-2851-4ee4-86dd-18609baa3581]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:44:38 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5630701-6f13-4631-979a-c1ba71b794e3 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'eXwcYCbF'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:44:38 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce2bd3c5-0363-4948-abfe-d9e3111db641 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:44:38 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce2bd3c5-0363-4948-abfe-d9e3111db641 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:44:38 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e7f1e12-a9a0-4c85-9cd9-7190d9931369]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:44:38 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5630701-6f13-4631-979a-c1ba71b794e3 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:44:38 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:44:38 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:44:38 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[5afe0b1d-914f-40a2-9deb-0115b5e1dff2]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:44:38 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5630701-6f13-4631-979a-c1ba71b794e3 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 26 10:44:38 user nova-compute[73572]:  {{(pid=73572) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 10:44:38 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5630701-6f13-4631-979a-c1ba71b794e3 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 26 10:44:38 user nova-compute[73572]:  {{(pid=73572) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 10:44:38 user nova-compute[73572]: WARNING os_brick.initiator.connectors.iscsi [None req-e5630701-6f13-4631-979a-c1ba71b794e3 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 26 10:44:38 user nova-compute[73572]: 
Aug 26 10:44:38 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce2bd3c5-0363-4948-abfe-d9e3111db641 -p 172.16.0.220:3260 --login {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:44:38 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce2bd3c5-0363-4948-abfe-d9e3111db641 -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:44:38 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[6893e1fe-3619-4138-8cbe-6b729d002902]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ce2bd3c5-0363-4948-abfe-d9e3111db641, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ce2bd3c5-0363-4948-abfe-d9e3111db641, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:44:38 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5630701-6f13-4631-979a-c1ba71b794e3 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ce2bd3c5-0363-4948-abfe-d9e3111db641, portal: 172.16.0.220,3260]
Aug 26 10:44:38 user nova-compute[73572]: Login to [iface: default, target: iqn.2010-10.org.openstack:ce2bd3c5-0363-4948-abfe-d9e3111db641, portal: 172.16.0.220,3260] successful.
Aug 26 10:44:38 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:44:38 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce2bd3c5-0363-4948-abfe-d9e3111db641 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:44:38 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce2bd3c5-0363-4948-abfe-d9e3111db641 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:44:38 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[668855b1-6757-4fe7-8e18-30ad0fca9ba5]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:44:38 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5630701-6f13-4631-979a-c1ba71b794e3 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:44:38 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:44:38 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:44:38 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[461077da-b671-4f21-90ce-8916567b4009]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce2bd3c5-0363-4948-abfe-d9e3111db641 (non-flash)\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:44:38 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5630701-6f13-4631-979a-c1ba71b794e3 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce2bd3c5-0363-4948-abfe-d9e3111db641 (non-flash)
Aug 26 10:44:38 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 10:44:38 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5630701-6f13-4631-979a-c1ba71b794e3 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce2bd3c5-0363-4948-abfe-d9e3111db641 (non-flash)
Aug 26 10:44:38 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 10:44:38 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-e5630701-6f13-4631-979a-c1ba71b794e3 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ce2bd3c5-0363-4948-abfe-d9e3111db641" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.244s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 10:44:38 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5630701-6f13-4631-979a-c1ba71b794e3 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Connected to 172.16.0.220:3260 {{(pid=73572) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 10:44:38 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-e5630701-6f13-4631-979a-c1ba71b794e3 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] HCTL ('33', '-', '-', 0) found on session 59 with lun 0 {{(pid=73572) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 10:44:38 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-e5630701-6f13-4631-979a-c1ba71b794e3 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73572) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 10:44:38 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:44:38 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:44:38 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[f151a1a9-1d34-480c-951b-86b5269a1952]: (4, ('- - 0', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:44:38 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-e5630701-6f13-4631-979a-c1ba71b794e3 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Searching for a device in session 59 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73572) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 10:44:38 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5630701-6f13-4631-979a-c1ba71b794e3 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eXwcYCbF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73572) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 10:44:39 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-e5630701-6f13-4631-979a-c1ba71b794e3 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.274s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 10:44:39 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5630701-6f13-4631-979a-c1ba71b794e3 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] <== connect_volume: return (1276ms) {'type': 'block', 'scsi_wwn': '23762363366366365', 'path': '/dev/sdb'} {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 10:44:39 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e5630701-6f13-4631-979a-c1ba71b794e3 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] [instance: 5d100a08-eaf2-4132-87dd-a8dcfe17f68f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23762363366366365', 'path': '/dev/sdb'} {{(pid=73572) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 10:44:39 user nova-compute[73572]: DEBUG nova.objects.instance [None req-e5630701-6f13-4631-979a-c1ba71b794e3 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Lazy-loading 'flavor' on Instance uuid 5d100a08-eaf2-4132-87dd-a8dcfe17f68f {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:44:39 user nova-compute[73572]: DEBUG nova.virt.libvirt.guest [None req-e5630701-6f13-4631-979a-c1ba71b794e3 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 10:44:39 user nova-compute[73572]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 10:44:39 user nova-compute[73572]:   <source dev="/dev/sdb"/>
Aug 26 10:44:39 user nova-compute[73572]:   <target dev="vdb" bus="virtio"/>
Aug 26 10:44:39 user nova-compute[73572]:   <serial>ce2bd3c5-0363-4948-abfe-d9e3111db641</serial>
Aug 26 10:44:39 user nova-compute[73572]: </disk>
Aug 26 10:44:39 user nova-compute[73572]:  {{(pid=73572) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 10:44:40 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-e5630701-6f13-4631-979a-c1ba71b794e3 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] No BDM found with device name vda, not building metadata. {{(pid=73572) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 10:44:40 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-e5630701-6f13-4631-979a-c1ba71b794e3 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73572) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 10:44:40 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-e5630701-6f13-4631-979a-c1ba71b794e3 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] No VIF found with MAC fa:16:3e:68:58:83, not building metadata {{(pid=73572) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 10:44:40 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-e5630701-6f13-4631-979a-c1ba71b794e3 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Lock "5d100a08-eaf2-4132-87dd-a8dcfe17f68f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.757s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:44:41 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:44:43 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-adb9eabb-8361-4992-8b5c-7a0adbaf6035 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Acquiring lock "5d100a08-eaf2-4132-87dd-a8dcfe17f68f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:44:43 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-adb9eabb-8361-4992-8b5c-7a0adbaf6035 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Lock "5d100a08-eaf2-4132-87dd-a8dcfe17f68f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:44:43 user nova-compute[73572]: INFO nova.compute.manager [None req-adb9eabb-8361-4992-8b5c-7a0adbaf6035 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] [instance: 5d100a08-eaf2-4132-87dd-a8dcfe17f68f] Detaching volume ce2bd3c5-0363-4948-abfe-d9e3111db641
Aug 26 10:44:43 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:44:43 user nova-compute[73572]: INFO nova.virt.block_device [None req-adb9eabb-8361-4992-8b5c-7a0adbaf6035 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] [instance: 5d100a08-eaf2-4132-87dd-a8dcfe17f68f] Attempting to driver detach volume ce2bd3c5-0363-4948-abfe-d9e3111db641 from mountpoint /dev/vdb
Aug 26 10:44:43 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-adb9eabb-8361-4992-8b5c-7a0adbaf6035 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Attempting to detach device vdb from instance 5d100a08-eaf2-4132-87dd-a8dcfe17f68f from the persistent domain config. {{(pid=73572) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 10:44:43 user nova-compute[73572]: DEBUG nova.virt.libvirt.guest [None req-adb9eabb-8361-4992-8b5c-7a0adbaf6035 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 10:44:43 user nova-compute[73572]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 10:44:43 user nova-compute[73572]:   <source dev="/dev/sdb"/>
Aug 26 10:44:43 user nova-compute[73572]:   <target dev="vdb" bus="virtio"/>
Aug 26 10:44:43 user nova-compute[73572]:   <serial>ce2bd3c5-0363-4948-abfe-d9e3111db641</serial>
Aug 26 10:44:43 user nova-compute[73572]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 10:44:43 user nova-compute[73572]: </disk>
Aug 26 10:44:43 user nova-compute[73572]:  {{(pid=73572) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 10:44:43 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-adb9eabb-8361-4992-8b5c-7a0adbaf6035 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Successfully detached device vdb from instance 5d100a08-eaf2-4132-87dd-a8dcfe17f68f from the persistent domain config.
Aug 26 10:44:43 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-adb9eabb-8361-4992-8b5c-7a0adbaf6035 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5d100a08-eaf2-4132-87dd-a8dcfe17f68f from the live domain config. {{(pid=73572) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 10:44:43 user nova-compute[73572]: DEBUG nova.virt.libvirt.guest [None req-adb9eabb-8361-4992-8b5c-7a0adbaf6035 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 10:44:43 user nova-compute[73572]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 10:44:43 user nova-compute[73572]:   <source dev="/dev/sdb"/>
Aug 26 10:44:43 user nova-compute[73572]:   <target dev="vdb" bus="virtio"/>
Aug 26 10:44:43 user nova-compute[73572]:   <serial>ce2bd3c5-0363-4948-abfe-d9e3111db641</serial>
Aug 26 10:44:43 user nova-compute[73572]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 10:44:43 user nova-compute[73572]: </disk>
Aug 26 10:44:43 user nova-compute[73572]:  {{(pid=73572) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 10:44:43 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Received event <DeviceRemovedEvent: 1693046683.5641623, 5d100a08-eaf2-4132-87dd-a8dcfe17f68f => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73572) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 10:44:43 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-adb9eabb-8361-4992-8b5c-7a0adbaf6035 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5d100a08-eaf2-4132-87dd-a8dcfe17f68f {{(pid=73572) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 10:44:43 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-adb9eabb-8361-4992-8b5c-7a0adbaf6035 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Successfully detached device vdb from instance 5d100a08-eaf2-4132-87dd-a8dcfe17f68f from the live domain config.
Aug 26 10:44:43 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-adb9eabb-8361-4992-8b5c-7a0adbaf6035 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] [instance: 5d100a08-eaf2-4132-87dd-a8dcfe17f68f] calling os-brick to detach iSCSI Volume {{(pid=73572) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 10:44:43 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-adb9eabb-8361-4992-8b5c-7a0adbaf6035 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc89c3d6a10>, {'target_iqns': ['iqn.2010-10.org.openstack:ce2bd3c5-0363-4948-abfe-d9e3111db641'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eXwcYCbF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 10:44:43 user nova-compute[73572]: WARNING os_brick.initiator.connectors.base [None req-adb9eabb-8361-4992-8b5c-7a0adbaf6035 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 10:44:43 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-adb9eabb-8361-4992-8b5c-7a0adbaf6035 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 10:44:43 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-adb9eabb-8361-4992-8b5c-7a0adbaf6035 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 10:44:43 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-adb9eabb-8361-4992-8b5c-7a0adbaf6035 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ce2bd3c5-0363-4948-abfe-d9e3111db641', 0)] {{(pid=73572) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 10:44:43 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:44:43 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:44:43 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebe521f0-dac9-40f6-9578-54404a499351]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ce2bd3c5-0363-4948-abfe-d9e3111db641\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:44:43 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:44:43 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:44:43 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eff6744-51f2-4adc-b2bb-37ffb11356a6]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce2bd3c5-0363-4948-abfe-d9e3111db641 (non-flash)\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:44:43 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-adb9eabb-8361-4992-8b5c-7a0adbaf6035 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce2bd3c5-0363-4948-abfe-d9e3111db641 (non-flash)
Aug 26 10:44:43 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 10:44:43 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-adb9eabb-8361-4992-8b5c-7a0adbaf6035 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce2bd3c5-0363-4948-abfe-d9e3111db641 (non-flash)
Aug 26 10:44:43 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 10:44:43 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-adb9eabb-8361-4992-8b5c-7a0adbaf6035 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc878bf11b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ce2bd3c5-0363-4948-abfe-d9e3111db641'): ({'sdb'}, set())}) {{(pid=73572) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 10:44:43 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-adb9eabb-8361-4992-8b5c-7a0adbaf6035 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Removing single pathed devices sdb {{(pid=73572) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 10:44:43 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:44:43 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:44:43 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[ada1f8d5-7b5f-4512-a1c7-856b5c3795b9]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:44:43 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:44:43 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:44:43 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[8730b0d9-1dff-435a-8a63-4210214885c6]: (4, ('ok\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:44:43 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-adb9eabb-8361-4992-8b5c-7a0adbaf6035 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Flushing IO for device /dev/sdb {{(pid=73572) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 10:44:43 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:44:43 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:44:43 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2f7359c-9964-4bc4-947c-60b86754f76f]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:44:43 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-adb9eabb-8361-4992-8b5c-7a0adbaf6035 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73572) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 10:44:43 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:44:43 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:44:43 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7431060-ce44-4882-ad57-7f3150477a99]: (4, ('1', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:44:43 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-adb9eabb-8361-4992-8b5c-7a0adbaf6035 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73572) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 10:44:43 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-adb9eabb-8361-4992-8b5c-7a0adbaf6035 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] SCSI volumes sdb have been removed. {{(pid=73572) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 10:44:43 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-adb9eabb-8361-4992-8b5c-7a0adbaf6035 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ce2bd3c5-0363-4948-abfe-d9e3111db641')] {{(pid=73572) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 10:44:43 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce2bd3c5-0363-4948-abfe-d9e3111db641 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:44:43 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce2bd3c5-0363-4948-abfe-d9e3111db641 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:44:43 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[211d9f67-4ced-4064-9382-8ef1240bc0ee]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:44:43 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-adb9eabb-8361-4992-8b5c-7a0adbaf6035 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:44:43 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce2bd3c5-0363-4948-abfe-d9e3111db641 -p 172.16.0.220:3260 --logout {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:44:43 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce2bd3c5-0363-4948-abfe-d9e3111db641 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:44:43 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4d08fa0-587d-4320-8de6-55772daf77b8]: (4, ('Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:ce2bd3c5-0363-4948-abfe-d9e3111db641, portal: 172.16.0.220,3260]\nLogout of [sid: 59, target: iqn.2010-10.org.openstack:ce2bd3c5-0363-4948-abfe-d9e3111db641, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:44:43 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-adb9eabb-8361-4992-8b5c-7a0adbaf6035 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:ce2bd3c5-0363-4948-abfe-d9e3111db641, portal: 172.16.0.220,3260]
Aug 26 10:44:43 user nova-compute[73572]: Logout of [sid: 59, target: iqn.2010-10.org.openstack:ce2bd3c5-0363-4948-abfe-d9e3111db641, portal: 172.16.0.220,3260] successful.
Aug 26 10:44:43 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:44:43 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce2bd3c5-0363-4948-abfe-d9e3111db641 -p 172.16.0.220:3260 --op delete {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:44:43 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce2bd3c5-0363-4948-abfe-d9e3111db641 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:44:43 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[604e092a-31c9-4881-a664-7c3e9e0d801d]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:44:43 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-adb9eabb-8361-4992-8b5c-7a0adbaf6035 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:44:43 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-adb9eabb-8361-4992-8b5c-7a0adbaf6035 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.259s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 10:44:43 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-adb9eabb-8361-4992-8b5c-7a0adbaf6035 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] <== disconnect_volume: return (261ms) None {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 10:44:43 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-adb9eabb-8361-4992-8b5c-7a0adbaf6035 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] [instance: 5d100a08-eaf2-4132-87dd-a8dcfe17f68f] Disconnected iSCSI Volume {{(pid=73572) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 10:44:44 user nova-compute[73572]: DEBUG nova.objects.instance [None req-adb9eabb-8361-4992-8b5c-7a0adbaf6035 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Lazy-loading 'flavor' on Instance uuid 5d100a08-eaf2-4132-87dd-a8dcfe17f68f {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:44:44 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-adb9eabb-8361-4992-8b5c-7a0adbaf6035 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Lock "5d100a08-eaf2-4132-87dd-a8dcfe17f68f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.594s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:44:44 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:44:44 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:44:44 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73572) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 10:44:44 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:44:44 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:44:44 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:44:44 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:44:44 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Auditing locally available compute resources for user (node: user) {{(pid=73572) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 10:44:44 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d100a08-eaf2-4132-87dd-a8dcfe17f68f/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:44:45 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d100a08-eaf2-4132-87dd-a8dcfe17f68f/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:44:45 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d100a08-eaf2-4132-87dd-a8dcfe17f68f/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:44:45 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d100a08-eaf2-4132-87dd-a8dcfe17f68f/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:44:45 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:44:45 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:44:45 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Hypervisor/Node resource view: name=user free_ram=8687MB free_disk=25.142704010009766GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=73572) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 10:44:45 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:44:45 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:44:45 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance 5d100a08-eaf2-4132-87dd-a8dcfe17f68f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:44:45 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73572) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 10:44:45 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73572) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 10:44:45 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:44:45 user nova-compute[73572]: DEBUG nova.compute.provider_tree [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Inventory has not changed in ProviderTree for provider: e2cec974-59b2-4c77-a53d-a7f4e5a30d75 {{(pid=73572) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 10:44:45 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Inventory has not changed for provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73572) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 10:44:45 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Compute_service record updated for user:user {{(pid=73572) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 10:44:45 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.191s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:44:48 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:44:48 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:44:49 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:44:53 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:44:58 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:45:03 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:45:08 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:45:08 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:45:08 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73572) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 10:45:08 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73572) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 10:45:08 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73572) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 10:45:08 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:45:13 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:45:18 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:45:18 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:45:18 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73572) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 10:45:18 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73572) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 10:45:18 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73572) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 10:45:18 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:45:23 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:45:28 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:45:28 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:45:28 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73572) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 10:45:28 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73572) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 10:45:28 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73572) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 10:45:28 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:45:33 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:45:33 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:45:33 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73572) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 10:45:33 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73572) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 10:45:33 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73572) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 10:45:33 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:45:33 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:45:34 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:45:36 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:45:36 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Starting heal instance info cache {{(pid=73572) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 10:45:36 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Rebuilding the list of instances to heal {{(pid=73572) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 10:45:36 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquiring lock "refresh_cache-5d100a08-eaf2-4132-87dd-a8dcfe17f68f" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:45:36 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquired lock "refresh_cache-5d100a08-eaf2-4132-87dd-a8dcfe17f68f" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:45:36 user nova-compute[73572]: DEBUG nova.network.neutron [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] [instance: 5d100a08-eaf2-4132-87dd-a8dcfe17f68f] Forcefully refreshing network info cache for instance {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 10:45:36 user nova-compute[73572]: DEBUG nova.objects.instance [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lazy-loading 'info_cache' on Instance uuid 5d100a08-eaf2-4132-87dd-a8dcfe17f68f {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:45:37 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-c5b1a037-3279-4f57-8ce9-c698ba664839 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Acquiring lock "5d100a08-eaf2-4132-87dd-a8dcfe17f68f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:45:37 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-c5b1a037-3279-4f57-8ce9-c698ba664839 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Lock "5d100a08-eaf2-4132-87dd-a8dcfe17f68f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:45:37 user nova-compute[73572]: DEBUG nova.objects.instance [None req-c5b1a037-3279-4f57-8ce9-c698ba664839 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Lazy-loading 'flavor' on Instance uuid 5d100a08-eaf2-4132-87dd-a8dcfe17f68f {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:45:37 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-c5b1a037-3279-4f57-8ce9-c698ba664839 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Lock "5d100a08-eaf2-4132-87dd-a8dcfe17f68f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:45:37 user nova-compute[73572]: DEBUG nova.network.neutron [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] [instance: 5d100a08-eaf2-4132-87dd-a8dcfe17f68f] Updating instance_info_cache with network_info: [{"id": "efe52e67-0439-4035-988e-daae3acfc823", "address": "fa:16:3e:68:58:83", "network": {"id": "598e1cfa-caaf-470c-ac5a-e91aa2611d1f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1541764581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08b110acd72c427db0de4e98d05f5e56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefe52e67-04", "ovs_interfaceid": "efe52e67-0439-4035-988e-daae3acfc823", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:45:37 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Releasing lock "refresh_cache-5d100a08-eaf2-4132-87dd-a8dcfe17f68f" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:45:37 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] [instance: 5d100a08-eaf2-4132-87dd-a8dcfe17f68f] Updated the network info_cache for instance {{(pid=73572) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 10:45:37 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-c5b1a037-3279-4f57-8ce9-c698ba664839 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Acquiring lock "5d100a08-eaf2-4132-87dd-a8dcfe17f68f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:45:37 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-c5b1a037-3279-4f57-8ce9-c698ba664839 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Lock "5d100a08-eaf2-4132-87dd-a8dcfe17f68f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:45:37 user nova-compute[73572]: INFO nova.compute.manager [None req-c5b1a037-3279-4f57-8ce9-c698ba664839 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] [instance: 5d100a08-eaf2-4132-87dd-a8dcfe17f68f] Attaching volume 74938b21-6029-4218-b4b7-6c7e6801005f to /dev/vdb
Aug 26 10:45:37 user nova-compute[73572]: DEBUG os_brick.utils [None req-c5b1a037-3279-4f57-8ce9-c698ba664839 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 10:45:37 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:45:37 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:45:37 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[76ddb3d4-062f-404e-8948-d0a4dfdd7b19]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:de8a79ed912\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:45:37 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:45:37 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:45:37 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb013391-17ae-49e7-82e2-abbe0dc85932]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:45:37 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:45:37 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:45:37 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[38e6e6c4-64bb-4ecd-8a74-d5e54b491c60]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:45:37 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce41c9c3-e5b5-41d7-97ad-21d7e69fe5a9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:45:37 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-c5b1a037-3279-4f57-8ce9-c698ba664839 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Running cmd (subprocess): nvme version {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:45:37 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-c5b1a037-3279-4f57-8ce9-c698ba664839 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] 'nvme version' failed. Not Retrying. {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 10:45:37 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c5b1a037-3279-4f57-8ce9-c698ba664839 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] nvme not present on system {{(pid=73572) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 10:45:37 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:45:37 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 10:45:37 user nova-compute[73572]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 10:45:37 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8a89cbd-5ff6-46bd-83bc-adbd7106b921]: (4, '') {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:45:37 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.lightos [None req-c5b1a037-3279-4f57-8ce9-c698ba664839 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73572) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 10:45:37 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.lightos [None req-c5b1a037-3279-4f57-8ce9-c698ba664839 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73572) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 10:45:37 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.lightos [None req-c5b1a037-3279-4f57-8ce9-c698ba664839 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] LIGHTOS: no hostnqn found. {{(pid=73572) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 10:45:37 user nova-compute[73572]: DEBUG os_brick.utils [None req-c5b1a037-3279-4f57-8ce9-c698ba664839 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:de8a79ed912', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 10:45:37 user nova-compute[73572]: DEBUG nova.virt.block_device [None req-c5b1a037-3279-4f57-8ce9-c698ba664839 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] [instance: 5d100a08-eaf2-4132-87dd-a8dcfe17f68f] Updating existing volume attachment record: 29f1e0fe-b1fb-4510-adb6-e524df39deb2 {{(pid=73572) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 10:45:38 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:45:40 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:45:43 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:45:43 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:45:43 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:45:44 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:45:44 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:45:44 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73572) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 10:45:45 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:45:45 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:45:45 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:45:45 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:45:45 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Auditing locally available compute resources for user (node: user) {{(pid=73572) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 10:45:45 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d100a08-eaf2-4132-87dd-a8dcfe17f68f/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:45:46 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d100a08-eaf2-4132-87dd-a8dcfe17f68f/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:45:46 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d100a08-eaf2-4132-87dd-a8dcfe17f68f/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:45:46 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d100a08-eaf2-4132-87dd-a8dcfe17f68f/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:45:46 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:45:46 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:45:46 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Hypervisor/Node resource view: name=user free_ram=8711MB free_disk=25.141109466552734GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=73572) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 10:45:46 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:45:46 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:45:46 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance 5d100a08-eaf2-4132-87dd-a8dcfe17f68f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:45:46 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73572) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 10:45:46 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73572) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 10:45:46 user nova-compute[73572]: DEBUG nova.compute.provider_tree [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Inventory has not changed in ProviderTree for provider: e2cec974-59b2-4c77-a53d-a7f4e5a30d75 {{(pid=73572) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 10:45:46 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Inventory has not changed for provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73572) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 10:45:46 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Compute_service record updated for user:user {{(pid=73572) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 10:45:46 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.163s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:45:48 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:45:48 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c5b1a037-3279-4f57-8ce9-c698ba664839 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] [instance: 5d100a08-eaf2-4132-87dd-a8dcfe17f68f] Calling os-brick to attach iSCSI Volume {{(pid=73572) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 10:45:48 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5b1a037-3279-4f57-8ce9-c698ba664839 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc89c3d6a10>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:74938b21-6029-4218-b4b7-6c7e6801005f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RynLoxTN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 10:45:48 user nova-compute[73572]: WARNING os_brick.initiator.connectors.base [None req-c5b1a037-3279-4f57-8ce9-c698ba664839 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 10:45:48 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-c5b1a037-3279-4f57-8ce9-c698ba664839 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 10:45:48 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-c5b1a037-3279-4f57-8ce9-c698ba664839 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 10:45:48 user nova-compute[73572]: WARNING os_brick.initiator.connectors.base [None req-c5b1a037-3279-4f57-8ce9-c698ba664839 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 10:45:48 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-c5b1a037-3279-4f57-8ce9-c698ba664839 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:74938b21-6029-4218-b4b7-6c7e6801005f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 10:45:48 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-c5b1a037-3279-4f57-8ce9-c698ba664839 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:74938b21-6029-4218-b4b7-6c7e6801005f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 10:45:48 user nova-compute[73572]: INFO os_brick.initiator.connectors.iscsi [None req-c5b1a037-3279-4f57-8ce9-c698ba664839 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 10:45:48 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74938b21-6029-4218-b4b7-6c7e6801005f -p 172.16.0.220:3260 {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:45:48 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74938b21-6029-4218-b4b7-6c7e6801005f -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:45:48 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[87f5d3fc-b663-4a8e-bf11-fe5a20b189a8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:45:48 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5b1a037-3279-4f57-8ce9-c698ba664839 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 10:45:48 user nova-compute[73572]:  {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:45:48 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74938b21-6029-4218-b4b7-6c7e6801005f -p 172.16.0.220:3260 --interface default --op new {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:45:48 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74938b21-6029-4218-b4b7-6c7e6801005f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:45:48 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3001bf3-3254-4396-8601-18456c574a6f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:74938b21-6029-4218-b4b7-6c7e6801005f] added\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:45:48 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5b1a037-3279-4f57-8ce9-c698ba664839 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:74938b21-6029-4218-b4b7-6c7e6801005f] added
Aug 26 10:45:48 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:45:48 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74938b21-6029-4218-b4b7-6c7e6801005f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:45:48 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74938b21-6029-4218-b4b7-6c7e6801005f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:45:48 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2d3b030-f6f5-46f6-95b7-69c8a7b52c8f]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:45:48 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5b1a037-3279-4f57-8ce9-c698ba664839 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:45:48 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74938b21-6029-4218-b4b7-6c7e6801005f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:45:48 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74938b21-6029-4218-b4b7-6c7e6801005f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:45:48 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[91f75ceb-1d64-43f4-9f41-0fd55f60e3f5]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:45:48 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5b1a037-3279-4f57-8ce9-c698ba664839 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:45:48 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74938b21-6029-4218-b4b7-6c7e6801005f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RynLoxTN {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:45:48 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74938b21-6029-4218-b4b7-6c7e6801005f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RynLoxTN" returned: 0 in 0.018s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:45:48 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[7acf528a-2797-4ab8-9540-c3edbcbf72bb]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:45:48 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5b1a037-3279-4f57-8ce9-c698ba664839 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RynLoxTN'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:45:48 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74938b21-6029-4218-b4b7-6c7e6801005f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:45:48 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74938b21-6029-4218-b4b7-6c7e6801005f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:45:48 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[65f2fc84-cdf4-4c91-b521-e552e466b298]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:45:48 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5b1a037-3279-4f57-8ce9-c698ba664839 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:45:48 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:45:48 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:45:48 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[38936875-0160-420d-b621-bf85cfcdb8ed]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:45:48 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5b1a037-3279-4f57-8ce9-c698ba664839 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 26 10:45:48 user nova-compute[73572]:  {{(pid=73572) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 10:45:48 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5b1a037-3279-4f57-8ce9-c698ba664839 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 26 10:45:48 user nova-compute[73572]:  {{(pid=73572) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 10:45:48 user nova-compute[73572]: WARNING os_brick.initiator.connectors.iscsi [None req-c5b1a037-3279-4f57-8ce9-c698ba664839 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 26 10:45:48 user nova-compute[73572]: 
Aug 26 10:45:48 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74938b21-6029-4218-b4b7-6c7e6801005f -p 172.16.0.220:3260 --login {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:45:48 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74938b21-6029-4218-b4b7-6c7e6801005f -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:45:48 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ef33f82-08d0-4b8c-8702-b897ebeb5dd1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:74938b21-6029-4218-b4b7-6c7e6801005f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:74938b21-6029-4218-b4b7-6c7e6801005f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:45:48 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5b1a037-3279-4f57-8ce9-c698ba664839 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:74938b21-6029-4218-b4b7-6c7e6801005f, portal: 172.16.0.220,3260]
Aug 26 10:45:48 user nova-compute[73572]: Login to [iface: default, target: iqn.2010-10.org.openstack:74938b21-6029-4218-b4b7-6c7e6801005f, portal: 172.16.0.220,3260] successful.
Aug 26 10:45:48 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:45:48 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74938b21-6029-4218-b4b7-6c7e6801005f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:45:48 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74938b21-6029-4218-b4b7-6c7e6801005f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:45:48 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[a887ddc0-cb4e-4197-a8ac-7c9b45a52a26]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:45:48 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5b1a037-3279-4f57-8ce9-c698ba664839 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:45:48 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:45:48 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:45:48 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0d9b8af-8daf-4762-9529-53132896c3f0]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74938b21-6029-4218-b4b7-6c7e6801005f (non-flash)\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:45:48 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5b1a037-3279-4f57-8ce9-c698ba664839 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74938b21-6029-4218-b4b7-6c7e6801005f (non-flash)
Aug 26 10:45:48 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 10:45:48 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5b1a037-3279-4f57-8ce9-c698ba664839 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74938b21-6029-4218-b4b7-6c7e6801005f (non-flash)
Aug 26 10:45:48 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 10:45:48 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-c5b1a037-3279-4f57-8ce9-c698ba664839 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:74938b21-6029-4218-b4b7-6c7e6801005f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.242s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 10:45:48 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5b1a037-3279-4f57-8ce9-c698ba664839 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Connected to 172.16.0.220:3260 {{(pid=73572) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 10:45:48 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-c5b1a037-3279-4f57-8ce9-c698ba664839 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] HCTL ('33', '-', '-', 0) found on session 60 with lun 0 {{(pid=73572) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 10:45:48 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-c5b1a037-3279-4f57-8ce9-c698ba664839 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73572) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 10:45:48 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:45:48 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:45:48 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9a3c215-6561-4e5e-b512-fc100479a7a9]: (4, ('- - 0', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:45:48 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-c5b1a037-3279-4f57-8ce9-c698ba664839 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Searching for a device in session 60 and hctl ['33', '*', '*', 0] yield: None {{(pid=73572) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 10:45:48 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:45:49 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-c5b1a037-3279-4f57-8ce9-c698ba664839 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Searching for a device in session 60 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73572) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 10:45:49 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5b1a037-3279-4f57-8ce9-c698ba664839 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RynLoxTN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73572) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 10:45:49 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-c5b1a037-3279-4f57-8ce9-c698ba664839 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.271s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 10:45:49 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5b1a037-3279-4f57-8ce9-c698ba664839 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] <== connect_volume: return (1273ms) {'type': 'block', 'scsi_wwn': '23337383964393934', 'path': '/dev/sdb'} {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 10:45:49 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c5b1a037-3279-4f57-8ce9-c698ba664839 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] [instance: 5d100a08-eaf2-4132-87dd-a8dcfe17f68f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23337383964393934', 'path': '/dev/sdb'} {{(pid=73572) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 10:45:49 user nova-compute[73572]: DEBUG nova.objects.instance [None req-c5b1a037-3279-4f57-8ce9-c698ba664839 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Lazy-loading 'flavor' on Instance uuid 5d100a08-eaf2-4132-87dd-a8dcfe17f68f {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:45:49 user nova-compute[73572]: DEBUG nova.virt.libvirt.guest [None req-c5b1a037-3279-4f57-8ce9-c698ba664839 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 10:45:49 user nova-compute[73572]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 10:45:49 user nova-compute[73572]:   <source dev="/dev/sdb"/>
Aug 26 10:45:49 user nova-compute[73572]:   <target dev="vdb" bus="virtio"/>
Aug 26 10:45:49 user nova-compute[73572]:   <serial>74938b21-6029-4218-b4b7-6c7e6801005f</serial>
Aug 26 10:45:49 user nova-compute[73572]: </disk>
Aug 26 10:45:49 user nova-compute[73572]:  {{(pid=73572) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 10:45:50 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-c5b1a037-3279-4f57-8ce9-c698ba664839 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] No BDM found with device name vda, not building metadata. {{(pid=73572) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 10:45:50 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-c5b1a037-3279-4f57-8ce9-c698ba664839 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73572) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 10:45:50 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-c5b1a037-3279-4f57-8ce9-c698ba664839 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] No VIF found with MAC fa:16:3e:68:58:83, not building metadata {{(pid=73572) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 10:45:50 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-c5b1a037-3279-4f57-8ce9-c698ba664839 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Lock "5d100a08-eaf2-4132-87dd-a8dcfe17f68f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.725s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:45:50 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:45:51 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:45:51 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9a71dc3c-1d0f-4172-9919-1add65ea6ab7 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Acquiring lock "5d100a08-eaf2-4132-87dd-a8dcfe17f68f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:45:51 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9a71dc3c-1d0f-4172-9919-1add65ea6ab7 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Lock "5d100a08-eaf2-4132-87dd-a8dcfe17f68f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:45:51 user nova-compute[73572]: INFO nova.compute.manager [None req-9a71dc3c-1d0f-4172-9919-1add65ea6ab7 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] [instance: 5d100a08-eaf2-4132-87dd-a8dcfe17f68f] Detaching volume 74938b21-6029-4218-b4b7-6c7e6801005f
Aug 26 10:45:52 user nova-compute[73572]: INFO nova.virt.block_device [None req-9a71dc3c-1d0f-4172-9919-1add65ea6ab7 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] [instance: 5d100a08-eaf2-4132-87dd-a8dcfe17f68f] Attempting to driver detach volume 74938b21-6029-4218-b4b7-6c7e6801005f from mountpoint /dev/vdb
Aug 26 10:45:52 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-9a71dc3c-1d0f-4172-9919-1add65ea6ab7 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Attempting to detach device vdb from instance 5d100a08-eaf2-4132-87dd-a8dcfe17f68f from the persistent domain config. {{(pid=73572) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 10:45:52 user nova-compute[73572]: DEBUG nova.virt.libvirt.guest [None req-9a71dc3c-1d0f-4172-9919-1add65ea6ab7 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 10:45:52 user nova-compute[73572]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 10:45:52 user nova-compute[73572]:   <source dev="/dev/sdb"/>
Aug 26 10:45:52 user nova-compute[73572]:   <target dev="vdb" bus="virtio"/>
Aug 26 10:45:52 user nova-compute[73572]:   <serial>74938b21-6029-4218-b4b7-6c7e6801005f</serial>
Aug 26 10:45:52 user nova-compute[73572]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 10:45:52 user nova-compute[73572]: </disk>
Aug 26 10:45:52 user nova-compute[73572]:  {{(pid=73572) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 10:45:52 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-9a71dc3c-1d0f-4172-9919-1add65ea6ab7 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Successfully detached device vdb from instance 5d100a08-eaf2-4132-87dd-a8dcfe17f68f from the persistent domain config.
Aug 26 10:45:52 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-9a71dc3c-1d0f-4172-9919-1add65ea6ab7 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5d100a08-eaf2-4132-87dd-a8dcfe17f68f from the live domain config. {{(pid=73572) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 10:45:52 user nova-compute[73572]: DEBUG nova.virt.libvirt.guest [None req-9a71dc3c-1d0f-4172-9919-1add65ea6ab7 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 10:45:52 user nova-compute[73572]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 10:45:52 user nova-compute[73572]:   <source dev="/dev/sdb"/>
Aug 26 10:45:52 user nova-compute[73572]:   <target dev="vdb" bus="virtio"/>
Aug 26 10:45:52 user nova-compute[73572]:   <serial>74938b21-6029-4218-b4b7-6c7e6801005f</serial>
Aug 26 10:45:52 user nova-compute[73572]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 10:45:52 user nova-compute[73572]: </disk>
Aug 26 10:45:52 user nova-compute[73572]:  {{(pid=73572) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 10:45:52 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Received event <DeviceRemovedEvent: 1693046752.5146377, 5d100a08-eaf2-4132-87dd-a8dcfe17f68f => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73572) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 10:45:52 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-9a71dc3c-1d0f-4172-9919-1add65ea6ab7 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5d100a08-eaf2-4132-87dd-a8dcfe17f68f {{(pid=73572) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 10:45:52 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-9a71dc3c-1d0f-4172-9919-1add65ea6ab7 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Successfully detached device vdb from instance 5d100a08-eaf2-4132-87dd-a8dcfe17f68f from the live domain config.
Aug 26 10:45:52 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9a71dc3c-1d0f-4172-9919-1add65ea6ab7 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] [instance: 5d100a08-eaf2-4132-87dd-a8dcfe17f68f] calling os-brick to detach iSCSI Volume {{(pid=73572) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 10:45:52 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a71dc3c-1d0f-4172-9919-1add65ea6ab7 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc89c3d6a10>, {'target_iqns': ['iqn.2010-10.org.openstack:74938b21-6029-4218-b4b7-6c7e6801005f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RynLoxTN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 10:45:52 user nova-compute[73572]: WARNING os_brick.initiator.connectors.base [None req-9a71dc3c-1d0f-4172-9919-1add65ea6ab7 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 10:45:52 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-9a71dc3c-1d0f-4172-9919-1add65ea6ab7 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 10:45:52 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-9a71dc3c-1d0f-4172-9919-1add65ea6ab7 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 10:45:52 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a71dc3c-1d0f-4172-9919-1add65ea6ab7 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:74938b21-6029-4218-b4b7-6c7e6801005f', 0)] {{(pid=73572) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 10:45:52 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:45:52 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:45:52 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[720bbcb0-629d-40e8-a86b-f31f60fb06e9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:74938b21-6029-4218-b4b7-6c7e6801005f\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:45:52 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:45:52 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:45:52 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[96e1dccd-af07-45b5-8909-d55873cf6247]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74938b21-6029-4218-b4b7-6c7e6801005f (non-flash)\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:45:52 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a71dc3c-1d0f-4172-9919-1add65ea6ab7 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74938b21-6029-4218-b4b7-6c7e6801005f (non-flash)
Aug 26 10:45:52 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 10:45:52 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a71dc3c-1d0f-4172-9919-1add65ea6ab7 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74938b21-6029-4218-b4b7-6c7e6801005f (non-flash)
Aug 26 10:45:52 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 10:45:52 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a71dc3c-1d0f-4172-9919-1add65ea6ab7 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc878bf0a60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:74938b21-6029-4218-b4b7-6c7e6801005f'): ({'sdb'}, set())}) {{(pid=73572) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 10:45:52 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-9a71dc3c-1d0f-4172-9919-1add65ea6ab7 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Removing single pathed devices sdb {{(pid=73572) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 10:45:52 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:45:52 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:45:52 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[98847885-12f6-4838-a156-f173aaac7878]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:45:52 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:45:52 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:45:52 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[4945a408-5de5-44fc-a20c-23a11e7214b6]: (4, ('ok\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:45:52 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-9a71dc3c-1d0f-4172-9919-1add65ea6ab7 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Flushing IO for device /dev/sdb {{(pid=73572) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 10:45:52 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:45:52 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:45:52 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c743238-b01f-4b44-b12a-cdc36b06350a]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:45:52 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-9a71dc3c-1d0f-4172-9919-1add65ea6ab7 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73572) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 10:45:52 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:45:52 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:45:52 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[eed0b268-8e2c-4e3d-a49a-3ffb546b1bc8]: (4, ('1', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:45:52 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-9a71dc3c-1d0f-4172-9919-1add65ea6ab7 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73572) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 10:45:52 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-9a71dc3c-1d0f-4172-9919-1add65ea6ab7 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] SCSI volumes sdb have been removed. {{(pid=73572) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 10:45:52 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a71dc3c-1d0f-4172-9919-1add65ea6ab7 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:74938b21-6029-4218-b4b7-6c7e6801005f')] {{(pid=73572) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 10:45:52 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74938b21-6029-4218-b4b7-6c7e6801005f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:45:52 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74938b21-6029-4218-b4b7-6c7e6801005f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:45:52 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[597dfc42-babd-4d91-8390-4876d785d59d]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:45:52 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a71dc3c-1d0f-4172-9919-1add65ea6ab7 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:45:52 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74938b21-6029-4218-b4b7-6c7e6801005f -p 172.16.0.220:3260 --logout {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:45:52 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74938b21-6029-4218-b4b7-6c7e6801005f -p 172.16.0.220:3260 --logout" returned: 0 in 0.044s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:45:52 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fac2abf-c23b-47b1-967f-82efc6b2a448]: (4, ('Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:74938b21-6029-4218-b4b7-6c7e6801005f, portal: 172.16.0.220,3260]\nLogout of [sid: 60, target: iqn.2010-10.org.openstack:74938b21-6029-4218-b4b7-6c7e6801005f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:45:52 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a71dc3c-1d0f-4172-9919-1add65ea6ab7 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:74938b21-6029-4218-b4b7-6c7e6801005f, portal: 172.16.0.220,3260]
Aug 26 10:45:52 user nova-compute[73572]: Logout of [sid: 60, target: iqn.2010-10.org.openstack:74938b21-6029-4218-b4b7-6c7e6801005f, portal: 172.16.0.220,3260] successful.
Aug 26 10:45:52 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:45:52 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74938b21-6029-4218-b4b7-6c7e6801005f -p 172.16.0.220:3260 --op delete {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:45:52 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74938b21-6029-4218-b4b7-6c7e6801005f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:45:52 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[dba5ef75-0787-4499-b153-56c574bec6b2]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:45:52 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a71dc3c-1d0f-4172-9919-1add65ea6ab7 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:45:52 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-9a71dc3c-1d0f-4172-9919-1add65ea6ab7 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.245s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 10:45:52 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a71dc3c-1d0f-4172-9919-1add65ea6ab7 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] <== disconnect_volume: return (247ms) None {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 10:45:52 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9a71dc3c-1d0f-4172-9919-1add65ea6ab7 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] [instance: 5d100a08-eaf2-4132-87dd-a8dcfe17f68f] Disconnected iSCSI Volume {{(pid=73572) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 10:45:53 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:45:53 user nova-compute[73572]: DEBUG nova.objects.instance [None req-9a71dc3c-1d0f-4172-9919-1add65ea6ab7 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Lazy-loading 'flavor' on Instance uuid 5d100a08-eaf2-4132-87dd-a8dcfe17f68f {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:45:53 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9a71dc3c-1d0f-4172-9919-1add65ea6ab7 tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Lock "5d100a08-eaf2-4132-87dd-a8dcfe17f68f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.571s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:45:55 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:45:58 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:46:03 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:46:08 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:46:08 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:46:08 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73572) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 10:46:08 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73572) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 10:46:08 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73572) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 10:46:08 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:46:08 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:46:10 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:46:13 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:46:14 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:46:18 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:46:23 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:46:28 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:46:33 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:46:33 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:46:33 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73572) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 10:46:33 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73572) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 10:46:33 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73572) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 10:46:33 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:46:35 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:46:36 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:46:38 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:46:38 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:46:38 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73572) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 10:46:38 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73572) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 10:46:38 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73572) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 10:46:38 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:46:38 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:46:38 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Starting heal instance info cache {{(pid=73572) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 10:46:38 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Rebuilding the list of instances to heal {{(pid=73572) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 10:46:38 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquiring lock "refresh_cache-5d100a08-eaf2-4132-87dd-a8dcfe17f68f" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:46:38 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquired lock "refresh_cache-5d100a08-eaf2-4132-87dd-a8dcfe17f68f" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:46:38 user nova-compute[73572]: DEBUG nova.network.neutron [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] [instance: 5d100a08-eaf2-4132-87dd-a8dcfe17f68f] Forcefully refreshing network info cache for instance {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 10:46:38 user nova-compute[73572]: DEBUG nova.objects.instance [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lazy-loading 'info_cache' on Instance uuid 5d100a08-eaf2-4132-87dd-a8dcfe17f68f {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:46:39 user nova-compute[73572]: DEBUG nova.network.neutron [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] [instance: 5d100a08-eaf2-4132-87dd-a8dcfe17f68f] Updating instance_info_cache with network_info: [{"id": "efe52e67-0439-4035-988e-daae3acfc823", "address": "fa:16:3e:68:58:83", "network": {"id": "598e1cfa-caaf-470c-ac5a-e91aa2611d1f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1541764581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08b110acd72c427db0de4e98d05f5e56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefe52e67-04", "ovs_interfaceid": "efe52e67-0439-4035-988e-daae3acfc823", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:46:39 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Releasing lock "refresh_cache-5d100a08-eaf2-4132-87dd-a8dcfe17f68f" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:46:39 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] [instance: 5d100a08-eaf2-4132-87dd-a8dcfe17f68f] Updated the network info_cache for instance {{(pid=73572) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 10:46:43 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:46:43 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:46:45 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:46:45 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:46:45 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:46:45 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:46:45 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Auditing locally available compute resources for user (node: user) {{(pid=73572) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 10:46:45 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d100a08-eaf2-4132-87dd-a8dcfe17f68f/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:46:46 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d100a08-eaf2-4132-87dd-a8dcfe17f68f/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:46:46 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d100a08-eaf2-4132-87dd-a8dcfe17f68f/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:46:46 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d100a08-eaf2-4132-87dd-a8dcfe17f68f/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:46:46 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:46:46 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:46:46 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Hypervisor/Node resource view: name=user free_ram=8723MB free_disk=25.138996124267578GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=73572) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 10:46:46 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:46:46 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:46:46 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance 5d100a08-eaf2-4132-87dd-a8dcfe17f68f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:46:46 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73572) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 10:46:46 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73572) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 10:46:46 user nova-compute[73572]: DEBUG nova.compute.provider_tree [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Inventory has not changed in ProviderTree for provider: e2cec974-59b2-4c77-a53d-a7f4e5a30d75 {{(pid=73572) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 10:46:46 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Inventory has not changed for provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73572) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 10:46:46 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Compute_service record updated for user:user {{(pid=73572) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 10:46:46 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.170s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:46:47 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:46:47 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:46:47 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:46:47 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73572) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 10:46:48 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:46:50 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-0de08b4c-d7fd-478b-9077-62518348225e tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Acquiring lock "5d100a08-eaf2-4132-87dd-a8dcfe17f68f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:46:50 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-0de08b4c-d7fd-478b-9077-62518348225e tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Lock "5d100a08-eaf2-4132-87dd-a8dcfe17f68f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:46:50 user nova-compute[73572]: DEBUG nova.objects.instance [None req-0de08b4c-d7fd-478b-9077-62518348225e tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Lazy-loading 'flavor' on Instance uuid 5d100a08-eaf2-4132-87dd-a8dcfe17f68f {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:46:50 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-0de08b4c-d7fd-478b-9077-62518348225e tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Lock "5d100a08-eaf2-4132-87dd-a8dcfe17f68f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:46:50 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-0de08b4c-d7fd-478b-9077-62518348225e tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Acquiring lock "5d100a08-eaf2-4132-87dd-a8dcfe17f68f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:46:50 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-0de08b4c-d7fd-478b-9077-62518348225e tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Lock "5d100a08-eaf2-4132-87dd-a8dcfe17f68f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:46:50 user nova-compute[73572]: INFO nova.compute.manager [None req-0de08b4c-d7fd-478b-9077-62518348225e tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] [instance: 5d100a08-eaf2-4132-87dd-a8dcfe17f68f] Attaching volume 7a40e4cf-48b3-471e-aa18-25f5c0ad305e to /dev/vdb
Aug 26 10:46:50 user nova-compute[73572]: DEBUG os_brick.utils [None req-0de08b4c-d7fd-478b-9077-62518348225e tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 10:46:50 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:46:50 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:46:50 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6a43d4c-709e-44ec-845f-b13832830381]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:de8a79ed912\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:46:50 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:46:50 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:46:50 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[69e85f80-1ac5-449d-8fed-3923d61ed46e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:46:50 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:46:50 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:46:50 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[fffae6b6-299d-4768-bd11-114b2b47e27b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:46:50 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fe0d256-73b4-4f46-9291-b69df7544a90]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:46:50 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-0de08b4c-d7fd-478b-9077-62518348225e tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Running cmd (subprocess): nvme version {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:46:50 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-0de08b4c-d7fd-478b-9077-62518348225e tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] 'nvme version' failed. Not Retrying. {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 10:46:50 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0de08b4c-d7fd-478b-9077-62518348225e tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] nvme not present on system {{(pid=73572) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 10:46:50 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:46:50 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 10:46:50 user nova-compute[73572]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 10:46:50 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[8be22f32-7867-4726-a805-94154a7f85a1]: (4, '') {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:46:50 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.lightos [None req-0de08b4c-d7fd-478b-9077-62518348225e tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73572) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 10:46:50 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.lightos [None req-0de08b4c-d7fd-478b-9077-62518348225e tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73572) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 10:46:50 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.lightos [None req-0de08b4c-d7fd-478b-9077-62518348225e tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] LIGHTOS: no hostnqn found. {{(pid=73572) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 10:46:50 user nova-compute[73572]: DEBUG os_brick.utils [None req-0de08b4c-d7fd-478b-9077-62518348225e tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:de8a79ed912', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 10:46:50 user nova-compute[73572]: DEBUG nova.virt.block_device [None req-0de08b4c-d7fd-478b-9077-62518348225e tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] [instance: 5d100a08-eaf2-4132-87dd-a8dcfe17f68f] Updating existing volume attachment record: cdc02a59-3c9a-465e-944e-5cde3e03e68f {{(pid=73572) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 10:46:50 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:46:51 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:46:53 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:46:58 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:47:00 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0de08b4c-d7fd-478b-9077-62518348225e tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] [instance: 5d100a08-eaf2-4132-87dd-a8dcfe17f68f] Calling os-brick to attach iSCSI Volume {{(pid=73572) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 10:47:00 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-0de08b4c-d7fd-478b-9077-62518348225e tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc89c3d6a10>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:7a40e4cf-48b3-471e-aa18-25f5c0ad305e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'grUqIweF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 10:47:00 user nova-compute[73572]: WARNING os_brick.initiator.connectors.base [None req-0de08b4c-d7fd-478b-9077-62518348225e tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 10:47:00 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-0de08b4c-d7fd-478b-9077-62518348225e tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 10:47:00 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-0de08b4c-d7fd-478b-9077-62518348225e tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 10:47:00 user nova-compute[73572]: WARNING os_brick.initiator.connectors.base [None req-0de08b4c-d7fd-478b-9077-62518348225e tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 10:47:00 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-0de08b4c-d7fd-478b-9077-62518348225e tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7a40e4cf-48b3-471e-aa18-25f5c0ad305e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 10:47:00 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-0de08b4c-d7fd-478b-9077-62518348225e tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7a40e4cf-48b3-471e-aa18-25f5c0ad305e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 10:47:00 user nova-compute[73572]: INFO os_brick.initiator.connectors.iscsi [None req-0de08b4c-d7fd-478b-9077-62518348225e tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 10:47:00 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a40e4cf-48b3-471e-aa18-25f5c0ad305e -p 172.16.0.220:3260 {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:47:00 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a40e4cf-48b3-471e-aa18-25f5c0ad305e -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:47:00 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f399725-bc93-4521-b608-794133e0c37d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:47:00 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-0de08b4c-d7fd-478b-9077-62518348225e tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 10:47:00 user nova-compute[73572]:  {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:47:00 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a40e4cf-48b3-471e-aa18-25f5c0ad305e -p 172.16.0.220:3260 --interface default --op new {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:47:00 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a40e4cf-48b3-471e-aa18-25f5c0ad305e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:47:00 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[175ae92a-ce10-479e-9c3f-5d9130733e1b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7a40e4cf-48b3-471e-aa18-25f5c0ad305e] added\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:47:00 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-0de08b4c-d7fd-478b-9077-62518348225e tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7a40e4cf-48b3-471e-aa18-25f5c0ad305e] added
Aug 26 10:47:00 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:47:00 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a40e4cf-48b3-471e-aa18-25f5c0ad305e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:47:00 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a40e4cf-48b3-471e-aa18-25f5c0ad305e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:47:00 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a560970-38a2-4f1d-b89a-1ff61f4f8b4c]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:47:00 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-0de08b4c-d7fd-478b-9077-62518348225e tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:47:00 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a40e4cf-48b3-471e-aa18-25f5c0ad305e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:47:00 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a40e4cf-48b3-471e-aa18-25f5c0ad305e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:47:00 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[aae8256d-46bd-473b-9c21-f34fbade4f03]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:47:00 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-0de08b4c-d7fd-478b-9077-62518348225e tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:47:00 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a40e4cf-48b3-471e-aa18-25f5c0ad305e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v grUqIweF {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:47:00 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a40e4cf-48b3-471e-aa18-25f5c0ad305e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v grUqIweF" returned: 0 in 0.018s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:47:00 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe153639-3ab6-4bd4-814b-cf8c65043575]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:47:00 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-0de08b4c-d7fd-478b-9077-62518348225e tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'grUqIweF'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:47:00 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a40e4cf-48b3-471e-aa18-25f5c0ad305e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:47:00 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a40e4cf-48b3-471e-aa18-25f5c0ad305e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:47:00 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ce4366c-baae-4eb8-97cf-4cf91c3ca828]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:47:00 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-0de08b4c-d7fd-478b-9077-62518348225e tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:47:00 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:47:00 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:47:00 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6549714-9a60-45a7-8b80-eba3f5d4350a]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:47:00 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-0de08b4c-d7fd-478b-9077-62518348225e tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 26 10:47:00 user nova-compute[73572]:  {{(pid=73572) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 10:47:00 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-0de08b4c-d7fd-478b-9077-62518348225e tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 26 10:47:00 user nova-compute[73572]:  {{(pid=73572) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 10:47:00 user nova-compute[73572]: WARNING os_brick.initiator.connectors.iscsi [None req-0de08b4c-d7fd-478b-9077-62518348225e tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 26 10:47:00 user nova-compute[73572]: 
Aug 26 10:47:00 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a40e4cf-48b3-471e-aa18-25f5c0ad305e -p 172.16.0.220:3260 --login {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:47:00 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a40e4cf-48b3-471e-aa18-25f5c0ad305e -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:47:00 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[4855cc34-ba9b-413b-b749-75525a85aa92]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7a40e4cf-48b3-471e-aa18-25f5c0ad305e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7a40e4cf-48b3-471e-aa18-25f5c0ad305e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:47:00 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-0de08b4c-d7fd-478b-9077-62518348225e tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7a40e4cf-48b3-471e-aa18-25f5c0ad305e, portal: 172.16.0.220,3260]
Aug 26 10:47:00 user nova-compute[73572]: Login to [iface: default, target: iqn.2010-10.org.openstack:7a40e4cf-48b3-471e-aa18-25f5c0ad305e, portal: 172.16.0.220,3260] successful.
Aug 26 10:47:00 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:47:00 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a40e4cf-48b3-471e-aa18-25f5c0ad305e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:47:00 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a40e4cf-48b3-471e-aa18-25f5c0ad305e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:47:00 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4ab22a6-c443-4e09-8d9f-7343cf3dff42]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:47:00 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-0de08b4c-d7fd-478b-9077-62518348225e tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:47:00 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:47:00 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:47:00 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc358467-70db-4619-ad24-90cc6f5e922e]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a40e4cf-48b3-471e-aa18-25f5c0ad305e (non-flash)\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:47:00 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-0de08b4c-d7fd-478b-9077-62518348225e tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a40e4cf-48b3-471e-aa18-25f5c0ad305e (non-flash)
Aug 26 10:47:00 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 10:47:00 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-0de08b4c-d7fd-478b-9077-62518348225e tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a40e4cf-48b3-471e-aa18-25f5c0ad305e (non-flash)
Aug 26 10:47:00 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 10:47:00 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-0de08b4c-d7fd-478b-9077-62518348225e tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7a40e4cf-48b3-471e-aa18-25f5c0ad305e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.270s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 10:47:00 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-0de08b4c-d7fd-478b-9077-62518348225e tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Connected to 172.16.0.220:3260 {{(pid=73572) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 10:47:00 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-0de08b4c-d7fd-478b-9077-62518348225e tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] HCTL ('33', '-', '-', 0) found on session 61 with lun 0 {{(pid=73572) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 10:47:00 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-0de08b4c-d7fd-478b-9077-62518348225e tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73572) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 10:47:00 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:47:00 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:47:00 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[7130c9c3-0cb7-4e60-ac4b-e8f0952d1770]: (4, ('- - 0', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:47:00 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-0de08b4c-d7fd-478b-9077-62518348225e tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Searching for a device in session 61 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73572) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 10:47:00 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-0de08b4c-d7fd-478b-9077-62518348225e tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'grUqIweF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73572) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 10:47:01 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-0de08b4c-d7fd-478b-9077-62518348225e tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.304s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 10:47:01 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-0de08b4c-d7fd-478b-9077-62518348225e tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] <== connect_volume: return (1306ms) {'type': 'block', 'scsi_wwn': '23461633361626362', 'path': '/dev/sdb'} {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 10:47:01 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0de08b4c-d7fd-478b-9077-62518348225e tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] [instance: 5d100a08-eaf2-4132-87dd-a8dcfe17f68f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23461633361626362', 'path': '/dev/sdb'} {{(pid=73572) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 10:47:01 user nova-compute[73572]: DEBUG nova.objects.instance [None req-0de08b4c-d7fd-478b-9077-62518348225e tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Lazy-loading 'flavor' on Instance uuid 5d100a08-eaf2-4132-87dd-a8dcfe17f68f {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:47:01 user nova-compute[73572]: DEBUG nova.virt.libvirt.guest [None req-0de08b4c-d7fd-478b-9077-62518348225e tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 10:47:01 user nova-compute[73572]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 10:47:01 user nova-compute[73572]:   <source dev="/dev/sdb"/>
Aug 26 10:47:01 user nova-compute[73572]:   <target dev="vdb" bus="virtio"/>
Aug 26 10:47:01 user nova-compute[73572]:   <serial>7a40e4cf-48b3-471e-aa18-25f5c0ad305e</serial>
Aug 26 10:47:01 user nova-compute[73572]: </disk>
Aug 26 10:47:01 user nova-compute[73572]:  {{(pid=73572) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 10:47:02 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-0de08b4c-d7fd-478b-9077-62518348225e tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] No BDM found with device name vda, not building metadata. {{(pid=73572) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 10:47:02 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-0de08b4c-d7fd-478b-9077-62518348225e tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73572) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 10:47:02 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-0de08b4c-d7fd-478b-9077-62518348225e tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] No VIF found with MAC fa:16:3e:68:58:83, not building metadata {{(pid=73572) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 10:47:02 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-0de08b4c-d7fd-478b-9077-62518348225e tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Lock "5d100a08-eaf2-4132-87dd-a8dcfe17f68f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.155s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:47:03 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:47:03 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:47:03 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73572) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 10:47:03 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73572) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 10:47:03 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73572) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 10:47:03 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:47:03 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:47:03 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:47:03 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:47:03 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:47:03 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:47:03 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:47:03 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:47:03 user nova-compute[73572]: DEBUG nova.virt.libvirt.imagecache [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Verify base images {{(pid=73572) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Aug 26 10:47:03 user nova-compute[73572]: DEBUG nova.virt.libvirt.imagecache [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Image id 299da0c9-e1c4-48f0-be55-fbe20dd06bc9 yields fingerprint 2099350d6f3bcd0de9471c73862d4fe75b049801 {{(pid=73572) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Aug 26 10:47:03 user nova-compute[73572]: INFO nova.virt.libvirt.imagecache [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] image 299da0c9-e1c4-48f0-be55-fbe20dd06bc9 at (/opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801): checking
Aug 26 10:47:03 user nova-compute[73572]: DEBUG nova.virt.libvirt.imagecache [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] image 299da0c9-e1c4-48f0-be55-fbe20dd06bc9 at (/opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801): image is in use {{(pid=73572) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Aug 26 10:47:03 user nova-compute[73572]: DEBUG nova.virt.libvirt.imagecache [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=73572) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Aug 26 10:47:03 user nova-compute[73572]: DEBUG nova.virt.libvirt.imagecache [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] 5d100a08-eaf2-4132-87dd-a8dcfe17f68f is a valid instance name {{(pid=73572) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Aug 26 10:47:03 user nova-compute[73572]: DEBUG nova.virt.libvirt.imagecache [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] 5d100a08-eaf2-4132-87dd-a8dcfe17f68f has a disk file {{(pid=73572) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Aug 26 10:47:03 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d100a08-eaf2-4132-87dd-a8dcfe17f68f/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:47:04 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d100a08-eaf2-4132-87dd-a8dcfe17f68f/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:47:04 user nova-compute[73572]: DEBUG nova.virt.libvirt.imagecache [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance 5d100a08-eaf2-4132-87dd-a8dcfe17f68f is backed by 2099350d6f3bcd0de9471c73862d4fe75b049801 {{(pid=73572) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Aug 26 10:47:04 user nova-compute[73572]: WARNING nova.virt.libvirt.imagecache [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Unknown base file: /opt/stack/data/nova/instances/_base/07206003e8abff675a157299cdd9d53c100accd6
Aug 26 10:47:04 user nova-compute[73572]: WARNING nova.virt.libvirt.imagecache [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Unknown base file: /opt/stack/data/nova/instances/_base/747d48e964c0676e8d4851cc87d91435f1032515
Aug 26 10:47:04 user nova-compute[73572]: WARNING nova.virt.libvirt.imagecache [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Unknown base file: /opt/stack/data/nova/instances/_base/856ce9f1ce221991f19ccb14996e0e14779d8b86
Aug 26 10:47:04 user nova-compute[73572]: WARNING nova.virt.libvirt.imagecache [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Unknown base file: /opt/stack/data/nova/instances/_base/b1630a0bd1f65b732f97e7fe5f0e33cb0595e9a3
Aug 26 10:47:04 user nova-compute[73572]: WARNING nova.virt.libvirt.imagecache [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Unknown base file: /opt/stack/data/nova/instances/_base/b7f12b3ebd3b1f7c2c0a0b6854287900df597183
Aug 26 10:47:04 user nova-compute[73572]: WARNING nova.virt.libvirt.imagecache [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Unknown base file: /opt/stack/data/nova/instances/_base/6a30f2d519f1cc16d403081c495de5f8aba77255
Aug 26 10:47:04 user nova-compute[73572]: WARNING nova.virt.libvirt.imagecache [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Unknown base file: /opt/stack/data/nova/instances/_base/5a6b07019ada95d7ee0a3913be7c9a514414b976
Aug 26 10:47:04 user nova-compute[73572]: WARNING nova.virt.libvirt.imagecache [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Unknown base file: /opt/stack/data/nova/instances/_base/185e949b7072af41e5f0cfe823069a60b504cffb
Aug 26 10:47:04 user nova-compute[73572]: WARNING nova.virt.libvirt.imagecache [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Unknown base file: /opt/stack/data/nova/instances/_base/681e5c5fd0998c6bda4aea7aa659ea4dda7e3951
Aug 26 10:47:04 user nova-compute[73572]: INFO nova.virt.libvirt.imagecache [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Active base files: /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801
Aug 26 10:47:04 user nova-compute[73572]: INFO nova.virt.libvirt.imagecache [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Removable base files: /opt/stack/data/nova/instances/_base/07206003e8abff675a157299cdd9d53c100accd6 /opt/stack/data/nova/instances/_base/747d48e964c0676e8d4851cc87d91435f1032515 /opt/stack/data/nova/instances/_base/856ce9f1ce221991f19ccb14996e0e14779d8b86 /opt/stack/data/nova/instances/_base/b1630a0bd1f65b732f97e7fe5f0e33cb0595e9a3 /opt/stack/data/nova/instances/_base/b7f12b3ebd3b1f7c2c0a0b6854287900df597183 /opt/stack/data/nova/instances/_base/6a30f2d519f1cc16d403081c495de5f8aba77255 /opt/stack/data/nova/instances/_base/5a6b07019ada95d7ee0a3913be7c9a514414b976 /opt/stack/data/nova/instances/_base/185e949b7072af41e5f0cfe823069a60b504cffb /opt/stack/data/nova/instances/_base/681e5c5fd0998c6bda4aea7aa659ea4dda7e3951
Aug 26 10:47:04 user nova-compute[73572]: INFO nova.virt.libvirt.imagecache [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/07206003e8abff675a157299cdd9d53c100accd6
Aug 26 10:47:04 user nova-compute[73572]: INFO nova.virt.libvirt.imagecache [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/747d48e964c0676e8d4851cc87d91435f1032515
Aug 26 10:47:04 user nova-compute[73572]: INFO nova.virt.libvirt.imagecache [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/856ce9f1ce221991f19ccb14996e0e14779d8b86
Aug 26 10:47:04 user nova-compute[73572]: INFO nova.virt.libvirt.imagecache [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/b1630a0bd1f65b732f97e7fe5f0e33cb0595e9a3
Aug 26 10:47:04 user nova-compute[73572]: INFO nova.virt.libvirt.imagecache [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/b7f12b3ebd3b1f7c2c0a0b6854287900df597183
Aug 26 10:47:04 user nova-compute[73572]: INFO nova.virt.libvirt.imagecache [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/6a30f2d519f1cc16d403081c495de5f8aba77255
Aug 26 10:47:04 user nova-compute[73572]: INFO nova.virt.libvirt.imagecache [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/5a6b07019ada95d7ee0a3913be7c9a514414b976
Aug 26 10:47:04 user nova-compute[73572]: INFO nova.virt.libvirt.imagecache [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/185e949b7072af41e5f0cfe823069a60b504cffb
Aug 26 10:47:04 user nova-compute[73572]: INFO nova.virt.libvirt.imagecache [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/681e5c5fd0998c6bda4aea7aa659ea4dda7e3951
Aug 26 10:47:04 user nova-compute[73572]: DEBUG nova.virt.libvirt.imagecache [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Verification complete {{(pid=73572) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Aug 26 10:47:04 user nova-compute[73572]: DEBUG nova.virt.libvirt.imagecache [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Verify swap images {{(pid=73572) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Aug 26 10:47:04 user nova-compute[73572]: DEBUG nova.virt.libvirt.imagecache [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Verify ephemeral images {{(pid=73572) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Aug 26 10:47:05 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-896d252a-8c3e-49c0-8956-73be0d2d3d4a tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Acquiring lock "5d100a08-eaf2-4132-87dd-a8dcfe17f68f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:47:05 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-896d252a-8c3e-49c0-8956-73be0d2d3d4a tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Lock "5d100a08-eaf2-4132-87dd-a8dcfe17f68f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:47:05 user nova-compute[73572]: INFO nova.compute.manager [None req-896d252a-8c3e-49c0-8956-73be0d2d3d4a tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] [instance: 5d100a08-eaf2-4132-87dd-a8dcfe17f68f] Detaching volume 7a40e4cf-48b3-471e-aa18-25f5c0ad305e
Aug 26 10:47:05 user nova-compute[73572]: INFO nova.virt.block_device [None req-896d252a-8c3e-49c0-8956-73be0d2d3d4a tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] [instance: 5d100a08-eaf2-4132-87dd-a8dcfe17f68f] Attempting to driver detach volume 7a40e4cf-48b3-471e-aa18-25f5c0ad305e from mountpoint /dev/vdb
Aug 26 10:47:05 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-896d252a-8c3e-49c0-8956-73be0d2d3d4a tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Attempting to detach device vdb from instance 5d100a08-eaf2-4132-87dd-a8dcfe17f68f from the persistent domain config. {{(pid=73572) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 10:47:05 user nova-compute[73572]: DEBUG nova.virt.libvirt.guest [None req-896d252a-8c3e-49c0-8956-73be0d2d3d4a tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 10:47:05 user nova-compute[73572]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 10:47:05 user nova-compute[73572]:   <source dev="/dev/sdb"/>
Aug 26 10:47:05 user nova-compute[73572]:   <target dev="vdb" bus="virtio"/>
Aug 26 10:47:05 user nova-compute[73572]:   <serial>7a40e4cf-48b3-471e-aa18-25f5c0ad305e</serial>
Aug 26 10:47:05 user nova-compute[73572]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 10:47:05 user nova-compute[73572]: </disk>
Aug 26 10:47:05 user nova-compute[73572]:  {{(pid=73572) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 10:47:05 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-896d252a-8c3e-49c0-8956-73be0d2d3d4a tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Successfully detached device vdb from instance 5d100a08-eaf2-4132-87dd-a8dcfe17f68f from the persistent domain config.
Aug 26 10:47:05 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-896d252a-8c3e-49c0-8956-73be0d2d3d4a tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5d100a08-eaf2-4132-87dd-a8dcfe17f68f from the live domain config. {{(pid=73572) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 10:47:05 user nova-compute[73572]: DEBUG nova.virt.libvirt.guest [None req-896d252a-8c3e-49c0-8956-73be0d2d3d4a tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 10:47:05 user nova-compute[73572]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 10:47:05 user nova-compute[73572]:   <source dev="/dev/sdb"/>
Aug 26 10:47:05 user nova-compute[73572]:   <target dev="vdb" bus="virtio"/>
Aug 26 10:47:05 user nova-compute[73572]:   <serial>7a40e4cf-48b3-471e-aa18-25f5c0ad305e</serial>
Aug 26 10:47:05 user nova-compute[73572]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 10:47:05 user nova-compute[73572]: </disk>
Aug 26 10:47:05 user nova-compute[73572]:  {{(pid=73572) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 10:47:05 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Received event <DeviceRemovedEvent: 1693046825.811389, 5d100a08-eaf2-4132-87dd-a8dcfe17f68f => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73572) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 10:47:05 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-896d252a-8c3e-49c0-8956-73be0d2d3d4a tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5d100a08-eaf2-4132-87dd-a8dcfe17f68f {{(pid=73572) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 10:47:05 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-896d252a-8c3e-49c0-8956-73be0d2d3d4a tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Successfully detached device vdb from instance 5d100a08-eaf2-4132-87dd-a8dcfe17f68f from the live domain config.
Aug 26 10:47:05 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-896d252a-8c3e-49c0-8956-73be0d2d3d4a tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] [instance: 5d100a08-eaf2-4132-87dd-a8dcfe17f68f] calling os-brick to detach iSCSI Volume {{(pid=73572) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 10:47:05 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-896d252a-8c3e-49c0-8956-73be0d2d3d4a tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc89c3d6a10>, {'target_iqns': ['iqn.2010-10.org.openstack:7a40e4cf-48b3-471e-aa18-25f5c0ad305e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'grUqIweF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 10:47:05 user nova-compute[73572]: WARNING os_brick.initiator.connectors.base [None req-896d252a-8c3e-49c0-8956-73be0d2d3d4a tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 10:47:05 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-896d252a-8c3e-49c0-8956-73be0d2d3d4a tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 10:47:05 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-896d252a-8c3e-49c0-8956-73be0d2d3d4a tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 10:47:05 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-896d252a-8c3e-49c0-8956-73be0d2d3d4a tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7a40e4cf-48b3-471e-aa18-25f5c0ad305e', 0)] {{(pid=73572) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 10:47:05 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:47:05 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:47:05 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:47:05 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[67ee868e-df56-40cb-9c44-6bb39465fb21]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7a40e4cf-48b3-471e-aa18-25f5c0ad305e\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:47:05 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:47:05 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:47:05 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ff90e77-76c9-4ab7-afc7-a32074a0be20]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a40e4cf-48b3-471e-aa18-25f5c0ad305e (non-flash)\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:47:05 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-896d252a-8c3e-49c0-8956-73be0d2d3d4a tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a40e4cf-48b3-471e-aa18-25f5c0ad305e (non-flash)
Aug 26 10:47:05 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 10:47:05 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-896d252a-8c3e-49c0-8956-73be0d2d3d4a tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a40e4cf-48b3-471e-aa18-25f5c0ad305e (non-flash)
Aug 26 10:47:05 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 10:47:05 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-896d252a-8c3e-49c0-8956-73be0d2d3d4a tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc878be5ea0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7a40e4cf-48b3-471e-aa18-25f5c0ad305e'): ({'sdb'}, set())}) {{(pid=73572) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 10:47:05 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-896d252a-8c3e-49c0-8956-73be0d2d3d4a tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Removing single pathed devices sdb {{(pid=73572) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 10:47:05 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:47:05 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:47:05 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7655f66-60db-4261-848b-bc5880875d76]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:47:05 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:47:05 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.027s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:47:05 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[b17d23fb-ab08-4b2f-97d5-d61e35433867]: (4, ('ok\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:47:05 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-896d252a-8c3e-49c0-8956-73be0d2d3d4a tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Flushing IO for device /dev/sdb {{(pid=73572) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 10:47:05 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:47:05 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:47:05 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff7e561a-d232-474a-93a9-adf12676ac8e]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:47:05 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-896d252a-8c3e-49c0-8956-73be0d2d3d4a tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73572) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 10:47:05 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:47:05 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.038s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:47:05 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[0527aa93-4fbc-47e4-aa4f-12870dc9f48e]: (4, ('1', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:47:06 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-896d252a-8c3e-49c0-8956-73be0d2d3d4a tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73572) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 10:47:06 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-896d252a-8c3e-49c0-8956-73be0d2d3d4a tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] SCSI volumes sdb have been removed. {{(pid=73572) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 10:47:06 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-896d252a-8c3e-49c0-8956-73be0d2d3d4a tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7a40e4cf-48b3-471e-aa18-25f5c0ad305e')] {{(pid=73572) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 10:47:06 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a40e4cf-48b3-471e-aa18-25f5c0ad305e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:47:06 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a40e4cf-48b3-471e-aa18-25f5c0ad305e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:47:06 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ec28ffd-b1df-40c2-a42f-ead363bfa523]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:47:06 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-896d252a-8c3e-49c0-8956-73be0d2d3d4a tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:47:06 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a40e4cf-48b3-471e-aa18-25f5c0ad305e -p 172.16.0.220:3260 --logout {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:47:06 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a40e4cf-48b3-471e-aa18-25f5c0ad305e -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:47:06 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec1e2ddf-6e45-4789-a649-3a465edf7c49]: (4, ('Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:7a40e4cf-48b3-471e-aa18-25f5c0ad305e, portal: 172.16.0.220,3260]\nLogout of [sid: 61, target: iqn.2010-10.org.openstack:7a40e4cf-48b3-471e-aa18-25f5c0ad305e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:47:06 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-896d252a-8c3e-49c0-8956-73be0d2d3d4a tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:7a40e4cf-48b3-471e-aa18-25f5c0ad305e, portal: 172.16.0.220,3260]
Aug 26 10:47:06 user nova-compute[73572]: Logout of [sid: 61, target: iqn.2010-10.org.openstack:7a40e4cf-48b3-471e-aa18-25f5c0ad305e, portal: 172.16.0.220,3260] successful.
Aug 26 10:47:06 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:47:06 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a40e4cf-48b3-471e-aa18-25f5c0ad305e -p 172.16.0.220:3260 --op delete {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:47:06 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a40e4cf-48b3-471e-aa18-25f5c0ad305e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:47:06 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[259fabd9-1284-4f7d-8b8c-b0661c99ed35]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:47:06 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-896d252a-8c3e-49c0-8956-73be0d2d3d4a tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:47:06 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-896d252a-8c3e-49c0-8956-73be0d2d3d4a tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.281s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 10:47:06 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-896d252a-8c3e-49c0-8956-73be0d2d3d4a tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] <== disconnect_volume: return (282ms) None {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 10:47:06 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-896d252a-8c3e-49c0-8956-73be0d2d3d4a tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] [instance: 5d100a08-eaf2-4132-87dd-a8dcfe17f68f] Disconnected iSCSI Volume {{(pid=73572) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 10:47:08 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:47:10 user nova-compute[73572]: DEBUG nova.objects.instance [None req-896d252a-8c3e-49c0-8956-73be0d2d3d4a tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Lazy-loading 'flavor' on Instance uuid 5d100a08-eaf2-4132-87dd-a8dcfe17f68f {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:47:10 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-896d252a-8c3e-49c0-8956-73be0d2d3d4a tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Lock "5d100a08-eaf2-4132-87dd-a8dcfe17f68f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 4.991s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:47:13 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:47:13 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:47:13 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73572) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 10:47:13 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73572) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 10:47:13 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73572) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 10:47:13 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:47:18 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:47:23 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:47:28 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:47:33 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:47:36 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:47:37 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:47:38 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:47:40 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:47:40 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Starting heal instance info cache {{(pid=73572) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 10:47:40 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Rebuilding the list of instances to heal {{(pid=73572) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 10:47:41 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquiring lock "refresh_cache-5d100a08-eaf2-4132-87dd-a8dcfe17f68f" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:47:41 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquired lock "refresh_cache-5d100a08-eaf2-4132-87dd-a8dcfe17f68f" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:47:41 user nova-compute[73572]: DEBUG nova.network.neutron [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] [instance: 5d100a08-eaf2-4132-87dd-a8dcfe17f68f] Forcefully refreshing network info cache for instance {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 10:47:41 user nova-compute[73572]: DEBUG nova.objects.instance [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lazy-loading 'info_cache' on Instance uuid 5d100a08-eaf2-4132-87dd-a8dcfe17f68f {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:47:41 user nova-compute[73572]: DEBUG nova.network.neutron [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] [instance: 5d100a08-eaf2-4132-87dd-a8dcfe17f68f] Updating instance_info_cache with network_info: [{"id": "efe52e67-0439-4035-988e-daae3acfc823", "address": "fa:16:3e:68:58:83", "network": {"id": "598e1cfa-caaf-470c-ac5a-e91aa2611d1f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1541764581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08b110acd72c427db0de4e98d05f5e56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefe52e67-04", "ovs_interfaceid": "efe52e67-0439-4035-988e-daae3acfc823", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:47:41 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Releasing lock "refresh_cache-5d100a08-eaf2-4132-87dd-a8dcfe17f68f" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:47:41 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] [instance: 5d100a08-eaf2-4132-87dd-a8dcfe17f68f] Updated the network info_cache for instance {{(pid=73572) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 10:47:43 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:47:43 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:47:43 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73572) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 10:47:43 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73572) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 10:47:43 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73572) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 10:47:43 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:47:44 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:47:46 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:47:46 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:47:46 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:47:46 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:47:46 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:47:46 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Auditing locally available compute resources for user (node: user) {{(pid=73572) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 10:47:46 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d100a08-eaf2-4132-87dd-a8dcfe17f68f/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:47:47 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d100a08-eaf2-4132-87dd-a8dcfe17f68f/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:47:47 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d100a08-eaf2-4132-87dd-a8dcfe17f68f/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:47:47 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d100a08-eaf2-4132-87dd-a8dcfe17f68f/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:47:47 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:47:47 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:47:47 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Hypervisor/Node resource view: name=user free_ram=8709MB free_disk=25.13732147216797GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=73572) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 10:47:47 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:47:47 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:47:47 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance 5d100a08-eaf2-4132-87dd-a8dcfe17f68f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:47:47 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73572) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 10:47:47 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73572) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 10:47:47 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Refreshing inventories for resource provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 {{(pid=73572) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 26 10:47:47 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Updating ProviderTree inventory for provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73572) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 26 10:47:47 user nova-compute[73572]: DEBUG nova.compute.provider_tree [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Updating inventory in ProviderTree for provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73572) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 26 10:47:48 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Refreshing aggregate associations for resource provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75, aggregates: None {{(pid=73572) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 26 10:47:48 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Refreshing trait associations for resource provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75, traits: COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSSE3,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE2,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NODE,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_NE2K_PCI {{(pid=73572) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 26 10:47:48 user nova-compute[73572]: DEBUG nova.compute.provider_tree [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Inventory has not changed in ProviderTree for provider: e2cec974-59b2-4c77-a53d-a7f4e5a30d75 {{(pid=73572) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 10:47:48 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Inventory has not changed for provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73572) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 10:47:48 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Compute_service record updated for user:user {{(pid=73572) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 10:47:48 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.441s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:47:48 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:47:48 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:47:48 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73572) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 10:47:48 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73572) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 10:47:48 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73572) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 10:47:48 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:47:49 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:47:49 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:47:49 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73572) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 10:47:49 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:47:52 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:47:52 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:47:53 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:47:57 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:47:58 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:47:59 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:48:00 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:48:01 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:48:01 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73572) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 26 10:48:03 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:48:03 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:48:05 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:48:06 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:48:08 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:48:08 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:48:08 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Cleaning up deleted instances {{(pid=73572) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 26 10:48:08 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] There are 0 instances to clean {{(pid=73572) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 26 10:48:10 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-05b8d775-5036-48ca-b92e-0fb851c0a01a tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] Acquiring lock "882eddbf-2173-47ed-92d1-964343380d96" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:48:10 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-05b8d775-5036-48ca-b92e-0fb851c0a01a tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] Lock "882eddbf-2173-47ed-92d1-964343380d96" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:48:10 user nova-compute[73572]: DEBUG nova.compute.manager [None req-05b8d775-5036-48ca-b92e-0fb851c0a01a tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] [instance: 882eddbf-2173-47ed-92d1-964343380d96] Starting instance... {{(pid=73572) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 10:48:10 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-05b8d775-5036-48ca-b92e-0fb851c0a01a tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:48:10 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-05b8d775-5036-48ca-b92e-0fb851c0a01a tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:48:10 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-05b8d775-5036-48ca-b92e-0fb851c0a01a tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73572) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 10:48:10 user nova-compute[73572]: INFO nova.compute.claims [None req-05b8d775-5036-48ca-b92e-0fb851c0a01a tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] [instance: 882eddbf-2173-47ed-92d1-964343380d96] Claim successful on node user
Aug 26 10:48:10 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:48:10 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:48:10 user nova-compute[73572]: DEBUG nova.compute.provider_tree [None req-05b8d775-5036-48ca-b92e-0fb851c0a01a tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] Inventory has not changed in ProviderTree for provider: e2cec974-59b2-4c77-a53d-a7f4e5a30d75 {{(pid=73572) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 10:48:10 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-05b8d775-5036-48ca-b92e-0fb851c0a01a tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] Inventory has not changed for provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73572) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 10:48:10 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-05b8d775-5036-48ca-b92e-0fb851c0a01a tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.273s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:48:10 user nova-compute[73572]: DEBUG nova.compute.manager [None req-05b8d775-5036-48ca-b92e-0fb851c0a01a tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] [instance: 882eddbf-2173-47ed-92d1-964343380d96] Start building networks asynchronously for instance. {{(pid=73572) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 10:48:11 user nova-compute[73572]: DEBUG nova.compute.manager [None req-05b8d775-5036-48ca-b92e-0fb851c0a01a tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] [instance: 882eddbf-2173-47ed-92d1-964343380d96] Allocating IP information in the background. {{(pid=73572) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 10:48:11 user nova-compute[73572]: DEBUG nova.network.neutron [None req-05b8d775-5036-48ca-b92e-0fb851c0a01a tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] [instance: 882eddbf-2173-47ed-92d1-964343380d96] allocate_for_instance() {{(pid=73572) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 10:48:11 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-05b8d775-5036-48ca-b92e-0fb851c0a01a tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] [instance: 882eddbf-2173-47ed-92d1-964343380d96] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 10:48:11 user nova-compute[73572]: DEBUG nova.compute.manager [None req-05b8d775-5036-48ca-b92e-0fb851c0a01a tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] [instance: 882eddbf-2173-47ed-92d1-964343380d96] Start building block device mappings for instance. {{(pid=73572) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 10:48:11 user nova-compute[73572]: DEBUG nova.policy [None req-05b8d775-5036-48ca-b92e-0fb851c0a01a tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd024076057ad4efc8cec0c6b126b432c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a124fd1ae2f419587b80fa0726162f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73572) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 10:48:11 user nova-compute[73572]: DEBUG nova.compute.manager [None req-05b8d775-5036-48ca-b92e-0fb851c0a01a tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] [instance: 882eddbf-2173-47ed-92d1-964343380d96] Start spawning the instance on the hypervisor. {{(pid=73572) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 10:48:11 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-05b8d775-5036-48ca-b92e-0fb851c0a01a tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] [instance: 882eddbf-2173-47ed-92d1-964343380d96] Creating instance directory {{(pid=73572) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 10:48:11 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-05b8d775-5036-48ca-b92e-0fb851c0a01a tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] [instance: 882eddbf-2173-47ed-92d1-964343380d96] Creating image(s)
Aug 26 10:48:11 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-05b8d775-5036-48ca-b92e-0fb851c0a01a tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] Acquiring lock "/opt/stack/data/nova/instances/882eddbf-2173-47ed-92d1-964343380d96/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:48:11 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-05b8d775-5036-48ca-b92e-0fb851c0a01a tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] Lock "/opt/stack/data/nova/instances/882eddbf-2173-47ed-92d1-964343380d96/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:48:11 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-05b8d775-5036-48ca-b92e-0fb851c0a01a tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] Lock "/opt/stack/data/nova/instances/882eddbf-2173-47ed-92d1-964343380d96/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:48:11 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-05b8d775-5036-48ca-b92e-0fb851c0a01a tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:48:11 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-05b8d775-5036-48ca-b92e-0fb851c0a01a tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json" returned: 0 in 0.175s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:48:11 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-05b8d775-5036-48ca-b92e-0fb851c0a01a tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] Acquiring lock "2099350d6f3bcd0de9471c73862d4fe75b049801" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:48:11 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-05b8d775-5036-48ca-b92e-0fb851c0a01a tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] Lock "2099350d6f3bcd0de9471c73862d4fe75b049801" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:48:11 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-05b8d775-5036-48ca-b92e-0fb851c0a01a tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:48:11 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-05b8d775-5036-48ca-b92e-0fb851c0a01a tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json" returned: 0 in 0.174s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:48:11 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-05b8d775-5036-48ca-b92e-0fb851c0a01a tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801,backing_fmt=raw /opt/stack/data/nova/instances/882eddbf-2173-47ed-92d1-964343380d96/disk 1073741824 {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:48:11 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-05b8d775-5036-48ca-b92e-0fb851c0a01a tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801,backing_fmt=raw /opt/stack/data/nova/instances/882eddbf-2173-47ed-92d1-964343380d96/disk 1073741824" returned: 0 in 0.052s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:48:11 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-05b8d775-5036-48ca-b92e-0fb851c0a01a tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] Lock "2099350d6f3bcd0de9471c73862d4fe75b049801" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.236s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:48:11 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-05b8d775-5036-48ca-b92e-0fb851c0a01a tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:48:11 user nova-compute[73572]: DEBUG nova.network.neutron [None req-05b8d775-5036-48ca-b92e-0fb851c0a01a tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] [instance: 882eddbf-2173-47ed-92d1-964343380d96] Successfully created port: 89e82ce7-b0b8-4a65-a46e-b611b985dd13 {{(pid=73572) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 10:48:11 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-05b8d775-5036-48ca-b92e-0fb851c0a01a tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json" returned: 0 in 0.180s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:48:11 user nova-compute[73572]: DEBUG nova.virt.disk.api [None req-05b8d775-5036-48ca-b92e-0fb851c0a01a tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] Checking if we can resize image /opt/stack/data/nova/instances/882eddbf-2173-47ed-92d1-964343380d96/disk. size=1073741824 {{(pid=73572) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 10:48:11 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-05b8d775-5036-48ca-b92e-0fb851c0a01a tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/882eddbf-2173-47ed-92d1-964343380d96/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:48:12 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-05b8d775-5036-48ca-b92e-0fb851c0a01a tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/882eddbf-2173-47ed-92d1-964343380d96/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:48:12 user nova-compute[73572]: DEBUG nova.virt.disk.api [None req-05b8d775-5036-48ca-b92e-0fb851c0a01a tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] Cannot resize image /opt/stack/data/nova/instances/882eddbf-2173-47ed-92d1-964343380d96/disk to a smaller size. {{(pid=73572) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 10:48:12 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-05b8d775-5036-48ca-b92e-0fb851c0a01a tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] [instance: 882eddbf-2173-47ed-92d1-964343380d96] Created local disks {{(pid=73572) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 10:48:12 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-05b8d775-5036-48ca-b92e-0fb851c0a01a tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] [instance: 882eddbf-2173-47ed-92d1-964343380d96] Ensure instance console log exists: /opt/stack/data/nova/instances/882eddbf-2173-47ed-92d1-964343380d96/console.log {{(pid=73572) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 10:48:12 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-05b8d775-5036-48ca-b92e-0fb851c0a01a tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:48:12 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-05b8d775-5036-48ca-b92e-0fb851c0a01a tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:48:12 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-05b8d775-5036-48ca-b92e-0fb851c0a01a tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:48:12 user nova-compute[73572]: DEBUG nova.network.neutron [None req-05b8d775-5036-48ca-b92e-0fb851c0a01a tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] [instance: 882eddbf-2173-47ed-92d1-964343380d96] Successfully updated port: 89e82ce7-b0b8-4a65-a46e-b611b985dd13 {{(pid=73572) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 10:48:12 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-05b8d775-5036-48ca-b92e-0fb851c0a01a tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] Acquiring lock "refresh_cache-882eddbf-2173-47ed-92d1-964343380d96" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:48:12 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-05b8d775-5036-48ca-b92e-0fb851c0a01a tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] Acquired lock "refresh_cache-882eddbf-2173-47ed-92d1-964343380d96" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:48:12 user nova-compute[73572]: DEBUG nova.network.neutron [None req-05b8d775-5036-48ca-b92e-0fb851c0a01a tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] [instance: 882eddbf-2173-47ed-92d1-964343380d96] Building network info cache for instance {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 10:48:12 user nova-compute[73572]: DEBUG nova.network.neutron [None req-05b8d775-5036-48ca-b92e-0fb851c0a01a tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] [instance: 882eddbf-2173-47ed-92d1-964343380d96] Instance cache missing network info. {{(pid=73572) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 10:48:12 user nova-compute[73572]: DEBUG nova.compute.manager [req-43cad2b6-75e9-48e6-9011-23bab2809f5d req-87112862-dc4f-4a5d-a223-1b9f9feef7aa service nova] [instance: 882eddbf-2173-47ed-92d1-964343380d96] Received event network-changed-89e82ce7-b0b8-4a65-a46e-b611b985dd13 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:48:12 user nova-compute[73572]: DEBUG nova.compute.manager [req-43cad2b6-75e9-48e6-9011-23bab2809f5d req-87112862-dc4f-4a5d-a223-1b9f9feef7aa service nova] [instance: 882eddbf-2173-47ed-92d1-964343380d96] Refreshing instance network info cache due to event network-changed-89e82ce7-b0b8-4a65-a46e-b611b985dd13. {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 10:48:12 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-43cad2b6-75e9-48e6-9011-23bab2809f5d req-87112862-dc4f-4a5d-a223-1b9f9feef7aa service nova] Acquiring lock "refresh_cache-882eddbf-2173-47ed-92d1-964343380d96" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:48:13 user nova-compute[73572]: DEBUG nova.network.neutron [None req-05b8d775-5036-48ca-b92e-0fb851c0a01a tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] [instance: 882eddbf-2173-47ed-92d1-964343380d96] Updating instance_info_cache with network_info: [{"id": "89e82ce7-b0b8-4a65-a46e-b611b985dd13", "address": "fa:16:3e:7a:23:a2", "network": {"id": "efc34ba2-d981-4ab9-97e9-13ceeb155aef", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-538309683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a124fd1ae2f419587b80fa0726162f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89e82ce7-b0", "ovs_interfaceid": "89e82ce7-b0b8-4a65-a46e-b611b985dd13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:48:13 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-05b8d775-5036-48ca-b92e-0fb851c0a01a tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] Releasing lock "refresh_cache-882eddbf-2173-47ed-92d1-964343380d96" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:48:13 user nova-compute[73572]: DEBUG nova.compute.manager [None req-05b8d775-5036-48ca-b92e-0fb851c0a01a tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] [instance: 882eddbf-2173-47ed-92d1-964343380d96] Instance network_info: |[{"id": "89e82ce7-b0b8-4a65-a46e-b611b985dd13", "address": "fa:16:3e:7a:23:a2", "network": {"id": "efc34ba2-d981-4ab9-97e9-13ceeb155aef", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-538309683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a124fd1ae2f419587b80fa0726162f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89e82ce7-b0", "ovs_interfaceid": "89e82ce7-b0b8-4a65-a46e-b611b985dd13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73572) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 10:48:13 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-43cad2b6-75e9-48e6-9011-23bab2809f5d req-87112862-dc4f-4a5d-a223-1b9f9feef7aa service nova] Acquired lock "refresh_cache-882eddbf-2173-47ed-92d1-964343380d96" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:48:13 user nova-compute[73572]: DEBUG nova.network.neutron [req-43cad2b6-75e9-48e6-9011-23bab2809f5d req-87112862-dc4f-4a5d-a223-1b9f9feef7aa service nova] [instance: 882eddbf-2173-47ed-92d1-964343380d96] Refreshing network info cache for port 89e82ce7-b0b8-4a65-a46e-b611b985dd13 {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 10:48:13 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-05b8d775-5036-48ca-b92e-0fb851c0a01a tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] [instance: 882eddbf-2173-47ed-92d1-964343380d96] Start _get_guest_xml network_info=[{"id": "89e82ce7-b0b8-4a65-a46e-b611b985dd13", "address": "fa:16:3e:7a:23:a2", "network": {"id": "efc34ba2-d981-4ab9-97e9-13ceeb155aef", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-538309683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a124fd1ae2f419587b80fa0726162f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89e82ce7-b0", "ovs_interfaceid": "89e82ce7-b0b8-4a65-a46e-b611b985dd13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T10:07:33Z,direct_url=<?>,disk_format='qcow2',id=299da0c9-e1c4-48f0-be55-fbe20dd06bc9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5c995f8bbbab4368b67a253e0df3971a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T10:07:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'guest_format': None, 'size': 0, 'encryption_format': None, 'device_type': 'disk', 'image_id': '299da0c9-e1c4-48f0-be55-fbe20dd06bc9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73572) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 10:48:13 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-05b8d775-5036-48ca-b92e-0fb851c0a01a tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:48:13 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-05b8d775-5036-48ca-b92e-0fb851c0a01a tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:48:13 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-05b8d775-5036-48ca-b92e-0fb851c0a01a tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73572) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 10:48:13 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-05b8d775-5036-48ca-b92e-0fb851c0a01a tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] CPU controller missing on host. {{(pid=73572) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 10:48:13 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-05b8d775-5036-48ca-b92e-0fb851c0a01a tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73572) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 10:48:13 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-05b8d775-5036-48ca-b92e-0fb851c0a01a tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] CPU controller found on host. {{(pid=73572) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 10:48:13 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-05b8d775-5036-48ca-b92e-0fb851c0a01a tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73572) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 10:48:13 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-05b8d775-5036-48ca-b92e-0fb851c0a01a tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T10:07:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T10:07:33Z,direct_url=<?>,disk_format='qcow2',id=299da0c9-e1c4-48f0-be55-fbe20dd06bc9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5c995f8bbbab4368b67a253e0df3971a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T10:07:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 10:48:13 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-05b8d775-5036-48ca-b92e-0fb851c0a01a tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] Flavor limits 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 10:48:13 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-05b8d775-5036-48ca-b92e-0fb851c0a01a tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] Image limits 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 10:48:13 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-05b8d775-5036-48ca-b92e-0fb851c0a01a tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] Flavor pref 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 10:48:13 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-05b8d775-5036-48ca-b92e-0fb851c0a01a tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] Image pref 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 10:48:13 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-05b8d775-5036-48ca-b92e-0fb851c0a01a tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 10:48:13 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-05b8d775-5036-48ca-b92e-0fb851c0a01a tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 10:48:13 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-05b8d775-5036-48ca-b92e-0fb851c0a01a tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73572) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 10:48:13 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-05b8d775-5036-48ca-b92e-0fb851c0a01a tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] Got 1 possible topologies {{(pid=73572) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 10:48:13 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-05b8d775-5036-48ca-b92e-0fb851c0a01a tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 10:48:13 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-05b8d775-5036-48ca-b92e-0fb851c0a01a tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 10:48:13 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-05b8d775-5036-48ca-b92e-0fb851c0a01a tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T10:48:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1113939593',display_name='tempest-TestServerVolumeAttachmentScenario-server-1113939593',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1113939593',id=52,image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE7aOgXOfrPjTgKc0lHTbqjtIlGsU4/M/K2s8wKzLXm9z3xW3dqaJYxMT2k6tc6rvwd8tX8DTTcWpSrJUZWSeYsWAl0lkVhskn8gOF5UldBDzBRsah4jALVFxFCpnAHGlw==',key_name='tempest-keypair-509735975',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4a124fd1ae2f419587b80fa0726162f2',ramdisk_id='',reservation_id='r-3r006h5s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1456898794',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1456898794-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T10:48:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d024076057ad4efc8cec0c6b126b432c',uuid=882eddbf-2173-47ed-92d1-964343380d96,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "89e82ce7-b0b8-4a65-a46e-b611b985dd13", "address": "fa:16:3e:7a:23:a2", "network": {"id": "efc34ba2-d981-4ab9-97e9-13ceeb155aef", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-538309683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a124fd1ae2f419587b80fa0726162f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89e82ce7-b0", "ovs_interfaceid": "89e82ce7-b0b8-4a65-a46e-b611b985dd13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73572) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 10:48:13 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-05b8d775-5036-48ca-b92e-0fb851c0a01a tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] Converting VIF {"id": "89e82ce7-b0b8-4a65-a46e-b611b985dd13", "address": "fa:16:3e:7a:23:a2", "network": {"id": "efc34ba2-d981-4ab9-97e9-13ceeb155aef", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-538309683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a124fd1ae2f419587b80fa0726162f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89e82ce7-b0", "ovs_interfaceid": "89e82ce7-b0b8-4a65-a46e-b611b985dd13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:48:13 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-05b8d775-5036-48ca-b92e-0fb851c0a01a tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:23:a2,bridge_name='br-int',has_traffic_filtering=True,id=89e82ce7-b0b8-4a65-a46e-b611b985dd13,network=Network(efc34ba2-d981-4ab9-97e9-13ceeb155aef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89e82ce7-b0') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:48:13 user nova-compute[73572]: DEBUG nova.objects.instance [None req-05b8d775-5036-48ca-b92e-0fb851c0a01a tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] Lazy-loading 'pci_devices' on Instance uuid 882eddbf-2173-47ed-92d1-964343380d96 {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:48:13 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-05b8d775-5036-48ca-b92e-0fb851c0a01a tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] [instance: 882eddbf-2173-47ed-92d1-964343380d96] End _get_guest_xml xml=<domain type="kvm">
Aug 26 10:48:13 user nova-compute[73572]:   <uuid>882eddbf-2173-47ed-92d1-964343380d96</uuid>
Aug 26 10:48:13 user nova-compute[73572]:   <name>instance-00000034</name>
Aug 26 10:48:13 user nova-compute[73572]:   <memory>524288</memory>
Aug 26 10:48:13 user nova-compute[73572]:   <vcpu>1</vcpu>
Aug 26 10:48:13 user nova-compute[73572]:   <metadata>
Aug 26 10:48:13 user nova-compute[73572]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 10:48:13 user nova-compute[73572]:       <nova:package version="0.0.0"/>
Aug 26 10:48:13 user nova-compute[73572]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-1113939593</nova:name>
Aug 26 10:48:13 user nova-compute[73572]:       <nova:creationTime>2023-08-26 10:48:13</nova:creationTime>
Aug 26 10:48:13 user nova-compute[73572]:       <nova:flavor name="m1.tiny">
Aug 26 10:48:13 user nova-compute[73572]:         <nova:memory>512</nova:memory>
Aug 26 10:48:13 user nova-compute[73572]:         <nova:disk>1</nova:disk>
Aug 26 10:48:13 user nova-compute[73572]:         <nova:swap>0</nova:swap>
Aug 26 10:48:13 user nova-compute[73572]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 10:48:13 user nova-compute[73572]:         <nova:vcpus>1</nova:vcpus>
Aug 26 10:48:13 user nova-compute[73572]:       </nova:flavor>
Aug 26 10:48:13 user nova-compute[73572]:       <nova:owner>
Aug 26 10:48:13 user nova-compute[73572]:         <nova:user uuid="d024076057ad4efc8cec0c6b126b432c">tempest-TestServerVolumeAttachmentScenario-1456898794-project-member</nova:user>
Aug 26 10:48:13 user nova-compute[73572]:         <nova:project uuid="4a124fd1ae2f419587b80fa0726162f2">tempest-TestServerVolumeAttachmentScenario-1456898794</nova:project>
Aug 26 10:48:13 user nova-compute[73572]:       </nova:owner>
Aug 26 10:48:13 user nova-compute[73572]:       <nova:root type="image" uuid="299da0c9-e1c4-48f0-be55-fbe20dd06bc9"/>
Aug 26 10:48:13 user nova-compute[73572]:       <nova:ports>
Aug 26 10:48:13 user nova-compute[73572]:         <nova:port uuid="89e82ce7-b0b8-4a65-a46e-b611b985dd13">
Aug 26 10:48:13 user nova-compute[73572]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 26 10:48:13 user nova-compute[73572]:         </nova:port>
Aug 26 10:48:13 user nova-compute[73572]:       </nova:ports>
Aug 26 10:48:13 user nova-compute[73572]:     </nova:instance>
Aug 26 10:48:13 user nova-compute[73572]:   </metadata>
Aug 26 10:48:13 user nova-compute[73572]:   <sysinfo type="smbios">
Aug 26 10:48:13 user nova-compute[73572]:     <system>
Aug 26 10:48:13 user nova-compute[73572]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 10:48:13 user nova-compute[73572]:       <entry name="product">OpenStack Nova</entry>
Aug 26 10:48:13 user nova-compute[73572]:       <entry name="version">0.0.0</entry>
Aug 26 10:48:13 user nova-compute[73572]:       <entry name="serial">882eddbf-2173-47ed-92d1-964343380d96</entry>
Aug 26 10:48:13 user nova-compute[73572]:       <entry name="uuid">882eddbf-2173-47ed-92d1-964343380d96</entry>
Aug 26 10:48:13 user nova-compute[73572]:       <entry name="family">Virtual Machine</entry>
Aug 26 10:48:13 user nova-compute[73572]:     </system>
Aug 26 10:48:13 user nova-compute[73572]:   </sysinfo>
Aug 26 10:48:13 user nova-compute[73572]:   <os>
Aug 26 10:48:13 user nova-compute[73572]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 10:48:13 user nova-compute[73572]:     <boot dev="hd"/>
Aug 26 10:48:13 user nova-compute[73572]:     <smbios mode="sysinfo"/>
Aug 26 10:48:13 user nova-compute[73572]:   </os>
Aug 26 10:48:13 user nova-compute[73572]:   <features>
Aug 26 10:48:13 user nova-compute[73572]:     <acpi/>
Aug 26 10:48:13 user nova-compute[73572]:     <apic/>
Aug 26 10:48:13 user nova-compute[73572]:     <vmcoreinfo/>
Aug 26 10:48:13 user nova-compute[73572]:   </features>
Aug 26 10:48:13 user nova-compute[73572]:   <clock offset="utc">
Aug 26 10:48:13 user nova-compute[73572]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 10:48:13 user nova-compute[73572]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 10:48:13 user nova-compute[73572]:     <timer name="hpet" present="no"/>
Aug 26 10:48:13 user nova-compute[73572]:   </clock>
Aug 26 10:48:13 user nova-compute[73572]:   <cpu mode="custom" match="exact">
Aug 26 10:48:13 user nova-compute[73572]:     <model>Nehalem</model>
Aug 26 10:48:13 user nova-compute[73572]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 10:48:13 user nova-compute[73572]:   </cpu>
Aug 26 10:48:13 user nova-compute[73572]:   <devices>
Aug 26 10:48:13 user nova-compute[73572]:     <disk type="file" device="disk">
Aug 26 10:48:13 user nova-compute[73572]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 10:48:13 user nova-compute[73572]:       <source file="/opt/stack/data/nova/instances/882eddbf-2173-47ed-92d1-964343380d96/disk"/>
Aug 26 10:48:13 user nova-compute[73572]:       <target dev="vda" bus="virtio"/>
Aug 26 10:48:13 user nova-compute[73572]:     </disk>
Aug 26 10:48:13 user nova-compute[73572]:     <interface type="ethernet">
Aug 26 10:48:13 user nova-compute[73572]:       <mac address="fa:16:3e:7a:23:a2"/>
Aug 26 10:48:13 user nova-compute[73572]:       <model type="virtio"/>
Aug 26 10:48:13 user nova-compute[73572]:       <mtu size="1442"/>
Aug 26 10:48:13 user nova-compute[73572]:       <target dev="tap89e82ce7-b0"/>
Aug 26 10:48:13 user nova-compute[73572]:     </interface>
Aug 26 10:48:13 user nova-compute[73572]:     <serial type="pty">
Aug 26 10:48:13 user nova-compute[73572]:       <log file="/opt/stack/data/nova/instances/882eddbf-2173-47ed-92d1-964343380d96/console.log" append="off"/>
Aug 26 10:48:13 user nova-compute[73572]:     </serial>
Aug 26 10:48:13 user nova-compute[73572]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 10:48:13 user nova-compute[73572]:     <video>
Aug 26 10:48:13 user nova-compute[73572]:       <model type="virtio"/>
Aug 26 10:48:13 user nova-compute[73572]:     </video>
Aug 26 10:48:13 user nova-compute[73572]:     <rng model="virtio">
Aug 26 10:48:13 user nova-compute[73572]:       <backend model="random">/dev/urandom</backend>
Aug 26 10:48:13 user nova-compute[73572]:     </rng>
Aug 26 10:48:13 user nova-compute[73572]:     <controller type="usb" index="0" model="none"/>
Aug 26 10:48:13 user nova-compute[73572]:     <memballoon model="virtio">
Aug 26 10:48:13 user nova-compute[73572]:       <stats period="10"/>
Aug 26 10:48:13 user nova-compute[73572]:     </memballoon>
Aug 26 10:48:13 user nova-compute[73572]:   </devices>
Aug 26 10:48:13 user nova-compute[73572]: </domain>
Aug 26 10:48:13 user nova-compute[73572]:  {{(pid=73572) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 10:48:13 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-05b8d775-5036-48ca-b92e-0fb851c0a01a tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T10:48:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1113939593',display_name='tempest-TestServerVolumeAttachmentScenario-server-1113939593',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1113939593',id=52,image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE7aOgXOfrPjTgKc0lHTbqjtIlGsU4/M/K2s8wKzLXm9z3xW3dqaJYxMT2k6tc6rvwd8tX8DTTcWpSrJUZWSeYsWAl0lkVhskn8gOF5UldBDzBRsah4jALVFxFCpnAHGlw==',key_name='tempest-keypair-509735975',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4a124fd1ae2f419587b80fa0726162f2',ramdisk_id='',reservation_id='r-3r006h5s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1456898794',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1456898794-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T10:48:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d024076057ad4efc8cec0c6b126b432c',uuid=882eddbf-2173-47ed-92d1-964343380d96,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "89e82ce7-b0b8-4a65-a46e-b611b985dd13", "address": "fa:16:3e:7a:23:a2", "network": {"id": "efc34ba2-d981-4ab9-97e9-13ceeb155aef", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-538309683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a124fd1ae2f419587b80fa0726162f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89e82ce7-b0", "ovs_interfaceid": "89e82ce7-b0b8-4a65-a46e-b611b985dd13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 10:48:13 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-05b8d775-5036-48ca-b92e-0fb851c0a01a tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] Converting VIF {"id": "89e82ce7-b0b8-4a65-a46e-b611b985dd13", "address": "fa:16:3e:7a:23:a2", "network": {"id": "efc34ba2-d981-4ab9-97e9-13ceeb155aef", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-538309683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a124fd1ae2f419587b80fa0726162f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89e82ce7-b0", "ovs_interfaceid": "89e82ce7-b0b8-4a65-a46e-b611b985dd13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:48:13 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-05b8d775-5036-48ca-b92e-0fb851c0a01a tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:23:a2,bridge_name='br-int',has_traffic_filtering=True,id=89e82ce7-b0b8-4a65-a46e-b611b985dd13,network=Network(efc34ba2-d981-4ab9-97e9-13ceeb155aef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89e82ce7-b0') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:48:13 user nova-compute[73572]: DEBUG os_vif [None req-05b8d775-5036-48ca-b92e-0fb851c0a01a tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:23:a2,bridge_name='br-int',has_traffic_filtering=True,id=89e82ce7-b0b8-4a65-a46e-b611b985dd13,network=Network(efc34ba2-d981-4ab9-97e9-13ceeb155aef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89e82ce7-b0') {{(pid=73572) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 10:48:13 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:48:13 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:48:13 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 10:48:13 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:48:13 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap89e82ce7-b0, may_exist=True, interface_attrs={}) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:48:13 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap89e82ce7-b0, col_values=(('external_ids', {'iface-id': '89e82ce7-b0b8-4a65-a46e-b611b985dd13', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7a:23:a2', 'vm-uuid': '882eddbf-2173-47ed-92d1-964343380d96'}),), if_exists=True) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:48:13 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:48:13 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:48:13 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:48:13 user nova-compute[73572]: INFO os_vif [None req-05b8d775-5036-48ca-b92e-0fb851c0a01a tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:23:a2,bridge_name='br-int',has_traffic_filtering=True,id=89e82ce7-b0b8-4a65-a46e-b611b985dd13,network=Network(efc34ba2-d981-4ab9-97e9-13ceeb155aef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89e82ce7-b0')
Aug 26 10:48:13 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-05b8d775-5036-48ca-b92e-0fb851c0a01a tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] No BDM found with device name vda, not building metadata. {{(pid=73572) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 10:48:13 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-05b8d775-5036-48ca-b92e-0fb851c0a01a tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] No VIF found with MAC fa:16:3e:7a:23:a2, not building metadata {{(pid=73572) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 10:48:13 user nova-compute[73572]: DEBUG nova.network.neutron [req-43cad2b6-75e9-48e6-9011-23bab2809f5d req-87112862-dc4f-4a5d-a223-1b9f9feef7aa service nova] [instance: 882eddbf-2173-47ed-92d1-964343380d96] Updated VIF entry in instance network info cache for port 89e82ce7-b0b8-4a65-a46e-b611b985dd13. {{(pid=73572) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 10:48:13 user nova-compute[73572]: DEBUG nova.network.neutron [req-43cad2b6-75e9-48e6-9011-23bab2809f5d req-87112862-dc4f-4a5d-a223-1b9f9feef7aa service nova] [instance: 882eddbf-2173-47ed-92d1-964343380d96] Updating instance_info_cache with network_info: [{"id": "89e82ce7-b0b8-4a65-a46e-b611b985dd13", "address": "fa:16:3e:7a:23:a2", "network": {"id": "efc34ba2-d981-4ab9-97e9-13ceeb155aef", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-538309683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a124fd1ae2f419587b80fa0726162f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89e82ce7-b0", "ovs_interfaceid": "89e82ce7-b0b8-4a65-a46e-b611b985dd13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:48:13 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-43cad2b6-75e9-48e6-9011-23bab2809f5d req-87112862-dc4f-4a5d-a223-1b9f9feef7aa service nova] Releasing lock "refresh_cache-882eddbf-2173-47ed-92d1-964343380d96" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:48:14 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:48:14 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:48:14 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:48:14 user nova-compute[73572]: DEBUG nova.compute.manager [req-389d3cd7-9579-422f-83d4-0a6f4002e0d3 req-614cb9f7-ca71-4f58-bd31-afa8d26af7e7 service nova] [instance: 882eddbf-2173-47ed-92d1-964343380d96] Received event network-vif-plugged-89e82ce7-b0b8-4a65-a46e-b611b985dd13 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:48:14 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-389d3cd7-9579-422f-83d4-0a6f4002e0d3 req-614cb9f7-ca71-4f58-bd31-afa8d26af7e7 service nova] Acquiring lock "882eddbf-2173-47ed-92d1-964343380d96-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:48:14 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-389d3cd7-9579-422f-83d4-0a6f4002e0d3 req-614cb9f7-ca71-4f58-bd31-afa8d26af7e7 service nova] Lock "882eddbf-2173-47ed-92d1-964343380d96-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:48:14 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-389d3cd7-9579-422f-83d4-0a6f4002e0d3 req-614cb9f7-ca71-4f58-bd31-afa8d26af7e7 service nova] Lock "882eddbf-2173-47ed-92d1-964343380d96-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:48:14 user nova-compute[73572]: DEBUG nova.compute.manager [req-389d3cd7-9579-422f-83d4-0a6f4002e0d3 req-614cb9f7-ca71-4f58-bd31-afa8d26af7e7 service nova] [instance: 882eddbf-2173-47ed-92d1-964343380d96] No waiting events found dispatching network-vif-plugged-89e82ce7-b0b8-4a65-a46e-b611b985dd13 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:48:14 user nova-compute[73572]: WARNING nova.compute.manager [req-389d3cd7-9579-422f-83d4-0a6f4002e0d3 req-614cb9f7-ca71-4f58-bd31-afa8d26af7e7 service nova] [instance: 882eddbf-2173-47ed-92d1-964343380d96] Received unexpected event network-vif-plugged-89e82ce7-b0b8-4a65-a46e-b611b985dd13 for instance with vm_state building and task_state spawning.
Aug 26 10:48:15 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:48:15 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:48:15 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:48:16 user nova-compute[73572]: DEBUG nova.virt.driver [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Emitting event <LifecycleEvent: 1693046896.7726393, 882eddbf-2173-47ed-92d1-964343380d96 => Resumed> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:48:16 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 882eddbf-2173-47ed-92d1-964343380d96] VM Resumed (Lifecycle Event)
Aug 26 10:48:16 user nova-compute[73572]: DEBUG nova.compute.manager [None req-05b8d775-5036-48ca-b92e-0fb851c0a01a tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] [instance: 882eddbf-2173-47ed-92d1-964343380d96] Instance event wait completed in 0 seconds for  {{(pid=73572) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 10:48:16 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-05b8d775-5036-48ca-b92e-0fb851c0a01a tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] [instance: 882eddbf-2173-47ed-92d1-964343380d96] Guest created on hypervisor {{(pid=73572) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 10:48:16 user nova-compute[73572]: INFO nova.virt.libvirt.driver [-] [instance: 882eddbf-2173-47ed-92d1-964343380d96] Instance spawned successfully.
Aug 26 10:48:16 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-05b8d775-5036-48ca-b92e-0fb851c0a01a tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] [instance: 882eddbf-2173-47ed-92d1-964343380d96] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 10:48:16 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 882eddbf-2173-47ed-92d1-964343380d96] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:48:16 user nova-compute[73572]: DEBUG nova.compute.manager [req-1812c5b2-5ea2-4ebf-9595-588c59ceefc7 req-fcd22372-9cad-4c2e-8411-e34529dc9031 service nova] [instance: 882eddbf-2173-47ed-92d1-964343380d96] Received event network-vif-plugged-89e82ce7-b0b8-4a65-a46e-b611b985dd13 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:48:16 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-1812c5b2-5ea2-4ebf-9595-588c59ceefc7 req-fcd22372-9cad-4c2e-8411-e34529dc9031 service nova] Acquiring lock "882eddbf-2173-47ed-92d1-964343380d96-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:48:16 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-1812c5b2-5ea2-4ebf-9595-588c59ceefc7 req-fcd22372-9cad-4c2e-8411-e34529dc9031 service nova] Lock "882eddbf-2173-47ed-92d1-964343380d96-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:48:16 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-1812c5b2-5ea2-4ebf-9595-588c59ceefc7 req-fcd22372-9cad-4c2e-8411-e34529dc9031 service nova] Lock "882eddbf-2173-47ed-92d1-964343380d96-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:48:16 user nova-compute[73572]: DEBUG nova.compute.manager [req-1812c5b2-5ea2-4ebf-9595-588c59ceefc7 req-fcd22372-9cad-4c2e-8411-e34529dc9031 service nova] [instance: 882eddbf-2173-47ed-92d1-964343380d96] No waiting events found dispatching network-vif-plugged-89e82ce7-b0b8-4a65-a46e-b611b985dd13 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:48:16 user nova-compute[73572]: WARNING nova.compute.manager [req-1812c5b2-5ea2-4ebf-9595-588c59ceefc7 req-fcd22372-9cad-4c2e-8411-e34529dc9031 service nova] [instance: 882eddbf-2173-47ed-92d1-964343380d96] Received unexpected event network-vif-plugged-89e82ce7-b0b8-4a65-a46e-b611b985dd13 for instance with vm_state building and task_state spawning.
Aug 26 10:48:16 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 882eddbf-2173-47ed-92d1-964343380d96] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73572) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 10:48:16 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-05b8d775-5036-48ca-b92e-0fb851c0a01a tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] [instance: 882eddbf-2173-47ed-92d1-964343380d96] Found default for hw_cdrom_bus of ide {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:48:16 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-05b8d775-5036-48ca-b92e-0fb851c0a01a tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] [instance: 882eddbf-2173-47ed-92d1-964343380d96] Found default for hw_disk_bus of virtio {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:48:16 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-05b8d775-5036-48ca-b92e-0fb851c0a01a tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] [instance: 882eddbf-2173-47ed-92d1-964343380d96] Found default for hw_input_bus of None {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:48:16 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-05b8d775-5036-48ca-b92e-0fb851c0a01a tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] [instance: 882eddbf-2173-47ed-92d1-964343380d96] Found default for hw_pointer_model of None {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:48:16 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-05b8d775-5036-48ca-b92e-0fb851c0a01a tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] [instance: 882eddbf-2173-47ed-92d1-964343380d96] Found default for hw_video_model of virtio {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:48:16 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-05b8d775-5036-48ca-b92e-0fb851c0a01a tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] [instance: 882eddbf-2173-47ed-92d1-964343380d96] Found default for hw_vif_model of virtio {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:48:16 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 882eddbf-2173-47ed-92d1-964343380d96] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 10:48:16 user nova-compute[73572]: DEBUG nova.virt.driver [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Emitting event <LifecycleEvent: 1693046896.774222, 882eddbf-2173-47ed-92d1-964343380d96 => Started> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:48:16 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 882eddbf-2173-47ed-92d1-964343380d96] VM Started (Lifecycle Event)
Aug 26 10:48:16 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 882eddbf-2173-47ed-92d1-964343380d96] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:48:16 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 882eddbf-2173-47ed-92d1-964343380d96] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73572) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 10:48:16 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: 882eddbf-2173-47ed-92d1-964343380d96] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 10:48:16 user nova-compute[73572]: INFO nova.compute.manager [None req-05b8d775-5036-48ca-b92e-0fb851c0a01a tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] [instance: 882eddbf-2173-47ed-92d1-964343380d96] Took 5.62 seconds to spawn the instance on the hypervisor.
Aug 26 10:48:16 user nova-compute[73572]: DEBUG nova.compute.manager [None req-05b8d775-5036-48ca-b92e-0fb851c0a01a tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] [instance: 882eddbf-2173-47ed-92d1-964343380d96] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:48:16 user nova-compute[73572]: INFO nova.compute.manager [None req-05b8d775-5036-48ca-b92e-0fb851c0a01a tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] [instance: 882eddbf-2173-47ed-92d1-964343380d96] Took 6.29 seconds to build instance.
Aug 26 10:48:17 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-05b8d775-5036-48ca-b92e-0fb851c0a01a tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] Lock "882eddbf-2173-47ed-92d1-964343380d96" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.401s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:48:18 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:48:20 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:48:23 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:48:28 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._sync_power_states {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:48:28 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Triggering sync for uuid 5d100a08-eaf2-4132-87dd-a8dcfe17f68f {{(pid=73572) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 10:48:28 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Triggering sync for uuid 882eddbf-2173-47ed-92d1-964343380d96 {{(pid=73572) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 10:48:28 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquiring lock "5d100a08-eaf2-4132-87dd-a8dcfe17f68f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:48:28 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "5d100a08-eaf2-4132-87dd-a8dcfe17f68f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:48:28 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquiring lock "882eddbf-2173-47ed-92d1-964343380d96" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:48:28 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "882eddbf-2173-47ed-92d1-964343380d96" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:48:28 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "5d100a08-eaf2-4132-87dd-a8dcfe17f68f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.026s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:48:28 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "882eddbf-2173-47ed-92d1-964343380d96" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.030s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:48:28 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:48:28 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:48:28 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73572) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 10:48:28 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73572) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 10:48:28 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73572) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 10:48:28 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:48:30 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:48:33 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:48:35 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:48:37 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:48:38 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:48:38 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:48:40 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:48:40 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Starting heal instance info cache {{(pid=73572) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 10:48:40 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Rebuilding the list of instances to heal {{(pid=73572) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 10:48:40 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquiring lock "refresh_cache-5d100a08-eaf2-4132-87dd-a8dcfe17f68f" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:48:40 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquired lock "refresh_cache-5d100a08-eaf2-4132-87dd-a8dcfe17f68f" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:48:40 user nova-compute[73572]: DEBUG nova.network.neutron [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] [instance: 5d100a08-eaf2-4132-87dd-a8dcfe17f68f] Forcefully refreshing network info cache for instance {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 10:48:40 user nova-compute[73572]: DEBUG nova.objects.instance [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lazy-loading 'info_cache' on Instance uuid 5d100a08-eaf2-4132-87dd-a8dcfe17f68f {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:48:40 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:48:41 user nova-compute[73572]: DEBUG nova.network.neutron [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] [instance: 5d100a08-eaf2-4132-87dd-a8dcfe17f68f] Updating instance_info_cache with network_info: [{"id": "efe52e67-0439-4035-988e-daae3acfc823", "address": "fa:16:3e:68:58:83", "network": {"id": "598e1cfa-caaf-470c-ac5a-e91aa2611d1f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1541764581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08b110acd72c427db0de4e98d05f5e56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefe52e67-04", "ovs_interfaceid": "efe52e67-0439-4035-988e-daae3acfc823", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:48:41 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Releasing lock "refresh_cache-5d100a08-eaf2-4132-87dd-a8dcfe17f68f" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:48:41 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] [instance: 5d100a08-eaf2-4132-87dd-a8dcfe17f68f] Updated the network info_cache for instance {{(pid=73572) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 10:48:41 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-403c8c72-8f6d-48b7-8417-6950fbae6a8a tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Acquiring lock "5d100a08-eaf2-4132-87dd-a8dcfe17f68f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:48:41 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-403c8c72-8f6d-48b7-8417-6950fbae6a8a tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Lock "5d100a08-eaf2-4132-87dd-a8dcfe17f68f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:48:41 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-403c8c72-8f6d-48b7-8417-6950fbae6a8a tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Acquiring lock "5d100a08-eaf2-4132-87dd-a8dcfe17f68f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:48:41 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-403c8c72-8f6d-48b7-8417-6950fbae6a8a tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Lock "5d100a08-eaf2-4132-87dd-a8dcfe17f68f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:48:41 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-403c8c72-8f6d-48b7-8417-6950fbae6a8a tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Lock "5d100a08-eaf2-4132-87dd-a8dcfe17f68f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:48:41 user nova-compute[73572]: INFO nova.compute.manager [None req-403c8c72-8f6d-48b7-8417-6950fbae6a8a tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] [instance: 5d100a08-eaf2-4132-87dd-a8dcfe17f68f] Terminating instance
Aug 26 10:48:41 user nova-compute[73572]: DEBUG nova.compute.manager [None req-403c8c72-8f6d-48b7-8417-6950fbae6a8a tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] [instance: 5d100a08-eaf2-4132-87dd-a8dcfe17f68f] Start destroying the instance on the hypervisor. {{(pid=73572) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 10:48:42 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:48:42 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:48:42 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:48:42 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:48:42 user nova-compute[73572]: DEBUG nova.compute.manager [req-d60cb0c2-515f-4a1e-af04-4fcc02bd6162 req-81cbf02d-a3a3-4d8c-ba70-b8ef08668467 service nova] [instance: 5d100a08-eaf2-4132-87dd-a8dcfe17f68f] Received event network-vif-unplugged-efe52e67-0439-4035-988e-daae3acfc823 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:48:42 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-d60cb0c2-515f-4a1e-af04-4fcc02bd6162 req-81cbf02d-a3a3-4d8c-ba70-b8ef08668467 service nova] Acquiring lock "5d100a08-eaf2-4132-87dd-a8dcfe17f68f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:48:42 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-d60cb0c2-515f-4a1e-af04-4fcc02bd6162 req-81cbf02d-a3a3-4d8c-ba70-b8ef08668467 service nova] Lock "5d100a08-eaf2-4132-87dd-a8dcfe17f68f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:48:42 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-d60cb0c2-515f-4a1e-af04-4fcc02bd6162 req-81cbf02d-a3a3-4d8c-ba70-b8ef08668467 service nova] Lock "5d100a08-eaf2-4132-87dd-a8dcfe17f68f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:48:42 user nova-compute[73572]: DEBUG nova.compute.manager [req-d60cb0c2-515f-4a1e-af04-4fcc02bd6162 req-81cbf02d-a3a3-4d8c-ba70-b8ef08668467 service nova] [instance: 5d100a08-eaf2-4132-87dd-a8dcfe17f68f] No waiting events found dispatching network-vif-unplugged-efe52e67-0439-4035-988e-daae3acfc823 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:48:42 user nova-compute[73572]: DEBUG nova.compute.manager [req-d60cb0c2-515f-4a1e-af04-4fcc02bd6162 req-81cbf02d-a3a3-4d8c-ba70-b8ef08668467 service nova] [instance: 5d100a08-eaf2-4132-87dd-a8dcfe17f68f] Received event network-vif-unplugged-efe52e67-0439-4035-988e-daae3acfc823 for instance with task_state deleting. {{(pid=73572) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 10:48:42 user nova-compute[73572]: INFO nova.virt.libvirt.driver [-] [instance: 5d100a08-eaf2-4132-87dd-a8dcfe17f68f] Instance destroyed successfully.
Aug 26 10:48:42 user nova-compute[73572]: DEBUG nova.objects.instance [None req-403c8c72-8f6d-48b7-8417-6950fbae6a8a tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Lazy-loading 'resources' on Instance uuid 5d100a08-eaf2-4132-87dd-a8dcfe17f68f {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:48:42 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-403c8c72-8f6d-48b7-8417-6950fbae6a8a tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T10:40:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-2059362283',display_name='tempest-SnapshotDataIntegrityTests-server-2059362283',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-2059362283',id=50,image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBKdEp0w0UXSvbsLXu31QpCjtLT19TQYHlehd0sPp9NdF2G4q72gh7+ChYSu7QWRPROEJWvRQ9nqCuCO81DqgKOI7Wd/69n7M8zXrBQgmGPg0HiA/bfGSCkqga+t1tS25Q==',key_name='tempest-keypair-663370735',keypairs=<?>,launch_index=0,launched_at=2023-08-26T10:40:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='08b110acd72c427db0de4e98d05f5e56',ramdisk_id='',reservation_id='r-gsabkpwk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-1461246978',owner_user_name='tempest-SnapshotDataIntegrityTests-1461246978-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T10:40:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3ec14c9df0ff443eb6500d15209e001f',uuid=5d100a08-eaf2-4132-87dd-a8dcfe17f68f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "efe52e67-0439-4035-988e-daae3acfc823", "address": "fa:16:3e:68:58:83", "network": {"id": "598e1cfa-caaf-470c-ac5a-e91aa2611d1f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1541764581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08b110acd72c427db0de4e98d05f5e56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefe52e67-04", "ovs_interfaceid": "efe52e67-0439-4035-988e-daae3acfc823", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 10:48:42 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-403c8c72-8f6d-48b7-8417-6950fbae6a8a tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Converting VIF {"id": "efe52e67-0439-4035-988e-daae3acfc823", "address": "fa:16:3e:68:58:83", "network": {"id": "598e1cfa-caaf-470c-ac5a-e91aa2611d1f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1541764581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08b110acd72c427db0de4e98d05f5e56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefe52e67-04", "ovs_interfaceid": "efe52e67-0439-4035-988e-daae3acfc823", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:48:42 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-403c8c72-8f6d-48b7-8417-6950fbae6a8a tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:68:58:83,bridge_name='br-int',has_traffic_filtering=True,id=efe52e67-0439-4035-988e-daae3acfc823,network=Network(598e1cfa-caaf-470c-ac5a-e91aa2611d1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapefe52e67-04') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:48:42 user nova-compute[73572]: DEBUG os_vif [None req-403c8c72-8f6d-48b7-8417-6950fbae6a8a tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:68:58:83,bridge_name='br-int',has_traffic_filtering=True,id=efe52e67-0439-4035-988e-daae3acfc823,network=Network(598e1cfa-caaf-470c-ac5a-e91aa2611d1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapefe52e67-04') {{(pid=73572) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 10:48:42 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:48:42 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapefe52e67-04, bridge=br-int, if_exists=True) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:48:42 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:48:42 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:48:42 user nova-compute[73572]: INFO os_vif [None req-403c8c72-8f6d-48b7-8417-6950fbae6a8a tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:68:58:83,bridge_name='br-int',has_traffic_filtering=True,id=efe52e67-0439-4035-988e-daae3acfc823,network=Network(598e1cfa-caaf-470c-ac5a-e91aa2611d1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapefe52e67-04')
Aug 26 10:48:42 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-403c8c72-8f6d-48b7-8417-6950fbae6a8a tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] [instance: 5d100a08-eaf2-4132-87dd-a8dcfe17f68f] Deleting instance files /opt/stack/data/nova/instances/5d100a08-eaf2-4132-87dd-a8dcfe17f68f_del
Aug 26 10:48:42 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-403c8c72-8f6d-48b7-8417-6950fbae6a8a tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] [instance: 5d100a08-eaf2-4132-87dd-a8dcfe17f68f] Deletion of /opt/stack/data/nova/instances/5d100a08-eaf2-4132-87dd-a8dcfe17f68f_del complete
Aug 26 10:48:42 user nova-compute[73572]: INFO nova.compute.manager [None req-403c8c72-8f6d-48b7-8417-6950fbae6a8a tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] [instance: 5d100a08-eaf2-4132-87dd-a8dcfe17f68f] Took 0.85 seconds to destroy the instance on the hypervisor.
Aug 26 10:48:42 user nova-compute[73572]: DEBUG oslo.service.loopingcall [None req-403c8c72-8f6d-48b7-8417-6950fbae6a8a tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73572) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 10:48:42 user nova-compute[73572]: DEBUG nova.compute.manager [-] [instance: 5d100a08-eaf2-4132-87dd-a8dcfe17f68f] Deallocating network for instance {{(pid=73572) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 10:48:42 user nova-compute[73572]: DEBUG nova.network.neutron [-] [instance: 5d100a08-eaf2-4132-87dd-a8dcfe17f68f] deallocate_for_instance() {{(pid=73572) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 10:48:43 user nova-compute[73572]: DEBUG nova.network.neutron [-] [instance: 5d100a08-eaf2-4132-87dd-a8dcfe17f68f] Updating instance_info_cache with network_info: [] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:48:43 user nova-compute[73572]: INFO nova.compute.manager [-] [instance: 5d100a08-eaf2-4132-87dd-a8dcfe17f68f] Took 0.93 seconds to deallocate network for instance.
Aug 26 10:48:43 user nova-compute[73572]: DEBUG nova.compute.manager [req-392a3d30-6466-447e-a7e3-629d8f64bb3e req-52fb6f29-3d01-4bf1-904b-5f0328a1d2a9 service nova] [instance: 5d100a08-eaf2-4132-87dd-a8dcfe17f68f] Received event network-vif-deleted-efe52e67-0439-4035-988e-daae3acfc823 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:48:43 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-403c8c72-8f6d-48b7-8417-6950fbae6a8a tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:48:43 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-403c8c72-8f6d-48b7-8417-6950fbae6a8a tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:48:43 user nova-compute[73572]: DEBUG nova.compute.provider_tree [None req-403c8c72-8f6d-48b7-8417-6950fbae6a8a tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Inventory has not changed in ProviderTree for provider: e2cec974-59b2-4c77-a53d-a7f4e5a30d75 {{(pid=73572) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 10:48:43 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-403c8c72-8f6d-48b7-8417-6950fbae6a8a tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Inventory has not changed for provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73572) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 10:48:43 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-403c8c72-8f6d-48b7-8417-6950fbae6a8a tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.172s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:48:43 user nova-compute[73572]: INFO nova.scheduler.client.report [None req-403c8c72-8f6d-48b7-8417-6950fbae6a8a tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Deleted allocations for instance 5d100a08-eaf2-4132-87dd-a8dcfe17f68f
Aug 26 10:48:44 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-403c8c72-8f6d-48b7-8417-6950fbae6a8a tempest-SnapshotDataIntegrityTests-1461246978 tempest-SnapshotDataIntegrityTests-1461246978-project-member] Lock "5d100a08-eaf2-4132-87dd-a8dcfe17f68f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.175s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:48:44 user nova-compute[73572]: DEBUG nova.compute.manager [req-a82a72d6-a6e8-47da-815c-cba11a16ab92 req-e8bb598d-f550-4811-b1e3-3d381f783ac2 service nova] [instance: 5d100a08-eaf2-4132-87dd-a8dcfe17f68f] Received event network-vif-plugged-efe52e67-0439-4035-988e-daae3acfc823 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:48:44 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-a82a72d6-a6e8-47da-815c-cba11a16ab92 req-e8bb598d-f550-4811-b1e3-3d381f783ac2 service nova] Acquiring lock "5d100a08-eaf2-4132-87dd-a8dcfe17f68f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:48:44 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-a82a72d6-a6e8-47da-815c-cba11a16ab92 req-e8bb598d-f550-4811-b1e3-3d381f783ac2 service nova] Lock "5d100a08-eaf2-4132-87dd-a8dcfe17f68f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:48:44 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-a82a72d6-a6e8-47da-815c-cba11a16ab92 req-e8bb598d-f550-4811-b1e3-3d381f783ac2 service nova] Lock "5d100a08-eaf2-4132-87dd-a8dcfe17f68f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:48:44 user nova-compute[73572]: DEBUG nova.compute.manager [req-a82a72d6-a6e8-47da-815c-cba11a16ab92 req-e8bb598d-f550-4811-b1e3-3d381f783ac2 service nova] [instance: 5d100a08-eaf2-4132-87dd-a8dcfe17f68f] No waiting events found dispatching network-vif-plugged-efe52e67-0439-4035-988e-daae3acfc823 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:48:44 user nova-compute[73572]: WARNING nova.compute.manager [req-a82a72d6-a6e8-47da-815c-cba11a16ab92 req-e8bb598d-f550-4811-b1e3-3d381f783ac2 service nova] [instance: 5d100a08-eaf2-4132-87dd-a8dcfe17f68f] Received unexpected event network-vif-plugged-efe52e67-0439-4035-988e-daae3acfc823 for instance with vm_state deleted and task_state None.
Aug 26 10:48:45 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:48:46 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:48:46 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:48:46 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:48:46 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:48:46 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:48:46 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Auditing locally available compute resources for user (node: user) {{(pid=73572) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 10:48:46 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/882eddbf-2173-47ed-92d1-964343380d96/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:48:47 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/882eddbf-2173-47ed-92d1-964343380d96/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:48:47 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/882eddbf-2173-47ed-92d1-964343380d96/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:48:47 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/882eddbf-2173-47ed-92d1-964343380d96/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:48:47 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:48:47 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:48:47 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:48:47 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Hypervisor/Node resource view: name=user free_ram=8662MB free_disk=25.126266479492188GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=73572) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 10:48:47 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:48:47 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:48:47 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance 882eddbf-2173-47ed-92d1-964343380d96 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:48:47 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73572) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 10:48:47 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73572) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 10:48:48 user nova-compute[73572]: DEBUG nova.compute.provider_tree [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Inventory has not changed in ProviderTree for provider: e2cec974-59b2-4c77-a53d-a7f4e5a30d75 {{(pid=73572) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 10:48:48 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Inventory has not changed for provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73572) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 10:48:48 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Compute_service record updated for user:user {{(pid=73572) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 10:48:48 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.244s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:48:50 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:48:50 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:48:50 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:48:50 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73572) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 10:48:52 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:48:54 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:48:57 user nova-compute[73572]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693046922.6653333, 5d100a08-eaf2-4132-87dd-a8dcfe17f68f => Stopped> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:48:57 user nova-compute[73572]: INFO nova.compute.manager [-] [instance: 5d100a08-eaf2-4132-87dd-a8dcfe17f68f] VM Stopped (Lifecycle Event)
Aug 26 10:48:57 user nova-compute[73572]: DEBUG nova.compute.manager [None req-3670ee08-63ed-4bd8-9a01-fa53b860c6f2 None None] [instance: 5d100a08-eaf2-4132-87dd-a8dcfe17f68f] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:48:57 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:48:57 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:48:57 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73572) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 10:48:57 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73572) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 10:48:57 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73572) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 10:48:57 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:49:02 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:49:07 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:49:12 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:49:17 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:49:17 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:49:17 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73572) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 10:49:17 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73572) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 10:49:17 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73572) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 10:49:17 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:49:22 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:49:27 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:49:32 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:49:32 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:49:36 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:49:37 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:49:39 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:49:39 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:49:40 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:49:41 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:49:41 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Starting heal instance info cache {{(pid=73572) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 10:49:41 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquiring lock "refresh_cache-882eddbf-2173-47ed-92d1-964343380d96" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:49:41 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquired lock "refresh_cache-882eddbf-2173-47ed-92d1-964343380d96" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:49:41 user nova-compute[73572]: DEBUG nova.network.neutron [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] [instance: 882eddbf-2173-47ed-92d1-964343380d96] Forcefully refreshing network info cache for instance {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 10:49:42 user nova-compute[73572]: DEBUG nova.network.neutron [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] [instance: 882eddbf-2173-47ed-92d1-964343380d96] Updating instance_info_cache with network_info: [{"id": "89e82ce7-b0b8-4a65-a46e-b611b985dd13", "address": "fa:16:3e:7a:23:a2", "network": {"id": "efc34ba2-d981-4ab9-97e9-13ceeb155aef", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-538309683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a124fd1ae2f419587b80fa0726162f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89e82ce7-b0", "ovs_interfaceid": "89e82ce7-b0b8-4a65-a46e-b611b985dd13", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:49:42 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Releasing lock "refresh_cache-882eddbf-2173-47ed-92d1-964343380d96" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:49:42 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] [instance: 882eddbf-2173-47ed-92d1-964343380d96] Updated the network info_cache for instance {{(pid=73572) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 10:49:42 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:49:47 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:49:47 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:49:47 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:49:47 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:49:47 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:49:47 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Auditing locally available compute resources for user (node: user) {{(pid=73572) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 10:49:47 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:49:47 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/882eddbf-2173-47ed-92d1-964343380d96/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:49:48 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/882eddbf-2173-47ed-92d1-964343380d96/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:49:48 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/882eddbf-2173-47ed-92d1-964343380d96/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:49:48 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/882eddbf-2173-47ed-92d1-964343380d96/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:49:48 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:49:48 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:49:48 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Hypervisor/Node resource view: name=user free_ram=8778MB free_disk=25.124858856201172GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=73572) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 10:49:48 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:49:48 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:49:48 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance 882eddbf-2173-47ed-92d1-964343380d96 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:49:48 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73572) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 10:49:48 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73572) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 10:49:48 user nova-compute[73572]: DEBUG nova.compute.provider_tree [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Inventory has not changed in ProviderTree for provider: e2cec974-59b2-4c77-a53d-a7f4e5a30d75 {{(pid=73572) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 10:49:48 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Inventory has not changed for provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73572) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 10:49:48 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Compute_service record updated for user:user {{(pid=73572) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 10:49:48 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.153s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:49:51 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:49:51 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:49:51 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:49:52 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:49:52 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73572) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 10:49:52 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:49:56 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:49:57 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:50:01 user nova-compute[73572]: DEBUG nova.compute.manager [req-67f34dd9-7f7f-4e98-aea8-be0839d43121 req-d5018350-ec23-4c17-ae8e-9638f3cb4e8f service nova] [instance: 882eddbf-2173-47ed-92d1-964343380d96] Received event network-changed-89e82ce7-b0b8-4a65-a46e-b611b985dd13 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:50:01 user nova-compute[73572]: DEBUG nova.compute.manager [req-67f34dd9-7f7f-4e98-aea8-be0839d43121 req-d5018350-ec23-4c17-ae8e-9638f3cb4e8f service nova] [instance: 882eddbf-2173-47ed-92d1-964343380d96] Refreshing instance network info cache due to event network-changed-89e82ce7-b0b8-4a65-a46e-b611b985dd13. {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 10:50:01 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-67f34dd9-7f7f-4e98-aea8-be0839d43121 req-d5018350-ec23-4c17-ae8e-9638f3cb4e8f service nova] Acquiring lock "refresh_cache-882eddbf-2173-47ed-92d1-964343380d96" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:50:01 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-67f34dd9-7f7f-4e98-aea8-be0839d43121 req-d5018350-ec23-4c17-ae8e-9638f3cb4e8f service nova] Acquired lock "refresh_cache-882eddbf-2173-47ed-92d1-964343380d96" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:50:01 user nova-compute[73572]: DEBUG nova.network.neutron [req-67f34dd9-7f7f-4e98-aea8-be0839d43121 req-d5018350-ec23-4c17-ae8e-9638f3cb4e8f service nova] [instance: 882eddbf-2173-47ed-92d1-964343380d96] Refreshing network info cache for port 89e82ce7-b0b8-4a65-a46e-b611b985dd13 {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 10:50:02 user nova-compute[73572]: DEBUG nova.network.neutron [req-67f34dd9-7f7f-4e98-aea8-be0839d43121 req-d5018350-ec23-4c17-ae8e-9638f3cb4e8f service nova] [instance: 882eddbf-2173-47ed-92d1-964343380d96] Updated VIF entry in instance network info cache for port 89e82ce7-b0b8-4a65-a46e-b611b985dd13. {{(pid=73572) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 10:50:02 user nova-compute[73572]: DEBUG nova.network.neutron [req-67f34dd9-7f7f-4e98-aea8-be0839d43121 req-d5018350-ec23-4c17-ae8e-9638f3cb4e8f service nova] [instance: 882eddbf-2173-47ed-92d1-964343380d96] Updating instance_info_cache with network_info: [{"id": "89e82ce7-b0b8-4a65-a46e-b611b985dd13", "address": "fa:16:3e:7a:23:a2", "network": {"id": "efc34ba2-d981-4ab9-97e9-13ceeb155aef", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-538309683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.219", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a124fd1ae2f419587b80fa0726162f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89e82ce7-b0", "ovs_interfaceid": "89e82ce7-b0b8-4a65-a46e-b611b985dd13", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:50:02 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-67f34dd9-7f7f-4e98-aea8-be0839d43121 req-d5018350-ec23-4c17-ae8e-9638f3cb4e8f service nova] Releasing lock "refresh_cache-882eddbf-2173-47ed-92d1-964343380d96" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:50:02 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:50:02 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:50:02 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73572) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 10:50:02 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73572) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 10:50:02 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73572) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 10:50:02 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:50:03 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-afa547fe-0b44-46f2-add1-5f8bebf0097e tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] Acquiring lock "882eddbf-2173-47ed-92d1-964343380d96" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:50:03 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-afa547fe-0b44-46f2-add1-5f8bebf0097e tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] Lock "882eddbf-2173-47ed-92d1-964343380d96" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:50:03 user nova-compute[73572]: DEBUG nova.objects.instance [None req-afa547fe-0b44-46f2-add1-5f8bebf0097e tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] Lazy-loading 'flavor' on Instance uuid 882eddbf-2173-47ed-92d1-964343380d96 {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:50:03 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-afa547fe-0b44-46f2-add1-5f8bebf0097e tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] Lock "882eddbf-2173-47ed-92d1-964343380d96" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:50:04 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-afa547fe-0b44-46f2-add1-5f8bebf0097e tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] Acquiring lock "882eddbf-2173-47ed-92d1-964343380d96" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:50:04 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-afa547fe-0b44-46f2-add1-5f8bebf0097e tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] Lock "882eddbf-2173-47ed-92d1-964343380d96" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:50:04 user nova-compute[73572]: INFO nova.compute.manager [None req-afa547fe-0b44-46f2-add1-5f8bebf0097e tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] [instance: 882eddbf-2173-47ed-92d1-964343380d96] Attaching volume 5803590e-d0bd-4a1e-9291-c30979a0d2a5 to /dev/vdb
Aug 26 10:50:04 user nova-compute[73572]: DEBUG os_brick.utils [None req-afa547fe-0b44-46f2-add1-5f8bebf0097e tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 10:50:04 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:50:04 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:50:04 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed874ad6-1ad7-4eff-8769-b1636bd4d7f2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:de8a79ed912\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:50:04 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:50:04 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:50:04 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dcac2fa-f4db-4fdb-8a15-f8178eea23c8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:50:04 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:50:04 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:50:04 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d4fb970-7f66-479b-9253-58c5cae9f215]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:50:04 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb72c568-2080-473c-82fb-4b76b1b74c3b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:50:04 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-afa547fe-0b44-46f2-add1-5f8bebf0097e tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] Running cmd (subprocess): nvme version {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:50:04 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-afa547fe-0b44-46f2-add1-5f8bebf0097e tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] 'nvme version' failed. Not Retrying. {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 10:50:04 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.nvmeof [None req-afa547fe-0b44-46f2-add1-5f8bebf0097e tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] nvme not present on system {{(pid=73572) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 10:50:04 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:50:04 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 10:50:04 user nova-compute[73572]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 10:50:04 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6b0d209-0fa3-4cec-988a-fb495f73b5cb]: (4, '') {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:50:04 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.lightos [None req-afa547fe-0b44-46f2-add1-5f8bebf0097e tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73572) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 10:50:04 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.lightos [None req-afa547fe-0b44-46f2-add1-5f8bebf0097e tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73572) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 10:50:04 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.lightos [None req-afa547fe-0b44-46f2-add1-5f8bebf0097e tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] LIGHTOS: no hostnqn found. {{(pid=73572) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 10:50:04 user nova-compute[73572]: DEBUG os_brick.utils [None req-afa547fe-0b44-46f2-add1-5f8bebf0097e tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:de8a79ed912', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 10:50:04 user nova-compute[73572]: DEBUG nova.virt.block_device [None req-afa547fe-0b44-46f2-add1-5f8bebf0097e tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] [instance: 882eddbf-2173-47ed-92d1-964343380d96] Updating existing volume attachment record: 7acf38b3-f3c0-43eb-b4a5-6940c1b64f5e {{(pid=73572) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 10:50:05 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:50:07 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:50:10 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:50:12 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:50:14 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-afa547fe-0b44-46f2-add1-5f8bebf0097e tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] [instance: 882eddbf-2173-47ed-92d1-964343380d96] Calling os-brick to attach iSCSI Volume {{(pid=73572) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 10:50:14 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-afa547fe-0b44-46f2-add1-5f8bebf0097e tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc89c3d6a10>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:5803590e-d0bd-4a1e-9291-c30979a0d2a5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qUFZRtVD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 10:50:14 user nova-compute[73572]: WARNING os_brick.initiator.connectors.base [None req-afa547fe-0b44-46f2-add1-5f8bebf0097e tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 10:50:14 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-afa547fe-0b44-46f2-add1-5f8bebf0097e tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 10:50:14 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-afa547fe-0b44-46f2-add1-5f8bebf0097e tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 10:50:14 user nova-compute[73572]: WARNING os_brick.initiator.connectors.base [None req-afa547fe-0b44-46f2-add1-5f8bebf0097e tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 10:50:14 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-afa547fe-0b44-46f2-add1-5f8bebf0097e tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5803590e-d0bd-4a1e-9291-c30979a0d2a5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 10:50:14 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-afa547fe-0b44-46f2-add1-5f8bebf0097e tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5803590e-d0bd-4a1e-9291-c30979a0d2a5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 10:50:14 user nova-compute[73572]: INFO os_brick.initiator.connectors.iscsi [None req-afa547fe-0b44-46f2-add1-5f8bebf0097e tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 10:50:14 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5803590e-d0bd-4a1e-9291-c30979a0d2a5 -p 172.16.0.220:3260 {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:50:14 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5803590e-d0bd-4a1e-9291-c30979a0d2a5 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:50:14 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d664c91-d3ad-4b92-afac-3b1ae4d8a38c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:50:14 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-afa547fe-0b44-46f2-add1-5f8bebf0097e tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 10:50:14 user nova-compute[73572]:  {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:50:14 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5803590e-d0bd-4a1e-9291-c30979a0d2a5 -p 172.16.0.220:3260 --interface default --op new {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:50:14 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5803590e-d0bd-4a1e-9291-c30979a0d2a5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:50:14 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[e586513a-6440-4161-998c-cfa183fcea66]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5803590e-d0bd-4a1e-9291-c30979a0d2a5] added\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:50:14 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-afa547fe-0b44-46f2-add1-5f8bebf0097e tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5803590e-d0bd-4a1e-9291-c30979a0d2a5] added
Aug 26 10:50:14 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:50:14 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5803590e-d0bd-4a1e-9291-c30979a0d2a5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:50:14 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5803590e-d0bd-4a1e-9291-c30979a0d2a5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:50:14 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[42cbce30-6b62-48bf-b0e2-82845a82202d]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:50:14 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-afa547fe-0b44-46f2-add1-5f8bebf0097e tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:50:14 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5803590e-d0bd-4a1e-9291-c30979a0d2a5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:50:14 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5803590e-d0bd-4a1e-9291-c30979a0d2a5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:50:14 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[d90950c3-762b-44b8-a975-8b40125d7d2d]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:50:14 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-afa547fe-0b44-46f2-add1-5f8bebf0097e tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:50:14 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5803590e-d0bd-4a1e-9291-c30979a0d2a5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qUFZRtVD {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:50:14 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5803590e-d0bd-4a1e-9291-c30979a0d2a5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qUFZRtVD" returned: 0 in 0.021s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:50:14 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[18d4637d-f783-4646-acad-b8899859f847]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:50:14 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-afa547fe-0b44-46f2-add1-5f8bebf0097e tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qUFZRtVD'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:50:14 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5803590e-d0bd-4a1e-9291-c30979a0d2a5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:50:14 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5803590e-d0bd-4a1e-9291-c30979a0d2a5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:50:14 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[be683670-9355-4e6d-93ae-a2c6a51939d9]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:50:14 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-afa547fe-0b44-46f2-add1-5f8bebf0097e tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:50:14 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:50:14 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:50:14 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[52b51fc6-21d7-4ab8-8aba-76750ce75b10]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:50:14 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-afa547fe-0b44-46f2-add1-5f8bebf0097e tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 26 10:50:14 user nova-compute[73572]:  {{(pid=73572) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 10:50:14 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-afa547fe-0b44-46f2-add1-5f8bebf0097e tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 26 10:50:14 user nova-compute[73572]:  {{(pid=73572) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 10:50:14 user nova-compute[73572]: WARNING os_brick.initiator.connectors.iscsi [None req-afa547fe-0b44-46f2-add1-5f8bebf0097e tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 26 10:50:14 user nova-compute[73572]: 
Aug 26 10:50:14 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5803590e-d0bd-4a1e-9291-c30979a0d2a5 -p 172.16.0.220:3260 --login {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:50:14 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5803590e-d0bd-4a1e-9291-c30979a0d2a5 -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:50:14 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[04ac4d69-cc3b-4bc2-aed6-a0062b4bf5d4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5803590e-d0bd-4a1e-9291-c30979a0d2a5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5803590e-d0bd-4a1e-9291-c30979a0d2a5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:50:14 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-afa547fe-0b44-46f2-add1-5f8bebf0097e tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5803590e-d0bd-4a1e-9291-c30979a0d2a5, portal: 172.16.0.220,3260]
Aug 26 10:50:14 user nova-compute[73572]: Login to [iface: default, target: iqn.2010-10.org.openstack:5803590e-d0bd-4a1e-9291-c30979a0d2a5, portal: 172.16.0.220,3260] successful.
Aug 26 10:50:14 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:50:14 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5803590e-d0bd-4a1e-9291-c30979a0d2a5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:50:14 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5803590e-d0bd-4a1e-9291-c30979a0d2a5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:50:14 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2b1ab27-9941-427a-9e54-a8eb81c93bdc]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:50:14 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-afa547fe-0b44-46f2-add1-5f8bebf0097e tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:50:14 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:50:14 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:50:14 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[36e2b587-c79d-40b2-86c9-2f25d494bfc9]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5803590e-d0bd-4a1e-9291-c30979a0d2a5 (non-flash)\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:50:14 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-afa547fe-0b44-46f2-add1-5f8bebf0097e tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5803590e-d0bd-4a1e-9291-c30979a0d2a5 (non-flash)
Aug 26 10:50:14 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 10:50:14 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-afa547fe-0b44-46f2-add1-5f8bebf0097e tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5803590e-d0bd-4a1e-9291-c30979a0d2a5 (non-flash)
Aug 26 10:50:14 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 10:50:14 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-afa547fe-0b44-46f2-add1-5f8bebf0097e tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5803590e-d0bd-4a1e-9291-c30979a0d2a5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.249s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 10:50:14 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-afa547fe-0b44-46f2-add1-5f8bebf0097e tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] Connected to 172.16.0.220:3260 {{(pid=73572) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 10:50:14 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-afa547fe-0b44-46f2-add1-5f8bebf0097e tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] HCTL ('33', '-', '-', 0) found on session 62 with lun 0 {{(pid=73572) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 10:50:14 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-afa547fe-0b44-46f2-add1-5f8bebf0097e tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73572) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 10:50:14 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:50:14 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:50:14 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[65d6b77a-e2da-4029-bd1b-26636a82cf43]: (4, ('- - 0', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:50:14 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-afa547fe-0b44-46f2-add1-5f8bebf0097e tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] Searching for a device in session 62 and hctl ['33', '*', '*', 0] yield: None {{(pid=73572) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 10:50:15 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-afa547fe-0b44-46f2-add1-5f8bebf0097e tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] Searching for a device in session 62 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73572) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 10:50:15 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-afa547fe-0b44-46f2-add1-5f8bebf0097e tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qUFZRtVD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73572) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 10:50:15 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-afa547fe-0b44-46f2-add1-5f8bebf0097e tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.282s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 10:50:15 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-afa547fe-0b44-46f2-add1-5f8bebf0097e tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] <== connect_volume: return (1284ms) {'type': 'block', 'scsi_wwn': '26365323132383938', 'path': '/dev/sdb'} {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 10:50:15 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-afa547fe-0b44-46f2-add1-5f8bebf0097e tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] [instance: 882eddbf-2173-47ed-92d1-964343380d96] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26365323132383938', 'path': '/dev/sdb'} {{(pid=73572) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 10:50:15 user nova-compute[73572]: DEBUG nova.objects.instance [None req-afa547fe-0b44-46f2-add1-5f8bebf0097e tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] Lazy-loading 'flavor' on Instance uuid 882eddbf-2173-47ed-92d1-964343380d96 {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:50:15 user nova-compute[73572]: DEBUG nova.virt.libvirt.guest [None req-afa547fe-0b44-46f2-add1-5f8bebf0097e tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 10:50:15 user nova-compute[73572]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 10:50:15 user nova-compute[73572]:   <source dev="/dev/sdb"/>
Aug 26 10:50:15 user nova-compute[73572]:   <target dev="vdb" bus="virtio"/>
Aug 26 10:50:15 user nova-compute[73572]:   <serial>5803590e-d0bd-4a1e-9291-c30979a0d2a5</serial>
Aug 26 10:50:15 user nova-compute[73572]: </disk>
Aug 26 10:50:15 user nova-compute[73572]:  {{(pid=73572) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 10:50:16 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-afa547fe-0b44-46f2-add1-5f8bebf0097e tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] No BDM found with device name vda, not building metadata. {{(pid=73572) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 10:50:16 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-afa547fe-0b44-46f2-add1-5f8bebf0097e tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73572) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 10:50:16 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-afa547fe-0b44-46f2-add1-5f8bebf0097e tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] No VIF found with MAC fa:16:3e:7a:23:a2, not building metadata {{(pid=73572) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 10:50:16 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-afa547fe-0b44-46f2-add1-5f8bebf0097e tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] Lock "882eddbf-2173-47ed-92d1-964343380d96" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.106s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:50:17 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:50:19 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-51d3dc2f-7501-418e-9451-e28c5da2e5ef tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] Acquiring lock "882eddbf-2173-47ed-92d1-964343380d96" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:50:19 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-51d3dc2f-7501-418e-9451-e28c5da2e5ef tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] Lock "882eddbf-2173-47ed-92d1-964343380d96" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:50:19 user nova-compute[73572]: DEBUG nova.objects.instance [None req-51d3dc2f-7501-418e-9451-e28c5da2e5ef tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] Lazy-loading 'flavor' on Instance uuid 882eddbf-2173-47ed-92d1-964343380d96 {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:50:19 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-51d3dc2f-7501-418e-9451-e28c5da2e5ef tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] Lock "882eddbf-2173-47ed-92d1-964343380d96" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:50:19 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-51d3dc2f-7501-418e-9451-e28c5da2e5ef tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] Acquiring lock "882eddbf-2173-47ed-92d1-964343380d96" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:50:19 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-51d3dc2f-7501-418e-9451-e28c5da2e5ef tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] Lock "882eddbf-2173-47ed-92d1-964343380d96" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:50:19 user nova-compute[73572]: INFO nova.compute.manager [None req-51d3dc2f-7501-418e-9451-e28c5da2e5ef tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] [instance: 882eddbf-2173-47ed-92d1-964343380d96] Attaching volume 300a113b-c988-4c8b-b8a9-94325465e302 to /dev/vdc
Aug 26 10:50:19 user nova-compute[73572]: DEBUG os_brick.utils [None req-51d3dc2f-7501-418e-9451-e28c5da2e5ef tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 10:50:19 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:50:19 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:50:19 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[8933bf56-d50d-455e-aeea-c8496ce81d5b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:de8a79ed912\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:50:19 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:50:19 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:50:19 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa4b274d-e655-453a-b177-a552aec6faa3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:50:19 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:50:19 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:50:19 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[40cb165e-a50c-4b0d-b0a5-0842970ac2fb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:50:19 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[25bfa7e4-f2a9-4805-b486-4fccbe82e9db]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:50:19 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-51d3dc2f-7501-418e-9451-e28c5da2e5ef tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] Running cmd (subprocess): nvme version {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:50:19 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-51d3dc2f-7501-418e-9451-e28c5da2e5ef tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] 'nvme version' failed. Not Retrying. {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 10:50:19 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.nvmeof [None req-51d3dc2f-7501-418e-9451-e28c5da2e5ef tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] nvme not present on system {{(pid=73572) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 10:50:19 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:50:19 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 10:50:19 user nova-compute[73572]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 10:50:19 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[35abf9f1-6410-42ce-9416-e2e6fba6ddb4]: (4, '') {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:50:19 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.lightos [None req-51d3dc2f-7501-418e-9451-e28c5da2e5ef tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73572) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 10:50:19 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.lightos [None req-51d3dc2f-7501-418e-9451-e28c5da2e5ef tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73572) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 10:50:19 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.lightos [None req-51d3dc2f-7501-418e-9451-e28c5da2e5ef tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] LIGHTOS: no hostnqn found. {{(pid=73572) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 10:50:19 user nova-compute[73572]: DEBUG os_brick.utils [None req-51d3dc2f-7501-418e-9451-e28c5da2e5ef tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:de8a79ed912', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 10:50:19 user nova-compute[73572]: DEBUG nova.virt.block_device [None req-51d3dc2f-7501-418e-9451-e28c5da2e5ef tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] [instance: 882eddbf-2173-47ed-92d1-964343380d96] Updating existing volume attachment record: 81b06220-d5b8-416c-9422-fb620b0f6751 {{(pid=73572) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 10:50:20 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:50:22 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:50:27 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:50:29 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-51d3dc2f-7501-418e-9451-e28c5da2e5ef tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] [instance: 882eddbf-2173-47ed-92d1-964343380d96] Calling os-brick to attach iSCSI Volume {{(pid=73572) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 10:50:29 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-51d3dc2f-7501-418e-9451-e28c5da2e5ef tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc89c3d6a10>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:300a113b-c988-4c8b-b8a9-94325465e302'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZjCfqXVi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 10:50:29 user nova-compute[73572]: WARNING os_brick.initiator.connectors.base [None req-51d3dc2f-7501-418e-9451-e28c5da2e5ef tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 10:50:29 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-51d3dc2f-7501-418e-9451-e28c5da2e5ef tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 10:50:29 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-51d3dc2f-7501-418e-9451-e28c5da2e5ef tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 10:50:29 user nova-compute[73572]: WARNING os_brick.initiator.connectors.base [None req-51d3dc2f-7501-418e-9451-e28c5da2e5ef tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 10:50:29 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-51d3dc2f-7501-418e-9451-e28c5da2e5ef tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:300a113b-c988-4c8b-b8a9-94325465e302" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 10:50:29 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-51d3dc2f-7501-418e-9451-e28c5da2e5ef tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:300a113b-c988-4c8b-b8a9-94325465e302" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 10:50:29 user nova-compute[73572]: INFO os_brick.initiator.connectors.iscsi [None req-51d3dc2f-7501-418e-9451-e28c5da2e5ef tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 10:50:29 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:300a113b-c988-4c8b-b8a9-94325465e302 -p 172.16.0.220:3260 {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:50:29 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:300a113b-c988-4c8b-b8a9-94325465e302 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:50:29 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cbdaf0d-a534-4b42-beeb-4375cfacb79d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:50:29 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-51d3dc2f-7501-418e-9451-e28c5da2e5ef tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 10:50:29 user nova-compute[73572]:  {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:50:29 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:300a113b-c988-4c8b-b8a9-94325465e302 -p 172.16.0.220:3260 --interface default --op new {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:50:29 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:300a113b-c988-4c8b-b8a9-94325465e302 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:50:29 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca630a64-f2a4-4760-9cd6-285823afc444]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:300a113b-c988-4c8b-b8a9-94325465e302] added\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:50:29 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-51d3dc2f-7501-418e-9451-e28c5da2e5ef tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:300a113b-c988-4c8b-b8a9-94325465e302] added
Aug 26 10:50:29 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:50:29 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:300a113b-c988-4c8b-b8a9-94325465e302 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:50:29 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:300a113b-c988-4c8b-b8a9-94325465e302 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:50:29 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[261d58fb-a0f6-476d-bfbe-3dbf84f39079]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:50:29 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-51d3dc2f-7501-418e-9451-e28c5da2e5ef tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:50:29 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:300a113b-c988-4c8b-b8a9-94325465e302 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:50:29 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:300a113b-c988-4c8b-b8a9-94325465e302 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:50:29 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[e131a66b-093a-4aea-8b02-f45dcaba199b]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:50:29 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-51d3dc2f-7501-418e-9451-e28c5da2e5ef tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:50:29 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:300a113b-c988-4c8b-b8a9-94325465e302 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZjCfqXVi {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:50:29 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:300a113b-c988-4c8b-b8a9-94325465e302 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZjCfqXVi" returned: 0 in 0.017s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:50:29 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[5600c46c-27f5-4fe3-8f0f-27a493567a9e]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:50:29 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-51d3dc2f-7501-418e-9451-e28c5da2e5ef tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZjCfqXVi'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:50:29 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:300a113b-c988-4c8b-b8a9-94325465e302 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:50:29 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:300a113b-c988-4c8b-b8a9-94325465e302 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:50:29 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[97a8798d-3f56-4c04-b026-5374135d81ab]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:50:29 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-51d3dc2f-7501-418e-9451-e28c5da2e5ef tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:50:29 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:50:29 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:50:29 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdd1c37b-fe3b-4c60-8379-f3f5c13521fc]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5803590e-d0bd-4a1e-9291-c30979a0d2a5 (non-flash)\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:50:29 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-51d3dc2f-7501-418e-9451-e28c5da2e5ef tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5803590e-d0bd-4a1e-9291-c30979a0d2a5 (non-flash)
Aug 26 10:50:29 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 10:50:29 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-51d3dc2f-7501-418e-9451-e28c5da2e5ef tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5803590e-d0bd-4a1e-9291-c30979a0d2a5 (non-flash)
Aug 26 10:50:29 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 10:50:29 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:300a113b-c988-4c8b-b8a9-94325465e302 -p 172.16.0.220:3260 --login {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:50:29 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:300a113b-c988-4c8b-b8a9-94325465e302 -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:50:29 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[7142ce07-a4e6-4814-af11-50ec83bee07a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:300a113b-c988-4c8b-b8a9-94325465e302, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:300a113b-c988-4c8b-b8a9-94325465e302, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:50:29 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-51d3dc2f-7501-418e-9451-e28c5da2e5ef tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:300a113b-c988-4c8b-b8a9-94325465e302, portal: 172.16.0.220,3260]
Aug 26 10:50:29 user nova-compute[73572]: Login to [iface: default, target: iqn.2010-10.org.openstack:300a113b-c988-4c8b-b8a9-94325465e302, portal: 172.16.0.220,3260] successful.
Aug 26 10:50:29 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:50:29 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:300a113b-c988-4c8b-b8a9-94325465e302 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:50:30 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:300a113b-c988-4c8b-b8a9-94325465e302 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:50:30 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd28b4bd-44ba-4df3-be0c-43acbfee9b67]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:50:30 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-51d3dc2f-7501-418e-9451-e28c5da2e5ef tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:50:30 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:50:30 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:50:30 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecd278da-c72d-42aa-9465-4a4c698ad830]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5803590e-d0bd-4a1e-9291-c30979a0d2a5 (non-flash)\ntcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:300a113b-c988-4c8b-b8a9-94325465e302 (non-flash)\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:50:30 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-51d3dc2f-7501-418e-9451-e28c5da2e5ef tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5803590e-d0bd-4a1e-9291-c30979a0d2a5 (non-flash)
Aug 26 10:50:30 user nova-compute[73572]: tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:300a113b-c988-4c8b-b8a9-94325465e302 (non-flash)
Aug 26 10:50:30 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 10:50:30 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-51d3dc2f-7501-418e-9451-e28c5da2e5ef tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5803590e-d0bd-4a1e-9291-c30979a0d2a5 (non-flash)
Aug 26 10:50:30 user nova-compute[73572]: tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:300a113b-c988-4c8b-b8a9-94325465e302 (non-flash)
Aug 26 10:50:30 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 10:50:30 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-51d3dc2f-7501-418e-9451-e28c5da2e5ef tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:300a113b-c988-4c8b-b8a9-94325465e302" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.248s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 10:50:30 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-51d3dc2f-7501-418e-9451-e28c5da2e5ef tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] Connected to 172.16.0.220:3260 {{(pid=73572) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 10:50:30 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-51d3dc2f-7501-418e-9451-e28c5da2e5ef tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] HCTL ('34', '-', '-', 0) found on session 63 with lun 0 {{(pid=73572) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 10:50:30 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-51d3dc2f-7501-418e-9451-e28c5da2e5ef tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73572) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 10:50:30 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:50:30 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:50:30 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[bea7cb17-3632-4817-b5a8-55118ed9c4d0]: (4, ('- - 0', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:50:30 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-51d3dc2f-7501-418e-9451-e28c5da2e5ef tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] Searching for a device in session 63 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73572) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 10:50:30 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-51d3dc2f-7501-418e-9451-e28c5da2e5ef tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZjCfqXVi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73572) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 10:50:31 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-51d3dc2f-7501-418e-9451-e28c5da2e5ef tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.278s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 10:50:31 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-51d3dc2f-7501-418e-9451-e28c5da2e5ef tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] <== connect_volume: return (1280ms) {'type': 'block', 'scsi_wwn': '23830303761636134', 'path': '/dev/sdc'} {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 10:50:31 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-51d3dc2f-7501-418e-9451-e28c5da2e5ef tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] [instance: 882eddbf-2173-47ed-92d1-964343380d96] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23830303761636134', 'path': '/dev/sdc'} {{(pid=73572) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 10:50:31 user nova-compute[73572]: DEBUG nova.objects.instance [None req-51d3dc2f-7501-418e-9451-e28c5da2e5ef tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] Lazy-loading 'flavor' on Instance uuid 882eddbf-2173-47ed-92d1-964343380d96 {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:50:31 user nova-compute[73572]: DEBUG nova.virt.libvirt.guest [None req-51d3dc2f-7501-418e-9451-e28c5da2e5ef tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 10:50:31 user nova-compute[73572]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 10:50:31 user nova-compute[73572]:   <source dev="/dev/sdc"/>
Aug 26 10:50:31 user nova-compute[73572]:   <target dev="vdc" bus="virtio"/>
Aug 26 10:50:31 user nova-compute[73572]:   <serial>300a113b-c988-4c8b-b8a9-94325465e302</serial>
Aug 26 10:50:31 user nova-compute[73572]: </disk>
Aug 26 10:50:31 user nova-compute[73572]:  {{(pid=73572) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 10:50:31 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-51d3dc2f-7501-418e-9451-e28c5da2e5ef tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] No BDM found with device name vda, not building metadata. {{(pid=73572) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 10:50:31 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-51d3dc2f-7501-418e-9451-e28c5da2e5ef tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73572) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 10:50:31 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-51d3dc2f-7501-418e-9451-e28c5da2e5ef tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] No BDM found with device name vdc, not building metadata. {{(pid=73572) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 10:50:31 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-51d3dc2f-7501-418e-9451-e28c5da2e5ef tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] No VIF found with MAC fa:16:3e:7a:23:a2, not building metadata {{(pid=73572) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 10:50:31 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-51d3dc2f-7501-418e-9451-e28c5da2e5ef tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] Lock "882eddbf-2173-47ed-92d1-964343380d96" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.033s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:50:32 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:50:32 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-cf595fd4-498e-4f74-b20f-db34b547d8fa tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] Acquiring lock "882eddbf-2173-47ed-92d1-964343380d96" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:50:32 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-cf595fd4-498e-4f74-b20f-db34b547d8fa tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] Lock "882eddbf-2173-47ed-92d1-964343380d96" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:50:32 user nova-compute[73572]: INFO nova.compute.manager [None req-cf595fd4-498e-4f74-b20f-db34b547d8fa tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] [instance: 882eddbf-2173-47ed-92d1-964343380d96] Detaching volume 300a113b-c988-4c8b-b8a9-94325465e302
Aug 26 10:50:33 user nova-compute[73572]: INFO nova.virt.block_device [None req-cf595fd4-498e-4f74-b20f-db34b547d8fa tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] [instance: 882eddbf-2173-47ed-92d1-964343380d96] Attempting to driver detach volume 300a113b-c988-4c8b-b8a9-94325465e302 from mountpoint /dev/vdc
Aug 26 10:50:33 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-cf595fd4-498e-4f74-b20f-db34b547d8fa tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] Attempting to detach device vdc from instance 882eddbf-2173-47ed-92d1-964343380d96 from the persistent domain config. {{(pid=73572) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 10:50:33 user nova-compute[73572]: DEBUG nova.virt.libvirt.guest [None req-cf595fd4-498e-4f74-b20f-db34b547d8fa tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 10:50:33 user nova-compute[73572]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 10:50:33 user nova-compute[73572]:   <source dev="/dev/sdc"/>
Aug 26 10:50:33 user nova-compute[73572]:   <target dev="vdc" bus="virtio"/>
Aug 26 10:50:33 user nova-compute[73572]:   <serial>300a113b-c988-4c8b-b8a9-94325465e302</serial>
Aug 26 10:50:33 user nova-compute[73572]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 26 10:50:33 user nova-compute[73572]: </disk>
Aug 26 10:50:33 user nova-compute[73572]:  {{(pid=73572) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 10:50:33 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-cf595fd4-498e-4f74-b20f-db34b547d8fa tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] Successfully detached device vdc from instance 882eddbf-2173-47ed-92d1-964343380d96 from the persistent domain config.
Aug 26 10:50:33 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-cf595fd4-498e-4f74-b20f-db34b547d8fa tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 882eddbf-2173-47ed-92d1-964343380d96 from the live domain config. {{(pid=73572) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 10:50:33 user nova-compute[73572]: DEBUG nova.virt.libvirt.guest [None req-cf595fd4-498e-4f74-b20f-db34b547d8fa tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 10:50:33 user nova-compute[73572]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 10:50:33 user nova-compute[73572]:   <source dev="/dev/sdc"/>
Aug 26 10:50:33 user nova-compute[73572]:   <target dev="vdc" bus="virtio"/>
Aug 26 10:50:33 user nova-compute[73572]:   <serial>300a113b-c988-4c8b-b8a9-94325465e302</serial>
Aug 26 10:50:33 user nova-compute[73572]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 26 10:50:33 user nova-compute[73572]: </disk>
Aug 26 10:50:33 user nova-compute[73572]:  {{(pid=73572) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 10:50:33 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Received event <DeviceRemovedEvent: 1693047033.4979875, 882eddbf-2173-47ed-92d1-964343380d96 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=73572) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 10:50:33 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-cf595fd4-498e-4f74-b20f-db34b547d8fa tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 882eddbf-2173-47ed-92d1-964343380d96 {{(pid=73572) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 10:50:33 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-cf595fd4-498e-4f74-b20f-db34b547d8fa tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] Successfully detached device vdc from instance 882eddbf-2173-47ed-92d1-964343380d96 from the live domain config.
Aug 26 10:50:33 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cf595fd4-498e-4f74-b20f-db34b547d8fa tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] [instance: 882eddbf-2173-47ed-92d1-964343380d96] calling os-brick to detach iSCSI Volume {{(pid=73572) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 10:50:33 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf595fd4-498e-4f74-b20f-db34b547d8fa tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc89c3d6a10>, {'target_iqns': ['iqn.2010-10.org.openstack:300a113b-c988-4c8b-b8a9-94325465e302'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZjCfqXVi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 10:50:33 user nova-compute[73572]: WARNING os_brick.initiator.connectors.base [None req-cf595fd4-498e-4f74-b20f-db34b547d8fa tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 10:50:33 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-cf595fd4-498e-4f74-b20f-db34b547d8fa tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 10:50:33 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-cf595fd4-498e-4f74-b20f-db34b547d8fa tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 10:50:33 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf595fd4-498e-4f74-b20f-db34b547d8fa tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:300a113b-c988-4c8b-b8a9-94325465e302', 0)] {{(pid=73572) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 10:50:33 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:50:33 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:50:33 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[866bd0ec-8921-48f8-98c1-edba2e1a152e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:300a113b-c988-4c8b-b8a9-94325465e302\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5803590e-d0bd-4a1e-9291-c30979a0d2a5\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:50:33 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:50:33 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:50:33 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b282333-1ace-4aa1-99ae-40c5b36e36e5]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5803590e-d0bd-4a1e-9291-c30979a0d2a5 (non-flash)\ntcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:300a113b-c988-4c8b-b8a9-94325465e302 (non-flash)\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:50:33 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf595fd4-498e-4f74-b20f-db34b547d8fa tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5803590e-d0bd-4a1e-9291-c30979a0d2a5 (non-flash)
Aug 26 10:50:33 user nova-compute[73572]: tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:300a113b-c988-4c8b-b8a9-94325465e302 (non-flash)
Aug 26 10:50:33 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 10:50:33 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf595fd4-498e-4f74-b20f-db34b547d8fa tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5803590e-d0bd-4a1e-9291-c30979a0d2a5 (non-flash)
Aug 26 10:50:33 user nova-compute[73572]: tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:300a113b-c988-4c8b-b8a9-94325465e302 (non-flash)
Aug 26 10:50:33 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 10:50:33 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf595fd4-498e-4f74-b20f-db34b547d8fa tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc878a893f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:300a113b-c988-4c8b-b8a9-94325465e302'): ({'sdc'}, set())}) {{(pid=73572) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 10:50:33 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-cf595fd4-498e-4f74-b20f-db34b547d8fa tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] Removing single pathed devices sdc {{(pid=73572) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 10:50:33 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:50:33 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:50:33 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[225ce350-0849-4850-a5b2-d29e5c6b0d55]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:50:33 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:50:33 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:50:33 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[640b6084-3980-419b-b69e-e9e30628c667]: (4, ('ok\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:50:33 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-cf595fd4-498e-4f74-b20f-db34b547d8fa tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] Flushing IO for device /dev/sdc {{(pid=73572) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 10:50:33 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:50:33 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:50:33 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[04ace299-f13a-4846-85a0-0d3c40bed592]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:50:33 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-cf595fd4-498e-4f74-b20f-db34b547d8fa tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73572) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 10:50:33 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:50:33 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.054s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:50:33 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d903e03-c08e-4e14-bc7f-9eb56b5c74ca]: (4, ('1', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:50:33 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-cf595fd4-498e-4f74-b20f-db34b547d8fa tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73572) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 10:50:33 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-cf595fd4-498e-4f74-b20f-db34b547d8fa tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] SCSI volumes sdc have been removed. {{(pid=73572) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 10:50:33 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf595fd4-498e-4f74-b20f-db34b547d8fa tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:300a113b-c988-4c8b-b8a9-94325465e302')] {{(pid=73572) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 10:50:33 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:300a113b-c988-4c8b-b8a9-94325465e302 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:50:33 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:300a113b-c988-4c8b-b8a9-94325465e302 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:50:33 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5af5686-707b-4e5b-a723-2088c924b80b]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:50:33 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf595fd4-498e-4f74-b20f-db34b547d8fa tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:50:33 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:300a113b-c988-4c8b-b8a9-94325465e302 -p 172.16.0.220:3260 --logout {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:50:33 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:300a113b-c988-4c8b-b8a9-94325465e302 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:50:33 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4a73da5-86a4-450c-9dd8-419a2b23aefe]: (4, ('Logging out of session [sid: 63, target: iqn.2010-10.org.openstack:300a113b-c988-4c8b-b8a9-94325465e302, portal: 172.16.0.220,3260]\nLogout of [sid: 63, target: iqn.2010-10.org.openstack:300a113b-c988-4c8b-b8a9-94325465e302, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:50:33 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf595fd4-498e-4f74-b20f-db34b547d8fa tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 63, target: iqn.2010-10.org.openstack:300a113b-c988-4c8b-b8a9-94325465e302, portal: 172.16.0.220,3260]
Aug 26 10:50:33 user nova-compute[73572]: Logout of [sid: 63, target: iqn.2010-10.org.openstack:300a113b-c988-4c8b-b8a9-94325465e302, portal: 172.16.0.220,3260] successful.
Aug 26 10:50:33 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:50:33 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:300a113b-c988-4c8b-b8a9-94325465e302 -p 172.16.0.220:3260 --op delete {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:50:33 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:300a113b-c988-4c8b-b8a9-94325465e302 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:50:33 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[176db1c9-dcb1-4250-ac54-99c89ea2f53f]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:50:33 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf595fd4-498e-4f74-b20f-db34b547d8fa tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:50:33 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-cf595fd4-498e-4f74-b20f-db34b547d8fa tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.278s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 10:50:33 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf595fd4-498e-4f74-b20f-db34b547d8fa tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] <== disconnect_volume: return (279ms) None {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 10:50:33 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cf595fd4-498e-4f74-b20f-db34b547d8fa tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] [instance: 882eddbf-2173-47ed-92d1-964343380d96] Disconnected iSCSI Volume {{(pid=73572) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 10:50:34 user nova-compute[73572]: DEBUG nova.objects.instance [None req-cf595fd4-498e-4f74-b20f-db34b547d8fa tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] Lazy-loading 'flavor' on Instance uuid 882eddbf-2173-47ed-92d1-964343380d96 {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:50:34 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-cf595fd4-498e-4f74-b20f-db34b547d8fa tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] Lock "882eddbf-2173-47ed-92d1-964343380d96" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.845s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:50:35 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:50:37 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:50:41 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:50:42 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:50:42 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:50:43 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:50:43 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Starting heal instance info cache {{(pid=73572) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 10:50:43 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Rebuilding the list of instances to heal {{(pid=73572) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 10:50:43 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquiring lock "refresh_cache-882eddbf-2173-47ed-92d1-964343380d96" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:50:43 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquired lock "refresh_cache-882eddbf-2173-47ed-92d1-964343380d96" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:50:43 user nova-compute[73572]: DEBUG nova.network.neutron [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] [instance: 882eddbf-2173-47ed-92d1-964343380d96] Forcefully refreshing network info cache for instance {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 10:50:43 user nova-compute[73572]: DEBUG nova.objects.instance [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lazy-loading 'info_cache' on Instance uuid 882eddbf-2173-47ed-92d1-964343380d96 {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:50:44 user nova-compute[73572]: DEBUG nova.network.neutron [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] [instance: 882eddbf-2173-47ed-92d1-964343380d96] Updating instance_info_cache with network_info: [{"id": "89e82ce7-b0b8-4a65-a46e-b611b985dd13", "address": "fa:16:3e:7a:23:a2", "network": {"id": "efc34ba2-d981-4ab9-97e9-13ceeb155aef", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-538309683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.219", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a124fd1ae2f419587b80fa0726162f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89e82ce7-b0", "ovs_interfaceid": "89e82ce7-b0b8-4a65-a46e-b611b985dd13", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:50:44 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Releasing lock "refresh_cache-882eddbf-2173-47ed-92d1-964343380d96" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:50:44 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] [instance: 882eddbf-2173-47ed-92d1-964343380d96] Updated the network info_cache for instance {{(pid=73572) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 10:50:47 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:50:47 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:50:47 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73572) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 10:50:47 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73572) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 10:50:47 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73572) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 10:50:47 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:50:48 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:50:48 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:50:48 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:50:48 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:50:48 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Auditing locally available compute resources for user (node: user) {{(pid=73572) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 10:50:48 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/882eddbf-2173-47ed-92d1-964343380d96/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:50:49 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/882eddbf-2173-47ed-92d1-964343380d96/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:50:49 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/882eddbf-2173-47ed-92d1-964343380d96/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:50:49 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/882eddbf-2173-47ed-92d1-964343380d96/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:50:49 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73572) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 10:50:49 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:50:49 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:50:49 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Hypervisor/Node resource view: name=user free_ram=8739MB free_disk=25.123226165771484GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=73572) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 10:50:49 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:50:49 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:50:49 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance 882eddbf-2173-47ed-92d1-964343380d96 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:50:49 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73572) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 10:50:49 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73572) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 10:50:49 user nova-compute[73572]: DEBUG nova.compute.provider_tree [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Inventory has not changed in ProviderTree for provider: e2cec974-59b2-4c77-a53d-a7f4e5a30d75 {{(pid=73572) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 10:50:49 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Inventory has not changed for provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73572) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 10:50:49 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Compute_service record updated for user:user {{(pid=73572) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 10:50:49 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.171s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:50:50 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:50:50 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:50:52 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:50:52 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:50:54 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:50:54 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73572) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 10:50:57 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:50:58 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:51:02 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:51:07 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:51:12 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:51:17 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:51:22 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:51:23 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-f1f25a89-b5df-4d75-81fd-b0bfebeffad1 tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] Acquiring lock "882eddbf-2173-47ed-92d1-964343380d96" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:51:23 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-f1f25a89-b5df-4d75-81fd-b0bfebeffad1 tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] Lock "882eddbf-2173-47ed-92d1-964343380d96" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:51:23 user nova-compute[73572]: INFO nova.compute.manager [None req-f1f25a89-b5df-4d75-81fd-b0bfebeffad1 tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] [instance: 882eddbf-2173-47ed-92d1-964343380d96] Detaching volume 5803590e-d0bd-4a1e-9291-c30979a0d2a5
Aug 26 10:51:23 user nova-compute[73572]: INFO nova.virt.block_device [None req-f1f25a89-b5df-4d75-81fd-b0bfebeffad1 tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] [instance: 882eddbf-2173-47ed-92d1-964343380d96] Attempting to driver detach volume 5803590e-d0bd-4a1e-9291-c30979a0d2a5 from mountpoint /dev/vdb
Aug 26 10:51:23 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-f1f25a89-b5df-4d75-81fd-b0bfebeffad1 tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] Attempting to detach device vdb from instance 882eddbf-2173-47ed-92d1-964343380d96 from the persistent domain config. {{(pid=73572) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 10:51:23 user nova-compute[73572]: DEBUG nova.virt.libvirt.guest [None req-f1f25a89-b5df-4d75-81fd-b0bfebeffad1 tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 10:51:23 user nova-compute[73572]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 10:51:23 user nova-compute[73572]:   <source dev="/dev/sdb"/>
Aug 26 10:51:23 user nova-compute[73572]:   <target dev="vdb" bus="virtio"/>
Aug 26 10:51:23 user nova-compute[73572]:   <serial>5803590e-d0bd-4a1e-9291-c30979a0d2a5</serial>
Aug 26 10:51:23 user nova-compute[73572]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 10:51:23 user nova-compute[73572]: </disk>
Aug 26 10:51:23 user nova-compute[73572]:  {{(pid=73572) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 10:51:23 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-f1f25a89-b5df-4d75-81fd-b0bfebeffad1 tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] Successfully detached device vdb from instance 882eddbf-2173-47ed-92d1-964343380d96 from the persistent domain config.
Aug 26 10:51:23 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-f1f25a89-b5df-4d75-81fd-b0bfebeffad1 tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 882eddbf-2173-47ed-92d1-964343380d96 from the live domain config. {{(pid=73572) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 10:51:23 user nova-compute[73572]: DEBUG nova.virt.libvirt.guest [None req-f1f25a89-b5df-4d75-81fd-b0bfebeffad1 tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 10:51:23 user nova-compute[73572]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 10:51:23 user nova-compute[73572]:   <source dev="/dev/sdb"/>
Aug 26 10:51:23 user nova-compute[73572]:   <target dev="vdb" bus="virtio"/>
Aug 26 10:51:23 user nova-compute[73572]:   <serial>5803590e-d0bd-4a1e-9291-c30979a0d2a5</serial>
Aug 26 10:51:23 user nova-compute[73572]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 10:51:23 user nova-compute[73572]: </disk>
Aug 26 10:51:23 user nova-compute[73572]:  {{(pid=73572) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 10:51:23 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Received event <DeviceRemovedEvent: 1693047083.7396557, 882eddbf-2173-47ed-92d1-964343380d96 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73572) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 10:51:23 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-f1f25a89-b5df-4d75-81fd-b0bfebeffad1 tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 882eddbf-2173-47ed-92d1-964343380d96 {{(pid=73572) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 10:51:23 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-f1f25a89-b5df-4d75-81fd-b0bfebeffad1 tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] Successfully detached device vdb from instance 882eddbf-2173-47ed-92d1-964343380d96 from the live domain config.
Aug 26 10:51:23 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f1f25a89-b5df-4d75-81fd-b0bfebeffad1 tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] [instance: 882eddbf-2173-47ed-92d1-964343380d96] calling os-brick to detach iSCSI Volume {{(pid=73572) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 10:51:23 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1f25a89-b5df-4d75-81fd-b0bfebeffad1 tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc89c3d6a10>, {'target_iqns': ['iqn.2010-10.org.openstack:5803590e-d0bd-4a1e-9291-c30979a0d2a5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qUFZRtVD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 10:51:23 user nova-compute[73572]: WARNING os_brick.initiator.connectors.base [None req-f1f25a89-b5df-4d75-81fd-b0bfebeffad1 tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 10:51:23 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-f1f25a89-b5df-4d75-81fd-b0bfebeffad1 tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 10:51:23 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-f1f25a89-b5df-4d75-81fd-b0bfebeffad1 tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 10:51:23 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1f25a89-b5df-4d75-81fd-b0bfebeffad1 tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5803590e-d0bd-4a1e-9291-c30979a0d2a5', 0)] {{(pid=73572) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 10:51:23 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:51:23 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:51:23 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[c17c7244-f5e9-4ccf-aa49-858c1f67d2e4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5803590e-d0bd-4a1e-9291-c30979a0d2a5\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:51:23 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:51:23 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:51:23 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6322994-81a9-4fa6-bd62-c7bef45d4a6a]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5803590e-d0bd-4a1e-9291-c30979a0d2a5 (non-flash)\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:51:23 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1f25a89-b5df-4d75-81fd-b0bfebeffad1 tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5803590e-d0bd-4a1e-9291-c30979a0d2a5 (non-flash)
Aug 26 10:51:23 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 10:51:23 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1f25a89-b5df-4d75-81fd-b0bfebeffad1 tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5803590e-d0bd-4a1e-9291-c30979a0d2a5 (non-flash)
Aug 26 10:51:23 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 10:51:23 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1f25a89-b5df-4d75-81fd-b0bfebeffad1 tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc878c0b7f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5803590e-d0bd-4a1e-9291-c30979a0d2a5'): ({'sdb'}, set())}) {{(pid=73572) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 10:51:23 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-f1f25a89-b5df-4d75-81fd-b0bfebeffad1 tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] Removing single pathed devices sdb {{(pid=73572) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 10:51:23 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:51:23 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:51:23 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[df9864fd-15b6-4f11-95c2-97166f69bfc1]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:51:23 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:51:23 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:51:23 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5742e2b-da2f-44e4-aed1-c9098e705e28]: (4, ('ok\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:51:23 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-f1f25a89-b5df-4d75-81fd-b0bfebeffad1 tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] Flushing IO for device /dev/sdb {{(pid=73572) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 10:51:23 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:51:23 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:51:23 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c80498c-4fcc-446b-9884-73951934ccaf]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:51:23 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-f1f25a89-b5df-4d75-81fd-b0bfebeffad1 tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73572) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 10:51:23 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:51:23 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:51:23 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e81db0d-fb45-43b6-99d0-e0b648a2a5dc]: (4, ('1', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:51:23 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-f1f25a89-b5df-4d75-81fd-b0bfebeffad1 tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73572) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 10:51:23 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-f1f25a89-b5df-4d75-81fd-b0bfebeffad1 tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] SCSI volumes sdb have been removed. {{(pid=73572) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 10:51:23 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1f25a89-b5df-4d75-81fd-b0bfebeffad1 tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5803590e-d0bd-4a1e-9291-c30979a0d2a5')] {{(pid=73572) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 10:51:23 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5803590e-d0bd-4a1e-9291-c30979a0d2a5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:51:23 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5803590e-d0bd-4a1e-9291-c30979a0d2a5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:51:23 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[e970298a-8814-4022-bbe4-901331a58777]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:51:23 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1f25a89-b5df-4d75-81fd-b0bfebeffad1 tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:51:23 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5803590e-d0bd-4a1e-9291-c30979a0d2a5 -p 172.16.0.220:3260 --logout {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:51:23 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5803590e-d0bd-4a1e-9291-c30979a0d2a5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:51:23 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a7ceec8-b3e6-42b2-89e8-ae2555d595ff]: (4, ('Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:5803590e-d0bd-4a1e-9291-c30979a0d2a5, portal: 172.16.0.220,3260]\nLogout of [sid: 62, target: iqn.2010-10.org.openstack:5803590e-d0bd-4a1e-9291-c30979a0d2a5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:51:23 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1f25a89-b5df-4d75-81fd-b0bfebeffad1 tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:5803590e-d0bd-4a1e-9291-c30979a0d2a5, portal: 172.16.0.220,3260]
Aug 26 10:51:23 user nova-compute[73572]: Logout of [sid: 62, target: iqn.2010-10.org.openstack:5803590e-d0bd-4a1e-9291-c30979a0d2a5, portal: 172.16.0.220,3260] successful.
Aug 26 10:51:23 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:51:23 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5803590e-d0bd-4a1e-9291-c30979a0d2a5 -p 172.16.0.220:3260 --op delete {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:51:24 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5803590e-d0bd-4a1e-9291-c30979a0d2a5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:51:24 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c767dd9-9f29-4436-bc40-300832d896e9]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:51:24 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1f25a89-b5df-4d75-81fd-b0bfebeffad1 tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:51:24 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-f1f25a89-b5df-4d75-81fd-b0bfebeffad1 tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.257s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 10:51:24 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1f25a89-b5df-4d75-81fd-b0bfebeffad1 tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] <== disconnect_volume: return (258ms) None {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 10:51:24 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f1f25a89-b5df-4d75-81fd-b0bfebeffad1 tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] [instance: 882eddbf-2173-47ed-92d1-964343380d96] Disconnected iSCSI Volume {{(pid=73572) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 10:51:24 user nova-compute[73572]: DEBUG nova.objects.instance [None req-f1f25a89-b5df-4d75-81fd-b0bfebeffad1 tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] Lazy-loading 'flavor' on Instance uuid 882eddbf-2173-47ed-92d1-964343380d96 {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:51:24 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-f1f25a89-b5df-4d75-81fd-b0bfebeffad1 tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] Lock "882eddbf-2173-47ed-92d1-964343380d96" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.606s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:51:27 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:51:32 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:51:32 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:51:32 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73572) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 10:51:32 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73572) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 10:51:32 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73572) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 10:51:32 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:51:37 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:51:41 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:51:42 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:51:43 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:51:45 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:51:45 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Starting heal instance info cache {{(pid=73572) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 10:51:45 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Rebuilding the list of instances to heal {{(pid=73572) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 10:51:45 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquiring lock "refresh_cache-882eddbf-2173-47ed-92d1-964343380d96" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:51:45 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquired lock "refresh_cache-882eddbf-2173-47ed-92d1-964343380d96" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:51:45 user nova-compute[73572]: DEBUG nova.network.neutron [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] [instance: 882eddbf-2173-47ed-92d1-964343380d96] Forcefully refreshing network info cache for instance {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 10:51:45 user nova-compute[73572]: DEBUG nova.objects.instance [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lazy-loading 'info_cache' on Instance uuid 882eddbf-2173-47ed-92d1-964343380d96 {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:51:46 user nova-compute[73572]: DEBUG nova.network.neutron [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] [instance: 882eddbf-2173-47ed-92d1-964343380d96] Updating instance_info_cache with network_info: [{"id": "89e82ce7-b0b8-4a65-a46e-b611b985dd13", "address": "fa:16:3e:7a:23:a2", "network": {"id": "efc34ba2-d981-4ab9-97e9-13ceeb155aef", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-538309683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.219", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a124fd1ae2f419587b80fa0726162f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89e82ce7-b0", "ovs_interfaceid": "89e82ce7-b0b8-4a65-a46e-b611b985dd13", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:51:46 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Releasing lock "refresh_cache-882eddbf-2173-47ed-92d1-964343380d96" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:51:46 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] [instance: 882eddbf-2173-47ed-92d1-964343380d96] Updated the network info_cache for instance {{(pid=73572) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 10:51:48 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:51:48 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:51:48 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73572) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 10:51:48 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73572) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 10:51:48 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73572) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 10:51:48 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:51:48 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:51:48 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:51:48 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:51:48 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:51:48 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Auditing locally available compute resources for user (node: user) {{(pid=73572) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 10:51:48 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/882eddbf-2173-47ed-92d1-964343380d96/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:51:49 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/882eddbf-2173-47ed-92d1-964343380d96/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:51:49 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/882eddbf-2173-47ed-92d1-964343380d96/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:51:49 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/882eddbf-2173-47ed-92d1-964343380d96/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:51:49 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:51:49 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:51:49 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Hypervisor/Node resource view: name=user free_ram=8750MB free_disk=25.122554779052734GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=73572) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 10:51:49 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:51:49 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:51:49 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance 882eddbf-2173-47ed-92d1-964343380d96 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:51:49 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73572) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 10:51:49 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73572) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 10:51:49 user nova-compute[73572]: DEBUG nova.compute.provider_tree [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Inventory has not changed in ProviderTree for provider: e2cec974-59b2-4c77-a53d-a7f4e5a30d75 {{(pid=73572) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 10:51:49 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Inventory has not changed for provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73572) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 10:51:49 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Compute_service record updated for user:user {{(pid=73572) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 10:51:49 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.151s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:51:51 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:51:51 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:51:52 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:51:52 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:51:53 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:51:55 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:51:55 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73572) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 10:51:58 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:51:59 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:52:03 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:52:08 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:52:08 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:52:08 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73572) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 10:52:08 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73572) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 10:52:08 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73572) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 10:52:08 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:52:13 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:52:13 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-21600627-4ef5-47de-8825-e2cba3347a9d tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] Acquiring lock "882eddbf-2173-47ed-92d1-964343380d96" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:52:13 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-21600627-4ef5-47de-8825-e2cba3347a9d tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] Lock "882eddbf-2173-47ed-92d1-964343380d96" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:52:13 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-21600627-4ef5-47de-8825-e2cba3347a9d tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] Acquiring lock "882eddbf-2173-47ed-92d1-964343380d96-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:52:13 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-21600627-4ef5-47de-8825-e2cba3347a9d tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] Lock "882eddbf-2173-47ed-92d1-964343380d96-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:52:13 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-21600627-4ef5-47de-8825-e2cba3347a9d tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] Lock "882eddbf-2173-47ed-92d1-964343380d96-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:52:13 user nova-compute[73572]: INFO nova.compute.manager [None req-21600627-4ef5-47de-8825-e2cba3347a9d tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] [instance: 882eddbf-2173-47ed-92d1-964343380d96] Terminating instance
Aug 26 10:52:13 user nova-compute[73572]: DEBUG nova.compute.manager [None req-21600627-4ef5-47de-8825-e2cba3347a9d tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] [instance: 882eddbf-2173-47ed-92d1-964343380d96] Start destroying the instance on the hypervisor. {{(pid=73572) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 10:52:13 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:52:13 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:52:13 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:52:13 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:52:13 user nova-compute[73572]: DEBUG nova.compute.manager [req-f381307b-ade5-43de-bba2-9ce029c319ec req-f4ec959d-0cc0-4152-9507-673faf4f8cf4 service nova] [instance: 882eddbf-2173-47ed-92d1-964343380d96] Received event network-vif-unplugged-89e82ce7-b0b8-4a65-a46e-b611b985dd13 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:52:13 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-f381307b-ade5-43de-bba2-9ce029c319ec req-f4ec959d-0cc0-4152-9507-673faf4f8cf4 service nova] Acquiring lock "882eddbf-2173-47ed-92d1-964343380d96-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:52:13 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-f381307b-ade5-43de-bba2-9ce029c319ec req-f4ec959d-0cc0-4152-9507-673faf4f8cf4 service nova] Lock "882eddbf-2173-47ed-92d1-964343380d96-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:52:13 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-f381307b-ade5-43de-bba2-9ce029c319ec req-f4ec959d-0cc0-4152-9507-673faf4f8cf4 service nova] Lock "882eddbf-2173-47ed-92d1-964343380d96-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:52:13 user nova-compute[73572]: DEBUG nova.compute.manager [req-f381307b-ade5-43de-bba2-9ce029c319ec req-f4ec959d-0cc0-4152-9507-673faf4f8cf4 service nova] [instance: 882eddbf-2173-47ed-92d1-964343380d96] No waiting events found dispatching network-vif-unplugged-89e82ce7-b0b8-4a65-a46e-b611b985dd13 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:52:13 user nova-compute[73572]: DEBUG nova.compute.manager [req-f381307b-ade5-43de-bba2-9ce029c319ec req-f4ec959d-0cc0-4152-9507-673faf4f8cf4 service nova] [instance: 882eddbf-2173-47ed-92d1-964343380d96] Received event network-vif-unplugged-89e82ce7-b0b8-4a65-a46e-b611b985dd13 for instance with task_state deleting. {{(pid=73572) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 10:52:14 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:52:14 user nova-compute[73572]: INFO nova.virt.libvirt.driver [-] [instance: 882eddbf-2173-47ed-92d1-964343380d96] Instance destroyed successfully.
Aug 26 10:52:14 user nova-compute[73572]: DEBUG nova.objects.instance [None req-21600627-4ef5-47de-8825-e2cba3347a9d tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] Lazy-loading 'resources' on Instance uuid 882eddbf-2173-47ed-92d1-964343380d96 {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:52:14 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-21600627-4ef5-47de-8825-e2cba3347a9d tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T10:48:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1113939593',display_name='tempest-TestServerVolumeAttachmentScenario-server-1113939593',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1113939593',id=52,image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE7aOgXOfrPjTgKc0lHTbqjtIlGsU4/M/K2s8wKzLXm9z3xW3dqaJYxMT2k6tc6rvwd8tX8DTTcWpSrJUZWSeYsWAl0lkVhskn8gOF5UldBDzBRsah4jALVFxFCpnAHGlw==',key_name='tempest-keypair-509735975',keypairs=<?>,launch_index=0,launched_at=2023-08-26T10:48:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4a124fd1ae2f419587b80fa0726162f2',ramdisk_id='',reservation_id='r-3r006h5s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1456898794',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1456898794-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T10:48:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d024076057ad4efc8cec0c6b126b432c',uuid=882eddbf-2173-47ed-92d1-964343380d96,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "89e82ce7-b0b8-4a65-a46e-b611b985dd13", "address": "fa:16:3e:7a:23:a2", "network": {"id": "efc34ba2-d981-4ab9-97e9-13ceeb155aef", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-538309683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.219", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a124fd1ae2f419587b80fa0726162f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89e82ce7-b0", "ovs_interfaceid": "89e82ce7-b0b8-4a65-a46e-b611b985dd13", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 10:52:14 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-21600627-4ef5-47de-8825-e2cba3347a9d tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] Converting VIF {"id": "89e82ce7-b0b8-4a65-a46e-b611b985dd13", "address": "fa:16:3e:7a:23:a2", "network": {"id": "efc34ba2-d981-4ab9-97e9-13ceeb155aef", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-538309683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.219", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a124fd1ae2f419587b80fa0726162f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89e82ce7-b0", "ovs_interfaceid": "89e82ce7-b0b8-4a65-a46e-b611b985dd13", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:52:14 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-21600627-4ef5-47de-8825-e2cba3347a9d tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7a:23:a2,bridge_name='br-int',has_traffic_filtering=True,id=89e82ce7-b0b8-4a65-a46e-b611b985dd13,network=Network(efc34ba2-d981-4ab9-97e9-13ceeb155aef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89e82ce7-b0') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:52:14 user nova-compute[73572]: DEBUG os_vif [None req-21600627-4ef5-47de-8825-e2cba3347a9d tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7a:23:a2,bridge_name='br-int',has_traffic_filtering=True,id=89e82ce7-b0b8-4a65-a46e-b611b985dd13,network=Network(efc34ba2-d981-4ab9-97e9-13ceeb155aef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89e82ce7-b0') {{(pid=73572) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 10:52:14 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:52:14 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap89e82ce7-b0, bridge=br-int, if_exists=True) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:52:14 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:52:14 user nova-compute[73572]: INFO os_vif [None req-21600627-4ef5-47de-8825-e2cba3347a9d tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7a:23:a2,bridge_name='br-int',has_traffic_filtering=True,id=89e82ce7-b0b8-4a65-a46e-b611b985dd13,network=Network(efc34ba2-d981-4ab9-97e9-13ceeb155aef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89e82ce7-b0')
Aug 26 10:52:14 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-21600627-4ef5-47de-8825-e2cba3347a9d tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] [instance: 882eddbf-2173-47ed-92d1-964343380d96] Deleting instance files /opt/stack/data/nova/instances/882eddbf-2173-47ed-92d1-964343380d96_del
Aug 26 10:52:14 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-21600627-4ef5-47de-8825-e2cba3347a9d tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] [instance: 882eddbf-2173-47ed-92d1-964343380d96] Deletion of /opt/stack/data/nova/instances/882eddbf-2173-47ed-92d1-964343380d96_del complete
Aug 26 10:52:14 user nova-compute[73572]: INFO nova.compute.manager [None req-21600627-4ef5-47de-8825-e2cba3347a9d tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] [instance: 882eddbf-2173-47ed-92d1-964343380d96] Took 0.83 seconds to destroy the instance on the hypervisor.
Aug 26 10:52:14 user nova-compute[73572]: DEBUG oslo.service.loopingcall [None req-21600627-4ef5-47de-8825-e2cba3347a9d tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73572) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 10:52:14 user nova-compute[73572]: DEBUG nova.compute.manager [-] [instance: 882eddbf-2173-47ed-92d1-964343380d96] Deallocating network for instance {{(pid=73572) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 10:52:14 user nova-compute[73572]: DEBUG nova.network.neutron [-] [instance: 882eddbf-2173-47ed-92d1-964343380d96] deallocate_for_instance() {{(pid=73572) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 10:52:15 user nova-compute[73572]: DEBUG nova.network.neutron [-] [instance: 882eddbf-2173-47ed-92d1-964343380d96] Updating instance_info_cache with network_info: [] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:52:15 user nova-compute[73572]: INFO nova.compute.manager [-] [instance: 882eddbf-2173-47ed-92d1-964343380d96] Took 1.03 seconds to deallocate network for instance.
Aug 26 10:52:15 user nova-compute[73572]: DEBUG nova.compute.manager [req-24bfa072-f594-4364-8854-128e69b02103 req-b8dcfef4-857c-42c9-b309-06d5ffa17d08 service nova] [instance: 882eddbf-2173-47ed-92d1-964343380d96] Received event network-vif-deleted-89e82ce7-b0b8-4a65-a46e-b611b985dd13 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:52:15 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-21600627-4ef5-47de-8825-e2cba3347a9d tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:52:15 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-21600627-4ef5-47de-8825-e2cba3347a9d tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:52:15 user nova-compute[73572]: DEBUG nova.compute.provider_tree [None req-21600627-4ef5-47de-8825-e2cba3347a9d tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] Inventory has not changed in ProviderTree for provider: e2cec974-59b2-4c77-a53d-a7f4e5a30d75 {{(pid=73572) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 10:52:15 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-21600627-4ef5-47de-8825-e2cba3347a9d tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] Inventory has not changed for provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73572) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 10:52:15 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-21600627-4ef5-47de-8825-e2cba3347a9d tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.119s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:52:15 user nova-compute[73572]: INFO nova.scheduler.client.report [None req-21600627-4ef5-47de-8825-e2cba3347a9d tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] Deleted allocations for instance 882eddbf-2173-47ed-92d1-964343380d96
Aug 26 10:52:15 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-21600627-4ef5-47de-8825-e2cba3347a9d tempest-TestServerVolumeAttachmentScenario-1456898794 tempest-TestServerVolumeAttachmentScenario-1456898794-project-member] Lock "882eddbf-2173-47ed-92d1-964343380d96" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.163s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:52:16 user nova-compute[73572]: DEBUG nova.compute.manager [req-6708a629-1dfa-47cb-a2cf-f84405cbb8ca req-51db5786-5078-41eb-97c0-0be9a475d312 service nova] [instance: 882eddbf-2173-47ed-92d1-964343380d96] Received event network-vif-plugged-89e82ce7-b0b8-4a65-a46e-b611b985dd13 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:52:16 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-6708a629-1dfa-47cb-a2cf-f84405cbb8ca req-51db5786-5078-41eb-97c0-0be9a475d312 service nova] Acquiring lock "882eddbf-2173-47ed-92d1-964343380d96-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:52:16 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-6708a629-1dfa-47cb-a2cf-f84405cbb8ca req-51db5786-5078-41eb-97c0-0be9a475d312 service nova] Lock "882eddbf-2173-47ed-92d1-964343380d96-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:52:16 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-6708a629-1dfa-47cb-a2cf-f84405cbb8ca req-51db5786-5078-41eb-97c0-0be9a475d312 service nova] Lock "882eddbf-2173-47ed-92d1-964343380d96-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:52:16 user nova-compute[73572]: DEBUG nova.compute.manager [req-6708a629-1dfa-47cb-a2cf-f84405cbb8ca req-51db5786-5078-41eb-97c0-0be9a475d312 service nova] [instance: 882eddbf-2173-47ed-92d1-964343380d96] No waiting events found dispatching network-vif-plugged-89e82ce7-b0b8-4a65-a46e-b611b985dd13 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:52:16 user nova-compute[73572]: WARNING nova.compute.manager [req-6708a629-1dfa-47cb-a2cf-f84405cbb8ca req-51db5786-5078-41eb-97c0-0be9a475d312 service nova] [instance: 882eddbf-2173-47ed-92d1-964343380d96] Received unexpected event network-vif-plugged-89e82ce7-b0b8-4a65-a46e-b611b985dd13 for instance with vm_state deleted and task_state None.
Aug 26 10:52:19 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:52:24 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:52:29 user nova-compute[73572]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693047134.3310862, 882eddbf-2173-47ed-92d1-964343380d96 => Stopped> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:52:29 user nova-compute[73572]: INFO nova.compute.manager [-] [instance: 882eddbf-2173-47ed-92d1-964343380d96] VM Stopped (Lifecycle Event)
Aug 26 10:52:29 user nova-compute[73572]: DEBUG nova.compute.manager [None req-50b34daf-75e7-4817-8923-9c9bf058958c None None] [instance: 882eddbf-2173-47ed-92d1-964343380d96] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:52:29 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:52:34 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:52:39 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:52:41 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:52:44 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:52:45 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:52:45 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Starting heal instance info cache {{(pid=73572) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 10:52:45 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Rebuilding the list of instances to heal {{(pid=73572) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 10:52:45 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Didn't find any instances for network info cache update. {{(pid=73572) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 26 10:52:45 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:52:49 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:52:49 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:52:49 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:52:49 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:52:49 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:52:49 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Auditing locally available compute resources for user (node: user) {{(pid=73572) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 10:52:50 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:52:50 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:52:50 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Hypervisor/Node resource view: name=user free_ram=8906MB free_disk=25.14984893798828GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=73572) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 10:52:50 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:52:50 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:52:50 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73572) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 10:52:50 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73572) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 10:52:50 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Refreshing inventories for resource provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 {{(pid=73572) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 26 10:52:50 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Updating ProviderTree inventory for provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73572) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 26 10:52:50 user nova-compute[73572]: DEBUG nova.compute.provider_tree [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Updating inventory in ProviderTree for provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73572) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 26 10:52:50 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Refreshing aggregate associations for resource provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75, aggregates: None {{(pid=73572) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 26 10:52:50 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Refreshing trait associations for resource provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75, traits: COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSSE3,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE2,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NODE,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_NE2K_PCI {{(pid=73572) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 26 10:52:50 user nova-compute[73572]: DEBUG nova.compute.provider_tree [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Inventory has not changed in ProviderTree for provider: e2cec974-59b2-4c77-a53d-a7f4e5a30d75 {{(pid=73572) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 10:52:50 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Inventory has not changed for provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73572) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 10:52:50 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Compute_service record updated for user:user {{(pid=73572) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 10:52:50 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.431s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:52:53 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:52:53 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:52:54 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:52:54 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:52:55 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:52:55 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73572) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 10:52:59 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:53:00 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:53:04 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:53:06 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:53:06 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73572) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 26 10:53:09 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:53:14 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:53:14 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:53:14 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73572) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 10:53:14 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73572) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 10:53:14 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73572) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 10:53:14 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:53:18 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:53:19 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:53:20 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:53:20 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:53:21 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:53:21 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Cleaning up deleted instances {{(pid=73572) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 26 10:53:21 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] There are 0 instances to clean {{(pid=73572) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 26 10:53:23 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:53:24 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:53:29 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:53:29 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:53:29 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73572) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 10:53:29 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73572) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 10:53:29 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73572) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 10:53:29 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:53:34 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:53:39 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:53:43 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:53:44 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:53:45 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:53:45 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Starting heal instance info cache {{(pid=73572) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 10:53:45 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Rebuilding the list of instances to heal {{(pid=73572) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 10:53:45 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Didn't find any instances for network info cache update. {{(pid=73572) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 26 10:53:47 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:53:49 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:53:51 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:53:51 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:53:51 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:53:51 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:53:51 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Auditing locally available compute resources for user (node: user) {{(pid=73572) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 10:53:52 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:53:52 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:53:52 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Hypervisor/Node resource view: name=user free_ram=8923MB free_disk=25.148147583007812GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=73572) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 10:53:52 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:53:52 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:53:52 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73572) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 10:53:52 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73572) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 10:53:52 user nova-compute[73572]: DEBUG nova.compute.provider_tree [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Inventory has not changed in ProviderTree for provider: e2cec974-59b2-4c77-a53d-a7f4e5a30d75 {{(pid=73572) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 10:53:52 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Inventory has not changed for provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73572) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 10:53:52 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Compute_service record updated for user:user {{(pid=73572) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 10:53:52 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.115s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:53:54 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:53:54 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:53:54 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:53:54 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:53:55 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:53:57 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:53:57 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73572) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 10:53:59 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:53:59 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:53:59 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73572) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 10:53:59 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73572) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 10:53:59 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73572) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 10:53:59 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:54:00 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:54:04 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:54:09 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:54:14 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:54:19 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:54:23 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:54:24 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:54:28 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:54:29 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:54:30 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:54:31 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:54:34 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:54:35 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:54:36 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:54:39 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:54:40 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:54:40 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:54:43 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:54:44 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:54:46 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:54:46 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-31941589-42a2-4e7a-a0c4-780583a299c4 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Acquiring lock "dcfbde2c-659b-4095-ba9b-35df887ec976" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:54:46 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-31941589-42a2-4e7a-a0c4-780583a299c4 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Lock "dcfbde2c-659b-4095-ba9b-35df887ec976" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:54:46 user nova-compute[73572]: DEBUG nova.compute.manager [None req-31941589-42a2-4e7a-a0c4-780583a299c4 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] [instance: dcfbde2c-659b-4095-ba9b-35df887ec976] Starting instance... {{(pid=73572) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 10:54:46 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-31941589-42a2-4e7a-a0c4-780583a299c4 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:54:46 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-31941589-42a2-4e7a-a0c4-780583a299c4 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:54:46 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-31941589-42a2-4e7a-a0c4-780583a299c4 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73572) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 10:54:46 user nova-compute[73572]: INFO nova.compute.claims [None req-31941589-42a2-4e7a-a0c4-780583a299c4 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] [instance: dcfbde2c-659b-4095-ba9b-35df887ec976] Claim successful on node user
Aug 26 10:54:46 user nova-compute[73572]: DEBUG nova.compute.provider_tree [None req-31941589-42a2-4e7a-a0c4-780583a299c4 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Inventory has not changed in ProviderTree for provider: e2cec974-59b2-4c77-a53d-a7f4e5a30d75 {{(pid=73572) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 10:54:46 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-31941589-42a2-4e7a-a0c4-780583a299c4 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Inventory has not changed for provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73572) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 10:54:46 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-31941589-42a2-4e7a-a0c4-780583a299c4 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.216s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:54:46 user nova-compute[73572]: DEBUG nova.compute.manager [None req-31941589-42a2-4e7a-a0c4-780583a299c4 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] [instance: dcfbde2c-659b-4095-ba9b-35df887ec976] Start building networks asynchronously for instance. {{(pid=73572) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 10:54:46 user nova-compute[73572]: DEBUG nova.compute.manager [None req-31941589-42a2-4e7a-a0c4-780583a299c4 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] [instance: dcfbde2c-659b-4095-ba9b-35df887ec976] Allocating IP information in the background. {{(pid=73572) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 10:54:46 user nova-compute[73572]: DEBUG nova.network.neutron [None req-31941589-42a2-4e7a-a0c4-780583a299c4 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] [instance: dcfbde2c-659b-4095-ba9b-35df887ec976] allocate_for_instance() {{(pid=73572) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 10:54:46 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-31941589-42a2-4e7a-a0c4-780583a299c4 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] [instance: dcfbde2c-659b-4095-ba9b-35df887ec976] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 10:54:46 user nova-compute[73572]: DEBUG nova.compute.manager [None req-31941589-42a2-4e7a-a0c4-780583a299c4 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] [instance: dcfbde2c-659b-4095-ba9b-35df887ec976] Start building block device mappings for instance. {{(pid=73572) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 10:54:47 user nova-compute[73572]: DEBUG nova.compute.manager [None req-31941589-42a2-4e7a-a0c4-780583a299c4 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] [instance: dcfbde2c-659b-4095-ba9b-35df887ec976] Start spawning the instance on the hypervisor. {{(pid=73572) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 10:54:47 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-31941589-42a2-4e7a-a0c4-780583a299c4 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] [instance: dcfbde2c-659b-4095-ba9b-35df887ec976] Creating instance directory {{(pid=73572) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 10:54:47 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-31941589-42a2-4e7a-a0c4-780583a299c4 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] [instance: dcfbde2c-659b-4095-ba9b-35df887ec976] Creating image(s)
Aug 26 10:54:47 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-31941589-42a2-4e7a-a0c4-780583a299c4 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Acquiring lock "/opt/stack/data/nova/instances/dcfbde2c-659b-4095-ba9b-35df887ec976/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:54:47 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-31941589-42a2-4e7a-a0c4-780583a299c4 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Lock "/opt/stack/data/nova/instances/dcfbde2c-659b-4095-ba9b-35df887ec976/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:54:47 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-31941589-42a2-4e7a-a0c4-780583a299c4 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Lock "/opt/stack/data/nova/instances/dcfbde2c-659b-4095-ba9b-35df887ec976/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:54:47 user nova-compute[73572]: DEBUG nova.policy [None req-31941589-42a2-4e7a-a0c4-780583a299c4 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '09fbaed1c8d3472fbf649238cbabb508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '131418241f3f4a21a1e8a08a962a31c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73572) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 10:54:47 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-31941589-42a2-4e7a-a0c4-780583a299c4 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:54:47 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-31941589-42a2-4e7a-a0c4-780583a299c4 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json" returned: 0 in 0.206s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:54:47 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-31941589-42a2-4e7a-a0c4-780583a299c4 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Acquiring lock "2099350d6f3bcd0de9471c73862d4fe75b049801" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:54:47 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-31941589-42a2-4e7a-a0c4-780583a299c4 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Lock "2099350d6f3bcd0de9471c73862d4fe75b049801" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:54:47 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-31941589-42a2-4e7a-a0c4-780583a299c4 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:54:47 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-31941589-42a2-4e7a-a0c4-780583a299c4 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json" returned: 0 in 0.192s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:54:47 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-31941589-42a2-4e7a-a0c4-780583a299c4 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801,backing_fmt=raw /opt/stack/data/nova/instances/dcfbde2c-659b-4095-ba9b-35df887ec976/disk 1073741824 {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:54:47 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-31941589-42a2-4e7a-a0c4-780583a299c4 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801,backing_fmt=raw /opt/stack/data/nova/instances/dcfbde2c-659b-4095-ba9b-35df887ec976/disk 1073741824" returned: 0 in 0.061s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:54:47 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-31941589-42a2-4e7a-a0c4-780583a299c4 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Lock "2099350d6f3bcd0de9471c73862d4fe75b049801" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.262s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:54:47 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-31941589-42a2-4e7a-a0c4-780583a299c4 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:54:47 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:54:47 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Starting heal instance info cache {{(pid=73572) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 10:54:47 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Rebuilding the list of instances to heal {{(pid=73572) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 10:54:47 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] [instance: dcfbde2c-659b-4095-ba9b-35df887ec976] Skipping network cache update for instance because it is Building. {{(pid=73572) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 26 10:54:47 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Didn't find any instances for network info cache update. {{(pid=73572) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 26 10:54:47 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-31941589-42a2-4e7a-a0c4-780583a299c4 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2099350d6f3bcd0de9471c73862d4fe75b049801 --force-share --output=json" returned: 0 in 0.231s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:54:47 user nova-compute[73572]: DEBUG nova.virt.disk.api [None req-31941589-42a2-4e7a-a0c4-780583a299c4 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Checking if we can resize image /opt/stack/data/nova/instances/dcfbde2c-659b-4095-ba9b-35df887ec976/disk. size=1073741824 {{(pid=73572) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 10:54:47 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-31941589-42a2-4e7a-a0c4-780583a299c4 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcfbde2c-659b-4095-ba9b-35df887ec976/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:54:48 user nova-compute[73572]: DEBUG nova.network.neutron [None req-31941589-42a2-4e7a-a0c4-780583a299c4 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] [instance: dcfbde2c-659b-4095-ba9b-35df887ec976] Successfully created port: 90c1e997-ee83-43a9-97ae-2e3033f819e2 {{(pid=73572) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 10:54:48 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-31941589-42a2-4e7a-a0c4-780583a299c4 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcfbde2c-659b-4095-ba9b-35df887ec976/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:54:48 user nova-compute[73572]: DEBUG nova.virt.disk.api [None req-31941589-42a2-4e7a-a0c4-780583a299c4 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Cannot resize image /opt/stack/data/nova/instances/dcfbde2c-659b-4095-ba9b-35df887ec976/disk to a smaller size. {{(pid=73572) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 10:54:48 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-31941589-42a2-4e7a-a0c4-780583a299c4 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] [instance: dcfbde2c-659b-4095-ba9b-35df887ec976] Created local disks {{(pid=73572) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 10:54:48 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-31941589-42a2-4e7a-a0c4-780583a299c4 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] [instance: dcfbde2c-659b-4095-ba9b-35df887ec976] Ensure instance console log exists: /opt/stack/data/nova/instances/dcfbde2c-659b-4095-ba9b-35df887ec976/console.log {{(pid=73572) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 10:54:48 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-31941589-42a2-4e7a-a0c4-780583a299c4 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:54:48 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-31941589-42a2-4e7a-a0c4-780583a299c4 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:54:48 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-31941589-42a2-4e7a-a0c4-780583a299c4 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:54:48 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:54:49 user nova-compute[73572]: DEBUG nova.network.neutron [None req-31941589-42a2-4e7a-a0c4-780583a299c4 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] [instance: dcfbde2c-659b-4095-ba9b-35df887ec976] Successfully updated port: 90c1e997-ee83-43a9-97ae-2e3033f819e2 {{(pid=73572) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 10:54:49 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-31941589-42a2-4e7a-a0c4-780583a299c4 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Acquiring lock "refresh_cache-dcfbde2c-659b-4095-ba9b-35df887ec976" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:54:49 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-31941589-42a2-4e7a-a0c4-780583a299c4 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Acquired lock "refresh_cache-dcfbde2c-659b-4095-ba9b-35df887ec976" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:54:49 user nova-compute[73572]: DEBUG nova.network.neutron [None req-31941589-42a2-4e7a-a0c4-780583a299c4 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] [instance: dcfbde2c-659b-4095-ba9b-35df887ec976] Building network info cache for instance {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 10:54:49 user nova-compute[73572]: DEBUG nova.network.neutron [None req-31941589-42a2-4e7a-a0c4-780583a299c4 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] [instance: dcfbde2c-659b-4095-ba9b-35df887ec976] Instance cache missing network info. {{(pid=73572) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 10:54:49 user nova-compute[73572]: DEBUG nova.compute.manager [req-2e2f9d03-c092-4513-b22c-92a440c603c5 req-e4b2beef-9fae-4186-8b3d-402d24087065 service nova] [instance: dcfbde2c-659b-4095-ba9b-35df887ec976] Received event network-changed-90c1e997-ee83-43a9-97ae-2e3033f819e2 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:54:49 user nova-compute[73572]: DEBUG nova.compute.manager [req-2e2f9d03-c092-4513-b22c-92a440c603c5 req-e4b2beef-9fae-4186-8b3d-402d24087065 service nova] [instance: dcfbde2c-659b-4095-ba9b-35df887ec976] Refreshing instance network info cache due to event network-changed-90c1e997-ee83-43a9-97ae-2e3033f819e2. {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 10:54:49 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-2e2f9d03-c092-4513-b22c-92a440c603c5 req-e4b2beef-9fae-4186-8b3d-402d24087065 service nova] Acquiring lock "refresh_cache-dcfbde2c-659b-4095-ba9b-35df887ec976" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:54:49 user nova-compute[73572]: DEBUG nova.network.neutron [None req-31941589-42a2-4e7a-a0c4-780583a299c4 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] [instance: dcfbde2c-659b-4095-ba9b-35df887ec976] Updating instance_info_cache with network_info: [{"id": "90c1e997-ee83-43a9-97ae-2e3033f819e2", "address": "fa:16:3e:a5:1f:21", "network": {"id": "052a8e12-a71a-4c35-8001-bd3093ecdc4f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1777132020-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "131418241f3f4a21a1e8a08a962a31c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90c1e997-ee", "ovs_interfaceid": "90c1e997-ee83-43a9-97ae-2e3033f819e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:54:49 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:54:49 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-31941589-42a2-4e7a-a0c4-780583a299c4 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Releasing lock "refresh_cache-dcfbde2c-659b-4095-ba9b-35df887ec976" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:54:49 user nova-compute[73572]: DEBUG nova.compute.manager [None req-31941589-42a2-4e7a-a0c4-780583a299c4 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] [instance: dcfbde2c-659b-4095-ba9b-35df887ec976] Instance network_info: |[{"id": "90c1e997-ee83-43a9-97ae-2e3033f819e2", "address": "fa:16:3e:a5:1f:21", "network": {"id": "052a8e12-a71a-4c35-8001-bd3093ecdc4f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1777132020-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "131418241f3f4a21a1e8a08a962a31c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90c1e997-ee", "ovs_interfaceid": "90c1e997-ee83-43a9-97ae-2e3033f819e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73572) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 10:54:49 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-2e2f9d03-c092-4513-b22c-92a440c603c5 req-e4b2beef-9fae-4186-8b3d-402d24087065 service nova] Acquired lock "refresh_cache-dcfbde2c-659b-4095-ba9b-35df887ec976" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:54:49 user nova-compute[73572]: DEBUG nova.network.neutron [req-2e2f9d03-c092-4513-b22c-92a440c603c5 req-e4b2beef-9fae-4186-8b3d-402d24087065 service nova] [instance: dcfbde2c-659b-4095-ba9b-35df887ec976] Refreshing network info cache for port 90c1e997-ee83-43a9-97ae-2e3033f819e2 {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 10:54:49 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-31941589-42a2-4e7a-a0c4-780583a299c4 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] [instance: dcfbde2c-659b-4095-ba9b-35df887ec976] Start _get_guest_xml network_info=[{"id": "90c1e997-ee83-43a9-97ae-2e3033f819e2", "address": "fa:16:3e:a5:1f:21", "network": {"id": "052a8e12-a71a-4c35-8001-bd3093ecdc4f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1777132020-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "131418241f3f4a21a1e8a08a962a31c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90c1e997-ee", "ovs_interfaceid": "90c1e997-ee83-43a9-97ae-2e3033f819e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T10:07:33Z,direct_url=<?>,disk_format='qcow2',id=299da0c9-e1c4-48f0-be55-fbe20dd06bc9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5c995f8bbbab4368b67a253e0df3971a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T10:07:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'guest_format': None, 'size': 0, 'encryption_format': None, 'device_type': 'disk', 'image_id': '299da0c9-e1c4-48f0-be55-fbe20dd06bc9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73572) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 10:54:49 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-31941589-42a2-4e7a-a0c4-780583a299c4 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:54:49 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-31941589-42a2-4e7a-a0c4-780583a299c4 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:54:49 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-31941589-42a2-4e7a-a0c4-780583a299c4 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73572) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 10:54:49 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-31941589-42a2-4e7a-a0c4-780583a299c4 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] CPU controller missing on host. {{(pid=73572) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 10:54:49 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-31941589-42a2-4e7a-a0c4-780583a299c4 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73572) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 10:54:49 user nova-compute[73572]: DEBUG nova.virt.libvirt.host [None req-31941589-42a2-4e7a-a0c4-780583a299c4 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] CPU controller found on host. {{(pid=73572) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 10:54:49 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-31941589-42a2-4e7a-a0c4-780583a299c4 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73572) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 10:54:49 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-31941589-42a2-4e7a-a0c4-780583a299c4 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T10:07:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T10:07:33Z,direct_url=<?>,disk_format='qcow2',id=299da0c9-e1c4-48f0-be55-fbe20dd06bc9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5c995f8bbbab4368b67a253e0df3971a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T10:07:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 10:54:49 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-31941589-42a2-4e7a-a0c4-780583a299c4 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Flavor limits 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 10:54:49 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-31941589-42a2-4e7a-a0c4-780583a299c4 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Image limits 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 10:54:49 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-31941589-42a2-4e7a-a0c4-780583a299c4 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Flavor pref 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 10:54:49 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-31941589-42a2-4e7a-a0c4-780583a299c4 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Image pref 0:0:0 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 10:54:49 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-31941589-42a2-4e7a-a0c4-780583a299c4 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 10:54:49 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-31941589-42a2-4e7a-a0c4-780583a299c4 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 10:54:49 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-31941589-42a2-4e7a-a0c4-780583a299c4 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73572) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 10:54:49 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-31941589-42a2-4e7a-a0c4-780583a299c4 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Got 1 possible topologies {{(pid=73572) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 10:54:49 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-31941589-42a2-4e7a-a0c4-780583a299c4 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 10:54:49 user nova-compute[73572]: DEBUG nova.virt.hardware [None req-31941589-42a2-4e7a-a0c4-780583a299c4 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73572) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 10:54:49 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-31941589-42a2-4e7a-a0c4-780583a299c4 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T10:54:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1144350221',display_name='tempest-SnapshotDataIntegrityTests-server-1144350221',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1144350221',id=53,image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIwJiwCjKebPGrSIiVHMkFvOZcRMRfLCj+LXfvjHn8GONSUSdFFQb6Y1tP+r19OggZ9ZVV5zsF/oQ0zQVYOFobrMyTPA/XqnC3zalEYxeqHQDbaNhP+5eJd+4uUhQS+SwA==',key_name='tempest-keypair-886884209',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='131418241f3f4a21a1e8a08a962a31c9',ramdisk_id='',reservation_id='r-v3mnttfm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-479992689',owner_user_name='tempest-SnapshotDataIntegrityTests-479992689-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T10:54:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='09fbaed1c8d3472fbf649238cbabb508',uuid=dcfbde2c-659b-4095-ba9b-35df887ec976,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "90c1e997-ee83-43a9-97ae-2e3033f819e2", "address": "fa:16:3e:a5:1f:21", "network": {"id": "052a8e12-a71a-4c35-8001-bd3093ecdc4f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1777132020-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "131418241f3f4a21a1e8a08a962a31c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90c1e997-ee", "ovs_interfaceid": "90c1e997-ee83-43a9-97ae-2e3033f819e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73572) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 10:54:49 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-31941589-42a2-4e7a-a0c4-780583a299c4 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Converting VIF {"id": "90c1e997-ee83-43a9-97ae-2e3033f819e2", "address": "fa:16:3e:a5:1f:21", "network": {"id": "052a8e12-a71a-4c35-8001-bd3093ecdc4f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1777132020-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "131418241f3f4a21a1e8a08a962a31c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90c1e997-ee", "ovs_interfaceid": "90c1e997-ee83-43a9-97ae-2e3033f819e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:54:49 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-31941589-42a2-4e7a-a0c4-780583a299c4 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a5:1f:21,bridge_name='br-int',has_traffic_filtering=True,id=90c1e997-ee83-43a9-97ae-2e3033f819e2,network=Network(052a8e12-a71a-4c35-8001-bd3093ecdc4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90c1e997-ee') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:54:49 user nova-compute[73572]: DEBUG nova.objects.instance [None req-31941589-42a2-4e7a-a0c4-780583a299c4 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Lazy-loading 'pci_devices' on Instance uuid dcfbde2c-659b-4095-ba9b-35df887ec976 {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:54:49 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-31941589-42a2-4e7a-a0c4-780583a299c4 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] [instance: dcfbde2c-659b-4095-ba9b-35df887ec976] End _get_guest_xml xml=<domain type="kvm">
Aug 26 10:54:49 user nova-compute[73572]:   <uuid>dcfbde2c-659b-4095-ba9b-35df887ec976</uuid>
Aug 26 10:54:49 user nova-compute[73572]:   <name>instance-00000035</name>
Aug 26 10:54:49 user nova-compute[73572]:   <memory>524288</memory>
Aug 26 10:54:49 user nova-compute[73572]:   <vcpu>1</vcpu>
Aug 26 10:54:49 user nova-compute[73572]:   <metadata>
Aug 26 10:54:49 user nova-compute[73572]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 10:54:49 user nova-compute[73572]:       <nova:package version="0.0.0"/>
Aug 26 10:54:49 user nova-compute[73572]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-1144350221</nova:name>
Aug 26 10:54:49 user nova-compute[73572]:       <nova:creationTime>2023-08-26 10:54:49</nova:creationTime>
Aug 26 10:54:49 user nova-compute[73572]:       <nova:flavor name="m1.tiny">
Aug 26 10:54:49 user nova-compute[73572]:         <nova:memory>512</nova:memory>
Aug 26 10:54:49 user nova-compute[73572]:         <nova:disk>1</nova:disk>
Aug 26 10:54:49 user nova-compute[73572]:         <nova:swap>0</nova:swap>
Aug 26 10:54:49 user nova-compute[73572]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 10:54:49 user nova-compute[73572]:         <nova:vcpus>1</nova:vcpus>
Aug 26 10:54:49 user nova-compute[73572]:       </nova:flavor>
Aug 26 10:54:49 user nova-compute[73572]:       <nova:owner>
Aug 26 10:54:49 user nova-compute[73572]:         <nova:user uuid="09fbaed1c8d3472fbf649238cbabb508">tempest-SnapshotDataIntegrityTests-479992689-project-member</nova:user>
Aug 26 10:54:49 user nova-compute[73572]:         <nova:project uuid="131418241f3f4a21a1e8a08a962a31c9">tempest-SnapshotDataIntegrityTests-479992689</nova:project>
Aug 26 10:54:49 user nova-compute[73572]:       </nova:owner>
Aug 26 10:54:49 user nova-compute[73572]:       <nova:root type="image" uuid="299da0c9-e1c4-48f0-be55-fbe20dd06bc9"/>
Aug 26 10:54:49 user nova-compute[73572]:       <nova:ports>
Aug 26 10:54:49 user nova-compute[73572]:         <nova:port uuid="90c1e997-ee83-43a9-97ae-2e3033f819e2">
Aug 26 10:54:49 user nova-compute[73572]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 26 10:54:49 user nova-compute[73572]:         </nova:port>
Aug 26 10:54:49 user nova-compute[73572]:       </nova:ports>
Aug 26 10:54:49 user nova-compute[73572]:     </nova:instance>
Aug 26 10:54:49 user nova-compute[73572]:   </metadata>
Aug 26 10:54:49 user nova-compute[73572]:   <sysinfo type="smbios">
Aug 26 10:54:49 user nova-compute[73572]:     <system>
Aug 26 10:54:49 user nova-compute[73572]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 10:54:49 user nova-compute[73572]:       <entry name="product">OpenStack Nova</entry>
Aug 26 10:54:49 user nova-compute[73572]:       <entry name="version">0.0.0</entry>
Aug 26 10:54:49 user nova-compute[73572]:       <entry name="serial">dcfbde2c-659b-4095-ba9b-35df887ec976</entry>
Aug 26 10:54:49 user nova-compute[73572]:       <entry name="uuid">dcfbde2c-659b-4095-ba9b-35df887ec976</entry>
Aug 26 10:54:49 user nova-compute[73572]:       <entry name="family">Virtual Machine</entry>
Aug 26 10:54:49 user nova-compute[73572]:     </system>
Aug 26 10:54:49 user nova-compute[73572]:   </sysinfo>
Aug 26 10:54:49 user nova-compute[73572]:   <os>
Aug 26 10:54:49 user nova-compute[73572]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 10:54:49 user nova-compute[73572]:     <boot dev="hd"/>
Aug 26 10:54:49 user nova-compute[73572]:     <smbios mode="sysinfo"/>
Aug 26 10:54:49 user nova-compute[73572]:   </os>
Aug 26 10:54:49 user nova-compute[73572]:   <features>
Aug 26 10:54:49 user nova-compute[73572]:     <acpi/>
Aug 26 10:54:49 user nova-compute[73572]:     <apic/>
Aug 26 10:54:49 user nova-compute[73572]:     <vmcoreinfo/>
Aug 26 10:54:49 user nova-compute[73572]:   </features>
Aug 26 10:54:49 user nova-compute[73572]:   <clock offset="utc">
Aug 26 10:54:49 user nova-compute[73572]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 10:54:49 user nova-compute[73572]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 10:54:49 user nova-compute[73572]:     <timer name="hpet" present="no"/>
Aug 26 10:54:49 user nova-compute[73572]:   </clock>
Aug 26 10:54:49 user nova-compute[73572]:   <cpu mode="custom" match="exact">
Aug 26 10:54:49 user nova-compute[73572]:     <model>Nehalem</model>
Aug 26 10:54:49 user nova-compute[73572]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 10:54:49 user nova-compute[73572]:   </cpu>
Aug 26 10:54:49 user nova-compute[73572]:   <devices>
Aug 26 10:54:49 user nova-compute[73572]:     <disk type="file" device="disk">
Aug 26 10:54:49 user nova-compute[73572]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 10:54:49 user nova-compute[73572]:       <source file="/opt/stack/data/nova/instances/dcfbde2c-659b-4095-ba9b-35df887ec976/disk"/>
Aug 26 10:54:49 user nova-compute[73572]:       <target dev="vda" bus="virtio"/>
Aug 26 10:54:49 user nova-compute[73572]:     </disk>
Aug 26 10:54:49 user nova-compute[73572]:     <interface type="ethernet">
Aug 26 10:54:49 user nova-compute[73572]:       <mac address="fa:16:3e:a5:1f:21"/>
Aug 26 10:54:49 user nova-compute[73572]:       <model type="virtio"/>
Aug 26 10:54:49 user nova-compute[73572]:       <mtu size="1442"/>
Aug 26 10:54:49 user nova-compute[73572]:       <target dev="tap90c1e997-ee"/>
Aug 26 10:54:49 user nova-compute[73572]:     </interface>
Aug 26 10:54:49 user nova-compute[73572]:     <serial type="pty">
Aug 26 10:54:49 user nova-compute[73572]:       <log file="/opt/stack/data/nova/instances/dcfbde2c-659b-4095-ba9b-35df887ec976/console.log" append="off"/>
Aug 26 10:54:49 user nova-compute[73572]:     </serial>
Aug 26 10:54:49 user nova-compute[73572]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 10:54:49 user nova-compute[73572]:     <video>
Aug 26 10:54:49 user nova-compute[73572]:       <model type="virtio"/>
Aug 26 10:54:49 user nova-compute[73572]:     </video>
Aug 26 10:54:49 user nova-compute[73572]:     <rng model="virtio">
Aug 26 10:54:49 user nova-compute[73572]:       <backend model="random">/dev/urandom</backend>
Aug 26 10:54:49 user nova-compute[73572]:     </rng>
Aug 26 10:54:49 user nova-compute[73572]:     <controller type="usb" index="0" model="none"/>
Aug 26 10:54:49 user nova-compute[73572]:     <memballoon model="virtio">
Aug 26 10:54:49 user nova-compute[73572]:       <stats period="10"/>
Aug 26 10:54:49 user nova-compute[73572]:     </memballoon>
Aug 26 10:54:49 user nova-compute[73572]:   </devices>
Aug 26 10:54:49 user nova-compute[73572]: </domain>
Aug 26 10:54:49 user nova-compute[73572]:  {{(pid=73572) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 10:54:49 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-31941589-42a2-4e7a-a0c4-780583a299c4 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T10:54:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1144350221',display_name='tempest-SnapshotDataIntegrityTests-server-1144350221',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1144350221',id=53,image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIwJiwCjKebPGrSIiVHMkFvOZcRMRfLCj+LXfvjHn8GONSUSdFFQb6Y1tP+r19OggZ9ZVV5zsF/oQ0zQVYOFobrMyTPA/XqnC3zalEYxeqHQDbaNhP+5eJd+4uUhQS+SwA==',key_name='tempest-keypair-886884209',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='131418241f3f4a21a1e8a08a962a31c9',ramdisk_id='',reservation_id='r-v3mnttfm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-479992689',owner_user_name='tempest-SnapshotDataIntegrityTests-479992689-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T10:54:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='09fbaed1c8d3472fbf649238cbabb508',uuid=dcfbde2c-659b-4095-ba9b-35df887ec976,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "90c1e997-ee83-43a9-97ae-2e3033f819e2", "address": "fa:16:3e:a5:1f:21", "network": {"id": "052a8e12-a71a-4c35-8001-bd3093ecdc4f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1777132020-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "131418241f3f4a21a1e8a08a962a31c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90c1e997-ee", "ovs_interfaceid": "90c1e997-ee83-43a9-97ae-2e3033f819e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 10:54:49 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-31941589-42a2-4e7a-a0c4-780583a299c4 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Converting VIF {"id": "90c1e997-ee83-43a9-97ae-2e3033f819e2", "address": "fa:16:3e:a5:1f:21", "network": {"id": "052a8e12-a71a-4c35-8001-bd3093ecdc4f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1777132020-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "131418241f3f4a21a1e8a08a962a31c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90c1e997-ee", "ovs_interfaceid": "90c1e997-ee83-43a9-97ae-2e3033f819e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 10:54:49 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-31941589-42a2-4e7a-a0c4-780583a299c4 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a5:1f:21,bridge_name='br-int',has_traffic_filtering=True,id=90c1e997-ee83-43a9-97ae-2e3033f819e2,network=Network(052a8e12-a71a-4c35-8001-bd3093ecdc4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90c1e997-ee') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 10:54:49 user nova-compute[73572]: DEBUG os_vif [None req-31941589-42a2-4e7a-a0c4-780583a299c4 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:1f:21,bridge_name='br-int',has_traffic_filtering=True,id=90c1e997-ee83-43a9-97ae-2e3033f819e2,network=Network(052a8e12-a71a-4c35-8001-bd3093ecdc4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90c1e997-ee') {{(pid=73572) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 10:54:49 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:54:49 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:54:49 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 10:54:49 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:54:49 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap90c1e997-ee, may_exist=True, interface_attrs={}) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:54:49 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap90c1e997-ee, col_values=(('external_ids', {'iface-id': '90c1e997-ee83-43a9-97ae-2e3033f819e2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a5:1f:21', 'vm-uuid': 'dcfbde2c-659b-4095-ba9b-35df887ec976'}),), if_exists=True) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 10:54:49 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:54:49 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:54:49 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:54:49 user nova-compute[73572]: INFO os_vif [None req-31941589-42a2-4e7a-a0c4-780583a299c4 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:1f:21,bridge_name='br-int',has_traffic_filtering=True,id=90c1e997-ee83-43a9-97ae-2e3033f819e2,network=Network(052a8e12-a71a-4c35-8001-bd3093ecdc4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90c1e997-ee')
Aug 26 10:54:49 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-31941589-42a2-4e7a-a0c4-780583a299c4 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] No BDM found with device name vda, not building metadata. {{(pid=73572) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 10:54:49 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-31941589-42a2-4e7a-a0c4-780583a299c4 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] No VIF found with MAC fa:16:3e:a5:1f:21, not building metadata {{(pid=73572) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 10:54:49 user nova-compute[73572]: DEBUG nova.network.neutron [req-2e2f9d03-c092-4513-b22c-92a440c603c5 req-e4b2beef-9fae-4186-8b3d-402d24087065 service nova] [instance: dcfbde2c-659b-4095-ba9b-35df887ec976] Updated VIF entry in instance network info cache for port 90c1e997-ee83-43a9-97ae-2e3033f819e2. {{(pid=73572) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 10:54:49 user nova-compute[73572]: DEBUG nova.network.neutron [req-2e2f9d03-c092-4513-b22c-92a440c603c5 req-e4b2beef-9fae-4186-8b3d-402d24087065 service nova] [instance: dcfbde2c-659b-4095-ba9b-35df887ec976] Updating instance_info_cache with network_info: [{"id": "90c1e997-ee83-43a9-97ae-2e3033f819e2", "address": "fa:16:3e:a5:1f:21", "network": {"id": "052a8e12-a71a-4c35-8001-bd3093ecdc4f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1777132020-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "131418241f3f4a21a1e8a08a962a31c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90c1e997-ee", "ovs_interfaceid": "90c1e997-ee83-43a9-97ae-2e3033f819e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:54:49 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-2e2f9d03-c092-4513-b22c-92a440c603c5 req-e4b2beef-9fae-4186-8b3d-402d24087065 service nova] Releasing lock "refresh_cache-dcfbde2c-659b-4095-ba9b-35df887ec976" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:54:51 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:54:51 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:54:51 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:54:51 user nova-compute[73572]: DEBUG nova.compute.manager [req-53433abe-301a-4078-885b-1c04dda0a065 req-556f54b9-67e6-47bb-95dc-d5af722f66ba service nova] [instance: dcfbde2c-659b-4095-ba9b-35df887ec976] Received event network-vif-plugged-90c1e997-ee83-43a9-97ae-2e3033f819e2 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:54:51 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-53433abe-301a-4078-885b-1c04dda0a065 req-556f54b9-67e6-47bb-95dc-d5af722f66ba service nova] Acquiring lock "dcfbde2c-659b-4095-ba9b-35df887ec976-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:54:51 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-53433abe-301a-4078-885b-1c04dda0a065 req-556f54b9-67e6-47bb-95dc-d5af722f66ba service nova] Lock "dcfbde2c-659b-4095-ba9b-35df887ec976-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:54:51 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-53433abe-301a-4078-885b-1c04dda0a065 req-556f54b9-67e6-47bb-95dc-d5af722f66ba service nova] Lock "dcfbde2c-659b-4095-ba9b-35df887ec976-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:54:51 user nova-compute[73572]: DEBUG nova.compute.manager [req-53433abe-301a-4078-885b-1c04dda0a065 req-556f54b9-67e6-47bb-95dc-d5af722f66ba service nova] [instance: dcfbde2c-659b-4095-ba9b-35df887ec976] No waiting events found dispatching network-vif-plugged-90c1e997-ee83-43a9-97ae-2e3033f819e2 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:54:51 user nova-compute[73572]: WARNING nova.compute.manager [req-53433abe-301a-4078-885b-1c04dda0a065 req-556f54b9-67e6-47bb-95dc-d5af722f66ba service nova] [instance: dcfbde2c-659b-4095-ba9b-35df887ec976] Received unexpected event network-vif-plugged-90c1e997-ee83-43a9-97ae-2e3033f819e2 for instance with vm_state building and task_state spawning.
Aug 26 10:54:51 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:54:51 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:54:51 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:54:51 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:54:53 user nova-compute[73572]: DEBUG nova.compute.manager [req-4cc590c8-cab6-4f7d-a925-1ec53b6f3d37 req-89de5a26-c3b5-4b71-8e35-469c606e14b6 service nova] [instance: dcfbde2c-659b-4095-ba9b-35df887ec976] Received event network-vif-plugged-90c1e997-ee83-43a9-97ae-2e3033f819e2 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:54:53 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-4cc590c8-cab6-4f7d-a925-1ec53b6f3d37 req-89de5a26-c3b5-4b71-8e35-469c606e14b6 service nova] Acquiring lock "dcfbde2c-659b-4095-ba9b-35df887ec976-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:54:53 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-4cc590c8-cab6-4f7d-a925-1ec53b6f3d37 req-89de5a26-c3b5-4b71-8e35-469c606e14b6 service nova] Lock "dcfbde2c-659b-4095-ba9b-35df887ec976-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:54:53 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-4cc590c8-cab6-4f7d-a925-1ec53b6f3d37 req-89de5a26-c3b5-4b71-8e35-469c606e14b6 service nova] Lock "dcfbde2c-659b-4095-ba9b-35df887ec976-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:54:53 user nova-compute[73572]: DEBUG nova.compute.manager [req-4cc590c8-cab6-4f7d-a925-1ec53b6f3d37 req-89de5a26-c3b5-4b71-8e35-469c606e14b6 service nova] [instance: dcfbde2c-659b-4095-ba9b-35df887ec976] No waiting events found dispatching network-vif-plugged-90c1e997-ee83-43a9-97ae-2e3033f819e2 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 10:54:53 user nova-compute[73572]: WARNING nova.compute.manager [req-4cc590c8-cab6-4f7d-a925-1ec53b6f3d37 req-89de5a26-c3b5-4b71-8e35-469c606e14b6 service nova] [instance: dcfbde2c-659b-4095-ba9b-35df887ec976] Received unexpected event network-vif-plugged-90c1e997-ee83-43a9-97ae-2e3033f819e2 for instance with vm_state building and task_state spawning.
Aug 26 10:54:53 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:54:53 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:54:53 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:54:53 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:54:53 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Auditing locally available compute resources for user (node: user) {{(pid=73572) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 10:54:53 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcfbde2c-659b-4095-ba9b-35df887ec976/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:54:53 user nova-compute[73572]: DEBUG nova.virt.driver [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Emitting event <LifecycleEvent: 1693047293.9682245, dcfbde2c-659b-4095-ba9b-35df887ec976 => Resumed> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:54:53 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: dcfbde2c-659b-4095-ba9b-35df887ec976] VM Resumed (Lifecycle Event)
Aug 26 10:54:53 user nova-compute[73572]: DEBUG nova.compute.manager [None req-31941589-42a2-4e7a-a0c4-780583a299c4 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] [instance: dcfbde2c-659b-4095-ba9b-35df887ec976] Instance event wait completed in 0 seconds for  {{(pid=73572) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 10:54:53 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-31941589-42a2-4e7a-a0c4-780583a299c4 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] [instance: dcfbde2c-659b-4095-ba9b-35df887ec976] Guest created on hypervisor {{(pid=73572) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 10:54:53 user nova-compute[73572]: INFO nova.virt.libvirt.driver [-] [instance: dcfbde2c-659b-4095-ba9b-35df887ec976] Instance spawned successfully.
Aug 26 10:54:54 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-31941589-42a2-4e7a-a0c4-780583a299c4 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] [instance: dcfbde2c-659b-4095-ba9b-35df887ec976] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 10:54:54 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: dcfbde2c-659b-4095-ba9b-35df887ec976] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:54:54 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: dcfbde2c-659b-4095-ba9b-35df887ec976] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73572) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 10:54:54 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-31941589-42a2-4e7a-a0c4-780583a299c4 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] [instance: dcfbde2c-659b-4095-ba9b-35df887ec976] Found default for hw_cdrom_bus of ide {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:54:54 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-31941589-42a2-4e7a-a0c4-780583a299c4 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] [instance: dcfbde2c-659b-4095-ba9b-35df887ec976] Found default for hw_disk_bus of virtio {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:54:54 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-31941589-42a2-4e7a-a0c4-780583a299c4 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] [instance: dcfbde2c-659b-4095-ba9b-35df887ec976] Found default for hw_input_bus of None {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:54:54 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-31941589-42a2-4e7a-a0c4-780583a299c4 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] [instance: dcfbde2c-659b-4095-ba9b-35df887ec976] Found default for hw_pointer_model of None {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:54:54 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-31941589-42a2-4e7a-a0c4-780583a299c4 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] [instance: dcfbde2c-659b-4095-ba9b-35df887ec976] Found default for hw_video_model of virtio {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:54:54 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-31941589-42a2-4e7a-a0c4-780583a299c4 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] [instance: dcfbde2c-659b-4095-ba9b-35df887ec976] Found default for hw_vif_model of virtio {{(pid=73572) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 10:54:54 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: dcfbde2c-659b-4095-ba9b-35df887ec976] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 10:54:54 user nova-compute[73572]: DEBUG nova.virt.driver [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Emitting event <LifecycleEvent: 1693047293.9695468, dcfbde2c-659b-4095-ba9b-35df887ec976 => Started> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 10:54:54 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: dcfbde2c-659b-4095-ba9b-35df887ec976] VM Started (Lifecycle Event)
Aug 26 10:54:54 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: dcfbde2c-659b-4095-ba9b-35df887ec976] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:54:54 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: dcfbde2c-659b-4095-ba9b-35df887ec976] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73572) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 10:54:54 user nova-compute[73572]: INFO nova.compute.manager [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] [instance: dcfbde2c-659b-4095-ba9b-35df887ec976] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 10:54:54 user nova-compute[73572]: INFO nova.compute.manager [None req-31941589-42a2-4e7a-a0c4-780583a299c4 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] [instance: dcfbde2c-659b-4095-ba9b-35df887ec976] Took 7.02 seconds to spawn the instance on the hypervisor.
Aug 26 10:54:54 user nova-compute[73572]: DEBUG nova.compute.manager [None req-31941589-42a2-4e7a-a0c4-780583a299c4 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] [instance: dcfbde2c-659b-4095-ba9b-35df887ec976] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 10:54:54 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcfbde2c-659b-4095-ba9b-35df887ec976/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:54:54 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcfbde2c-659b-4095-ba9b-35df887ec976/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:54:54 user nova-compute[73572]: INFO nova.compute.manager [None req-31941589-42a2-4e7a-a0c4-780583a299c4 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] [instance: dcfbde2c-659b-4095-ba9b-35df887ec976] Took 7.74 seconds to build instance.
Aug 26 10:54:54 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-31941589-42a2-4e7a-a0c4-780583a299c4 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Lock "dcfbde2c-659b-4095-ba9b-35df887ec976" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.886s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:54:54 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcfbde2c-659b-4095-ba9b-35df887ec976/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:54:54 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:54:54 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:54:54 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:54:54 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Hypervisor/Node resource view: name=user free_ram=8563MB free_disk=25.133384704589844GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=73572) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 10:54:54 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:54:54 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:54:55 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance dcfbde2c-659b-4095-ba9b-35df887ec976 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:54:55 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73572) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 10:54:55 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73572) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 10:54:55 user nova-compute[73572]: DEBUG nova.compute.provider_tree [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Inventory has not changed in ProviderTree for provider: e2cec974-59b2-4c77-a53d-a7f4e5a30d75 {{(pid=73572) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 10:54:55 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Inventory has not changed for provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73572) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 10:54:55 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Compute_service record updated for user:user {{(pid=73572) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 10:54:55 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.237s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:54:56 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:54:57 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:54:57 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:54:57 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:54:57 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:54:57 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73572) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 10:54:59 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:55:00 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:55:01 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:55:04 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:55:09 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:55:11 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:55:14 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:55:16 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:55:19 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:55:21 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:55:24 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:55:26 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:55:27 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:55:29 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:55:34 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:55:39 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:55:44 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:55:45 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:55:47 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:55:47 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Starting heal instance info cache {{(pid=73572) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 10:55:47 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Rebuilding the list of instances to heal {{(pid=73572) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 10:55:47 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquiring lock "refresh_cache-dcfbde2c-659b-4095-ba9b-35df887ec976" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:55:47 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquired lock "refresh_cache-dcfbde2c-659b-4095-ba9b-35df887ec976" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:55:47 user nova-compute[73572]: DEBUG nova.network.neutron [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] [instance: dcfbde2c-659b-4095-ba9b-35df887ec976] Forcefully refreshing network info cache for instance {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 10:55:47 user nova-compute[73572]: DEBUG nova.objects.instance [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lazy-loading 'info_cache' on Instance uuid dcfbde2c-659b-4095-ba9b-35df887ec976 {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:55:48 user nova-compute[73572]: DEBUG nova.network.neutron [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] [instance: dcfbde2c-659b-4095-ba9b-35df887ec976] Updating instance_info_cache with network_info: [{"id": "90c1e997-ee83-43a9-97ae-2e3033f819e2", "address": "fa:16:3e:a5:1f:21", "network": {"id": "052a8e12-a71a-4c35-8001-bd3093ecdc4f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1777132020-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "131418241f3f4a21a1e8a08a962a31c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90c1e997-ee", "ovs_interfaceid": "90c1e997-ee83-43a9-97ae-2e3033f819e2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:55:48 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Releasing lock "refresh_cache-dcfbde2c-659b-4095-ba9b-35df887ec976" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:55:48 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] [instance: dcfbde2c-659b-4095-ba9b-35df887ec976] Updated the network info_cache for instance {{(pid=73572) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 10:55:49 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:55:50 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:55:54 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:55:54 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:55:54 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:55:54 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:55:54 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Auditing locally available compute resources for user (node: user) {{(pid=73572) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 10:55:54 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcfbde2c-659b-4095-ba9b-35df887ec976/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:55:54 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:55:55 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcfbde2c-659b-4095-ba9b-35df887ec976/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:55:55 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcfbde2c-659b-4095-ba9b-35df887ec976/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:55:55 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcfbde2c-659b-4095-ba9b-35df887ec976/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:55:55 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:55:55 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:55:55 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Hypervisor/Node resource view: name=user free_ram=8719MB free_disk=25.101871490478516GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=73572) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 10:55:55 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:55:55 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:55:55 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance dcfbde2c-659b-4095-ba9b-35df887ec976 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:55:55 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73572) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 10:55:55 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73572) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 10:55:55 user nova-compute[73572]: DEBUG nova.compute.provider_tree [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Inventory has not changed in ProviderTree for provider: e2cec974-59b2-4c77-a53d-a7f4e5a30d75 {{(pid=73572) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 10:55:55 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Inventory has not changed for provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73572) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 10:55:55 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Compute_service record updated for user:user {{(pid=73572) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 10:55:55 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.155s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:55:57 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:55:57 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:55:57 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:55:58 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:55:59 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:55:59 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73572) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 10:55:59 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:56:02 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:56:04 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:56:09 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:56:14 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:56:19 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:56:19 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:56:19 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73572) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 10:56:19 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73572) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 10:56:19 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73572) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 10:56:19 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:56:24 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:56:29 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:56:34 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:56:38 user nova-compute[73572]: DEBUG nova.compute.manager [req-4df04d98-bd16-4caf-9c9a-421d4fdd104e req-244d8ba9-83a3-4dcd-a16a-b92ae4184f5b service nova] [instance: dcfbde2c-659b-4095-ba9b-35df887ec976] Received event network-changed-90c1e997-ee83-43a9-97ae-2e3033f819e2 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 10:56:38 user nova-compute[73572]: DEBUG nova.compute.manager [req-4df04d98-bd16-4caf-9c9a-421d4fdd104e req-244d8ba9-83a3-4dcd-a16a-b92ae4184f5b service nova] [instance: dcfbde2c-659b-4095-ba9b-35df887ec976] Refreshing instance network info cache due to event network-changed-90c1e997-ee83-43a9-97ae-2e3033f819e2. {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 10:56:38 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-4df04d98-bd16-4caf-9c9a-421d4fdd104e req-244d8ba9-83a3-4dcd-a16a-b92ae4184f5b service nova] Acquiring lock "refresh_cache-dcfbde2c-659b-4095-ba9b-35df887ec976" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:56:38 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-4df04d98-bd16-4caf-9c9a-421d4fdd104e req-244d8ba9-83a3-4dcd-a16a-b92ae4184f5b service nova] Acquired lock "refresh_cache-dcfbde2c-659b-4095-ba9b-35df887ec976" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:56:38 user nova-compute[73572]: DEBUG nova.network.neutron [req-4df04d98-bd16-4caf-9c9a-421d4fdd104e req-244d8ba9-83a3-4dcd-a16a-b92ae4184f5b service nova] [instance: dcfbde2c-659b-4095-ba9b-35df887ec976] Refreshing network info cache for port 90c1e997-ee83-43a9-97ae-2e3033f819e2 {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 10:56:38 user nova-compute[73572]: DEBUG nova.network.neutron [req-4df04d98-bd16-4caf-9c9a-421d4fdd104e req-244d8ba9-83a3-4dcd-a16a-b92ae4184f5b service nova] [instance: dcfbde2c-659b-4095-ba9b-35df887ec976] Updated VIF entry in instance network info cache for port 90c1e997-ee83-43a9-97ae-2e3033f819e2. {{(pid=73572) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 10:56:38 user nova-compute[73572]: DEBUG nova.network.neutron [req-4df04d98-bd16-4caf-9c9a-421d4fdd104e req-244d8ba9-83a3-4dcd-a16a-b92ae4184f5b service nova] [instance: dcfbde2c-659b-4095-ba9b-35df887ec976] Updating instance_info_cache with network_info: [{"id": "90c1e997-ee83-43a9-97ae-2e3033f819e2", "address": "fa:16:3e:a5:1f:21", "network": {"id": "052a8e12-a71a-4c35-8001-bd3093ecdc4f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1777132020-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "131418241f3f4a21a1e8a08a962a31c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90c1e997-ee", "ovs_interfaceid": "90c1e997-ee83-43a9-97ae-2e3033f819e2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:56:38 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-4df04d98-bd16-4caf-9c9a-421d4fdd104e req-244d8ba9-83a3-4dcd-a16a-b92ae4184f5b service nova] Releasing lock "refresh_cache-dcfbde2c-659b-4095-ba9b-35df887ec976" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:56:40 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:56:41 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:56:42 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9053f3c7-4b61-4ffb-9604-a1852464fece tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Acquiring lock "dcfbde2c-659b-4095-ba9b-35df887ec976" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:56:42 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9053f3c7-4b61-4ffb-9604-a1852464fece tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Lock "dcfbde2c-659b-4095-ba9b-35df887ec976" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:56:42 user nova-compute[73572]: DEBUG nova.objects.instance [None req-9053f3c7-4b61-4ffb-9604-a1852464fece tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Lazy-loading 'flavor' on Instance uuid dcfbde2c-659b-4095-ba9b-35df887ec976 {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:56:42 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9053f3c7-4b61-4ffb-9604-a1852464fece tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Lock "dcfbde2c-659b-4095-ba9b-35df887ec976" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:56:42 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9053f3c7-4b61-4ffb-9604-a1852464fece tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Acquiring lock "dcfbde2c-659b-4095-ba9b-35df887ec976" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:56:42 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9053f3c7-4b61-4ffb-9604-a1852464fece tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Lock "dcfbde2c-659b-4095-ba9b-35df887ec976" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:56:42 user nova-compute[73572]: INFO nova.compute.manager [None req-9053f3c7-4b61-4ffb-9604-a1852464fece tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] [instance: dcfbde2c-659b-4095-ba9b-35df887ec976] Attaching volume 943247a0-b7ed-4dcf-8f9a-e07232dc0df2 to /dev/vdb
Aug 26 10:56:42 user nova-compute[73572]: DEBUG os_brick.utils [None req-9053f3c7-4b61-4ffb-9604-a1852464fece tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 10:56:42 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:56:43 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.054s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:56:43 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[7411c505-45c7-416d-bdcc-a644c105a227]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:de8a79ed912\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:56:43 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:56:43 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:56:43 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0f67827-d487-4440-8a6b-088af3ff308b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:56:43 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:56:43 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:56:43 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[11ba9bdc-889a-45de-a41b-a90d1d286ab2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:56:43 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[e59e2bfb-b646-4ff2-842d-8257cca60da6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:56:43 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9053f3c7-4b61-4ffb-9604-a1852464fece tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Running cmd (subprocess): nvme version {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:56:43 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9053f3c7-4b61-4ffb-9604-a1852464fece tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] 'nvme version' failed. Not Retrying. {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 10:56:43 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9053f3c7-4b61-4ffb-9604-a1852464fece tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] nvme not present on system {{(pid=73572) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 10:56:43 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:56:43 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 10:56:43 user nova-compute[73572]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 10:56:43 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a0fb0fc-4314-46f2-8bac-09c35effbb24]: (4, '') {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:56:43 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.lightos [None req-9053f3c7-4b61-4ffb-9604-a1852464fece tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73572) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 10:56:43 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.lightos [None req-9053f3c7-4b61-4ffb-9604-a1852464fece tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73572) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 10:56:43 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.lightos [None req-9053f3c7-4b61-4ffb-9604-a1852464fece tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] LIGHTOS: no hostnqn found. {{(pid=73572) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 10:56:43 user nova-compute[73572]: DEBUG os_brick.utils [None req-9053f3c7-4b61-4ffb-9604-a1852464fece tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] <== get_connector_properties: return (154ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:de8a79ed912', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 10:56:43 user nova-compute[73572]: DEBUG nova.virt.block_device [None req-9053f3c7-4b61-4ffb-9604-a1852464fece tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] [instance: dcfbde2c-659b-4095-ba9b-35df887ec976] Updating existing volume attachment record: 0fe2aef8-bb96-45a4-a8d6-8172aaa8af0d {{(pid=73572) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 10:56:45 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:56:46 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:56:46 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:56:49 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:56:49 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Starting heal instance info cache {{(pid=73572) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 10:56:49 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Rebuilding the list of instances to heal {{(pid=73572) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 10:56:49 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquiring lock "refresh_cache-dcfbde2c-659b-4095-ba9b-35df887ec976" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:56:49 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquired lock "refresh_cache-dcfbde2c-659b-4095-ba9b-35df887ec976" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:56:49 user nova-compute[73572]: DEBUG nova.network.neutron [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] [instance: dcfbde2c-659b-4095-ba9b-35df887ec976] Forcefully refreshing network info cache for instance {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 10:56:49 user nova-compute[73572]: DEBUG nova.objects.instance [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lazy-loading 'info_cache' on Instance uuid dcfbde2c-659b-4095-ba9b-35df887ec976 {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:56:50 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:56:50 user nova-compute[73572]: DEBUG nova.network.neutron [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] [instance: dcfbde2c-659b-4095-ba9b-35df887ec976] Updating instance_info_cache with network_info: [{"id": "90c1e997-ee83-43a9-97ae-2e3033f819e2", "address": "fa:16:3e:a5:1f:21", "network": {"id": "052a8e12-a71a-4c35-8001-bd3093ecdc4f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1777132020-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "131418241f3f4a21a1e8a08a962a31c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90c1e997-ee", "ovs_interfaceid": "90c1e997-ee83-43a9-97ae-2e3033f819e2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:56:50 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Releasing lock "refresh_cache-dcfbde2c-659b-4095-ba9b-35df887ec976" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:56:50 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] [instance: dcfbde2c-659b-4095-ba9b-35df887ec976] Updated the network info_cache for instance {{(pid=73572) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 10:56:51 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:56:55 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:56:56 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:56:56 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:56:56 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:56:56 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:56:56 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:56:56 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:56:56 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Auditing locally available compute resources for user (node: user) {{(pid=73572) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 10:56:56 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcfbde2c-659b-4095-ba9b-35df887ec976/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:56:57 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcfbde2c-659b-4095-ba9b-35df887ec976/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:56:57 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcfbde2c-659b-4095-ba9b-35df887ec976/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:56:57 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcfbde2c-659b-4095-ba9b-35df887ec976/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:56:57 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:56:57 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:56:57 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Hypervisor/Node resource view: name=user free_ram=8779MB free_disk=25.092731475830078GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=73572) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 10:56:57 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:56:57 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:56:57 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance dcfbde2c-659b-4095-ba9b-35df887ec976 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:56:57 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73572) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 10:56:57 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73572) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 10:56:57 user nova-compute[73572]: DEBUG nova.compute.provider_tree [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Inventory has not changed in ProviderTree for provider: e2cec974-59b2-4c77-a53d-a7f4e5a30d75 {{(pid=73572) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 10:56:57 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Inventory has not changed for provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73572) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 10:56:57 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Compute_service record updated for user:user {{(pid=73572) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 10:56:57 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.181s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:56:58 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:56:58 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:56:59 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9053f3c7-4b61-4ffb-9604-a1852464fece tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] [instance: dcfbde2c-659b-4095-ba9b-35df887ec976] Calling os-brick to attach iSCSI Volume {{(pid=73572) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 10:56:59 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-9053f3c7-4b61-4ffb-9604-a1852464fece tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc89c3d6a10>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:943247a0-b7ed-4dcf-8f9a-e07232dc0df2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MvnIRCKJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 10:56:59 user nova-compute[73572]: WARNING os_brick.initiator.connectors.base [None req-9053f3c7-4b61-4ffb-9604-a1852464fece tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 10:56:59 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-9053f3c7-4b61-4ffb-9604-a1852464fece tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 10:56:59 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-9053f3c7-4b61-4ffb-9604-a1852464fece tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 10:56:59 user nova-compute[73572]: WARNING os_brick.initiator.connectors.base [None req-9053f3c7-4b61-4ffb-9604-a1852464fece tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 10:56:59 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-9053f3c7-4b61-4ffb-9604-a1852464fece tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:943247a0-b7ed-4dcf-8f9a-e07232dc0df2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 10:56:59 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-9053f3c7-4b61-4ffb-9604-a1852464fece tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:943247a0-b7ed-4dcf-8f9a-e07232dc0df2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 10:56:59 user nova-compute[73572]: INFO os_brick.initiator.connectors.iscsi [None req-9053f3c7-4b61-4ffb-9604-a1852464fece tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 10:56:59 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:943247a0-b7ed-4dcf-8f9a-e07232dc0df2 -p 172.16.0.220:3260 {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:56:59 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:943247a0-b7ed-4dcf-8f9a-e07232dc0df2 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:56:59 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[02c08fff-44fb-406b-ba14-7003df79a3eb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:56:59 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-9053f3c7-4b61-4ffb-9604-a1852464fece tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 10:56:59 user nova-compute[73572]:  {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:56:59 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:943247a0-b7ed-4dcf-8f9a-e07232dc0df2 -p 172.16.0.220:3260 --interface default --op new {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:56:59 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:943247a0-b7ed-4dcf-8f9a-e07232dc0df2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:56:59 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ed8571a-8c35-473b-8443-5b72938b89f8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:943247a0-b7ed-4dcf-8f9a-e07232dc0df2] added\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:56:59 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-9053f3c7-4b61-4ffb-9604-a1852464fece tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:943247a0-b7ed-4dcf-8f9a-e07232dc0df2] added
Aug 26 10:56:59 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:56:59 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:943247a0-b7ed-4dcf-8f9a-e07232dc0df2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:56:59 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:943247a0-b7ed-4dcf-8f9a-e07232dc0df2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:56:59 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[be799620-dd2e-4fa7-88c3-a195662854ae]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:56:59 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-9053f3c7-4b61-4ffb-9604-a1852464fece tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:56:59 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:943247a0-b7ed-4dcf-8f9a-e07232dc0df2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:56:59 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:943247a0-b7ed-4dcf-8f9a-e07232dc0df2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:56:59 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a181b70-8fc5-4d0f-b299-71b4ba5ccab4]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:56:59 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-9053f3c7-4b61-4ffb-9604-a1852464fece tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:56:59 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:943247a0-b7ed-4dcf-8f9a-e07232dc0df2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MvnIRCKJ {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:56:59 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:943247a0-b7ed-4dcf-8f9a-e07232dc0df2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MvnIRCKJ" returned: 0 in 0.017s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:56:59 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[22953a7e-ca43-48ba-a079-0fb689615869]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:56:59 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-9053f3c7-4b61-4ffb-9604-a1852464fece tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MvnIRCKJ'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:56:59 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:943247a0-b7ed-4dcf-8f9a-e07232dc0df2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:56:59 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:943247a0-b7ed-4dcf-8f9a-e07232dc0df2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:56:59 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[01813796-5155-45f2-b191-b56fb77d5a14]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:56:59 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-9053f3c7-4b61-4ffb-9604-a1852464fece tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:56:59 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:56:59 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:56:59 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[52b43aaa-ac46-4b1b-aa39-7742ba76efa7]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:56:59 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-9053f3c7-4b61-4ffb-9604-a1852464fece tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 26 10:56:59 user nova-compute[73572]:  {{(pid=73572) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 10:56:59 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-9053f3c7-4b61-4ffb-9604-a1852464fece tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 26 10:56:59 user nova-compute[73572]:  {{(pid=73572) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 10:56:59 user nova-compute[73572]: WARNING os_brick.initiator.connectors.iscsi [None req-9053f3c7-4b61-4ffb-9604-a1852464fece tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 26 10:56:59 user nova-compute[73572]: 
Aug 26 10:56:59 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:943247a0-b7ed-4dcf-8f9a-e07232dc0df2 -p 172.16.0.220:3260 --login {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:56:59 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:943247a0-b7ed-4dcf-8f9a-e07232dc0df2 -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:56:59 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[82c36ae0-f73f-47cc-bda8-6a4577bf49d5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:943247a0-b7ed-4dcf-8f9a-e07232dc0df2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:943247a0-b7ed-4dcf-8f9a-e07232dc0df2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:56:59 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-9053f3c7-4b61-4ffb-9604-a1852464fece tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:943247a0-b7ed-4dcf-8f9a-e07232dc0df2, portal: 172.16.0.220,3260]
Aug 26 10:56:59 user nova-compute[73572]: Login to [iface: default, target: iqn.2010-10.org.openstack:943247a0-b7ed-4dcf-8f9a-e07232dc0df2, portal: 172.16.0.220,3260] successful.
Aug 26 10:56:59 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:56:59 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:943247a0-b7ed-4dcf-8f9a-e07232dc0df2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:56:59 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:943247a0-b7ed-4dcf-8f9a-e07232dc0df2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:56:59 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[a167a240-f3da-4a9e-b676-b119dcb9aebf]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:56:59 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-9053f3c7-4b61-4ffb-9604-a1852464fece tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:56:59 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:56:59 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:56:59 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[649a3fab-57b9-4cf7-9882-0903b9dc0ee6]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:943247a0-b7ed-4dcf-8f9a-e07232dc0df2 (non-flash)\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:56:59 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-9053f3c7-4b61-4ffb-9604-a1852464fece tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:943247a0-b7ed-4dcf-8f9a-e07232dc0df2 (non-flash)
Aug 26 10:56:59 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 10:56:59 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-9053f3c7-4b61-4ffb-9604-a1852464fece tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:943247a0-b7ed-4dcf-8f9a-e07232dc0df2 (non-flash)
Aug 26 10:56:59 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 10:56:59 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-9053f3c7-4b61-4ffb-9604-a1852464fece tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:943247a0-b7ed-4dcf-8f9a-e07232dc0df2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.250s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 10:56:59 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-9053f3c7-4b61-4ffb-9604-a1852464fece tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Connected to 172.16.0.220:3260 {{(pid=73572) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 10:56:59 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-9053f3c7-4b61-4ffb-9604-a1852464fece tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] HCTL ('33', '-', '-', 0) found on session 67 with lun 0 {{(pid=73572) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 10:56:59 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-9053f3c7-4b61-4ffb-9604-a1852464fece tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73572) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 10:56:59 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:56:59 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:56:59 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[948698a2-85b4-4e7f-bf8c-a6c09e36e08c]: (4, ('- - 0', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:56:59 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-9053f3c7-4b61-4ffb-9604-a1852464fece tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Searching for a device in session 67 and hctl ['33', '*', '*', 0] yield: None {{(pid=73572) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 10:57:00 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:57:00 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-9053f3c7-4b61-4ffb-9604-a1852464fece tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Searching for a device in session 67 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73572) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 10:57:00 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-9053f3c7-4b61-4ffb-9604-a1852464fece tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MvnIRCKJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73572) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 10:57:00 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-9053f3c7-4b61-4ffb-9604-a1852464fece tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.285s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 10:57:00 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-9053f3c7-4b61-4ffb-9604-a1852464fece tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] <== connect_volume: return (1286ms) {'type': 'block', 'scsi_wwn': '23761333931306139', 'path': '/dev/sdb'} {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 10:57:00 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9053f3c7-4b61-4ffb-9604-a1852464fece tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] [instance: dcfbde2c-659b-4095-ba9b-35df887ec976] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23761333931306139', 'path': '/dev/sdb'} {{(pid=73572) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 10:57:00 user nova-compute[73572]: DEBUG nova.objects.instance [None req-9053f3c7-4b61-4ffb-9604-a1852464fece tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Lazy-loading 'flavor' on Instance uuid dcfbde2c-659b-4095-ba9b-35df887ec976 {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:57:00 user nova-compute[73572]: DEBUG nova.virt.libvirt.guest [None req-9053f3c7-4b61-4ffb-9604-a1852464fece tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 10:57:00 user nova-compute[73572]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 10:57:00 user nova-compute[73572]:   <source dev="/dev/sdb"/>
Aug 26 10:57:00 user nova-compute[73572]:   <target dev="vdb" bus="virtio"/>
Aug 26 10:57:00 user nova-compute[73572]:   <serial>943247a0-b7ed-4dcf-8f9a-e07232dc0df2</serial>
Aug 26 10:57:00 user nova-compute[73572]: </disk>
Aug 26 10:57:00 user nova-compute[73572]:  {{(pid=73572) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 10:57:01 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-9053f3c7-4b61-4ffb-9604-a1852464fece tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] No BDM found with device name vda, not building metadata. {{(pid=73572) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 10:57:01 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-9053f3c7-4b61-4ffb-9604-a1852464fece tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73572) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 10:57:01 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-9053f3c7-4b61-4ffb-9604-a1852464fece tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] No VIF found with MAC fa:16:3e:a5:1f:21, not building metadata {{(pid=73572) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 10:57:01 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9053f3c7-4b61-4ffb-9604-a1852464fece tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Lock "dcfbde2c-659b-4095-ba9b-35df887ec976" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 18.729s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:57:01 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:57:01 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73572) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 10:57:04 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:57:05 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:57:06 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:57:10 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:57:11 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:57:15 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:57:16 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:57:20 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:57:25 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:57:25 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:57:25 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73572) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 10:57:25 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73572) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 10:57:25 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73572) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 10:57:25 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:57:26 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:57:30 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:57:30 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-d5361b3e-d4cb-40aa-9da5-2e03b25612b7 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Acquiring lock "dcfbde2c-659b-4095-ba9b-35df887ec976" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:57:30 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-d5361b3e-d4cb-40aa-9da5-2e03b25612b7 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Lock "dcfbde2c-659b-4095-ba9b-35df887ec976" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:57:30 user nova-compute[73572]: INFO nova.compute.manager [None req-d5361b3e-d4cb-40aa-9da5-2e03b25612b7 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] [instance: dcfbde2c-659b-4095-ba9b-35df887ec976] Detaching volume 943247a0-b7ed-4dcf-8f9a-e07232dc0df2
Aug 26 10:57:31 user nova-compute[73572]: INFO nova.virt.block_device [None req-d5361b3e-d4cb-40aa-9da5-2e03b25612b7 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] [instance: dcfbde2c-659b-4095-ba9b-35df887ec976] Attempting to driver detach volume 943247a0-b7ed-4dcf-8f9a-e07232dc0df2 from mountpoint /dev/vdb
Aug 26 10:57:31 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-d5361b3e-d4cb-40aa-9da5-2e03b25612b7 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Attempting to detach device vdb from instance dcfbde2c-659b-4095-ba9b-35df887ec976 from the persistent domain config. {{(pid=73572) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 10:57:31 user nova-compute[73572]: DEBUG nova.virt.libvirt.guest [None req-d5361b3e-d4cb-40aa-9da5-2e03b25612b7 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 10:57:31 user nova-compute[73572]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 10:57:31 user nova-compute[73572]:   <source dev="/dev/sdb"/>
Aug 26 10:57:31 user nova-compute[73572]:   <target dev="vdb" bus="virtio"/>
Aug 26 10:57:31 user nova-compute[73572]:   <serial>943247a0-b7ed-4dcf-8f9a-e07232dc0df2</serial>
Aug 26 10:57:31 user nova-compute[73572]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 10:57:31 user nova-compute[73572]: </disk>
Aug 26 10:57:31 user nova-compute[73572]:  {{(pid=73572) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 10:57:31 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-d5361b3e-d4cb-40aa-9da5-2e03b25612b7 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Successfully detached device vdb from instance dcfbde2c-659b-4095-ba9b-35df887ec976 from the persistent domain config.
Aug 26 10:57:31 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-d5361b3e-d4cb-40aa-9da5-2e03b25612b7 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance dcfbde2c-659b-4095-ba9b-35df887ec976 from the live domain config. {{(pid=73572) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 10:57:31 user nova-compute[73572]: DEBUG nova.virt.libvirt.guest [None req-d5361b3e-d4cb-40aa-9da5-2e03b25612b7 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 10:57:31 user nova-compute[73572]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 10:57:31 user nova-compute[73572]:   <source dev="/dev/sdb"/>
Aug 26 10:57:31 user nova-compute[73572]:   <target dev="vdb" bus="virtio"/>
Aug 26 10:57:31 user nova-compute[73572]:   <serial>943247a0-b7ed-4dcf-8f9a-e07232dc0df2</serial>
Aug 26 10:57:31 user nova-compute[73572]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 10:57:31 user nova-compute[73572]: </disk>
Aug 26 10:57:31 user nova-compute[73572]:  {{(pid=73572) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 10:57:31 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Received event <DeviceRemovedEvent: 1693047451.4700704, dcfbde2c-659b-4095-ba9b-35df887ec976 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73572) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 10:57:31 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-d5361b3e-d4cb-40aa-9da5-2e03b25612b7 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance dcfbde2c-659b-4095-ba9b-35df887ec976 {{(pid=73572) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 10:57:31 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-d5361b3e-d4cb-40aa-9da5-2e03b25612b7 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Successfully detached device vdb from instance dcfbde2c-659b-4095-ba9b-35df887ec976 from the live domain config.
Aug 26 10:57:31 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d5361b3e-d4cb-40aa-9da5-2e03b25612b7 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] [instance: dcfbde2c-659b-4095-ba9b-35df887ec976] calling os-brick to detach iSCSI Volume {{(pid=73572) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 10:57:31 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5361b3e-d4cb-40aa-9da5-2e03b25612b7 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc89c3d6a10>, {'target_iqns': ['iqn.2010-10.org.openstack:943247a0-b7ed-4dcf-8f9a-e07232dc0df2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MvnIRCKJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 10:57:31 user nova-compute[73572]: WARNING os_brick.initiator.connectors.base [None req-d5361b3e-d4cb-40aa-9da5-2e03b25612b7 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 10:57:31 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-d5361b3e-d4cb-40aa-9da5-2e03b25612b7 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 10:57:31 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-d5361b3e-d4cb-40aa-9da5-2e03b25612b7 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 10:57:31 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5361b3e-d4cb-40aa-9da5-2e03b25612b7 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:943247a0-b7ed-4dcf-8f9a-e07232dc0df2', 0)] {{(pid=73572) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 10:57:31 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:57:31 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:57:31 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e71b6f7-5c25-4db3-8e44-c12462442d8a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:943247a0-b7ed-4dcf-8f9a-e07232dc0df2\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:57:31 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:57:31 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:57:31 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[972ccf60-5963-4018-956a-312938444211]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:943247a0-b7ed-4dcf-8f9a-e07232dc0df2 (non-flash)\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:57:31 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5361b3e-d4cb-40aa-9da5-2e03b25612b7 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:943247a0-b7ed-4dcf-8f9a-e07232dc0df2 (non-flash)
Aug 26 10:57:31 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 10:57:31 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5361b3e-d4cb-40aa-9da5-2e03b25612b7 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:943247a0-b7ed-4dcf-8f9a-e07232dc0df2 (non-flash)
Aug 26 10:57:31 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 10:57:31 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5361b3e-d4cb-40aa-9da5-2e03b25612b7 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc878a89ea0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:943247a0-b7ed-4dcf-8f9a-e07232dc0df2'): ({'sdb'}, set())}) {{(pid=73572) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 10:57:31 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-d5361b3e-d4cb-40aa-9da5-2e03b25612b7 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Removing single pathed devices sdb {{(pid=73572) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 10:57:31 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:57:31 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:57:31 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[93235432-19ca-477b-9003-5747fdadafca]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:57:31 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:57:31 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:57:31 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[d81f2ac6-8b0a-48b0-8529-4266a2161553]: (4, ('ok\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:57:31 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-d5361b3e-d4cb-40aa-9da5-2e03b25612b7 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Flushing IO for device /dev/sdb {{(pid=73572) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 10:57:31 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:57:31 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:57:31 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[988207a7-7963-4154-bbc5-e6d1a646db15]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:57:31 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-d5361b3e-d4cb-40aa-9da5-2e03b25612b7 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73572) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 10:57:31 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:57:31 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.035s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:57:31 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[c57645f6-221f-4ae8-9bf1-3d5f17d5b009]: (4, ('1', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:57:31 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-d5361b3e-d4cb-40aa-9da5-2e03b25612b7 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73572) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 10:57:31 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-d5361b3e-d4cb-40aa-9da5-2e03b25612b7 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] SCSI volumes sdb have been removed. {{(pid=73572) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 10:57:31 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5361b3e-d4cb-40aa-9da5-2e03b25612b7 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:943247a0-b7ed-4dcf-8f9a-e07232dc0df2')] {{(pid=73572) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 10:57:31 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:943247a0-b7ed-4dcf-8f9a-e07232dc0df2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:57:31 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:943247a0-b7ed-4dcf-8f9a-e07232dc0df2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:57:31 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bb84331-68fd-446f-b567-387ed077546e]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:57:31 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5361b3e-d4cb-40aa-9da5-2e03b25612b7 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:57:31 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:943247a0-b7ed-4dcf-8f9a-e07232dc0df2 -p 172.16.0.220:3260 --logout {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:57:31 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:943247a0-b7ed-4dcf-8f9a-e07232dc0df2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:57:31 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ef1bb4f-26c4-4cce-b246-1d3dd758a736]: (4, ('Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:943247a0-b7ed-4dcf-8f9a-e07232dc0df2, portal: 172.16.0.220,3260]\nLogout of [sid: 67, target: iqn.2010-10.org.openstack:943247a0-b7ed-4dcf-8f9a-e07232dc0df2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:57:31 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5361b3e-d4cb-40aa-9da5-2e03b25612b7 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:943247a0-b7ed-4dcf-8f9a-e07232dc0df2, portal: 172.16.0.220,3260]
Aug 26 10:57:31 user nova-compute[73572]: Logout of [sid: 67, target: iqn.2010-10.org.openstack:943247a0-b7ed-4dcf-8f9a-e07232dc0df2, portal: 172.16.0.220,3260] successful.
Aug 26 10:57:31 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:57:31 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:943247a0-b7ed-4dcf-8f9a-e07232dc0df2 -p 172.16.0.220:3260 --op delete {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:57:31 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:943247a0-b7ed-4dcf-8f9a-e07232dc0df2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:57:31 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3efe1e6-9363-4601-9a7f-183b36191dab]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:57:31 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5361b3e-d4cb-40aa-9da5-2e03b25612b7 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:57:31 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-d5361b3e-d4cb-40aa-9da5-2e03b25612b7 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.251s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 10:57:31 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5361b3e-d4cb-40aa-9da5-2e03b25612b7 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] <== disconnect_volume: return (253ms) None {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 10:57:31 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d5361b3e-d4cb-40aa-9da5-2e03b25612b7 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] [instance: dcfbde2c-659b-4095-ba9b-35df887ec976] Disconnected iSCSI Volume {{(pid=73572) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 10:57:32 user nova-compute[73572]: DEBUG nova.objects.instance [None req-d5361b3e-d4cb-40aa-9da5-2e03b25612b7 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Lazy-loading 'flavor' on Instance uuid dcfbde2c-659b-4095-ba9b-35df887ec976 {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:57:32 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-d5361b3e-d4cb-40aa-9da5-2e03b25612b7 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Lock "dcfbde2c-659b-4095-ba9b-35df887ec976" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.581s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:57:35 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:57:40 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:57:45 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:57:46 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:57:49 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:57:49 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Starting heal instance info cache {{(pid=73572) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 10:57:49 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Rebuilding the list of instances to heal {{(pid=73572) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 10:57:49 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquiring lock "refresh_cache-dcfbde2c-659b-4095-ba9b-35df887ec976" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:57:49 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquired lock "refresh_cache-dcfbde2c-659b-4095-ba9b-35df887ec976" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:57:49 user nova-compute[73572]: DEBUG nova.network.neutron [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] [instance: dcfbde2c-659b-4095-ba9b-35df887ec976] Forcefully refreshing network info cache for instance {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 10:57:49 user nova-compute[73572]: DEBUG nova.objects.instance [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lazy-loading 'info_cache' on Instance uuid dcfbde2c-659b-4095-ba9b-35df887ec976 {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:57:50 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:57:50 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:57:50 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73572) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 10:57:50 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73572) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 10:57:50 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73572) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 10:57:50 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:57:50 user nova-compute[73572]: DEBUG nova.network.neutron [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] [instance: dcfbde2c-659b-4095-ba9b-35df887ec976] Updating instance_info_cache with network_info: [{"id": "90c1e997-ee83-43a9-97ae-2e3033f819e2", "address": "fa:16:3e:a5:1f:21", "network": {"id": "052a8e12-a71a-4c35-8001-bd3093ecdc4f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1777132020-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "131418241f3f4a21a1e8a08a962a31c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90c1e997-ee", "ovs_interfaceid": "90c1e997-ee83-43a9-97ae-2e3033f819e2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:57:50 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Releasing lock "refresh_cache-dcfbde2c-659b-4095-ba9b-35df887ec976" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:57:50 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] [instance: dcfbde2c-659b-4095-ba9b-35df887ec976] Updated the network info_cache for instance {{(pid=73572) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 10:57:53 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:57:55 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:57:56 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:57:56 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:57:56 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:57:56 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:57:56 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:57:56 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Auditing locally available compute resources for user (node: user) {{(pid=73572) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 10:57:56 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcfbde2c-659b-4095-ba9b-35df887ec976/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:57:57 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcfbde2c-659b-4095-ba9b-35df887ec976/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:57:57 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcfbde2c-659b-4095-ba9b-35df887ec976/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:57:57 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcfbde2c-659b-4095-ba9b-35df887ec976/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:57:57 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:57:57 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:57:57 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Hypervisor/Node resource view: name=user free_ram=8764MB free_disk=25.09162139892578GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=73572) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 10:57:57 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:57:57 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:57:57 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance dcfbde2c-659b-4095-ba9b-35df887ec976 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:57:57 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73572) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 10:57:57 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73572) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 10:57:58 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Refreshing inventories for resource provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 {{(pid=73572) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 26 10:57:58 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Updating ProviderTree inventory for provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73572) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 26 10:57:58 user nova-compute[73572]: DEBUG nova.compute.provider_tree [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Updating inventory in ProviderTree for provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73572) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 26 10:57:58 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Refreshing aggregate associations for resource provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75, aggregates: None {{(pid=73572) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 26 10:57:58 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Refreshing trait associations for resource provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75, traits: COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSSE3,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE2,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NODE,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_NE2K_PCI {{(pid=73572) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 26 10:57:58 user nova-compute[73572]: DEBUG nova.compute.provider_tree [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Inventory has not changed in ProviderTree for provider: e2cec974-59b2-4c77-a53d-a7f4e5a30d75 {{(pid=73572) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 10:57:58 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Inventory has not changed for provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73572) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 10:57:58 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Compute_service record updated for user:user {{(pid=73572) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 10:57:58 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.541s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:58:00 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:58:00 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:58:00 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:58:00 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:58:03 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:58:03 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73572) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 10:58:05 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:58:05 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:58:09 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:58:09 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73572) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 26 10:58:10 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:58:15 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:58:20 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:58:25 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:58:25 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-7b0f10fa-3319-40c4-9a62-41e652ee1f84 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Acquiring lock "dcfbde2c-659b-4095-ba9b-35df887ec976" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:58:25 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-7b0f10fa-3319-40c4-9a62-41e652ee1f84 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Lock "dcfbde2c-659b-4095-ba9b-35df887ec976" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:58:25 user nova-compute[73572]: DEBUG nova.objects.instance [None req-7b0f10fa-3319-40c4-9a62-41e652ee1f84 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Lazy-loading 'flavor' on Instance uuid dcfbde2c-659b-4095-ba9b-35df887ec976 {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:58:25 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-7b0f10fa-3319-40c4-9a62-41e652ee1f84 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Lock "dcfbde2c-659b-4095-ba9b-35df887ec976" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:58:25 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-7b0f10fa-3319-40c4-9a62-41e652ee1f84 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Acquiring lock "dcfbde2c-659b-4095-ba9b-35df887ec976" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:58:25 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-7b0f10fa-3319-40c4-9a62-41e652ee1f84 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Lock "dcfbde2c-659b-4095-ba9b-35df887ec976" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:58:25 user nova-compute[73572]: INFO nova.compute.manager [None req-7b0f10fa-3319-40c4-9a62-41e652ee1f84 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] [instance: dcfbde2c-659b-4095-ba9b-35df887ec976] Attaching volume cccbbb7c-cff3-4e67-98a3-cc48ad6478cc to /dev/vdb
Aug 26 10:58:25 user nova-compute[73572]: DEBUG os_brick.utils [None req-7b0f10fa-3319-40c4-9a62-41e652ee1f84 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 10:58:25 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:58:25 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:58:25 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ca6cbfe-a2f1-482a-af86-eb9df43b4442]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:de8a79ed912\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:58:25 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:58:25 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:58:25 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[89f88174-eb69-4a3a-84a6-9d0fd42dba73]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:58:25 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:58:25 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:58:25 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a4e7500-98cc-47b4-a5c5-2370f688d322]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:58:25 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[a55b9475-5745-4e5f-a04b-606dd8ea2e52]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:58:25 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-7b0f10fa-3319-40c4-9a62-41e652ee1f84 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Running cmd (subprocess): nvme version {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:58:25 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-7b0f10fa-3319-40c4-9a62-41e652ee1f84 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] 'nvme version' failed. Not Retrying. {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 10:58:25 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7b0f10fa-3319-40c4-9a62-41e652ee1f84 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] nvme not present on system {{(pid=73572) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 10:58:25 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:58:25 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 10:58:25 user nova-compute[73572]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 10:58:25 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[813c798c-6cfb-44f5-bdf3-2b787944c653]: (4, '') {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:58:25 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.lightos [None req-7b0f10fa-3319-40c4-9a62-41e652ee1f84 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73572) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 10:58:25 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.lightos [None req-7b0f10fa-3319-40c4-9a62-41e652ee1f84 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73572) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 10:58:25 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.lightos [None req-7b0f10fa-3319-40c4-9a62-41e652ee1f84 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] LIGHTOS: no hostnqn found. {{(pid=73572) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 10:58:25 user nova-compute[73572]: DEBUG os_brick.utils [None req-7b0f10fa-3319-40c4-9a62-41e652ee1f84 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:de8a79ed912', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 10:58:25 user nova-compute[73572]: DEBUG nova.virt.block_device [None req-7b0f10fa-3319-40c4-9a62-41e652ee1f84 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] [instance: dcfbde2c-659b-4095-ba9b-35df887ec976] Updating existing volume attachment record: f67b9f6f-9569-406e-815b-5c593b7105fc {{(pid=73572) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 10:58:26 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:58:30 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:58:32 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:58:32 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Cleaning up deleted instances {{(pid=73572) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 26 10:58:32 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] There are 0 instances to clean {{(pid=73572) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 26 10:58:33 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:58:35 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:58:35 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7b0f10fa-3319-40c4-9a62-41e652ee1f84 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] [instance: dcfbde2c-659b-4095-ba9b-35df887ec976] Calling os-brick to attach iSCSI Volume {{(pid=73572) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 10:58:35 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b0f10fa-3319-40c4-9a62-41e652ee1f84 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc89c3d6a10>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:cccbbb7c-cff3-4e67-98a3-cc48ad6478cc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xNAikJWR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 10:58:35 user nova-compute[73572]: WARNING os_brick.initiator.connectors.base [None req-7b0f10fa-3319-40c4-9a62-41e652ee1f84 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 10:58:35 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-7b0f10fa-3319-40c4-9a62-41e652ee1f84 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 10:58:35 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-7b0f10fa-3319-40c4-9a62-41e652ee1f84 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 10:58:35 user nova-compute[73572]: WARNING os_brick.initiator.connectors.base [None req-7b0f10fa-3319-40c4-9a62-41e652ee1f84 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 10:58:35 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-7b0f10fa-3319-40c4-9a62-41e652ee1f84 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cccbbb7c-cff3-4e67-98a3-cc48ad6478cc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 10:58:35 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-7b0f10fa-3319-40c4-9a62-41e652ee1f84 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cccbbb7c-cff3-4e67-98a3-cc48ad6478cc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 10:58:35 user nova-compute[73572]: INFO os_brick.initiator.connectors.iscsi [None req-7b0f10fa-3319-40c4-9a62-41e652ee1f84 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 10:58:35 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cccbbb7c-cff3-4e67-98a3-cc48ad6478cc -p 172.16.0.220:3260 {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:58:35 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cccbbb7c-cff3-4e67-98a3-cc48ad6478cc -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:58:35 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f9b2ce1-43f9-4a49-b1ac-d7e542f47270]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:58:35 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b0f10fa-3319-40c4-9a62-41e652ee1f84 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 10:58:35 user nova-compute[73572]:  {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:58:35 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cccbbb7c-cff3-4e67-98a3-cc48ad6478cc -p 172.16.0.220:3260 --interface default --op new {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:58:35 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cccbbb7c-cff3-4e67-98a3-cc48ad6478cc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:58:35 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[23fe1b1e-fb68-4a08-8df2-96a14f2b7b02]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cccbbb7c-cff3-4e67-98a3-cc48ad6478cc] added\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:58:35 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b0f10fa-3319-40c4-9a62-41e652ee1f84 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cccbbb7c-cff3-4e67-98a3-cc48ad6478cc] added
Aug 26 10:58:35 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:58:35 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cccbbb7c-cff3-4e67-98a3-cc48ad6478cc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:58:35 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cccbbb7c-cff3-4e67-98a3-cc48ad6478cc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:58:35 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[2941ade3-96ef-4328-b727-483a18dab37f]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:58:35 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b0f10fa-3319-40c4-9a62-41e652ee1f84 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:58:35 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cccbbb7c-cff3-4e67-98a3-cc48ad6478cc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:58:35 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cccbbb7c-cff3-4e67-98a3-cc48ad6478cc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:58:35 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[6efcbb7b-7569-405c-8ac2-fd0814a8ab77]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:58:35 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b0f10fa-3319-40c4-9a62-41e652ee1f84 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:58:35 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cccbbb7c-cff3-4e67-98a3-cc48ad6478cc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xNAikJWR {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:58:35 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cccbbb7c-cff3-4e67-98a3-cc48ad6478cc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xNAikJWR" returned: 0 in 0.017s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:58:35 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[400424fa-8275-41c9-b735-04c095f95fdc]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:58:35 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b0f10fa-3319-40c4-9a62-41e652ee1f84 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xNAikJWR'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:58:35 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cccbbb7c-cff3-4e67-98a3-cc48ad6478cc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:58:35 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cccbbb7c-cff3-4e67-98a3-cc48ad6478cc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:58:35 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[73d02922-e5fb-470b-877a-178c79cb52a1]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:58:35 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b0f10fa-3319-40c4-9a62-41e652ee1f84 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:58:35 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:58:35 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:58:35 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[b640b68b-a3c0-40a3-8868-60b758079fb7]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:58:35 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b0f10fa-3319-40c4-9a62-41e652ee1f84 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 26 10:58:35 user nova-compute[73572]:  {{(pid=73572) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 10:58:35 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b0f10fa-3319-40c4-9a62-41e652ee1f84 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 26 10:58:35 user nova-compute[73572]:  {{(pid=73572) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 10:58:35 user nova-compute[73572]: WARNING os_brick.initiator.connectors.iscsi [None req-7b0f10fa-3319-40c4-9a62-41e652ee1f84 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 26 10:58:35 user nova-compute[73572]: 
Aug 26 10:58:35 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cccbbb7c-cff3-4e67-98a3-cc48ad6478cc -p 172.16.0.220:3260 --login {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:58:35 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cccbbb7c-cff3-4e67-98a3-cc48ad6478cc -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:58:35 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d791706-abda-47ac-b393-a7cfce330056]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cccbbb7c-cff3-4e67-98a3-cc48ad6478cc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cccbbb7c-cff3-4e67-98a3-cc48ad6478cc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:58:35 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b0f10fa-3319-40c4-9a62-41e652ee1f84 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cccbbb7c-cff3-4e67-98a3-cc48ad6478cc, portal: 172.16.0.220,3260]
Aug 26 10:58:35 user nova-compute[73572]: Login to [iface: default, target: iqn.2010-10.org.openstack:cccbbb7c-cff3-4e67-98a3-cc48ad6478cc, portal: 172.16.0.220,3260] successful.
Aug 26 10:58:35 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:58:35 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cccbbb7c-cff3-4e67-98a3-cc48ad6478cc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:58:35 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cccbbb7c-cff3-4e67-98a3-cc48ad6478cc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:58:35 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[edfc50f8-7324-45cc-9466-7419401bcb12]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:58:35 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b0f10fa-3319-40c4-9a62-41e652ee1f84 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:58:35 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:58:35 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:58:35 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[d13ed375-aa6b-4864-95c8-8a8205d83009]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cccbbb7c-cff3-4e67-98a3-cc48ad6478cc (non-flash)\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:58:35 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b0f10fa-3319-40c4-9a62-41e652ee1f84 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cccbbb7c-cff3-4e67-98a3-cc48ad6478cc (non-flash)
Aug 26 10:58:35 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 10:58:35 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b0f10fa-3319-40c4-9a62-41e652ee1f84 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cccbbb7c-cff3-4e67-98a3-cc48ad6478cc (non-flash)
Aug 26 10:58:35 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 10:58:35 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-7b0f10fa-3319-40c4-9a62-41e652ee1f84 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cccbbb7c-cff3-4e67-98a3-cc48ad6478cc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.252s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 10:58:35 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b0f10fa-3319-40c4-9a62-41e652ee1f84 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Connected to 172.16.0.220:3260 {{(pid=73572) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 10:58:35 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-7b0f10fa-3319-40c4-9a62-41e652ee1f84 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] HCTL ('33', '-', '-', 0) found on session 68 with lun 0 {{(pid=73572) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 10:58:35 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-7b0f10fa-3319-40c4-9a62-41e652ee1f84 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73572) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 10:58:35 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:58:35 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:58:35 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[12d5e0cd-2af6-4a4b-9635-6b225d0350dc]: (4, ('- - 0', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:58:35 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-7b0f10fa-3319-40c4-9a62-41e652ee1f84 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Searching for a device in session 68 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73572) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 10:58:35 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b0f10fa-3319-40c4-9a62-41e652ee1f84 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xNAikJWR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73572) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 10:58:36 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-7b0f10fa-3319-40c4-9a62-41e652ee1f84 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.285s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 10:58:36 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b0f10fa-3319-40c4-9a62-41e652ee1f84 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] <== connect_volume: return (1287ms) {'type': 'block', 'scsi_wwn': '23533393130316633', 'path': '/dev/sdb'} {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 10:58:36 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7b0f10fa-3319-40c4-9a62-41e652ee1f84 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] [instance: dcfbde2c-659b-4095-ba9b-35df887ec976] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23533393130316633', 'path': '/dev/sdb'} {{(pid=73572) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 10:58:36 user nova-compute[73572]: DEBUG nova.objects.instance [None req-7b0f10fa-3319-40c4-9a62-41e652ee1f84 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Lazy-loading 'flavor' on Instance uuid dcfbde2c-659b-4095-ba9b-35df887ec976 {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:58:36 user nova-compute[73572]: DEBUG nova.virt.libvirt.guest [None req-7b0f10fa-3319-40c4-9a62-41e652ee1f84 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 10:58:36 user nova-compute[73572]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 10:58:36 user nova-compute[73572]:   <source dev="/dev/sdb"/>
Aug 26 10:58:36 user nova-compute[73572]:   <target dev="vdb" bus="virtio"/>
Aug 26 10:58:36 user nova-compute[73572]:   <serial>cccbbb7c-cff3-4e67-98a3-cc48ad6478cc</serial>
Aug 26 10:58:36 user nova-compute[73572]: </disk>
Aug 26 10:58:36 user nova-compute[73572]:  {{(pid=73572) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 10:58:37 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-7b0f10fa-3319-40c4-9a62-41e652ee1f84 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] No BDM found with device name vda, not building metadata. {{(pid=73572) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 10:58:37 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-7b0f10fa-3319-40c4-9a62-41e652ee1f84 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73572) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 10:58:37 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-7b0f10fa-3319-40c4-9a62-41e652ee1f84 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] No VIF found with MAC fa:16:3e:a5:1f:21, not building metadata {{(pid=73572) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 10:58:37 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-7b0f10fa-3319-40c4-9a62-41e652ee1f84 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Lock "dcfbde2c-659b-4095-ba9b-35df887ec976" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.951s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:58:39 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-eef37baf-da11-473c-8748-7182bc659828 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Acquiring lock "dcfbde2c-659b-4095-ba9b-35df887ec976" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:58:39 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-eef37baf-da11-473c-8748-7182bc659828 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Lock "dcfbde2c-659b-4095-ba9b-35df887ec976" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:58:39 user nova-compute[73572]: INFO nova.compute.manager [None req-eef37baf-da11-473c-8748-7182bc659828 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] [instance: dcfbde2c-659b-4095-ba9b-35df887ec976] Detaching volume cccbbb7c-cff3-4e67-98a3-cc48ad6478cc
Aug 26 10:58:39 user nova-compute[73572]: INFO nova.virt.block_device [None req-eef37baf-da11-473c-8748-7182bc659828 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] [instance: dcfbde2c-659b-4095-ba9b-35df887ec976] Attempting to driver detach volume cccbbb7c-cff3-4e67-98a3-cc48ad6478cc from mountpoint /dev/vdb
Aug 26 10:58:39 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-eef37baf-da11-473c-8748-7182bc659828 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Attempting to detach device vdb from instance dcfbde2c-659b-4095-ba9b-35df887ec976 from the persistent domain config. {{(pid=73572) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 10:58:39 user nova-compute[73572]: DEBUG nova.virt.libvirt.guest [None req-eef37baf-da11-473c-8748-7182bc659828 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 10:58:39 user nova-compute[73572]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 10:58:39 user nova-compute[73572]:   <source dev="/dev/sdb"/>
Aug 26 10:58:39 user nova-compute[73572]:   <target dev="vdb" bus="virtio"/>
Aug 26 10:58:39 user nova-compute[73572]:   <serial>cccbbb7c-cff3-4e67-98a3-cc48ad6478cc</serial>
Aug 26 10:58:39 user nova-compute[73572]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 10:58:39 user nova-compute[73572]: </disk>
Aug 26 10:58:39 user nova-compute[73572]:  {{(pid=73572) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 10:58:39 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-eef37baf-da11-473c-8748-7182bc659828 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Successfully detached device vdb from instance dcfbde2c-659b-4095-ba9b-35df887ec976 from the persistent domain config.
Aug 26 10:58:39 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-eef37baf-da11-473c-8748-7182bc659828 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance dcfbde2c-659b-4095-ba9b-35df887ec976 from the live domain config. {{(pid=73572) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 10:58:39 user nova-compute[73572]: DEBUG nova.virt.libvirt.guest [None req-eef37baf-da11-473c-8748-7182bc659828 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 10:58:39 user nova-compute[73572]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 10:58:39 user nova-compute[73572]:   <source dev="/dev/sdb"/>
Aug 26 10:58:39 user nova-compute[73572]:   <target dev="vdb" bus="virtio"/>
Aug 26 10:58:39 user nova-compute[73572]:   <serial>cccbbb7c-cff3-4e67-98a3-cc48ad6478cc</serial>
Aug 26 10:58:39 user nova-compute[73572]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 10:58:39 user nova-compute[73572]: </disk>
Aug 26 10:58:39 user nova-compute[73572]:  {{(pid=73572) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 10:58:40 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:58:40 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Received event <DeviceRemovedEvent: 1693047520.3496919, dcfbde2c-659b-4095-ba9b-35df887ec976 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73572) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 10:58:40 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-eef37baf-da11-473c-8748-7182bc659828 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance dcfbde2c-659b-4095-ba9b-35df887ec976 {{(pid=73572) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 10:58:40 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-eef37baf-da11-473c-8748-7182bc659828 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Successfully detached device vdb from instance dcfbde2c-659b-4095-ba9b-35df887ec976 from the live domain config.
Aug 26 10:58:40 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eef37baf-da11-473c-8748-7182bc659828 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] [instance: dcfbde2c-659b-4095-ba9b-35df887ec976] calling os-brick to detach iSCSI Volume {{(pid=73572) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 10:58:40 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-eef37baf-da11-473c-8748-7182bc659828 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc89c3d6a10>, {'target_iqns': ['iqn.2010-10.org.openstack:cccbbb7c-cff3-4e67-98a3-cc48ad6478cc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xNAikJWR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 10:58:40 user nova-compute[73572]: WARNING os_brick.initiator.connectors.base [None req-eef37baf-da11-473c-8748-7182bc659828 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 10:58:40 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-eef37baf-da11-473c-8748-7182bc659828 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 10:58:40 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-eef37baf-da11-473c-8748-7182bc659828 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 10:58:40 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-eef37baf-da11-473c-8748-7182bc659828 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cccbbb7c-cff3-4e67-98a3-cc48ad6478cc', 0)] {{(pid=73572) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 10:58:40 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:58:40 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:58:40 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[46f1e59e-8462-442e-a38e-7a1acd7fc659]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cccbbb7c-cff3-4e67-98a3-cc48ad6478cc\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:58:40 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:58:40 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:58:40 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[09821ee2-d382-41e9-84db-c208a2232518]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cccbbb7c-cff3-4e67-98a3-cc48ad6478cc (non-flash)\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:58:40 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-eef37baf-da11-473c-8748-7182bc659828 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cccbbb7c-cff3-4e67-98a3-cc48ad6478cc (non-flash)
Aug 26 10:58:40 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 10:58:40 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-eef37baf-da11-473c-8748-7182bc659828 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cccbbb7c-cff3-4e67-98a3-cc48ad6478cc (non-flash)
Aug 26 10:58:40 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 10:58:40 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-eef37baf-da11-473c-8748-7182bc659828 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc878c7c0d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cccbbb7c-cff3-4e67-98a3-cc48ad6478cc'): ({'sdb'}, set())}) {{(pid=73572) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 10:58:40 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-eef37baf-da11-473c-8748-7182bc659828 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Removing single pathed devices sdb {{(pid=73572) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 10:58:40 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:58:40 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:58:40 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[96fb4277-481d-486b-b36a-069b973b050d]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:58:40 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:58:40 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:58:40 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[104b376b-3bbb-480e-8cb4-3f888cda12db]: (4, ('ok\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:58:40 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-eef37baf-da11-473c-8748-7182bc659828 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Flushing IO for device /dev/sdb {{(pid=73572) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 10:58:40 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:58:40 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:58:40 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4b3e678-cea6-4637-9a76-6725a8352b7c]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:58:40 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-eef37baf-da11-473c-8748-7182bc659828 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73572) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 10:58:40 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:58:40 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:58:40 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[c90d243c-64d9-40ea-a51e-9e069d4a0909]: (4, ('1', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:58:40 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-eef37baf-da11-473c-8748-7182bc659828 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73572) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 10:58:40 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-eef37baf-da11-473c-8748-7182bc659828 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] SCSI volumes sdb have been removed. {{(pid=73572) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 10:58:40 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-eef37baf-da11-473c-8748-7182bc659828 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cccbbb7c-cff3-4e67-98a3-cc48ad6478cc')] {{(pid=73572) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 10:58:40 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cccbbb7c-cff3-4e67-98a3-cc48ad6478cc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:58:40 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cccbbb7c-cff3-4e67-98a3-cc48ad6478cc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:58:40 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0034f66-e7a5-4ef4-9414-8d1ba91cbb48]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:58:40 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-eef37baf-da11-473c-8748-7182bc659828 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:58:40 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cccbbb7c-cff3-4e67-98a3-cc48ad6478cc -p 172.16.0.220:3260 --logout {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:58:40 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cccbbb7c-cff3-4e67-98a3-cc48ad6478cc -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:58:40 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[231acdec-814e-4ffe-978b-968ae489af0c]: (4, ('Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:cccbbb7c-cff3-4e67-98a3-cc48ad6478cc, portal: 172.16.0.220,3260]\nLogout of [sid: 68, target: iqn.2010-10.org.openstack:cccbbb7c-cff3-4e67-98a3-cc48ad6478cc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:58:40 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-eef37baf-da11-473c-8748-7182bc659828 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:cccbbb7c-cff3-4e67-98a3-cc48ad6478cc, portal: 172.16.0.220,3260]
Aug 26 10:58:40 user nova-compute[73572]: Logout of [sid: 68, target: iqn.2010-10.org.openstack:cccbbb7c-cff3-4e67-98a3-cc48ad6478cc, portal: 172.16.0.220,3260] successful.
Aug 26 10:58:40 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:58:40 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cccbbb7c-cff3-4e67-98a3-cc48ad6478cc -p 172.16.0.220:3260 --op delete {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:58:40 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cccbbb7c-cff3-4e67-98a3-cc48ad6478cc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:58:40 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[6218df8d-ac0c-45de-b2ca-bd89ac215b18]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:58:40 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-eef37baf-da11-473c-8748-7182bc659828 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:58:40 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-eef37baf-da11-473c-8748-7182bc659828 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.254s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 10:58:40 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-eef37baf-da11-473c-8748-7182bc659828 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] <== disconnect_volume: return (256ms) None {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 10:58:40 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eef37baf-da11-473c-8748-7182bc659828 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] [instance: dcfbde2c-659b-4095-ba9b-35df887ec976] Disconnected iSCSI Volume {{(pid=73572) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 10:58:41 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:58:41 user nova-compute[73572]: DEBUG nova.objects.instance [None req-eef37baf-da11-473c-8748-7182bc659828 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Lazy-loading 'flavor' on Instance uuid dcfbde2c-659b-4095-ba9b-35df887ec976 {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:58:41 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-eef37baf-da11-473c-8748-7182bc659828 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Lock "dcfbde2c-659b-4095-ba9b-35df887ec976" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.611s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:58:45 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:58:45 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._sync_power_states {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:58:45 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Triggering sync for uuid dcfbde2c-659b-4095-ba9b-35df887ec976 {{(pid=73572) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 10:58:45 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquiring lock "dcfbde2c-659b-4095-ba9b-35df887ec976" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:58:45 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "dcfbde2c-659b-4095-ba9b-35df887ec976" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:58:45 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "dcfbde2c-659b-4095-ba9b-35df887ec976" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.024s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:58:46 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:58:49 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:58:49 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Starting heal instance info cache {{(pid=73572) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 10:58:49 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Rebuilding the list of instances to heal {{(pid=73572) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 10:58:49 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquiring lock "refresh_cache-dcfbde2c-659b-4095-ba9b-35df887ec976" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:58:49 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquired lock "refresh_cache-dcfbde2c-659b-4095-ba9b-35df887ec976" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:58:49 user nova-compute[73572]: DEBUG nova.network.neutron [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] [instance: dcfbde2c-659b-4095-ba9b-35df887ec976] Forcefully refreshing network info cache for instance {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 10:58:49 user nova-compute[73572]: DEBUG nova.objects.instance [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lazy-loading 'info_cache' on Instance uuid dcfbde2c-659b-4095-ba9b-35df887ec976 {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:58:50 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:58:50 user nova-compute[73572]: DEBUG nova.network.neutron [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] [instance: dcfbde2c-659b-4095-ba9b-35df887ec976] Updating instance_info_cache with network_info: [{"id": "90c1e997-ee83-43a9-97ae-2e3033f819e2", "address": "fa:16:3e:a5:1f:21", "network": {"id": "052a8e12-a71a-4c35-8001-bd3093ecdc4f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1777132020-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "131418241f3f4a21a1e8a08a962a31c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90c1e997-ee", "ovs_interfaceid": "90c1e997-ee83-43a9-97ae-2e3033f819e2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:58:50 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Releasing lock "refresh_cache-dcfbde2c-659b-4095-ba9b-35df887ec976" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:58:50 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] [instance: dcfbde2c-659b-4095-ba9b-35df887ec976] Updated the network info_cache for instance {{(pid=73572) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 10:58:54 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:58:55 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:58:57 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:58:57 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:58:57 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:58:57 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:58:57 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Auditing locally available compute resources for user (node: user) {{(pid=73572) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 10:58:57 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcfbde2c-659b-4095-ba9b-35df887ec976/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:58:58 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcfbde2c-659b-4095-ba9b-35df887ec976/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:58:58 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcfbde2c-659b-4095-ba9b-35df887ec976/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:58:58 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcfbde2c-659b-4095-ba9b-35df887ec976/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:58:58 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:58:58 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:58:58 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Hypervisor/Node resource view: name=user free_ram=8767MB free_disk=25.090667724609375GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=73572) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 10:58:58 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:58:58 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:58:58 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance dcfbde2c-659b-4095-ba9b-35df887ec976 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:58:58 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73572) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 10:58:58 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73572) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 10:58:58 user nova-compute[73572]: DEBUG nova.compute.provider_tree [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Inventory has not changed in ProviderTree for provider: e2cec974-59b2-4c77-a53d-a7f4e5a30d75 {{(pid=73572) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 10:58:58 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Inventory has not changed for provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73572) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 10:58:58 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Compute_service record updated for user:user {{(pid=73572) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 10:58:58 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.149s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:58:59 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:59:00 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:59:00 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:59:01 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:59:05 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:59:05 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:59:05 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73572) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 10:59:06 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:59:10 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:59:15 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:59:20 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:59:25 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:59:30 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:59:33 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-c19ad40d-a6db-4946-81bf-ce95cadadd41 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Acquiring lock "dcfbde2c-659b-4095-ba9b-35df887ec976" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:59:33 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-c19ad40d-a6db-4946-81bf-ce95cadadd41 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Lock "dcfbde2c-659b-4095-ba9b-35df887ec976" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:59:33 user nova-compute[73572]: DEBUG nova.objects.instance [None req-c19ad40d-a6db-4946-81bf-ce95cadadd41 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Lazy-loading 'flavor' on Instance uuid dcfbde2c-659b-4095-ba9b-35df887ec976 {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:59:33 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-c19ad40d-a6db-4946-81bf-ce95cadadd41 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Lock "dcfbde2c-659b-4095-ba9b-35df887ec976" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.047s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:59:34 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-c19ad40d-a6db-4946-81bf-ce95cadadd41 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Acquiring lock "dcfbde2c-659b-4095-ba9b-35df887ec976" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:59:34 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-c19ad40d-a6db-4946-81bf-ce95cadadd41 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Lock "dcfbde2c-659b-4095-ba9b-35df887ec976" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:59:34 user nova-compute[73572]: INFO nova.compute.manager [None req-c19ad40d-a6db-4946-81bf-ce95cadadd41 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] [instance: dcfbde2c-659b-4095-ba9b-35df887ec976] Attaching volume eb42c30e-7d0f-43a8-9562-01c0f0471b89 to /dev/vdb
Aug 26 10:59:34 user nova-compute[73572]: DEBUG os_brick.utils [None req-c19ad40d-a6db-4946-81bf-ce95cadadd41 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 10:59:34 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:59:34 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:59:34 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[afaac98f-c58a-48eb-b292-3137ee6a77ed]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:de8a79ed912\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:59:34 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:59:34 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:59:34 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[b82b378c-479c-4eab-862a-47429918325e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:59:34 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:59:34 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:59:34 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed3cb1b0-b0a0-441e-ac88-feaacde743a3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:59:34 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[e66af764-a7cb-4bf7-a95c-699e44dca2e7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:59:34 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-c19ad40d-a6db-4946-81bf-ce95cadadd41 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Running cmd (subprocess): nvme version {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:59:34 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-c19ad40d-a6db-4946-81bf-ce95cadadd41 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] 'nvme version' failed. Not Retrying. {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 10:59:34 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c19ad40d-a6db-4946-81bf-ce95cadadd41 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] nvme not present on system {{(pid=73572) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 10:59:34 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:59:34 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 10:59:34 user nova-compute[73572]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 10:59:34 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[b393159d-859d-4f2e-9933-abcfda8f7392]: (4, '') {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:59:34 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.lightos [None req-c19ad40d-a6db-4946-81bf-ce95cadadd41 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73572) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 10:59:34 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.lightos [None req-c19ad40d-a6db-4946-81bf-ce95cadadd41 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73572) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 10:59:34 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.lightos [None req-c19ad40d-a6db-4946-81bf-ce95cadadd41 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] LIGHTOS: no hostnqn found. {{(pid=73572) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 10:59:34 user nova-compute[73572]: DEBUG os_brick.utils [None req-c19ad40d-a6db-4946-81bf-ce95cadadd41 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:de8a79ed912', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 10:59:34 user nova-compute[73572]: DEBUG nova.virt.block_device [None req-c19ad40d-a6db-4946-81bf-ce95cadadd41 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] [instance: dcfbde2c-659b-4095-ba9b-35df887ec976] Updating existing volume attachment record: d6027259-40be-4178-8d58-a0510fe5e1a9 {{(pid=73572) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 10:59:35 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:59:36 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:59:40 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:59:44 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c19ad40d-a6db-4946-81bf-ce95cadadd41 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] [instance: dcfbde2c-659b-4095-ba9b-35df887ec976] Calling os-brick to attach iSCSI Volume {{(pid=73572) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 10:59:44 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-c19ad40d-a6db-4946-81bf-ce95cadadd41 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc89c3d6a10>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:eb42c30e-7d0f-43a8-9562-01c0f0471b89'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dhFqKnZO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 10:59:44 user nova-compute[73572]: WARNING os_brick.initiator.connectors.base [None req-c19ad40d-a6db-4946-81bf-ce95cadadd41 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 10:59:44 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-c19ad40d-a6db-4946-81bf-ce95cadadd41 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 10:59:44 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-c19ad40d-a6db-4946-81bf-ce95cadadd41 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 10:59:44 user nova-compute[73572]: WARNING os_brick.initiator.connectors.base [None req-c19ad40d-a6db-4946-81bf-ce95cadadd41 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 10:59:44 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-c19ad40d-a6db-4946-81bf-ce95cadadd41 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eb42c30e-7d0f-43a8-9562-01c0f0471b89" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 10:59:44 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-c19ad40d-a6db-4946-81bf-ce95cadadd41 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eb42c30e-7d0f-43a8-9562-01c0f0471b89" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 10:59:44 user nova-compute[73572]: INFO os_brick.initiator.connectors.iscsi [None req-c19ad40d-a6db-4946-81bf-ce95cadadd41 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 10:59:44 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb42c30e-7d0f-43a8-9562-01c0f0471b89 -p 172.16.0.220:3260 {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:59:44 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb42c30e-7d0f-43a8-9562-01c0f0471b89 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:59:44 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[4161a004-8a5e-4d32-b9dc-c95f6635bf12]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:59:44 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-c19ad40d-a6db-4946-81bf-ce95cadadd41 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 10:59:44 user nova-compute[73572]:  {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:59:44 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb42c30e-7d0f-43a8-9562-01c0f0471b89 -p 172.16.0.220:3260 --interface default --op new {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:59:44 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb42c30e-7d0f-43a8-9562-01c0f0471b89 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:59:44 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0ccf3e3-ac4e-458e-a1c8-5817cb273f73]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:eb42c30e-7d0f-43a8-9562-01c0f0471b89] added\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:59:44 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-c19ad40d-a6db-4946-81bf-ce95cadadd41 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:eb42c30e-7d0f-43a8-9562-01c0f0471b89] added
Aug 26 10:59:44 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:59:44 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb42c30e-7d0f-43a8-9562-01c0f0471b89 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:59:44 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb42c30e-7d0f-43a8-9562-01c0f0471b89 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:59:44 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[ace1eb95-6d39-4c3a-b26d-83fd1a356845]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:59:44 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-c19ad40d-a6db-4946-81bf-ce95cadadd41 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:59:44 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb42c30e-7d0f-43a8-9562-01c0f0471b89 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:59:44 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb42c30e-7d0f-43a8-9562-01c0f0471b89 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:59:44 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[81ebd29c-0820-4e44-8705-2610295b7e32]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:59:44 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-c19ad40d-a6db-4946-81bf-ce95cadadd41 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:59:44 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb42c30e-7d0f-43a8-9562-01c0f0471b89 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dhFqKnZO {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:59:44 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb42c30e-7d0f-43a8-9562-01c0f0471b89 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dhFqKnZO" returned: 0 in 0.017s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:59:44 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[72c3168b-16ed-4830-b8ce-70b9de39125c]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:59:44 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-c19ad40d-a6db-4946-81bf-ce95cadadd41 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dhFqKnZO'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:59:44 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb42c30e-7d0f-43a8-9562-01c0f0471b89 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:59:44 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb42c30e-7d0f-43a8-9562-01c0f0471b89 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:59:44 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4d753c8-82d3-44c0-b055-7f5fe5477185]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:59:44 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-c19ad40d-a6db-4946-81bf-ce95cadadd41 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:59:44 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:59:44 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:59:44 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[05bb980f-ffdf-4630-8442-d165d3f00355]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:59:44 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-c19ad40d-a6db-4946-81bf-ce95cadadd41 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 26 10:59:44 user nova-compute[73572]:  {{(pid=73572) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 10:59:44 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-c19ad40d-a6db-4946-81bf-ce95cadadd41 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 26 10:59:44 user nova-compute[73572]:  {{(pid=73572) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 10:59:44 user nova-compute[73572]: WARNING os_brick.initiator.connectors.iscsi [None req-c19ad40d-a6db-4946-81bf-ce95cadadd41 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 26 10:59:44 user nova-compute[73572]: 
Aug 26 10:59:44 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb42c30e-7d0f-43a8-9562-01c0f0471b89 -p 172.16.0.220:3260 --login {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:59:44 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb42c30e-7d0f-43a8-9562-01c0f0471b89 -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:59:44 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1b98375-d5f4-446d-8812-76a1a67b302e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:eb42c30e-7d0f-43a8-9562-01c0f0471b89, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:eb42c30e-7d0f-43a8-9562-01c0f0471b89, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:59:44 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-c19ad40d-a6db-4946-81bf-ce95cadadd41 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:eb42c30e-7d0f-43a8-9562-01c0f0471b89, portal: 172.16.0.220,3260]
Aug 26 10:59:44 user nova-compute[73572]: Login to [iface: default, target: iqn.2010-10.org.openstack:eb42c30e-7d0f-43a8-9562-01c0f0471b89, portal: 172.16.0.220,3260] successful.
Aug 26 10:59:44 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:59:44 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb42c30e-7d0f-43a8-9562-01c0f0471b89 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:59:44 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb42c30e-7d0f-43a8-9562-01c0f0471b89 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:59:44 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0d9332c-df6c-4ff5-b9fa-148bb31f305c]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:59:44 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-c19ad40d-a6db-4946-81bf-ce95cadadd41 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:59:44 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:59:44 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:59:44 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[42cf4fa5-1b8f-4392-bd4c-55d2519e6c41]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb42c30e-7d0f-43a8-9562-01c0f0471b89 (non-flash)\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:59:44 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-c19ad40d-a6db-4946-81bf-ce95cadadd41 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb42c30e-7d0f-43a8-9562-01c0f0471b89 (non-flash)
Aug 26 10:59:44 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 10:59:44 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-c19ad40d-a6db-4946-81bf-ce95cadadd41 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb42c30e-7d0f-43a8-9562-01c0f0471b89 (non-flash)
Aug 26 10:59:44 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 10:59:44 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-c19ad40d-a6db-4946-81bf-ce95cadadd41 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eb42c30e-7d0f-43a8-9562-01c0f0471b89" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.241s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 10:59:44 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-c19ad40d-a6db-4946-81bf-ce95cadadd41 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Connected to 172.16.0.220:3260 {{(pid=73572) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 10:59:44 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-c19ad40d-a6db-4946-81bf-ce95cadadd41 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] HCTL ('33', '-', '-', 0) found on session 69 with lun 0 {{(pid=73572) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 10:59:44 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-c19ad40d-a6db-4946-81bf-ce95cadadd41 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73572) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 10:59:44 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:59:44 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:59:44 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2350f9b-7f50-41d2-aece-10ce2cf764b2]: (4, ('- - 0', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:59:44 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-c19ad40d-a6db-4946-81bf-ce95cadadd41 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Searching for a device in session 69 and hctl ['33', '*', '*', 0] yield: None {{(pid=73572) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 10:59:45 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 10:59:45 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:59:45 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73572) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 10:59:45 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73572) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 10:59:45 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73572) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 10:59:45 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:59:45 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-c19ad40d-a6db-4946-81bf-ce95cadadd41 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Searching for a device in session 69 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73572) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 10:59:45 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-c19ad40d-a6db-4946-81bf-ce95cadadd41 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dhFqKnZO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73572) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 10:59:45 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-c19ad40d-a6db-4946-81bf-ce95cadadd41 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.269s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 10:59:45 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-c19ad40d-a6db-4946-81bf-ce95cadadd41 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] <== connect_volume: return (1271ms) {'type': 'block', 'scsi_wwn': '23238646232323164', 'path': '/dev/sdb'} {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 10:59:45 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c19ad40d-a6db-4946-81bf-ce95cadadd41 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] [instance: dcfbde2c-659b-4095-ba9b-35df887ec976] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23238646232323164', 'path': '/dev/sdb'} {{(pid=73572) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 10:59:45 user nova-compute[73572]: DEBUG nova.objects.instance [None req-c19ad40d-a6db-4946-81bf-ce95cadadd41 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Lazy-loading 'flavor' on Instance uuid dcfbde2c-659b-4095-ba9b-35df887ec976 {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:59:45 user nova-compute[73572]: DEBUG nova.virt.libvirt.guest [None req-c19ad40d-a6db-4946-81bf-ce95cadadd41 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 10:59:45 user nova-compute[73572]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 10:59:45 user nova-compute[73572]:   <source dev="/dev/sdb"/>
Aug 26 10:59:45 user nova-compute[73572]:   <target dev="vdb" bus="virtio"/>
Aug 26 10:59:45 user nova-compute[73572]:   <serial>eb42c30e-7d0f-43a8-9562-01c0f0471b89</serial>
Aug 26 10:59:45 user nova-compute[73572]: </disk>
Aug 26 10:59:45 user nova-compute[73572]:  {{(pid=73572) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 10:59:45 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-c19ad40d-a6db-4946-81bf-ce95cadadd41 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] No BDM found with device name vda, not building metadata. {{(pid=73572) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 10:59:45 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-c19ad40d-a6db-4946-81bf-ce95cadadd41 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73572) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 10:59:45 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-c19ad40d-a6db-4946-81bf-ce95cadadd41 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] No VIF found with MAC fa:16:3e:a5:1f:21, not building metadata {{(pid=73572) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 10:59:46 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-c19ad40d-a6db-4946-81bf-ce95cadadd41 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Lock "dcfbde2c-659b-4095-ba9b-35df887ec976" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.043s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:59:46 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:59:48 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-d2cfe466-934b-4021-9296-1a757cf9653a tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Acquiring lock "dcfbde2c-659b-4095-ba9b-35df887ec976" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:59:48 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-d2cfe466-934b-4021-9296-1a757cf9653a tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Lock "dcfbde2c-659b-4095-ba9b-35df887ec976" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:59:48 user nova-compute[73572]: INFO nova.compute.manager [None req-d2cfe466-934b-4021-9296-1a757cf9653a tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] [instance: dcfbde2c-659b-4095-ba9b-35df887ec976] Detaching volume eb42c30e-7d0f-43a8-9562-01c0f0471b89
Aug 26 10:59:48 user nova-compute[73572]: INFO nova.virt.block_device [None req-d2cfe466-934b-4021-9296-1a757cf9653a tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] [instance: dcfbde2c-659b-4095-ba9b-35df887ec976] Attempting to driver detach volume eb42c30e-7d0f-43a8-9562-01c0f0471b89 from mountpoint /dev/vdb
Aug 26 10:59:48 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-d2cfe466-934b-4021-9296-1a757cf9653a tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Attempting to detach device vdb from instance dcfbde2c-659b-4095-ba9b-35df887ec976 from the persistent domain config. {{(pid=73572) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 10:59:48 user nova-compute[73572]: DEBUG nova.virt.libvirt.guest [None req-d2cfe466-934b-4021-9296-1a757cf9653a tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 10:59:48 user nova-compute[73572]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 10:59:48 user nova-compute[73572]:   <source dev="/dev/sdb"/>
Aug 26 10:59:48 user nova-compute[73572]:   <target dev="vdb" bus="virtio"/>
Aug 26 10:59:48 user nova-compute[73572]:   <serial>eb42c30e-7d0f-43a8-9562-01c0f0471b89</serial>
Aug 26 10:59:48 user nova-compute[73572]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 10:59:48 user nova-compute[73572]: </disk>
Aug 26 10:59:48 user nova-compute[73572]:  {{(pid=73572) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 10:59:48 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-d2cfe466-934b-4021-9296-1a757cf9653a tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Successfully detached device vdb from instance dcfbde2c-659b-4095-ba9b-35df887ec976 from the persistent domain config.
Aug 26 10:59:48 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-d2cfe466-934b-4021-9296-1a757cf9653a tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance dcfbde2c-659b-4095-ba9b-35df887ec976 from the live domain config. {{(pid=73572) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 10:59:48 user nova-compute[73572]: DEBUG nova.virt.libvirt.guest [None req-d2cfe466-934b-4021-9296-1a757cf9653a tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 10:59:48 user nova-compute[73572]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 10:59:48 user nova-compute[73572]:   <source dev="/dev/sdb"/>
Aug 26 10:59:48 user nova-compute[73572]:   <target dev="vdb" bus="virtio"/>
Aug 26 10:59:48 user nova-compute[73572]:   <serial>eb42c30e-7d0f-43a8-9562-01c0f0471b89</serial>
Aug 26 10:59:48 user nova-compute[73572]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 10:59:48 user nova-compute[73572]: </disk>
Aug 26 10:59:48 user nova-compute[73572]:  {{(pid=73572) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 10:59:49 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Received event <DeviceRemovedEvent: 1693047589.3983536, dcfbde2c-659b-4095-ba9b-35df887ec976 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73572) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 10:59:49 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-d2cfe466-934b-4021-9296-1a757cf9653a tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance dcfbde2c-659b-4095-ba9b-35df887ec976 {{(pid=73572) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 10:59:49 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-d2cfe466-934b-4021-9296-1a757cf9653a tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Successfully detached device vdb from instance dcfbde2c-659b-4095-ba9b-35df887ec976 from the live domain config.
Aug 26 10:59:49 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d2cfe466-934b-4021-9296-1a757cf9653a tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] [instance: dcfbde2c-659b-4095-ba9b-35df887ec976] calling os-brick to detach iSCSI Volume {{(pid=73572) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 10:59:49 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2cfe466-934b-4021-9296-1a757cf9653a tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc89c3d6a10>, {'target_iqns': ['iqn.2010-10.org.openstack:eb42c30e-7d0f-43a8-9562-01c0f0471b89'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dhFqKnZO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 10:59:49 user nova-compute[73572]: WARNING os_brick.initiator.connectors.base [None req-d2cfe466-934b-4021-9296-1a757cf9653a tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 10:59:49 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-d2cfe466-934b-4021-9296-1a757cf9653a tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 10:59:49 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-d2cfe466-934b-4021-9296-1a757cf9653a tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 10:59:49 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2cfe466-934b-4021-9296-1a757cf9653a tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eb42c30e-7d0f-43a8-9562-01c0f0471b89', 0)] {{(pid=73572) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 10:59:49 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:59:49 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:59:49 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9348732-75f6-464b-91f0-a35172b95bc1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eb42c30e-7d0f-43a8-9562-01c0f0471b89\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:59:49 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:59:49 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:59:49 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[642c6f5b-9f03-4268-b2d1-cb7fb75a46de]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb42c30e-7d0f-43a8-9562-01c0f0471b89 (non-flash)\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:59:49 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2cfe466-934b-4021-9296-1a757cf9653a tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb42c30e-7d0f-43a8-9562-01c0f0471b89 (non-flash)
Aug 26 10:59:49 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 10:59:49 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2cfe466-934b-4021-9296-1a757cf9653a tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb42c30e-7d0f-43a8-9562-01c0f0471b89 (non-flash)
Aug 26 10:59:49 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 10:59:49 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2cfe466-934b-4021-9296-1a757cf9653a tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc878bafb50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eb42c30e-7d0f-43a8-9562-01c0f0471b89'): ({'sdb'}, set())}) {{(pid=73572) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 10:59:49 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-d2cfe466-934b-4021-9296-1a757cf9653a tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Removing single pathed devices sdb {{(pid=73572) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 10:59:49 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:59:49 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:59:49 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd251542-7e1a-48e4-9bfc-2d5ab92551d7]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:59:49 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:59:49 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:59:49 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[14c2ff29-41e2-4b6a-9552-788c5a01c403]: (4, ('ok\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:59:49 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-d2cfe466-934b-4021-9296-1a757cf9653a tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Flushing IO for device /dev/sdb {{(pid=73572) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 10:59:49 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:59:49 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:59:49 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e21fd44-a693-467d-b992-20d4d7883ab7]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:59:49 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-d2cfe466-934b-4021-9296-1a757cf9653a tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73572) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 10:59:49 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:59:49 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.050s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:59:49 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[f88375dd-598d-4296-abc0-d3addd0a2107]: (4, ('1', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:59:49 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-d2cfe466-934b-4021-9296-1a757cf9653a tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73572) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 10:59:49 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-d2cfe466-934b-4021-9296-1a757cf9653a tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] SCSI volumes sdb have been removed. {{(pid=73572) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 10:59:49 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2cfe466-934b-4021-9296-1a757cf9653a tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eb42c30e-7d0f-43a8-9562-01c0f0471b89')] {{(pid=73572) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 10:59:49 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb42c30e-7d0f-43a8-9562-01c0f0471b89 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:59:49 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb42c30e-7d0f-43a8-9562-01c0f0471b89 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:59:49 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bf68f28-0e32-438a-b05d-251174f7f25f]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:59:49 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2cfe466-934b-4021-9296-1a757cf9653a tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:59:49 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb42c30e-7d0f-43a8-9562-01c0f0471b89 -p 172.16.0.220:3260 --logout {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:59:49 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb42c30e-7d0f-43a8-9562-01c0f0471b89 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:59:49 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[56a6213d-e3d2-415c-a5e6-5056e4465238]: (4, ('Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:eb42c30e-7d0f-43a8-9562-01c0f0471b89, portal: 172.16.0.220,3260]\nLogout of [sid: 69, target: iqn.2010-10.org.openstack:eb42c30e-7d0f-43a8-9562-01c0f0471b89, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:59:49 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2cfe466-934b-4021-9296-1a757cf9653a tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:eb42c30e-7d0f-43a8-9562-01c0f0471b89, portal: 172.16.0.220,3260]
Aug 26 10:59:49 user nova-compute[73572]: Logout of [sid: 69, target: iqn.2010-10.org.openstack:eb42c30e-7d0f-43a8-9562-01c0f0471b89, portal: 172.16.0.220,3260] successful.
Aug 26 10:59:49 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:59:49 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb42c30e-7d0f-43a8-9562-01c0f0471b89 -p 172.16.0.220:3260 --op delete {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:59:49 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb42c30e-7d0f-43a8-9562-01c0f0471b89 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:59:49 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[315eea93-2b5d-4a2b-af59-81887b73cbc2]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 10:59:49 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2cfe466-934b-4021-9296-1a757cf9653a tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 10:59:49 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-d2cfe466-934b-4021-9296-1a757cf9653a tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.261s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 10:59:49 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2cfe466-934b-4021-9296-1a757cf9653a tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] <== disconnect_volume: return (262ms) None {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 10:59:49 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d2cfe466-934b-4021-9296-1a757cf9653a tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] [instance: dcfbde2c-659b-4095-ba9b-35df887ec976] Disconnected iSCSI Volume {{(pid=73572) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 10:59:50 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:59:50 user nova-compute[73572]: DEBUG nova.objects.instance [None req-d2cfe466-934b-4021-9296-1a757cf9653a tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Lazy-loading 'flavor' on Instance uuid dcfbde2c-659b-4095-ba9b-35df887ec976 {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:59:50 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-d2cfe466-934b-4021-9296-1a757cf9653a tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Lock "dcfbde2c-659b-4095-ba9b-35df887ec976" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.621s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:59:51 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:59:51 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:59:51 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Starting heal instance info cache {{(pid=73572) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 10:59:51 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Rebuilding the list of instances to heal {{(pid=73572) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 10:59:51 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquiring lock "refresh_cache-dcfbde2c-659b-4095-ba9b-35df887ec976" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 10:59:51 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquired lock "refresh_cache-dcfbde2c-659b-4095-ba9b-35df887ec976" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 10:59:51 user nova-compute[73572]: DEBUG nova.network.neutron [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] [instance: dcfbde2c-659b-4095-ba9b-35df887ec976] Forcefully refreshing network info cache for instance {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 10:59:51 user nova-compute[73572]: DEBUG nova.objects.instance [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lazy-loading 'info_cache' on Instance uuid dcfbde2c-659b-4095-ba9b-35df887ec976 {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 10:59:52 user nova-compute[73572]: DEBUG nova.network.neutron [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] [instance: dcfbde2c-659b-4095-ba9b-35df887ec976] Updating instance_info_cache with network_info: [{"id": "90c1e997-ee83-43a9-97ae-2e3033f819e2", "address": "fa:16:3e:a5:1f:21", "network": {"id": "052a8e12-a71a-4c35-8001-bd3093ecdc4f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1777132020-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "131418241f3f4a21a1e8a08a962a31c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90c1e997-ee", "ovs_interfaceid": "90c1e997-ee83-43a9-97ae-2e3033f819e2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 10:59:52 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Releasing lock "refresh_cache-dcfbde2c-659b-4095-ba9b-35df887ec976" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 10:59:52 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] [instance: dcfbde2c-659b-4095-ba9b-35df887ec976] Updated the network info_cache for instance {{(pid=73572) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 10:59:55 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 10:59:55 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:59:57 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:59:58 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 10:59:58 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:59:58 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:59:58 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 10:59:58 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Auditing locally available compute resources for user (node: user) {{(pid=73572) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 10:59:58 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcfbde2c-659b-4095-ba9b-35df887ec976/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:59:59 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcfbde2c-659b-4095-ba9b-35df887ec976/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:59:59 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcfbde2c-659b-4095-ba9b-35df887ec976/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 10:59:59 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcfbde2c-659b-4095-ba9b-35df887ec976/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 10:59:59 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:59:59 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 10:59:59 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Hypervisor/Node resource view: name=user free_ram=8755MB free_disk=25.089637756347656GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=73572) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 10:59:59 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 10:59:59 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 10:59:59 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance dcfbde2c-659b-4095-ba9b-35df887ec976 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 10:59:59 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73572) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 10:59:59 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73572) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 10:59:59 user nova-compute[73572]: DEBUG nova.compute.provider_tree [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Inventory has not changed in ProviderTree for provider: e2cec974-59b2-4c77-a53d-a7f4e5a30d75 {{(pid=73572) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 10:59:59 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Inventory has not changed for provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73572) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 10:59:59 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Compute_service record updated for user:user {{(pid=73572) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 10:59:59 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.151s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:00:00 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 11:00:01 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:00:01 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:00:01 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:00:05 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:00:06 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:00:06 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:00:06 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73572) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 11:00:10 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:00:15 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:00:20 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:00:25 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:00:30 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:00:35 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 11:00:40 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:00:43 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-a39f818f-f25f-4b0d-8a6f-21a7da4a58a8 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Acquiring lock "dcfbde2c-659b-4095-ba9b-35df887ec976" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:00:43 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-a39f818f-f25f-4b0d-8a6f-21a7da4a58a8 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Lock "dcfbde2c-659b-4095-ba9b-35df887ec976" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:00:43 user nova-compute[73572]: DEBUG nova.objects.instance [None req-a39f818f-f25f-4b0d-8a6f-21a7da4a58a8 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Lazy-loading 'flavor' on Instance uuid dcfbde2c-659b-4095-ba9b-35df887ec976 {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:00:43 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-a39f818f-f25f-4b0d-8a6f-21a7da4a58a8 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Lock "dcfbde2c-659b-4095-ba9b-35df887ec976" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:00:43 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-a39f818f-f25f-4b0d-8a6f-21a7da4a58a8 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Acquiring lock "dcfbde2c-659b-4095-ba9b-35df887ec976" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:00:43 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-a39f818f-f25f-4b0d-8a6f-21a7da4a58a8 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Lock "dcfbde2c-659b-4095-ba9b-35df887ec976" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:00:43 user nova-compute[73572]: INFO nova.compute.manager [None req-a39f818f-f25f-4b0d-8a6f-21a7da4a58a8 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] [instance: dcfbde2c-659b-4095-ba9b-35df887ec976] Attaching volume 5abde979-48d5-45a8-9ad5-8efbfe3460c4 to /dev/vdb
Aug 26 11:00:43 user nova-compute[73572]: DEBUG os_brick.utils [None req-a39f818f-f25f-4b0d-8a6f-21a7da4a58a8 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 11:00:43 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:00:43 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:00:43 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[a54e086d-0b43-40f3-9496-cdd5462e1bbc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:de8a79ed912\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:00:43 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:00:43 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:00:43 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ffa3193-9fd6-40a7-8e2e-9e8f16bbdb28]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:00:43 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:00:43 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:00:43 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[950518e5-4088-4794-a084-eaada9c8b8ff]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:00:43 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[891cfe8c-0b6d-4bf2-94f8-5e72ace09cb7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:00:43 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-a39f818f-f25f-4b0d-8a6f-21a7da4a58a8 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Running cmd (subprocess): nvme version {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:00:43 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-a39f818f-f25f-4b0d-8a6f-21a7da4a58a8 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] 'nvme version' failed. Not Retrying. {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 11:00:43 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a39f818f-f25f-4b0d-8a6f-21a7da4a58a8 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] nvme not present on system {{(pid=73572) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 11:00:43 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:00:43 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 11:00:43 user nova-compute[73572]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 11:00:43 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[1814cb40-2e72-4e66-9d69-4903a83ea03d]: (4, '') {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:00:43 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.lightos [None req-a39f818f-f25f-4b0d-8a6f-21a7da4a58a8 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73572) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 11:00:43 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.lightos [None req-a39f818f-f25f-4b0d-8a6f-21a7da4a58a8 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73572) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 11:00:43 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.lightos [None req-a39f818f-f25f-4b0d-8a6f-21a7da4a58a8 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] LIGHTOS: no hostnqn found. {{(pid=73572) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 11:00:43 user nova-compute[73572]: DEBUG os_brick.utils [None req-a39f818f-f25f-4b0d-8a6f-21a7da4a58a8 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:de8a79ed912', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 11:00:43 user nova-compute[73572]: DEBUG nova.virt.block_device [None req-a39f818f-f25f-4b0d-8a6f-21a7da4a58a8 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] [instance: dcfbde2c-659b-4095-ba9b-35df887ec976] Updating existing volume attachment record: eb53782e-c68c-4643-ad69-fbc7a4f6e07a {{(pid=73572) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 11:00:45 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:00:46 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:00:48 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:00:50 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:00:51 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:00:53 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a39f818f-f25f-4b0d-8a6f-21a7da4a58a8 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] [instance: dcfbde2c-659b-4095-ba9b-35df887ec976] Calling os-brick to attach iSCSI Volume {{(pid=73572) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 11:00:53 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-a39f818f-f25f-4b0d-8a6f-21a7da4a58a8 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc89c3d6a10>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:5abde979-48d5-45a8-9ad5-8efbfe3460c4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wYAhyWMv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 11:00:53 user nova-compute[73572]: WARNING os_brick.initiator.connectors.base [None req-a39f818f-f25f-4b0d-8a6f-21a7da4a58a8 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 11:00:53 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-a39f818f-f25f-4b0d-8a6f-21a7da4a58a8 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 11:00:53 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-a39f818f-f25f-4b0d-8a6f-21a7da4a58a8 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 11:00:53 user nova-compute[73572]: WARNING os_brick.initiator.connectors.base [None req-a39f818f-f25f-4b0d-8a6f-21a7da4a58a8 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 11:00:53 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-a39f818f-f25f-4b0d-8a6f-21a7da4a58a8 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5abde979-48d5-45a8-9ad5-8efbfe3460c4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 11:00:53 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-a39f818f-f25f-4b0d-8a6f-21a7da4a58a8 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5abde979-48d5-45a8-9ad5-8efbfe3460c4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 11:00:53 user nova-compute[73572]: INFO os_brick.initiator.connectors.iscsi [None req-a39f818f-f25f-4b0d-8a6f-21a7da4a58a8 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 11:00:53 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5abde979-48d5-45a8-9ad5-8efbfe3460c4 -p 172.16.0.220:3260 {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:00:53 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5abde979-48d5-45a8-9ad5-8efbfe3460c4 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:00:53 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[007c656d-9f33-48e0-9e23-95f03dd29fab]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:00:53 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-a39f818f-f25f-4b0d-8a6f-21a7da4a58a8 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 11:00:53 user nova-compute[73572]:  {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:00:53 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5abde979-48d5-45a8-9ad5-8efbfe3460c4 -p 172.16.0.220:3260 --interface default --op new {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:00:53 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5abde979-48d5-45a8-9ad5-8efbfe3460c4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:00:53 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[952db9eb-f166-44bb-a4dd-5355af706d53]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5abde979-48d5-45a8-9ad5-8efbfe3460c4] added\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:00:53 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-a39f818f-f25f-4b0d-8a6f-21a7da4a58a8 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5abde979-48d5-45a8-9ad5-8efbfe3460c4] added
Aug 26 11:00:53 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:00:53 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5abde979-48d5-45a8-9ad5-8efbfe3460c4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:00:53 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5abde979-48d5-45a8-9ad5-8efbfe3460c4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:00:53 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ad7c17a-864e-4070-9ef6-d8a4e13cf8eb]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:00:53 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-a39f818f-f25f-4b0d-8a6f-21a7da4a58a8 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:00:53 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5abde979-48d5-45a8-9ad5-8efbfe3460c4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:00:53 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5abde979-48d5-45a8-9ad5-8efbfe3460c4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:00:53 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[489c7bda-ae3f-4047-8481-713c6e51a984]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:00:53 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-a39f818f-f25f-4b0d-8a6f-21a7da4a58a8 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:00:53 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5abde979-48d5-45a8-9ad5-8efbfe3460c4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wYAhyWMv {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:00:53 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5abde979-48d5-45a8-9ad5-8efbfe3460c4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wYAhyWMv" returned: 0 in 0.017s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:00:53 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[01d6a496-47a9-4938-bc85-8210433770a9]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:00:53 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-a39f818f-f25f-4b0d-8a6f-21a7da4a58a8 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wYAhyWMv'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:00:53 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5abde979-48d5-45a8-9ad5-8efbfe3460c4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:00:53 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5abde979-48d5-45a8-9ad5-8efbfe3460c4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:00:53 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[7deeb99b-e730-4ed9-bead-079490cad001]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:00:53 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-a39f818f-f25f-4b0d-8a6f-21a7da4a58a8 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:00:53 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:00:53 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:00:53 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[b296f63c-9244-4b1f-9efd-f8e8eb6dbf84]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:00:53 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-a39f818f-f25f-4b0d-8a6f-21a7da4a58a8 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 26 11:00:53 user nova-compute[73572]:  {{(pid=73572) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 11:00:53 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-a39f818f-f25f-4b0d-8a6f-21a7da4a58a8 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 26 11:00:53 user nova-compute[73572]:  {{(pid=73572) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 11:00:53 user nova-compute[73572]: WARNING os_brick.initiator.connectors.iscsi [None req-a39f818f-f25f-4b0d-8a6f-21a7da4a58a8 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 26 11:00:53 user nova-compute[73572]: 
Aug 26 11:00:53 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5abde979-48d5-45a8-9ad5-8efbfe3460c4 -p 172.16.0.220:3260 --login {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:00:53 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5abde979-48d5-45a8-9ad5-8efbfe3460c4 -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:00:53 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b2802e5-43da-434a-836e-bae3843d75e0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5abde979-48d5-45a8-9ad5-8efbfe3460c4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5abde979-48d5-45a8-9ad5-8efbfe3460c4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:00:53 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-a39f818f-f25f-4b0d-8a6f-21a7da4a58a8 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5abde979-48d5-45a8-9ad5-8efbfe3460c4, portal: 172.16.0.220,3260]
Aug 26 11:00:53 user nova-compute[73572]: Login to [iface: default, target: iqn.2010-10.org.openstack:5abde979-48d5-45a8-9ad5-8efbfe3460c4, portal: 172.16.0.220,3260] successful.
Aug 26 11:00:53 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:00:53 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5abde979-48d5-45a8-9ad5-8efbfe3460c4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:00:53 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5abde979-48d5-45a8-9ad5-8efbfe3460c4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:00:53 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[01bccdfa-c997-4b7b-8533-ea79a8aad04e]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:00:53 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-a39f818f-f25f-4b0d-8a6f-21a7da4a58a8 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:00:53 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:00:53 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:00:53 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0359dc3-a868-475d-89e9-9376412b9c19]: (4, ('tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5abde979-48d5-45a8-9ad5-8efbfe3460c4 (non-flash)\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:00:53 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-a39f818f-f25f-4b0d-8a6f-21a7da4a58a8 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5abde979-48d5-45a8-9ad5-8efbfe3460c4 (non-flash)
Aug 26 11:00:53 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 11:00:53 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-a39f818f-f25f-4b0d-8a6f-21a7da4a58a8 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] iscsi session list stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5abde979-48d5-45a8-9ad5-8efbfe3460c4 (non-flash)
Aug 26 11:00:53 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 11:00:53 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-a39f818f-f25f-4b0d-8a6f-21a7da4a58a8 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5abde979-48d5-45a8-9ad5-8efbfe3460c4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.242s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 11:00:53 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-a39f818f-f25f-4b0d-8a6f-21a7da4a58a8 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Connected to 172.16.0.220:3260 {{(pid=73572) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 11:00:53 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-a39f818f-f25f-4b0d-8a6f-21a7da4a58a8 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] HCTL ('33', '-', '-', 0) found on session 70 with lun 0 {{(pid=73572) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 11:00:53 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-a39f818f-f25f-4b0d-8a6f-21a7da4a58a8 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73572) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 11:00:53 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:00:53 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:00:53 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee656546-d94f-42e4-ae51-1f32799356aa]: (4, ('- - 0', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:00:53 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-a39f818f-f25f-4b0d-8a6f-21a7da4a58a8 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Searching for a device in session 70 and hctl ['33', '*', '*', 0] yield: None {{(pid=73572) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 11:00:53 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:00:53 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Starting heal instance info cache {{(pid=73572) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 11:00:53 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Rebuilding the list of instances to heal {{(pid=73572) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 11:00:53 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquiring lock "refresh_cache-dcfbde2c-659b-4095-ba9b-35df887ec976" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 11:00:53 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquired lock "refresh_cache-dcfbde2c-659b-4095-ba9b-35df887ec976" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 11:00:53 user nova-compute[73572]: DEBUG nova.network.neutron [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] [instance: dcfbde2c-659b-4095-ba9b-35df887ec976] Forcefully refreshing network info cache for instance {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 11:00:53 user nova-compute[73572]: DEBUG nova.objects.instance [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lazy-loading 'info_cache' on Instance uuid dcfbde2c-659b-4095-ba9b-35df887ec976 {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:00:54 user nova-compute[73572]: DEBUG nova.network.neutron [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] [instance: dcfbde2c-659b-4095-ba9b-35df887ec976] Updating instance_info_cache with network_info: [{"id": "90c1e997-ee83-43a9-97ae-2e3033f819e2", "address": "fa:16:3e:a5:1f:21", "network": {"id": "052a8e12-a71a-4c35-8001-bd3093ecdc4f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1777132020-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "131418241f3f4a21a1e8a08a962a31c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90c1e997-ee", "ovs_interfaceid": "90c1e997-ee83-43a9-97ae-2e3033f819e2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:00:54 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Releasing lock "refresh_cache-dcfbde2c-659b-4095-ba9b-35df887ec976" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 11:00:54 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] [instance: dcfbde2c-659b-4095-ba9b-35df887ec976] Updated the network info_cache for instance {{(pid=73572) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 11:00:54 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-a39f818f-f25f-4b0d-8a6f-21a7da4a58a8 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Searching for a device in session 70 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73572) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 11:00:54 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-a39f818f-f25f-4b0d-8a6f-21a7da4a58a8 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wYAhyWMv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73572) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 11:00:54 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-a39f818f-f25f-4b0d-8a6f-21a7da4a58a8 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.269s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 11:00:54 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-a39f818f-f25f-4b0d-8a6f-21a7da4a58a8 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] <== connect_volume: return (1272ms) {'type': 'block', 'scsi_wwn': '26438316466373739', 'path': '/dev/sdb'} {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 11:00:54 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a39f818f-f25f-4b0d-8a6f-21a7da4a58a8 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] [instance: dcfbde2c-659b-4095-ba9b-35df887ec976] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26438316466373739', 'path': '/dev/sdb'} {{(pid=73572) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 11:00:54 user nova-compute[73572]: DEBUG nova.objects.instance [None req-a39f818f-f25f-4b0d-8a6f-21a7da4a58a8 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Lazy-loading 'flavor' on Instance uuid dcfbde2c-659b-4095-ba9b-35df887ec976 {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:00:54 user nova-compute[73572]: DEBUG nova.virt.libvirt.guest [None req-a39f818f-f25f-4b0d-8a6f-21a7da4a58a8 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 11:00:54 user nova-compute[73572]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 11:00:54 user nova-compute[73572]:   <source dev="/dev/sdb"/>
Aug 26 11:00:54 user nova-compute[73572]:   <target dev="vdb" bus="virtio"/>
Aug 26 11:00:54 user nova-compute[73572]:   <serial>5abde979-48d5-45a8-9ad5-8efbfe3460c4</serial>
Aug 26 11:00:54 user nova-compute[73572]: </disk>
Aug 26 11:00:54 user nova-compute[73572]:  {{(pid=73572) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 11:00:55 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:00:55 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-a39f818f-f25f-4b0d-8a6f-21a7da4a58a8 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] No BDM found with device name vda, not building metadata. {{(pid=73572) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 11:00:55 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-a39f818f-f25f-4b0d-8a6f-21a7da4a58a8 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73572) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 11:00:55 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-a39f818f-f25f-4b0d-8a6f-21a7da4a58a8 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] No VIF found with MAC fa:16:3e:a5:1f:21, not building metadata {{(pid=73572) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 11:00:55 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-a39f818f-f25f-4b0d-8a6f-21a7da4a58a8 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Lock "dcfbde2c-659b-4095-ba9b-35df887ec976" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.977s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:00:55 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:00:56 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:00:57 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-58f8130b-2fcc-4902-8ce9-25a069ad7eee tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Acquiring lock "dcfbde2c-659b-4095-ba9b-35df887ec976" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:00:57 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-58f8130b-2fcc-4902-8ce9-25a069ad7eee tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Lock "dcfbde2c-659b-4095-ba9b-35df887ec976" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:00:57 user nova-compute[73572]: INFO nova.compute.manager [None req-58f8130b-2fcc-4902-8ce9-25a069ad7eee tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] [instance: dcfbde2c-659b-4095-ba9b-35df887ec976] Detaching volume 5abde979-48d5-45a8-9ad5-8efbfe3460c4
Aug 26 11:00:57 user nova-compute[73572]: INFO nova.virt.block_device [None req-58f8130b-2fcc-4902-8ce9-25a069ad7eee tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] [instance: dcfbde2c-659b-4095-ba9b-35df887ec976] Attempting to driver detach volume 5abde979-48d5-45a8-9ad5-8efbfe3460c4 from mountpoint /dev/vdb
Aug 26 11:00:57 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-58f8130b-2fcc-4902-8ce9-25a069ad7eee tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Attempting to detach device vdb from instance dcfbde2c-659b-4095-ba9b-35df887ec976 from the persistent domain config. {{(pid=73572) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 11:00:57 user nova-compute[73572]: DEBUG nova.virt.libvirt.guest [None req-58f8130b-2fcc-4902-8ce9-25a069ad7eee tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 11:00:57 user nova-compute[73572]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 11:00:57 user nova-compute[73572]:   <source dev="/dev/sdb"/>
Aug 26 11:00:57 user nova-compute[73572]:   <target dev="vdb" bus="virtio"/>
Aug 26 11:00:57 user nova-compute[73572]:   <serial>5abde979-48d5-45a8-9ad5-8efbfe3460c4</serial>
Aug 26 11:00:57 user nova-compute[73572]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 11:00:57 user nova-compute[73572]: </disk>
Aug 26 11:00:57 user nova-compute[73572]:  {{(pid=73572) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 11:00:57 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-58f8130b-2fcc-4902-8ce9-25a069ad7eee tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Successfully detached device vdb from instance dcfbde2c-659b-4095-ba9b-35df887ec976 from the persistent domain config.
Aug 26 11:00:57 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-58f8130b-2fcc-4902-8ce9-25a069ad7eee tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance dcfbde2c-659b-4095-ba9b-35df887ec976 from the live domain config. {{(pid=73572) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 11:00:57 user nova-compute[73572]: DEBUG nova.virt.libvirt.guest [None req-58f8130b-2fcc-4902-8ce9-25a069ad7eee tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 11:00:57 user nova-compute[73572]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 11:00:57 user nova-compute[73572]:   <source dev="/dev/sdb"/>
Aug 26 11:00:57 user nova-compute[73572]:   <target dev="vdb" bus="virtio"/>
Aug 26 11:00:57 user nova-compute[73572]:   <serial>5abde979-48d5-45a8-9ad5-8efbfe3460c4</serial>
Aug 26 11:00:57 user nova-compute[73572]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 11:00:57 user nova-compute[73572]: </disk>
Aug 26 11:00:57 user nova-compute[73572]:  {{(pid=73572) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 11:00:58 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-9a4666d7-046c-4a9f-8a3e-db417b0301d1 None None] Received event <DeviceRemovedEvent: 1693047658.3865173, dcfbde2c-659b-4095-ba9b-35df887ec976 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73572) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 11:00:58 user nova-compute[73572]: DEBUG nova.virt.libvirt.driver [None req-58f8130b-2fcc-4902-8ce9-25a069ad7eee tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance dcfbde2c-659b-4095-ba9b-35df887ec976 {{(pid=73572) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 11:00:58 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-58f8130b-2fcc-4902-8ce9-25a069ad7eee tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Successfully detached device vdb from instance dcfbde2c-659b-4095-ba9b-35df887ec976 from the live domain config.
Aug 26 11:00:58 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-58f8130b-2fcc-4902-8ce9-25a069ad7eee tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] [instance: dcfbde2c-659b-4095-ba9b-35df887ec976] calling os-brick to detach iSCSI Volume {{(pid=73572) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 11:00:58 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-58f8130b-2fcc-4902-8ce9-25a069ad7eee tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc89c3d6a10>, {'target_iqns': ['iqn.2010-10.org.openstack:5abde979-48d5-45a8-9ad5-8efbfe3460c4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wYAhyWMv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 11:00:58 user nova-compute[73572]: WARNING os_brick.initiator.connectors.base [None req-58f8130b-2fcc-4902-8ce9-25a069ad7eee tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 11:00:58 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-58f8130b-2fcc-4902-8ce9-25a069ad7eee tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 11:00:58 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-58f8130b-2fcc-4902-8ce9-25a069ad7eee tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 11:00:58 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-58f8130b-2fcc-4902-8ce9-25a069ad7eee tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5abde979-48d5-45a8-9ad5-8efbfe3460c4', 0)] {{(pid=73572) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 11:00:58 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:00:58 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:00:58 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[14db24b9-a70c-4bfe-a8d2-50f98f4b6a99]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5abde979-48d5-45a8-9ad5-8efbfe3460c4\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:00:58 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:00:58 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:00:58 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[65bf4c62-bdac-4dd0-a40d-475cb3cab19e]: (4, ('tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5abde979-48d5-45a8-9ad5-8efbfe3460c4 (non-flash)\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:00:58 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-58f8130b-2fcc-4902-8ce9-25a069ad7eee tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5abde979-48d5-45a8-9ad5-8efbfe3460c4 (non-flash)
Aug 26 11:00:58 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 11:00:58 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-58f8130b-2fcc-4902-8ce9-25a069ad7eee tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] iscsi session list stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5abde979-48d5-45a8-9ad5-8efbfe3460c4 (non-flash)
Aug 26 11:00:58 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 11:00:58 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-58f8130b-2fcc-4902-8ce9-25a069ad7eee tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc89c201000>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5abde979-48d5-45a8-9ad5-8efbfe3460c4'): ({'sdb'}, set())}) {{(pid=73572) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 11:00:58 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-58f8130b-2fcc-4902-8ce9-25a069ad7eee tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Removing single pathed devices sdb {{(pid=73572) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 11:00:58 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:00:58 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:00:58 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[5046971c-e3b0-4290-b413-18e24b076cac]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:00:58 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:00:58 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:00:58 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3f5f2b1-bc92-4aaf-8e6d-c3666c5e2eff]: (4, ('ok\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:00:58 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-58f8130b-2fcc-4902-8ce9-25a069ad7eee tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Flushing IO for device /dev/sdb {{(pid=73572) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 11:00:58 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:00:58 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:00:58 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[befe6ba8-b014-404f-b514-75a898eb4cb6]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:00:58 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-58f8130b-2fcc-4902-8ce9-25a069ad7eee tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73572) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 11:00:58 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:00:58 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.038s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:00:58 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6bd2dec-9c40-4a54-8db3-92c3e221602c]: (4, ('1', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:00:58 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-58f8130b-2fcc-4902-8ce9-25a069ad7eee tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73572) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 11:00:58 user nova-compute[73572]: DEBUG os_brick.initiator.linuxscsi [None req-58f8130b-2fcc-4902-8ce9-25a069ad7eee tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] SCSI volumes sdb have been removed. {{(pid=73572) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 11:00:58 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-58f8130b-2fcc-4902-8ce9-25a069ad7eee tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5abde979-48d5-45a8-9ad5-8efbfe3460c4')] {{(pid=73572) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 11:00:58 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5abde979-48d5-45a8-9ad5-8efbfe3460c4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:00:58 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5abde979-48d5-45a8-9ad5-8efbfe3460c4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:00:58 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[27f0ba30-4a63-4cba-8da6-21978d5fd56f]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:00:58 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-58f8130b-2fcc-4902-8ce9-25a069ad7eee tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:00:58 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5abde979-48d5-45a8-9ad5-8efbfe3460c4 -p 172.16.0.220:3260 --logout {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:00:58 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5abde979-48d5-45a8-9ad5-8efbfe3460c4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:00:58 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[01cf5341-dbcf-4726-a6d5-eb5f0067991f]: (4, ('Logging out of session [sid: 70, target: iqn.2010-10.org.openstack:5abde979-48d5-45a8-9ad5-8efbfe3460c4, portal: 172.16.0.220,3260]\nLogout of [sid: 70, target: iqn.2010-10.org.openstack:5abde979-48d5-45a8-9ad5-8efbfe3460c4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:00:58 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-58f8130b-2fcc-4902-8ce9-25a069ad7eee tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 70, target: iqn.2010-10.org.openstack:5abde979-48d5-45a8-9ad5-8efbfe3460c4, portal: 172.16.0.220,3260]
Aug 26 11:00:58 user nova-compute[73572]: Logout of [sid: 70, target: iqn.2010-10.org.openstack:5abde979-48d5-45a8-9ad5-8efbfe3460c4, portal: 172.16.0.220,3260] successful.
Aug 26 11:00:58 user nova-compute[73572]:  stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:00:58 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5abde979-48d5-45a8-9ad5-8efbfe3460c4 -p 172.16.0.220:3260 --op delete {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:00:58 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5abde979-48d5-45a8-9ad5-8efbfe3460c4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=84543) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:00:58 user nova-compute[73572]: DEBUG oslo.privsep.daemon [-] privsep: reply[f931c08f-0547-4b8f-8b7a-f9b922947ae0]: (4, ('', '')) {{(pid=84543) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:00:58 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-58f8130b-2fcc-4902-8ce9-25a069ad7eee tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73572) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:00:58 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.base [None req-58f8130b-2fcc-4902-8ce9-25a069ad7eee tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.251s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 11:00:58 user nova-compute[73572]: DEBUG os_brick.initiator.connectors.iscsi [None req-58f8130b-2fcc-4902-8ce9-25a069ad7eee tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] <== disconnect_volume: return (251ms) None {{(pid=73572) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 11:00:58 user nova-compute[73572]: DEBUG nova.virt.libvirt.volume.iscsi [None req-58f8130b-2fcc-4902-8ce9-25a069ad7eee tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] [instance: dcfbde2c-659b-4095-ba9b-35df887ec976] Disconnected iSCSI Volume {{(pid=73572) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 11:00:59 user nova-compute[73572]: DEBUG nova.objects.instance [None req-58f8130b-2fcc-4902-8ce9-25a069ad7eee tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Lazy-loading 'flavor' on Instance uuid dcfbde2c-659b-4095-ba9b-35df887ec976 {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:00:59 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-58f8130b-2fcc-4902-8ce9-25a069ad7eee tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Lock "dcfbde2c-659b-4095-ba9b-35df887ec976" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.641s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:01:00 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:01:00 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:01:00 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:01:00 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:01:00 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:01:00 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Auditing locally available compute resources for user (node: user) {{(pid=73572) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 11:01:00 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcfbde2c-659b-4095-ba9b-35df887ec976/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:01:01 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcfbde2c-659b-4095-ba9b-35df887ec976/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:01:01 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcfbde2c-659b-4095-ba9b-35df887ec976/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:01:01 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:01:01 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcfbde2c-659b-4095-ba9b-35df887ec976/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:01:01 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 11:01:01 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 11:01:01 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Hypervisor/Node resource view: name=user free_ram=8741MB free_disk=25.088695526123047GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=73572) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 11:01:01 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:01:01 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:01:01 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance dcfbde2c-659b-4095-ba9b-35df887ec976 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 11:01:01 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73572) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 11:01:01 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73572) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 11:01:01 user nova-compute[73572]: DEBUG nova.compute.provider_tree [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Inventory has not changed in ProviderTree for provider: e2cec974-59b2-4c77-a53d-a7f4e5a30d75 {{(pid=73572) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 11:01:01 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Inventory has not changed for provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73572) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 11:01:01 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Compute_service record updated for user:user {{(pid=73572) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 11:01:01 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.186s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:01:03 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:01:03 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:01:03 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:01:05 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:01:07 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:01:07 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73572) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 11:01:08 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:01:10 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 11:01:10 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:01:10 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73572) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 11:01:10 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73572) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 11:01:10 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73572) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 11:01:10 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:01:15 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 11:01:20 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 11:01:25 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:01:30 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:01:35 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:01:40 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:01:45 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:01:50 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:01:50 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:01:55 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 11:01:55 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:01:55 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73572) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 11:01:55 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73572) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 11:01:55 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73572) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 11:01:55 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:01:55 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:01:55 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Starting heal instance info cache {{(pid=73572) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 11:01:55 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Rebuilding the list of instances to heal {{(pid=73572) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 11:01:55 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquiring lock "refresh_cache-dcfbde2c-659b-4095-ba9b-35df887ec976" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 11:01:55 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquired lock "refresh_cache-dcfbde2c-659b-4095-ba9b-35df887ec976" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 11:01:55 user nova-compute[73572]: DEBUG nova.network.neutron [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] [instance: dcfbde2c-659b-4095-ba9b-35df887ec976] Forcefully refreshing network info cache for instance {{(pid=73572) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 11:01:55 user nova-compute[73572]: DEBUG nova.objects.instance [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lazy-loading 'info_cache' on Instance uuid dcfbde2c-659b-4095-ba9b-35df887ec976 {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:01:56 user nova-compute[73572]: DEBUG nova.network.neutron [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] [instance: dcfbde2c-659b-4095-ba9b-35df887ec976] Updating instance_info_cache with network_info: [{"id": "90c1e997-ee83-43a9-97ae-2e3033f819e2", "address": "fa:16:3e:a5:1f:21", "network": {"id": "052a8e12-a71a-4c35-8001-bd3093ecdc4f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1777132020-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "131418241f3f4a21a1e8a08a962a31c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90c1e997-ee", "ovs_interfaceid": "90c1e997-ee83-43a9-97ae-2e3033f819e2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:01:56 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Releasing lock "refresh_cache-dcfbde2c-659b-4095-ba9b-35df887ec976" {{(pid=73572) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 11:01:56 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] [instance: dcfbde2c-659b-4095-ba9b-35df887ec976] Updated the network info_cache for instance {{(pid=73572) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 11:01:56 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:02:00 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 11:02:00 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:02:00 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:02:00 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:02:00 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:02:00 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Auditing locally available compute resources for user (node: user) {{(pid=73572) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 11:02:00 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcfbde2c-659b-4095-ba9b-35df887ec976/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:02:01 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcfbde2c-659b-4095-ba9b-35df887ec976/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:02:01 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcfbde2c-659b-4095-ba9b-35df887ec976/disk --force-share --output=json {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:02:01 user nova-compute[73572]: DEBUG oslo_concurrency.processutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcfbde2c-659b-4095-ba9b-35df887ec976/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=73572) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:02:01 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 11:02:01 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 11:02:01 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Hypervisor/Node resource view: name=user free_ram=8763MB free_disk=25.087928771972656GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=73572) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 11:02:01 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:02:01 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:02:01 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Instance dcfbde2c-659b-4095-ba9b-35df887ec976 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73572) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 11:02:01 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73572) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 11:02:01 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73572) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 11:02:02 user nova-compute[73572]: DEBUG nova.compute.provider_tree [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Inventory has not changed in ProviderTree for provider: e2cec974-59b2-4c77-a53d-a7f4e5a30d75 {{(pid=73572) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 11:02:02 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Inventory has not changed for provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73572) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 11:02:02 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Compute_service record updated for user:user {{(pid=73572) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 11:02:02 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.237s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:02:03 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:02:03 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:02:04 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:02:04 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:02:05 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:02:07 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:02:07 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73572) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 11:02:10 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:02:10 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:02:15 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:02:20 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:02:25 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:02:30 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:02:34 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-dfd3b402-4754-4dd1-a13f-df8e54183d67 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Acquiring lock "dcfbde2c-659b-4095-ba9b-35df887ec976" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:02:34 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-dfd3b402-4754-4dd1-a13f-df8e54183d67 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Lock "dcfbde2c-659b-4095-ba9b-35df887ec976" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:02:34 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-dfd3b402-4754-4dd1-a13f-df8e54183d67 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Acquiring lock "dcfbde2c-659b-4095-ba9b-35df887ec976-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:02:34 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-dfd3b402-4754-4dd1-a13f-df8e54183d67 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Lock "dcfbde2c-659b-4095-ba9b-35df887ec976-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:02:34 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-dfd3b402-4754-4dd1-a13f-df8e54183d67 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Lock "dcfbde2c-659b-4095-ba9b-35df887ec976-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:02:34 user nova-compute[73572]: INFO nova.compute.manager [None req-dfd3b402-4754-4dd1-a13f-df8e54183d67 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] [instance: dcfbde2c-659b-4095-ba9b-35df887ec976] Terminating instance
Aug 26 11:02:34 user nova-compute[73572]: DEBUG nova.compute.manager [None req-dfd3b402-4754-4dd1-a13f-df8e54183d67 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] [instance: dcfbde2c-659b-4095-ba9b-35df887ec976] Start destroying the instance on the hypervisor. {{(pid=73572) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 11:02:34 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:02:34 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:02:34 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:02:34 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:02:34 user nova-compute[73572]: DEBUG nova.compute.manager [req-494cfa64-eca1-4e12-894d-cd7377fb07bd req-019653a1-12c7-4a2b-84c8-8703c0b3ff20 service nova] [instance: dcfbde2c-659b-4095-ba9b-35df887ec976] Received event network-vif-unplugged-90c1e997-ee83-43a9-97ae-2e3033f819e2 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:02:34 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-494cfa64-eca1-4e12-894d-cd7377fb07bd req-019653a1-12c7-4a2b-84c8-8703c0b3ff20 service nova] Acquiring lock "dcfbde2c-659b-4095-ba9b-35df887ec976-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:02:34 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-494cfa64-eca1-4e12-894d-cd7377fb07bd req-019653a1-12c7-4a2b-84c8-8703c0b3ff20 service nova] Lock "dcfbde2c-659b-4095-ba9b-35df887ec976-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:02:34 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-494cfa64-eca1-4e12-894d-cd7377fb07bd req-019653a1-12c7-4a2b-84c8-8703c0b3ff20 service nova] Lock "dcfbde2c-659b-4095-ba9b-35df887ec976-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:02:34 user nova-compute[73572]: DEBUG nova.compute.manager [req-494cfa64-eca1-4e12-894d-cd7377fb07bd req-019653a1-12c7-4a2b-84c8-8703c0b3ff20 service nova] [instance: dcfbde2c-659b-4095-ba9b-35df887ec976] No waiting events found dispatching network-vif-unplugged-90c1e997-ee83-43a9-97ae-2e3033f819e2 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:02:34 user nova-compute[73572]: DEBUG nova.compute.manager [req-494cfa64-eca1-4e12-894d-cd7377fb07bd req-019653a1-12c7-4a2b-84c8-8703c0b3ff20 service nova] [instance: dcfbde2c-659b-4095-ba9b-35df887ec976] Received event network-vif-unplugged-90c1e997-ee83-43a9-97ae-2e3033f819e2 for instance with task_state deleting. {{(pid=73572) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 11:02:35 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:02:35 user nova-compute[73572]: INFO nova.virt.libvirt.driver [-] [instance: dcfbde2c-659b-4095-ba9b-35df887ec976] Instance destroyed successfully.
Aug 26 11:02:35 user nova-compute[73572]: DEBUG nova.objects.instance [None req-dfd3b402-4754-4dd1-a13f-df8e54183d67 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Lazy-loading 'resources' on Instance uuid dcfbde2c-659b-4095-ba9b-35df887ec976 {{(pid=73572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:02:35 user nova-compute[73572]: DEBUG nova.virt.libvirt.vif [None req-dfd3b402-4754-4dd1-a13f-df8e54183d67 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T10:54:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1144350221',display_name='tempest-SnapshotDataIntegrityTests-server-1144350221',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1144350221',id=53,image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIwJiwCjKebPGrSIiVHMkFvOZcRMRfLCj+LXfvjHn8GONSUSdFFQb6Y1tP+r19OggZ9ZVV5zsF/oQ0zQVYOFobrMyTPA/XqnC3zalEYxeqHQDbaNhP+5eJd+4uUhQS+SwA==',key_name='tempest-keypair-886884209',keypairs=<?>,launch_index=0,launched_at=2023-08-26T10:54:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='131418241f3f4a21a1e8a08a962a31c9',ramdisk_id='',reservation_id='r-v3mnttfm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='299da0c9-e1c4-48f0-be55-fbe20dd06bc9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-479992689',owner_user_name='tempest-SnapshotDataIntegrityTests-479992689-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T10:54:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='09fbaed1c8d3472fbf649238cbabb508',uuid=dcfbde2c-659b-4095-ba9b-35df887ec976,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "90c1e997-ee83-43a9-97ae-2e3033f819e2", "address": "fa:16:3e:a5:1f:21", "network": {"id": "052a8e12-a71a-4c35-8001-bd3093ecdc4f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1777132020-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "131418241f3f4a21a1e8a08a962a31c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90c1e997-ee", "ovs_interfaceid": "90c1e997-ee83-43a9-97ae-2e3033f819e2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 11:02:35 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-dfd3b402-4754-4dd1-a13f-df8e54183d67 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Converting VIF {"id": "90c1e997-ee83-43a9-97ae-2e3033f819e2", "address": "fa:16:3e:a5:1f:21", "network": {"id": "052a8e12-a71a-4c35-8001-bd3093ecdc4f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1777132020-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "131418241f3f4a21a1e8a08a962a31c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90c1e997-ee", "ovs_interfaceid": "90c1e997-ee83-43a9-97ae-2e3033f819e2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 11:02:35 user nova-compute[73572]: DEBUG nova.network.os_vif_util [None req-dfd3b402-4754-4dd1-a13f-df8e54183d67 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a5:1f:21,bridge_name='br-int',has_traffic_filtering=True,id=90c1e997-ee83-43a9-97ae-2e3033f819e2,network=Network(052a8e12-a71a-4c35-8001-bd3093ecdc4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90c1e997-ee') {{(pid=73572) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 11:02:35 user nova-compute[73572]: DEBUG os_vif [None req-dfd3b402-4754-4dd1-a13f-df8e54183d67 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a5:1f:21,bridge_name='br-int',has_traffic_filtering=True,id=90c1e997-ee83-43a9-97ae-2e3033f819e2,network=Network(052a8e12-a71a-4c35-8001-bd3093ecdc4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90c1e997-ee') {{(pid=73572) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 11:02:35 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:02:35 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap90c1e997-ee, bridge=br-int, if_exists=True) {{(pid=73572) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:02:35 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 11:02:35 user nova-compute[73572]: INFO os_vif [None req-dfd3b402-4754-4dd1-a13f-df8e54183d67 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a5:1f:21,bridge_name='br-int',has_traffic_filtering=True,id=90c1e997-ee83-43a9-97ae-2e3033f819e2,network=Network(052a8e12-a71a-4c35-8001-bd3093ecdc4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90c1e997-ee')
Aug 26 11:02:35 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-dfd3b402-4754-4dd1-a13f-df8e54183d67 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] [instance: dcfbde2c-659b-4095-ba9b-35df887ec976] Deleting instance files /opt/stack/data/nova/instances/dcfbde2c-659b-4095-ba9b-35df887ec976_del
Aug 26 11:02:35 user nova-compute[73572]: INFO nova.virt.libvirt.driver [None req-dfd3b402-4754-4dd1-a13f-df8e54183d67 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] [instance: dcfbde2c-659b-4095-ba9b-35df887ec976] Deletion of /opt/stack/data/nova/instances/dcfbde2c-659b-4095-ba9b-35df887ec976_del complete
Aug 26 11:02:35 user nova-compute[73572]: INFO nova.compute.manager [None req-dfd3b402-4754-4dd1-a13f-df8e54183d67 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] [instance: dcfbde2c-659b-4095-ba9b-35df887ec976] Took 0.89 seconds to destroy the instance on the hypervisor.
Aug 26 11:02:35 user nova-compute[73572]: DEBUG oslo.service.loopingcall [None req-dfd3b402-4754-4dd1-a13f-df8e54183d67 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73572) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 11:02:35 user nova-compute[73572]: DEBUG nova.compute.manager [-] [instance: dcfbde2c-659b-4095-ba9b-35df887ec976] Deallocating network for instance {{(pid=73572) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 11:02:35 user nova-compute[73572]: DEBUG nova.network.neutron [-] [instance: dcfbde2c-659b-4095-ba9b-35df887ec976] deallocate_for_instance() {{(pid=73572) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 11:02:36 user nova-compute[73572]: DEBUG nova.network.neutron [-] [instance: dcfbde2c-659b-4095-ba9b-35df887ec976] Updating instance_info_cache with network_info: [] {{(pid=73572) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:02:36 user nova-compute[73572]: INFO nova.compute.manager [-] [instance: dcfbde2c-659b-4095-ba9b-35df887ec976] Took 0.90 seconds to deallocate network for instance.
Aug 26 11:02:36 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-dfd3b402-4754-4dd1-a13f-df8e54183d67 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:02:36 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-dfd3b402-4754-4dd1-a13f-df8e54183d67 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:02:36 user nova-compute[73572]: DEBUG nova.compute.manager [req-1a3a7497-ef69-4c94-ab08-7fafcbdea3eb req-10d09940-96ab-4a6b-b458-b68a75088c0d service nova] [instance: dcfbde2c-659b-4095-ba9b-35df887ec976] Received event network-vif-deleted-90c1e997-ee83-43a9-97ae-2e3033f819e2 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:02:36 user nova-compute[73572]: DEBUG nova.compute.provider_tree [None req-dfd3b402-4754-4dd1-a13f-df8e54183d67 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Inventory has not changed in ProviderTree for provider: e2cec974-59b2-4c77-a53d-a7f4e5a30d75 {{(pid=73572) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 11:02:36 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-dfd3b402-4754-4dd1-a13f-df8e54183d67 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Inventory has not changed for provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73572) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 11:02:36 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-dfd3b402-4754-4dd1-a13f-df8e54183d67 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.240s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:02:36 user nova-compute[73572]: INFO nova.scheduler.client.report [None req-dfd3b402-4754-4dd1-a13f-df8e54183d67 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Deleted allocations for instance dcfbde2c-659b-4095-ba9b-35df887ec976
Aug 26 11:02:36 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-dfd3b402-4754-4dd1-a13f-df8e54183d67 tempest-SnapshotDataIntegrityTests-479992689 tempest-SnapshotDataIntegrityTests-479992689-project-member] Lock "dcfbde2c-659b-4095-ba9b-35df887ec976" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.248s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:02:36 user nova-compute[73572]: DEBUG nova.compute.manager [req-b21885b4-e3f1-4825-a913-9b099c567758 req-a1ca1aeb-e2a1-4027-8f84-5db7923b1578 service nova] [instance: dcfbde2c-659b-4095-ba9b-35df887ec976] Received event network-vif-plugged-90c1e997-ee83-43a9-97ae-2e3033f819e2 {{(pid=73572) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:02:36 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-b21885b4-e3f1-4825-a913-9b099c567758 req-a1ca1aeb-e2a1-4027-8f84-5db7923b1578 service nova] Acquiring lock "dcfbde2c-659b-4095-ba9b-35df887ec976-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:02:36 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-b21885b4-e3f1-4825-a913-9b099c567758 req-a1ca1aeb-e2a1-4027-8f84-5db7923b1578 service nova] Lock "dcfbde2c-659b-4095-ba9b-35df887ec976-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:02:36 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [req-b21885b4-e3f1-4825-a913-9b099c567758 req-a1ca1aeb-e2a1-4027-8f84-5db7923b1578 service nova] Lock "dcfbde2c-659b-4095-ba9b-35df887ec976-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:02:36 user nova-compute[73572]: DEBUG nova.compute.manager [req-b21885b4-e3f1-4825-a913-9b099c567758 req-a1ca1aeb-e2a1-4027-8f84-5db7923b1578 service nova] [instance: dcfbde2c-659b-4095-ba9b-35df887ec976] No waiting events found dispatching network-vif-plugged-90c1e997-ee83-43a9-97ae-2e3033f819e2 {{(pid=73572) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:02:36 user nova-compute[73572]: WARNING nova.compute.manager [req-b21885b4-e3f1-4825-a913-9b099c567758 req-a1ca1aeb-e2a1-4027-8f84-5db7923b1578 service nova] [instance: dcfbde2c-659b-4095-ba9b-35df887ec976] Received unexpected event network-vif-plugged-90c1e997-ee83-43a9-97ae-2e3033f819e2 for instance with vm_state deleted and task_state None.
Aug 26 11:02:40 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:02:45 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 11:02:50 user nova-compute[73572]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693047755.1815367, dcfbde2c-659b-4095-ba9b-35df887ec976 => Stopped> {{(pid=73572) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 11:02:50 user nova-compute[73572]: INFO nova.compute.manager [-] [instance: dcfbde2c-659b-4095-ba9b-35df887ec976] VM Stopped (Lifecycle Event)
Aug 26 11:02:50 user nova-compute[73572]: DEBUG nova.compute.manager [None req-4b38f8b5-7f4b-4c14-bfa5-6bef75d35a07 None None] [instance: dcfbde2c-659b-4095-ba9b-35df887ec976] Checking state {{(pid=73572) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:02:50 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:02:52 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:02:55 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 11:02:56 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:02:56 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Starting heal instance info cache {{(pid=73572) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 11:02:56 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Rebuilding the list of instances to heal {{(pid=73572) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 11:02:56 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Didn't find any instances for network info cache update. {{(pid=73572) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 26 11:02:56 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:03:00 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 11:03:00 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:03:00 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73572) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 11:03:00 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73572) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 11:03:00 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73572) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 11:03:00 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:03:01 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:03:01 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:03:01 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:03:01 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:03:01 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Auditing locally available compute resources for user (node: user) {{(pid=73572) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 11:03:02 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 11:03:02 user nova-compute[73572]: WARNING nova.virt.libvirt.driver [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 11:03:02 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Hypervisor/Node resource view: name=user free_ram=8916MB free_disk=25.11510467529297GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=73572) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 11:03:02 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:03:02 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:03:02 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73572) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 11:03:02 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73572) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 11:03:02 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Refreshing inventories for resource provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 {{(pid=73572) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 26 11:03:02 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Updating ProviderTree inventory for provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73572) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 26 11:03:02 user nova-compute[73572]: DEBUG nova.compute.provider_tree [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Updating inventory in ProviderTree for provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73572) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 26 11:03:02 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Refreshing aggregate associations for resource provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75, aggregates: None {{(pid=73572) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 26 11:03:02 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Refreshing trait associations for resource provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75, traits: COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSSE3,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE2,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NODE,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_NE2K_PCI {{(pid=73572) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 26 11:03:02 user nova-compute[73572]: DEBUG nova.compute.provider_tree [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Inventory has not changed in ProviderTree for provider: e2cec974-59b2-4c77-a53d-a7f4e5a30d75 {{(pid=73572) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 11:03:02 user nova-compute[73572]: DEBUG nova.scheduler.client.report [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Inventory has not changed for provider e2cec974-59b2-4c77-a53d-a7f4e5a30d75 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73572) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 11:03:02 user nova-compute[73572]: DEBUG nova.compute.resource_tracker [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Compute_service record updated for user:user {{(pid=73572) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 11:03:02 user nova-compute[73572]: DEBUG oslo_concurrency.lockutils [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.394s {{(pid=73572) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:03:03 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:03:04 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:03:04 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:03:05 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 11:03:08 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:03:08 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73572) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 11:03:10 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 11:03:10 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:03:15 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 11:03:20 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:03:23 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:03:23 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73572) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 26 11:03:25 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:03:25 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:03:29 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:03:30 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:03:32 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:03:35 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:03:36 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:03:36 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Cleaning up deleted instances {{(pid=73572) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 26 11:03:36 user nova-compute[73572]: DEBUG nova.compute.manager [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] There are 0 instances to clean {{(pid=73572) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 26 11:03:40 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:03:43 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:03:45 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 11:03:50 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 11:03:52 user nova-compute[73572]: DEBUG oslo_service.periodic_task [None req-9cc73f72-2e5a-4913-9ce3-b6c12ace6f23 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73572) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:03:55 user nova-compute[73572]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73572) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}